JP4963642B2 - Information processing apparatus, information processing system, and information processing method - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing system, an information processing method , a program, and a recording medium .

  In recent years, due to the digitization and networking of various devices, individual devices operate in cooperation with each other. Thus, a system in which devices operate in cooperation with each other can perform processing that cannot be realized by a single device. On the other hand, when a cooperative operation is performed between a plurality of devices, the user needs to input and set a large number of operations, and the operation becomes complicated.

  In response to such a tendency, there has been proposed a technique aimed at improving the operability when a cooperative operation is performed between apparatuses. For example, Patent Document 1 discloses a mail transmission system for easily transmitting text data created in advance by a PC or PDA as an e-mail using a cell phone mail service as a technique for improving the cooperation between apparatuses. Yes.

JP 2003-101661 A

However, the above-described conventional technology is not a technology that can be generally used during device cooperation. Also, as a method of device cooperation between a PC and a mobile phone, the user needs to input a key code for controlling the mobile phone on the PC, and the convenience of operation is impaired.
The present invention has been made in view of the above-described problems, and an object thereof is to allow a user to easily and easily operate a system in which a plurality of devices operate in cooperation.

An information processing apparatus according to the present invention includes a task information stored in a terminal device that is executed in response to a user operation, and input information that is input to an input part of an input screen related to the task. and user operation information acquisition means for acquiring user operation information for the operation, on the basis of the acquired task information in the user operation information acquiring unit, an input screen according to tasks performed in response to the user operation on the display device Screen display processing means for displaying and input reflecting means for displaying the input value input to the input portion of the input screen displayed in the screen display processing means based on the input information acquired in the user operation information acquiring means and having a, the.

An information processing method according to the present invention includes a task information stored in a terminal device for a task executed in response to a user operation, and input information input to an input part of an input screen related to the task. Based on the user operation information acquisition step in which the user operation information acquisition means acquires user operation information related to the operation, and the task information acquired in the user operation information acquisition step, the display device is executed according to the user operation Based on the screen display processing step in which the image display processing means displays the input screen related to the task and the input information acquired in the user operation information acquisition step, the input portion of the input screen displayed in the screen display processing step And an input reflecting step in which the input reflecting means displays the input value that has been input .

An information processing system according to the present invention is an information processing system including a terminal device and an information processing device capable of communicating with the terminal device, wherein the terminal device is task information of a task executed in response to a user operation. And storage processing means for storing user operation information related to a user operation including the input information input to an input part of the input screen related to the task , wherein the information processing apparatus stores the information in the terminal device display and user operation information acquiring unit, an input screen based on the obtained task information in the user operation information obtaining means, according to the tasks performed in response to the user operation on the display device that acquires user operation information Based on the input information acquired by the screen display processing means and the user operation information acquisition means. An input reflecting means for displaying the input values input to the input portion of the input screen has, and having a.

  The present invention may be a program or a storage medium.

  According to the present invention, in a system in which a plurality of devices operate in cooperation, a user can easily operate and easily operate.

Embodiments according to the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing system. The information processing system 1 includes a terminal device 2 and an information processing device 3. The terminal device 2 and the information processing device 3 are connected via wired or wireless communication, and can transmit and receive data. That is, the terminal device 2 and the information processing device 3 can communicate with each other. The terminal device 2 is, for example, a mobile phone, a digital camera, or a personal information terminal device. The information processing apparatus 3 is, for example, a digital copying machine, an ink jet composite copying machine, or a digital television display device.

The terminal device 2 includes a user interface device 10, a communication device 13, a central processing unit 14, and a memory 15. The user interface device 10 includes a display device 11 and an input device 12.
The display device 11 is a liquid crystal display or the like. The display device 11 displays an input screen related to a task. The input device 12 is an operation button or the like. A user can perform user operations on the terminal device 2 via the input device 12 to input information. The communication device 13 is a connection interface such as an antenna that can perform wireless communication. The central processing unit 14 is a CPU and controls the entire terminal device 2. The memory 15 is a storage device such as a ROM, a RAM, a hard disk, and a removable storage medium. The memory 15 stores an application (program) that can perform a task desired by the user, user operation information of a user operation input through the input device 12, and the like.

The information processing device 3 includes a user interface device 20, a communication device 23, a central processing unit 24, a memory 25, and a connection detection device 26 that detects a connection instruction from the terminal device 2. . The user interface device 20 includes a display device 21 and an input device 22.
The display device 21 is a liquid crystal display or the like. The display device 21 displays an input screen related to a task. The input device 22 is a keyboard, a mouse, a touch panel display, or the like. The user can input information to the information processing device 3 via the input device 22 and give an instruction. The communication device 23 is a connection interface such as an antenna that can perform wireless communication. The central processing unit 24 is a CPU and controls the entire information processing apparatus 3. The memory 25 is a storage device such as a ROM, RAM, or hard disk. The memory 25 stores an application that is the same as or related to an application that can perform a desired task stored in the memory 15 of the terminal device 2, user operation information acquired by a user operation information acquisition unit described later, and the like. Is done. The connection detection device 26 which is an example of the connection detection means is a sensor, and detects a connection instruction from the terminal device 2 by the user. Note that this communication instruction may be detected by the communication device 23.

  FIG. 2 is a diagram illustrating an example of functional configurations of the terminal device and the information processing device. The terminal device 2 includes a terminal storage processing unit 16 and a terminal display control unit 17 as its functional configuration. The terminal storage processing unit 16 performs processing of recording information (contents) related to user operations performed by the user via the input device 12 in the memory 15 as user operation information in the terminal device 2. The terminal display control unit 17 controls the display device 11 to display an input screen such as a GUI (Graphical User Interface) related to a task according to a user operation. Note that the functions described above are realized by the central processing unit 14 executing a program stored in the memory 15.

  The information processing apparatus 3 includes a user operation information acquisition unit 27, a user operation information storage processing unit 28, a display control unit 29, and an input detection unit 33 as functional configurations. The user operation information acquisition unit 27, which is an example of a user operation information acquisition unit, performs processing for acquiring user operation information stored in the memory 15 of the terminal device 2 via the communication device 23. The user operation information storage processing unit 28, which is an example of a storage processing unit, performs a process of storing the user operation information acquired by the user operation information acquisition unit 27 in the memory 25. A display control unit 29, which is an example of a display control unit, controls display via the display device 21. The display control unit 29 has a screen display processing unit 31 and an input reflection unit 32. A screen display processing unit 31, which is an example of a screen display processing unit, controls the display device 21 to display an input screen such as a GUI based on user operation information. The input reflection unit 32, which is an example of an input reflection unit, performs control to display an input value on an input portion of an input screen displayed on the display device 21 based on user operation information. The input detection unit 33 detects an input by the user via the input device 22. Note that the functions described above are realized by the central processing unit 24 executing a program stored in the memory 25.

FIG. 3 is a flowchart illustrating an example of operation processing of the terminal device. This flowchart is started when the terminal device 2 is powered on by the user.
In step S201, the terminal storage processing unit 16 provides a memory area called User_Operation in the memory 25, for example. The terminal storage processing unit 16 performs processing for blanking the contents of the provided memory area.

Next, in step S202, the terminal storage processing unit 16 determines whether a user operation has been performed. Here, the user operation includes two operations. The first operation (first operation) is an operation for starting an application capable of executing a task desired by the user. The terminal display control unit 17 of the terminal device 2 displays an input screen using a GUI on the display device 11 in accordance with the application activated by the first user operation. This input screen includes an input part where the user can actually input characters and the like. The second operation (second operation) is an input operation performed by the user via the input device 12 on the input site displayed on the display device 11.
When the user operation is performed, the terminal storage processing unit 16 advances the process to step S203. If no user operation has been performed, the terminal storage processing unit 16 determines again in step S202 whether or not a user operation has been performed.

  In step S203, the terminal storage processing unit 16 stores the contents of the user operation in the memory area User_Operation. Here, the content of the user operation stored in the memory area User_Operation is referred to as user operation information. The user operation information includes information of an application started to perform a task desired by the user (hereinafter referred to as task information), an input value input to an input part of the input screen (hereinafter referred to as input information), Is included. Note that the task information may be information regarding processing actually performed by the user in the activated application.

  Next, in step S204, the terminal display control unit 17 performs display on the display device 11 in accordance with a user operation. In the case of the first user operation, as described above, the terminal display control unit 17 displays an input screen including a GUI input part on the display device 11 in accordance with the application executed by the first user operation. In the case of the second user operation, the content of the input through the input device 12 is reflected by the user, and the input value is displayed on the input part.

Next, in step S205, the terminal storage processing unit 16 determines whether or not the user has instructed the power to the terminal device 2 to be turned on again, or has been instructed by the user to return the terminal device 2 to the initial state in the predetermined specification. Determine whether. When instructed, the terminal storage processing unit 16 advances the processing to step S206. If no instruction is given, the terminal storage processing unit 16 returns the process to step S202.
In step S206, the terminal storage processing unit 16 leaves the memory area User_Operation blank.
Next, in step S207, the terminal storage processing unit 16 changes the display on the display device 11 to the initial state, and returns the process to step S202.

FIG. 4 is a flowchart illustrating an example of operation processing of the information processing apparatus. This flowchart is started when the information processing apparatus 3 is turned on by the user.
In step S211, the user operation information acquisition unit 27 determines whether the connection detection device 26 of the information processing device 3 has detected a connection instruction from the terminal device 2 by the user. If detected, the user operation information acquisition unit 27 advances the process to step S212. If not detected, the user operation information acquisition unit 27 returns the process to step S211.

  In step S <b> 212, the user operation information acquisition unit 27 performs a process of acquiring user operation information stored in the memory area User_Operation of the memory 15 of the terminal device 2. More specifically, the user operation information acquisition unit 27 acquires the user operation information transmitted from the terminal device 2 via the communication device 13 by the communication device 23. Note that the user operation information acquisition unit 27 may acquire the user operation information by reading it through the connection detection device 26. Subsequently, the user operation information storage processing unit 28 stores the user operation information acquired by the user operation information acquisition unit 27 in the memory 25.

Next, in step S213, the screen display processing unit 31 of the display control unit 29 starts an application that is the same as or related to the task information based on the task information included in the user operation information stored in the memory 25, It is displayed on the display device 21. The screen display processing unit 31 displays a GUI input screen on the display device 21 according to the application. This input screen includes an input part where characters and the like can be actually input by the user.
Next, in step S <b> 214, the input reflection unit 32 of the display control unit 29 sets the input part displayed on the display device 21 to the terminal device 2 based on the input information of the user operation information stored in the memory 25. The input value input to the display is reflected.

  As described above, according to the first embodiment, the display control unit 29 of the information processing device 3 performs the task executed on the display device 21 according to the user operation based on the acquired user operation information. The input value input to the input screen and the input part of the input screen are displayed. Therefore, the user does not need to perform a duplicate user operation in the information processing apparatus 3, and thus the user operation can be easily performed for a task desired by the user.

(Second Embodiment)
FIG. 5 is a diagram showing an example in which the information processing system is applied to a system including a mobile phone and a digital copying machine. An information processing system 4 shown in FIG. 5 is a system in which the terminal device 2 is applied to a mobile phone 5 and the information processing device 3 is applied to a digital copying machine 6. In FIG. 5, the display device 11 of the terminal device 2 is a liquid crystal display unit of the mobile phone 5. The input device 12 of the terminal device 2 is an operation button of the mobile phone 5. Further, the mobile phone 5 incorporates, as the communication device 13, a connection interface using, for example, BlueTooth (TM), a wireless IC tag, and software called a response application.
In FIG. 5, the display device 21 and the input device 22 of the information processing device 3 are configured by a touch panel liquid crystal display device. The digital copying machine 6 incorporates software called a connection interface, an IC tag sensor, and a UI controller as a connection detection device 26 that detects a connection instruction from a user.

  FIG. 6 is a flowchart showing an example of operation processing of the information processing system including the mobile phone and the digital copying machine according to the second embodiment. In the description of this flowchart, in order for a user to send an e-mail using a mobile phone, an application that executes a task related to e-mail transmission is activated, and an e-mail destination address (destination), a subject, an e-mail text, etc. are input to some extent. Processing when the user instructs the digital copying machine 6 to connect without sending the mail to the other party in the mobile phone 5 will be described.

  In step S <b> 401, the terminal storage processing unit 16 of the mobile phone 5 stores the user operation information of the user operation in the memory area User_Operation in the memory 15. The user operation information here is task information indicating that an application for executing a task related to mail transmission is started. Furthermore, as the user operation information here, input information (destination information) input to an input part for inputting a destination, input information (subject information) input to an input part for inputting a subject, and input for inputting a body text This is input information (text information) input to the part. Note that the user operation information may be task information indicating that an application is started and a task for creating a mail text is started.

  Next, in step S402, the user operation information acquisition unit 27 of the digital copying machine 6 detects whether or not the tag sensor or the like as the connection detection device 26 has detected a connection instruction (that is, detects a tag embedded in the mobile phone 5). Whether or not). If it is detected, the user operation information acquisition unit 27 advances the process to step S403. If not detected, the user operation information acquisition unit 27 returns the process to step S401. The connection detection device 26 may detect the connection instruction by the following method. That is, the terminal storage processing unit 16 writes connection instruction information to the tag embedded in the mobile phone 5 in response to a user operation. When the user brings the tag (mobile phone 5) in which the connection instruction information is written close to the connection detection device 26, the connection detection device 26 of the digital copying machine 6 reads the tag embedded in the mobile phone 5. When the connection instruction information is included in the tag, the user operation information acquisition unit 27 determines that the connection instruction by the user has been detected. If the tag does not include connection instruction information, the user operation information acquisition unit 27 determines that a connection instruction by the user has not been detected.

  In step S403, the user operation information acquisition unit 27 of the digital copying machine 6 performs a process of acquiring user operation information stored in the memory area User_Operation of the memory 15 of the mobile phone 5 via the communication device 23 or the like. Subsequently, the user operation information storage processing unit 28 stores the user operation information acquired by the user operation information acquisition unit 27 in the memory 25.

  Next, in step S <b> 404, the user operation information acquisition unit 27 of the digital copying machine 6 determines an application activated by the user on the mobile phone 5 based on the task information included in the acquired user operation information. In the example of the present embodiment, the user operation information acquisition unit 27 determines that the application activated by the user on the mobile phone 5 is an email transmission application.

Next, in step S405, the screen display processing unit 31 of the digital copying machine 6 performs the mail transmission that is the same as or related to the determined application based on the task information included in the user operation information stored in the memory 25. Start the application. The screen display processing unit 31 displays a mail input screen by GUI on the display device 21 according to the application. This e-mail input screen includes input parts such as “destination”, “subject”, and “e-mail text” where the user can actually input characters and the like.
Next, in step S 406, the input reflection unit 32 of the digital copying machine 6 displays “destination” “subject” displayed on the display device 21 based on the input information included in the user operation information stored in the memory 25. The input value is reflected in the input part such as “mail body” and displayed.

Next, in step S407, the input detection unit 33 of the digital copying machine 6 inputs the input parts such as “destination”, “subject”, “mail body”, and the like displayed on the display device 21 by the user. It is determined whether or not. When input is performed, the input detection unit 33 advances the process to step S408. If it is determined that no input has been made, the input detection unit 33 returns the process to step S407 again.
In step S <b> 408, the input reflection unit 32 of the digital copying machine 6 reflects and displays the input value detected by the input detection unit 33 on the input part displayed on the display device 21.

  FIG. 7 is a diagram showing an example of a screen displayed on the display device of the mobile phone and the digital copying machine by the operation processing of the information processing system including the mobile phone and the digital copying machine according to the second embodiment. In the display device 11 of the mobile phone 5 in FIG. 7, the terminal display control unit 17 displays a task input screen 18 relating to mail transmission. Further, the terminal display control unit 17 displays an input value for the input part 19 by the user. In the display device 21 of the digital copying machine of FIG. 7, the screen display processing unit 31 displays an input screen 34 of an application related to mail transmission that is the same as the application related to mail transmission activated in the mobile phone 5. The input reflecting unit 32 displays the input value input to the input part 19 displayed on the display device 11 of the mobile phone 5.

  Here, FIG. 8 shows an example of user operation information data stored in the memory area User_Operation in the memory of the terminal device. FIG. 8 is a diagram illustrating an example of user operation information when a user activates an application that executes a task related to mail transmission in the terminal device 2. 41 is task information which is one of user operation information. In the task information 41, “SendEmail” is described. This description indicates that the user has started an application that executes a task related to mail transmission. 42 to 44 are input information which is one of user operation information. The input information 42 describes a destination. The input information 43 describes the subject. The input information 44 describes the mail text. In FIG. 5, the data structure format described in XML (extensible Markup Language) format is displayed, but the structured data description method is not limited to this format. Note that the information processing device 3 may determine the user operation information based on the User_Operation, and may also perform the structuring in the intermediate processing when the information is reflected on the display device 21.

  As described above, according to the second embodiment, after the user performs input for mail transmission on the mobile phone 5, the user can continue to input for mail transmission also on the digital copying machine 6. . Therefore, since the user can perform a desired task operation with either the mobile phone 5 or the digital copying machine 6, it is possible to perform a simple operation by performing the user operation on the desired apparatus.

  Here, the mobile phone 5 is often used exclusively by one user. Therefore, it is considered that the user is proficient in inputting a mail text or the like on the mobile phone 5. On the other hand, the digital copying machine 6 has various functions. For example, assume that the digital copying machine 6 has a scanning function. In such a case, the user creates an e-mail text or the like on the mobile phone 5 that is familiar. Thereafter, the user can continue to create a mail text in the digital copying machine 6. Further, the user can perform an operation of scanning the document image via the scanning function of the digital copying machine 6 and sending it to the other party as an e-mail attachment.

  Note that the effects according to the present embodiment are not limited to whether the user is familiar with the mobile phone 5 or whether the digital copying machine 6 has a specific function such as a scan function. In other words, the effect according to the present embodiment is not only to provide a technology that enables the mobile phone 5 to create a mail in the digital copying machine 6. That is, according to the present embodiment, the operation started by a user (first device) can be continued in another device (second device) instructed by the user to connect. Therefore, the user does not need to input the same content as the input in the first device in the second device, and the operability can be improved.

(Third embodiment)
FIG. 9 is a flowchart showing an example of operation processing of the information processing system including the mobile phone and the digital copying machine according to the third embodiment. In the explanation of this flowchart, the user activates an application for executing a task related to browsing digital photos on the mobile phone 5 and inputs check marks for distinguishing from other digital photos to some of the plurality of digital photos being browsed. To do. Processing when the user issues a connection instruction to the digital copying machine 6 with a check mark added will be described.

  In step S <b> 701, the terminal storage processing unit 16 of the mobile phone 5 records the user operation information of the user operation in the memory area User_Operation in the memory 25. Here, the user operation information is task information indicating that an application for executing a task related to browsing digital photographs is started. Furthermore, as the user operation information here, the displayed digital photograph No. This is input information based on an operation of adding a check mark to the check mark column of XXX.

  Next, in step S702, the user operation information acquisition unit 27 of the digital copying machine 6 determines whether the tag sensor or the like as the connection detection device 26 has detected a connection instruction from the mobile phone 5 by the user (that is, the mobile phone 5). It is determined whether or not a tag embedded in is detected. If detected, the user operation information acquisition unit 27 advances the process to step S703. If not detected, the user operation information acquisition unit 27 returns the process to step S701.

  In step S <b> 703, the user operation information acquisition unit 27 of the digital copying machine 6 performs a process of acquiring user operation information stored in the memory area User_Operation of the memory 15 of the mobile phone 5 via the communication device 23 or the like. Subsequently, the user operation information storage processing unit 28 stores the user operation information acquired by the user operation information acquisition unit 27 in the memory 25.

  In step S <b> 704, the user operation information acquisition unit 27 of the digital copying machine 6 determines an application that has been started on the mobile phone 5 based on the task information included in the acquired user operation information. In the example of the embodiment, the user operation information acquisition unit 27 determines that the application activated by the user on the mobile phone 5 is an application for browsing a digital photograph.

Next, in step S <b> 705, the screen display processing unit 31 of the digital copying machine 6 selects a digital photograph that is the same as or related to the determined application based on the task information included in the user operation information stored in the memory 25. Start the application to browse. The screen display processing unit 31 displays a digital photo browsing screen using a GUI on the display device 21 in accordance with the application. The digital photo browsing screen includes a check mark field as an input part.
Next, in step S <b> 706, the user operation information acquisition unit 27 acquires digital photograph data that the user is browsing on the mobile phone 5, or at least a thumbnail image having a size sufficient for screen display. The screen display processing unit 31 displays the digital image acquired by the user operation information acquisition unit 27.

  Next, in step S707, the input reflection unit 32 of the digital copying machine 6 checks the check mark column displayed on the display device 21 based on the input information included in the user operation information stored in the memory 25. Is reflected and displayed.

In step S <b> 708, the input detection unit 33 of the digital copying machine 6 determines whether or not a check mark has been input by the user in the check mark field displayed on the display device 21. When input is performed, the input detection unit 33 advances the processing to step S709. If it is determined that no input has been made, the input detection unit 33 returns the process to step S708 again.
In step S 709, the input reflection unit 32 of the digital copying machine 6 reflects and displays the input value (check mark) detected by the input detection unit 33 in the check mark column displayed on the display device 21.

  FIG. 10 is a diagram showing an example of a screen displayed on the display device of the mobile phone and the digital copying machine by the operation process of the information processing system including the mobile phone and the digital copying machine. In the display device 11 of the mobile phone 5 in FIG. 10, the terminal display control unit 17 displays a digital photo browsing screen 34. In addition, the terminal display control unit 17 displays a check mark 36 in the check mark field 35. In the display device 21 of the digital copying machine 6 in FIG. 10, the screen display processing unit 31 performs a digital photo browsing screen in accordance with an application that is the same as or related to the digital photo browsing application started in the mobile phone 5 based on the task information. 37 is displayed. The input reflecting unit 32 reflects the check mark 36 displayed in the check mark field 35 of the display device 11 of the mobile phone 5 based on the input information, and displays the check mark 39 in the check mark field 38. . The digital copying machine has a printing function. The display control unit 29 displays a print setting screen 40 for printing a digital photo with a check mark 39 in the vicinity of the digital photo browsing screen 37 displayed on the display device 21.

  According to the third embodiment, the display control unit 29 checks the digital photograph displayed on the digital copying machine 6 based on the input information after the user places a check mark on the digital photograph displayed on the mobile phone 5. Reflect the mark. Therefore, the user can perform an instruction operation such as printing only a digital photograph with a check mark or an instruction operation such as laying out only a digital photograph with a check mark on one sheet.

  The user can remove the check mark 36 attached to the mobile phone 5 from the check mark field 35 of the digital photograph displayed on the display device 21 of the digital copying machine 6. Further, the user can add a check mark to the check mark column 35 of the digital photograph that has not been checked.

  Further, according to the third embodiment, the user attaches a check mark 36 to a digital image desired to be printed by the digital copying machine 6 while moving, and remotely instructs the digital copying machine 6 to connect. When the digital copying machine 6 is moved to the installation location, it is possible to instruct the printing output of a digital image with a check mark. In this way, the user can reduce the time for obtaining the print output result by performing the user operation within the movement time, or can occupy the digital copying machine 6 as the shared device for a long time. Can be avoided.

  Thus, according to the above-described embodiment, a user operation for a task desired by the user can be easily performed.

In the second and third embodiments, the case where the mobile phone 5 is applied to the terminal device 2 and the digital copying machine 6 is applied to the information processing device 3 has been described. However, the present invention is not limited to this. The roles of the devices that make up the information processing system may alternate within a single task embodiment.
Moreover, in the information processing system according to the embodiment of the present invention, the terminal device and the information processing device are not only configured by a single device, but either one or both may be configured by a plurality of device groups. Good.

  Each unit constituting the information processing apparatus and the information processing system and each step of the information processing method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable recording medium on which the program is recorded are included in the present invention.

  Further, the present invention can be implemented as, for example, a system, apparatus, method, program, or recording medium, and may be applied to an apparatus composed of a single device.

  The present invention supplies a software program for realizing the functions of the above-described embodiments directly or remotely to a system or apparatus. In addition, this includes a case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention. In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a recording medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

It is a figure which shows an example of the hardware constitutions of an information processing system. It is a figure which shows an example of a function structure of an information processing system. It is a flowchart which shows an example of the operation | movement process of a terminal device. It is a flowchart which shows an example of the operation processing of information processing apparatus. It is a figure which shows an example which applied the information processing system which concerns on 2nd Embodiment to the system containing a mobile telephone and a digital copying machine. 10 is a flowchart illustrating an example of operation processing of an information processing system including a mobile phone and a digital copying machine according to a second embodiment. It is a figure which shows an example of the screen displayed on the display apparatus of the mobile telephone and digital copying machine which concern on 2nd Embodiment. It is a figure which shows an example of the data as user operation information. 10 is a flowchart illustrating an example of operation processing of an information processing system including a mobile phone and a digital copying machine according to a third embodiment. It is a figure which shows an example of the screen displayed on the display apparatus of the mobile telephone and digital copying machine which concern on 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing system 2 Terminal device 3 Information processing device 10 User interface device 11 Display device 12 Input device 13 Communication device 14 Central processing unit 15 Memory 16 Terminal storage processing unit 17 Terminal display control unit 20 User interface device 21 Display device 22 Input device DESCRIPTION OF SYMBOLS 23 Communication apparatus 24 Central processing unit 25 Memory 26 Connection detection apparatus 27 User operation information acquisition part 28 User operation information storage process part 29 Display control part 31 Screen display process part 32 Input reflection part 33 Input detection part

Claims (7)

Acquisition of user operation information related to a user operation including task information of a task executed in response to a user operation stored in the terminal device and input information input to an input part of an input screen related to the task User operation information acquisition means for
Screen display processing means for displaying an input screen relating to a task executed in response to the user operation on a display device based on the task information acquired by the user operation information acquisition means ;
Based on the input information acquired by the user operation information acquisition means, an input reflecting means for displaying the input value input to the input part of the input screen displayed by the screen display processing means;
An information processing apparatus comprising: Connection detecting means for detecting a connection instruction;
A storage processing unit that stores user operation information related to a user operation stored in the terminal device in a storage device when a connection instruction is detected in the connection detection unit;
The information processing apparatus according to claim 1 , further comprising: An information processing system including a terminal device and an information processing device capable of communicating with the terminal device,
The terminal device
Storage processing means for storing user operation information related to a user operation including task information of a task executed in response to a user operation and input information input to an input part of an input screen related to the task; ,
The information processing apparatus includes:
User operation information acquisition means for acquiring user operation information stored in the terminal device;
Screen display processing means for displaying an input screen relating to a task executed in response to the user operation on a display device based on the task information acquired by the user operation information acquisition means ;
Based on the input information acquired by the user operation information acquisition means, an input reflecting means for displaying the input value input to the input part of the input screen displayed by the screen display processing means;
An information processing system comprising: The user operation information related to the user operation including the task information of the task executed in response to the user operation stored in the terminal device and the input information input to the input part of the input screen related to the task is stored as the user. A user operation information acquisition step acquired by the operation information acquisition means;
Based on the task information acquired in the user operation information acquisition step, a screen display processing step in which an image display processing unit displays an input screen related to a task executed in response to the user operation on a display device ;
Based on the input information acquired in the user operation information acquisition step, the input reflection step in which the input reflection means displays the input value input to the input part of the input screen displayed in the screen display processing step;
An information processing method in an information processing apparatus characterized by comprising: A connection detection step in which the connection detection means detects the connection instruction;
When a connection instruction is detected in the connection detection step, a storage processing step in which storage processing means stores user operation information related to a user operation stored in the terminal device in a storage device;
The information processing method according to claim 4 , further comprising: The user operation information related to the user operation including the task information of the task executed in response to the user operation stored in the terminal device and the input information input to the input part of the input screen related to the task is stored as the user. A user operation information acquisition step acquired by the operation information acquisition means;
Based on the task information acquired in the user operation information acquisition step, a screen display processing step in which an image display processing unit displays an input screen related to a task executed in response to the user operation on a display device ;
Based on the input information acquired in the user operation information acquisition step, the input reflection step in which the input reflection means displays the input value input to the input part of the input screen displayed in the screen display processing step;
A program that causes a computer to execute. A computer-readable recording medium on which the program according to claim 6 is recorded.

Images