JP6601078B2 - System, information processing apparatus, alarm control program, and alarm control method - Google Patents

Description

  The present invention relates to a system, an information processing apparatus, an alarm control program, and an alarm control method.

  Conventionally, at city halls and ward offices, depending on the time of the next office and the time of the next office, the window may be crowded, and the next person may wait for a long time. For this reason, for example, it is desired to reduce the waiting time of the next agency by facilitating the work at the window and improving the efficiency.

  As prior art, there is one that assists the user in maintaining a correct posture. Specifically, for example, it is determined whether or not the user is using the mobile terminal in a correct posture by using at least one of the user's face image captured by the mobile terminal, the tilt angle of the mobile terminal, or a combination thereof. However, there are those that give a predetermined alarm when not used in the correct posture.

JP 2013-69286 A

  For example, at a government office, lending a tablet terminal to a visitor, and prior to proceeding at the counter, the visitor enters some information about the procedure during the waiting time, so that It may be possible to shorten the procedure time by reducing data entry. However, for example, it is difficult to provide an effective alarm for prompting data input to a user who does not realize that data should be input to the tablet terminal or who has neglected data input.

  In one aspect, the present invention provides a system, an information processing apparatus, an alarm control program, and an alarm control method for controlling the type of alarm when a predetermined alarm is output according to the state of the user. Objective.

  According to an aspect of the present invention, an information processing apparatus having a sensor that detects contact with the apparatus main body and an imaging camera, whether or not contact with the information processing apparatus is detected, and an image captured by the imaging camera. A system including an alarm control device that controls the type of alarm when a predetermined alarm is output from the information processing device according to a combination of whether or not a predetermined image is detected from the captured image. Is done.

  Further, according to one aspect of the present invention, whether or not contact with the apparatus main body is detected by a sensor included in the information processing apparatus, and predetermined image detection from the captured image captured by the imaging camera included in the information processing apparatus. An information processing device, an alarm control program, and an alarm control method are proposed for controlling the type of alarm when a predetermined alarm is output from the information processing device in accordance with a combination of whether or not the information is performed.

  According to one aspect of the present invention, there is an effect that the type of alarm when a predetermined alarm is output can be controlled according to the state of the user.

FIG. 1 is an explanatory diagram of an example of the alarm control method according to the first embodiment. FIG. 2 is an explanatory diagram of a system configuration example of the alarm control system 200 according to the second embodiment. FIG. 3 is a block diagram illustrating a hardware configuration example of the alarm control device 201. FIG. 4 is a block diagram illustrating a hardware configuration example of the terminal device Ti. FIG. 5 is an explanatory diagram showing an example of the contents stored in the lending management DB 220. FIG. 6 is an explanatory diagram illustrating a screen example of the top screen 600. FIG. 7 is an explanatory diagram illustrating a screen example of the life scene selection screen 700. FIG. 8 is a block diagram illustrating a functional configuration example of the alarm control device 201. FIG. 9 is an explanatory diagram illustrating an example of updating the storage contents of the lending management DB 220. FIG. 10 is a block diagram illustrating a functional configuration example of the terminal device Ti. FIG. 11 is an explanatory diagram illustrating an example of changing the display mode of the touch panel display 403. FIG. 12 is an explanatory diagram showing a screen example of the concierge screen 1200. FIG. 13 is a flowchart showing an alarm processing procedure of the terminal device Ti. FIG. 14 is a flowchart (part 1) illustrating an example of a specific processing procedure of the alarm output processing. FIG. 15 is a flowchart (part 2) illustrating an example of a specific processing procedure of the alarm output processing. FIG. 16 is a flowchart showing an alarm control processing procedure of the alarm control device 201. FIG. 17 is a flowchart (part 1) illustrating an example of a specific processing procedure of the alarm instruction transmission processing. FIG. 18 is a flowchart (part 2) illustrating an example of a specific process procedure of the alarm instruction transmission process.

  Exemplary embodiments of a system, an information processing apparatus, an alarm control program, and an alarm control method according to the present invention will be described below in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is an explanatory diagram of an example of the alarm control method according to the first embodiment. In FIG. 1, an information processing apparatus 100 is a computer that includes an imaging camera 110 and a display 120 and controls the type of alarm when a predetermined alarm is output. Specifically, the information processing apparatus 100 is, for example, a portable computer such as a tablet terminal or a smartphone that can be moved and operated by a user. Information processor 100 may be a wearable terminal which a user can wear and move and operate, for example.

  The predetermined alarm is an alarm for prompting the user to take some action. Examples of the predetermined alarm include an alarm for prompting data input and an alarm for prompting movement to a certain place. The type of alarm is a classification of alarms according to which user's senses prompt the action. The types of alarms include, for example, those that prompt action through vision, those that prompt action through tactile sense, those that prompt action through hearing, and those that prompt action through two or more senses of vision, touch, and hearing.

  Here, at city halls and ward offices, depending on the time of the next office and the time of the next office, the window may be crowded, and the next person may wait for a long time. For this reason, lending a tablet terminal to the next agency person at a general counter of the government office, etc., and before the procedure at the window, the next agency person inputs some information about the procedure during the waiting time, It is conceivable to shorten the procedure time by reducing the data input operation at the site.

  However, even if the tablet terminal is lent to the next agency, data input to the tablet terminal may not be performed smoothly. For example, when a visitor is talking to someone, you may not be aware that data should be entered into the tablet terminal prior to the procedure at the counter. In addition, some officials know that data should be entered, but they feel troublesome and neglect data entry.

  For this reason, it may be possible to prompt the data input by outputting an alarm from a tablet terminal to a person who has not completed data input. However, since the visiting agent who talks with someone often does not look at the tablet terminal, it is often not immediately noticed even if an alarm is displayed to prompt data entry.

  In addition, a visitor who is not familiar with the operation of a tablet terminal, such as an elderly person, cannot immediately understand how to operate the tablet terminal and may take time to input data. In such a case, it is not preferable to perform an alarm display for prompting data input, which will irritate the next agency.

  Therefore, in the present embodiment, an alarm control method for controlling the type of alarm when a predetermined alarm is output according to the state of the user with respect to the information processing apparatus 100 will be described. Hereinafter, a processing example of the information processing apparatus 100 will be described.

  (1) The information processing apparatus 100 determines whether contact with the apparatus main body is detected based on a detection result of a sensor that detects contact with the apparatus main body. Examples of the sensor that detects contact with the apparatus main body include a tactile sensor that detects contact with the grip portion of the information processing apparatus 100 and a touch panel display (for example, the display 120) that detects a touch operation.

  (2) The information processing apparatus 100 performs predetermined image detection from the captured image captured by the imaging camera 110. Here, the imaging camera 110 is provided on the front side (the display 120 side) of the information processing apparatus 100, and can photograph a user who is looking at the display 120, for example.

  The predetermined image detection is, for example, face detection or iris detection. Specifically, for example, the information processing apparatus 100 performs face detection from a captured image captured by the imaging camera 110 using existing techniques such as pattern recognition and machine learning. Thereby, the face image of a person located in front of the information processing apparatus 100 can be detected.

  (3) The information processing apparatus 100 determines a predetermined value depending on a combination of whether or not contact with the apparatus main body is detected and whether or not a predetermined image is detected from the captured image captured by the imaging camera 110. Controls the type of alarm when outputting an alarm. The predetermined alarm is, for example, an alarm for prompting data input.

  Here, if contact with the apparatus main body is not detected and predetermined image detection (for example, face detection) is not performed, the user is not touching the apparatus main body and is in front of the apparatus. It can be said that it is not located. In addition, the fact that the user is not located in front of the apparatus is highly likely that the user is not looking at the display 120.

  For this reason, the information processing apparatus 100 may perform control to output a predetermined alarm sound when, for example, contact with the terminal device is not detected and face detection is not performed. . The predetermined alarm sound may be, for example, a monotonous rhythm sound such as a buzzer sound, or may be a voice message that prompts data input.

  As a result, a user who does not hold the information processing apparatus 100 and does not look at the display 120 can be prompted to input data through the user's hearing. For example, when a user who has not completed data input does not have the information processing apparatus 100 and is sitting on a sofa or talking with someone, the user's hearing is stimulated by outputting an alarm sound. You can be reminded that you should enter data.

  Further, when contact with the apparatus main body is detected and predetermined image detection (for example, face detection) is not performed, the user is touching the apparatus main body, but is not positioned in front of the apparatus. It can be said that there is. In addition, the fact that the user is touching the apparatus main body is highly likely that the user has the information processing apparatus 100 in his / her hand.

  For this reason, the information processing apparatus 100 may perform control to vibrate a vibrator (not shown) when, for example, contact with the apparatus main body is detected and face detection is not performed. The vibrator is a vibrating device that is mounted on the information processing apparatus 100 and vibrates. When the vibrator vibrates, the apparatus main body can be vibrated.

  As a result, a user who has the information processing apparatus 100 in his hand but is not looking at the display 120 can be prompted to input data through the user's sense of touch. For example, when a user who has not completed data input holds the information processing apparatus 100 and is sitting on a sofa or talking to someone, the user can be stimulated by vibrating the apparatus body. You can notice that you should enter data. In addition, the vibration caused by the vibrator is less confused with the alarm for other people than the alarm sound, so that it is easy for the user to notice that the alarm is for him / herself. Furthermore, since vibration caused by the vibrator does not generate a loud sound, the user can be easily noticed without being surprised and it is difficult for other people to feel uncomfortable.

  If contact with the apparatus main body is not detected and predetermined image detection (for example, face detection) is performed, the user is not touching the apparatus main body, but is positioned in front of the apparatus. It can be said that it is in a state. In addition, being located in front of the apparatus is highly likely that the user is looking at the display 120 or the display 120 is in the field of view.

  For this reason, the information processing apparatus 100 performs control to change the display mode of the display 120 when, for example, contact with the apparatus main body is not detected and face detection is performed. Good. The change in the display mode may be, for example, changing the background color of the screen displayed on the display 120 or blinking the screen.

  As a result, a user who does not have the information processing apparatus 100 in his / her hand but is looking at the display 120 can be prompted to input data through the user's vision. For example, even if the user does not have the information processing apparatus 100, if the display 120 is in the field of view, the user can stimulate the user's vision by changing the display mode of the display 120 to input data. You can notice what to do.

  As described above, according to the information processing apparatus 100 according to the first embodiment, the type of the alarm when a predetermined alarm is output can be controlled according to the state of the user with respect to the information processing apparatus 100. Accordingly, it is possible to prompt a user who has not yet completed data input to input data by stimulating different sensations according to the state of the user, and to perform an effective alarm that the user can easily notice. .

  In the above description, the alarm for prompting data input is described as an example of the predetermined alarm, but the present invention is not limited to this. For example, as a predetermined alarm, an alarm that prompts the user to move to the counter may be applied near the arrival of the procedure time at the counter. Thereby, different senses can be stimulated according to the state of the user, the movement to the window can be promoted, and an effective alarm that can be easily noticed by the user can be performed.

(Embodiment 2)
Next, an alarm control system 200 according to the second embodiment will be described. Note that description of portions similar to those described in the first embodiment is omitted.

  FIG. 2 is an explanatory diagram of a system configuration example of the alarm control system 200 according to the second embodiment. In FIG. 2, the alarm control system 200 includes an alarm control device 201, terminal devices T1 to Tn, and a plurality of access points AP. In the alarm control system 200, the alarm control device 201, the terminal devices T1 to Tn, and the access point AP are connected via a wired or wireless network 210. The network 210 is, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a mobile communication network, or the like.

  In the following description, an arbitrary terminal device among the terminal devices T1 to Tn may be referred to as “terminal device Ti” (i = 1, 2,..., N).

  Here, the alarm control system 200 is, for example, a system provided in a government office such as a city hall or a ward office. The alarm control device 201 is a computer that has a lending management DB (database) 220 and controls the type of alarm when a predetermined alarm is output from the terminal device Ti. The alarm control device 201 is a server, for example. The contents stored in the lending management DB 220 will be described later with reference to FIG.

  The terminal device Ti is a computer that is lent to a user (for example, a resident) at a general counter in the office. The general counter is a counter that provides various services so that users who visit the government office can smoothly carry out the procedures. The general window serves as a rental place and return place for the terminal device Ti.

  The access point AP is a wireless LAN access point installed in the office. For example, the access point AP is installed in the vicinity of a window, a waiting area, a store, an entrance / exit of each section. The terminal device Ti can wirelessly communicate with each access point AP within the communication area of each access point AP, and can be connected to the network 210 via each access point AP.

  In the above description, the terminal device Ti is lent to a user who has visited the government office, but the present invention is not limited to this. For example, as the terminal device Ti, a tablet terminal or a smartphone owned by a user who visits a public office may be used.

(Hardware configuration example of alarm control device 201)
FIG. 3 is a block diagram illustrating a hardware configuration example of the alarm control device 201. In FIG. 3, the alarm control apparatus 201 includes a CPU (Central Processing Unit) 301, a memory 302, an I / F (Interface) 303, a disk drive 304, and a disk 305. Each component is connected by a bus 300.

  Here, the CPU 301 governs overall control of the alarm control device 201. The memory 302 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), and a flash ROM. Specifically, for example, a flash ROM or ROM stores various programs, and a RAM is used as a work area for the CPU 301. The program stored in the memory 302 is loaded into the CPU 301 to cause the CPU 301 to execute the coded process.

  The I / F 303 is connected to the network 210 through a communication line, and is connected to other computers (for example, the terminal devices T1 to Tn illustrated in FIG. 2) via the network 210. The I / F 303 controls an internal interface with the network 210 and controls input / output of data from other computers. For example, a modem or a LAN adapter may be employed as the I / F 303.

  The disk drive 304 controls reading / writing of data with respect to the disk 305 according to the control of the CPU 301. The disk 305 stores data written under the control of the disk drive 304. Examples of the disk 305 include a magnetic disk and an optical disk.

  Note that the alarm control device 201 may include, for example, an SSD (Solid State Drive), a keyboard, a mouse, and a display in addition to the above-described components.

(Hardware configuration example of terminal device Ti)
FIG. 4 is a block diagram illustrating a hardware configuration example of the terminal device Ti. In FIG. 4, the terminal device Ti includes a CPU 401, a memory 402, a touch panel display 403, an in-camera 404, an I / F 405, a grip sensor 406, a vibrator 407, a card reader 408, and a speaker 409. Have. Each component is connected by a bus 400.

  Here, the CPU 401 governs overall control of the terminal device Ti. The memory 402 includes, for example, a ROM, a RAM, a flash ROM, and the like. Specifically, for example, a flash ROM or ROM stores various programs, and the RAM is used as a work area of the CPU 401. The program stored in the memory 402 is loaded on the CPU 401 to cause the CPU 401 to execute the coded process.

  The touch panel display 403 is an input device that displays data such as a document, an image, and function information as well as a cursor, an icon, or a tool box. As the touch panel display 403, for example, a capacitive touch panel can be adopted.

  The in camera 404 is an imaging device provided on the front side of the terminal device Ti. Specifically, for example, the in-camera 404 is located on the side where the touch panel display 403 is provided (see, for example, FIG. 6 described later), and shoots a user who is viewing or operating the touch panel display 403. Is possible.

  The I / F 405 includes a wireless communication circuit and an antenna, and is connected to the network 210 via an access point AP (see FIG. 2) or a base station of a mobile communication network. It is connected to the alarm control device 201) shown in FIG. The I / F 405 controls an internal interface with the network 210 and controls input / output of data from other computers.

  The grip sensor 406 is a sensor that detects contact with the grip portion of the terminal device Ti. The grip portion is a grip portion for holding the terminal device Ti, and is, for example, a portion other than the touch panel display 403 in a front portion of the terminal device Ti, a back portion and a side portion of the terminal device Ti. As the grip sensor 406, for example, a capacitive sensor can be adopted.

  The vibrator 407 is a vibrating device that vibrates. When the vibrator 407 vibrates, the terminal device Ti main body can be vibrated. The vibration pattern of the vibrator 407 can be changed. The card reader 408 is a device that reads a card. Examples of the card include an IC (Integrated Circuit) card and a magnetic card. The speaker 409 outputs sound. The volume of the speaker 409 can be adjusted.

  In addition to the components described above, the terminal device Ti may include, for example, a disk drive, a disk, a GPS (Global Positioning System) unit, a speed sensor, an acceleration sensor, an angular velocity sensor, and the like. Further, the information processing apparatus 100 illustrated in FIG. 1 can be realized by a hardware configuration similar to that of the terminal apparatus Ti.

(Contents stored in the rental management DB 220)
Next, the contents stored in the lending management DB 220 of the alarm control device 201 will be described. The lending management DB 220 is realized by a storage device such as the memory 302 and the disk 305 shown in FIG.

  FIG. 5 is an explanatory diagram showing an example of the contents stored in the lending management DB 220. In FIG. 5, the lending management DB 220 has fields of terminal ID, lending number, lending date, lending time, return date, return time, and personal number, and lending by setting information in each field Management information (for example, lending management information 500-1, 500-2) is stored as a record.

  Here, the terminal ID is an identifier for uniquely identifying the terminal device Ti. The lending number is an identifier that uniquely identifies lending management information. Of the lending numbers, the first 3 digits indicate the Japanese calendar, the 4th to 7th digits indicate the lending date, and the last 4 digits indicate numbers that are numbered in the order in which the terminal device Ti was lent. Show.

  The rental date indicates the date on which the terminal device Ti was lent. The lending time indicates the time when the terminal device Ti is lent. The return date indicates the date on which the terminal device Ti is returned. The return time indicates the time when the terminal device Ti is returned. The personal number is an identifier that uniquely identifies the user. The personal number may be, for example, a resident card code, or may be a unique number (my number) assigned to each citizen who has a resident card in the My Number system.

  In the rental management DB 220, for example, when the terminal device Ti is lent to a user at a general counter in a government office, new rental management information is newly registered each time. An example of updating the storage contents of the lending management DB 220 will be described later with reference to FIG.

(Example of top screen 600)
Next, a screen example of the top screen 600 displayed on the touch panel display 403 of the terminal device Ti will be described.

  FIG. 6 is an explanatory diagram illustrating a screen example of the top screen 600. In FIG. 6, a top screen 600 is a screen displayed on the touch panel display 403 when, for example, the terminal device Ti is powered on. A message 610 is displayed on the top screen 600.

  The message 610 prompts the user to pass the resident card through the card reader 408 (see FIG. 4). The user can input his / her resident information to the terminal device Ti by causing the card reader 408 to read his / her resident card. The resident information includes, for example, the user's personal number and basic 4 information (address, name, date of birth, gender) and the like.

  Further, when the resident information of the user is input on the top screen 600, for example, a transition is made to a life scene selection screen 700 as shown in FIG. Further, when the resident information of the user is input on the top screen 600, for example, the input resident information is transmitted from the terminal device Ti to the alarm control device 201.

  As described above, the in-camera 404 is provided on the upper part of the touch panel display 403 so that a user who is looking at the touch panel display 403 can be photographed. In addition, a release button B is provided below the touch panel display 403. The cancel button B is a button for canceling the alarm.

(Screen example of life scene selection screen 700)
Next, a screen example of the life scene selection screen 700 displayed on the touch panel display 403 of the terminal device Ti will be described.

  FIG. 7 is an explanatory diagram illustrating a screen example of the life scene selection screen 700. In FIG. 7, a life scene selection screen 700 is a screen displayed on the touch panel display 403 when input of resident information on the top screen 600 (see FIG. 6) is completed.

  On the life scene selection screen 700, buttons corresponding to the life scene (for example, buttons 701 to 710) are displayed. On the life scene selection screen 700, the user selects a button corresponding to his / her life scene (business). For example, when a procedure corresponding to “moving” is performed, the button 706 is selected by a touch operation.

  Further, when a button corresponding to a life scene is selected on the life scene selection screen 700, for example, a transition is made to a reservation screen (not shown) for making a reservation to a procedure section that performs a procedure according to the selected life scene. . Thereby, it is possible to make a reservation to the procedure section using the terminal device Ti without receiving directly at the window.

(Functional configuration example of the alarm control device 201)
FIG. 8 is a block diagram illustrating a functional configuration example of the alarm control device 201. In FIG. 8, the alarm control device 201 includes a communication control unit 801, an update unit 802, a determination unit 803, a detection unit 804, and an alarm control unit 805. The communication control unit 801 to the alarm control unit 805 are functions as control units. Specifically, for example, the CPU 301 executes a program stored in a storage device such as the memory 302 and the disk 305 illustrated in FIG. Or the function is realized by the I / F 303. The processing result of each functional unit is stored in a storage device such as the memory 302 and the disk 305, for example.

  The communication control unit 801 receives a lending notification from the terminal device Ti. Here, the lending notification notifies the user who has visited the office that the terminal device Ti has been rented out. The lending notification includes, for example, the terminal ID of the terminal device Ti.

  The update unit 802 newly registers lending management information in the lending management DB 220 (for example, see FIG. 5) in response to receiving a lending notification from the terminal device Ti. Specifically, for example, the update unit 802 registers new lending management information by setting the terminal ID included in the lending notification in the terminal ID field of the lending management DB 220.

  An example of updating the storage contents of the lending management DB 220 will be described later with reference to FIG.

  The determination unit 803 determines whether data input in one or more specific input forms among predetermined input forms is completed in the terminal device Ti. Here, the predetermined input form is a mechanism for inputting or selecting data, for example, an input screen such as the top screen 600 shown in FIG. 6 or the life scene selection screen 700 shown in FIG. .

  Specifically, for example, when the communication control unit 801 receives an input completion notification from the terminal device Ti, the determination unit 803 determines that data input in a specific input form is completed. Here, the input completion notification is a notification indicating that data input in a specific input form has been completed.

  Further, the communication control unit 801 transmits an information acquisition request to the terminal device Ti when data input in a specific input form is incomplete. Here, the information acquisition request is a request for a captured image captured by the in-camera 404 of the terminal device Ti and a contact detection result indicating whether contact with the terminal device Ti is detected.

  Specifically, for example, the communication control unit 801 determines that the terminal is in a case where data input to a specific input form is incomplete and the elapsed time after receiving the lending notification exceeds a predetermined time T. An information acquisition request may be transmitted to the device Ti. Here, the predetermined time T can be arbitrarily set, and is set to a time of about 3 minutes to 5 minutes, for example.

  In addition, the communication control unit 801 receives a captured image and a contact detection result from the terminal device Ti. As described above, the captured image is a captured image captured by the in-camera 404 of the terminal device Ti. The contact detection result is information indicating whether contact with the terminal device Ti is detected.

  Specifically, for example, the communication control unit 801 receives an information acquisition response from the terminal device Ti as a result of transmitting an information acquisition request to the terminal device Ti. Here, the information acquisition response is a response to the information acquisition request from the alarm control device 201, and includes a captured image captured by the in-camera 404 and a contact detection result.

  The detection unit 804 performs predetermined image detection from the received captured image. Here, the predetermined image detection is, for example, face detection or iris detection. Specifically, for example, the detection unit 804 performs face detection from a captured image included in the received information acquisition response using existing techniques such as pattern recognition and machine learning. Furthermore, the detection unit 804 may perform iris detection from the detected face image.

  The alarm control unit 805 controls the type of alarm when a predetermined alarm is output from the terminal device Ti. Specifically, for example, the alarm control unit 805 determines from the terminal device Ti according to a combination of whether or not contact with the terminal device Ti is detected and whether or not a predetermined image is detected from the captured image. Controls the type of alarm when a predetermined alarm is output. Here, the predetermined alarm is, for example, an alarm for prompting data input in a specific input form. Further, whether or not contact with the terminal device Ti is detected is specified from, for example, a contact detection result included in the information acquisition response received from the terminal device Ti.

First Alarm Instruction For example, the alarm control unit 805 performs control to vibrate the vibrator 407 in the terminal device Ti when contact with the terminal device Ti is detected and a predetermined image is not detected. You may decide. Specifically, for example, the alarm control unit 805 transmits a first alarm instruction to the terminal device Ti by the communication control unit 801. Here, the first alarm instruction instructs the terminal device Ti to start the vibrator 407.

Second alarm instruction Further, for example, when the contact with the terminal device Ti is not detected and the predetermined image is not detected, the alarm control unit 805 has a predetermined alarm for the terminal device Ti. You may decide to perform control which outputs a sound. Specifically, for example, the alarm control unit 805 transmits a second alarm instruction to the terminal device Ti by the communication control unit 801. Here, the second alarm instruction instructs the terminal device Ti to output a predetermined alarm sound (for example, a buzzer sound).

  Further, for example, the alarm control unit 805 may specify the orientation of the face with respect to the touch panel display 403 when a predetermined image is detected. Note that the orientation of the face can be specified, for example, from the position of the iris detected from the face image. Next, the alarm control unit 805 determines whether or not the specified face orientation is a specific orientation.

  Specifically, for example, the alarm control unit 805 determines that the face is in a specific direction when the vertical direction of the face substantially matches the vertical direction of the touch panel display 403. However, the upward direction of the touch panel display 403 is the direction in which the in-camera 404 is provided, and the downward direction of the touch panel display 403 is the direction in which the release button B is provided (see, for example, FIG. 6).

  Here, when the orientation of the face is a specific orientation, it can be said that the user can see the touch panel display 403 in the correct orientation. Further, the fact that the user has not touched the terminal device Ti and is looking at the touch panel display 403 in the correct direction, but the data input is incomplete, the user does not know how to operate the terminal device Ti. Therefore, it may take time to input data.

-Third alarm instruction For this reason, the alarm control unit 805 sends a predetermined message to the terminal device Ti when, for example, contact with the terminal device Ti is detected and the face direction is a specific direction. You may decide to perform control to display. The predetermined message is, for example, a message prompting the user to ask the staff for help.

  Specifically, for example, the alarm control unit 805 transmits a third alarm instruction to the terminal device Ti by the communication control unit 801. Here, the third alarm instruction instructs the terminal device Ti to display a predetermined message. A specific example of the predetermined message will be described later with reference to FIG.

  On the other hand, when the orientation of the face is not a specific orientation, it can be said that the user is not in a state in which the touch panel display 403 can be viewed in the correct orientation, but the touch panel display 403 is in the field of view.

  For this reason, the alarm control unit 805 may control the terminal device Ti to change the display mode of the touch panel display 403 when the face orientation is not a specific orientation. However, if contact with the terminal device Ti is not detected, the terminal device Ti is away from the user, and the user may not notice the change in the display mode of the touch panel display 403.

Fourth Alarm Instruction Therefore, the alarm control unit 805 changes the display mode of the touch panel display 403 when contact with the terminal device Ti is not detected and the face orientation is not a specific orientation. At the same time, control for outputting a predetermined alarm sound may be performed. Specifically, for example, the alarm control unit 805 transmits a fourth alarm instruction to the terminal device Ti by the communication control unit 801. Here, the fourth alarm instruction instructs the terminal device Ti to change the display mode of the touch panel display 403 and output a predetermined alarm sound.

On the other hand, the alarm control unit 805 controls to change the display mode of the touch panel display 403 when contact with the terminal device Ti is detected and the face direction is not a specific direction. You may decide to do it. Specifically, for example, the alarm control unit 805 transmits a fifth alarm instruction to the terminal device Ti by the communication control unit 801. Here, the fifth alarm instruction instructs the terminal device Ti to change the display mode of the touch panel display 403.

  Even if the face is in a specific direction, if no contact with the terminal device Ti is detected, the user can input data even if the user can view the touch panel display 403 in the correct direction. May not have done. For this reason, for example, when contact with the terminal device Ti is not detected and the face is in a specific direction, the alarm control unit 805 controls the terminal device Ti with respect to the terminal device Ti. Then, the fourth alarm instruction may be transmitted.

  Note that the alarm control unit 805 may perform control to vibrate the vibrator 407 in the terminal device Ti when contact with the terminal device Ti is detected. On the other hand, when contact with the terminal device Ti is not detected, the alarm control unit 805 may not vibrate the vibrator 407 in the terminal device Ti. That is, the alarm control unit 805 may vibrate the vibrator 407 regardless of whether or not a predetermined image is detected as long as contact with the terminal device Ti is detected. Further, the alarm control unit 805 may perform control for causing the terminal device Ti to output a predetermined alarm sound when contact with the terminal device Ti is not detected.

  Further, the alarm control unit 805 may control the terminal device Ti to change the display mode of the touch panel display 403 when a predetermined image is detected. On the other hand, when the predetermined image is not detected, the alarm control unit 805 may not cause the terminal device Ti to change the display mode of the touch panel display 403. That is, the alarm control unit 805 may change the display mode of the touch panel display 403 regardless of whether or not contact with the terminal device Ti is detected as long as a predetermined image is detected. Further, the alarm control unit 805 may perform control to cause the terminal device Ti to vibrate the vibrator 407 and / or output a predetermined alarm sound when the predetermined image detection is not performed.

  Further, the communication control unit 801, when data input to a specific input form is incomplete and the elapsed time after the control by the alarm control unit 805 has exceeded a predetermined time T, the terminal device The information acquisition request may be transmitted again to Ti. Thereby, even after a predetermined alarm is output from the terminal device Ti, when the data input is not completed after the predetermined time T, the information acquisition request can be transmitted again to the terminal device Ti.

  In the above description, the predetermined image detection is performed by the alarm control device 201, but may be performed by the terminal device Ti. In this case, the alarm control device 201 receives, for example, a detection result obtained by performing predetermined image detection from the terminal device Ti.

(Example of updating stored contents of the lending management DB 220)
Next, an example of updating the storage contents of the lending management DB 220 will be described with reference to FIG. Here, it is assumed that the terminal device T3 is lent to the user at the general counter of the government office.

  FIG. 9 is an explanatory diagram illustrating an example of updating the storage contents of the lending management DB 220. In (9-1) illustrated in FIG. 9, the update unit 802 assigns the terminal ID “T3” included in the loan notification to the loan management DB 220 in response to the communication control unit 801 receiving the loan notification from the terminal device T3. Is set in the terminal ID field. As a result, the lending management information 500-3 is newly registered in the lending management DB 220.

  Furthermore, the update unit 802 sets the lending number, the lending date, and the lending time in the lending number, lending date, and lending time fields of the lending management information 500-3, respectively. The lending date and lending time may be included in the lending notification, or may be the date and time when the lending notification is received.

  Thereby, the lending date and lending time when the terminal device T3 was lent can be recorded. At this time, the return date, return time, and personal number fields are not set.

  In (9-2) shown in FIG. 9, the update unit 802 receives the resident information in the personal number field of the lending management information 500-3 in response to the communication control unit 801 receiving the resident information from the terminal device T3. Set the personal number included in. Thereby, the personal number which uniquely identifies the user who lent the terminal device T3 can be recorded.

  In (9-3) shown in FIG. 9, the update unit 802 returns the return date and return time of the lending management information 500-3 in response to the return notification received from the terminal device T3 by the communication control unit 801. Set the return date and return time in each field. The return notification is transmitted from the terminal device T3 to the alarm control device 201 when the terminal device T3 is returned.

  The return notification includes, for example, the terminal ID of the terminal device Ti. Further, the return date and return time may be included in the return notification, or may be the date and time when the return notification is received. Thereby, the return date and return time when the terminal device T3 was returned can be recorded.

  Thus, the lending / returning status of the terminal device Ti (for example, the terminal device T3) is managed by updating the lending management information (for example, the lending management information 500-3) in accordance with various information from the terminal device Ti. can do.

(Functional configuration example of terminal device Ti)
FIG. 10 is a block diagram illustrating a functional configuration example of the terminal device Ti. In FIG. 10, the terminal device Ti includes a communication control unit 1001, a display control unit 1002, a reception unit 1003, a detection unit 1004, an acquisition unit 1005, a vibrator control unit 1006, and a sound control unit 1007. It is a configuration. The communication control unit 1001 to the sound control unit 1007 are functions as control units. Specifically, for example, the CPU 401 executes a program stored in the memory 402 illustrated in FIG. 4 or the I / F 405. By realizing the function. The processing result of each functional unit is stored in the memory 402, for example.

  The communication control unit 1001 transmits a lending notification to the alarm control device 201 in response to the power supply of the device main body being turned on. The lending notification is for notifying that the terminal device Ti has been lent. The lending notification includes, for example, the terminal ID of the terminal device Ti. The lending notice may include a lending date and a lending time. The lending date and lending time are, for example, the date and time when the power of the terminal device Ti is turned on.

  The display control unit 1002 displays a predetermined input form. The predetermined input form is a mechanism for inputting or selecting data, and is, for example, an input screen such as a top screen 600 (see FIG. 6) or a life scene selection screen 700 (see FIG. 7).

  Specifically, for example, the display control unit 1002 displays the top screen 600 on the touch panel display 403 in response to the power supply of the apparatus main body being turned on. Further, for example, the display control unit 1002 displays the life scene selection screen 700 on the touch panel display 403 in response to the completion of the input of the resident information on the top screen 600.

  The accepting unit 1003 accepts data input in a predetermined input form. Specifically, for example, the accepting unit 1003 accepts the resident information of the user input by causing the card reader 408 to read the resident card on the top screen 600. Further, for example, the accepting unit 1003 accepts selection of a button corresponding to the life scene of the user on the life scene selection screen 700.

  Further, the communication control unit 1001 transmits an input completion notification to the alarm control device 201 in response to completion of data input in one or more specific input forms among predetermined input forms. Here, the input completion notification is a notification indicating that data input in a specific input form has been completed. The input completion notification may include data input in a specific input form.

  For example, a specific input form is the top screen 600. In this case, for example, the communication control unit 1001 performs alarm control on an input completion notification indicating that data input on a specific input form (top screen 600) has been completed in response to resident information being input on the top screen 600. To the device 201. The input completion notification includes, for example, the resident information of the user input on the top screen 600.

  Further, for example, the specific input form is assumed to be two screens, a top screen 600 and a life scene selection screen 700. In this case, for example, the communication control unit 1001 has completed the data input on the specific input form (the top screen 600 and the life scene selection screen 700) in response to the life scene being selected on the life scene selection screen 700. Is sent to the alarm control apparatus 201.

  Further, the communication control unit 1001 receives an information acquisition request from the alarm control device 201. As described above, the information acquisition request is for requesting a captured image captured by the in-camera 404 of the terminal device Ti and a contact detection result indicating whether contact with the terminal device Ti is detected.

  The detection unit 1004 detects contact with the apparatus main body. Specifically, for example, the detection unit 1004 detects contact with the apparatus main body in response to reception of an information acquisition request from the alarm control apparatus 201. More specifically, for example, the detection unit 1004 detects contact with the apparatus main body in response to detection of a touch operation on the touch panel display 403. Further, for example, the detection unit 1004 detects contact with the apparatus main body when the grip sensor 406 detects contact with the grip portion of the terminal device Ti.

  The acquisition unit 1005 acquires a captured image captured by the in-camera 404. Specifically, for example, the acquisition unit 1005 outputs an imaging instruction to the in-camera 404 in response to the reception of the information acquisition request from the alarm control device 201, thereby taking a captured image captured by the in-camera 404. To get.

  Further, the communication control unit 1001 transmits an information acquisition response to the alarm control device 201. As described above, the information acquisition response is a response to the information acquisition request from the alarm control device 201, and whether the captured image acquired by the acquisition unit 1005 and the contact with the terminal device Ti are detected by the detection unit 1004. A contact detection result indicating whether or not.

  Further, the communication control unit 1001 receives an alarm instruction from the alarm control device 201. As described above, the predetermined alarm is, for example, an alarm for prompting data input in a specific input form. The alarm instruction is for instructing the type of the alarm when a predetermined alarm is output, and is, for example, first to fifth alarm instructions for prompting data input in a specific input form.

  The vibrator control unit 1006 controls the vibrator 407. Specifically, for example, vibrator control unit 1006 vibrates vibrator 407 in response to the reception of the first alarm instruction. Moreover, the vibrator control unit 1006 stops the vibrator 407 in response to receiving the alarm release request.

  Here, the alarm release request is a request to release a predetermined alarm. For example, the user inputs an alarm release request to the terminal device Ti by pressing a release button B provided at the lower part of the touch panel display 403. Thereby, a predetermined alarm can be canceled.

  The sound control unit 1007 controls the output of a predetermined alarm sound. Specifically, for example, the sound control unit 1007 outputs a buzzer sound from the speaker 409 in response to reception of the second or fourth alarm instruction. Further, the sound control unit 1007 stops outputting the buzzer sound in response to receiving the alarm release request.

  The display control unit 1002 displays a predetermined message. The predetermined message is, for example, a message prompting the user to ask the staff for help. Specifically, for example, the display control unit 1002 displays a concierge screen 1200 as shown in FIG. 12 described later on the touch panel display 403 in response to the reception of the third alarm instruction.

  In addition, the display control unit 1002 changes the display mode of the touch panel display 403. Specifically, for example, the display control unit 1002 may change the background color of the screen displayed on the touch panel display 403 in response to the reception of the fourth or fifth alarm instruction. Further, the screen may be displayed blinking. The blinking speed of the screen may be changeable.

  In this case, the display control unit 1002 returns the background color of the screen displayed on the touch panel display 403 to the color before the change in response to receiving the alarm release request, and ends the blinking display of the screen. An example of changing the display mode of the touch panel display 403 will be described later with reference to FIG.

  Note that the terminal device Ti may include functional units corresponding to the determination unit 803, the detection unit 804, and the alarm control unit 805 included in the alarm control device 201. Thereby, for example, the information processing apparatus 100 illustrated in FIG. 1 can be realized.

(Example of changing display mode of touch panel display 403)
FIG. 11 is an explanatory diagram illustrating an example of changing the display mode of the touch panel display 403. In FIG. 11, a top screen 600 is displayed on the touch panel display 403. For example, in the initial setting, the background color of the top screen 600 is “white”.

  For example, the display control unit 1002 changes the background color of the top screen 600 displayed on the touch panel display 403 from “white” to “yellow” in response to reception of the fourth or fifth alarm instruction from the alarm control device 201. And the top screen 600 blinks (right side in FIG. 11). Thereby, when the user can see the touch panel display 403, data input on the top screen 600 can be prompted through the user's vision.

  Further, in response to receiving the alarm release request, the display control unit 1002 returns the background color of the top screen 600 displayed on the touch panel display 403 from “yellow” to “white”, and the top screen 600 blinks. Is finished (left side in FIG. 11). Thus, when the user notices that data should be input and presses the release button B, the background color of the top screen 600 can be returned to the original and the blinking display can be terminated.

(Example of concierge screen 1200)
Next, a screen example of the concierge screen 1200 displayed on the touch panel display 403 of the terminal device Ti will be described.

  FIG. 12 is an explanatory diagram showing a screen example of the concierge screen 1200. In FIG. 12, a concierge screen 1200 is a screen displayed in response to the reception of the third alarm instruction from the alarm control device 201. The concierge screen 1200 displays a message 1210 that prompts the staff (concierge) to ask for help.

  According to the concierge screen 1200, for example, when a user who is not familiar with the operation of the terminal device Ti, such as an elderly person, is taking time to input data, the nearby concierge (staff) is prompted to ask for help. Can do.

  Further, the display control unit 1002 may end the display of the concierge screen 1200 and display the top screen 600 in response to receiving the alarm release request. Thereby, for example, when the user wants to input data by himself without requesting help from the concierge, the top screen 600 can be displayed again.

  Here, the case where the concierge screen 1200 is switched from the top screen 600 and displayed on the touch panel display 403 has been described as an example, but the present invention is not limited thereto. Specifically, for example, the display control unit 1002 may pop up the concierge screen 1200 on the top screen 600.

(Alarm processing procedure of terminal device Ti)
Next, an alarm processing procedure of the terminal device Ti will be described. The alarm process is a process for outputting a predetermined alarm. Here, the predetermined alarm is an alarm for prompting data input on a specific input form (top screen 600).

  FIG. 13 is a flowchart showing an alarm processing procedure of the terminal device Ti. In the flowchart of FIG. 13, first, the terminal device Ti determines whether or not the power of the apparatus main body is turned on (step S1301). Here, the terminal apparatus Ti waits for the apparatus main body to be powered on (step S1301: No).

  When the power of the apparatus main body is turned on (step S1301: Yes), the terminal apparatus Ti transmits a lending notification to the alarm control apparatus 201 (step S1302). The terminal device Ti displays the top screen 600 on the touch panel display 403 (step S1303).

  Next, the terminal device Ti determines whether or not the input of inhabitant information has been received on the top screen 600 (step S1304). Here, when the input of inhabitant information is not received (step S1304: No), the terminal device Ti determines whether an information acquisition request is received from the alarm control device 201 (step S1305).

  If no information acquisition request has been received (step S1305: NO), the terminal device Ti returns to step S1304. On the other hand, when the information acquisition request is received (step S1305: Yes), the terminal device Ti outputs an imaging instruction to the in-camera 404, thereby acquiring a captured image captured by the in-camera 404 (step S1306).

  Next, the terminal apparatus Ti detects contact with the apparatus main body (step S1307). Then, the terminal device Ti transmits an information acquisition response including the acquired captured image and a contact detection result indicating whether or not contact with the device main body is detected to the alarm control device 201 (step S1308).

  Next, the terminal device Ti determines whether an alarm instruction has been received from the alarm control device 201 (step S1309). Here, the terminal device Ti waits to receive an alarm instruction (step S1309: No). If an alarm instruction is received (step S1309: YES), the terminal device Ti executes an alarm output process (step S1310) and returns to step S1304.

  The specific processing procedure of the alarm output process will be described later with reference to FIGS. 14 and 15.

  In step S1304, when the input of resident information is accepted (step S1304: Yes), the terminal device Ti transmits an input completion notification including the input resident information to the alarm control device 201 (step S1311). A series of processing by this flowchart is complete | finished.

  Thereby, an alarm for prompting the user who has not completed data input on the top screen 600 to input data can be performed.

  Next, a specific processing procedure of the alarm output processing in step S1310 shown in FIG. 13 will be described using FIG. 14 and FIG.

  14 and 15 are flowcharts showing an example of a specific processing procedure of the alarm output processing. In the flowchart of FIG. 14, first, the terminal device Ti determines whether or not the alarm instruction received in step S1309 shown in FIG. 13 is the first alarm instruction (step S1401).

  Here, if it is the first alarm instruction (step S1401: Yes), the terminal device Ti vibrates the vibrator 407 (step S1402). Thus, data input on the top screen 600 can be prompted through the user's sense of touch.

  Next, the terminal device Ti determines whether an alarm release request has been received (step S1403). Here, the terminal device Ti waits to receive an alarm release request (step S1403: No). If an alarm release request is received (step S1403: Yes), the terminal device Ti stops the vibrator 407 (step S1404) and returns to the step that called the alarm output process.

  If it is not the first alarm instruction in step S1401 (step S1401: No), the terminal apparatus Ti determines whether or not the alarm instruction received in step S1309 is the second alarm instruction (step S1401). S1405).

  Here, if it is the second alarm instruction (step S1405: Yes), the terminal device Ti outputs a buzzer sound from the speaker 409 (step S1406). As a result, data input on the top screen 600 can be prompted through the user's hearing.

  Next, the terminal device Ti determines whether an alarm release request has been received (step S1407). Here, the terminal device Ti waits to receive an alarm release request (step S1407: No). If an alarm release request is received (step S1407: YES), the terminal device Ti stops outputting the buzzer sound (step S1408) and returns to the step that called the alarm output process.

  In step S1405, if it is not the second alarm instruction (step S1405: No), the terminal device Ti determines whether or not the alarm instruction received in step S1309 is the third alarm instruction (step S1405). S1409).

  Here, if it is the third alarm instruction (step S1409: Yes), the terminal device Ti displays the concierge screen 1200 on the touch panel display 403 (step S1410), and returns to the step that called the alarm output process. Thereby, the user can be urged to ask for help from a nearby concierge (staff).

  In step S1409, if it is not the third alarm instruction (step S1409: No), the terminal device Ti proceeds to step S1501 shown in FIG.

  In the flowchart of FIG. 15, first, the terminal device Ti determines whether or not the alarm instruction received in step S1309 is a fourth alarm instruction (step S1501).

  Here, if it is the fourth alarm instruction (step S1501: Yes), the terminal device Ti changes the background color of the top screen 600 and blinks it (step S1502), and outputs a buzzer sound from the speaker 409 (step S1502). Step S1503). Thereby, data input on the top screen 600 can be urged through the visual and auditory sense of the user.

  Next, the terminal device Ti determines whether an alarm release request has been received (step S1504). Here, the terminal device Ti waits to receive an alarm release request (step S1504: No). If an alarm release request is received (step S1504: YES), the terminal device Ti returns the background color of the top screen 600 to the color before the change, ends the blinking display (step S1505), and outputs a buzzer sound. Stop (step S1506) and return to the step that called the alarm output process.

  If it is not the fourth alarm instruction in step S1501 (step S1501: No), the terminal device Ti changes the background color of the top screen 600 and blinks it (step S1507). Accordingly, data input on the top screen 600 can be prompted through the user's vision.

  Next, the terminal device Ti determines whether an alarm release request has been received (step S1508). Here, the terminal device Ti waits to receive an alarm release request (step S1508: No). If an alarm release request is received (step S1508: YES), the terminal device Ti returns the background color of the top screen 600 to the color before change, ends the blinking display (step S1509), and calls the alarm output process. Return to the previous step.

(Alarm control processing procedure of the alarm control device 201)
Next, an alarm control processing procedure of the alarm control device 201 will be described. The alarm control process is a process for controlling the type of the alarm when a predetermined alarm is output. Here, the predetermined alarm is an alarm for prompting data input on a specific input form (top screen 600).

  FIG. 16 is a flowchart showing an alarm control processing procedure of the alarm control device 201. In the flowchart of FIG. 16, first, the alarm control device 201 determines whether or not a lending notification is received from the terminal device Ti (step S1601). Here, the alarm control device 201 waits to receive a lending notification (step S1601: No).

  When the lending notification is received (step S1601: Yes), the alarm control device 201 newly registers lending management information in the lending management DB 220 (step S1602). Next, the alarm control device 201 starts measuring the input waiting time t (step S1603).

  Then, the alarm control device 201 determines whether or not an input completion notification has been received from the terminal device Ti (step S1604). Here, when the input completion notification has not been received (step S1604: No), the alarm control device 201 determines whether or not the input waiting time t has exceeded the predetermined time T (step S1605).

  When the input waiting time t does not exceed the predetermined time T (step S1605: No), the alarm control device 201 returns to step S1604. On the other hand, when the input waiting time t exceeds the predetermined time T (step S1605: Yes), the alarm control device 201 transmits an information acquisition request to the terminal device Ti (step S1606).

  Next, the alarm control device 201 determines whether or not an information acquisition response has been received from the terminal device Ti (step S1607). Here, the alarm control device 201 waits for reception of an information acquisition response (step S1607: No). If an information acquisition response is received (step S1607: YES), the alarm control device 201 executes an alarm instruction transmission process (step S1608).

  The alarm instruction transmission process is a process of transmitting an alarm instruction for instructing the type of alarm when the terminal device Ti outputs a predetermined alarm. A specific processing procedure of the alarm instruction transmission processing will be described later with reference to FIGS. 17 and 18.

  Next, the alarm control device 201 resets the input waiting time t (step S1609) and returns to step S1604. When the input completion notification is received in step S1604 (step S1604: Yes), the alarm control device 201 sets the personal number included in the input completion notification in the lending management information (step S1610), according to this flowchart. A series of processing ends.

  Thereby, when data input on the top screen 600 is not completed, an alarm instruction can be transmitted to the terminal device Ti.

  Next, a specific processing procedure of the alarm instruction transmission processing in step S1608 shown in FIG. 16 will be described using FIG. 17 and FIG.

  17 and 18 are flowcharts showing an example of a specific processing procedure of the alarm instruction transmission process. In the flowchart of FIG. 17, first, the alarm control device 201 performs face detection from the captured image included in the information acquisition response (step S1701). The alarm control device 201 determines whether a face has been detected (step S1702).

  Here, when the face is not detected (step S1702: No), the alarm control device 201 refers to the contact detection result included in the information acquisition response and determines whether or not contact with the terminal device Ti is detected. Judgment is made (step S1703).

  When contact with the terminal device Ti is detected (step S1703: YES), the alarm control device 201 transmits a first alarm instruction to the terminal device Ti (step S1704), and an alarm instruction transmission process Return to the step that called. The first alarm instruction instructs the terminal device Ti to start the vibrator 407.

  On the other hand, when contact with the terminal device Ti is not detected (step S1703: No), the alarm control device 201 transmits a second alarm instruction to the terminal device Ti (step S1705), and performs alarm instruction transmission processing. Return to the calling step. The second alarm instruction instructs the terminal device Ti to output a predetermined alarm sound (for example, a buzzer sound).

  If a face is detected in step S1702 (step S1702: Yes), the alarm control device 201 proceeds to step S1801 shown in FIG.

  In the flowchart of FIG. 18, first, the alarm control device 201 specifies the face orientation with respect to the touch panel display 403 (step S <b> 1801). Then, the alarm control device 201 determines whether or not the specified face orientation is a specific orientation (step S1802).

  Here, when the face orientation is a specific orientation (step S1802: Yes), the alarm control device 201 refers to the contact detection result included in the information acquisition response and the contact with the terminal device Ti is detected. It is determined whether or not there is (step S1803).

  If contact with the terminal device Ti is detected (step S1803: Yes), the alarm control device 201 transmits a third alarm instruction to the terminal device Ti (step S1804), and an alarm instruction transmission process is performed. Return to the step that called. The third alarm instruction instructs the terminal device Ti to display a predetermined message.

  On the other hand, when contact with the terminal device Ti is not detected (step S1803: No), the alarm control device 201 proceeds to step S1806.

  In step S1802, when the face orientation is not a specific orientation (step S1802: No), the alarm control device 201 refers to the contact detection result included in the information acquisition response, and makes contact with the terminal device Ti. It is determined whether or not it has been detected (step S1805).

  If contact with the terminal device Ti is not detected (step S1805: No), the alarm control device 201 transmits a fourth alarm instruction to the terminal device Ti (step S1806), and an alarm instruction transmission process is performed. Return to the step that called. The fourth alarm instruction instructs the terminal device Ti to change the display mode of the touch panel display 403 and output a predetermined alarm sound.

  On the other hand, when contact with the terminal device Ti is detected (step S1805: YES), the alarm control device 201 transmits a fifth alarm instruction to the terminal device Ti (step S1807) and performs alarm instruction transmission processing. Return to the calling step. The fifth alarm instruction instructs the terminal device Ti to change the display mode of the touch panel display 403.

  Thereby, according to the state of the user, the type of alarm output from the terminal device Ti in order to prompt data input on the top screen 600 can be controlled.

  As described above, according to the alarm control device 201 according to the second embodiment, the combination of whether or not contact with the terminal device Ti is detected and whether or not a predetermined image is detected from the captured image. Accordingly, the type of alarm when a predetermined alarm is output from the terminal device Ti can be controlled. The predetermined alarm is, for example, an alarm for prompting data input in a specific input form.

  Thereby, the type of the alarm when a predetermined alarm is output from the terminal device Ti can be controlled according to the state of the user. For example, it is possible to provide an effective alarm for prompting the user who has not completed data input in a specific input form to input data in the specific input form.

  Moreover, according to the alarm control apparatus 201, a predetermined image detection (for example, face detection, iris detection) can be performed from the captured image imaged by the in camera 404 of the terminal device Ti. This makes it possible to determine whether or not the touch panel display 403 can be viewed and operated by the user.

  Further, according to the alarm control device 201, when a predetermined image is detected, the orientation of the face with respect to the touch panel display 403 can be specified. Accordingly, it is possible to determine whether or not the touch panel display 403 is in a state where the user can see and operate the touch panel display 403 in the correct direction.

  Specifically, for example, according to the alarm control device 201, when contact with the terminal device Ti is detected and a predetermined image is not detected, control for vibrating the vibrator 407 to the terminal device Ti is performed. It can be carried out. Accordingly, when the user is not looking at the touch panel display 403 but is in contact with the terminal device Ti, a specific input form (for example, the top screen 600, the life scene selection screen, for example) is sensed through the user's sense of touch. 700).

  Further, for example, according to the alarm control device 201, when contact with the terminal device Ti is not detected and a predetermined image is not detected, the terminal device Ti outputs a predetermined alarm sound. Control can be performed. Thereby, when the user is not looking at the touch panel display 403 and is not touching the terminal device Ti, data input in a specific input form can be prompted through the user's hearing.

  Further, for example, according to the alarm control device 201, when contact with the terminal device Ti is not detected and a predetermined image is detected, the display mode of the touch panel display 403 is displayed on the terminal device Ti. Control to be changed can be performed. Thereby, when the user is not touching the terminal device Ti but is in a state where the touch panel display 403 can be viewed and operated, the user is prompted to input data in a specific input form. it can.

  Further, for example, according to the alarm control device 201, when contact with the terminal device Ti is not detected and a predetermined image is detected, a predetermined alarm sound is further given to the terminal device Ti. Control to output can be performed. Accordingly, when the user is not touching the terminal device Ti but is in a state where the touch panel display 403 can be viewed and operated, the user is prompted to input data in a specific input form through visual and auditory senses. be able to.

  Further, for example, according to the alarm control device 201, when contact with the terminal device Ti is detected and the face is in a specific direction, control is performed to display a predetermined message on the terminal device Ti. be able to. The predetermined message is, for example, a message prompting the user to ask the staff for help. Thereby, when the user is touching the terminal device Ti and is in a state where the touch panel display 403 can be viewed and operated in the correct direction, the user is asked for help from a nearby concierge (staff). Can be encouraged. For example, when a user who is not familiar with the operation of the terminal device Ti, such as an elderly person, is taking time to input data, a nearby concierge (staff) can be prompted to ask for help.

  Further, for example, according to the alarm control device 201, when contact with the terminal device Ti is detected and the face orientation is not a specific orientation, control is performed to change the display mode of the touch panel display 403. Can do. Thus, when the user touches the terminal device Ti but cannot touch the touch panel display 403 in the correct orientation, the user is prompted to input data in a specific input form. Can do.

  Therefore, according to the alarm control system 200 according to the second embodiment, it is possible to perform an effective alarm for prompting data input to the terminal device Ti lent to the user. It is possible to shorten the procedure time by reducing the number of data input operations.

  Further, regardless of the state of the user with respect to the terminal device Ti (that is, the state of how the user handles the terminal device Ti), there is a problem such as an input omission or an input error appropriately and reliably. Can be informed. For this reason, it is possible to correct the state of a malfunction such as an input omission or an input error as early as possible, thereby allowing the subsequent procedure to be performed smoothly and allowing the user to comfortably use the government office.

  Specifically, for example, since the user can be prompted to input data during the waiting time, the user can effectively use the waiting time. In addition, it is possible to avoid a situation in which, after the user is called at the window, he / she notices an input leak or the like and performs a data input operation, so that he / she waits again and again with another person's turn. Thereby, it is possible to allow the user to perform the procedure with as little stress as possible, and as a result, it is possible to achieve smooth and efficient operations at the window.

  In the above description, the case where the alarm control system 200 is applied to a system provided at a city office, a ward office, or the like has been described as an example, but the present invention is not limited thereto. For example, the alarm control system 200 may be applied to a system in a facility (for example, a hospital or a bank) in which a user may wait for performing some procedure at a window or the like.

  The alarm control method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. The alarm control program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The alarm control program may be distributed through a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Appendix 1) An information processing apparatus having a sensor for detecting contact with the apparatus main body and an imaging camera;
A predetermined alarm is issued from the information processing device according to a combination of whether or not contact with the information processing device is detected and whether or not a predetermined image is detected from the captured image captured by the imaging camera. An alarm control device for controlling the type of the alarm when outputting;
A system characterized by including.

(Additional remark 2) The said imaging camera is an in-camera mounted in the said information processing apparatus, The system of Additional remark 1 characterized by the above-mentioned.

(Additional remark 3) The said predetermined alarm is an alarm output when the data input in a specific 1 or several input form is incomplete among predetermined input forms, The additional remark 1 characterized by the above-mentioned 2. The system according to 2.

(Supplementary note 4) The system according to any one of supplementary notes 1 to 3, wherein the predetermined image detection is face detection or iris detection.

(Appendix 5) The alarm control device
When contact with the information processing apparatus is not detected and the predetermined image is not detected, control is performed to output a predetermined alarm sound to the information processing apparatus. The system according to any one of appendices 1 to 4.

(Appendix 6) The information processing apparatus includes a vibrator,
The alarm control device includes:
Additional notes 1 to 5, wherein when the contact with the information processing device is detected and the predetermined image is not detected, the information processing device is controlled to vibrate the vibrator. The system according to any one of the above.

(Supplementary note 7) The information processing apparatus has a touch panel display,
The alarm control device includes:
When the contact with the information processing apparatus is not detected and the predetermined image is detected, the information processing apparatus is controlled to change a display mode of the touch panel display. The system according to any one of supplementary notes 1 to 6.

(Supplementary note 8) The system according to supplementary note 7, wherein the change of the display mode includes a change of a background color of a screen displayed on the touch panel display.

(Supplementary note 9) The system according to supplementary note 7 or 8, wherein the change of the display mode includes blinking display of a screen displayed on the touch panel display.

(Supplementary Note 10) The alarm control device includes:
When the contact with the information processing apparatus is not detected and the predetermined image is detected, the information processing apparatus is further controlled to output a predetermined alarm sound. The system according to any one of appendices 7 to 9.

(Additional remark 11) The said information processing apparatus has a touchscreen display,
The alarm control device includes:
When contact with the information processing device is detected and face detection is performed from the captured image, it is determined whether the detected face orientation with respect to the touch panel display is a specific orientation,
11. The information processing apparatus according to any one of appendices 1 to 10, wherein when the face orientation is the specific orientation, the information processing apparatus is controlled to display a predetermined message on the touch panel display. System.

(Supplementary Note 12) The alarm control device includes:
The system according to appendix 11, wherein when the face orientation is not the specific orientation, the information processing apparatus is controlled to change a display mode of the touch panel display.

(Additional remark 13) The said information processing apparatus has a vibrator,
The alarm control device includes:
The system according to any one of appendices 1 to 4, wherein when contact with the information processing apparatus is detected, the information processing apparatus is controlled to vibrate the vibrator.

(Supplementary Note 14) The alarm control device includes:
The system according to appendix 13, wherein the vibrator is not caused to vibrate in the information processing apparatus when contact with the information processing apparatus is not detected.

(Supplementary Note 15) The alarm control device includes:
15. The system according to appendix 13 or 14, wherein when the contact with the information processing device is not detected, control is performed to cause the information processing device to output a predetermined alarm sound.

(Supplementary Note 16) The information processing apparatus has a touch panel display,
The alarm control device includes:
The system according to any one of appendices 1 to 4, wherein when the predetermined image is detected, the information processing apparatus is controlled to change a display mode of the touch panel display.

(Supplementary Note 17) The alarm control device includes:
The system according to supplementary note 16, wherein when the predetermined image is not detected, the display mode of the touch panel display is not changed by the information processing apparatus.

(Supplementary Note 18) The information processing apparatus includes a vibrator,
The alarm control device includes:
The system according to appendix 16 or 17, wherein when the predetermined image is not detected, control is performed to cause the information processing apparatus to vibrate the vibrator or output a predetermined alarm sound. .

(Supplementary note 19) The information processing apparatus includes a vibrator,
The alarm control device includes:
18. The system according to appendix 16 or 17, wherein when the predetermined image is not detected, control is performed to cause the information processing apparatus to vibrate the vibrator and to output a predetermined alarm sound.

(Supplementary note 20) an imaging camera;
A sensor for detecting contact with the device body;
According to the combination of whether or not contact with the apparatus main body is detected and whether or not predetermined image detection is performed from the captured image captured by the imaging camera, the alarm when the predetermined alarm is output A control unit for controlling the type,
An information processing apparatus comprising:

(Supplementary note 21)
According to a combination of whether or not contact with the apparatus main body is detected by a sensor included in the information processing apparatus and whether or not a predetermined image is detected from a captured image captured by the imaging camera included in the information processing apparatus. , Controlling the type of alarm when a predetermined alarm is output from the information processing apparatus,
An alarm control program for executing a process.

(Appendix 22) The computer
According to a combination of whether or not contact with the apparatus main body is detected by a sensor included in the information processing apparatus and whether or not a predetermined image is detected from a captured image captured by the imaging camera included in the information processing apparatus. , Controlling the type of alarm when a predetermined alarm is output from the information processing apparatus,
An alarm control method characterized by executing processing.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 110 Imaging camera 120 Display 200 Alarm control system 201 Alarm control apparatus 220 Rental management DB
300, 400 Bus 301, 401 CPU
302, 402 Memory 303, 405 I / F
304 disk drive 305 disk 403 touch panel display 404 in-camera 406 grip sensor 407 vibrator 408 card reader 409 speaker 600 top screen 700 life scene selection screen 801, 1001 communication control unit 802 update unit 803 determination unit 804 detection unit 805 alarm control unit 1002 display Control unit 1003 Reception unit 1004 Detection unit 1005 Acquisition unit 1006 Vibrator control unit 1007 Sound control unit 1200 Concierge screen AP access point T1 to Tn, Ti terminal device

Claims (12)

The contact with the apparatus main body have a sensor and an imaging camera to detect, and the information processing apparatus to be disbursed at the counter,
Of the predetermined input forms, when the data input in one or more specific input forms is incomplete and the elapsed time since the information processing device was lent exceeds a predetermined time, the information processing For prompting the data input from the information processing device according to a combination of whether or not contact with the device is detected and whether or not a predetermined image is detected from the captured image captured by the imaging camera . An alarm control device for controlling the type of alarm when outputting an alarm;
A system characterized by including.   The system according to claim 1, wherein the imaging camera is an in-camera mounted on the information processing apparatus.   The system according to claim 1, wherein the predetermined image detection is face detection or iris detection.   The alarm control device includes:
  When contact with the information processing apparatus is not detected and the predetermined image is not detected, control is performed to output a predetermined alarm sound to the information processing apparatus. The system according to claim 1.   The information processing apparatus has a vibrator,
  The alarm control device includes:
  5. The control of causing the information processing apparatus to vibrate the vibrator is performed when contact with the information processing apparatus is detected and the predetermined image is not detected. The system as described in any one of.   The information processing apparatus has a touch panel display,
  The alarm control device includes:
  When the contact with the information processing apparatus is not detected and the predetermined image is detected, the information processing apparatus is controlled to change a display mode of the touch panel display. The system according to any one of claims 1 to 5.   The alarm control device includes:
  When the contact with the information processing apparatus is not detected and the predetermined image is detected, the information processing apparatus is further controlled to output a predetermined alarm sound. The system according to claim 6.   The information processing apparatus has a touch panel display,
  The alarm control device includes:
  When contact with the information processing device is detected and face detection is performed from the captured image, it is determined whether the detected face orientation with respect to the touch panel display is a specific orientation,
  8. The control according to claim 1, wherein when the orientation of the face is the specific orientation, the information processing apparatus is controlled to display a predetermined message on the touch panel display. The described system.   9. The system according to claim 8, wherein the predetermined message is a message prompting a user to ask a staff member for help. An information processing device lent out at a window,
An imaging camera;
A sensor for detecting contact with the device body;
Contact to the device body when data entry in one or more specific input forms is not completed and the elapsed time since the device was lent exceeds a predetermined time Control for controlling the type of alarm when a predetermined alarm is output according to a combination of whether or not a predetermined image is detected from a captured image captured by the imaging camera. And
An information processing apparatus comprising: On the computer,
Among the predetermined input forms, when the data input in one or more specific input forms is incomplete, and the elapsed time since the information processing apparatus has been lent exceeds a predetermined time, the information processing apparatus Depending on a combination of whether or not contact with the apparatus main body is detected by a sensor included in the information processing apparatus and whether or not predetermined image detection is performed from a captured image captured by an imaging camera included in the information processing apparatus. Control the type of alarm when a predetermined alarm is output from the processing device.
An alarm control program for executing a process. Computer
Among the predetermined input forms, when the data input in one or more specific input forms is incomplete, and the elapsed time since the information processing apparatus has been lent exceeds a predetermined time, the information processing apparatus Depending on a combination of whether or not contact with the apparatus main body is detected by a sensor included in the information processing apparatus and whether or not predetermined image detection is performed from a captured image captured by an imaging camera included in the information processing apparatus. Control the type of alarm when a predetermined alarm is output from the processing device.
An alarm control method characterized by executing processing.

Images