JP7246695B2 - LOCKING/UNLOCKING CONTROL DEVICE, LOCKING/UNLOCKING CONTROL METHOD AND PROGRAM - Google Patents

Description

The present invention relates to a locking/unlocking control device, a locking/unlocking control method, and a program for controlling locking/unlocking of a door.

2. Description of the Related Art In housing complexes, hospital facilities, and nursing care facilities, entrance doors to buildings are usually locked, and some are unlocked by a user's unlocking operation. There are various unlocking methods, for example, a method of inserting a cylinder lock or an electric lock into a keyhole to unlock, or a method of inputting a personal identification number into an operation panel.

However, these conventional methods are complicated to operate in hospitals and nursing homes where staff frequently come and go, and hygiene requirements such as infection prevention are high. There was a problem that could arise. In addition, it was necessary to unlock the door every time an outsider visited, which was inconvenient. In order to solve these problems and to simplify the operation and improve safety and hygiene, methods have been proposed in which authentication is performed through communication between the user's mobile terminal and the electronic lock to unlock it (for example, patent documents 1).

In the method of transmitting an unlocking signal for an electronic lock described in Patent Document 1, when a mobile terminal possessed by a user detects that it has entered a geofence of an electronic lock, the mobile terminal, using a first communication method, Start detecting connectable devices and establish a connection with the electronic lock. After the connection is established, the electronic lock unlocks based on the unlocking signal sent from the mobile terminal to the electronic lock. It is explained that this makes it possible to reduce the operations required of the user.

JP 2017-14736 A

The technique described in Patent Document 1 requires that the user always possesses a mobile terminal that transmits an unlocking signal to the electronic lock. The problem was that I couldn't unlock it. For example, hospitals and nursing homes have many visitors such as temporary caregivers and visitors, and if these visitors do not have a mobile terminal that can communicate with the electronic lock, they cannot unlock it. .

In addition, there is also a problem that a person carrying a portable terminal passes by, or a person temporarily holding another person's portable terminal approaches the electronic lock, causing a malfunction.

The present invention has been made in view of the above circumstances, and provides a locking/unlocking control device, a locking/unlocking control method, and a program that enable only an authenticated person to safely unlock a door through simple touchless operations. intended to

In order to achieve the above object, the lock/unlock control device according to the first aspect of the present invention includes:
a display control unit for displaying a key input screen in which a plurality of key buttons are arranged;
an object detection unit that detects a position of a detection object related to a user's non-contact operation from an image captured by a camera in a direction away from the key input screen of the user facing the key input screen;
Mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen is generated, and the coordinates of the detection target detected by the target detection unit in the operation range are mapped to the a mapping unit that converts to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted by the mapping unit , and locking or unlocking is performed according to the order of selection of the key button. and a locking/unlocking control unit for controlling.

The locking/unlocking control section may unlock when the order of selection of the key buttons matches the order of selection of the key buttons included in the passkey notified to the user in advance.

A number is associated with each of the plurality of key buttons,
The lock/unlock control unit may unlock when the order of selection of the numbers of the key buttons matches the order of the number string included in the passkey notified to the user in advance.

The order of selection of the key buttons may be an order in which the plurality of key buttons arranged on the key input screen can be selected from the outside with a single stroke.

A passkey issued in advance by request from the user's terminal may be valid only for a predetermined time or number of times.

The key input screen may be displayed by projecting an image on the door with a projector.

Further comprising a communication unit that performs communication with the user's terminal,
when a passkey is requested from the user's terminal, the communication unit transmits the passkey to the user's terminal;
The locking/unlocking control unit determines a key button selected from the plurality of key buttons based on the position of the detection target detected by the target detection unit, and the selection order of the key buttons is transmitted by the communication unit. Unlocking may be executed if the passkey matches the passkey obtained.

further comprising a communication unit that performs communication with the server;
when the user's terminal requests the server for a passkey, the server transmits the passkey to the communication unit and the user's terminal;
The locking/unlocking control section determines a key button selected from the plurality of key buttons based on the position of the detection target detected by the target detection section, and the selection order of the key buttons is determined by the communication section. If it matches the received passkey, unlocking may be performed.

The display control unit may highlight a key button that matches the coordinates of the detection target on the key input screen converted from the coordinates of the detection target in the operation range.

A locking/unlocking control method according to a second aspect of the present invention includes:
a display control step for displaying a key input screen in which a plurality of key buttons are arranged;
a target detection step of detecting a position of a detection target related to a user's non-contact operation from an image captured by a camera of a user facing the key input screen in a direction away from the key input screen;
generating mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen; a mapping step of converting to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted in the mapping step , and locking or unlocking is performed according to the order of selection of the key button. and a locking/unlocking control step for controlling.

Further, the program according to the third aspect of the present invention is
the computer,
a display control unit that displays a key input screen in which a plurality of key buttons are arranged;
A target detection unit that detects the position of a detection target related to a user's non-contact operation from an image captured by a camera in a direction away from the key input screen of the user facing the key input screen;
Mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen is generated, and the coordinates of the detection target detected by the target detection unit in the operation range are mapped to the a mapping unit that converts to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted by the mapping unit , and locking or unlocking is performed according to the order of selection of the key button. a locking/unlocking control unit to control,
It is characterized by functioning as

According to the present invention, only an authenticated person can safely unlock the door through simple touchless operation.

It is a schematic diagram showing an example of use of the locking/unlocking control device according to the embodiment. 3 is a block diagram showing the hardware configuration of the locking/unlocking control device; FIG. FIG. 3 is a functional block diagram showing the functional configuration of the locking/unlocking control device; It is the figure which showed the user's operation range. FIG. 10 is a diagram showing an operation example for starting key button selection; FIG. 4 is a flow chart showing the flow of processing of the locking/unlocking control device and the mobile terminal according to Embodiment 1; 4 is a diagram showing a key input screen according to Embodiment 1; FIG. 4 is a diagram showing an image of a passkey according to Embodiment 1; FIG. FIG. 10 is a diagram showing a key input screen according to Embodiment 2; FIG. FIG. 10 is a diagram for explaining a passkey according to Embodiment 2; FIG. FIG. 10 is a diagram showing a network configuration according to Embodiment 3; FIG. 11 is a flow diagram showing the flow of processing of the locking/unlocking control device, the mobile terminal, and the application server according to the third embodiment; It is a schematic diagram showing an example of use of a locking/unlocking control device according to another embodiment.

(Embodiment 1)
Embodiment 1 of the present invention will be described in detail with reference to the drawings.

A locking/unlocking control device 10 according to the present embodiment is a device that controls locking/unlocking of a door based on a camera image of a user's motion. The lock/unlock control device 10 displays a key input screen 201 in which a plurality of key buttons are arranged on the display surface, determines the key input based on the action of the user who faces the display surface, and unlocks when authentication is established. It controls locking.

In this embodiment, as an example, as shown in FIG. 1, a key input screen 201 in which a plurality of key buttons are arranged on an automatic glass door is displayed by rear projection, and based on the movement of the user's hand facing it, , and lock/unlock. FIG. 1 is a schematic diagram showing a usage example of the locking/unlocking control device 10. As shown in FIG.

The lock/unlock control device 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a storage section 13, a communication section 14, and an input/output section 15, as shown in FIG. The lock/unlock control device 10 is also connected to the camera 20 and the projector 30 via the input/output unit 15 .

The CPU 11 is an arithmetic processing device that executes various processes and calculations. The RAM 12 is a memory from which data can be read and written at high speed, and temporarily stores image data captured by the camera 20 and image data read from the storage unit 13 for data processing executed by the CPU 11 .

The storage unit 13 is, for example, a large-capacity memory made up of a non-volatile memory such as a flash memory. The storage unit 13 stores image data of the key input screen 201 displayed by the projector 30, image data acquired from the camera 20, and various programs such as a locking/unlocking control processing program executed by the CPU 11.

The communication unit 14 communicates with other communication devices including the mobile terminal 50 of the user by any communication method. Communication between the communication unit 14 and the mobile terminal 50 may be direct wireless communication or communication via the Internet.

Camera 20 is any camera used to measure distance and position. The camera 20 is, for example, a color camera that outputs color image data in real time. The camera 20 is installed so that the line of sight is directed in a direction substantially perpendicular to the display surface and away from the display surface. In FIG. 1, it is installed on the frame of the glass door.

The projector 30 displays a key input screen in which a plurality of key buttons are arranged on the glass door of the automatic door by rear projection, and displays an image reflecting the movement of the user's hand on the glass door.

By executing the lock/unlock control processing program stored in the storage unit 13, the CPU 11 and the RAM 12, as shown in FIG. 114 , a display control unit 115 , a key generation unit 116 , a key authentication unit 117 , and a locking/unlocking control unit 118 .

The image acquisition unit 111 acquires image data captured by the camera 20 . The image acquisition unit 111 outputs frame images at predetermined timings included in image data captured by the camera 20 to the object detection unit 112 at predetermined time intervals.

The target detection unit 112 detects a predetermined detection target image from the frame images input from the image acquisition unit 111 . The image to be detected is an image of a part that can be moved by the user to specify the position on the key input screen 201, and is, for example, an image of a human hand, finger, pointer, or the like. In the present embodiment, a case of detecting an image of a hand 101 with spread fingers including a palm will be described. Any conventional method can be used to detect the image to be detected.

For example, a color image of a preset specific color (for example, flesh color) is extracted from the frame image input from the image acquisition unit 111 using a color mask. Also, binarization processing is performed on the frame image. The image of the hand 101 in the flesh-colored portion may be detected by taking the logical sum of the extracted image of the color mask obtained by these processes and the binarized image.

Also, frame images for two or more consecutive frames or frame images for two or more binarized frames are subjected to inter-frame difference processing, and histograms are created from the obtained difference images. Based on this histogram, an image of the hand 101 may be detected by identifying an active area in which there is a large change in motion.

Alternatively, a template of a human hand or fingers may be stored in the storage unit 13 in advance, and the image of the hand 101 may be detected by performing template matching on the frame image input from the image acquisition unit 111 .

Information such as the size, position, and shape of the hand 101 detected by the object detection unit 112 is output to the operation range identification unit 113 and the mapping unit 114 .

Based on information such as the size, position, and shape of the hand 101 input from the object detection unit 112 , the operation range identification unit 113 determines whether the user can detect the user from the camera's field of view 1001 corresponding to the entire frame image acquired by the image acquisition unit 111 . The operation range 1002 used for operation is specified.

An example of a method for specifying the operation range 1002 when the user operates with one hand 101 will be described with reference to FIG. The frame image (field-of-view area 1001 of the camera) acquired by the image acquisition unit 111 includes an image of the user. The operation range specifying unit 113 acquires the width W of the hand 101 and the center position _P1 of the hand 101 input from the object detection unit 112 . Then, an operation range 1002 having a width of m×W is specified with the point _P1 as the center. Here, m is a predetermined positive coefficient and may be changeable by the user.

The height of the operation range 1002 specified by the operation range specifying unit 113 is a value obtained by multiplying the width determined based on the center position _P1 of the hand 101 by a predetermined ratio. Information on the operation range 1002 identified in this manner is output to the mapping unit 114 .

Mapping unit 114 maps operation range 1002 identified by operation range identification unit 113 onto key input screen 201 projected by projector 30 . The mapping unit 114 then generates mapping information in which the coordinates of the operation range 1002 are associated with the coordinates of the key input screen 201 and stores it in the RAM 12 . Further, the coordinates of the hand 101 in the operation range 1002 are coordinate-transformed into the coordinates of the key input screen 201 using the mapping information, and the obtained coordinates of the hand 101 are output.

The display control unit 115 causes the projector 30 to output the key input screen 201 when the object detection unit 112 detects the image of the hand 101 to be detected. Also, the key button that matches the coordinates of the hand 101 in the coordinates of the key input screen 201 is highlighted.

A key generation unit 116 generates a passkey for unlocking. In this embodiment, the passkey is an image indicating the order of selection of key buttons on the key input screen 201 . The communication unit 14 transmits the passkey generated by the key generation unit 116 to the mobile terminal 50 of the authorized user. The passkey generated by the key generator 116 may be valid only for a predetermined time. Alternatively, the authentication may be valid only for a predetermined number of authentications.

Key authentication unit 117 compares the selection order of key buttons, which are keys generated by key generation unit 116, with the selection order of key buttons that match the coordinates of hand 101 output by mapping unit 114, and determines whether they match. output the authentication result based on Determination of key button selection by the key authentication unit 117 is performed by any conventional method. For example, the authentication may be started after the first key button is selected in the order of selection of key buttons that are keys, and the sequentially selected key buttons may be determined. Alternatively, after determining an action such as waving the hand 101 as shown in FIG. 5(a) or clenching the hand 101 as shown in FIG. 5(b) with the first key button, authentication is started and sequentially The key button to be selected may be determined.

The lock/unlock control unit 118 unlocks the door when the authentication result output by the key authentication unit 117 is successful, and controls the door to remain locked when the authentication is not successful. Here, when a time limit is set for the passkey, authentication is not established when a predetermined time elapses. In addition, when the valid number of passkeys is set, the authentication fails after the valid number of times.

The operations of the locking/unlocking control device 10 configured as described above and the user's mobile terminal 50 will be described with reference to the flowchart shown in FIG. FIG. 6 is a flowchart showing the processing of the lock/unlock control device 10 and the user's portable terminal 50. As shown in FIG.

First, the user obtains a passkey in advance. Specifically, the user's portable terminal 50 requests the passkey to the lock/unlock control device 10 (step S101). The key generation unit 116 of the lock/unlock control device 10 generates a passkey when the mobile terminal 50 belongs to the user whose passage is approved (step S102), and transmits the passkey from the communication unit 14 to the mobile terminal 50. (step S103).

The camera 20 of the lock/unlock control device 10 continues photographing. The image acquisition unit 111 of the lock/unlock control device 10 outputs frame images at predetermined timings included in the image data captured by the camera 20 to the object detection unit 112 at predetermined time intervals. The target detection unit 112 detects the image of the hand 101 as the detection target from the frame image input from the image acquisition unit 111 .

When the object detection unit 112 detects the image of the hand 101 to be detected, the display control unit 115 outputs the key input screen 201 from the projector 30 and displays it on the door (step S104). The displayed key input screen 201 is a screen in which a plurality of key buttons are arranged as shown in FIG. In this embodiment, a key input screen 201 in which 3×3 key buttons are arranged is displayed.

Here, the passkey obtained in advance by the user is an image showing the order of selection of key buttons. For example, as shown in FIG. 8, it is an image in which the order of selection of five key buttons is indicated by arrows. After confirming the passkey image received in step S103, the user moves one hand facing the camera 20 to select a key button. The lock/unlock control device 10 acquires the key input by the user (step S105).

Specifically, based on information such as the size, position, and shape of the hand 101 output by the object detection unit 112, the operation range identification unit 113 detects the area of the camera's field of view corresponding to the entire frame image acquired by the image acquisition unit 111. From 1001, an operation range 1002 that the user uses for operation is specified. After that, the mapping unit 114 maps the operation range 1002 input from the operation range specifying unit 113 onto the key input screen 201 projected by the projector 30 , and maps the coordinates of the operation range 1002 to the coordinates of the key input screen 201 . Generate information. Further, the mapping unit 114 uses the generated mapping information to coordinate-transform the coordinates in the operation range 1002 of the hand 101 into the coordinates in the key input screen 201 and outputs the obtained coordinates of the hand 101 .

Next, the display control unit 115 selects and highlights a key button that matches the coordinates of the hand 101 on the key input screen 201 output from the mapping unit 114 . The key buttons are selected in this manner, and the key authentication unit 117 acquires the key input indicating the order of selection of the key buttons (step S105).

The key authentication unit 117 compares the selection order of the key buttons, which are passkeys generated by the key generation unit 116, with the selection order of the key buttons that match the coordinates of the hand 101 output by the mapping unit 114, and determines whether they match. is executed (step S106). It should be noted that the order of selection of the key buttons, which are passkeys, is preferably an order in which a plurality of key buttons arranged on the key input screen 201 can be selected from the outside with a single stroke. This is because it is easier for the user to select and the possibility of erroneous operation is reduced.

Then, the locking/unlocking control unit 118 performs locking/unlocking control to unlock the door when the authentication result output by the key authentication unit 117 is successful, and to keep the door locked when the authentication is not successful (step S107). ).

In this way, when the user moves the hand 101 based on the pre-notified passkey to input the passkey, the lock/unlock control device 10 can execute authentication processing for the input passkey.

As described above, in the present embodiment, the communication unit 14 notifies the user in advance of the pass key for unlocking the door, and when the user faces the key input screen 201, the operation range specifying unit 113 detects the camera. The operation range 1002 used by the user for operation is specified from the visual field area 1001, the mapping unit 114 generates mapping information for mapping the operation range 1002 on the key input screen 201, and the target detection unit 112 detects using the mapping information. The coordinates of the position of the hand 101 are converted into the coordinates of the key input screen 201, and the key authentication unit 117 acquires the user's key input based on the converted coordinates of the hand 101. FIG. The lock/unlock control unit 118 determines that authentication has been established when the order of selection of the key buttons by the user matches the order of selection indicated by the passkey, and performs unlocking control. As a result, the simple operation of moving the hand 101 in a touchless manner makes it possible to reliably execute the authentication process, and only the authenticated person can safely unlock the door.

(Embodiment 2)
Embodiment 2 of the present invention will be described in detail with reference to the drawings.

The locking/unlocking control device 10 according to the present embodiment has the same configuration as that of the first embodiment, and executes the same locking/unlocking control process, but the contents of the passkey are different. The contents of the passkey will be explained in detail.

In this embodiment, the processing shown in the flowchart of FIG. 6 is executed in the same manner as in the first embodiment, but the passkey generated in step S102 is a numeric string. For example, it is "43971" consisting of five numbers, and this number string is transmitted to the user's portable terminal 50 in step S103.

The key input screen 201 displayed in step S104 is a screen in which key buttons with numbers are arranged. At this time, it is preferable to arrange the numbers so that when the numbers are selected in the order of the number string of the passkey, they are selected from the outside with a single stroke. For example, numbers 439/817/265 are arranged in order from the upper left as shown in FIG. In this case, when the user performs a key input operation according to the pass key "43971", selection can be made from the outside with a single stroke as shown in FIG. This number arrangement may be changed for each user or for each authentication process.

The key input is acquired (step S105), the subsequent authentication process (step S106), and the locking/unlocking control (step S107) are the same as those in the first embodiment. That is, when the order of numbers selected by the user's key button matches the order of the number string included in the passkey notified to the user in advance, it is determined that the authentication has been established, and unlocking is executed. .

As described above, in the present embodiment, the passkey transmitted to the user in advance is composed of a string of numbers, and display control unit 115 displays key input screen 201 in which key buttons containing numbers are arranged. When the order in which the numbers of the key buttons are selected by the user's operation matches the number string of the passkey, it is determined that authentication has been established, and control is performed to unlock the door. As a result, only the number string is notified to the user, so the amount of data to be transmitted is small, and by changing the arrangement of the numbers on the key input screen 201, it becomes difficult to guess the shape of a single stroke, improving the security level of authentication. It is possible to

(Embodiment 3)
Embodiment 3 of the present invention will be described in detail with reference to the drawings.

The locking/unlocking control device 10 according to this embodiment has the same configuration as that of the first embodiment, but as shown in FIG. It differs in that it communicates with the application server 70 . Another difference is that the lock/unlock control device 10 does not include the key generation unit 116 because the application server 70 generates the passkey.

The operations of the lock/unlock control device 10, the user's portable terminal 50, and the application server 70 will be described with reference to the flowchart shown in FIG. FIG. 12 is a flowchart showing processing of the lock/unlock control device 10, the user's portable terminal 50, and the application server 70. As shown in FIG.

First, the user acquires the passkey of the door that the user will pass through. Specifically, the mobile terminal 50 of the user transmits the identification information of the user and the identification information of the door to the application server 70 (step S201), and requests the passkey (step S202). When the application server 70 permits the user to pass through the door, a passkey is generated (step S203), and the passkey is transmitted from the application server 70 to the mobile terminal 50 and the lock/unlock control device 10 (step S204). Here, the passkey to be transmitted is the image indicating the selection order of the key buttons described in the first embodiment or the number string described in the second embodiment.

After transmitting the passkey, the application server 70 instructs the lock/unlock controller 10 to start authentication processing (step S205). The camera 20 of the lock/unlock control device 10 continues photographing. In the lock/unlock control device 10, upon receiving an instruction to start the authentication process from the application server 70, the image acquisition unit 111 acquires frame images at predetermined timings included in the image data captured by the camera 20 at predetermined time intervals. Output to the object detection unit 112 . The target detection unit 112 detects the image of the hand 101 as the detection target from the frame image input from the image acquisition unit 111 .

When the object detection unit 112 detects the image of the hand 101 to be detected, the display control unit 115 outputs the key input screen 201 from the projector 30 and displays it on the door (step S206).

After confirming the passkey received in step S204, the user moves one hand facing the camera 20 to select a key button. The lock/unlock control device 10 acquires the key input by the user (step S207).

Specifically, based on information such as the size, position, and shape of the hand 101 output by the object detection unit 112, the operation range identification unit 113 detects the area of the camera's field of view corresponding to the entire frame image acquired by the image acquisition unit 111. From 1001, an operation range 1002 that the user uses for operation is specified. After that, the mapping unit 114 maps the operation range 1002 input from the operation range specifying unit 113 onto the key input screen 201 projected by the projector 30 , and maps the coordinates of the operation range 1002 to the coordinates of the key input screen 201 . Generate information. Further, the mapping unit 114 uses the generated mapping information to coordinate-transform the coordinates of the hand 101 in the operation range 1002 into the coordinates of the key input screen 201 and outputs the obtained coordinates of the hand 101 .

Next, the display control unit 115 highlights key buttons that match the coordinates of the hand 101 in the coordinates of the key input screen 201 output from the mapping unit 114 . The key buttons are selected in this manner, and the key authentication unit 117 acquires the key input indicating the order of selection of the key buttons (step S207).

The key authentication unit 117 compares the selection order of the key buttons, which are passkeys generated by the application server 70, with the selection order of the key buttons matching the coordinates of the hand 101 output by the mapping unit 114, and determines whether they match. An authentication process for determination is executed (step S208).

Then, the locking/unlocking control unit 118 performs locking/unlocking control to unlock the door when the authentication result output by the key authentication unit 117 is successful, and to keep the door locked when the authentication is not successful (step S209). ). The lock/unlock controller 10 transmits the authentication result to the application server 70 (step S210).

In this way, when the user inputs the passkey by moving the hand 101 in a non-contact manner based on the passkey generated by the application server 70, the lock/unlock control device 10 authenticates the input passkey. can be executed.

As described above, in the present embodiment, the application server 70 notifies the user's portable terminal 50 and the lock/unlock control device 10 of the passkey for unlocking the door, and the user inputs the key on the key input screen 201. , the lock/unlock control device 10 determines that the authentication has been established when the order of selection of the key buttons by the user matches the order of selection indicated by the passkey, and performs unlocking control. As a result, by a simple operation of moving the hand 101 in a touchless manner for a plurality of doors provided with the locking/unlocking control device 10 capable of communicating with the application server 70, the authentication process can be reliably executed, and the authenticated person can be authenticated. can only be unlocked safely.

As described above, according to the present invention, the lock/unlock control device displays a key input screen in which a plurality of key buttons are arranged, detects the position of a detection target related to a user's operation, and based on the position of the detection target, displays a plurality of key buttons. The key buttons selected from the key buttons are determined, and locking or unlocking is controlled according to the order of selection of the key buttons. This makes it possible for only an authenticated person to safely unlock the door through a simple touchless operation.

It should be noted that the present invention is not limited to the above-described embodiments, and various modifications are of course possible without departing from the gist of the present invention.

For example, in Embodiments 1-3 above, the key input screen 201 is displayed on the automatic glass door by rear projection, but it may be displayed by any display method. For example, as shown in FIG. 13, it may be displayed on a display 202 provided on a wall or a display 203 provided on an operation panel.

Further, in Embodiment 1-3, the key buttons on the key input screen 201 are arranged in a 3×3 arrangement, but the arrangement is arbitrary. For example, it may be 2×2 or 4×4. The security level improves as the number of arrays increases.

Further, in Embodiments 1-3, the position of the user's hand 101, which is the detection target, is detected based on the frame image captured by the camera 20, and the selected key button is determined. may be used to detect the position of the hand 101 . For example, a laser or infrared sensor may be used to detect the position of hand 101 .

Also, in the second embodiment, the numbers are displayed on the key buttons of the key input screen 201, but the numbers may be displayed at other positions. For example, it may be distributed to the user on paper, posted on a wall, or transmitted to the mobile terminal 50 of the user.

Further, by causing an information terminal such as an existing computer to execute the processing program executed by the CPU 11, the information terminal can function as the locking/unlocking control device 10 according to the present invention.

Any method can be used to distribute such a program. may be stored and distributed in the , or may be distributed via a communication network such as the Internet.

10... Lock/unlock control device 11... CPU
12 RAM
DESCRIPTION OF SYMBOLS 13... Storage part 14... Communication part 15... Input/output part 20... Camera 30... Projector 50... Portable terminal 60... Internet 70... Application server 101... Hand 111... Image acquisition part 112... Object detection part 113... Operation range specification part 114 Mapping unit 115 Display control unit 116 Key generation unit 117 Key authentication unit 118 Lock/unlock control unit 201 Key input screen 202, 203 Display 1001 Visual field region 1002 Operation range

Claims (11)

a display control unit for displaying a key input screen in which a plurality of key buttons are arranged;
an object detection unit that detects a position of a detection object related to a user's non-contact operation from an image captured by a camera in a direction away from the key input screen of the user facing the key input screen;
Mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen is generated, and the coordinates of the detection target detected by the target detection unit in the operation range are mapped to the a mapping unit that converts to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted by the mapping unit , and locking or unlocking is performed according to the order of selection of the key button. and a locking/unlocking control unit that controls
Lock/unlock control device. The lock/unlock control unit executes unlocking when the order of selection of the key buttons matches the order of selection of the key buttons included in the passkey notified to the user in advance.
The locking/unlocking control device according to claim 1. A number is associated with each of the plurality of key buttons,
The lock/unlock control unit executes unlocking when the order of selection of the numbers of the key buttons matches the order of the number string included in the passkey notified to the user in advance.
The locking/unlocking control device according to claim 1. The order of selection of the key buttons is an order in which the plurality of key buttons arranged on the key input screen can be selected with a single stroke from the outside.
The locking/unlocking control device according to any one of claims 1 to 3. The passkey issued in advance by request from the user's terminal is valid only for a predetermined time or number of times.
The locking/unlocking control device according to any one of claims 1 to 4. The key input screen is displayed by a projector projecting an image onto the door.
The locking/unlocking control device according to any one of claims 1 to 5. Further comprising a communication unit that performs communication with the user's terminal,
when a passkey is requested from the user's terminal, the communication unit transmits the passkey to the user's terminal;
The locking/unlocking control unit determines a key button selected from the plurality of key buttons based on the position of the detection target detected by the target detection unit, and the selection order of the key buttons is transmitted by the communication unit. Execute unlocking if it matches the passkey that was entered,
The locking/unlocking control device according to any one of claims 1 to 6. further comprising a communication unit that performs communication with the server;
when the user's terminal requests the server for a passkey, the server transmits the passkey to the communication unit and the user's terminal;
The locking/unlocking control section determines a key button selected from the plurality of key buttons based on the position of the detection target detected by the target detection section, and the selection order of the key buttons is determined by the communication section. Execute unlocking if it matches the received passkey;
The locking/unlocking control device according to any one of claims 1 to 6. The display control unit highlights a key button that matches the coordinates of the detection target on the key input screen converted from the coordinates of the detection target in the operation range.
The locking/unlocking control device according to any one of claims 1 to 8. a display control step for displaying a key input screen in which a plurality of key buttons are arranged;
a target detection step of detecting a position of a detection target related to a user's non-contact operation from an image captured by a camera of a user facing the key input screen in a direction away from the key input screen;
generating mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen; a mapping step of converting to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted in the mapping step , and locking or unlocking is performed according to the order of selection of the key button. and a locking/unlocking control step to control,
lock/unlock control method; the computer,
a display control unit that displays a key input screen in which a plurality of key buttons are arranged;
A target detection unit that detects the position of a detection target related to a user's non-contact operation from an image captured by a camera in a direction away from the key input screen of the user facing the key input screen;
Mapping information for mapping an operation range in which the user's operation is effective in the field of view area of the camera to the key input screen is generated, and the coordinates of the detection target detected by the target detection unit in the operation range are mapped to the a mapping unit that converts to coordinates on the key input screen using mapping information;
The key button selected from the plurality of key buttons is determined based on the coordinates of the detection target on the key input screen converted by the mapping unit , and locking or unlocking is performed according to the order of selection of the key button. a locking/unlocking control unit to control,
A program that acts as a

Images