JP2005063077A - Method and device for personal authentication and connector - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method, a device and a system for personal authentication that are installed in communication terminal equipment such as a camera cellphone to perform personal authentication only within the equipment to keep individual information and privacy information from being disclosed, thus contributing to constructing a sound information society. <P>SOLUTION: A camera cellphone 200 with a camera 108 and an imaging flash device 109 has an authentication part tag 300 with an original image recording device 301, an authentication face image data processing part 302, an image collation device 305, a collation determination result storage device 306, and a collation determination result adding/sending device 307. The authentication face image data processing part 302 has an animation recording device 303 and a still image selection device 304. The original image recording device 301 records one's own face image that the owner or exclusive possessor of the camera cell phone first took upon coming to possess the cell phone. The collation determination result adding/sending device 307 is provided which sends collation determination results to a communication partner who requests authentication. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an individual required for verification when performing personal authentication requested by a service provider via a public communication network using personal information for verification recorded in advance on a recording medium occupied or owned by the individual. It is possible to perform personal authentication without transmitting iris information, fingerprint information, voiceprint information, gene information, etc., in addition to facial image information, which is biometric information, which is information, that is, without revealing personal information or privacy information. The present invention relates to a personal authentication method, a personal authentication device, and a connector that contribute to the construction of a good information society.

  Mobile phones and information terminals are now used for financial operations such as sending and receiving e-mail, teleshopping, and bank transfers, and social contract procedures, and authenticate whether or not the terminal device is actually operated. It has become important to do.

  In general, a method for recognizing a terminal user has generally been such that a service provider who requires personal authentication stores information identifying an opponent for whom personal authentication is requested, for example, an ID number, a password, a fingerprint, etc., in advance as his own database. The identity of the person in question is stored in a third-party organization that manages the information independently from the other party and collated with the personal identification information sent from the other party via communication when a transaction settlement is required. It is premised on how to confirm.

  Therefore, in the conventional authentication system, it is necessary to provide information for identifying an individual necessary for identity verification to the other party as a service provider before a specific transaction occurs.

  Conventionally, there have been many cases where key identification and ID (Identifier) number are input to confirm the identity, but recently, an authentication method using biometric information has begun. In contrast to authentication methods that use passwords and ID numbers, there is still a strong public resistance to sending biometric information, which is the most privacy-related information, such as fingerprints, irises, facial photos, and genetic information to the other party over the Internet. In addition, it is an individual to provide personal identification information for pre-authentication to the other party, excluding commercial transactions or administrative procedures where certain purposes are mutually confirmed in procedures such as electronic payment, etc. While it is pointed out that it conflicts with the Information Protection Law or the Personal Information Protection Ordinance established by local governments nationwide, there is still a lot of risk of leaking personal information because there are still many unknown parts in the management system.

  On the other hand, as an authentication method using biometric information that has been put into practical use so far, a method of registering the user's biometric information in an information terminal device and restricting the operation of the device has been proposed so far, and the operation of the information terminal itself In addition to the above-mentioned method, there are many that perform pseudo authentication by restricting access to the outside. This authentication method is based on the assumption that the person who operates the information terminal device is responsible for the settlement of the transaction.

JP 2000-259828 A JP 2001-273498 A Shin Kosugi, “Finding and locating faces in scenes using multiple pyramids for personal identification”, IEICE Transactions, Vol. J77-D-II, No. 4, pp. 672-681, April 1994 M.H.Yang et al "Detecting Faces in Images: A Survey" IEEE Tans. On Pattern Analysis and Machine Intelligence, Vol.24, No.1, Jan. 2002.

  Among the conventional authentication methods, the identity verification based on the ID number or password and the personal authentication method are set depending on the human memory, so the risk of decryption and leakage is inevitable. In addition, it is possible for a third party to be easily impersonated by requesting someone else to act as a message or act, and only the person remembers the payment procedure that the person operating the information terminal is a legitimate user. It is only a pseudo-authentication method that is intended to be established with a password that is assumed to be established.

  In the authentication method based on the method of providing personal information to the outside in advance, registering biometric information that identifies an individual with a company or government agency that is an authentication requester is highly resistant to the public, and companies and government agencies communicate with each other. There is an opinion that requesting the other party to provide personal information on the precondition of providing services through the line should be avoided as it violates personal privacy and basic human rights.

  Requesting the provision of personal identification information to the individual in advance through the network on the assumption that the electronic payment is performed by the individual can be regarded as a request using a superior position in business. If an individual requests registration of personal information as necessary for the transaction procedure via communication, and the personal information provided by himself / herself is used for purposes other than those disclosed by the other party, This is because a method for confirming the fact according to the intention has not been established, and therefore the risk of using personal identification information for other purposes to the other party who provided the personal information cannot be avoided.

  From the viewpoint of the Personal Information Protection Law, the method of authenticating the user by registering personal information in the information terminal on the user side is safe from the viewpoint of the user because there is no risk of personal information leaking outside. is there. On the other hand, from the viewpoint of the authentication requester, the identity verification procedure performed in the information terminal or the connection terminal is merely self-reporting and is merely an extension of the authentication procedure for the information terminal device. It is doubtful whether it will become a requirement against a third party as a social certification.

  Technologies for verifying identity using biometric information unique to each person, such as faces, irises, retinas, fingerprints, palm prints, voice prints, genes, etc., have already been put into practical use around the world. However, in identity verification and personal authentication using biometric information, it is necessary that the person trying to identify the person in advance acquire biometric information for verification from the other party and store it as a database. When confirming, the person must input the personal information specified in any information terminal connected to the communication network, and send the data to the other party. It is difficult to ensure the safety of personal information protection.

  One of the problems is that it is impossible to prevent a partner who has registered by providing personal information from being used for other purposes against his will. Once biometric information that allows the person to be identified permanently is registered externally, the other party will be personally admitted to the third party regardless of the intended or unintentional reasons such as theft, falsification, processing error, management error, and illegal removal. It is virtually impossible to cancel the spread personal information socially due to information leakage accidents and crimes. Moreover, when the other party uses it for other purposes without permission, the person himself / herself may not have a way to confirm and stop the fact.

  Another problem is that if the person is forced to send his / her personal information when requested to verify his / her identity, the other party who made the request will receive 1) unauthorized access, 2) impersonation of others, ) Password theft 4) False conditions and violations of certification conditions 5) System breakthrough and destruction 6) Picking of communication data by third parties 7) Tampering of communication data by third parties 8) Access obstruction, 9) Unauthorized use of personal information sent upon request unless there is no illegal activity such as denial of access, there is no impersonation on the other side, and the security of the communication network is not completely guaranteed The danger of being unavoidable.

  In the advanced information society, various contracts are performed using communication means, so it is urgent to establish an authentication method through communication means that assumes non-face-to-face instead of the authentication method that has been established by face-to-face. It has become. Identity verification on the premise of face-to-face is a method of requesting presentation of materials that can identify the person (e.g., driver's license, passport, etc.) that can be identified to the person being faced, and an answer that only the person can know. This is done by asking questions.

  In the past, devices such as passwords and IC cards registered in advance have been used to verify the identity of the user via communication means. However, it is only authentication of access authority using the device as a key, and it was difficult to completely prevent intentional impersonation and crime. Recently, it has been recommended to use biometric information as a more reliable authentication means than passwords and IC cards in order to make up for the defects, and it has been adopted by some companies and government agencies in Japan.

  In an information system that is completed by information communication between information terminals, the responsibility of the system technology is up to the identification of the information terminal device, not the person who operates the information terminal. Currently, when using biometric information to identify the person who operates an information terminal device that has accessed the information system, the biometric information that is ubiquitous in the world is used for biometric information entered by the other party. In order to collate, the service provider requesting identification of the person must acquire and register in advance the biometric information of the requested partner.

  However, personal information acquired under each clause, such as the personal information protection guidelines agreed by the OECD, the Personal Information Protection Law established in Japan, and the Personal Information Protection Ordinance established by nearly half of the local governments in Japan, Because it is expressly prohibited to use for other purposes without confirmation, contracts that may occur in the future will make it impossible for any company or company to live in a highly developed electronic society in the near future. Either the biometric information is registered in advance in the organization, or the consent to use the personal information once registered in some organization for other purposes is given to all service providers.

  Even if you set a condition to give consent to the use of personal information for identity verification to the other party that is the service provider every time payment is requested via communication means, The inconsistency that the personal information of the person must be provided in advance for the authentication that “the person is the person”.

  For most citizens, it is true that personal information is unwilling to be used for other purposes, and the other reason for using personal information collected globally is considered a criminal act. is there. To this end, countries around the world, including Japan, place certain restrictions on the handling of personal information. However, if the highly information-oriented society is still using the common identity verification and personal authentication methods, electronic payments will be made. In identity verification and personal authentication in Japan, the regulations and restrictions must be fundamentally established.

  The present invention establishes a personal authentication method and a program execution system for solving such a fundamental contradiction.

  In general, we have two ways to prove your identity: presenting your ID card and getting a guarantee from a third party or person. The other party confirms the presented ID and the contents of the guarantee by a method determined by himself / herself, and then authenticates based on his / her judgment criteria. If the person accepting this personal identification determines that the presented item or the person who guarantees it is insufficient, the person who asks the other party will ask for a more certain guarantee for the other party and ensure the authenticity of the authentication as much as possible. try to.

  If this procedure is considered as a non-face-to-face authentication method, we will endeavor to present the material that proves the identity of the person as much as possible, and prepare a means to guarantee the legitimacy of the material. There is no choice but to find a balanced solution among the actions of each other by taking the steps to avoid the risk and judging the presentation. The recognition that the fact that requesting the other party's fingerprints and palm prints in ordinary transactions and contracts in society so far was an anti-social act, is permissible as an electronic payment method in the information society. Therefore, the personal authentication method based on the antisocial rules must be deceived.

  The present invention realizes a personal authentication method and a program execution system that solve the contradiction of the current authentication method that is made based on such a premise.

  The verification method using biometric information that can accurately identify the person is an extremely effective authentication means for those who require a strict authentication result, but the person who is authenticated does not want to use it psychologically or human rights From the standpoint of protection, many people say that use should be denied.

  The biometric information is information that should be presented to the other party on its own will, and is not easily left under the control of the other party.

  We live in a society where various contractual relationships occur, and by providing biological information for each aspect, there is a possibility that some organizations and organizations can accurately grasp individual behavior and ideas I will let you. As a result, humans are likely to feel more and more uneasy as if they were forced to engage in unequal human relationships just by feeling the possibility of unilaterally controlling the behavior and activities of an individual.

  The present invention makes it unnecessary to register personal information, which is biometric information, to a partner who requests personal authentication based on biometric information (face, iris, retina, fingerprint, palm print, voice print, gene, etc.) that can identify an individual. Personal authentication method, personal authentication device, connector, personal authentication system, authentication tag, and vehicle, machine, electrical appliance, vending machine, chip, special purpose machine, machine tool, other machine equipped with the authentication tag An object of the present invention is to provide a business method that realizes the authentication mechanism. Using personal information for verification recorded in advance for personal identification on the information communication terminal used by the individual, personal identification and personal authentication can be performed without transmitting personal information that can identify the individual to the outside. This is a system that uses biometrics personal information (face, iris, fingerprint, voiceprint, gene, etc.) that can be used to identify individuals in electronic payment procedures that require identity verification via an information communication network. Personal authentication method, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, machine, electrical appliance, vending machine, chip, dedicated machine The object is to provide machine tools, other machines, and business methods that realize such an authentication mechanism.

  The present invention that realizes an information communication environment that can authenticate each other without sending personal information to the outside without doubt that information terminals that we use in the ubiquitous era will increase around our lives Is an indispensable technology for the health of the information society.

  Through the development of image collation devices, methods, and systems such as camera-equipped mobile phones without externally transmitting face image data, the present invention provides biometric information such as face images as a means of identity verification that is indispensable for a contracting action via a communication network. The purpose is to solve the public's anxiety such as leakage of personal information by completing the verification procedure in the information terminal under the occupation of the individual and sending only the verification result.

  In the present invention, by inputting biometric information that can be specified by an individual into an information terminal, the person is verified against original information that can be specified by an individual registered in the terminal in advance, and the result is the basis for the verification. A system for transmitting the result of confirming that original information has not been tampered with or replaced, and a personal authentication method, a personal authentication method, and a program execution system for realizing the apparatus and method.

  The personal authentication system according to the present invention is first described by a personal authentication method using a face image and a mobile phone with a camera, but the system that does not transmit biometric information to the outside is a face, iris, retina, fingerprint, palm print, Information unique to each person, such as voiceprints, genes, etc., is established with exactly the same authentication method even if there are differences in personal information input devices. The fundamental principle is that the adopted biological information is stored in an information terminal device that is occupied or owned by the person or an expansion terminal that is used by connecting to the device, and is not transmitted to the outside. Only the falsification prevention verification information that proves the originality is registered with an external third party, and the result of identity verification using the information terminal and only the non-falsified proof data are transmitted to the other party.

  The identity verification and personal authentication method using a camera-equipped mobile phone using face images is connected to the mobile phone body inside the camera-equipped mobile phone that can be specified by the owner or the occupant or the external connection terminal of the camera-equipped mobile phone. A storage unit for storing facial features captured as feature original data for personal verification, an imaging unit for capturing facial images with the camera of the camera-equipped mobile phone, and verification from the facial images An extraction unit that extracts a facial feature upon request, a matching unit that collates the feature original data with the facial feature upon request, a first transmission unit that transmits the face information matching result to a service provider, and the feature original The data obtained by encoding the face image at the time of first use used for creating the data is a falsification preventing code original data that proves that the feature original data has not been falsified. And a second transmission unit that transmits to the third party as a data, and a third transmission unit that transmits data obtained by encoding the facial feature at the time of the verification request to the third party as tamper-proof code verification data A mobile phone, a falsification-preventing code original storage unit that stores the transmitted falsification-preventing code original data, and a falsification-preventing collation unit that collates the falsification-preventing code original data with the transmitted falsification-preventing code collation data. A third-party organization including a falsification preventing collation result transmitting unit that transmits the falsification preventing collation result that is the collation result to the service providing destination, and a first receiving unit that receives the transmitted face information collation result And a second receiving unit that receives the transmitted falsification preventing collation result, and a determination unit that determines the authenticity of the collation requester from the face information collation result and the falsification preventing collation result. It has and a test destination.

  The biometric information used in the authentication method using the face image and the camera-equipped mobile phone may be any information of iris, retina, vein pattern, fingerprint, palm print, voice print, gene, and the personal authentication method according to the present invention. The program execution system does not change.

  That is, the said subject is solved by the following this invention.

  Storing the facial features of the user of the camera-equipped mobile phone in the camera-equipped mobile phone or in the connector or computer connected to the external connection terminal of the mobile phone as feature original data for personal verification; A step of capturing a moving image with a camera of a camera-equipped mobile phone, a step of extracting facial features from the moving image, a step of comparing the original feature data with the facial features, and a step of transmitting the comparison result to the other party A personal authentication method for performing identity verification by connecting to a camera-equipped mobile phone, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and a vehicle equipped with the authentication tag , (Various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, To, business method that achieves the mechanism of such certification.

  A step of encoding the face image data used to create the feature original data, and a step of storing the encoded data as a falsification-preventing code original that proves that the feature original data has not been falsified. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine , Chips, special-purpose machines, machine tools, other machines, and business methods that implement such authentication mechanisms.

  Encoding the feature original image information (feature original data), obtaining falsification prevention information for proving that the feature original information has not been falsified, and using the communication means to transmit the falsification prevention information to a third party A personal authentication method, a program execution system, and a personal authentication device, further comprising: storing the information into a third party; and transmitting the anti-tampering verification information obtained from the information stored at the time of verification to the third party. , Connectors, personal authentication systems, authentication tags, vehicles equipped with the authentication tags, (various) computers, machines, electrical appliances, vending machines, chips, dedicated machines, machine tools, other machines, and such authentication Business method that realized the mechanism.

  The step of storing the original data of the feature includes the step of storing the connector owner or the occupant user by the camera function of the camera-equipped mobile phone at the start of use of the camera-equipped mobile phone or the personal authentication connector or computer connected to the mobile phone. A personal authentication method mounted on a connector or a computer, a program execution system, and a personal computer comprising: a step of imaging a face; a step of extracting a facial feature from the captured facial image; and a step of storing the facial feature Authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, machine tool, other machine, and the like Business method that realizes the authentication mechanism.

  The step of extracting a facial feature from the moving image includes a step of selecting a facial image facing the front from a plurality of images, a step of detecting a frontal face, and a step of extracting the feature. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, Machine tools, other machines, and business methods that realize this authentication mechanism.

  The falsification-preventing code original data is obtained by adding the density of pixels on any one horizontal line of the face image used to create the feature original for collation, and a program execution system Personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, machine tool, other machine, and A business method that implements this authentication mechanism.

  A device connected to the external connection terminal of the camera-equipped mobile phone or a personal identification authentication program built in the connected computer and the mobile phone to transmit data to the outside, and the data sent from the device Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine , Electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  A program for the connector is operated by a power source of a camera-equipped mobile phone, and the program is started using an operation button of the mobile phone, a personal authentication method, a program execution system, a personal authentication device, a connector, and a personal authentication system , Authentication tags, vehicles equipped with the authentication tags, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and businesses that realize such authentication mechanisms Method.

  A personal authentication method, a program execution system, and an individual image obtained by activating an imaging device when the connector is first inserted into a camera-equipped mobile phone and registering an image as an original image in a recording device with a built-in connector Authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, machine tool, other machine, and the like Business method that realizes the authentication mechanism.

  It is programmed so that the original tamper-preventing code data stored in the recording device in the connector is transmitted to an external third party through the mobile phone of the main body and recorded in a dedicated server of the authentication guarantee center. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, Chips, dedicated machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  The falsification preventing code original data is at least one of pixels on any one horizontal line or vertical line of the image related to the characteristic original image information (characteristic original data), or the number of bits of the data related to the characteristic original information. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, automatic Vending machines, chips, special-purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  The apparatus for transmitting the falsification-preventing code original data has a communication destination of an external third party specified in advance, and transmits the data by a data communication function of a camera-equipped mobile phone, and a program Execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, machine tool, other machine And a business method that implements this authentication mechanism.

  The falsification-preventing code original data stored in the connector automatically stores a plurality of data, and the falsification-preventing code original data to be registered with a third party is stored every time the identity verification procedure is performed. A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, a vehicle equipped with the authentication tag, and a (various) computer having a function of replacing data for proving non-falsification of a plurality of originals , Machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  When registering the falsification-preventing code original data with the third party organization, it has a function of registering the number simultaneously with the falsification-preventing code original data by transmitting the registration ID number of the camera-equipped mobile phone or connector or computer to be used. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, Machine tools, other machines, and business methods that realize this authentication mechanism.

  When referring to the falsification-preventing code original data registered with the third party organization, a function of transmitting the registration ID number of the camera-equipped mobile phone or the connector or the computer to be used and checking the number simultaneously with the falsification-preventing code original data Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated Machines, machine tools, other machines, and business methods that realize this authentication mechanism.

  When the original image falsification preventing data is registered by transmitting an image from the camera-equipped mobile phone to the connector for the first time, the falsification-preventing code original data extracted by the program execution device described above is used as the communication of the camera-equipped cellular phone. Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, Machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  Data that proves that the original image received from an external third party has not been tampered with and various information stored in the storage device, including the result of collation in the connector, without turning off the mobile phone communication Personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, automatic Vending machines, chips, special-purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  In communication using the mobile phone, the original image received from an external third party is not falsified while the phone communication of the mobile phone is maintained when the other party of the communication requests identity verification and personal authentication. A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and a personal authentication method capable of packet communication of the data to the other party by combining the data to be verified and the result collated in the connector; Vehicles equipped with authentication tags, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  Data for certifying non-falsification of the original image received from an external third party using the mail communication function of the mobile phone when requested for identity verification and personal authentication in the communication using the mobile phone; A personal authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, which can be sent to the other party together with the mail text created by the camera-equipped mobile phone, with the result collated in the connector And vehicles equipped with the authentication tag, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such an authentication mechanism.

  Individuals who have set a mode that enables various programs in the connector using the operation function of the camera-equipped mobile phone with the connector with the identity verification program execution device plugged into the external connection terminal Authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, work Machines, other machines, and business methods that implement such authentication mechanisms.

  In a personal authentication method and program execution system for causing a program execution device that executes an identity verification program to receive external data, the program execution device and a mobile phone with a camera are connected, and the data received by the mobile phone is converted. A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, a vehicle equipped with the authentication tag, and (various) computers, comprising a relay device for sending to the program execution device , Machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  The relay device includes a device that extracts and stores a still image from moving image data sent from the camera-equipped mobile phone, and a device that converts the data into connector-compatible data that can be collated with an original image. Authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, work Machines, other machines, and business methods that implement such authentication mechanisms.

  The face image data captured by the camera-equipped mobile phone is read by a program that enables execution of collation, and the face image data for collation is extracted from the recording medium recorded as the original and the moving image captured for identity verification. A personal authentication method, a program execution system, a personal authentication device, a connector, and a personal authentication system comprising a chip equipped with a program capable of integrally processing a step of calculating a correct answer rate by specifically comparing with a step , Authentication tags, vehicles equipped with the authentication tags, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and businesses that realize such authentication mechanisms Method.

  A storage unit that stores facial features of a user of a camera-equipped mobile phone as feature original data for personal verification; image data sent from an imaging unit that captures a facial image with the camera of the camera-equipped mobile phone; An extraction unit that extracts a facial feature from the face image when a matching request is made; a matching unit that matches the original feature data with the facial feature at the time of the matching request; and a first result of transmitting the matching result of the face information to a service provider. Transmitter and third party as data for encoding the face image at the time of first use used for creating the feature original data as anti-falsification code original data for proving that the feature original data has not been falsified A camera-equipped mobile phone comprising: a second transmission unit that transmits to an institution; and a third transmission unit that transmits data obtained by encoding the facial feature at the time of the collation request to the third-party organization as falsification-preventing code collation data; A tamper or code, a falsification-preventing code original storage unit that stores the transmitted falsification-preventing code original data, and a falsification-preventing collation unit that collates the falsification-preventing code original data with the transmitted falsification-preventing code collation data A third-party organization that includes a falsification prevention collation result transmission unit that transmits the falsification prevention collation result that is the collation result to the service provider, and a first reception that receives the transmitted face information collation result And a second receiving unit that receives the transmitted anti-falsification collation result, and a determination unit that determines the authenticity of the collation requester from the face information collation result and the falsification prevention collation result A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and the authentication tag. Vehicle, (various) computer, machinery, electrical appliances, vending machines, chip, special-purpose machine, machine tools and other machinery, as well as, business method that achieves the mechanism of such certification.

  The personal verification information is not only a face image but also other biological information such as iris information, retina information, auricle information, fingerprint information, palm print information, vein pattern information, voice print information, and gene information. A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and a vehicle equipped with the authentication tag. Various) Computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and business methods that realize such authentication mechanisms.

  Regarding the reading of the biometric information for personal verification, in addition to the input method using the image capturing function of the face image by the camera of the mobile phone with camera described above, an optical method for capturing fingerprints and palmprint information, an electrostatic method, Individuals who perform identity verification using biometric information imported using input devices with sensor functions such as thermal, electric field, and pressure systems, microphones that capture voiceprint information, and input devices with sensor functions that scan genetic information Authentication method, program execution system, personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, work Machines, other machines, and business methods that implement such authentication mechanisms.

  Camera that can read information, retina information, auricle information, fingerprint information, palm print information, vein pattern information, voice print information, gene information, etc. in addition to facial feature information in place of the camera-equipped mobile phone having the communication means A personal authentication method, a program execution system, which is effective for an information processing apparatus including a device for directly inputting personal information such as a sensor and a numeric keypad and a communication means capable of exchanging communication using an external communication network, Personal authentication device, connector, personal authentication system, authentication tag, vehicle equipped with the authentication tag, (various) computer, machine, electrical appliance, vending machine, chip, dedicated machine, machine tool, other machine, and A business method that implements this authentication mechanism.

  Information processing capable of proving the originality of biometric information for personal authentication by a third-party organization, comprising a device for directly inputting the personal information and a communication means capable of exchanging communication using an external public communication network Vending machines for alcoholic beverages, cigarettes, beverages, etc. equipped with equipment, transportation facilities, automatic ticket machines for entertainment facilities, automatic issuing machines for securities, resident's cards, credit card cash dispensers, ATM devices for financial institutions A personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and Vehicles equipped with authentication tags, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and such authentication Business method that achieves the set.

  The authentication method for matching using a still image extracted from the moving image, and the personal authentication method and the program execution system described above are face images when the service provider or the user himself / herself determines that simple authentication is acceptable. Can be captured as a still image and collated, and it has various authentication functions to connect to camera-equipped mobile phones and their external connection terminals. Capacity) and a personal authentication method, a program execution system, a personal authentication device, a connector, a personal authentication system, an authentication tag, and an authentication tag Onboard vehicles, (various) computers, machines, electrical appliances, vending machines, chips, special purpose machines, machine tools, other machines, and such authentication mechanisms Business methods that were expressed.

  According to the present invention, even when the other party asks for confirmation of identity through communication means, personal information that is privacy information, in particular, information terminal device that manages personal information that can identify an individual permanently, or connected to the device It is possible to establish accurate identity verification without providing personal information to the outside from an extended terminal or recording device, and at the same time, service providers who require authentication do not leave high-risk personal information, It becomes possible to perform identity verification that is indispensable for electronic payment.

  That is, according to the present invention, the following results are achieved.

  Identity verification without externally sending biometric information.

  This technological development is to complete a verification procedure for identifying a person using biometric information in an information terminal held as a means for identifying the person, and to present only the result of the verification to the other party. The original information for verification registered in the information terminal is protected by a mechanism that cannot be rewritten or falsified, but further, the visual confirmation or verification required for verification is possible so that the other party of the communication can verify the identity more reliably. Instead, it is assumed that a third party guarantees the legitimacy of the data that is the original of collation through communication means.

  Prevent the use of personal information by third parties for other purposes.

  Since the biometric information essential for verification is not provided to the other party or a third party using the method described in the preceding paragraph, the other party does not need to store personal information after judging and authenticating the validity of the requested identity verification result. On the other hand, the individual who provided the personal identification information will not have to worry about using personal information prohibited by the Personal Information Protection Law for other purposes.

  Do not pass authentication data to the other party.

  We cannot deny that personal biometric information is an effective means for personal identity authentication, but the premise of using biometric information that can identify the individual should be limited to the extent that it can be controlled by the will and judgment of the individual. . It should be understood from the national sentiment that the biometric information that is the identity verification means must not be registered with the other party because it is necessary for authentication.

  Until now, the driver's license and passport are always under the control of the person at the time of identity verification, and only the necessary part (sealed face photo or signature) is presented to the other party at the request of the other party. They are not entrusted to the other party, and it is unlikely that a person other than the issuer will keep the driver's license or the original passport for verification.

  With the 1948 Universal Declaration of Human Rights, the philosophy of protecting basic human rights as a common value for humankind has already been established in the international community, and the movement toward an advanced information society will accelerate on a global scale. On the other hand, as a social concern, the trend to further strengthen the protection of personal information and establish a legal system is taking root on a global scale.

  The present invention is the most important in electronic payment procedures through communication means, although it is certain that daily payments and contract procedures through communication means will increase rapidly in highly informationized society. Individual authentication without requiring a third party to register biometric information, which is personal identification information, in advance, and without providing personal information itself to an information system that is not under the control of the individual. We are proposing a technology that enables this.

  In the past societies, in the case of settlement of any social contract act, the parties mutually acknowledge the other party as a legitimate party of the contract act by interviewing each other, and the legitimacy of the party by a third party Guarantee of sexuality or a proof act and a certificate proving it, or a proof act by a public institution and a certificate proving it objectively, but in the information society, a concrete procedure to replace such a settlement act Establishment is required.

  Actually, various technologies have been proposed not only in Japan but also in countries around the world, and electronic payments are generally performed using a number of technologies required for authentication. However, by providing various services by many companies, organizations, and individuals, the number of access destinations and the number of access to users who use the services and enjoy the benefits increases, and accordingly it is related to the life and work of the person. It is inevitable that the collected personal information is geometrically accumulated on the network in a form not intended by the service provider's data file or server system, or even by the individual service provider. Therefore, contrary to the will of individuals who use information communication systems and the intentions of individual companies and administrative organizations that provide services, the risk of leakage of personal information is extremely high.

  The present invention realizes an authentication structure capable of electronic payment via communication means without registering any biometric information that can identify an individual outside. This is achieved by data verification by a third party that is a service provider that guarantees the originality of personal information for authentication that is managed by the individual. The present invention provides information terminal equipment (computers, telephones, mobile terminals, information appliances, vehicle control systems, vending machines, ticket vending machines, ticket machines, etc.) that will come in contact with every aspect of daily life expected with the arrival of the ubiquitous era. Without providing personal information to information devices and installation managers that have multiple information access interfaces that combine the functions of information devices (IC cards, memory cards, IC tags, etc.) or both Proving that the thorough pursuit of the convenience of the information society, as well as thorough protection of personal information and establishment of self-management rights of personal information.

Summary of the Invention

A. Device and method required for payment system for identity verification using camera-equipped mobile phone and third-party authentication organization 1) Personal authentication device and method for identity verification using camera-equipped mobile phone 2) For camera-equipped mobile phone Personal authentication tag and identity verification method 3) Credit card payment that cannot be impersonated using a mobile phone (1)
4) Credit card payment that cannot be impersonated using a mobile phone (2)
In the invention relating to the camera-equipped mobile phone and the personal authentication tag, the “original image” and the “collation image” using the face image, which is biometric information for identifying the individual used for identification, are biometric information for identifying the individual. “Fingerprint”, “palmprint”, “vein pattern”, “voiceprint”, “iris”, “gene”, “auricle shape”, “signature shape”, “writing pressure data”, and the like can be described. In that case, the imaging device of the camera-equipped mobile phone described in the present invention is premised on the replacement with the above-described device for inputting each biological information. In addition, the imaging device of the camera-equipped mobile phone, the collation device, the communication device, and the like can completely reproduce the present invention with the same mechanism even in a computer, a digital camera, a PDA, and a smart telephone, and realize exactly the same function.
1) Personal authentication device using camera-equipped mobile phone and identity verification method <System to prove that the owner and user of the mobile phone are the same>
Original image = Facial image information collation image to be stored in the mobile phone = Face image information for collation input by the mobile phone <Configuration for realizing the technical problem of the present invention>
An image capturing device that inputs face image information to a mobile phone An address that specifies a matching result obtained by calculating a correct rate of a matching original image and a matching original image that extracts a plurality of matching images from a captured moving image Cannot tamper, replace, modify, or delete the original image of the communication device to be transmitted. Extract data from the stored original image that proves non-falsification of the original image of the storage device. The device that encrypts the data when sending data that proves the tampering of the original image of the communication device that sends the data to the specified address. After registering the mobile phone number and owner with the phone company, A program for registering image information input by an imaging operation in a storage device of a mobile phone and making it an original image. Device and save with each other.
A device that collates non-falsified data of an original image transmitted from a mobile phone and automatically returns the result to the transmitted mobile phone or a specified destination.
<Proposed method>
Procedure for identity verification: Original non-falsification proof = Operate cell phone with attached certificate to activate identity verification image verification program, verify verification image captured by mobile phone imaging device and stored original image , Calculate the correct answer rate, temporarily store it, extract the non-falsification proof data from the original storage device, send the data to the third party through the communication device, and register it with the third party The result of collation with the data is received, and the correct answer rate temporarily stored in the mobile phone and the received non-falsified proof data are transmitted to the other party.
Procedure for identity verification; with non-falsification proof = operate a third-party certification type mobile phone to start the identity verification image verification program and verify the verification image captured by the mobile phone imaging device and the stored original image The correct answer rate is calculated and transmitted to the other party. On the other hand, the original non-falsification proof data is extracted by operating the mobile phone, and the non-falsification proof data is transmitted to a third party. The third-party organization compares the transmitted non-falsification proof data with the registered non-falsification data, and transmits the result to the designated destination.
Identity verification procedure: No tampering proof = Operate a simple mobile phone to start an identity verification image verification program, verify the verification image captured by the mobile phone imaging device and the stored original image, and correct Calculate the rate and send it to the other party.
2) Personal authentication tag for camera-equipped mobile phone and identification method <System to prove that the registrant and user of the personal authentication tag are the same>
Personal authentication tag = Original device image dedicated to identity verification that is inserted into the external connection terminal of the camera-equipped mobile phone = Face image information collation image that is the original stored in the personal authentication tag = Face for collation entered on the mobile phone Image Information <Configuration for Realizing Technical Problems of the Present Invention>
Mobile phone imaging device that inputs face image information into personal authentication tag Device that extracts a plurality of matching images to be matched with original image from moving image captured by mobile phone Mounted in personal authentication tag that matches original image with matching image Data that proves the non-falsification of the original image of the storage device that cannot be altered, replaced, modified, or deleted from the original image of the communication system that transmits the result of calculating the correct answer rate by collating with the device personal authentication tag. The device that extracts from the stored original image The data that proves non-falsification extracted from the original image of the device is sent to the specified address destination The data is encrypted when transmitting the data that proves that the original image of the communication system is not falsified The image information input by the first imaging operation after being plugged into the external connection terminal of the mobile phone is registered in the storage device of the personal authentication tag and is used as the original image Arm personal non tampering proof data unit to be transmitted in association with the mobile phone number of the authentication tag.
A device that collates non-falsified data of an original image transmitted from a mobile phone and automatically returns the result to the transmitted mobile phone or a specified destination.
<Proposed method>
Procedure for identity verification: With non-falsification certificate = Operate a cell phone with attached certificate, start the image verification program for identity verification of the personal authentication tag inserted into the external connection terminal, and verify the image captured by the imaging device of the cell phone Compare the image with the original image of the personal authentication tag, calculate the correct answer rate, temporarily store it, extract the original non-falsification proof data from the personal authentication tag, and send the data to a third-party organization via a mobile phone communication device To the non-falsified data registered with the third-party organization, and receive the correct answer rate temporarily stored in the mobile phone and the received non-falsified proof data to the other party To do.
Identity verification procedure: With non-falsification proof = Operate a third-party certification type mobile phone, start the image verification program for identity verification of the personal identification tag inserted in the external connection terminal, and take an image with the imaging device of the mobile phone The collated image is collated with the original image of the personal authentication tag, the correct answer rate is calculated and transmitted to the other party. On the other hand, the original non-falsification proof data is extracted from the personal authentication tag by operating the mobile phone, and the non-falsification proof data is transmitted to a third party. The third-party organization compares the transmitted non-falsification proof data with the registered non-falsification data, and transmits the result to the designated destination.
Identity verification procedure: No tampering proof = Manipulate a simple mobile phone to start an image verification program for personal authentication of a personal authentication tag inserted into the external connection terminal, and a verification image captured by the mobile phone imaging device Are compared with the original image of the personal authentication tag, and the correct answer rate is calculated and transmitted to the other party.

3) Credit card payment that cannot be impersonated using a mobile phone (1)
<Mobile phone that guarantees the identity of the owner (registrant) and user by credit card>
Mobile phone = Original mobile phone image with camera that can capture moving images = Face image information collation image to be stored in the cellular phone = Face image information card user for collation entered on a mobile phone = Credit card payment service Card holder = credit card owner card issuer = person who issues a credit card and settles the billed amount Third-party certification body = mobile phone with a mobile phone owner's identity verification function An organization that registers non-falsified data in order to obtain a non-falsification proof of the original image when purchasing or occupying and applying for identity verification.
(Operated by mobile phone company, credit company, insurance company, certification company, other independent company or public organization)
<Configuration for Realizing Technical Problems of the Present Invention>
A function to enter the amount charged to the cardholder with a function to read the cardholder side credit card number, and the cardholder's mobile number can be entered, which can be sent to the card issuer along with the data on the amount charged. The device cardholder who has the function can input the mobile phone number registered with the card issuer directly from the mobile phone. The device cardholder can enter the phone number presented by the device cardholder from the numeric keypad. An image pickup device that inputs facial image information to a mobile phone that can be substituted. A matching result that calculates the accuracy rate of a device original image that matches a matching image with a device original image that extracts a plurality of matching images from a captured moving image. Falsify, replace, modify, and delete the original image of the communication device that automatically sends the message to the mail address specified by the card issuer. Communication that automatically sends data proving non-falsification extracted from the original image of the device extracted from the original image storing the data that proves non-falsification of the original image of the storage device that cannot be stored to the address specified by the card issuer When the device cardholder who encrypts the data when sending data proving non-falsification of the device original image registers the mobile phone number and the owner's personal information with the telephone company, the first imaging operation A device for registering input image information in a storage device of a mobile phone and storing the original image non-falsification proof data transmitted from the mobile phone in association with the mobile phone number by the program card owner who makes the original image.
Personal information of the owner of the mobile phone number on the server device that registers the mobile number described in the application form sent from the person who wishes to own the card issuer side card (name, sex, address, date of birth) A device that automatically confirms that the name is the same as the owner's personal information registered with the telephone company. A secret postcard with a password for starting credit settlement using a mobile phone. Approval of the charge amount from the mobile phone number registered by the device card holder who transfers the charge amount sent from the device card user to be sent to the address and the card user name to the card owner's mobile phone A device that receives verification results of identity verification.
Device third party that receives the original certification result sent by the third party certification body in which the cardholder has registered the non-falsification certification data of the original image and sends the approval result of the billing amount of the previous paragraph to the card user A device that automatically matches the non-falsified data of the original image sent from the certification authority side mobile phone and sends the result back to the mobile phone that sent the result or the address specified by the card issuer.
<Proposed method>
Credit payment procedure: When performing identity verification and third-party authentication, present the mobile phone number to the card user, enter the mobile phone number and the billing amount at the payment terminal at the store, and the card issuer specifies The card center sends the data and the name of the card user to the mobile phone.
Upon receiving the data, the cardholder confirms the billing amount, the store name, and the billing date, operates the mobile phone to start the identity verification image verification program, and matches the verification image captured by the mobile phone imaging device. It compares with the stored original image, calculates the correct answer rate, and sends it to the other party.
The cardholder operates the mobile phone to extract the original non-falsification certification data and transmits the non-falsification certification data to a third party. The third-party organization compares the transmitted non-falsification proof data with the registered non-falsification data, and transmits the result to the other party designated by the card issuer.
The card issuer confirms the original tamper proof sent from the third-party certification body, and then sends a payment completion notification to the card user based on the payment approval data sent from the card holder. The user confirms the data and completes all procedures.
Identification procedure: No tampering proof = Present the mobile phone number to the simplified card user, the card user enters the mobile phone number and the billing amount at the payment terminal at the store, and the card issuer specifies the center The card center sends the data and the card user's store name to the mobile phone by mail.
Upon receiving the data, the cardholder confirms the billing amount, the store name, and the billing date, and operates the mobile phone to return mail to the center designated by the card issuer as an approved certificate.
The card issuer transmits a payment completion notification to the card user based on the payment approval data transmitted from the card holder, and the card user confirms the data and completes all procedures.

4) Credit card payment that cannot be impersonated using a mobile phone (2)
<Authentication tag that guarantees the identity of the owner (registrant) and user by credit card>
Mobile phone = Mobile phone authentication tag with camera that can capture moving images = Authentication tag original image dedicated to identity verification used by inserting it into the external connection terminal of the mobile phone = Face image information collation image that is the original stored in the mobile phone = Mobile phone Face image information card user for verification entered by phone = Credit card payment service card holder = Credit card holder name card issuer = Credit card issuance and settlement of billed amount Performer certification organization = Credit company or an independent organization that certifies the non-falsification of the original image stored in the authentication tag (mobile phone company, credit company, insurance company, certification company, other independent company or public company) It is also possible to operate by a public organization)
<Configuration for Realizing Technical Problems of the Present Invention>
A function to enter the amount charged to the cardholder with a function to read the cardholder side credit card number, and the cardholder's mobile number can be entered, which can be sent to the card issuer along with the data on the amount charged. The device cardholder who has the function can input the mobile phone number registered with the card issuer directly from the mobile phone. The device cardholder can enter the phone number presented by the device cardholder from the numeric keypad. A personal authentication tag that can be substituted and an image pickup device for a mobile phone that inputs face image information to the personal authentication tag for a mobile phone. A device original image and a check image that extract a plurality of check images to be checked from a moving image captured by a mobile phone The card is issued with the result of the correct rate calculated by comparing with the device personal authentication tag installed in the personal authentication tag to be verified. Non-falsification extracted from the original image of the device that extracts data certifying non-falsification of the original image of the storage device that cannot be altered, replaced, modified, or deleted from the original image of the communication system transmitted to the addressee The device cardholder who encrypts the data when transmitting the data certifying that the original image of the communication device that automatically authenticates the data to the address specified by the card issuer A program that registers the mobile phone number and the owner's personal information with the telephone company sent from the issuer, and then registers the image information entered in the first imaging operation in the storage device of the mobile phone as the original image Non-modified program personal identification tag that is inserted into the external connection terminal of the mobile phone and registered in the personal identification tag storage device with the image information input by the first imaging operation as the original image Apparatus for transmitting proof data in association with a cellular phone number.
A device in which the cardholder stores non-falsification proof data of an original image of a personal authentication tag transmitted from a mobile phone in association with the mobile phone number.
Card issuer The mobile phone number on the server device that registers the mobile number described in the application sent from the person who wishes to own the side card in association with the ID number of the personal authentication tag issued to the cardholder A device that automatically confirms that the owner's personal information (name, sex, address, date of birth) is the same as the owner's personal information registered with the telephone company. Device card owner who forwards the bill amount and card user name sent from the device card user who sends the confidential postcard with the password to be sent to the address of the owner of the same A device that receives the verification of the billing amount and the verification result of the identity verification from the mobile phone number registered by.
Upon receipt of the original certification result sent by the third party to whom the cardholder has registered the original image non-falsification certification data or the certification body designated by the card issuer, the card user will receive the approval result of the billing amount in the preceding paragraph. A device that verifies the original image non-falsified data transmitted from the device authentication side mobile phone and sends the result automatically to the address specified by the card issuer or the card issuer.
<Proposed method>
Credit payment procedure: When performing identity verification and third-party authentication, present the mobile phone number to the card user, enter the mobile phone number and the billing amount at the payment terminal at the store, and the card issuer specifies The card center sends the data and the name of the card user to the mobile phone.
Upon receiving the data, the cardholder confirms the billing amount, the store name, and the billing date, operates the mobile phone to start the identity verification image verification program, and matches the verification image captured by the mobile phone imaging device. It compares with the stored original image, calculates the correct answer rate, and sends it to the other party.
The cardholder inserts a personal authentication tag into the external connection terminal of the mobile phone, operates the mobile phone to extract the original non-falsification proof data, and sends the non-falsification proof data to a third party or a certificate authority designated by the card issuer To do. The certification authority collates the transmitted non-falsification proof data with the registered non-falsification data and transmits the result to the other party designated by the card issuer.
The card issuer confirms the original tamper proof sent from the third-party certification body, and then sends a payment completion notification to the card user based on the payment approval data sent from the card holder. The user confirms the data and completes all procedures.
Identification procedure: No tampering proof = Present the mobile phone number to the simplified card user, the card user enters the mobile phone number and the billing amount at the payment terminal at the store, and the card issuer specifies the center The card center sends the data and the card user's store name to the mobile phone by mail.
Upon receiving the data, the cardholder confirms the billing amount, the store name, and the billing date, and operates the mobile phone to return mail to the center designated by the card issuer as an approved certificate.
The card issuer transmits a payment completion notification to the card user based on the payment approval data transmitted from the card holder, and the card user confirms the data and completes all procedures.
B. Security and authentication system to completely change credit card payment B-1 Credit card payment system with distributed security structure using mobile phone This invention realizes a new systematic security system in credit card payment using mobile phone and network To do. Credit card creation based on the card issuer's social credit confirmation and the service provider's identity verification based on the visual recognition of the signature of the person cannot expect a credit creation function corresponding to the Internet age. .

  The card issuer authentication system used for credit card payment is an extremely large centralized management system. As the network era becomes full-fledged and IT technology has permeated the general society, crimes due to card counterfeiting and impersonation are increasing rapidly, and security management against crime damage is maintained with an unlimited amount of capital investment and non-life insurance.

In the future, not only face-to-face card payments so far, but also a significant increase in non-face-to-face electronic payment procedures via communication means is inevitable. The present invention realizes a credit settlement system based on a new personal authentication method that replaces a security management system of a credit card company that is enlarged with the background of the trend.
(1) Arrangement of basic concept and measures, processing, and functions of credit security
(2) Major communication technologies and authentication systems used in credit security
(3) Decentralized payment system to be introduced into credit card system Inventor has protected and utilized personal information in the operation demonstration project of regional information system using multi-use IC card developed in Osaka City from 1998 to 2002 A third-party authentication structure that achieves both

Until now, the structure of daily authentication in our social activities has been generally multi-use, multi-purpose and multi-step. However, an information system such as a credit card, which is based on a huge customer database, and a payment system via communication means have to concentrate multi-stage authentication payments on the management responsibility.
Such an information security system dramatically increases the risk of information leakage and crashes, and at the same time, the settlement procedure between individual card holders and service providers is rapidly becoming more difficult. Rapid expansion continues.

The present invention can completely contain crimes of tampering, eavesdropping, and impersonation of card data by using a multi-stage authentication structure and a plurality of independent communication routes between a service provider and a card holder in a place where a credit card is used. It became possible. At the same time, when verifying the identity of the card holder, a secure and stable authentication system is established under the communication environment via the Internet and general lines by using a database that is distributed between the card issuer and a third party. Is realized.
(1) Arrangement of basic concept of information security The credit card security system consists of communication security and computer security. Communication security is protection during communication from one information system to another, and computer security is protection of information in a computer system. Computer security includes OS security, database management software security, and data security on the card.
○ List of risks subject to information security in credit card payments.
Unauthorized access Impersonation of impersonation passwords / passwords for fraudulent authorization conditions and violations System breaks and destruction Picking of communication data by third parties Tampering of communication data by third parties Denial of access denial access
○ Four basic goals of credit card security measures 1) Confidentiality;
Guarantee that no information can be seen or pulled out by unauthorized persons.

2) completeness;
Ensure data consistency, especially to prevent creation, modification or destruction of data by non-certified individuals.

3) Availability;
Ensure that legitimate users are not unduly denied access to sources such as information sources, computer resources and communication resources.

4) Approved use;
Ensure that information sources are not used by non-certified persons or by non-certified methods.
○ System processing and functions necessary to realize the basic objectives of information security ■ Contents of system processing 1) Guarantee of access qualification (ID):
The identity of the name etc. can be confirmed. For ID confirmation, passwords are common at present, and IC cards are starting to attract attention.
2) Access control:
Prevent unauthorized access to information sources due to unauthorized use, unauthorized disclosure, unauthorized modification, unauthorized disposal, unauthorized instruction issuance, etc.
3) Encryption: (註 1)
Hide data cryptographically.
4) Guarantee of data completeness (identity):
Prevents data values from being changed, such as adding, deleting, or changing data.
5) Non-repudiation of actors:
Prevent parties that have made transactions or communications from denying the act later.

■ Electronic processing function.
1) Digital encryption processing; (註 1)
Digital data is encrypted so that it cannot be read normally.
2) Self-evidence processing:
Prove yourself using your biometrics information.
3) Self-certification processing:
An electronic signature is applied to prove one's own ID (electronic signature).
4) Other person certification process:
Authentication certification is performed electronically by a public institution (electronic authentication).
(2) Authentication mechanism based on information security management technology An authentication mechanism is a mechanism that confirms and guarantees the legitimacy of an information sender for information accessed by an information system. The premise is that the legitimacy regarding the communicated information is secured by information security.
In order for the other party or a third party to confirm the purpose and qualification of access via the information system, the following procedures are generally required.
1) Show unique knowledge such as password, date of birth, phone number, etc.
2) Indicates physical property such as keys and cards. (Electronic signatures such as IC cards can include self-certifiable electronic signatures)
3) Shows the inherent invariant characteristics of biometric information (such as fingerprints). (Biometrics information is biochemical feature information; 註 2)
4) An access history by a third party is shown as evidence that information exists at a specific time. (Electronic time stamps by public institutions, etc.)
5) Indicates an electronic authentication certificate that guarantees the identity trusted by the other party.
○ Problem location and direction of solution / from centralized processing to distributed processing ■ General authentication system using conventional Internet The typical security processing system on the Internet is to transfer funds (transactions) by credit card The world-wide public-key security system called SET (Secure Electronic Transaction) (generally called public-key infrastructure (PKI)) is the mainstream.

  SET was developed jointly by major credit card companies such as VISA and MasterCard to process bank card payments for Internet-based sales. The SET environment consists of card issuers, cardholders, stores, verifiers (financial institutions that support stores with bank card processing), payment gateways (systems operated for payment processing), and authentication that mainly performs authentication. It consists of a bureau.

Here, public key technology is used for authentication of all trading parties and encryption of all confidential transaction data. The encryption protects cardholders by not showing bank card numbers to stores that are at risk of eavesdropping. Several types of certificate authorities are used for PKI of SET.
1) Root certificate authority is entrusted to a trusted third party to issue a certificate to a certificate authority (brand certificate authority) that has jurisdiction over the credit card company.
2) Brand Certification Authority
Owners of brands such as VISA and MasterCard operate this level of certificate authority. Each brand is responsible for managing the certificates they are responsible for.
3) Regional Certification Authority Distributes processing across regions with different brands.
4) Certification authority for cardholders Issue card certificates to other cardholders.
5) Store certificate authority An electronic certificate authority that issues certificates to stores.

In order to safely process industry-settled payment systems using information security, such as SET, it will be necessary to construct a large-scale system on a global scale. There are the following two problems.
・ Each time authentication is performed, personal information is collected in a single authentication system, so personal information is communicated through an open network such as the Internet and exposed to risk of information exploitation.
-The entire system has become a large-scale and expensive system in order to execute a large amount of settlement and authentication processing on a global scale while preventing these risks, and the risk of crashes has also increased.
(3) Construction of a multi-stage authentication system that is trusted on the information system In order for the information system to support multi-purpose and multi-purpose devices and terminals in the ubiquitous era, But we need to build a system that can be used anywhere and anytime. The premise is that the information system must be secure, stable, and inexpensive that anyone and service providers can access with peace of mind, and it is necessary to solve two major problems that arise in SET.

The following is a basic requirement definition of an authentication system that is a prerequisite for development in the present invention.
・ Basic responsibility for authentication belongs to the user, and all progress is based on the user's intention and instructions.
・ Authentication is a hierarchical and decentralized authentication system, and it is assumed that the verification certifier does not have to assume any other authentication responsibilities associated with authentication.
In order to prevent spoofing and fraudulent processing of the service provider and confirmation certifier, the authentication request performs simultaneous multiple request processing that requests a plurality of confirmation certifiers from a plurality of routes at the same time.
-The requester of the certification receives only the result of the certification and takes safety measures not to handle other information such as the original information.
・ Information between each related party is limited to basic information and confirmation results for authentication instructions, ensuring reliability, ensuring a tracking function when problems occur, and generating and accumulating new information. To avoid.
・ Do not generate new personal and system information associated with authentication.
・ Each authentication proceeds independently and the authentication level is separated.

When a system based on the above processing is constructed, an authentication structure close to an authentication method based on human relationships that has been actually performed in our society will be realized on the network.
a) Applicable to all applications by ensuring interoperability
b) System scale can be flexibly constructed from small to large scale by combining small functions and structures (cluster structure)
c) Applicable to any system just by changing the operation procedure
d) Security disruption, such as leakage of personal information, can be effectively prevented by risk distribution.
e) Simplification and clarification of liability and scope of compensation can be realized by sharing responsibility
f) It becomes easy to introduce or add various security services and related products.
g) Ensure portability (flexibility and operability that can be used anytime, anywhere).
h) Easy collaboration and integration between public and private voluntary organizations
i) Easier to apply to the electronic notary office, the ultimate system of public institutions
j) Coordination with various national public certification systems becomes easy
k) Facilitates cooperation with financial authentication mechanisms
l) Flexible combination with other computer systems
m) Ensuring traceability by storing process logs, realizing many benefits such as process operation guarantees and crime / fraud deterrence effects, ensuring extremely efficient information security and protecting personal information It becomes possible.
(Note 1) Types of encryption technology Encryption processing, digital signatures, etc. are performed using so-called encryption technology and are important components when implementing security measures.
The most basic component is called an encryption algorithm, and performs data transformation for encryption and decryption. Encryption transforms plain text that can directly read words and numbers constituting information into unreadable data called cipher text. Decryption means reproducing the ciphertext into the original plaintext. Encryption has two inputs, plaintext data and an encryption key, and decryption requires ciphertext data and a decryption key.

  A typical use of cryptography is for confidentiality. Plain text is unprotected secret data, but the cipher text can be transmitted even in an untrusted environment. This is because if the cipher is of good quality, plaintext cannot be derived from the ciphertext without knowing the decryption key.

There are two types of encryption: symmetric encryption and public key encryption. These two have different characteristics and are used in different security processes.
(1) Symmetric encryption
Symmetric cryptosystems used in commercial networks since the early 1970s have been given a symmetric name because they use the same key for encryption and decryption. Also known as a secret key type encryption.
The most common symmetric cipher is an encryption algorithm called DES, which was adopted by the US Federal Standard in 1977 and is used in Japan to protect financial information. In order to avoid the risk of decryption, DES newly adopted a cryptographic algorithm called AES as a US government cipher in 2001 and is expected to spread all over the world.
(2) Public Key Encryption Public key encryption technology uses two correlated key pairs, one key for encryption and the other for decryption. One key is called a private key because it is kept secret by the system, and the other key is called a public key because it is open to the public. Since one of the keys is made public in this way, it is called public key cryptography.

Public key cryptography has two basic modes depending on whether the public key is used as an encryption key or a decryption key.
One is to use a public key as an encryption key, which is the same as normal encryption processing. However, it is not necessary for each person who communicates to have a different key. The other is to use a private key as an encryption key. Since only the owner can know the private key, it can authenticate the data sender and guarantee the integrity of the message. Called.

  By performing authentication processing using such public key cryptography, electronic signature processing, so-called electronic signature, can be performed.

  Public key cryptography is based on the assumption that it is difficult to solve mathematically, and a typical algorithm is the RSA algorithm invented at the Massachusetts Institute of Technology (MIT).

In a signature based on a public key, the decryption key (the sender's public key) can be held by the recipient without considering security, and the recipient can use it to verify the signature of any message. Yes.
(Note 2) Identification by biometrics (biological characteristics) Biometrics authentication uses biochemical characteristics and personal operational characteristics to electrically authenticate individuals. A biometric reader measures physical characteristics and compares them to specific values. Many biometric technologies have been developed.
(1) Fingerprint recognition (2) Voice recognition (3) Handwritten signature recognition (4) Face recognition (5) Iris recognition (6) Palm shape recognition (7) DNA recognition Other information exchange and electronic commerce on the Internet In order to perform the operation safely, it is important to specify a person who is actually operating at a plurality of terminals, home and office terminals, or a public internet kiosk in a shopping mall.
Biometric information can also be stored on personal media such as IC cards.

  The constituent elements of the technology according to the present invention are as follows. 1. an apparatus for inputting biometric information to an information terminal occupied by an individual; 2. a recording device for registering original information as a basis for verification, and a function for verifying that biometric information registered as an original is falsified or not replaced; 3. A function for comparing and determining biometric information input when it is necessary to verify the identity and registered original information. 4. A function to prove that the registered original is not falsified at the time of identity verification by a third party organization. It has a function of transmitting the verification result to the other party requesting identification.

  Hereinafter, embodiments of the present invention will be described.

(A) Overall System FIG. 1 is a block diagram showing a configuration of a personal authentication apparatus according to an embodiment of the present invention. As shown in the figure, a personal authentication device 100 according to an embodiment of the present invention is included in a camera-equipped mobile phone 200. The personal authentication device 100 includes an original image recording device 101, a face image data processing unit 102 at the time of authentication, an image collation device 105, a collation determination result storage device 106, a collation determination result attachment / transmission device 107, and a camera 108. And an imaging flash device 109.

  The camera 108 and the imaging flash 109 are used to acquire original information for verification for verifying the identity of the owner or exclusive user of the device or to acquire new personal information for verification at the start of use of the device. It is done. Of course, in addition to acquiring information for personal authentication, it can be used for normal photographing. The flash 109 is important because the illuminance is a considerably large point in securing a clear image as an image to be stored. When sunlight or illumination is backlit, the accuracy of verification is reduced.

  The original image recording device 101 records the face image of the user himself / herself that was first taken when the owner or the occupant of the camera-equipped cellular phone occupies the cellular phone, and can be written once and read as necessary However, the video cannot be altered or re-captured. The original image recording apparatus 101 stores the number of bytes related to the video data recorded in the original image recording apparatus 101 separately from the video data, and automatically transmits to a third party if necessary, and stores it. It is possible to provide a mechanism capable of When the manufacturing number determined at the factory shipment stage of the camera-equipped mobile phone 200 is registered with a third party at the time of shipment, the manufacturing number and the data capacity (number of bytes) of the first captured image are combined with the third party. By storing, personal authentication according to the apparatus and method of the present invention becomes extremely accurate, and social reliability can be ensured. The originality confirmation of the biometric information for verification registered by the user in the information terminal can be performed by verifying the data capacity of the biometric information registered by the user at the start of use of the information terminal.

  In the present invention, only the data capacity of the original information recorded in the original image recording apparatus 101 can be transmitted to the outside, that is, a third party, so that the biometric information as personal information is not output from the terminal device occupied by the individual. It is.

  The face image data processing unit 102 at the time of authentication includes a captured moving image recording device 103 and a still image sorting device 104.

  The video collated by the video collation device 105 at the time of authentication is a plurality of images selected by the face image data processing unit 102 from the moving image in order to avoid collation by imaging a dummy still image. This is due to the video. Since there is a risk of impersonation by taking a picture of the owner, it is possible to increase the accuracy of collation by selecting a moving image and collating by selecting multiple images arbitrarily selected from moving images it can.

  When the face of the owner is captured by the camera 108 at the time of collation, the face image data processing unit 102 collates a plurality of images from the captured moving image with the original image registered in the original image storage device 101, and the same person is obtained from both images. If it is determined, the result is stored in the collation determination result storage device 106. The image collation used for collation will be described in detail in the next section.

  When the owner communicates necessary information to a communication partner with an authentication request, the owner sends the information to the partner via the collation determination result attachment / sending device 107 of the stored mobile phone with camera. . Again, in the present invention, only the verification result is sent to the other party of the communication requesting the authentication, and the biometric information itself is not sent out from the terminal device occupied by the individual.

  The camera-equipped mobile phone 200 uses each device and processing unit necessary for authentication provided in the authentication unit 100, and finally confirms whether or not the user is the person using the comparison result. The operation in response to these authentications does not control the operation of the entire camera-equipped mobile phone 200 or a part thereof, but transmits an image collation determination result. Such an operation is not related to the collation result. .

  In the above description, an authentication method is used in which a face image is captured as a moving image and collated using a still image extracted from the moving image, but of course, it can also be captured and collated as a still image. It has a function that can be collated with still images. Furthermore, in the above description, the face image is adopted as the personal information among the biometric information, but instead of the face image or in addition to the face image, a new iris, fingerprint, palm print, retinal information, pinna information, Any of vein patterns, voiceprints, and genetic information may be used. In other words, in addition to the input method using the camera's face image capturing function, an input device having sensor functions such as an optical method, an electrostatic method, a thermal method, an electric field method, and a pressure method for capturing fingerprint and palm print information, voice print information It is also possible to capture biological information using an input device having a sensor function for scanning genetic information and a microphone for capturing genetic information. The information can be set to be used in combination of two or more. Furthermore, it is possible to increase the accuracy of identity verification by adding a password or ID number authentication function.

  The identification result of identity verification using a combination of any one of a plurality of biometric information, for example, personal face image, voice, fingerprint, or authentication result of a specific password or ID number is always a mobile phone with a camera, etc. The biometric information processed by the collation device in the information terminal and used for collation retains a structure that is not communicated to the outside.

  As an apparatus for acquiring iris information, for example, those described in JP-A-11-146507, JP-A-2002-307715, and JP-A-2002-330318 can be used. As an apparatus for acquiring fingerprint information, for example, the apparatus described in JP-A-2001-344544 can be used. As an apparatus for acquiring voiceprint information, for example, a device described in Japanese Patent Laid-Open No. 2000-259828 can be used. In addition, the personal information can be acquired using a known technique, and the acquired biometric information is not taken out of the authentication device, and can be used for the present invention in which only the collation result is output.

  For the sake of convenience, the apparatus and method of the present invention have been described using a personal authentication apparatus mounted on a camera-equipped mobile phone for convenience. However, the identity verification mechanism that is the authentication function of the apparatus and method according to the present invention is described below. Vending machines for liquor, cigarettes, beverages, etc., vending machines for transportation, entertainment, etc. Machines that provide social services, such as machine, securities, automatic issuing machine for resident's card, credit card cash dispenser, ATM equipment of financial institutions, equipment for service provision of operators such as public telephones (unmanned It can also be used widely for service providers. Furthermore, the present invention can be applied to various situations in society where identity verification is required, such as immigration control of foreigners and / or Japanese, identity verification associated with real estate sales / rental contracts, identity verification at hospitals, etc. Simple and accurate personal authentication / identification can be performed.

  Necessary when the external information is used to authenticate the information recorded in the original information storage device using other biological information in addition to the image information recorded in the original image recording device 101 in the information terminal such as a camera-equipped mobile phone. Such information is not personally recognizable information such as face image information. The density of the pixels on one specified line (line 1 in FIG. 6) of the image registered in the feature original data as an image photographed for collation is added by an adder, and the result is accumulated in an n-bit register and overflowed. The upper bits are ignored, and the lower n bits are registered as a falsification preventing code.

  The mechanism that includes a camera-equipped mobile phone and authenticates that it is a specific individual provided on a videophone or mobile videophone is not a function that controls the operation of each terminal based on the result of authentication, but the person who operated and the registered person The fact that the data is collated with images or other biometric information and only the result is externally transmitted to provide data that contributes to the authentication of the other party is realized by using the above-mentioned falsification prevention code This is because falsification, in other words, the originality guarantee is proved by a third party.

  (B) Entire system / Camera mobile phone with external connection terminal

  FIG. 2 is a block diagram showing a configuration of a personal authentication apparatus according to another embodiment of the present invention. As shown in the figure, a personal authentication device 300 according to an embodiment of the present invention is used by being attached to an external connection terminal of a camera-equipped mobile phone 200. The personal authentication device 300 includes an original image recording device 301, a face image data processing unit 302 at the time of authentication, an image collation device 305, a collation determination result storage device 306, a collation determination result attachment / transmission device 307, and a camera 308. And an imaging flash device 309.

  When the use of the personal authentication device 300 is started, the camera 108 and the imaging flash 109 acquire original information for verification for verifying the identity of the owner or the exclusive user of the device, and the personal authentication device 300 acquires the original information as new personal information for verification. Used to acquire a face image. Of course, in addition to acquiring information for personal authentication, it can be used for normal photographing. The flash 109 is important because the illuminance is a considerably large point in securing a clear image as an image to be stored. When sunlight or illumination is backlit, the accuracy of verification is reduced.

  The original image recording device 301 records the face image of the first photograph taken when the owner or the occupant of the camera-equipped cellular phone occupies the cellular phone. The original image recording device 301 can be written once and read as necessary. However, the video cannot be altered or re-captured. In addition, the original image recording apparatus 301 can store the number of bytes related to the video data recorded in the original image recording apparatus 301 separately from the video data, and can automatically transmit and store it to a third party as necessary. It has a possible mechanism. By registering the serial number determined at the manufacturing stage of the personal authentication device 300 at a factory under the control of the producer with a third party at the time of shipment of the product, the person who purchased or secured the product can perform this personal authentication. By transmitting the serial number of the apparatus 300 together with the data capacity (number of bytes) of the first captured image to a third party and storing it, the personal authentication method and the program execution system of the present invention can be performed. In addition to being extremely accurate, social reliability can be secured. When verifying the originality of biometric information for verification registered on an information terminal device that the user occupies, the data capacity of the biometric information registered by the user at the start of use of the information terminal device is verified and already registered The accuracy of the proof can be improved by checking the serial number again when the original serial number and the original proof are requested.

  A feature of the present invention is that biometric information, which is personal information, is not sent out from an information terminal device occupied by an individual, and can be transmitted to the outside, that is, to a third party organization, by falsification recorded in the original image recording apparatus 301. It is only the data capacity of the prevention code original data.

  The face image data processing unit 302 at the time of authentication includes a captured moving image recording device 303 and a still image sorting device 304.

  The video collated by the video collation device 305 at the time of authentication avoids collation by capturing a still image that enables impersonation by a dummy that takes a photograph of the owner's face, and the video captured and collated by the camera 108 of the mobile phone is These are a plurality of videos selected from a moving image by a program preset by the face image data processing unit 302. Since there is a risk of impersonation by taking a picture of the owner, it is possible to improve the accuracy of collation by selecting a still image from a moving image and collating using a plurality of images.

  When the face of the owner is captured by the camera 108 at the time of collation, the face image data processing unit 302 collates a plurality of images selected from the captured moving images with the original image registered in the original image storage device 301, and both images If it is determined that the person is the same person, the result of the comparison is stored in the storage device 306 as numerical data called a correct answer rate. The image collation used for collation will be described in detail in the next section.

  When the owner communicates necessary information to a communication partner who has an authentication request, the owner sends the stored collation determination result to the partner via the collation determination result attaching / sending device 307. As described above, in the present invention, numerical data of only the collation determination result is sent to a communication partner having an authentication request, and the biometric information itself is transmitted from a terminal device that is occupied by the individual. Is a personal authentication method and program execution system that are important not to go out.

  Information terminal device capable of reading information from a connector plugged into an external connection terminal or a connected computer, and a device capable of storing and reading personal information such as an IC card and a memory card in the camera-equipped mobile phone 200 Using the devices and processing units necessary for authentication provided in the authentication unit 300, and finally confirming whether or not the user is the person using the verification result, the operation corresponding to the authentication is performed by the camera-equipped mobile phone. 200 does not control the operation of the whole 200 or a part of it, but controls the camera-equipped mobile phone 200 to transmit the image collation determination result to the other party. Such an operation is not related to the collation result. Is.

  The information terminal authentication unit 300 inserted into the external connection terminal of the camera-equipped mobile phone 200, such as the connector or the connected computer, has a personal identification authentication program built therein. This program is preferably operated by the power source of the camera-equipped mobile phone and activated by an operation button of the mobile phone. In addition, a device for transmitting data to the outside by relaying the personal identification authentication program built in the information terminal authentication unit 300 and the mobile phone 200 is interposed, and the function of the mobile phone is made possible by data sent from the device You may make it do.

  When the information terminal authentication unit 300 is first inserted into the camera-equipped mobile phone 200, an image captured by activating the imaging device may be registered as an original image in the recording device 303 of the information terminal authentication unit 300 such as a connector. desirable.

  The original image stored in the recording device in the information terminal authentication unit is encoded, and is transmitted as a falsification-prevented code original data to an external third party through a connected mobile phone, to the dedicated server of the authentication assurance center. It is desirable to have a program that can be recorded. At this time, it is desirable that a communication destination of an external third-party organization is designated in advance and transmitted by the data communication function of the camera-equipped mobile phone. In addition, when an image is first transmitted from the camera-equipped mobile phone to the information terminal authentication unit such as a connector and the original image information for falsification prevention is registered, the falsification-preventing code original data is transmitted to the camera-equipped cellular phone. A function may be used to automatically send it to an external certificate authority.

  This falsification-preventing code original data is a pixel on any one horizontal line or vertical line of the image related to the original image information (feature original image information, feature original data), or the number of bits of data related to the characteristic original information. It is preferable that it is at least any one. In addition, a plurality of data is automatically stored as falsification-preventing code original data, and the falsification-preventing code original data registered with a third-party organization is stored in a plurality of stored originals each time an identity verification procedure is performed. It is preferable to have a function of replacing data that proves tampering.

  When registering the falsification-preventing code original data with a third-party organization, the registration ID number of the information terminal authentication unit such as a camera-equipped mobile phone or a connector or a computer is transmitted, and the number is referred to as the falsification-preventing code original data. You may have the function to register simultaneously. In addition, when referring to the original tamper-proof code data registered with a third-party organization, the registration ID number of the information terminal authentication unit such as a camera-equipped mobile phone or a connector or a computer is transmitted, and the number is converted into the tamper-proof code. You may have the function to collate simultaneously with original data.

  At the time of authentication, it is stored in a storage device that includes data for proving non-falsification of the original image received from an external third party and the result of collation in the information terminal authentication unit such as a connector without turning off communication of the mobile phone Various kinds of information may be transmitted to the other party in communication together. Data that proves that the original image received from an external third party has not been tampered with and information terminal such as a connector while maintaining the telephone communication of the mobile phone when requested by the communication partner for identity verification and personal authentication It is also possible to enable packet communication of the data to the other party by combining the results collated in the authentication unit. In addition, when requesting identity verification and personal authentication from the other party of the communication, data that proves non-falsification of the original image received from an external third party using the mail communication function of the mobile phone, a connector, etc. A result collated in the information terminal authentication unit may be attached so that it can be transmitted to the other party together with the mail text created by the camera-equipped mobile phone.

  Enables various programs in the information terminal authentication unit such as the connector using the operation function of the camera-equipped mobile phone with the information terminal authentication unit such as the connector equipped with the identity verification program inserted into the external connection terminal A mode may be set.

  An information terminal authentication unit (identity verification authentication program execution device) such as a connector equipped with a personal identification authentication program may be made to receive data from the outside. The execution device and the mobile phone with camera are connected, and the mobile phone You may further have the relay apparatus which converts the received data and sends it to an execution apparatus. The relay device may include a device that extracts and stores a still image from moving image data sent from a camera-equipped mobile phone, and a device that converts the data into data corresponding to the information terminal authentication unit, such as a connector that can be collated with the original image. Good.

  By using a program that enables execution of collation, face image data captured by a mobile phone with a camera is read and recorded as an original, and collation face image data is extracted from a moving image captured for identity verification. A chip equipped with a program capable of integrally processing the step of calculating the correct answer rate by concretely comparing with the step may be incorporated.

  It goes without saying that the types of personal information and the scope of use of the identity verification mechanism, which is the authentication function of the apparatus and method according to the present invention, are the same as in FIG.

  The present invention is a camera-equipped cellular phone or a cellular phone that is attached to a cellular phone and uses a function expansion terminal to convert the functions of these communication terminal devices into a photo ID and a hand-held function necessary for a contract. Should be interpreted as a combination of the two.

  At present, "face photo" is attached to identification cards such as official certificates such as driver's licenses, passports, student ID cards, employee ID cards, some credit cards, cash cards, and other membership cards. . In addition, identification cards such as student ID cards, employee ID cards, driver's licenses, passports, etc. must be viewed by a third party in a format in which the organization to which the person belongs belongs to a school seal, company seal, public safety commission seal, Ministry of Foreign Affairs stamp, etc. It is essential to have an issuer that can be clearly confirmed visually. In addition, especially important certificates such as licenses and passports have been devised so that face photos cannot be tampered with to prevent impersonation.

  These forms of identification are all for the person in front of you to verify your identity while comparing your face with your certificate. Recently, the number of cases accepted as an authentication procedure for copying and faxing is increasing, but this is basically an authentication method based on face-to-face.

  Among the specific purposes targeted by the present invention, the function of the identification card has the following two points.

  (1) Make it possible to set an authentication act in place of identification, regardless of whether the person belongs.

  (2) Realize an identity verification method that does not involve direct interviews using communication means.

  Hanko has the role of an allocation-type guarantee that authenticates each other's will by imprinting on the paper medium received by the other party using a seal that is owned by the principal and that identifies the principal. Have The seal is owned by the person, and the seal is saved by the other party, so that it is possible to prove the existence of the contract act at a later date.

  Among the specific purposes that are the goals of the present invention, the function of Hanko is the following two points.

  (1) Sending the data volume (name engraved on the seal) of the owner's original registration photo to the other party (stamped) will be a certificate confirming the will of the contract.

  (2) Register the data volume of the original registered face photo with a third party (seal registration), and send the data volume via a third party to make a contract with a seal certificate. .

  In order to satisfy the above two functions, for example, a camera-equipped mobile phone terminal to which the present invention is applied will be imaged for the first time only when the imaging mechanism is not used after shipment from the factory. It is important to have a device that can store the face image data of the person to be recorded in the terminal separately into the original photo and the data capacity. In addition, the data capacity is added to the terminal side and at the same time it is transmitted to the outside and stored by a designated third party.

  This function will be explained in the actual procedure flow.

  The following is an example of the functional description of the apparatus according to the present invention, and is a setting of a mobile phone sales store.

  Customer: Do you have a mobile phone that can replace Hanko?

  Clerk: A mobile phone with a camera that can store images. You can also use your ID card.

  Customer: Get it.

  Clerk; I understand. The phone you want will be registered with the center. Then enter your name, date of birth, address and telephone number on this application form. Do you have a driver's license or insurance card, and a stamp?

  Customer: I have a driver's license, but I don't have a stamp.

  Salesclerk; I sell it at the stationery store in the opposite direction. It is 300 yen, but ...

  Customer;

  Clerk; Sorry. With this mobile phone, you do n’t need a stamp or a license, but ...

  ...

  Clerk: Will you give me your existing phone number?

  Customer: Yes.

  Clerk; can I pay the fee by bank withdrawal? The procedure is easy if you use the bank account you are using now.

  Customer: I want to change my account, but is it difficult?

  Sales clerk: If you open a new bank account, it will be sold after opening. If you use another bank account, it will take some time because credit introduction is required for that bank.

  Customer: Ca n’t be helped, or it ’s okay?

  Clerk; Sorry. Recently, the damage caused by impersonation has increased, and it has become very difficult to confirm whether or not the bank account holder is the person, so there are also cases where it is denied.

  Customer: But I heard that if you have this camera phone, you can open a bank account right away.

  Clerk; That's right. Our camera-equipped mobile phones store the manufacturer number, phone number, and data that can be used to confirm who purchased the product at the center, making it easy to verify your identity. I started using this mobile phone at bank counters to verify my identity, and now I can do the same on the Internet.

  Customer;

  Clerk; yes. Please wait for a while.

  After registering the mobile phone;

  Clerk: All the procedures at the center have been completed. You will be able to use it after capturing your face. You can do it yourself later, but if you fail to retrieve it, you have to discard this phone.

  Customer: Is it difficult?

  Clerk; No. Please press this button after pointing the lens on the screen to your face. After the flash is lit, the image for saving will be displayed on the screen. That's it. If you don't like the image, you can shoot again by pressing the button with the red mark on the right. The rest is repeat.

  Customer: That ’s easy. I will do it myself later.

  If you accidentally touch other buttons or perform other operations, you will not be able to save images. In that case, the authentication function cannot be used at all. Of course you can use it as a normal camera-equipped mobile phone, but there are people who often fail and want to replace it, but even if it fails, it cannot be replaced. In that case, you have no choice but to purchase a new one. If it is until the next day of purchase, it will be 10% discount.

  And if you don't do this within 30 minutes of purchase, you will not be able to register the center. In that case, authentication will be made only by telephone, so authentication from the center or outside will not be accepted.

  Customer: If that's the case, I'll go here.

  Clerk; Then, point the lens on the inside of this phone to your face and press the shutter.

  Customer: Yes. Is this it? Bashah.

  Is it okay to use a picture of the face?

  Customer: Yes.

  Clerk; Then press the green call button on the left.

  Customer: Yes ... Registration is complete on the screen.

  That ’s it. Now that you have registered the data volume of the saved image and this phone number in the center, you can now use the authentication function. Do you want to register as a member of the company? If you become a member, you can purchase at a discount when it is stolen or lost, or you can receive an authentication guarantee service when used elsewhere.

  Customer: What is the certification guarantee service?

  Clerk; For example, if a customer suddenly needs to borrow money from a loan company, even if there has been no transaction before, they will be authenticated and applied with this camera phone. We will guarantee your identity, so if your loan company knows our system, you should be able to settle your loan relatively easily. Of course, there are various conditions for borrowing, but if you have a camera-equipped mobile phone terminal, you can also see transaction information with other banks and personal information published by the company you work for. The Normally, this is not possible due to the Personal Information Protection Law, but this phone has a guarantee of identity, so the other party should be able to view personal information with peace of mind.

  Customer: I see. How do you do it?

  Clerk; first call this phone number with the camera phone.

  Customer: Yes ......... Hello.

  Center; Thank you. It is an authentication center. ●● Thank you for using our service. What kind of service would you like?

  Customer: I would like to register as a member.

  Center; I understand. The phone you are using belongs to you.

  Customer: Yes.

  Center; Now, you will have your face photographed with the lens inside the phone. Select the face mark authentication icon from the menu button. "Satsuei OK" is displayed, so press the upper button. Keep shooting for a few seconds until you hear a beep.

  Customer: Yes ... Bashah, Gee Pi.

  Center; Thank you. If you see a face, just press the same button. If it is not visible or blurred, scroll to "Redo" and press the button. When “Satsuei OK” is displayed, press the same button again to take the picture again.

  Customer: I think it ’s okay.

  Center; Thank you. Now press the button above.

  Customer;

  Center: What is on the screen?

  Customer: “Correct”

  Center; so your phone confirms your identity, so press the same button again. The confirmation result is saved on the phone.

  Customer;

  Center; yes. You will see a menu on the screen, but please scroll and click the icon for member registration / confirmation.

  Customer: Yes.

  Center; You are now registered as a member of the Center. I ’ll confirm, but your name is ●● ■■ Husband. My date of birth is August 24, 1968. Is it OK.

  Customer: Yes.

  Center: The customer data we store includes the manufacturer registration number and phone number of the mobile phone you are currently using, your name and date of birth, and your mobile phone. The amount of image data stored on the phone. The name and registration number of the store where the customer purchased. There is no doubt that the shop is the Shinsaibashi Higashi store in Osaka, a XX shop.

  Customer: Yes.

  Center; Later, if the customer loses the phone call, he / she must register information to confirm the identity of the customer. Can you tell me the information you know and know and don't forget?

  Customer: What kind of information is good?

  Center; yes. It can be a number or a letter. Some people register their family's birthday or wedding anniversary, the town where the wife is from, the name of someone in your family, or the name of your pet. Some of you mentioned the name of the school you graduated from or the name of the first love person. It is also possible to register with another phone number.

  Customer: I ’ll leave it on your wedding anniversary. It is May 3, 1987.

  Center; I understand. Although it is rare, we may ask you a question in the sense of confirmation, so it is fine if you can only tell us the date. Last but not least, the menu appears on the screen. Can you scroll and click the send icon? If the transmission is completed after that, the procedure is complete. Thank you very much.

  Customer: No.

  Clerk; That's it. If a customer asks you to verify your identity when you are going to use this mobile phone for electronic shopping, make a bank transfer or transfer, or apply for a trip or concert, Display “correct” on the screen using the same procedure as above, and save. If you are talking on the phone and you are finished talking, click the send icon on the menu to finish the authentication.

  Customer: What should I do for the homepage or mail?

  Sales clerk: In the case of a homepage or when you make necessary writings, you will be asked to confirm your identity. In that case, select the authentication icon from the menu button and click to save the “correct” display in the same way as before, and select the send icon on the menu button to send. After “authenticated (confirmed)” appears on the homepage screen, follow the instructions on the homepage.

  If you want to send a mail, save the mail once, click the authentication icon from the menu, go to the point where “correct” is displayed on the screen, and then click the send icon as it is. The authentication result is attached to the mail saved in the camera phone.

  Customer: I understand.

  If you don't understand, please call me anytime. I will teach you various tricks. However, we will ask you to confirm your identity. I don't want to tell others.

  As described above, in the embodiment according to the present invention, as described above, secret information such as biometric information itself is not directly transmitted and received. Capture and register the original data in the device at the time of purchase, and send the result (probably several bytes of data) of the comparison data to the original data when the verification is necessary. . At the same time, as a guarantee that the original data has not been tampered with, the original encoded data for preventing tampering is created from the captured image of the original data (details will be described later) at the time of purchase of the device. The data is transmitted and stored, and the encoded data for anti-falsification verification that has been subjected to the encoding is created from the captured image data that is captured when the verification is necessary, and is transmitted to the third party organization. The obtained encoded data for anti-falsification collation is compared with the original encoded data for preventing falsification stored in advance, and it is determined whether falsification has been made, and the result is transmitted to the previous service provider side. On the service provider side, the verification result data sent from the service requester side will be received from the third party organization to determine whether or not it has been tampered with. It can be performed. At this time, it becomes possible for the service requester to receive the personal authentication without taking the risk of entrusting the highly confidential information such as biometric information to others.

  In the above description, for example, a face photograph has been described as comparison data used for authentication, but in principle any data can be used as long as it can be used for authentication of the person. Therefore, it is only necessary to have biometrics information, which can be known only to the person himself (cannot have it) or is always worn (or when collation is requested). Specifically, in addition to facial photographs, voiceprints, fingerprints, irises, gene information, and the like can provide similar effects in principle.

  Further, it becomes possible to provide a credit card function to, for example, a camera-equipped mobile phone using third-party authentication. The following is an explanation of an example of the actual use from the application for credit phone.

  Card company; “Customer, you are using our credit card now. Can you apply for a credit phone?”

  Customer: "?????????"

  Card company; “It is a system that allows card payments to be made directly with a camera phone instead of a card. You can choose from two methods.”

  Customer: "Please wait. What are the benefits of replacing that credit phone?"

  "First of all, safety is the first. When you use this credit phone, our center will check the customer directly by phone, so it cannot be used by others." Since the damage caused by counterfeiting and theft is almost eliminated, the amount of damage that has been made so far can be returned to the customer, reducing the membership fee and increasing the points depending on the amount used. The store also offers a variety of services. "

  Customer: “It ’s a store with a credit phone sign.”

  Card company; “Yes.”

  Customer: "How do you use it?"

  "When using at a restaurant or restaurant, first call the VISA call center from this camera phone. You will be asked to confirm your identity. Use this camera from the front of your face. Please take a picture and the screen will show “Checked” or “Retry” .When “Checked” appears, press the Send button to confirm your identity. Bring it to the cashier and press this button to bring it closer to the machine in the store. The machine will read the phone number. Just sign the slip that was launched in the same way.

  Customer: “What happens if I ca n’t confirm it after all?”

  Credit card company: “If you see“ Try again ”three times when verifying your identity, you will not be able to authenticate. In that case, if you do not have a card, you will not be able to use your credit card. You may not be able to identify yourself in a dark place or when the backlight is strong, but if you see “Repeat” frequently, you will need to change the registered face photo, so please contact us. It will be."

  Customer: "If you replace this phone, you can use it anywhere. Overseas?"

  “I ’m sorry, but now we ’re replacing the shop ’s machine with a camera-equipped mobile phone. There are over 5 million locations around the world, so if you ’d like to bring your card with you for a while, At present, this credit phone can be used at service centers and bank counters around the world, so cash services can be used. "

  Customer: “I will have both for a while. But if you go abroad and you can't use it anymore, it's a problem. If you ask yourself a question and you can't check your face with the camera, what do you do? Or the face was distorted by a bee. "

  “You can think of the case. You have a credit phone type for fingerprint verification. To tell you the truth, this type is easier to identify and less troublesome. However, there are quite a few customers who say that their fingerprints are not good, and that their fingerprints are not good. There are also models that can use both fingerprints, voiceprints, and facial photos, but few people will do that. "

  Customer: “I know about it. How can I apply?”

  Credit card company: “We fill out the application form and take a picture of your face with this camera. Your identity was good with your face.”

  Customer: “Fingerprints are more reliable than fingerprints. But what happens to the face photos taken here? I wonder if they will be used for other purposes. The video camera is also attached at the entrance of the company and at the post office.Because it is shoplifting prevention, you will always have a picture taken from the supermarket to the convenience store when shopping. Isn't it easy to monitor my actions when I go out? I think the police are already doing it. "

  “Yes, of course, VISA does not do that, and it is not only the Japanese Personal Information Protection Law, but also strictly according to the strictest rules established in countries around the world. So please rest assured. "

  Customer: "Wait a minute. I'm worried if I'm relieved but I don't have a little more explanation."

  “The photo taken here will be sent separately from the name and address of the customer you applied for. The document will be sent to the VISA Center by mail. If you are a photographer, send the image data along with the application number to the center where you register your personal information (biological information) and place it directly on the camera phone and the chip of the live IC card. It will be printed on the surface of the card.This print is written not only in the overcoat part but also in the center of the plastic material so it will not disappear even if the card is scraped.Of course in the case of fingerprints the print on the card No, since the phone and card manufacturing stage records the image data of this photo and the number of the application form, anyone can actually tell who the photo is. So don't worry if someone steals your data while you're sending it, or until you've manufactured your camera phone and delivered it to the headquarters. The part number of the camera phone you want is sent. "

  Customer: “Why?”

  Card company; “Registration center is troubled by not knowing which type of phone of which manufacturer should be registered.”

  Customer: “How do you process facial data registered on camera phones and cards?”

  "The data will be sent to another call center, and the picture data in the image registration center will be completely deleted"

  Customer: “What does the call center do?”

  Credit card company: “When a customer loses a credit phone or credit card, it has a role to check if the person who has been offered is the person who has been offered. Stores face image data and application number collected in the call center. Think of it as a server that only stores data and should be considered offline, because it never connects to the outside at all times. Will be sent to. "

  Customer: "I don't know what I'm specialized in, but it's different from where I put my face photo and fingerprints into my camera phone and card, and where I know my name and address."

  Card company; “Yes. When the phone and card with the customer's face photo and fingerprint registered are delivered to the issuing center, the number on the written application form is confirmed and delivered to the customer. The center records the phone and card manufacturer numbers delivered to the customer and enters them into the customer's database.

  Customer: “What kind of information is in the phone you sent?”

  Card company: “The information for identity verification is face image (fingerprint) data and falsification prevention data extracted from the data. The application number is also included.”

  Customer: “If you use the credit phone you received, you can use it like a credit card, right?”

  Card company; “Yes. However, if you do not verify that the customer you received is the same as the person who applied for it, you cannot use it at the store.”

  Customer: “Eh?”

  "You will be called to the call center with the credit card sent to you. As explained earlier, you will hear a voice saying" Please confirm your identity. "Check your face or fingerprint in the same way. Once you have been identified, you can use it like a credit card. Until then, the call center is designed to prevent payments at any store. "

  Customer: "Wait a bit, I'm a little confused. I'll explain what I interpreted, so let me know if it's correct. First take my photo from the store to the registration center. My face is registered, and if you register, my photos will disappear, and the data will be stored in the call center as data to be used in the event of a loss or stolen. I don't use it for offline payments.

  Card company; “That ’s right”

  Customer: “After the phone with my face photo registered is delivered to the headquarters, I send the phone to me against the application form I wrote. The credit company won't use my face image until I lost my phone and contacted the call center to verify the image I registered, so it's stored in the database. "

  Card company; “That ’s right”

  Customer: “If that happens, you can't understand if you replace the camera phone data sent to me with a photo of someone else's face.”

  “There are many suggestions from customers who think like a customer. To that end, we are taking two measures. One is a mechanism that prevents modification. However, to be honest, it is impossible if someone familiar with IT or the person who actually participated in the production of this phone does it. The other is that it is now possible to register tamper-proof data with a third-party organization that specializes in certification that is completely separate from our company. "

  Customer: “Isn't that bothersome?”

  Card company: “I mentioned earlier that when you first received your credit phone, you were asked to verify your identity. Of course, we will explain the rule that when you apply for a credit phone, you will register the anti-tamper data with a third-party certification organization. Of course, it's not mandatory, so you don't have to approve it, but you won't get discounts or other benefits. "

  Customer: “But isn't it misused by the third party?”

  Card company: “No photo or fingerprint data will be sent. No falsification data, phone number, only the device and card manufacturer number will be registered.

  Customer: “Then, using this phone to verify the identity is using only the data in the phone. I am solely responsible for the fact that the original data has not been modified. It should be understood that you are contacting a third party for confirmation. "

  “That ’s exactly right. The results of your identity verification on the phone you ’re using are saved once by our call center and your phone. If the phone's data and phone number are sent to the call center via the store / restaurant terminal, the data is collated and the payment for the amount used at that store is approved. It will be."

  Customer: “I see, my personal data is not used for credit payments other than the phone number.”

  Card company; “I think I have to be so nervous, but in fact, even when I send the phone number, it is encrypted, so the system is different from general phone number notification. It will be sent on a completely different communication line until it is matched in the call center, so I think that it is secure by itself.Of course, you can also use the number notification method adopted by telephone companies so far ...・ I don't think there will be much impact on security. "

  Customer: “I finally knew that this phone was safe.

  Credit card company: "I couldn't do it when I first tried to explain it, but there are actually two ways to use this credit phone so customers can choose it."

  Customer: “I ’m sorry. That ’s what you said at the beginning.”

  "One is to purchase a phone that can be used for VISA (registered trademark) payments as described above. This means that you can choose from VISA (registered trademark) compatible phones when you apply. The other method is to use a special tag for payment that is attached to the external extension terminal of the mobile phone you are using.The system is the same for both.VISA (registered trademark) ) In the case of compatible camera-equipped mobile phones, the personal information storage and verification system has a chip with a built-in phone, but the dedicated tag has the same system in the tag. Using the main unit is the same.If you are using a dedicated tag, you can use not only your mobile phone but also other mobile phones. Devices that can capture talk and personal information, such as a camera or a fingerprint input device, can be settled via communication as long as the functions are satisfied. It is supposed to use the IP address of the dedicated tag without using it for confirmation. "

  Customer: “Isn't that more convenient?”

  "There are various people. Both can be used in the same way, but the tag is certainly convenient. However, everyone always has a mobile phone at all times, but the dedicated tag In fact, it is relatively rarely forgotten or lost because it is not used frequently.It is easy to search by phone, but there is no call function even without a dedicated tag, so there are few cases where it is found lost. "

  Customer: “Let's apply now.

  Credit card company: “Here it is. The format is almost the same as before. At the bottom, there is a column to choose either credit phone or credit tag, please fill in there. The upper part is , Please fill in if there is a change in your address, work place, family, etc. Otherwise, you don't need it.If you want to use your current camera phone, apply for a credit tag. Please enter the model and phone number of your mobile phone now. Once you have filled it in, please separate the end from this tear line. "

  Customer: “This is the number of the application you mentioned earlier.”

  “Yes, the same number is written above and below the cutoff line. If the data is lost or the phone does not reach, please contact us to review the application form. If you do, you will always be asked for the application number.

(C) Detailed procedure for registering feature original data and falsification prevention code

  FIG. 3 is a flowchart for explaining a detailed procedure for registering feature original data and registering a falsification preventing code.

  A moving image is photographed, an image with a front face photographed is selected, the selected image is individually processed to calculate a feature amount of each image, and the feature amount is statistically processed to obtain a final result. This result is registered as feature original data. A part of data to be registered as feature original data is encoded, registered as a falsification preventing code, and transmitted to a third party organization.

  This series of operations will be described below with reference to FIG.

  (Step S-1) Moving image capture and capture

  A face is continuously photographed to obtain a moving image. A color image or a monochrome image may be used.

  (Step S-2) Front face detection

  A mask image as shown in FIG. 4 is created from a database of many faces, and the original image is scanned from the upper left to the lower right to detect a portion including both eyes. Specifically, with a mask image including both eyes, as shown in FIG. 5, a mask image is placed on the original image, the density is compared for each pixel, and the similarity is calculated to obtain a score. This operation is repeated by shifting one pixel to the right from the upper left of the original image. When it reaches the right end, it moves down one pixel and repeats from the left end to the right. This operation is repeated until reaching the lower right, and the maximum score is compared with a threshold value. Since the size of the face is not constant due to individual differences, shooting distance, and the like, the above processing is repeated by changing the mask size in several stages. If there is a possibility that the face is rotating, for example, the mask is rotated clockwise and counterclockwise by several degrees, and the above processing is repeated.

  In addition to the method of scanning by shifting one pixel at a time, this search can be performed by first shifting by about 10 pixels and searching globally to calculate a score, and then searching for a place where the score is large. A rough image can be created using an image pyramid and searched globally. Literature (Shin Kosugi, “Finding and locating faces in scenes using multiple pyramids for personal identification”, IEICE Transactions, Vol.J77-D-II, No.4, pp.672-681 , April 1994). The shifting method is not limited to one pixel. It is also possible to search only a portion with a high probability of a face without searching all from the upper left to the lower right of the original image. It is also possible to calculate the degree of similarity of coefficients after performing wavelet transform or the like instead of the image as it is. Various other methods are introduced in the literature (M. H. Yang et al “Detecting Faces in Images: A Survey” IEEE Tans. On Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, Jan. 2002.).

  (Step S-3) Front face image selection

  The above processing is performed for each image, and a plurality of images are selected in descending order of score.

  (Step S-4) Face image normalization

  The position of eyes and mouth is detected for each selected image. The image is scaled and normalized based on the position of the eye and the position of the mouth. Adjust brightness and contrast.

  (Step S-5) Feature original data registration

  As shown in FIG. 6, a plurality of images are overlaid, and as shown in FIG. 6, for each pixel, an average density value and variance are calculated for each pixel, and the average value and variance are calculated for each pixel. It is recorded for each pixel as a feature and used as feature original data. Also, the face width and the like are recorded as features in the feature original data.

  As described above, in addition to the method of recording the image data itself as a facial feature, it is also possible to record the coefficient as a facial feature and feature original data after performing transformation such as wavelet transform instead of the image as it is.

  (Step S-6) Registration of falsification prevention code

  The density of the pixels on the specified one line (line 1 in FIG. 6) of the image registered in the feature original data is added by the adder, the result is accumulated in the n-bit register, the overflowing upper bits are ignored, and the lower order n bits are registered as a falsification preventing code.

  (Step S-7) The falsification preventing code is transmitted to the third party organization.

  (D) Authentication function

  Next, details of the authentication function will be described. A moving image is photographed, an image with a front face photographed is selected, the selected image is individually processed to calculate a feature amount of each image, and the feature amount is statistically processed to obtain a final result.

  This result is collated with the feature original data, and the determination result and the falsification preventing code are transmitted.

  FIG. 8 is a flowchart for explaining this. This series of operations will be described below with reference to FIG.

  ・ Video recording and capture

  Same as step S-1 above.

  ・ Front face detection

  Same as step S-2 above.

  ・ Selection of front face image

  Same as step S-3 above.

  -Face image normalization

  Same as step S-4 above.

  ・ Verification of individual face images

  One of a plurality of normalized original images is optimally superimposed on the feature original data, and the eyes and their surroundings, the nose and their surroundings, the mouth and their surroundings are compared with the feature original data, and a score is calculated. For comparison with the feature original data, the degree of similarity is calculated by comparing the shades for each pixel, and is used as a score.

  As a comparison method between the original image and the feature original data, the cumulative value of the square of the difference for each pixel is compared, the pixel array is regarded as a feature vector, the inner product of the feature vectors is obtained, or the image is subjected to wavelet transform, etc. There is a method of comparing the coefficients when the conversion is performed.

  ・ Face recognition

  The average value of the scores obtained by collating the images is set as the final result. As the final result, median, maximum value, maximum value and variance can be considered. If the final result is larger than the set threshold value, the person is determined to be the person.

  Send results

  The determination result and the falsification preventing code are transmitted. If the determination result is negative, the falsification preventing code need not be transmitted.

  For the falsification prevention code, the data recorded in the storage device may be transmitted as it is, but in step S-6, the same processing as the falsification prevention code registration is performed and the newly obtained falsification prevention code is transmitted. May be.

(Example 1)
Next, an example of the above embodiment will be described in detail.

  A biometric information used for identity verification is used as a face image, and a communication system having an originality information guarantee function for original information used for collation with a collation device necessary for the information terminal is developed.

  For other biological information (fingerprints, palm prints, voice prints, irises, genes), only the input mechanism of the information terminal is different, and the registered information and the matching system can be handled by almost the same mechanism.

  The authentication system using the face image recognition device realized in the present embodiment is premised on a system that is operated by a portable terminal device / PDA or a notebook personal computer, which is a general mobile terminal. It is also a development that assumes an information terminal device with a dedicated information processing function that is used by plugging it into the external connection terminal of a camera-equipped mobile phone.

  In addition, personal gaming terminals and game centers, game machines used in other entertainment facilities, vending machines for liquor, tobacco, beverages, transportation, vending machines for entertainment facilities, securities, resident's card, etc. Connected to the public communication network, such as automatic issuing machines, credit card cash dispensers, financial institution ATM devices, public telephones and other devices that provide social services, etc. The authentication system according to the present invention is also effective when a device capable of performing the above is provided.

  The following describes the procedure for registering facial image feature original data for identity verification using a camera-equipped mobile phone and the personal authentication procedure using the same image, and details of technological development that enables this procedure. Outline.

  System usage procedures

(A) Registration of original information

  If the feature original data for personal verification is unregistered in an information terminal equipped with a communication means and an imaging device, the first image captured and registered is automatically registered in the storage device in the information terminal for verification. It becomes original information.

  1. Start the information terminal device, and select “Identify” from the screen menu.

  2. Point the lens at your face and capture a full face image.

  3. After imaging, confirm the image displayed on the screen and select “Register” or “Redo” on the screen to register or redo the image.

  4). The recording apparatus of the preceding paragraph employs a mechanism that cannot rewrite or tamper with the first registered image.

  5). In order to confirm the originality of the registered image in the previous section, specific information (falsification prevention data) is extracted from the image data and stored in the recording apparatus.

  6). At the same time as registering the original data and falsification prevention data of the previous paragraph, activate the communication function of the information terminal device and connect to the third party that has been set in advance, information on the terminal device (IP address, registered phone number), 5. Send the image verification data described to the agency and register it.

  7). The operations from 5. to 6. above are performed automatically, and “Registered” is displayed on the screen of the information terminal device when registration is completed.

  8). The program described in this item replaces the imaging device described above with an input device such as a contact sensor reading device, an audio recording device, a tablet device, etc., and enables recording of specific biological information corresponding to each. In the case of personal identification information other than the face image, the program operates in the same manner.

  (B) Identification procedure-email

  When sending information to a party requesting personal authentication by attaching the result of identity verification and the original guarantee of a third party (authentication center) using the email function

  1. Select “Identify” from the menu display related to authentication of the information terminal device.

  2. Select "Mail" from the displayed "Phone" and "Mail".

  3. The imaging function starts up.

  4). Take a full face image and press the shutter button to take the picture.

  5). The captured image and the original information stored in the information terminal are automatically collated, the correct answer rate is calculated, and the determination result is temporarily stored.

  6). The captured image to be checked against the original information in the previous section uses multiple face images selected from moving images (this is a function to prevent impersonation using still image data such as face photos, but still image &#0; still image verification is also possible).

  7). A third party who has registered the falsification prevention data by performing the processing in the preceding paragraph in the information terminal device and simultaneously starting the communication function, extracting the original falsification prevention data from the characteristic original data with a preset program Communicate with the institution to obtain data (16-bit encryption) that guarantees the originality.

  When the identity verification and originality confirmation processing is completed by the procedures from 8.1 to 7, either “verified” or “take another photo” is displayed on the display screen. (Repeat if "again ..." is displayed)

  9. The display of “Checked” switches to “Send / Save”, and when “Send” is selected, a new mail creation screen is automatically launched. (Judgment results and originality assurance data are automatically attached)

  10. If you click the “Send” button on the mail screen after entering the required items, the verification result originality proof data is sent to the other party along with the text created for the other party.

  11. When replying to an email requesting identity verification, select “Reply” from the received email, then select “Identify” from the menu button and perform the series of operations described in steps 2 to 10 above. If you select “Send” from the “Checked / Send / Save” displayed, it will be automatically sent to the other party.

  12 It is also possible to perform an identity confirmation operation before the mail operation. In that case, select “Save” in “Send / Save” displayed after “Verified”, create a mail, select “Attach Identity” from the Edit menu and send it. .

  註; This save function can also be used for telephone calls. It is also possible to easily confirm the identity by transmitting the collation result registered in advance.

  註; The storage function is equipped with a function that limits the time from acquisition of originality assurance data to transmission under the assumption of time constraints. The purpose of the present invention is to authenticate the party of the telephone call or data transmission action at the same time as the action for the identity verification.

(C) Identification procedure-mobile phone with camera or telephone

  When the other party asks for identity verification during a call using the telephone function.

  1. Select “Identify” from the menu without interrupting the call.

  2. Select "Phone" from the displayed "Phone" and "Mail".

  3. Follow the instructions on the screen and use the camera function to capture a full face image.

  4). Either “Checked” or “Please shoot again” is displayed on the screen. (If “again” is displayed, repeat steps 1 through 4.)

  5). “Send / Authenticate” is displayed after “Verify” is displayed, and if “Send” is selected, the result of the original verification is sent to the other party. If “Authenticate” is selected, a third-party organization The falsification prevention data is transmitted to

  6). The judgment result (validity rate) collated with the recorded original in the information terminal and the collation result of the falsification preventing data sent from the third party are encrypted.

  註; In personal authentication using a telephone, a program that displays a menu for selecting whether to request verification of originality from a third-party organization after “verified” is displayed. It becomes. The role of the third-party organization is to verify the tamper-proof data registered in advance and perform non-falsification proof. However, the mobile phone with camera actually requests other information terminal equipment to request non-falsification proof. The user who is using it. Personal identification by telephone consists of a simple identity verification procedure that is completed within the information terminal used by the user, and a non-falsified certificate of the original data for identifying the identity of the personal information terminal device by a third party. This can be divided into the attached “certified guarantor” personal authentication.

Explanation of technological development

  In order to realize this function, the following technologies will be developed, which will be described sequentially.

  (1) Development of face authentication function

  (2) Development of encryption function for guaranteeing original registered image data

  (3) Development of communication function for authentication

  (4) Development of portable terminal GUI function and function to prevent falsification of initial registration data

  (5) Porting software to mobile devices (PDAs)

  (1) Example of developing face authentication function

  Here, in order to prevent impersonation, we will develop a technology to authenticate the face using not only the front face but also a video image that moves left and right and up and down. However, as described above, if the service provider or the user himself / herself determines that simple authentication is acceptable, the face image can be captured as a still image and collated. Includes various authentication functions that connect to camera-equipped mobile phones and their external connection terminals, and includes functions that enable verification using still images in consideration of the information processing capabilities (mainly processing speed and recording capacity) of information terminal devices. Designed to be.

  Basically, for example, development is performed using “authentication technology by kernel principal angle method using video images” by Professor Amnon Shashua of Hebrew University.

  <Technology overview>

  There are two methods for authenticating a face using an image: a method using a still photo and a method using a video image. At present, most authentication systems use the still photo authentication method.

  In the face authentication method using a still picture, it is difficult to prevent impersonation using a photograph because authentication is performed with a single photograph. Also, in this method, the authentication accuracy is greatly reduced unless the shooting angle of the face at the time of registration and the face angle for actual authentication are almost the same. For this reason, most authentication methods require shooting with the same camera and the same face angle at the same place as at the time of registration.

  Since personal authentication is the main application here, impersonation is the biggest problem, and a video image method is used as a face authentication method to avoid the problem. If a video image is used, it is possible to obtain a three-dimensional image of the face, and impersonation is very difficult.

  In this embodiment, an authentication method using a “kernel principal angle method” is used as an authentication method using a video image. In this method, image data is converted into a high-dimensional vector, and the similarity of the image vector is verified by a kernel principal angle method (similarity is measured by the inner product of the vectors). When shown, it is a method of authenticating that the person is the person.

  Specifically, a video image of a face is taken with a camera of a mobile phone, and this image data is used to compare a registered video image with a registered data value (vector value), and a kernel principal angle value Is calculated, the similarity is measured, and the similarity is output, for example, as a percentage (<80%>, etc.) for authentication.

  In order to realize the functions according to the present embodiment, it is necessary to develop the following technology, but details thereof will be omitted here with reference to the above description.

  ・ Development of multidimensional vectorization of images

  ・ Development of kernel principal angle calculation method between multidimensional vectors

  ・ Development of learning method using support vector machine method

  ・ Development of authentication methods that are robust against lighting changes

  ・ Development of a format for sending and receiving personal authentication results

(2) Example of Development of Encrypted Function for Registered Image Data Original Guarantee In order to prevent the registered authentication image data from being tampered with and misused, the authentication image data registered in the portable terminal is tampered with. Develop a communication system with a function to guarantee originality of original information (authentication image data) that guarantees that it is not.

  <Technology overview: 2>

  The sum of luminance digital data of a specific area (for example, the area from the 100th scanning line to the 110th scanning line of each image: an area used for authentication is preferable) of a plurality of registered authentication image data. The lower 16 bits (for example, the last 5 digits of a lottery ticket) are digitally registered in the sum. If any part is tampered with, this number changes, so it is possible to verify the originality. The lower 16-bit data is registered with the original guarantee center. A function of transmitting 16-bit data corresponding to the original data of the portable terminal when performing the personal authentication, checking the originality by checking with the registered data at the center, and transmitting / receiving a proof to that effect from the original guarantee center.

  In order to realize the functions according to the present embodiment, it is necessary to develop the following technology, but details thereof will be omitted here with reference to the above description.

  ・ Development of an automatic extraction method for the optimum extraction area for each luminance data

  ・ Development of lower 16-bit luminance data

  ・ Development of original guarantee registration method and verification method

・ Development of format for sending and receiving original guarantee results

  (3) Examples of development of communication functions for authentication

  In the above (1) and (2), the individual functions of the face authentication function and the original guarantee function are developed. Here, the communication function of the entire system is developed. In particular, we will develop a method for dealing with the loss of a portable terminal, handling a large number of tasks at the same time, robustness as a system for data correction, and revision.

  In order to realize the functions according to the present embodiment, it is necessary to develop the following technology, but details thereof will be omitted here with reference to the above description.

  ・ Development of communication systems for sending and receiving authentication results and sending and receiving original guarantee results

  ・ Development of treatment system for lost mobile devices

  ・ Development of data revision and correction system

  ・ Development to maintain communication robustness

  (4) Example of development of mobile terminal GUI function and initial registration data falsification prevention function

  A portable terminal is a device that directly contacts a user, and its usability is likely to affect the penetration rate of this system. Here, a user-friendly GUI is developed, and the system can be easily used anytime and anywhere. It also develops an initial registration data falsification prevention function.

  In order to realize the functions according to the present embodiment, it is necessary to develop the following technology, but details thereof will be omitted here with reference to the above description.

  ・ Development of GUI for authentication registration operation

  ・ Development of GUI for original guarantee operation

  ・ Development of user authentication GUI

  ・ Development of initial registration data falsification prevention function

  (5) Implementation of software porting to mobile devices (PDAs)

  The purpose of this example is ultimately to install this function in mobile phones, but here we will focus on verifying the effectiveness of this function, so we will use a PDA as a mobile terminal, Confirm its effectiveness. Here, the developed software will be ported to the PDA and its functions will be confirmed. The purpose is a contract between a service provider and a service beneficiary who seeks an electronic payment function in the advanced information-oriented society through communication means, and requires some kind of payment using communication means. This is because it is assumed that the program is portable as an authentication unit of the existing service providing apparatus.

  In order to realize the functions according to the present embodiment, the following technology has been developed. However, the detailed description is omitted here on the assumption that the above-described details can be achieved.

  ・ Porting of registration function

  ・ Porting of face recognition function

  ・ Portability of originality guarantee function

  ・ Porting of GUI functions

  ・ Porting of communication functions

  Finally, examples of usage patterns of tags for identity verification are given. This includes cases where some mobile phones with cameras and other information terminals are used.

  ■ Open an account at a financial institution.

  ■ Make withdrawals and remittances via communication means.

  ・ When depositing and transferring money from a bank account, the bank must certify that the account opener is processing.

  -The basics of authentication are to confirm that the account opener that the bank wants to process is the principal.

  ・ The method of identity verification is to check the person's face, the passbook that he / she brought, and the stamp / signature of the stamp, and the method of confirming the registered PIN or password via ATM or communication. There is.

  ・ The actual identity verification does not directly confirm the identity in a strict sense.

  ・ Assuming that the person himself / herself has a passbook, a stamp, and a premise that no one other than the person knows the number or password, the result is that the person has been verified.

  ・ However, in the bankbook and Hanko, the bank side visually recognizes the person who performed the procedure, and in ATM, the person who performed the procedure is photographed with a video camera to back up the authentication.

  ・ For bank account withdrawals and direct debits via communication, a PIN or password is used in the same way as ATM, but there is no way to confirm who operated the terminal afterwards.

  In the present invention, it is possible to confirm that the person accessing the bank account by operating an information terminal having a communication function is the person who registered the account.

  In the present invention, the biometric information of the account opener registered in advance in the information terminal used for account settlement or in the extension terminal of the information terminal is used for identity verification.

  In the present invention, in order for a third party to prove that the pre-registered biometric information used for identification is not falsified, it is necessary to register the falsification prevention information with the third party.

  ■ Specific usage will be described below.

  ・ When an account opener accesses a bank or other financial institution for the purpose of deposit and withdrawal and direct debit, and the bank asks for identity verification, the biometric information of the person is stored while maintaining the communication. Insert the extension terminal into the external terminal of the mobile phone.

  ・ When using a face image, take a picture of your face with a digital camera attached to a camera-equipped mobile phone or information terminal, and perform identity verification.

  The image captured for identity verification is collated with the original registered in the recording device in the information terminal, and the correct answer probability is calculated.

  ・ After the person confirms the display of “identification confirmed”, requests a third party organization for non-falsification proof, and receives the proof result at the information terminal.

  -Confirm receipt of proof data, perform terminal operation for necessary account procedures, and send it together with proof data as a result of identity verification to complete the procedure.

  The above procedure is the same except for the device for inputting biological information when using fingerprints, palm prints, vein patterns, voice prints, irises, retinal patterns, and genes.

  ・ At the same time, send the anti-tampering information stored in the recording device to a third party to receive the data that proves that the original is not tampered with, and then confirm the identity verification data together with the verification result of the identity verification. And send it to the bank together with the account procedure operation data to complete the procedure.

  -If the biometric information is a face image, collation is performed using a face image captured by a camera-equipped mobile phone or a digital camera connected to an information terminal.

  -If the biometric information is a fingerprint, palm print, or vein pattern, input the information using a sensor, if the voice print is a microphone, and if it is a gene, input the information and check it against the original. The method of sending anti-tampering data to a third party to prove non-tampering is the same.

  ■ Account transactions using camera phones

  ■ Identification of financial institutions / banks and securities companies

  Account opener; “Moshimoshi. I would like to transfer the account.”

  Financial institution; “Okay, it ’s your account”

  Account opener; “Yes”

  Financial institution: “We will verify your identity. Registration is complete.”

  Account opener; “Yes”

  Financial institution: “Facial image authentication? Fingerprint authentication? Which are you using?"

  Account opener; “It ’s a face image”

  Financial institution; “Does your phone belong to you?”

  Account opener; “No, not mine”

  Financial institution; “It is an authentication tag that is used for identity verification. Have you already registered with the authentication center?”

  Account opener; “Yes”

  Financial institution; “Please give us your name, store number and account number”

  Account opener: “Yuji Koyama. The store number is 432. The account number is a regular account 2020334559276.”

  Financial institution; “I will ask some questions. My date of birth is July 7, 1952.”

  Account opener; “No. August 24, 1949”

  Financial institution; “Okay. When was the last remittance date?” Account opener “Sure, it is the end of last month.”

  Financial institution; “I understand. Then, insert the authentication tag into the external connection terminal of the camera phone you are using now and confirm your identity.”

  ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・

  Account opener; “Is this OK?”

  Financial institution; “I confirmed. Then please give me the account number of the transfer destination”

  From here on, it is an administrative procedure.

  The procedure for transferring a bank account by mail using the Internet or i-mode is as follows.

  -Call the input screen for account transfer and fill in the items required by the financial institution, such as personal information of the person, data such as account number, account number and name of the transfer destination.

  ・ If you select the “Send” button and connect to the other party's center, if you need to verify your identity, you will receive a response saying “Perform identity verification”.

  ・ Select the “Verify your identity” button, take a picture of your face with a camera-equipped mobile phone, verify your identity in the phone, receive non-falsification proof data from a third party, and confirm your identity Check the situation, return to the transfer input screen and send it again to complete the procedure.

  When electronic payments are made by securities companies, insurance companies, credit card companies, consumer financial institutions, etc., it is possible to verify the identity by the same method. The authentication tag used by setting it on a camera-equipped mobile phone or other information terminal with a communication function is not an authentication function directly issued and managed by financial institutions. Is available.

  ■ Use for private banking of excellent customers

  The concept of private banking business for asset owners whose banks place importance on transactions is spreading from foreign banks to Japanese financial institutions.

  Including asset management consulting, unlimited use of credit cards, telephone banking, use of internet banking accounts, etc. as well as convenience for banking and clients to prevent accidents and crimes such as financial settlement administrative procedures and leakage of personal information related to assets The need is very large.

  By distributing the authentication tag according to the present invention to the account opener in order to enhance the security of information exchanged with the financial institution via the communication means, the personal authentication procedure based on identity verification is always facilitated.

  Private banking account opening and procedures

  Account opener; “Open an account”

  Foreign bank; “Okay. Fill in this application form, attach the resident's card and submit it at a later date. The application is to be sent to the person in advance. Please contact us and bring your driver's license or passport. ''

  ····· Restarting.

  Account opener; “I have all of them”

  Foreign bank; “Okay. Please wait.”

  Foreign bank: “We do not issue a bankbook. The transaction results will be sent to the designated address every month. Daily transactions can be settled over the phone or via the Internet. However, since we need to confirm the identity of the person, we will send you a photo tag or an authentication tag with your fingerprint registered, so please use a mobile phone with a camera or a computer that can perform fingerprint verification. Please bring something that can identify you. "

  Account opener; “It seems convenient, but it seems difficult”

  Foreign bank: “As usual, we could not counter the malicious impersonation with just a PIN or password. With this method, the authentication tag provided by the Bank was attached to the external connection terminal of the camera phone. Just plug it in to see if you are the person who is making the call, so you can prevent accidents.

  Account opener; “If you exchange face photos and fingerprints, isn't there risk of the information being stolen?”

  Foreign bank; “Registered personal information will not be sent or received via communication. Do n’t worry, it ’s just the exchange between your camera-equipped mobile phone or computer and its authentication tag.”

  Account opener; “I hope that the authentication tag and Yara are always available at the time of the transaction”

  Foreign bank; “Yes, it ’s not just that. Customers are now using credit cards and credit cards.”

  Account opener; “Yes. VISA (registered trademark). MASTERS (registered trademark). JCB (registered trademark).”

  Foreign bank; “If you use this authentication tag, you will be able to issue a VISA (registered trademark) card with no usage limit”

  Account opener; “It ’s convenient when traveling abroad”

  Foreign bank: “You can shop within the limits of your deposit at any time, so it's safe even if the price is high.

  Account opener; “Please”

  “Now, please fill out this document too. This is an authorization to use the photo for opening an account for the settlement of the VISA (registered trademark) card. The VISA (registered trademark) card to be sent later The photo is recorded, think that the photo of the ID card is blind, and that the card is in a store with a terminal with a dedicated reader and a data reader for verification. You will need to prepare an IC card-compatible authentication tag, which will be given to all customers who have opened an account, but the IC card-compatible tag There will be a charge ”

  Account opener: "If you don't use the authentication tag, it's inconvenient"

  Foreign banks; “If you do not have an authentication tag or device to read data, you can use it as an ordinary credit card at any store. ”

  Account opener; “I understand”

Foreign bank; “Now, the procedure for opening an account is finished. Finally, I will take a picture with this camera.”

  ■ Air ticket reservation and coupon tickets

At the Japan Airlines (registered trademark) counter at Kansai Airport

  Staff: “How far are you using?”

  Passenger; “I am Haneda”

  Clerk; "The next flight will be 328. What air ticket do you have?"

  Passenger; “It is a coupon ticket registered on the Internet, but it should still remain”

  Person in charge: “Can I have my name and phone number or date of birth?”

  Passenger; “Yuji Koyama. It is 0662299185”

Personnel: “(Access to ticketing center) .... You can only use one more ticket . ANA (registered trademark) airline ticket , use this?”

  Passenger; “Yes”

  Person in charge: “Only this person can use this ticket (本 1). Excuse me, do you have the authentication tag you used when you purchased with your mobile phone (註 2)?”

  Passenger; “Is this tag OK?”

  Person in charge; “It ’s fine. This tag is a face check (註 3). Can you insert it into this terminal?”

  Passenger; “Is this OK?”

  Personnel: “Yes. Can you see the lens of this camera as it is… Yes, it ’s fine. This is the boarding pass. The boarding gate is No. 67. Please come.”

  (Note 1) There are the following methods for identity verification. However, cases 1 and 2 are limited to cases where the user has an air ticket and applies for boarding at the counter. Personal data written on tickets handled as securities proves the user's rights and responsibilities, and if the ticket is limited to the user, identity verification is required. If not, identifying the ticket purchaser and user becomes a problem. The present invention provides a system capable of verifying the identity of a user-only flight ticket applied for via the Internet or telephone.

  1: Visual recognition of ID cards with photographs such as driver's licenses, passports, and depending on airlines, employee ID cards and student ID cards.

  2; Confirmation of validity to issuer through visual recognition and communication of credit card (magnetic card and IC card) on which personal photo is printed.

  3; Verification of personal information corresponding to the original entered at the window with information media (authentication tag, IC card, mobile phone, PDA, etc.) on which the original information of the person's biometric information is recorded Confirmation of falsification prevention data.

  (Note 2) When purchasing air tickets that require identification of users such as coupon tickets, age restrictions, family discounts, etc. by telephone or electronic payment via the Internet, use the authentication tag for identity verification Register the device identification number (or phone number or mail address) used for authentication.

  (Note 3) In the case of fingerprint verification, the procedure follows the same procedure. The fingerprint input device provided on the dedicated terminal installed at the airline counter is made to recognize the fingerprint shape and verified against the registered original data.

  ■ Purchase coupons with a camera phone

  Passenger; "Moshi. Please give me a Tokyo Osaka net coupon"

  Ticketing Center: “I understand. You can call with a mobile phone.

  Passenger; “Yes”

  Ticketing Center: “Can you use it only for yourself?”

  Passenger; “Yes”

  Ticketing Center; "Can you use the phone now? Please give me your name and date of birth."

  Passenger; "Yuji Koyama. It is August 24, 1949"

  Ticketing Center: “When will you use it? It will be valid for 90 days from that date”

  Passenger; “Please start from August 1st”

  Ticketing Center: “I will confirm your identity, so please.”

  Passenger: "Is this all right (註 4)"

  Ticketing Center; “It ’s fine. Please take this mobile phone with you when boarding.”

  Passenger; “Yes”

  Ticketing Center: “Thank you for using Japan Airlines (registered trademark)”

(註 4) Passengers are prevented from falsification at the same time as the result of comparing their original image registered in the telephone or the extension terminal by capturing their face with a camera-equipped mobile phone while maintaining a call with the ticketing center. Non-falsification proof results obtained from a third party using data. Send it to the ticketing center and finish identity verification.

  ■ Get a resident's card and a seal certificate from the family register

  Residents: "Please give me a seal certificate and resident card"

  Family register: “You will need a Juki card and a confirmation of your identity”

  Residents: “What do you have?”

  Family register: “It is a driver's license and passport. The health insurance card is no longer available because there is no photo. If you have registered for identity verification with a Juki card, you can use just the Juki card. After that, you can use the authentication tag. "

  Residents: “I came on behalf of my husband, so this is my husband's Juki card.

  Family register; "In that case, only the owner can use it."

  Residents: “Why are you?”

  Family register: “Put the owner's Juki card in the dedicated terminal, take a picture of the person's face with this camera, match the person's face registered on the card, Because it authenticates. "

  Residents: “The husband is too busy to come, so how about it?”

  Family register: “If you can confirm your identity by phone or the Internet, you can issue a resident card and a seal certificate. Does your husband have a camera phone or authentication tag for identity verification?”

  Residents: “Yes, I should have it”

  Family register: “Now contact your husband and have this phone number on the family register be used to notify you of the number on your camera phone.”

  ・ ・ ・ ・ ・ ・

  Family register; “Yes. Tennoji Ward family register. Oyama-san?”

  Master; “Yes.”

  Family register; "Your wife is visible and you are requesting your husband's seal certificate and resident's card, but you know."

  Master; “Yes, I know”

  Family register; "I will ask you some questions"

  Master; “Yes.”

  Family register; "First of all, please give me your husband's date of birth."

  Master; “It is August 24, 1949”

  Family register; "When you moved to Tennoji Ward, when is it? Which is the previous address?"

  Master: "Sure. It's about February 5 years ago. I don't know the day I registered. The previous is 1st Street in Abeno Ward."

  Family register; “It ’s fine. Now we ’ll ask you to confirm your identity.

  Master; “Yes”

  Family register; "Thank you."

  ・ ・ ・ Authentication using camera mobile phone is the same as above ...

  Master; "... is this all right"

  Family register; “Yes, that ’s OK. I ’m glad you ’re going to be your wife. I ’ll give you a resident's card and a seal certificate to the woman you ’re visiting.”

  Master: “I understand. Thank you very much.”

  ■ How to verify your identity with IC cards such as Juki cards

  The method for registering biometric information in the Juki card and confirming the identity is as follows.

  1. Biometric information is registered for identity verification in a recording medium that can be freely written and read by residents on a storage medium equipped with a Juki card.

  2. The anti-tampering data extracted from the information is also registered in the chip, and at the same time, only the anti-tampering data is transmitted to the third party for registration.

  3. If the identity of the resident is required, insert the card into the dedicated terminal provided at the window, and enter the applicant's biometric information entered on the biometric reader that is built in or connected to the terminal and the information registered on the card. Use to verify card holder and card registrant.

  4). Either a local government or a private business can provide a service that registers biometric information on the Juki card and provides identity verification procedures, and a service that provides tamper-proof certification using falsification prevention data of the information. .

  The biometric information described in 5.1 to 4 is effective not only for facial photographs but also for fingerprints, palm prints, vein patterns, irises, voice prints, genes, and the like.

  ■ Use identity verification for credit card payments

  Credit card fraud is increasing rapidly. A credit card is a credit settlement procedure that is established on the assumption that a person holding the card is a legitimate user. Basically, it is a settlement system that is established by interpreting that a settlement means by a combination of a conventional passbook and a stamp or signature (self-signed signature) is performed via a communication means.

  The credit order of the system was established and the credit grant function was established because the pre-screening of the person who applied for the credit card was strict. However, as market competition intensifies, credit checks at the entrance are hardly functioning. Signs also lack the ability to verify payments, and in reality, damage such as impersonation, data falsification, and skimming is covered by insurance.

  The authentication tag that is the identity verification device according to the present invention is a device that makes it possible to confirm that the card holder and the card holder are the same person. A specific flow will be described below.

  -When a credit card is issued, face image data is recorded on a recording medium of the credit card body.

  ・ Register falsification prevention data extracted from the original image data at the same time.

  -When the card is sent to the person, the anti-tampering data is read from the card with an IC chip reader provided in the authentication tag, transmitted to a third party, and registered together with a number for identifying the card. The third-party organization may be able to provide authentication services by the card issuing organization, but the mechanism is the same.

  ・ When using a card, insert an authentication tag equipped with a device that reads the face image data registered in the IC chip into the mobile phone with camera and insert it into the external connection terminal of the mobile phone with camera. The person is verified by collating with the face image taken with the camera of the mobile phone.

  ・ At the same time as identity verification, non-falsification proof data is acquired using falsification prevention data.

  This non-falsification certificate can be verified by a batch system within a period determined by the card company, and the result can be recorded in a recording device of the credit card body and used for backup of the result of identity verification.

  In addition, unless the non-falsification proof data received from the credit company or a third party is registered in the record part of the card, a dedicated terminal device for sending data to the payment center used by the service provider and the card data chip By making it impossible to communicate information, it is possible to prevent reading of personal information and card payment information from a credit card.

  The purpose of this method is to decipher the security of a credit card and prevent it from being misused for an impersonation crime by stealing payment data. Data from the card is obtained by encrypting the result accessed by a dedicated terminal that the individual occupies immediately before settlement via communication, registering it in a credit card, reading it with the information terminal at each store or service base, and connecting to the card center. It becomes easy to prevent reading and falsification of data.

The card issuer can provide an advantage that prevents the occurrence of unauthorized damage to the applicant who registered the personal information when issuing the card, and can use it for improving the service.
(Example 2)
Next, another example of the above embodiment will be described in detail.
<Problems and solutions for credit card payment systems>
The problem with credit card payments, where damage due to impersonation occurs frequently, is that the credit line of the card is linear and that the responsibility is unified with the card issuer by closing. This is because a considerable amount of time is required from the issue of the card to the use of the card and the settlement of the card, and the card issuer and the cardholder must confirm the fact after the damage has already occurred. This pattern is shown in FIG.

Most of the damage is caused by skimming the card data of the cardholder and cases where data is stolen when the card user transmits the card data using communication.
Since the identity of the cardholder by the card user is based on a signature, there is no way to prevent impersonation if the card is forged.
Criminals can easily steal goods and services from the card issuer / owner line by separating millions of card usage points scattered around the world.
Reform of credit card system payment structure The credit card payment system designed by R & D has separate credit lines for issuers, owners, and users, which have been closed linearly, and makes payment when using cards in real time. This is done with parallel double lines. This is to eliminate the possibility of data eavesdropping by stopping the identity verification process that occurred between the most difficult cardholders and card users.

  As shown in FIG. 10, when using a card, the cardholder verifies the identity by using a mobile phone having a card payment function, and transmits the result to the card issuer's card authentication center (provisional name). The card user waits for the result of identity verification, inputs the mobile number and the billing amount into the payment terminal of the store, and transmits it to the card authentication center. The card authentication center confirms those procedures and sends the result to the card owner's mobile phone. The card owner checks the payment data written in the mail and sends it to the card authentication center. The procedure will be finished.

In the payment method based on this method, even if a mobile phone or a mobile phone number for authenticating the cardholder is stolen, impersonation in the procedure for card payment is not realized.
When authenticating with a stolen phone, the personal identification data cannot be transmitted to the card center with only the mobile phone in order to collate the biometric information registered in the mobile phone number with the owner. Since the mobile phone number is handled as known information, even if a third party accesses the card center with that number, the center will justify the third party unless there is an identity confirmation using a mobile phone. It will not be possible to notify.

  If the person himself / herself notifies the center with his / her mobile phone and a third party who knows the mobile number accesses the center from another payment terminal (spoofed terminal) and enters the mobile number, the validity is confirmed. The payment can be made by sending the invoiced amount after receiving the notification. However, even in that case, the billing amount and the store name are transmitted to the person's mobile phone, so even if settlement is made at that stage, the person's damage will not occur. In other words, the purchased product or service is occupied or consumed by the person, and no crime is established even if the product or service is completed.

  Even if the mobile number is exploited, the identity verification necessary for card payment is impossible unless the biometric information is falsified. A third-party certification organization holds the original non-falsified data to be loaded on the mobile phone, thereby enabling the original tamper-proof. At the time of card payment, a non-falsified certificate is sent to the card authentication center via a third-party certification organization.

Card impersonation is based on the validity of the card and the time gap between payment confirmations, but it is used for crimes by the cardholder performing identity verification. This pattern is shown in FIG.
Credit payment pattern In the case of verifying the identity in advance before the credit settlement, the identity of the card user (service provider) is verified before inputting the amount charged. This is useful for making payments while seated at a restaurant. The validity of the owner of the mobile phone can be quickly confirmed. In addition, according to the regulations of the credit company, there is a method in which the identity verification is validated at a certain interval (for example, 8 hours, 24 hours, or 1 week) without performing identity verification at each settlement.
1: Identity verification pattern before settlement is shown in FIG.
2: Identity verification pattern after payment request data is input.

  As described above in detail, according to the present invention, it is possible to contribute to the effective prevention of (systematic) crimes of credit cards, which have been steadily increasing recently.

  In the personal authentication method and program execution system according to the present invention, a user of an information terminal device such as a mobile phone, for example, can purchase an information terminal device purchased or provided by an organization to which the user belongs, For the purpose of personal authentication of the user himself / herself, it is intended to input biometric information that can be used for identity verification and use it for verification of identity verification. In the present invention, the biometric information for verification initially registered in the information terminal by the user for the purpose of personal authentication is a recording method that cannot be modified after registration. The falsification prevention mechanism, which is a technical measure applied to the recording device itself, and the falsification prevention information extracted from the original registered original information are registered with a third party through a communication line. Therefore, the basis for socially establishing the authentication method of the present invention in which personal information is not transmitted to the outside is that the biometric information such as face images, which is personal information that can be used to identify individual users, is included in the authentication requester. Is registered with a third party that is objectively evaluated and the institution verifies non-falsification.

It is a block diagram which shows an example of a structure of the personal authentication apparatus which concerns on embodiment of this invention. It is a block diagram which shows another example of a structure of the personal authentication apparatus which concerns on embodiment of this invention. It is a flowchart for demonstrating the detailed procedure of the registration of the characteristic original data for personal authentication which concerns on embodiment of this invention, and the registration of a falsification prevention code. It is an image figure for demonstrating the detailed procedure of registration of the characteristic original data for personal authentication which concerns on embodiment of this invention, and the registration of a falsification prevention code. It is an image figure for demonstrating the detailed procedure of registration of the characteristic original data for personal authentication which concerns on embodiment of this invention, and the registration of a falsification prevention code. It is an image figure for demonstrating the detailed procedure of registration of the characteristic original data for personal authentication which concerns on embodiment of this invention, and the registration of a falsification prevention code. It is an image figure for demonstrating the detailed procedure of registration of the characteristic original data for personal authentication which concerns on embodiment of this invention, and the registration of a falsification prevention code. It is a flowchart for demonstrating the detailed procedure of the authentication function for the personal authentication which concerns on embodiment of this invention. It is a conceptual diagram for demonstrating the system principle of the misuse of the personal identification number about a credit card, and impersonation. It is a conceptual diagram for demonstrating the idea of this invention which prevents the theft and impersonation of the PIN code about a credit card systematically. It is a timing flowchart for demonstrating the concept of the mobile phone with a personal authentication of this invention, and a credit card mobile phone application. It is a conceptual diagram for demonstrating the concept of the identity verification pattern before the payment based on this invention. It is a conceptual diagram for demonstrating the concept of the identity verification pattern after the payment request data input based on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Personal authentication apparatus 101 ... Original image recording apparatus 102 ... Face image data processing part 103 at the time of authentication 103 ... Captured moving image recording apparatus 104 ... Still image sorting apparatus 105 ... Image collation apparatus 106 ... Collation determination result storage apparatus 107 ... Collation determination Result attaching / sending device 108 ... Camera 109 ... Imaging flash device 200 ... Mobile phone with camera 300 ... Personal authentication device / personal authentication unit 301 ... Original image recording device 302 ... Face image data processing unit 303 at the time of authentication 303 ... Recording moving image recording Device 304: Still image sorting device 305 ... Image collation device 306 ... Collation determination result storage device 307 ... Collation determination result attachment / sending device

Claims (22)

Obtaining personal characteristic original data; and
Storing the original feature data;
Encoding the original feature data;
Transmitting the encoded feature original data;
Obtaining personal feature data;
Encoding the feature data;
Collating the encoded feature original data with the encoded feature data;
And a step of transmitting the verification result.   2. The personal authentication method according to claim 1, wherein the individual original feature data is based on biometric information.   The biometric information is at least one of face image, iris information, retina information, pinna information, fingerprint information, palm print information, vein pattern information, voice print information, and gene information. Personal authentication method.   The personal authentication method according to claim 1, further comprising a step of storing the encoded feature original data.   A step of obtaining falsification prevention information for proving that the encoded feature original data has not been falsified, a step of storing the falsification prevention information in a third party by a communication means, The personal authentication method according to claim 1, further comprising: transmitting falsification preventing collation information obtained from the obtained information to the third party organization.   The step of acquiring the original feature data of the individual and the step of acquiring the feature data of the individual are a mobile phone, a public telephone, a computer, a vending machine, and an unmanned service provider, and means for directly inputting the personal information; The personal authentication method according to claim 1, wherein the personal authentication method is performed by an apparatus including communication means capable of exchanging communication using an external public communication network.   The personal authentication method according to claim 6, wherein the mobile phone is a camera-equipped mobile phone.   The personal authentication method according to claim 6, wherein the vending machine is a vending machine for alcoholic beverages, tobacco, or beverages.   7. The personal authentication method according to claim 6, wherein the vending machine is any one of an automatic ticket vending machine at a transportation facility or an amusement facility, a securities or an automatic resident card issuing machine.   7. The personal authentication method according to claim 6, wherein the unmanned service providing machine is either a cash dispenser of a credit card or an ATM device of a financial institution. Obtaining the original feature data of the individual and obtaining the feature data of the individual;
Means for storing the original feature data;
Means for encoding the original feature data;
Means for encoding the feature data;
7. The personal authentication method according to claim 6, wherein the personal authentication method is performed by inserting a connector having means for collating the encoded feature original data with the encoded feature data into the apparatus.   2. The personal authentication method according to claim 1, wherein the original feature data and the feature data are based on facial features extracted from a facial image, and the facial image is a moving image.   The step of extracting a facial feature from the moving image includes a step of selecting a facial image facing the front from a plurality of images, a step of detecting a frontal face, and a step of extracting the feature. The personal authentication method according to claim 12.   The feature original data and the feature data are based on face features extracted from a face image, and the stored encoded feature original data is an arbitrary one of the face images used for the face feature extraction. 5. The personal authentication method according to claim 4, wherein the pixel density on the horizontal line is added.   The feature original data and the feature data are based on facial features extracted from a face image, and the tampering prevention information is a pixel on any one horizontal line or vertical line of the image related to the feature original data. 6. The personal authentication method according to claim 5, wherein the number of bits of the data related to the feature original data is at least one of them.   The step of acquiring the original feature data of the individual and the step of acquiring the feature data of the individual comprises means for directly inputting personal information and communication means capable of exchanging communication using an external public communication network In the step of storing the falsification prevention information in a third party by communication means, and also transmitting the registration ID number of the device and registering the number simultaneously with the encoded feature original data. The personal authentication method according to claim 5, further comprising:   The step of acquiring the original feature data of the individual and the step of acquiring the feature data of the individual include means for directly inputting personal information and communication means capable of exchanging communication using an external public communication network In the step of transmitting the falsification preventing collation information to a third party, the step of transmitting the registration ID number of the device and collating the number simultaneously with the encoded feature original data, The personal authentication method according to claim 5, further comprising: Obtaining personal characteristic original data; and
Storing the original feature data;
Obtaining personal feature data from a moving image;
Collating the original feature data with the feature data;
And a step of transmitting the verification result. Means for obtaining original feature original data;
Means for storing the original feature data;
Means for encoding the original feature data;
Means for transmitting the encoded feature original data;
Means for obtaining personal feature data;
Means for encoding the feature data;
Means for collating the encoded feature original data with the encoded feature data;
And a means for transmitting the collation result. Means for obtaining original feature original data;
Means for storing the original feature data;
Means for acquiring personal feature data from a moving image;
Means for comparing the feature original data with the feature data;
And a means for transmitting the collation result. Means for storing original feature data;
Means for encoding the original feature data;
Means for encoding personal feature data;
And a means for collating the encoded feature original data with the encoded feature data, and for providing to an apparatus having means for acquiring the individual feature original data or the individual feature data and an information receiving / transmitting means. Connector characterized by being made.   The connector according to claim 21, wherein the connector is an IC tag chip.

Images