JP5109701B2 - Terminal device, program used therefor and information processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To correct only erroneously identified characters individually by using a correcting medium for an electronic pen when a character string, which is entered, with an electronic pen, in an entry medium for an electronic pen, is erroneously identified. <P>SOLUTION: When a character string is entered in an entry business form, the character string is recognized on the basis of business form entry information acquired from an electronic pen. A business form area in which the character string is entered is identified by referring to the first business form area definition information, and the character string is identified by the character string recognition based on the business form entry information. The business form area and the character string are correlated with each other and stored in a memory, and then voice is outputted to display them. In order to correct erroneous recognition, the characters are recognized one by one on the basis of correction entry information acquired from the electronic pen. By referring to the second business form area definition information and correction area definition information, a business form area of a character to be corrected and a correction character are identified, and characters identified as the business form area to be corrected of the entered character string stored in the memory is overwritten by the correction character, and then voice is outputted to display the characters. <P>COPYRIGHT: (C)2009,JPO&amp;INPIT

Description

  The present invention relates to a technique for processing entry information entered on an electronic pen medium by an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known (see Patent Document 1). Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an annotation pen, or puts a check mark on the image designed on the special paper, the small camera displays the dot pattern printed on the special paper as the pen moves. Entry information such as characters and images detected and written by the user is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a method for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 2).

  Further, in Patent Document 3, by providing a discrimination item for specifying a character type, character recognition that can reduce misrecognition of OCR based on information entered by an electronic pen and reliably perform confusing character conversion. The system is described.

Japanese translation of PCT publication No. 2003-511761 JP 2004-153612 A JP 2007-265346 A

  According to the present invention, when a character string entered in an electronic pen entry medium is erroneously recognized by the electronic pen, it is possible to individually correct only the erroneously recognized characters using the electronic pen correction medium. It is an object to provide a terminal device, a program used therefor, and an information processing system.

  A terminal device according to the present invention is a terminal device that processes information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed, and outputs a voice. A voice output unit, a display unit for displaying a character string, a first form area that constitutes the electronic pen entry medium and recognizes a plurality of characters as a character string, and the first form area on the coding pattern First form area definition information storage means for storing first form area definition information associated with coordinate data indicating position coordinates, and a second form that constitutes the electronic pen entry medium and recognizes a character string character by character Second form area definition information for storing second form area definition information in which an area is associated with coordinate data indicating the position coordinates of the second form area on the coding pattern Correction that associates the memory means, the correction area that constitutes the correction medium for the electronic pen, the coordinate data indicating the position coordinates of the correction area on the coded pattern, and the characters described in the correction area A modified area definition information storage means for storing area definition information, a form entry information acquisition means for obtaining form entry information corresponding to the contents entered in the electronic pen entry medium from the electronic pen, and the form entry information By referring to the first form area definition information based on the included coordinate data, the first form area specifying means for specifying the first form area and the character recognition based on the form entry information, the first form is specified. The input character string recognition means for recognizing the input character string entered in the first form area specified by the area specifying means, and the input character string from the voice output unit A first voice output means for outputting a corresponding voice; a first display means for displaying the input character string on the display; a first form area specified by the first form area specifying means; and the input character string. A recognition result storage means for storing the information in association with each other, and after the input character string recognition means recognizes the input character string from the electronic pen, the electronic pen entry medium and the electronic pen correction medium are entered. The second form area is specified by referring to the second form area definition information on the basis of the coordinate data included in the correction entry information, and the correction entry information obtaining means for obtaining the correction entry information corresponding to the content Second form area specifying means and correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information And by referring to the correction area definition information, the corrected character specifying means for specifying the characters described on the correction area specified by the correction area specifying means, and the second result area from the recognition result storage means A deletion unit that deletes an entry character corresponding to the second form area specified by the specifying unit, a second form area specified by the second form area specifying unit, and the correction character are associated with the recognition result storage unit. A recognition result overwriting means for adding and storing, a second voice output means for outputting a voice corresponding to a character string overwritten with the correction character by the recognition result overwriting means, and the display section. And a second display means for displaying the corrected character string.

  In the terminal device configured as described above, the electronic pen is entry information that is digital data corresponding to the contents entered on the electronic pen entry medium or electronic pen correction medium on which a recognizable coding pattern is printed. Are transmitted immediately and sequentially to the terminal device. The terminal device can execute processing based on the entry information acquired immediately and sequentially from the electronic pen. The terminal device is an external device such as a PC, a PDA (Personal Digital Assistants), or a mobile phone that exists in the vicinity of the electronic pen and can process entry information acquired from the electronic pen. In the present invention, the entry information corresponds not only to digital data corresponding to the contents entered in the electronic pen entry medium or the electronic pen modification medium, but also to taps on the electronic pen entry medium or the electronic pen modification medium. Digital data to be included. Tap means that the electronic pen strikes a form area that the electronic pen entry medium has or a correction area that the electronic pen correction medium has. The user first enters an arbitrary character string in a predetermined form area of the electronic pen entry medium. Here, the character string is a collection of one or more characters such as numbers, hiragana, katakana, Greek characters, JIS1, and JIS2. At this time, the electronic pen acquires coordinate information, stroke data, and the like corresponding to the entered character string as form entry information, and immediately and sequentially transmits it to the terminal device. The coordinate information is X / Y coordinate data indicating the position coordinates of a character string on a dot pattern printed on an electronic pen entry medium. The stroke data is data indicating the trajectory of a character string entered by the electronic pen. By referring to the first form area definition information stored in advance based on the coordinate information included in the acquired form entry information, the terminal device specifies the form area in which the user has entered the character string. Also, the terminal device uses the character recognition engine installed in the terminal device based on the stroke data included in the acquired form entry information to perform HWR (HandWriting Recognition) or OCR (Optical Character Recognition). ) To identify the character string entered in the identified form area. Further, the terminal device associates the specified form area and character string, and stores them in the memory as a recognition result. Further, the terminal device outputs a voice corresponding to the specified character string from the voice output unit, and simultaneously displays the specified character string on the display unit. Thereby, the user can confirm that the character string recognized by the electronic pen is not different from the intended character string. In other words, the user can grasp the erroneous recognition of the terminal device by voice output and character string display.

  When correcting the misrecognition of the electronic pen, the user first designates the form area of the character to be corrected on the electronic pen entry medium by tapping. Next, the corrected character on the electronic pen correction medium is designated by tapping. The user repeats this operation for every character he wants to correct. At this time, the electronic pen acquires coordinate information and the like corresponding to the tap on the electronic pen entry medium and the electronic pen correction medium as correction entry information, and immediately and sequentially transmits them to the terminal device. By referring to the second form area definition information based on the coordinate information included in the acquired correction entry information, the terminal device specifies the form area to be corrected designated by the user. Further, by referring to the correction area definition information stored in advance based on the coordinate information included in the acquired correction entry information, the terminal device specifies the correction area designated by the user by tapping. Furthermore, the terminal device refers to the correction area definition information, specifies the character described in the specified correction area, and specifies the corrected character designated by the user by tapping as the correction character. Then, the terminal device overwrites the character stored in association with the form area specified as the form area to be corrected with the corrected character. The terminal device outputs the voice corresponding to the character string overwritten with the corrected character from the voice output unit, and simultaneously displays the corrected character string on the display unit. Thereby, the user can grasp | ascertain whether the character string after correction was recognized with the electronic pen reliably.

  The terminal device further includes start / end point specifying means for specifying a data start point and a data end point based on the correction entry information, and the second form area specifying means is configured to include the data start point and the data end point. By referring to the second form area definition information based on the coordinate data of the point, it is possible to specify the form area including both the data start point and the data end point, and the correction area specifying means includes: By referring to the correction area definition information based on the coordinate data of the data start point and the data end point, it is possible to specify a correction area that includes both the data start point and the data end point.

  Furthermore, the correction medium for the electronic pen has a start area corresponding to the start of the correction process and an end area corresponding to the end of the correction process in addition to the correction area in which predetermined characters are described, and the terminal device Determining means for determining whether or not an entry has been made with the electronic pen in the start area and the end area by referring to the correction area definition information based on the coordinate data included in the correction entry information The correction entry information acquisition means, the second form area specification means, the correction area specification means, and the correction character specification means when the determination means determines that the entry with the electronic pen has been made in the start area. When the determination means determines that the electronic pen has entered the end area, the deletion means and the recognition result overwrite means operate. That. According to this, when the start area is tapped, the terminal device determines that correction is started, and when the end area is tapped, the user designates the form area to be corrected and the correction character. Is determined to be complete. Therefore, the correction process can be surely executed.

  Further, the form entry information and the correction entry information acquired from the electronic pen include time information in addition to coordinate information and stroke data. The time information is information indicating the time when characters are entered with the electronic pen or the time when a predetermined area is tapped. The entry character string recognition means recognizes the entry character string by connecting one or more characters recognized by character recognition based on the form entry information in time series based on time information included in the form entry information. . Thereby, a correct entry character string can be specified.

  The program according to the present invention is a program executed by a computer that processes information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern that can be recognized by the electronic pen is printed. The computer includes a voice output unit that outputs a voice and a display unit that displays a character string, and the program configures the electronic pen entry medium and recognizes a plurality of characters as a character string. First form area definition information storage means for storing first form area definition information in which a form area is associated with coordinate data indicating a position coordinate of the first form area on the coding pattern, and entry for the electronic pen A second form area that constitutes a medium and recognizes a character string character by character, and position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing second form area definition information associated with coordinate data, a correction area constituting the correction medium for the electronic pen, and a position of the correction area on the coding pattern Correction area definition information storage means for storing correction area definition information in which coordinate data indicating coordinates and characters written on the correction area are associated with each other, contents to be written in the electronic pen entry medium from the electronic pen A form entry information obtaining means for obtaining form entry information corresponding to the first entry area specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information; The form area specifying means and the description entered in the first form area specified by the first form area specifying means by character recognition based on the form entry information. An input character string recognizing unit for recognizing a character string, a first audio output unit for outputting a voice corresponding to the input character string from the audio output unit, a first display unit for displaying the input character string on the display unit, A recognition result storing means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other; the entry character string recognition means for recognizing the entry character string from the electronic pen After that, the correction entry information acquisition means for acquiring the correction entry information corresponding to the entry contents on the electronic pen entry medium and the correction medium for the electronic pen, the second based on the coordinate data included in the correction entry information By referring to the form area definition information, the second form area specifying means for specifying the second form area, the correction area definition information based on the coordinate data included in the correction entry information. A correction area specifying means for specifying the correction area by referring to the information, and a correction character for specifying the characters described on the correction area specified by the correction area specifying means by referring to the correction area definition information The second form area specifying means includes: a specifying means; a deletion means for deleting an entry character corresponding to the second form area specified by the second form area specifying means; and the recognition result storing means from the recognition result storage means. Recognition result overwriting means for associating and storing the specified second form area and the corrected character, and second sound output means for outputting the sound corresponding to the character string overwriting the corrected character from the sound output unit The computer is caused to function as second display means for displaying the corrected character string on the display unit. By executing the above program by a computer, the above terminal device can be realized. Moreover, each aspect of the above-described terminal device can be realized in the same manner.

  Further, according to the information processing system of the present invention, when the user enters an arbitrary character string in a predetermined form area of the electronic pen entry form, the electronic pen displays the coordinate information and stroke corresponding to the entered character string. Data and the like are acquired as form entry information and transmitted to the terminal device immediately and sequentially. In the terminal device, the form area in which the user has entered the character string is specified by referring to the first form area definition information stored in advance based on the coordinate information included in the acquired form entry information. Further, the terminal device executes a character string entered in the specified form area by executing HWR or OCR by a character recognition engine installed in the terminal device based on the stroke data included in the acquired form entry information. Is identified. Further, the terminal device associates the specified form area and character string, and stores them in the memory as a recognition result. Further, the terminal device outputs a voice corresponding to the specified character string from the voice output unit, and simultaneously displays the specified character string on the display unit. Thereby, the user can confirm that the character string recognized by the electronic pen is not different from the intended character string. In other words, the user can grasp the erroneous recognition of the terminal device by voice output and character string display. When correcting the erroneous recognition of the electronic pen, the user first taps the form area of the character to be corrected on the electronic pen entry medium. Next, the user specifies the corrected character on the correction medium for electronic pen by tapping. At this time, the electronic pen acquires coordinate information and the like corresponding to the tap on the electronic pen entry medium and the electronic pen correction medium as correction entry information, and immediately and sequentially transmits them to the terminal device. By referring to the second form area definition information based on the coordinate information included in the acquired correction entry information, the terminal device specifies the form area to be corrected designated by the user. Further, by referring to the correction area definition information stored in advance based on the coordinate information included in the acquired correction entry information, the terminal device specifies the correction area designated by the user by tapping. Furthermore, the terminal device refers to the correction area definition information, specifies the character described in the specified correction area, and specifies the corrected character designated by the user by tapping as the correction character. Then, the terminal device overwrites the character stored in association with the form area specified as the correction area with the correction character. The terminal device outputs the voice corresponding to the character string overwritten with the corrected character from the voice output unit, and simultaneously displays the corrected character string on the display unit. Thereby, the user can grasp | ascertain whether the character string after correction was recognized with the electronic pen reliably. In this way, when a character string entered in the electronic pen entry medium is erroneously recognized by the electronic pen, only the erroneously recognized characters can be individually corrected using the electronic pen correction medium.

  In addition, the input character string and the corrected character string can be output only by voice output or only by displaying the character string.

  According to the terminal device, the program used therefor, and the information processing system according to the present invention, when a character string entered in the electronic pen entry medium is erroneously recognized by the electronic pen, using the electronic pen correction medium, Only misrecognized characters can be individually corrected.

  Preferred embodiments of the present invention will be described below with reference to the drawings.

<First Embodiment>
As shown in FIGS. 1 and 2, the information processing system according to the present embodiment includes an electronic pen 10A (10), dedicated paper (electronic pen medium) 20, and a terminal device 25A (25). Here, FIG. 1 is a diagram schematically showing a usage pattern of the electronic pen 10A, and FIG. 2 is a block diagram showing a configuration of the electronic pen 10A. A dot pattern (coded pattern) is printed on the dedicated paper 20. The electronic pen 10A includes a pen tip portion 17 similar to a normal ink pen. When a user writes characters on the dedicated paper 20 with the pen tip portion 17 in the same manner as a normal ink pen, the electronic pen 10A The dot pattern printed on the dedicated paper 20 is read locally and continuously along the movement trajectory of the pen tip portion 17, the coordinates of the local position on the dedicated paper 20 are calculated, and the coordinate data and the like are used as the terminal device 25A. Send to. The electronic pen 10A is used in the vicinity of the terminal device 25A so that data can be reliably transmitted to the terminal device 25A. Based on the received coordinate data and the like, the terminal device 25A performs a predetermined process such as storing an input character or performing a process according to a tap. Hereinafter, each configuration will be described in detail.

[Dedicated paper]
First, the dedicated paper 20 will be described. The dedicated paper 20 is a paper in which a dot pattern is printed on a sheet of paper, and further, designs, items such as ruled lines and entry frames, words, words, illustrations, and the like are printed thereon. The dot pattern is printed with ink containing carbon that absorbs infrared rays. In addition, the design and the like are printed with ordinary ink that does not contain carbon. The dot pattern and the design may be printed on the paper at the same time, or either one may be printed first.

  5 and 6 show examples of the dedicated paper 20 on which a design or the like is printed. FIG. 5 is an example of an electronic pen entry form (hereinafter referred to as “entry form”). FIG. 6 shows an example of a correction palette for electronic pens (hereinafter referred to as “correction palette”).

  The entry form shown in FIG. 5 is an example of an installment application form, in which a product name area 61A that is a user area for entering a product name / model, a quantity area 62A that is a user area for entering a quantity, and a cash price are entered. A price area 63A and the like are printed. The dot pattern is printed on almost the entire surface of the entry form, and the name and request of each user area, the frame line of each user area, and the like are printed on it with normal ink that does not contain carbon. When applying for an installment without being conscious of the dot pattern, the user fills in necessary items in each user area using the electronic pen 10A.

  The correction palette shown in FIG. 6 is a form used for correcting a misrecognized character string, and includes a correction area 65 and a “start” which are user areas in which numbers from “0” to “9” are written. A determination area 66 which is a user area described, a determination area 67 which is a user area where “end” is described, and the like are printed. The dot pattern is printed on almost the entire surface of the correction pallet, and numbers, frame lines, and the like are printed thereon with ordinary ink that does not contain carbon. When the user corrects a misrecognized character string without being aware of the dot pattern, after tapping the start area 66 using the electronic pen 10A, the user selects the form of the character to be corrected on the entry form. Tap the area and tap the correction area 65 corresponding to the corrected correct character (hereinafter referred to as “corrected character”) (to the dedicated paper (electronic pen medium 20) of the pen tip portion 17 of the electronic pen 10A). Hit). Then, when completing the correction, the user taps the end area 67 using the electronic pen 10A.

[Dot pattern]
Next, the dot pattern will be described. FIG. 3 is a diagram illustrating the relationship between the dots of the dot pattern printed on the dedicated paper 20 and the values to which the dots are converted. As shown in FIG. 3, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the dedicated paper 20 are determined by the combination of information thus associated.

  FIG. 4A shows an arrangement of a certain dot pattern. As shown in FIG. 4A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken from any part of the dedicated paper. Yes. A dot pattern formed by these 36 dots holds position coordinates (for example, on which position the dot pattern is located on the dedicated paper). FIG. 4B is a diagram in which each dot shown in FIG. 4A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 10A that captures a dot pattern image.

[Electronic pen]
Next, the electronic pen 10A will be described. As shown in FIG. 2, the electronic pen 10A includes a processor 11, a data communication unit 13, a battery 14, an LED 15, a camera 16, a pressure sensor 18, and a clock 22 therein. The electronic pen 10A includes an ink cartridge (not shown) as a component similar to a normal ink pen.

  The LED 15 is attached in the vicinity of the pen tip of the electronic pen 10A, and irradiates infrared rays toward the vicinity of the pen tip portion 17 (region 15a) on the dedicated paper 20 (see FIG. 1). The region 15 a is slightly shifted from the position where the pen tip portion 17 contacts the dedicated paper 20. The camera 16 captures a dot pattern in the area 15 a illuminated by the LED 15 and supplies image data of the dot pattern to the processor 11. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 15 are absorbed by the carbon contained in the dots at the dot portions. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, the area of the dot containing carbon and the other area can be distinguished from the difference in the amount of reflected infrared light by photographing with the camera 16. Even if a ruled line, a frame, or the like is printed in the photographing region, the dot pattern can be recognized because the ink of the ruled line, the frame, etc. does not contain carbon. Note that the imaging area of the camera 16 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 4A, and the imaging of the camera 16 is performed about 50 to 100 times per second.

  The battery 14 is for supplying power to each component in the electronic pen 10A. For example, the power of the electronic pen 10A itself is turned on / off by attaching / detaching a cap (not shown) of the electronic pen 10A. May be. The clock 22 transmits the current time (time stamp) and supplies it to the processor 11. The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters or the like on the dedicated paper 20 with the electronic pen 10 </ b> A, that is, the writing pressure, and supplies the detected pressure to the processor 11.

  The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when a user writes characters or the like on the dedicated paper 20 with the electronic pen 10 </ b> A, writing pressure is applied to the pen tip 17, and when the pressure sensor 18 detects a writing pressure higher than a predetermined value, the processor 11. Determines that the user has started entry and activates the LED 15 and the camera 16.

  While the user inputs, the processor 11 uses the dot pattern of the image data supplied by the camera 16 to determine the X and Y coordinates (simply “coordinate data”) on the dedicated paper 20 of the stroke to be entered by the user. Is called continuously. That is, the processor 11 converts the image data of the dot pattern as shown in FIG. 4A supplied by the camera 16 into the data array shown in FIG. 4B, and further converts the X coordinate bit value · Y The coordinate bit value is converted, and X, Y coordinate data is calculated from the data array by a predetermined calculation method. Then, the processor 11 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data and the X and Y coordinate data, and uses these information as entry information to obtain data. The communication unit 13 is transmitted to the terminal device 25A. Here, since the 6 × 6 dot pattern in one sheet of dedicated paper (electronic pen medium) 20 does not overlap in the dedicated paper 20, the user needs to use the electronic pen 10A in the user area. Can be specified from the coordinate data to which user area of the dedicated paper 20 the entry or tap corresponds to.

  When the data communication unit 13 receives time information, writing pressure data, and X, Y coordinate data from the processor 11 as entry information, the data communication unit 13 wirelessly transmits it to the terminal device 25A. Transmission by the data communication unit 13 is preferably performed by wireless transmission using Bluetooth (registered trademark). The data transmission from the data communication unit 13 to the terminal device 25A may be performed by other methods such as wired transmission using a USB cable or data transmission by contact with a terminal. Transmission of entry information to the terminal device 25A by the data communication unit 13 is performed immediately and sequentially.

[Terminal device]
Next, the terminal device 25A will be described with reference to FIG. The terminal device 25A includes, as hardware, an antenna device capable of data communication with the electronic pen 10A, a processor such as a CPU, a memory such as ROM and RAM, a speaker, a display, and the like, a PC, a mobile phone, or a mobile terminal It is. FIG. 7 is a functional block diagram of the terminal device 25A. The terminal device 25A performs a predetermined process by executing a dedicated application based on entry information such as X and Y coordinate data acquired from the electronic pen 10A.

  As shown in FIG. 7, the terminal device 25A includes information storage means 31, entry information acquisition means 32, start / end point identification means 33, form area identification means 34, entry character string recognition means 35, voice output means 36, display means. 37, a recognition result storage means 38, a correction area specification means 39, a determination means 40, a correction character specification means 41, a recognition result overwrite means 42, a voice output unit 43 and a display part 44. Physically, the information storage unit 31 and the recognition result storage unit 38 are configured by a memory such as a ROM or a RAM, the entry information acquisition unit 32 is configured by a data communication unit, a processor, or the like, and the voice output unit 43 is a speaker or the like. The display unit 44 includes a display or the like. In addition, the start / end point specifying means 33, the form area specifying means 34, the entered character string recognizing means 35, the voice output means 36, the display means 37, the correction area specifying means 39, the determining means 40, the corrected character specifying means 41 and the recognition result The writing means 42 is incorporated in a processor such as a CPU.

  The information storage unit 31 is a memory that stores the user area and coordinate data indicating the position coordinates of the user area on the dot pattern in association with each other. The information storage means 31 functions as a first form area definition information storage means, a second form area definition information storage means, and a correction area definition information storage means in the present invention.

  That is, as shown in FIG. 8, the information storage means 31 includes an area ID for identifying a user area recognized by a character string of an entry form that is the dedicated paper 20, an area name that is the name of the user area, and a user area. 1st form area definition information which matched the coordinate data showing the position coordinate area | region of this is memorize | stored. The area name “product name area” is stored in association with the area ID “A01”, the area name “quantity area” is stored in association with the area ID “A02”, and the area name in association with the area ID “A03”. “Price area” is stored. The data (xn, yn), Hn, and Wn constituting the coordinate data of each user area are the coordinates of the vertex V (xn, yn) of the user area on the dot pattern and the Y-axis direction, respectively, as shown in FIG. Means the height and the width in the X-axis direction.

  Similarly, as shown in FIG. 10, the information storage means 31 includes an area ID for identifying a user area to be recognized for each character of the entry form, which is the dedicated paper 20, an area name that is the name of the user area, and a user Second form area definition information in which coordinate data representing the position coordinate area of the area is associated is stored. The area name “01 product name area” is stored in association with the area ID “A01a01”, the area name “02 product name area” is stored in association with the area ID “A01a02”, and the area ID “A02a01” is related. The area name “01 quantity area” is stored.

  Further, as shown in FIG. 11, the information storage means 31 shows an area ID for identifying the user area of the correction palette that is the dedicated paper 20, the characters written in the user area, and the position coordinate area of the user area. Correction area definition information associated with coordinate data is stored. The character “1” is stored in association with the area ID “B01”, the character “2” is stored in association with the area ID “B02”, and the character “start” is stored in association with the area ID “B11”. The character “end” is stored in association with the area ID “B12”.

  The entry information acquisition means 32 is means for immediately and sequentially acquiring entry information corresponding to the entry contents on the dedicated paper 20 transmitted by the data communication unit 13 of the electronic pen 10A, and is based on Bluetooth (registered trademark). It is composed of an antenna that receives radio waves of a communication method. The entry information includes information acquired when entering taps, characters, symbols, designs, and the like. In particular, entry information acquired by tapping is referred to as tap information. The time information included in the tap information is called a tap time. In the present embodiment, the entry information acquisition means 32 acquires entry information corresponding to the contents entered in the entry form as form entry information. In the present embodiment, the entry information acquisition unit 32 acquires entry information corresponding to the entry form and the tap on the correction palette as the correction entry information. The entry information includes both form entry information and correction entry information. The entry information acquisition means 32 functions as a form entry information acquisition means and a correction entry information acquisition means in the present invention.

  The start / end point specifying unit 33 specifies the data start point and data end point of the stroke included in the correction entry information acquired by the entry information acquisition unit 32. Specifically, the start / end point specifying means 33 specifies the coordinate data indicating the position coordinates of the data start point and the data end point and the entry time.

  The form area specifying means 34 refers to the first form area definition information (see FIG. 8) stored by the information storage means 31 based on the coordinate data included in the form entry information acquired by the entry information acquisition means 32. Identify the corresponding user area. The user areas constituting the entry form are collectively referred to as “form area”. That is, the form area specifying unit 34 specifies the corresponding form area by referring to the first form area definition information stored in the information storage unit 31 based on the coordinate data included in the form entry information.

  Further, the form area specifying unit 34 responds by referring to the second form area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information acquired by the entry information acquisition unit 32. Specify the form area. At this time, the form area specifying unit 34 may specify only the form area including both the data start point and the data end point of one stroke. With such a setting, if either the data start point or the data end point of the stroke entered by the user in the entry form is outside the range of the form area, the user tries to tap the form area. It can be determined that it is not intended. Further, the form area specifying means 34 is filled in the form area by the user based on the time at the data start point and the data end point specified by the start / end point specifying means 33 and / or the movement distance between the two points. It is determined whether or not the stroke is a tap. The form area specifying unit 34 specifies the form area tapped by the electronic pen 10A based on the correction entry information and the second form area definition information.

  The form area specifying means 34 functions as the first form area specifying means and the second form area specifying means in the present invention.

  The entered character string recognizing means 35 performs character recognition by HWR, OCR, etc. based on the form entry information acquired by the entry information acquisition means 32, thereby allowing the characters entered in the entry form using the electronic pen 10A. Recognize Further, the entry character string recognition means 35 recognizes the entry character string by connecting the recognized characters in time series based on the time information included in the form entry information.

  The voice output unit 36 causes the voice output unit 43 to output a voice representing the input character string recognized by the input character string recognition unit 35. The voice representing the entered character string may be output by reproducing the voice data stored in advance in the information storage unit 31, or may be output after voice synthesis.

  The display unit 37 displays the entry character string recognized by the entry character string recognition unit 35 on the display unit 44.

  The recognition result storage means 38 associates the form area specified by the form area specifying means 34 based on the form entry information and the first form area definition information with the entry character string recognized by the entry character string recognition means 35. This is the memory to store.

  The correction area specifying means 39 refers to the correction area definition information (see FIG. 11) stored in the information storage means 31 based on the coordinate data included in the correction entry information acquired by the entry information acquisition means 32, thereby enabling electronic correction. The correction area 65 tapped using the pen 10A is specified. At this time, the correction area specifying means 39 may specify only the correction area 65 including both the data start point and the data end point of one stroke. With such a setting, when either the data start point or the data end point of the stroke entered by the user in the correction palette is outside the range of the correction area 65, the user taps the correction area 65. It can be determined that it was not intended. The correction area specifying means 39 is entered in the correction area 65 by the user on the basis of the time at the data start point and the data end point specified by the start / end point specifying means 33 and / or the movement distance between the two points. It is determined whether or not the stroke is a tap. The correction area 65 and the tapping time (tap time) are temporarily stored in the information storage unit 31 in association with each other.

  Specifically, in determining whether the stroke entered on the dedicated paper 20 by the user is a tap, as a first method, the difference between the entry time of the data end point and the entry time of the data start point is used. And the stroke is determined to be a tap when the difference is less than a predetermined time (for example, 0.2 seconds) set in advance. As another second method, a movement distance (length of a written line) between the data start point and the data end point is calculated based on the coordinate data, and the movement distance is less than a predetermined distance set in advance. If it is, it may be determined that the stroke is a tap. Alternatively, as a third method, conditions may be attached to both the time and the moving distance at the data start point and the data end point to determine whether or not the stroke is a tap.

  The corrected character specifying means 41 specifies the characters described in the correction area 65 specified by the correction area specifying means 39 by referring to the correction area definition information stored in the information storage means 31.

  The determination unit 40 refers to the correction area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information acquired by the entry information acquisition unit 32, so that the electronic pen 10A uses the start area. It is determined whether 66 and the end area 67 have been tapped.

  When the determination unit 40 determines that the end area 67 has been tapped, the recognition result overwriting unit 42 deletes the entry characters corresponding to the form area specified by the second form area specifying unit, and specifies the second form area The form area specified by the means and the corrected character are stored in association with each other.

  When the determination unit 40 determines that the start area 66 has been tapped, the sound output unit 36 causes the sound output unit 43 to output a beep sound indicating the start of correction. Further, the sound output unit 36 causes the sound output unit 43 to output a beep sound indicating completion of correction when the determination unit 40 determines that the end area 67 has been tapped. Further, the voice output unit 36 causes the voice output unit 43 to reproduce and output a voice representing a character string in which the corrected character specified by the corrected character specifying unit 41 is overwritten. The sound representing the peep sound and the corrected character string may be output by reproducing the sound data stored in advance in the information storage unit 31, or may be output after being synthesized.

  The audio output means 36 functions as the first audio output means and the second audio output means in the present invention.

  The display unit 37 causes the display unit 44 to display a character string in which the corrected character specified by the corrected character specifying unit 41 is overwritten.

  The display means 37 functions as the first display means and the second display means in the present invention.

  The recognition result overwrite means 42 deletes the entry characters corresponding to the form area specified by the form area specifying means 34 based on the correction entry information from the recognition result storage means 38. Then, the recognition result overwrite means 42 associates the form area with the corrected character specified by the corrected character specifying means 41 and stores it in the recognition result storage means 38.

  In the terminal device 25A, the above-described units are configured by installing a dedicated application.

[Dedicated application]
Next, the dedicated application 50 will be described with reference to FIG. FIG. 12 shows a module configuration of the dedicated application 50. The dedicated application 50 executes predetermined processing based on entry information that is digital data corresponding to the contents entered on the dedicated paper 20 by the electronic pen 10A, and is installed in the terminal device 25A in advance by downloading or the like. Yes. In other words, the dedicated application 50 includes form entry information that is digital data corresponding to the contents entered in the entry form by the electronic pen 10A, and correction entry information that is digital data corresponding to the contents entered in the correction palette by the electronic pen 10A. Based on the above, predetermined processing is executed.

  The dedicated application is associated with the dedicated paper 20 in principle. That is, if the type of the dedicated paper 20 is different, the dedicated application for processing the data written in each dedicated paper 20 is different depending on the type. However, the correspondence between the dedicated paper 20 and the dedicated application is not necessarily one-to-one, and data may be processed by associating one dedicated application with a plurality of types of dedicated paper 20. Further, data may be processed by associating a single type of dedicated paper 20 with a plurality of dedicated applications.

  As shown in FIG. 12, the dedicated application 50 includes an information storage module 101, an entry information acquisition module 102, a start / end point identification module 103, a form area identification module 104, an entry character string recognition module 105, a voice output module 106, and a display module. 107, a recognition result storage module 108, a correction area identification module 109, a determination module 110, a correction character identification module 111, and a recognition result overwrite module 112.

  As shown in FIGS. 8, 10, and 11, the information storage module 101 stores the user area and coordinate data indicating the position coordinates of the user area on the dot pattern in association with each other as shown in FIGS. This module The information storage module 101 is a module for storing the entry information acquired by the entry information acquisition module 102, that is, the form entry information and the correction entry information, in the information storage unit 31.

  The entry information acquisition module 102 is a module having a function of acquiring entry information (including tap information) corresponding to entry with the electronic pen 10 </ b> A on the dedicated paper 20 using the entry information acquisition unit 32. That is, the entry information acquisition module 102 uses the entry information acquisition means 32 to enter the form entry information corresponding to the entry with the electronic pen 10A to the entry form, and the electronic pen to the electronic pen entry form and the electronic pen correction pallet. The correction entry information corresponding to the tap by 10A is acquired.

  The start / end point specification module 103 has a function of specifying the coordinate data and the entry time for each of the stroke data start point and data end point included in the correction entry information acquired by the execution of the entry information acquisition module 102.

  The form area specifying module 104 has a function of specifying a form area corresponding to the form entry information by referring to the first form area definition information shown in FIG. 8 based on the coordinate data included in the form entry information. Further, the form area specifying module 104 has a function of specifying the form area corresponding to the correction entry information by referring to the second form area definition information shown in FIG. 10 based on the coordinate data included in the correction entry information. Have. At this time, the form area specifying module 104 specifies the form area tapped by the electronic pen 10A based on the correction entry information and the second form area definition information, and includes the data start point of one stroke data, A form area including both data end points may be specified.

  The entry character string recognition module 105 performs character recognition by HWR, OCR, etc. based on the form entry information acquired by the execution of the entry information acquisition module 102, thereby filling in the entry form using the electronic pen 10A. Has a function of recognizing the generated characters. Furthermore, the entry character string recognition module 105 has a function of recognizing the entry character string by connecting the recognized characters in time series based on the time information included in the form entry information.

  The voice output module 106 overwrites the input character string recognized by the execution of the input character string recognition module 105 and the corrected character specified by the execution of the correction character specifying module 111 by the execution of the recognition result overwrite specifying module 111. The voice output unit 43 has a function of outputting a voice representing a character string. The audio output module 106 has a function of causing the audio output unit 43 to output a beep sound indicating the start and end of correction.

  The display module 107 overwrites the input character string recognized by the execution of the input character string recognition module 105 and the corrected character specified by the execution of the correction character specifying module 111 by the execution of the recognition result overwrite specifying module 111. The display unit 44 has a function of displaying the columns.

  The recognition result storage module 108 identifies the form area identified based on the form entry information by the execution of the form area identification module 104 and the entry recognized by the entry character string recognition module 105 with respect to the recognition result storage unit 38. It has a function of storing character strings in association with each other.

  The correction area specifying module 109 corresponds to the correction entry information by referring to the correction area definition information shown in FIG. 11 based on the coordinate data included in the correction entry information acquired by the execution of the entry information acquisition module 102. It has a function of specifying the correction area 65, the start area 66, or the end area 67. At this time, the correction area specifying module 109 specifies the correction area 65 or the start area 66 or the end area 67 tapped by the electronic pen 10A based on the correction entry information and the correction definition information. The correction area 65 or the start area 66 or the end area 67 including both the data start point and the data end point of the data may be specified. The correction area 65 and the tapping time (tap time) are temporarily stored in the information storage unit 31 in association with each other.

  The correction area specifying module 109 has a function of determining whether the correction entry information acquired by the execution of the entry information acquisition module 102 is tap information and whether it is a tap within a predetermined reading time. As described above, when the correction entry information is tap information, as described above, when the time from the entry time of the data start point to the entry time of the data end point is less than a predetermined time set in advance. A method of determining that the stroke is a tap (first method) and a determination that the stroke is a tap when the movement distance between the data start point and the data end point is less than a predetermined distance set in advance. Either the method (second method) may be adopted, and conditions may be set for both the time of the data start point and the data end point and the movement distance between the two points (third method). ). The correction area specifying module 109 temporarily stores the specified correction area 65 in the information storage unit 31.

  The determination module 110 refers to the correction area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information acquired by the execution of the entry information acquisition module 102, so that the electronic pen 10A. Thus, it has a function of determining whether or not the start area 66 and the end area 67 are tapped.

  When it is determined that the start area has been tapped by executing the determination module 110, the entry information acquisition module 102 uses the entry information acquisition unit 32 to correct the entry form and the correction palette corresponding to the tap with the electronic pen 10A. It has a function to acquire entry information.

  When it is determined that the start area has been tapped by execution of the determination module 110, the form area specifying module 104 is based on the coordinate data included in the correction entry information acquired by the execution of the entry information acquisition module 102, as shown in FIG. By referring to the second form area definition information shown in (1), the form area corresponding to the correction entry information is specified.

  When it is determined that the start area has been tapped by the execution of the determination module 110, the correction area specifying module 109 is based on the coordinate data included in the correction entry information acquired by the execution of the entry information acquisition module 102, as shown in FIG. By referring to the correction area definition information shown in (2), the correction area 65 corresponding to the correction entry information is specified.

  When it is determined that the start area has been tapped by execution of the determination module 110, the corrected character specifying module 111 refers to the correction area definition information stored in the information storage unit 31 to thereby change the correction area specifying module 109. It has a function of specifying characters described in the correction area 65 specified by execution.

  When it is determined that the end area has been tapped by executing the determination module 110, the recognition result overwrite module 112 corresponds to the form area specified by executing the form area specifying module 104 based on the correction entry information. It has a function to delete characters from the entered character string. The recognition result overwrite module 112 has a function of storing the form area and the corrected character specified by executing the corrected character specifying module 111 in association with each other and storing them in the recognition result storage unit 38.

[Character recognition processing flow by this information processing system]
Next, a processing flow performed by the information processing system of the first embodiment will be described with reference to FIGS. FIG. 13 is a diagram illustrating a usage pattern of the electronic pen 10A on the entry form according to the first embodiment. FIG. 14 is a diagram illustrating a usage pattern of the electronic pen 10A on the correction pallet in the first embodiment. FIG. 15 is a flowchart of character string recognition processing in the terminal device 25A. FIG. 16 is a flowchart of the correction process executed by the terminal device 25A in the character string recognition process.

  The user performs arbitrary entry in the form area of the entry form with the electronic pen 10A. For example, the user enters the number “123456” indicating the cash price in the price area 63A of the entry form with the electronic pen 10A (see FIG. 13). The electronic pen 10A transmits coordinate data, time information, and writing pressure data corresponding to entry in the price area 63A to the terminal device 25A as form entry information. Then, the entry information acquisition means 32 of the terminal device 25A acquires form entry information immediately and sequentially from the electronic pen 10A (step S1).

  Here, “immediately” means that when the electronic pen 10A acquires entry information such as X and Y coordinate data, the entry information is immediately transmitted to the terminal device 25A and is acquired by the terminal device 25A. Also, “sequentially” means that while the electronic pen 10A continuously acquires entry information such as X and Y coordinate data, the entry information is successively transmitted to the terminal device 25A and acquired by the terminal device 25A. It means that.

  Subsequently, the form area specifying means 34 refers to the first form area definition information shown in FIG. 8 on the basis of the coordinate data included in the form entry information acquired by the entry information acquisition means 32, thereby providing the form entry information. A form area corresponding to is specified (step S2). For example, the form area specifying unit 34 refers to the first form area definition information on the basis of the coordinate data included in the form entry information, so that the price area 63A (area ID “A03”) as the form area corresponding to the form entry information. ). Further, the entry character string recognition means 35 executes character recognition by HWR or OCR based on the form entry information acquired by the entry information acquisition means 32, so that the form area specified by the form area specification means 34 is displayed. Recognize written characters. The entered character string recognition means 35 connects the recognized characters in time series based on the time information included in the form entry information, so that the entered characters entered in the form area specified by the form area specifying means 34 A column is recognized (step S3). For example, the entered character string recognizing means 35 executes character recognition based on the form entry information, so that the characters “1”, “2”, “3”, “4”, “5” entered in the price area 63A. "," 6 "are recognized. The entered character string recognition means 35 recognizes the entered character string “123456” entered in the price area 63A by connecting the recognized characters in time series based on the time information included in the form entry information.

  The recognition result storage means 38 stores the form area specified by the form area specifying means 34 and the entry character string recognized by the entry character string recognition means 35 in association with each other (step S4). For example, the recognition result storage unit 38 associates the price area 63A (area ID “A03”) specified by the form area specifying unit 34 with the entry character string “123456” recognized by the entry character string recognition unit 35. Store. Also, the voice output unit 36 causes the voice output unit 43 to output a voice representing the entered character string recognized by the entered character string recognition unit 35 (step S5). At the same time, the display unit 37 displays the input character string recognized by the input character string recognition unit 35 on the display unit 44 (step S6). For example, the voice output unit 36 causes the voice output unit 43 to output a voice “123456 yen” representing the input character string “123456” recognized by the input character string recognition unit 35, and the display unit 37 outputs “123456”. It is displayed on the display unit 44.

  The entered character string recognizing means 35 may erroneously recognize the character string. For example, as shown in FIG. 13, even if the user intends to enter “123456” in the price area 63A, the entered character string recognition means 35 may erroneously recognize the entered character string “123450”. is there. Then, the voice output means 36 causes the voice output unit 43 to output the voice “123450 yen” representing the input character string “123450” erroneously recognized by the input character string recognition means 35, and the display means 37 sets “123450”. Is displayed on the display unit 44. Thereby, the user can grasp that the terminal device 25A has recognized a character string different from the character string intended by the user.

  When correcting the misrecognition by the terminal device 25A, the user first taps the start area 66 of the correction pallet with the pen tip portion 17 of the electronic pen 10A (see FIG. 14). Next, in the form area of the entry form, the form area of the character whose misrecognition is to be corrected, for example, the price area 63a is tapped (see FIG. 13). Then, the electronic pen 10A transmits coordinate data, time information, and writing pressure data corresponding to the tap to the form area to the terminal device 25A as correction entry information (tap information). The entry information acquisition unit 32 of the terminal device 25A acquires the correction entry information immediately and sequentially from the electronic pen 10A.

  The entry information acquisition unit 32 determines whether or not a character string is erroneously recognized by determining whether or not the start area has been tapped (step S7). When it is determined by the entry information acquisition means 32 that the start area has not been tapped (step S7; No), the terminal device 25A completes the character recognition process. On the other hand, when it is determined by the entry information acquisition means 32 that the start area has been tapped (step S7; Yes), the terminal device 25A executes a correction process (step S8).

  In the correction process, the terminal device 25A first receives a determination that the start area 66 has been tapped by executing the determination unit 40 (step S11). The voice output unit 36 of the terminal device 25A causes the voice output unit 43 to output a beep sound indicating the start of correction (step S12). Subsequently, the start / end point specifying unit 33 specifies the coordinate data and the entry time at the data start point and the data end point of the stroke included in the correction entry information acquired by the entry information acquisition unit 32. Next, the form area specifying unit 34 refers to the second form area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information, and specifies the corresponding form area. For example, the form area specifying unit 34 refers to the second form area definition information on the basis of the coordinate data included in the correction entry information, so that the 06 price area 63a (area ID “A03a06” is designated as the form area corresponding to the form entry information. )). At this time, the form area specifying means 34 determines that the entry information is tap information based on the difference between the entry times of the data start point and the data end point. That is, the form area specifying unit 34 specifies the form area tapped with the electronic pen 10A based on the correction entry information and the second form area definition information (step S13).

  When the user finishes tapping the form area where the misrecognition is to be corrected, the user taps the correct character in the correction area 65 of the correction palette by the pen tip portion 17 of the electronic pen 10A. For example, when the correct character is “6”, the user taps the correction area 65a in which the character “6” is described with the pen tip portion 17 of the electronic pen 10A (see FIG. 14). Then, the electronic pen 10A transmits coordinate data, time information, and writing pressure data corresponding to the tap to the correction area 65a to the terminal device 25A as correction entry information (tap information). The entry information acquisition unit 32 of the terminal device 25A acquires the correction entry information immediately and sequentially from the electronic pen 10A.

  Further, when the tap on the correction area 65a is completed, the user finally taps the correction palette end area 67 with the pen tip portion 17 of the electronic pen 10A. Then, the electronic pen 10A transmits coordinate data, time information, and writing pressure data corresponding to the tap to the end area 67 as correction entry information (tap information) to the terminal device 25A. The entry information acquisition unit 32 of the terminal device 25A acquires the correction entry information immediately and sequentially from the electronic pen 10A.

  Subsequently, the start / end point specifying unit 33 specifies the data start point and data end point of the stroke included in the correction entry information acquired by the entry information acquisition unit 32, and the coordinate data at the data start point and data end point. And specify the entry time. Next, the correction area specifying unit 39 refers to the correction area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information, so that the corresponding correction area 65a (area ID “B06”) is stored. ) Is specified (step S14). At this time, the correction area specifying means 39 determines that the entry information is tap information based on the difference between the entry times of the data start point and the data end point. Specifically, the correction area specifying unit 39 temporarily stores the specified correction area 65a (area ID “B06”) in association with the tap time in the information storage unit 31.

  The correction area specifying means 39 uses the strokes written on the dedicated paper 20 based on the movement distance between the points calculated from the coordinate data of the data start point and the data end point (the length of the written line). It may be determined whether or not is a tap.

  Subsequently, the corrected character specifying means 41 specifies the characters described in the correction area specified by the correction area specifying means 39 by referring to the correction area definition information stored in the information storage means 31 (step) S15). The corrected character specifying means 41 specifies the character “6” described in the correction area 65a of the area ID “B06” by referring to the correction area definition information.

  The determination means 40 is terminated by the electronic pen 10A by referring to the correction area definition information stored in the information storage means 31 based on the coordinate data included in the correction entry information acquired by the entry information acquisition means 32. It is determined whether or not the area 67 has been tapped (step S16). When it is determined by the determination means 40 that the end area 67 is not tapped (step S16; No), the terminal device 25A repeatedly executes the processes of steps S13 to S15.

  On the other hand, if it is determined by the determination means 40 that the end area 67 has been tapped (step S16: Yes), the recognition result overwriting means 42 determines that the form area specifying means 34 is based on the correction entry information from the recognition result storage means 38. Delete the entry characters corresponding to the specified form area. Further, the recognition result overwriting means 42 associates the form area with the corrected character specified by the corrected character specifying means 41 and stores it in the recognition result storage means 38. That is, the recognition result overwriting means 42 adds the corrected character specified by the corrected character specifying means 41 in association with the form area specified by the form area specifying means 34 based on the correction entry information in the recognition result storage means 38. Write and store (step S17). For example, the recognition result overwriting means 42 uses the entry characters associated with the 06 price area 63a (area ID “A03a06”) specified by the form area specifying means 34 based on the correction entry information in the recognition result storage means 38. “0” is deleted, and the corrected character “6” specified by the corrected character specifying means 41 is stored. And the audio | voice output means 36 outputs the peep which shows correction completion from the audio | voice output part 43 (step S18). Thereby, terminal device 25A completes correction processing, and performs processing of Step S5 in character recognition processing.

  The voice output unit 36 of the terminal device 25A causes the voice output unit 43 to output a voice representing a character string in which the corrected character specified by the corrected character specifying unit 41 is overwritten (step S5). At the same time, the display unit 37 displays the corrected character string specified by the corrected character specifying unit 41 on the display unit 44 (step S6). For example, the voice output unit 36 causes the voice output unit 43 to output a voice “123456 yen” representing the character string “123456” in which the corrected character specified by the corrected character specifying unit 41 is overwritten. 123456 ”is displayed on the display unit 44. Thereby, the user can confirm whether or not the character string intended by the user can be corrected. Then, the terminal device 25A repeatedly executes the processes of steps S5 to S7 in the character recognition process.

  In this way, the user can easily confirm whether or not the character string entered by himself / herself is correctly recognized by the sound output from the sound output unit 43 and the character string displayed on the display unit 44. . Moreover, the user does not need to write twice with a double line or the like in the entry form by using the correction pallet. Furthermore, since the two-layer form area is defined, only the erroneously recognized characters can be individually corrected.

[Operational effects of this information processing system]
According to this information processing system, when an entry is made in the form area of the entry form with the electronic pen 10A, the entry character string is recognized by performing character recognition based on the form entry information, and the entry character is read from the voice output unit 43 The voice representing the column is output, and the entry character string is displayed on the display unit 44. Therefore, the user can easily confirm whether or not the character string entered in the form area of the entry form is recognized correctly. In addition, the user can quickly correct the recognized character by tapping the correction area of the correction pallet with the electronic pen 10A. It is possible to correct misrecognition of a character string with high accuracy. Furthermore, since two layers of form areas are defined in the same area, only erroneously recognized characters can be individually corrected, and the correction time can be shortened.

  In addition, the said 1st Embodiment can also be comprised and changed as follows.

  For example, the information storage unit 31 stores first form area definition information (see FIG. 8), second form area definition information (see FIG. 10), and correction area definition information (see FIG. 11) separately. The user area name, the characters written in the user area, and the coordinate data of the user area may be stored in association with each other, and the data structure of these information may be arbitrarily set Can be set.

  In the first embodiment, the clock 22 of the electronic pen 10A transmits the current time (see FIG. 2), but the clock 22 is in a communication connection state from the time when the communication connection with the terminal device 25A is established. It is possible to transmit the entry time starting from 0 and elapses during the entry of the stroke until the end of. In this case, the processor 11 acquires the elapsed time (entry time) transmitted by the clock 22 as time information during stroke entry, and associates the time information, pen pressure data, and X, Y coordinate data, The data communication unit 13 is transmitted to the terminal device 25A as entry information.

Second Embodiment
Next, a second embodiment will be described. Parts similar to those in the second embodiment and the first embodiment are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The difference between the second embodiment and the first embodiment is that the electronic pen 10A of the first embodiment includes the clock 22 as shown in FIG. 2, but the electronic pen 10B (10) of the second embodiment. Does not include a clock 22 as shown in FIG. In this case, the processor 11 acquires the writing pressure data and the X and Y coordinate data while the user performs the entry using the electronic pen 10B, and uses the data communication unit 13 as the entry information for the terminal device. 25B (25). Instead, the terminal device 25B has a clock for transmitting the current time, and stores the acquisition time when the entry information is acquired from the electronic pen 10B in association with each other. That is, the terminal device 25B stores the entry information and the acquisition time of the entry information in association with each other.

  Subsequently, a processing flow in the second embodiment will be described. FIG. 18 is a flowchart of character recognition processing in the terminal device 25B.

  The user performs arbitrary entry in the form area of the entry form with the electronic pen 10B. For example, the user enters the number “123456” indicating the cash price in the price area 63A of the entry form with the electronic pen 10B (see FIG. 13). Then, the electronic pen 10B transmits coordinate data, time information, and writing pressure data corresponding to the entry in the price area 63A to the terminal device 25B as form entry information. The entry information acquisition means 32 of the terminal device 25B acquires the form entry information transmitted by the electronic pen 10B immediately and sequentially, and the form entry information and the clock of the terminal device 25B when the form entry information is obtained. The information on the current time that has been transmitted is associated (step S21). The time information associated with the entry time is called acquisition time.

  Subsequently, the form area specifying unit 34 corresponds to the form entry information by referring to the form area definition information shown in FIG. 8 based on the coordinate data included in the form entry information acquired by the entry information acquisition unit 32. A form area to be specified is specified (step S22). For example, the form area specifying unit 34 refers to the first form area definition information on the basis of the coordinate data included in the form entry information, so that the price area 63A (area ID “A03”) as the form area corresponding to the form entry information. ). Further, the entry character string recognition means 35 executes character recognition by HWR or OCR based on the form entry information acquired by the entry information acquisition means 32, so that the form area specified by the form area specification means 34 is displayed. Recognize written characters. Then, the input character string recognition means 35 recognizes the input character string entered in the form area specified by the form area specification means 34 by connecting the recognized characters in time series based on the acquisition time (step S23). For example, the entered character string recognizing means 35 executes character recognition based on the form entry information, so that the characters “1”, “2”, “3”, “4”, “5” entered in the price area 63A. "," 6 "are recognized. The entered character string recognition means 35 recognizes the entered character string “123456” entered in the price area 63A by connecting the recognized characters in time series based on the time information included in the form entry information.

  The recognition result storage means 38 stores the form area specified by the form area specifying means 34 and the entry character string recognized by the entry character string recognition means 35 in association with each other (step S24). For example, the recognition result storage unit 38 associates the price area 63A (area ID “A03”) specified by the form area specifying unit 34 with the entry character string “123456” recognized by the entry character string recognition unit 35. Store. Also, the voice output unit 36 causes the voice output unit 43 to output a voice representing the entered character string recognized by the entered character string recognition unit 35 (step S25). At the same time, the display unit 37 displays the entry character string recognized by the entry character string recognition unit 35 on the display unit 44 (step S26). For example, the voice output unit 36 causes the voice output unit 43 to output a voice “123456 yen” representing the input character string “123456” recognized by the input character string recognition unit 35, and the display unit 37 outputs “123456”. It is displayed on the display unit 44.

  The entered character string recognizing means 35 may erroneously recognize the character string. For example, as shown in FIG. 13, even if the user intends to enter “123456” in the price area 63A, the entered character string recognition means 35 may erroneously recognize the entered character string “123450”. is there. Then, the voice output means 36 causes the voice output unit 43 to output the voice “123450 yen” representing the input character string “123450” erroneously recognized by the input character string recognition means 35, and the display means 37 sets “123450”. Is displayed on the display unit 44. Thereby, the user can grasp that the terminal device 25B has recognized a character string different from the character string intended by the user.

  When correcting the misrecognition by the terminal device 25B, the user first taps the start area 66 of the correction pallet with the pen tip portion 17 of the electronic pen 10B (see FIG. 14, * mark indicates tap). Next, in the form area of the entry form, a form area for which erroneous recognition is to be corrected, for example, the price area 63a is tapped (see FIG. 13). Then, the electronic pen 10B transmits the coordinate data, time information, and writing pressure data corresponding to the tap to the form area to the terminal device 25B as correction entry information (tap information). The entry information acquisition means 32 of the terminal device 25B acquires the correction entry information (tap information) transmitted by the electronic pen 10B immediately and sequentially, and when the correction entry information and the correction entry information are obtained, the terminal device The current time information transmitted by the clock of 25B is associated.

  The entry information acquisition means 32 determines whether or not a character string has been erroneously recognized by determining whether or not the start area has been tapped (step S27). When it is determined by the entry information acquisition means 32 that the start area has not been tapped (step S27; No), the terminal device 25B completes the character recognition process. On the other hand, when it is determined by the entry information acquisition means 32 that the start area has been tapped (step S26; Yes), the terminal device 25B executes a correction process (step S28).

  The flowchart of the correction process in the terminal device 25B is the same as the flowchart of FIG. 16 of the correction process of the first embodiment. However, every time the correction entry information (tap information) transmitted by the electronic pen 10B is acquired, the entry information acquisition means 32 of the terminal device 25B acquires the correction entry information and the clock of the terminal device 25B when the correction entry information is acquired. This is different from the first embodiment in that the information (acquisition time) of the current time transmitted by is stored in association with each other.

  First, the terminal device 25B receives a determination that the start area 66 has been tapped by the execution of the determination unit 40 (step S11). The voice output unit 36 of the terminal device 25A causes the voice output unit 43 to output a beep sound indicating the start of correction (step S12). Subsequently, the start / end point specifying unit 33 specifies the coordinate data and the acquisition time at the data start point and the data end point of the stroke included in the correction entry information acquired by the entry information acquisition unit 32. Next, the form area specifying unit 34 refers to the second form area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information, and specifies the corresponding form area. For example, the form area specifying unit 34 refers to the form area definition information based on the coordinate data included in the correction entry information, so that the 06 price area 63a (area ID “A03a06”) is used as the form area corresponding to the form entry information. Is identified. At this time, the form area specifying unit 34 determines that the entry information is tap information based on the difference between the acquisition times of the data start point and the data end point. That is, the form area specifying unit 34 specifies the form area tapped with the electronic pen 10B based on the correction entry information and the form area definition information (step S13).

  In addition, when the user finishes tapping the form area where the misrecognition is to be corrected, the user taps the correct character in the correction area 65 of the correction palette by the pen tip portion 17 of the electronic pen 10B. For example, when the correct character is “6”, the user taps the correction area 65a in which the character “6” is described with the pen tip portion 17 of the electronic pen 10A (see FIG. 14). Then, the electronic pen 10B transmits the coordinate data, time information, and writing pressure data corresponding to the tap to the correction area 65a to the terminal device 25B as correction entry information (tap information). The entry information acquisition means 32 of the terminal device 25B acquires the correction entry information (tap information) transmitted by the electronic pen 10B immediately and sequentially, and associates the correction entry information with the acquisition time.

  Further, when the tap on the correction area 65a is completed, the user finally taps the correction palette end area 67 with the pen tip portion 17 of the electronic pen 10A. Then, the electronic pen 10A transmits coordinate data, time information, and writing pressure data corresponding to the tap to the end area 67 as correction entry information (tap information) to the terminal device 25A. The entry information acquisition means 32 of the terminal device 25B acquires the correction entry information (tap information) transmitted by the electronic pen 10B immediately and sequentially, and associates the correction entry information with the acquisition time.

  Further, when the tap to the correction area 65a is completed, the user finally taps the correction palette end area 67 by the pen tip portion 17 of the electronic pen 10B. Then, the electronic pen 10B transmits coordinate data, time information, and writing pressure data corresponding to the tap to the end area 67 to the terminal device 25B as correction entry information (tap information). The entry information acquisition means 32 of the terminal device 25B acquires the correction entry information (tap information) transmitted by the electronic pen 10B immediately and sequentially, and associates the correction entry information with the acquisition time.

  Subsequently, the start / end point specifying unit 33 specifies the data start point and data end point of the stroke included in the correction entry information acquired by the entry information acquisition unit 32, and the coordinate data at the data start point and data end point. And specify the entry time. Next, the correction area specifying unit 39 refers to the correction area definition information stored in the information storage unit 31 based on the coordinate data included in the correction entry information, so that the corresponding correction area 65a (area ID “B06”) is stored. ) Is specified (step S14). At this time, the correction area specifying means 39 determines that the input information is tap information based on the difference between the input times of the data start point and the data end point, and counts the number of taps to the specified correction area 65. . Specifically, the correction area specifying unit 39 temporarily stores the specified correction area 65a (area ID “B06”) in association with the tap time in the information storage unit 31.

  The correction area specifying means 39 uses the strokes written on the dedicated paper 20 based on the movement distance between the points calculated from the coordinate data of the data start point and the data end point (the length of the written line). It may be determined whether or not is a tap.

  Subsequently, the corrected character specifying means 41 specifies the characters described in the correction area specified by the correction area specifying means 39 by referring to the correction area definition information stored in the information storage means 31 (step) S15). For example, the corrected character specifying unit 41 specifies the character “6” described in the correction area 65a of the area ID “B06” by referring to the correction area definition information. Further, the determination unit 40 refers to the correction area definition information stored in the information storage unit 31 on the basis of the coordinate data included in the correction entry information acquired by the entry information acquisition unit 32, whereby the electronic pen 10B. Thus, it is determined whether or not the end area 67 has been tapped (step S16). When it is determined by the determination means 40 that the end area 67 is not tapped (step S16; No), the terminal device 25B repeatedly executes the processes of steps 13 to S15.

  On the other hand, if it is determined by the determination means 40 that the end area 67 has been tapped (step S16: Yes), the recognition result overwriting means 42 determines that the form area specifying means 34 is based on the correction entry information from the recognition result storage means 38. Delete the entry characters corresponding to the specified form area. Further, the recognition result overwriting means 42 associates the form area with the corrected character specified by the corrected character specifying means 41 and stores it in the recognition result storage means 38. That is, the recognition result overwriting means 42 adds the corrected character specified by the corrected character specifying means 41 in association with the form area specified by the form area specifying means 34 based on the correction entry information in the recognition result storage means 38. Write and store (step S17). For example, the recognition result overwriting means 42 uses the entry characters associated with the 06 price area 63a (area ID “A03a06”) specified by the form area specifying means 34 based on the correction entry information in the recognition result storage means 38. “0” is deleted, and the corrected character “6” specified by the corrected character specifying means 41 is stored. And the audio | voice output means 36 outputs the peep which shows correction completion from the audio | voice output part 43 (step S18). Thereby, the terminal device 25B completes the correction process and executes the process of step S25 in the character recognition process.

  The voice output unit 36 of the terminal device 25B causes the voice output unit 43 to output a voice representing a character string in which the corrected character specified by the corrected character specifying unit 41 is overwritten (step S25). At the same time, the display unit 37 causes the display unit 44 to display a character string in which the corrected character specified by the corrected character specifying unit 41 is overwritten (step S26). For example, the voice output unit 36 causes the voice output unit 43 to output a voice “123456 yen” representing the character string “123456” in which the corrected character specified by the corrected character specifying unit 41 is overwritten. Then, the character string “123456” overwritten with the corrected character specified by the corrected character specifying means 41 is displayed on the display unit 44. Thereby, the user can confirm whether or not the character string intended by the user can be corrected. And the terminal device 25B repeatedly performs the process of step S26 and S27 in a character recognition process.

  Thus, the user can easily confirm whether or not the character string entered by himself / herself is correctly recognized based on the sound output from the sound output unit 43 and the character string displayed on the display unit 44. . Moreover, the user does not need to write twice with a double line or the like in the entry form by using the correction pallet. Furthermore, since the two-layer form area is defined, only the erroneously recognized characters can be individually corrected.

  In the second embodiment, the clock of the terminal device 25B starts from 0 until the communication connection state ends from the time when the communication connection with the electronic pen 10B is established, and elapses during the entry of the stroke. You may make it transmit entry time (elapsed time). In addition, the data structure of information stored in the information storage unit 31 of the terminal device 25B, the reading time determination method in the correction area specifying unit 39, the audio data output by the audio output unit 43, and the like are changed in the first embodiment. You may change suitably like an example.

  As described above, according to the first and second embodiments, it is possible to recognize an input character string written on the electronic pen entry medium and present it to the user as a voice. In addition, when the entered character string is erroneously recognized, it is possible to individually correct only the erroneously recognized characters using the electronic pen correction medium.

  The present invention is not limited to the first and second embodiments.

  In the above embodiment, the character string overwritten with the input character string and the corrected character is to be recognized by the user by voice output and character string display, but the output of the character string overwritten with the input character string and the corrected character is Only voice output may be performed, or only character string display may be performed.

  Further, property information (pen information or pen owner information) regarding the pen itself or its owner may be held in the electronic pen 10 so that it can be referred to from the terminal device 25, or property information. May be transmitted to the terminal device 25 together with the entry information. Pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, and the like. Pen owner information includes nationality, language, time zone, email address, name, address, fax / phone number, mobile phone number, and the like.

  In the above embodiment, the dot is ink containing carbon that absorbs infrared rays, and the LED 15 of the electronic pen 10 is an LED that irradiates infrared rays. However, it is not limited to this. For example, the dot is ink that emits light of a predetermined wavelength by light of a predetermined wavelength, the LED 15 of the electronic pen 10 is irradiated with light that emits ink of the dot, and the region of the wavelength that the ink of the dot emits light by the camera 16 is set. By detecting the dot pattern, the electronic pen 10 may read the dot pattern. If the dot pattern can be read by the camera 16, the ink type of the dot and the irradiation light of the LED 15 are limited to those shown in the above embodiment. I can't. In addition, as long as the position coordinates on the dedicated paper 20 can be specified, another coded pattern such as a two-dimensional code pattern may be used instead of the dot pattern.

  In addition, the dot pattern is normally assigned for each use of the paper, but when the dedicated paper 20 is printed in large quantities by a commercial printing machine, the same dot pattern is printed on the same type of electronic pen medium. Will be. In this case, in order to distinguish the electronic pen medium of the same type one by one, the electronic pen medium may be provided with an identification information entry field for entering identification information for identifying each medium. In the terminal device 25, if the identification information entered in the identification information entry field is identified by character recognition based on the entry information acquired from the electronic pen 10, and stored in association with the entry information, the same type of electronic The pen medium can be distinguished one by one. In addition, the pen ID may be stored in association with the entry information together with the identification information. Thereby, the terminal device 25 can identify each electronic pen medium based on the stored identification information or the identification information and the pen ID. On the other hand, when printing with a printer, it is also possible to assign a different dot pattern to each sheet of paper and print the dedicated paper 20. In this case, since the dot pattern printed on each dedicated paper 20 is different for each dedicated paper 20, the dedicated paper 20 can be identified and distinguished one by one by the dot pattern.

  The present invention can be used for all applications that perform character recognition using an electronic pen. For example, the information entered in the PIN number field of the credit card application form, the calculation part field of the installment application form, the amount calculation part field of the household account book application, the month / day recognition part field of the calendar application, and the part number entry part field of the inspection business form It can be applied when processing information. In particular, since the characters can be individually corrected, the larger the number of recognized character strings, the more effective.

It is a figure which shows the usage pattern of an electronic pen typically. It is a block diagram which shows the structure of the electronic pen in 1st Embodiment. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. (A) is a diagram schematically showing a dot pattern, and (b) is a diagram showing information corresponding to the dot pattern. It is a figure which shows the example of the entry form which is a medium for electronic pens. It is a figure which shows the example of the correction pallet which is a medium for electronic pens. It is a functional block diagram of a terminal device. It is a figure which shows typically the data structure of 1st form area definition information. It is a figure explaining coordinate data. It is a figure which shows typically the data structure of 2nd form area definition information. It is a figure which shows typically the data structure of correction area definition information. It is a module block diagram of the exclusive application in 1st Embodiment. It is a figure which shows the example of the usage condition of an electronic pen in the entry to an entry form. It is a figure which shows the example of the usage condition of an electronic pen in entry to a correction pallet. It is a flowchart of the character recognition process in 1st Embodiment. It is a flowchart of the correction process in 1st Embodiment. It is a block diagram which shows the structure of the electronic pen in 2nd Embodiment. It is a flowchart of the character recognition process in 2nd Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10, 10A, 10B ... Electronic pen, 11 ... Processor, 13 ... Data communication unit, 14 ... Battery, 15 ... LED, 16 ... Camera, 18 ... Pressure sensor, 20 ... Dedicated paper (medium for electronic pen), 22 ... Clock , 25, 25A, 25B ... terminal device, 31 ... information storage means, 32 ... entry information acquisition means, 33 ... start / end point identification means, 34 ... form area identification means, 35 ... entry character string recognition means, 36 ... voice output 37, display means, 38 ... recognition result storage means, 39 ... correction area specifying means, 40 ... determination means, 41 ... corrected character specifying means, 42 ... recognition result overwriting means, 43 ... voice output unit, 44 ... display 50, dedicated application

Claims (11)

A terminal device for processing information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed,
An audio output unit for outputting audio;
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing;
From the electronic pen, a form entry information acquisition means for acquiring form entry information corresponding to the content entered in the electronic pen entry medium;
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
An input character string recognizing means for recognizing an input character string entered in the first form area specified by the first form area specifying means by character recognition based on the form entry information;
A first voice output means for outputting a voice corresponding to the written character string from the voice output unit;
A recognition result storing means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means;
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
A correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
By referring to the correction area definition information, a correction character specifying means for specifying characters described on the correction area specified by the correction area specifying means;
A deletion unit that deletes an entry character corresponding to the second form area identified by the second form area identification unit from the recognition result storage unit;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
A terminal device comprising: a second voice output unit that outputs a voice corresponding to a character string in which the corrected character is overwritten from the voice output unit. A display for displaying a character string;
First display means for displaying the written character string on the display unit;
The terminal device according to claim 1, further comprising: a second display unit configured to display a character string in which the corrected character is overwritten on the display unit. A terminal device for processing information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed,
A display for displaying a character string;
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing;
From the electronic pen, a form entry information acquisition means for acquiring form entry information corresponding to the content entered in the electronic pen entry medium;
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
An input character string recognizing means for recognizing an input character string entered in the first form area specified by the first form area specifying means by character recognition based on the form entry information;
First display means for displaying the written character string on the display unit;
A recognition result storing means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means;
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
A correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
By referring to the correction area definition information, a correction character specifying means for specifying characters described on the correction area specified by the correction area specifying means;
A deletion unit that deletes an entry character corresponding to the second form area identified by the second form area identification unit from the recognition result storage unit;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
And a second display means for displaying a character string in which the corrected character is overwritten on the display unit.   The terminal device according to claim 1, wherein the electronic pen transmits the acquired form entry information and correction entry information to the terminal device immediately and sequentially. Based on the correction entry information, further comprising a start / end point specifying means for specifying a data start point and a data end point,
The second form area specifying means includes both the data start point and the data end point by referring to the second form area definition information based on the coordinate data of the data start point and the data end point. To identify the form area
The correction area specifying means refers to the correction area definition information based on the coordinate data of the data start point and the data end point, thereby determining a correction area including both the data start point and the data end point. The terminal device according to claim 1, wherein the terminal device is specified. The correction medium for the electronic pen has a start area corresponding to the start of the correction process and an end area corresponding to the end of the correction process, in addition to the correction area where the predetermined characters are described.
The terminal device
By further referring to the correction area definition information based on the coordinate data included in the correction entry information, further comprises a determination means for determining whether or not an entry with the electronic pen has been made in the start area and the end area,
When the determination means determines that the entry with the electronic pen has been made in the start area, the correction entry information acquisition means, the second form area specification means, the correction area specification means, and the correction character specification means operate. The terminal device according to any one of claims 1 to 5, wherein the deletion unit and the recognition result overwriting unit operate when the determination unit determines that an entry with the electronic pen has been made in the end area. .   The entry character string recognition means recognizes the entry character string by connecting one or more characters recognized by character recognition based on the form entry information in time series based on time information included in the form entry information. The terminal device according to claim 1, wherein: A program executed by a computer for processing information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed,
The computer includes an audio output unit for outputting audio,
The program is
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing,
Form entry information acquisition means for acquiring form entry information corresponding to the entry contents on the electronic pen entry medium from the electronic pen,
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
Entry character string recognition means for recognizing an entry character string entered in the first form area identified by the first form area identification means by character recognition based on the form entry information;
A first voice output means for outputting a voice corresponding to the written character string from the voice output unit;
A recognition result storage means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means,
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
Correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
A corrected character specifying means for specifying a character described on the correction area specified by the correction area specifying means by referring to the correction area definition information;
Deleting means for deleting the entry characters corresponding to the second form area specified by the second form area specifying means from the recognition result storage means;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
A program for causing the computer to function as second voice output means for outputting voice corresponding to a character string in which the corrected character is overwritten from the voice output unit. A program executed by a computer for processing information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed,
The computer includes a display unit that displays a character string,
The program is
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing,
Form entry information acquisition means for acquiring form entry information corresponding to the entry contents on the electronic pen entry medium from the electronic pen,
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
Entry character string recognition means for recognizing an entry character string entered in the first form area identified by the first form area identification means by character recognition based on the form entry information;
First display means for displaying the written character string on the display unit;
A recognition result storage means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means,
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
Correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
A corrected character specifying means for specifying a character described on the correction area specified by the correction area specifying means by referring to the correction area definition information;
Deleting means for deleting the entry characters corresponding to the second form area specified by the second form area specifying means from the recognition result storage means;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
A program for causing the computer to function as second display means for displaying a character string in which the corrected character is overwritten on the display unit. An electronic pen entry medium and an electronic pen correction medium on which an encoded pattern recognizable by the electronic pen is printed;
An electronic pen that reads the coded pattern printed on the electronic pen entry medium and the electronic pen correction medium as form entry information and correction entry information, and transmits it to the outside;
An information processing system comprising: a terminal device that acquires the form entry information and the correction entry information transmitted by the electronic pen and executes a predetermined process;
The terminal device
An audio output unit for outputting audio;
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing;
From the electronic pen, a form entry information acquisition means for acquiring form entry information corresponding to the content entered in the electronic pen entry medium;
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
An input character string recognizing means for recognizing an input character string entered in the first form area specified by the first form area specifying means by character recognition based on the form entry information;
A first voice output means for outputting a voice corresponding to the written character string from the voice output unit;
A recognition result storing means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means;
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
A correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
By referring to the correction area definition information, a correction character specifying means for specifying characters described on the correction area specified by the correction area specifying means;
A deletion unit that deletes an entry character corresponding to the second form area identified by the second form area identification unit from the recognition result storage unit;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
An information processing system comprising: a second voice output unit that outputs a voice corresponding to a character string in which the corrected character is overwritten from the voice output unit. An electronic pen entry medium and an electronic pen correction medium on which an encoded pattern recognizable by the electronic pen is printed;
An electronic pen that reads the coded pattern printed on the electronic pen entry medium and the electronic pen correction medium as form entry information and correction entry information, and transmits it to the outside;
An information processing system comprising: a terminal device that acquires the form entry information and the correction entry information transmitted by the electronic pen and executes a predetermined process;
The terminal device
A terminal device for processing information entered in an electronic pen entry medium and an electronic pen correction medium on which a coded pattern recognizable by the electronic pen is printed,
A display for displaying a character string;
A first form that constitutes the electronic pen entry medium and associates a first form area that recognizes a plurality of characters as a character string with coordinate data indicating the position coordinates of the first form area on the coded pattern. First form area definition information storage means for storing area definition information;
A second form area that constitutes the electronic pen entry medium and associates a second form area that recognizes a character string character by character with coordinate data indicating the position coordinates of the second form area on the coded pattern Second form area definition information storage means for storing definition information;
Correction area definition information in which a correction area constituting the correction medium for the electronic pen, coordinate data indicating a position coordinate of the correction area on the coded pattern, and characters written on the correction area are associated with each other. Correction area definition information storage means for storing;
From the electronic pen, a form entry information acquisition means for acquiring form entry information corresponding to the content entered in the electronic pen entry medium;
A first form area specifying means for specifying the first form area by referring to the first form area definition information based on the coordinate data included in the form entry information;
An input character string recognizing means for recognizing an input character string entered in the first form area specified by the first form area specifying means by character recognition based on the form entry information;
First display means for displaying the written character string on the display unit;
A recognition result storing means for storing the first form area specified by the first form area specifying means and the entry character string in association with each other;
Correction entry information for obtaining correction entry information corresponding to the entry contents on the electronic pen entry medium and the electronic pen modification medium after the entry character string recognition means recognizes the entry character string from the electronic pen Acquisition means;
A second form area specifying means for specifying the second form area by referring to the second form area definition information based on the coordinate data included in the correction entry information;
A correction area specifying means for specifying the correction area by referring to the correction area definition information based on the coordinate data included in the correction entry information;
By referring to the correction area definition information, a correction character specifying means for specifying characters described on the correction area specified by the correction area specifying means;
A deletion unit that deletes an entry character corresponding to the second form area identified by the second form area identification unit from the recognition result storage unit;
A recognition result overwriting means for storing the second form area specified by the second form area specifying means in association with the corrected character in the recognition result storage means;
And a second display means for displaying a character string in which the corrected character is overwritten on the display unit.

Images