JP2011060115A - Information processing system and display processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing system which can resolve the hardness to write, with respect to entry of characters by handwriting, while simplifying a writer's operation, and surely reflecting the writer's request for the rotating angle of a character entry area. <P>SOLUTION: A processing means 24 has a character entry area control part 243 which controls a character entry area 406 to which characters or symbols are input. The character entry area control part 243 performs rotation control processing of the character entry area 406. The writer puts an electronic pen 1 on a rotation control mark 408 projected on a screen 4 and draws a stroke, whereby the control part rotates the character entry area 406. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing system capable of inputting information using a coding pattern indicating position coordinates, and more particularly to control of a region for entering character information such as characters and symbols entered by a user.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto Pen” developed by Anoto, Sweden, is known as a representative one. This anotopen is used together with dedicated paper (hereinafter simply referred to as “exclusive paper”) on which a dot pattern indicating position coordinates patterned by a predetermined algorithm is printed.

  Specifically, the anotopen was calculated at the pen tip with a small camera for imaging a dot pattern printed on dedicated paper, and a processor for calculating position coordinates on the dedicated paper from the captured dot pattern. It is equipped with a data communication unit that transmits position coordinates etc. to an external device. In addition, when a user writes characters on the special paper with an anotopen, or when a check mark is entered in the image designed on the special paper, the small camera prints on the special paper as the pen moves. The captured dot pattern is imaged, and information (hereinafter referred to as “entry information”) such as characters, symbols, or figures entered by the user is obtained from successive position coordinates calculated by the processor. . This entry information is transmitted from the Anotopen to a nearby terminal device such as a personal computer or a mobile phone by the data communication unit (see, for example, Patent Document 1).

  Recently, a system for writing character information such as characters and symbols by touching a display screen of a computer device with a dedicated pen or the like has been proposed, and one of them is an area on a predetermined screen. One using a character entry area for entering character information handwritten by a user is known.

  For example, as a system that can fill in and input such characters, a character entry area is set in advance, and a character entry is performed by acquiring handwritten characters or symbols in the character entry area. The burden on the user (so-called user) during entry is reduced (for example, Patent Document 2).

  On the other hand, recently, it is also known that such a device for inputting handwritten characters is used as an input interface of a navigation device in a moving body such as an automobile (for example, Patent Document 3). Here, the inclination angle of the character entry area is set based on the instruction of the writer, and entry information is entered based on the set inclination angle.

  Furthermore, unlike the technique described above, without setting the character entry area, the entry person is free to fill in the entry information, and based on the entered entry information, the written direction (writing direction), the size of the character In addition, there is also known one that acquires entry information by analyzing the direction of each character (character direction) (for example, Patent Document 4).

Japanese translation of PCT publication No. 2003-511761 JP-A-8-50530 JP 2008-250679 A JP 2002-175498 A

  However, in any of the systems for inputting handwritten characters described in Patent Documents 2 to 4, the character entry area can be easily and surely removed in order to eliminate difficulty in writing by the writer when entering characters. Difficult to tilt.

  For example, in the device for inputting handwritten characters described in Patent Document 2, although there is a description that characters are written in the tilted character entry area, how is the character entry area inclined at what angle, Since there is no mention of the setting method, this character entry area cannot be inclined easily and reliably.

  Further, in the navigation device described in Patent Document 3, the character entry area is not displayed while the tilt operation is being performed in the character entry area by the entry person. It is easy or difficult to imagine, and it is difficult to reliably set the angle requested by the writer.

  On the other hand, the information processing system described in Patent Document 4 does not have a function to display a character entry area for supporting a character input position and reducing a processing load such as recognition processing. Since the position where information is input is not fixed, there is no concept of tilting the character entry area.

  The present invention has been made in order to solve the above-mentioned problems, and its purpose is to directly write a character entry handwritten while manipulating the character entry area, thereby simplifying the writer's operation. An object of the present invention is to provide an information processing system and a display processing program capable of eliminating difficulty and reliably reflecting the desire of the writer with respect to the rotation angle of the character entry area.

  In order to solve the above-described problem, the invention according to claim 1 is a reading unit that reads the coded pattern along a movement path when the coded pattern indicating the position coordinates is moved on the screen. A calculation unit that calculates the coordinates of the movement path based on the data of the coded pattern read by the reading unit, and a projection that projects the shape of the movement path as an image on the screen based on the calculated coordinates of the movement path. The projection output means for outputting to the means, and a demarcation mark for defining the character entry area for entering the character is displayed on the screen, and the rotation control mark that serves as a reference when the character entry area is rotated is used as the reference. Rotation control means for rotating the character entry area, and the reading means moves on the screen from the position of the rotation control mark. In this case, the rotation control unit has a configuration in which a predetermined point is set as a rotation center point, and the character entry area is rotated based on the set center point and the moving path of the reading unit. Yes.

  With this configuration, the invention according to claim 1 enables the character entry area to be rotated with reference to a predetermined center point when the reader moves the reading means from the position of the rotation control mark. The character entry area can be directly rotated without performing other operations such as setting the center point when rotating the entry area. In addition, since the character entry area rotates while displaying a demarcation mark that delimits the character entry area on the screen, the writer can fill in the character entry area to eliminate the difficulty of writing handwritten characters. It can be reliably rotated to the desired position. Therefore, it is possible to eliminate the difficulty of writing for handwritten characters while simplifying the operation of the writer, and to surely reflect the desire of the writer on the rotation angle of the character entry area.

  According to a second aspect of the present invention, there is provided reading means for reading the coded pattern along a movement path when moving on a light-transmitting sheet on which a coded pattern indicating position coordinates is formed, and the reading Calculating means for calculating the coordinates of the movement path based on the data of the coded pattern read by the means, and the shape of the movement path based on the calculated coordinates of the movement path as an image from the back surface of the light transmissive sheet. The character entry area while displaying on the display means a display output means for outputting to the display means for visually displaying from the front surface of the light transmissive sheet, and a demarcation mark for defining a character entry area for entering a character. Rotation control means for rotating the character entry area using a rotation control mark which becomes a reference when the image is rotated, and the reading means The rotation control means sets a predetermined point as the center point of rotation when moving on the light transmissive sheet from the position, and based on the set center point and the movement path of the reading means The character entry area is rotated.

  With this configuration, the invention according to claim 2 allows the character entry area to be rotated with reference to a predetermined center point when the reader moves the reading means from the position of the rotation control mark. The character entry area can be directly rotated without performing other operations such as setting the center point when rotating the entry area. Moreover, since the character entry area is rotated while displaying the demarcation mark for defining the character entry area on the display means through the light-transmitting sheet, the character entry for eliminating the difficulty of writing the handwritten character entry. The area entry can be reliably rotated to the position desired by the writer. Therefore, it is possible to eliminate the difficulty of writing for handwritten characters while simplifying the operation of the writer, and to surely reflect the desire of the writer on the rotation angle of the character entry area.

  The invention according to claim 3 is the information processing system according to claim 1 or 2, wherein the rotation control mark includes a plurality of rotation control marks, and the rotation control means moves the character entry area when the character entry area rotates. A rotation control mark different from the rotation control mark having the coordinates of the start position of the path is set as the rotation center point.

  With this configuration, since the invention according to claim 3 has a plurality of rotation control marks, the user can select any rotation control mark, and any rotation control mark is selected. Since the rotation control mark different from the rotation control mark is set as the rotation center point, the character entry area can be arbitrarily rotated in accordance with each writer's request.

  According to a fourth aspect of the present invention, in the information processing system according to any one of the first to third aspects, character recognition is performed based on the coordinates of the movement path included in the character entry area. Further comprising character recognition processing means, wherein when the character entry area is rotated, the character recognition process means before rotating the moving path of the reading means based on the rotation angle of the character entry area. It has the structure which converts into the movement path | route equivalent to a character entry area | region, and performs the said character recognition.

  With this configuration, the invention according to claim 4 can convert the movement path of the reading means into a movement path corresponding to the character entry area before the rotation based on the rotation angle of the character entry area. Rather than determining whether or not the entry information is rotated, it is possible to execute a recognition process quickly and improve the recognition accuracy.

  According to a fifth aspect of the present invention, in the information processing system according to the first aspect, the projection output unit outputs an image signal to be displayed on the display screen of the display unit, and is calculated by the calculation unit. A coordinate conversion unit that converts the coordinates into the coordinates of the display screen of the display unit, and the rotation control unit is instructed to coordinate the rotation control mark based on the coordinates converted by the coordinate conversion unit. It has the structure which recognizes that.

  With this configuration, in the invention described in claim 5, the coordinates calculated by the calculation means are converted into the coordinates of the display screen of the display means by the coordinate conversion section, and the rotation control means determines that the coordinates of the rotation control mark are Since it is configured to recognize that it has been instructed, the rotation control means can perform the rotation process of the character entry area based on the coordinate system of the rotation control mark on the display screen of the display means.

  The invention according to claim 6 is the information processing system according to claim 2, further comprising a coordinate conversion unit that converts the coordinates calculated by the calculation means into coordinates on a display screen of the display means, The rotation control means has a configuration for recognizing that the coordinates of the rotation control mark are instructed based on the coordinates converted by the coordinate conversion unit.

  With this configuration, in the invention according to claim 6, the coordinates calculated by the calculation means are converted into the coordinates of the display screen of the display means by the coordinate conversion section, and then the rotation control means sets the coordinates of the rotation control mark. Since it is configured to recognize that it has been instructed, the rotation control means can perform the rotation process of the character entry area based on the coordinate system of the rotation control mark on the display screen of the display means.

  According to a seventh aspect of the present invention, when the electronic pen that reads the coding pattern indicating the position coordinates and calculates the coordinates of the movement path moves on the screen on which the coding pattern is formed, the electronic pen A display processing program that is executed by a computer that performs information processing for displaying a shape indicating a movement path on the screen based on the coordinates of the movement path calculated by the electronic pen. Projection output means for outputting to the projection means for projecting the shape of the path as an image on the screen, and when the character entry area rotates while displaying a demarcation mark for defining the character entry area for entering the character on the screen And functioning as a rotation control means for rotating the character entry area using a reference rotation control mark. In addition, when the electronic pen moves on the screen from the position of the rotation control mark, a predetermined point is set as the rotation center point, and based on the set center point and the movement path of the electronic pen. The computer functions as the rotation control means so as to rotate the character entry area.

  In the invention according to claim 8, when the electronic pen that reads the coding pattern indicating the position coordinates and calculates the coordinates of the movement path moves on the light-transmitting sheet on which the coding pattern is formed, A display processing program executed by a computer that performs information processing for displaying a shape indicating a movement path of the electronic pen on the light-transmitting sheet, wherein the computer has a movement path calculated by the electronic pen. Display output means for outputting the shape of the moving path as an image based on the coordinates from the back surface of the light transmissive sheet to the display means for visual display from the front surface of the light transmissive sheet, characters for entering characters While displaying the demarcation mark that delimits the entry area on the display means, the rotation control mark is used as a reference when the character entry area is rotated. And functioning as a rotation control means for rotating the character entry area, and when the electronic pen moves on the light transmissive sheet from the position of the rotation control mark, a predetermined point is set as the rotation center point, The computer is configured to function as the rotation control means so as to rotate the character entry area based on the set center point and the movement path of the electronic pen.

  An information processing system according to the present invention can be configured by installing the above program in a computer device.

  In the present invention, if the reader moves the reading means from the position on the coordinates of the rotation control mark, the character entry area can be rotated with reference to a predetermined center point. The character entry area can be rotated without performing other operations such as setting the center point.

  Further, according to the present invention, since the character entry area rotates while displaying a demarcation mark for defining the character entry area on the screen, entry of the character entry area for eliminating difficulty in writing handwritten characters is performed. Can be reliably rotated to the position desired by the writer.

  Therefore, the present invention can eliminate the difficulty of writing handwritten characters while simplifying the operations of the writer, and can surely reflect the desires of the writer with respect to the rotation angle of the character entry area. .

It is a system configuration figure showing the composition of the information processing system in a 1st embodiment. It is a figure explaining the relationship between the arrangement | positioning of the dot in a dot pattern, and the value into which the dot is converted. It is a figure for demonstrating a dot pattern, (a) shows a dot pattern typically, (b) is a figure which shows the example of the information corresponding to it. It is the schematic which shows the structure of an electronic pen, and is a block diagram which shows the function It is a functional block diagram which shows the function of a computer apparatus. It is a figure for demonstrating the character entry area | region in 1st Embodiment, its rotation, and a rotation control mark, (a) is an example of the character entry area | region and rotation control mark set to a part of screen 4, and (B) is an example of the rotated character entry area. It is a figure for demonstrating the relationship between the character recognition area | region recognized by the rotated character entry area | region in 1st Embodiment, (a) is an example of the rotated character entry area | region, and (b) is rotated. It is an example of the character group described in the character entry area. It is a flowchart which shows the operation | movement of the display process including the rotation control process in the information processing system of 1st Embodiment. It is a flowchart which shows the operation | movement of the character recognition process in the information processing system of 1st Embodiment. It is a system configuration figure showing the composition of the information processing system in a 2nd embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  In the embodiment described below, a predetermined image is projected onto a screen having a predetermined coding pattern by a projecting unit such as a projector, and the user fills in the screen and a predetermined electronic pen described later. This is an embodiment when the information processing system and the display processing program of the present invention are applied to an information processing system for superimposing written entry information on the image.

<First Embodiment>
First, a first embodiment of an information processing system according to the present invention will be described with reference to FIGS.

[System configuration of information processing system]
First, the configuration of the information processing system 10 in the present embodiment will be described. FIG. 1 is a system configuration diagram showing the configuration of the information processing system 10 in the present embodiment.

  As shown in FIG. 1, the information processing system 10 according to the present embodiment includes an electronic pen 1 used by a user, and an entry made on the screen 4 by handwriting such as a character, a symbol, or a figure using the electronic pen 1. A computer device 2 that receives and processes information, and a projector 3 that receives an image signal from the computer device 2 and projects the same image on the screen 4 when displayed on the display means 26 of the computer device 2. .

  For example, the electronic pen of the present embodiment constitutes the reading means and calculation means of the present invention, the computer device 2 constitutes the rotation control means and recognition means of the present invention, and the projector 3 projects the projection of the present invention. Configure the means.

[screen]
Next, the screen 4 in the present embodiment will be described.

  The screen 4 includes a magnet plate 401 that is hard enough to apply a sufficient writing pressure to the electronic pen 1 and a sheet 402 on which a dot pattern (coded pattern) described later is formed on the entire surface by printing. In particular, the paper 402 is fixed to the front surface of the magnet plate 401 by pressing it with a magnet from above the paper 402 or by attaching it with glue, adhesive or the like. Instead of the magnet plate 401, a white board, a partition board, a wall surface of a room, or the like may be used. Further, instead of the paper 402, a sheet on which a dot pattern is printed may be used, or the dot pattern may be directly formed on the screen 4.

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) printed on the sheet 402 of the screen 4 in this embodiment will be described with reference to FIGS. FIG. 2 is a diagram for explaining the relationship between the dots of the dot pattern and the values to which the dots are converted. FIG. 3 is a diagram for explaining a dot pattern.

  As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). Further, the value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on 4 are determined. This dot pattern is printed with an ink containing carbon that absorbs infrared rays.

  FIG. 3A shows an arrangement of dot patterns at a certain position. As shown in FIG. 3 (a), 6 × 6 36 dots (hereinafter referred to as “6 × 6 dots”) within a range of about 2 mm in length and breadth from any part on the screen 4 (paper 402). Even if 6 × 6 dots are taken, they are arranged so as to form a unique pattern. The dot pattern formed by these 36 dots holds relative position coordinates on the screen 4 (paper 402). Note that FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. . This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the structure and operation of the electronic pen 1 in this embodiment will be described with reference to FIG. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1 and a block diagram showing its function.

  The electronic pen 1 is used for tapping (light tapping on the screen 4 by the pen tip portion 103) and writing of characters, symbols or figures on the screen 4 on which an image is projected by the projector 3. Further, when the user who becomes the writer taps on the screen 4 using the electronic pen 1 or draws a character, a symbol, or a figure, the electronic pen 1 moves on the screen 4 of the pen tip portion 103 described later. A dot pattern printed on the paper 402 is read locally and continuously along a path (hereinafter also referred to as “handwriting” or “stroke”). The electronic pen 1 calculates the coordinates of the local position on the screen 4 and transmits the calculated position coordinate data to the computer device 2.

  Specifically, as shown in FIG. 4, the electronic pen 1 includes a processor 108 including a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a CPU, a ROM, A memory 109 such as a RAM, a real-time clock 110, a communication unit 111 including an antenna and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the pen point unit 103 is brought into contact with the sheet 402 of the screen 4 by the user when writing or tapping characters. The handwriting written on the screen 4 by the electronic pen 1 is projected by the projector 3 by the processing of the computer device 2, so that the pen unit 104 may be not filled with ink, but can be erased. It may be filled with ink.

  The battery 112 is for supplying electric power to each member in the electronic pen 1. For example, the power of the electronic pen 1 itself is turned on / off by detaching a cap (not shown) of the electronic pen 1. It is configured. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied from the pen tip portion 103 through the pen portion 104 when the user enters a character or the like on the screen 4 with the electronic pen 1 or taps it, that is, the writing pressure. Is transmitted to the processor 108.

  Based on the pen pressure data provided from the pressure sensor 107, the processor 108 performs pen-down of the electronic pen 1 (first contact with the screen 4) and pen-up (the pen tip portion 103 leaves the touched state). Is turned on / off of the LED 105 and the CMOS camera 106. That is, when the user enters characters or the like on the screen 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and the pressure sensor 107 detects a writing pressure higher than a predetermined value. It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated. Then, when the user releases the electronic pen 1 from the screen 4, the pressure sensor 107 does not detect a writing pressure higher than a predetermined value. At this time, the processor 108 finishes entering one handwriting. And the operation of the LED 105 and the CMOS camera 106 is terminated.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 irradiates infrared rays toward the vicinity of the pen tip portion 103 on the screen 4. The region irradiated with infrared rays is configured to be slightly shifted from the position where the pen tip portion 103 contacts the screen 4. The CMOS camera 106 captures the above-described dot pattern in the area illuminated by the LED 105 and supplies image data of the dot pattern to the processor 108.

  As described above, since the dot pattern is printed with ink containing carbon that absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed at the positions of the dots. As a result, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. For this reason, by taking a picture with the CMOS camera 106, by setting a threshold value based on the difference in the amount of reflected infrared rays, it is possible to distinguish the dot area containing carbon from the other areas. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  The processor 108 operates while the characters or the like are written on the screen 4 by the user, that is, when the LED 105 and the CMOS camera 106 are switched on based on the writing pressure data supplied from the pressure sensor 107. The X and Y coordinates (hereinafter also simply referred to as “positional coordinates” and “coordinate data”) on the screen 4 are individually calculated for each dot pattern of each image data supplied by. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. Then, the data is converted into a Y coordinate bit value, and X, Y coordinate data is calculated from the data array by a predetermined calculation method.

  As described above, since the 6 × 6 dot pattern on the screen 4 does not overlap within the screen 4, when the user enters characters or the like with the electronic pen 1, the entered position is any position on the screen 4. Can be specified by coordinate calculation by the processor 108. Then, the processor 108 generates one coordinate attribute information by associating the current time (T) transmitted from the real-time clock 110, the pen pressure data (P), and the X and Y coordinate data.

  The memory 109 stores property information such as a pen ID (electronic pen identification information) such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 sequentially transmits each entry information in which the pen ID is associated with the coordinate attribute information or the like to the computer device 2. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark).

  Next, entry information transmitted from the electronic pen 1 to the computer device 2 will be described. When a user writes a stroke (handwriting) on the screen 4 using the electronic pen 1, first, the electronic pen 1 is brought into contact with the screen 4. Then, the pressure sensor 107 of the electronic pen 1 detects the writing pressure applied to the pen tip portion 103. When the processor 108 of the electronic pen 1 determines that the pressure sensor 107 has detected a writing pressure of a predetermined value or more, the processor 108 includes pen-down information PD indicating contact of the electronic pen 1 with the entry sheet 4 and identification information of the electronic pen 1. The entry information associated with the pen ID or the like is generated, and the communication unit 111 transmits the entry information to the computer apparatus 2.

  The user draws a stroke by moving the pen tip portion 103 after the pen tip portion 103 of the electronic pen 1 touches the entry sheet 4, but the processor 108 of the electronic pen 1 also continues to calculate coordinate information (X , Y), coordinate attribute information including pen pressure data (P) detected by the pressure sensor 107, time information (T) transmitted by the real-time clock 110, and entry information associated with the pen ID, The information is sequentially generated according to the dot pattern imaging period 106 and the communication unit 111 sequentially transmits the entry information to the computer apparatus 2.

  When the user finishes drawing the stroke and removes the electronic pen 1 from the entry sheet 4, the pressure sensor 107 does not detect the writing pressure. Therefore, the processor 108 determines that the pressure sensor 107 does not detect a writing pressure higher than a predetermined value. Then, entry information in which the pen-up information PU indicating the removal of the electronic pen 1 from the entry sheet 4 is associated with the pen ID which is the identification information of the electronic pen 1 is generated, and the entry information is entered in the communication unit 111. Information is transmitted to the computer apparatus 2. As described above, a set of coordinate attribute information generated by the electronic pen 1 from when the electronic pen 1 is determined to be pen-down to when the electronic pen 1 is determined to be pen-up, that is, when one stroke is entered by the user is referred to as stroke information. .

[Computer device]
Next, the computer apparatus 2 of this embodiment will be described with reference to FIGS. 1 and 5. FIG. 5 is a functional block diagram showing each function of the computer apparatus 2.

  The computer device 2 is, for example, a personal computer, and includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as ROM and RAM, a display, a mouse, a keyboard, and the like. The Further, as shown in FIG. 5, the computer apparatus 2 functionally includes an input means 21, such as a mouse or a keyboard, a receiving means 22, a processing means 24, a storage means 25, a display means 26, and a transmitting means 27, and an electronic device. A predetermined process is performed based on each entry information received from the pen 1.

  The receiving unit 22 includes an antenna, a receiving circuit, and the like, and sequentially receives each entry information transmitted from the electronic pen 1 and transmits it to the processing unit 24.

  The processing means 24 is constituted by a processor such as a CPU, and as shown in FIG. 5, a calibration processing unit 241 that executes a calibration process, which will be described later, is displayed on the display means 26 based on the result of the calibration process. A coordinate conversion unit 242 that performs coordinate conversion, a character entry region control unit 243 that controls a character entry region 206 into which characters and symbols are input, a character recognition processing unit 244 that recognizes characters and symbols in the character entry region 206, and a display A display control unit 245 that performs display control of the means 26 is provided. In particular, the character entry area control unit 243 performs rotation control processing of the character entry area 206, and the character entry area 206 is defined based on stroke entry information drawn on the screen 4 by the user with the electronic pen 1. Rotate. Details of each part of the processing unit 24 including the character entry area control unit 243 will be described later.

  The storage means 25 is configured by a memory such as a hard disk, a ROM, or a RAM, and a program for executing calibration processing (hereinafter referred to as “calibration program”) and a program for rotating the character entry area 206 ( Hereinafter, a “character entry area rotation program”) and a program for executing a character recognition process (hereinafter referred to as “character recognition program”) are stored. The storage unit 25 stores entry information received from the electronic pen 1 and various data generated by processing of the processing unit 24 described later.

  Further, in the storage unit 25, information on the position and shape of the calibration mark displayed on the display unit 26 on the display screen 201 regarding the calibration program, the coordinates of the dot pattern printed on the sheet of the screen 4 The value of the area is stored, and the coordinate conversion function obtained as a result of the calibration process is stored.

  Further, in the storage means 25, the initial value of the coordinate area of the character entry area 206 displayed on the display means 26 and a mark for demarcating and displaying the range (hereinafter also referred to as “definition mark”) regarding the character entry area rotation program. .) Information on the shape and the like of 207, information used for rotation control of the character entry area (hereinafter referred to as “rotation control mark”) 208, information on the relative position and shape in the character entry area, and other character entry areas Information necessary for the rotation control 206 is stored. The storage means 25 stores the value of the coordinate area of the character entry area 206 after being rotated by the user's operation with the electronic pen 1, the rotation angle, stroke information entered in the character entry area 206, and the like.

  Further, the storage means 25 is used to collate the shape pattern of the stroke group drawn in the character entry area 406 projected on the screen 4 and taken in as an entry in the character entry area 206 regarding the character recognition program. Information on the pattern of each character and symbol (hereinafter referred to as “pattern information”) and other information necessary for character recognition processing are stored.

  The display means 26 is constituted by a display or the like, and displays the contents instructed by the processing means 24. As shown in FIG. 1, the display screen 201 of the display means 26 has a display control unit of the processing means 24. Through the processing of 245, the recognized character display position mark 205, the character entry area 206, the demarcation mark 207, and the rotation control mark 208 are displayed.

  The transmission unit 27 transmits an image signal used for image display on the display unit 26 to the projector 3 according to an instruction from the processing unit 24. Therefore, the same image as that displayed on the display screen 201 of the computer apparatus 2 is enlarged and projected onto the image projection area 403 by the projector 3 on the screen 4. In the example shown in FIG. 1, the character entry area 206 and the rotation control mark 208 defined by the definition mark 207 displayed on the display screen 201 are respectively entered on the screen 4 by the character defined by the corresponding definition mark 407. Projected as a region 406 and a rotation control mark 408. The data transmission method to the projector 3 by the transmission unit 27 may be a wired method or a wireless method.

[Processing means]
Next, details of each part of the processing means 24 in the computer apparatus 2 will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram for explaining the character entry area 406 and its rotation and rotation control mark 408. FIG. 6A shows a character entry area 406, a demarcation mark 407 and a projection mark 407 projected onto the screen 4 by the projector 3. The rotation control mark 408 is shown, and (b) shows the rotated character entry area 406. FIG. 7 is a diagram for explaining the relationship between the rotated character entry area 406 and the recognized character. FIG. 7A shows the rotated character entry area 406, and FIG. A state in which strokes written with the electronic pen 1 are displayed in the written character entry area 406 is shown.

  The calibration processing unit 241 executes processing for obtaining a coordinate conversion function for converting the position coordinates based on the dot pattern on the screen 4 to the position coordinates on the display screen 201 in the display unit 26 of the computer apparatus 2. Specifically, for example, the calibration processing unit 241 causes the projector 3 to project the calibration mark on the screen 4 by displaying two or more calibration marks on the display screen 201 of the display unit 26. When the receiving unit 22 receives the coordinate data on the screen 4 generated by tapping the calibration mark projected on the screen 4 by the electronic pen 1, the calibration processing unit 241 uses the calibration mark as a calibration mark. The correspondence relationship between the position coordinates on the display screen 201 of the display means 26 and the position coordinates of the dot pattern on the screen 4 is obtained to obtain a coordinate conversion function.

  The coordinate conversion unit 242 performs X, Y on the screen 4 included in each entry information for each entry information transmitted and received from the electronic pen 1 based on the coordinate conversion function obtained by the calibration processing unit 241. The coordinate data is converted into the X and Y coordinates of the stroke on the display screen 201 in the display means 26 and stored in the storage means 25. At this time, when the coordinate conversion unit 242 recognizes that the converted X, Y coordinates (hereinafter also referred to as “calibration coordinates”) are within the coordinate area of the character entry area 206, the coordinate conversion unit 242 determines the calibration coordinates. These are stored in the storage means 25 as stroke information by entry in the character entry area 206.

  The character entry area control unit 243 has an initial value of the coordinate area of the character entry area 206 stored in the storage means 25, information on the demarcation mark 207 for delimiting and displaying the range, and rotation used for rotation control of the character entry area 206. Based on the relative position of the control mark 208 in the character entry area 206, the character entry area 206, the demarcation mark 207, and the rotation control mark 208 are displayed on the display screen 201 of the display means 26 as shown in FIG. The transmission unit 27 transmits an image signal for projecting the same image as the image to the projector 3, and the projector 3 projects an image on the screen 4 based on the image signal. Therefore, the same image as the character entry area 206, the demarcation mark 207, and the rotation control mark 208 on the display screen 201 of the display means 26 is displayed as shown in FIGS. 1 and 6A. The rotation control mark 408 is projected onto the screen 4.

  Here, the character entry area 206 is displayed in a horizontally long rectangular shape, and the rotation control mark 208 is displayed in a small square shape at each of the four corners of the character entry area 206. That is, a rotation control mark 208A is displayed at the upper left in the character entry area 206, a rotation control mark 208B at the lower left, a rotation control mark 208C at the upper right, and a rotation control mark 208D at the lower right. Accordingly, a horizontally long and rectangular character entry area 406 is projected on the screen 4 by the projector 3, and the rotation control mark 408A is located in the upper left of the character entry area 406, the rotation control mark 408B is located in the lower left, and the rotation control mark 408C is located in the upper right. A rotation control mark 408D is displayed on the lower right (FIG. 1 and FIG. 6A).

  In this example, the character entry area 406 (206) is displayed in an outer frame. However, the character entry area 406 (206) may be highlighted using yellow or other colors to fill in the entry information. The character entry area 406 (206) may be displayed by a ruled line (underline) for prompting.

  In addition, the character entry area control unit 243 uses the coordinate conversion function to convert the position coordinates at the start position (pen down) of the stroke entered on the screen 4 by the user using the electronic pen 1. If it is within the coordinate area 208, it is determined that the input stroke is an instruction to rotate the character entry area 206, and a rotation control mark 408 (hereinafter referred to as “reference mark”) designated by pen-down. A rotation control mark 408 different from the above is used as a rotation center point (hereinafter referred to as a “center point mark”), while maintaining the size and shape of the character entry area 206, and the character based on the input stroke. The rotation of the entry area 206 is controlled. At this time, since the projection images of the rotation control marks 208A to 208D correspond to the rotation control marks 408A to 408D, the user pens down the electronic pen 1 to any of the rotation control marks 408A to 408D on the screen 4. By drawing the stroke, the character entry area control unit 243 rotates the character entry area 206, and the image is projected by the projector 3 as it is.

  Here, regarding the setting of the center point mark, when the rotation control mark 408A (208A) is designated as the reference mark, the character entry area control unit 243 sets the rotation control mark 408C (208C) as the rotation center, When the rotation control mark 408B (208B) is designated as the reference mark, the rotation control mark 408D (208D) is set as the rotation center. When the rotation control mark 408C (208C) is designated as the reference mark, the character entry area control unit 243 sets the rotation control mark 408A (208A) as the rotation center, and the rotation control mark 408D (208D) is set. When designated as a reference mark, the rotation control mark 408D (208D) is set as the rotation center.

  Therefore, for example, as shown in FIG. 6B, the character entry area control unit 243 rotates the rotation control mark 408C (208C) as a reference mark based on one stroke entered on the screen 4 by the user. The control mark 408A (208A) is set as the center point mark, and the character entry area 406 (206) is rotated according to the stroke of the electronic pen 1. Then, the character entry area control unit 243 stops the rotation of the character entry area 406 (206) at the end position of the stroke, the coordinates of the center point mark, the coordinates of the start position (initial value) of the reference mark, and the reference mark Rotation angle (θ) is calculated from the coordinates of the end position of, and stored in storage means 25 together with rotation flag information indicating that character entry area 406 (206) is rotating. Therefore, even if the stroke by the electronic pen 1 does not draw an accurate arc centered on the set center point mark, the rotation angle (θ) is determined by the coordinates of the center point mark, the coordinates of the start position of the reference mark, and the reference point. The character entry area 406 (206) is also rotated by the rotation angle (θ) while maintaining its size and shape, which is determined by the coordinates of the end position of the mark.

  Further, the character entry area control unit 243 calculates coordinate data after rotation based on the rotation angle (θ) of the two rotation control marks 408 (208) other than the center point mark and the reference mark, and the coordinate data of the center point mark. Along with the coordinate data of the reference mark, it is stored in the storage means 25 as coordinate area data of the character entry area 406 (206) after rotation. Therefore, even when the character entry area 406 (206) is rotating, the coordinate conversion unit 242 indicates that the stroke information received from the electronic pen 1 is entered in the rotated character entry area 406 (206). It can be determined whether or not it is a thing.

  The character recognition processing unit 244 executes character recognition processing for the stroke of the electronic pen 1 entered in the character entry area 406 based on a predetermined instruction. Specifically, the character recognition processing unit 244 according to the present embodiment performs a recognition start key (not shown) such as the computer device 2 or the like in the coordinate input area 403 after handwritten entry such as characters and symbols is executed in the character entry area 406. When a tap operation in a recognition start area (not shown) or the character entry area 406 of the electronic pen 1 is detected, calibration coordinates (that is, the electronic pen 1) stored in the storage means 25 as entry information in the character entry area 406 are detected. The stroke coordinate data on the display screen of the display means 26 corresponding to the coordinate data of the stroke on the screen 4 is reversely rotated by the rotation angle (θ) and the coordinate data of the rotation center (the rotation matrix of −θ is changed). Character recognition is performed based on the coordinate data after the coordinate conversion. That is, the character recognition processing unit 244 coordinates in the character recognition target stroke (the stroke entered with the electronic pen 1 in the character entry area 406 (206)) in the same manner as a program for character recognition such as OCR (Optical Character Reader). The converted X, Y coordinate pattern and the pattern information of each character or symbol stored in advance in the storage means 25 are collated to identify the character or symbol.

  Here, as shown in FIGS. 7A and 7B, when it is determined that the character entry area 406 is rotated during the character recognition process (for example, the storage means 25 rotates it). If flag information is stored), the position of the set center point mark with respect to the calibration coordinate group stored in the storage means 25 as stroke information obtained by being entered in the character entry area 406 The rotation coordinates (θ) stored as the rotation center are rotated backward (by applying a rotation matrix of −θ) to normalize the calibration coordinates of each stroke, and the normalized X, Y coordinate group Character recognition processing is executed for the pattern by. As a result, it is possible to improve the accuracy of identifying characters and the like, that is, the recognition accuracy, by correcting the written characters and symbols in a state of being written horizontally.

  The display control unit 245 displays a calibration mark on the display screen 201 of the display unit 26 according to an instruction from the calibration processing unit 241 during the calibration process. Further, the display control unit 245 displays the character entry region 206, the demarcation mark 207, and the rotation control mark 208 according to an instruction from the character entry region control unit 243, or during and after the rotation by the operation using the electronic pen 1. The state is displayed on the display screen 201 of the display means 26 in real time. Further, the display control unit 245 causes the display screen 201 of the display unit 26 to display a stroke based on the position coordinates (calibration coordinates) obtained by coordinate conversion of the coordinate data of the entry information transmitted from the electronic pen 1 by the coordinate conversion unit 242. .

  In addition, when character recognition is executed, the display control unit 245 erases the display of handwritten strokes such as characters, symbols, and other figures displayed in the character entry area 206 and is specified by character recognition. Text data of characters and symbols is displayed at a place determined as a character input position. Specifically, when the computer device 2 is executing a program such as a text editor and the program window is displayed on the display screen of the display means 26, the display control unit 245 displays the character specified by character recognition. Is displayed at the position where the cursor for character input is located. At this time, the text data candidates after the character recognition are temporarily displayed in the character entry area 406 (206), and a confirmation key (not shown) such as the computer device 2 or a confirmation area (not shown) in the coordinate input area 403 or the electronic pen 1 is displayed. It may be configured to display at a predetermined character input position by detecting a tap operation in the character entry area 406.

  Note that the display control unit 245 projects image signals for causing the projector 3 to project the images displayed on the display screen 201 in synchronization with each other in order to project and display various images on the screen 4. The data is output and transmitted to the projector 3.

  Further, the projector 3 projects an image similar to the image displayed on the display unit 26 on the image projection area 403 of the screen 4 based on the image signal received from the transmission unit 27 of the computer apparatus 2.

[Rotation control processing]
Next, the operation of the rotation control process in the information processing system 10 will be described with reference to FIG. 8 together with various processes accompanying the reception of entry information. FIG. 8 is a flowchart showing display processing including rotation control processing in the information processing system 10 of this embodiment.

  In this operation processing, calibration processing is executed in advance by the calibration processing unit 241, a coordinate conversion function is obtained and stored in the storage unit 25, and coordinate conversion is performed by the coordinate conversion unit 242. Then, the character entry area control unit 243 refers to the initial value of the coordinate area of the character entry area 206 stored in the storage means 25, and as shown in FIG. 1, at the lower left of the display screen 201 of the display means 26, A character entry area 206 and a rotation control mark 208 defined by a rectangular demarcation mark 207 are displayed. Since an image signal for indicating the same image as this image is transmitted from the transmission unit 27 to the projector 3, the character drawn by the demarcation mark 407 is displayed by the projector 3 at the lower left of the image projection area 403 of the screen 4. An entry area 406 and rotation control marks 408A to 408D are projected and displayed.

  First, when one stroke is entered on the screen 4 by the user who is the writer, the electronic pen 1 transmits each entry information of the entered stroke to the computer device 2 (step S101).

  Specifically, when the electronic pen 1 detects pen-down based on the writing pressure detected by the user with the pressure sensor 107, the LED 105 and the CMOS camera 106 are turned on, and the pressure sensor 107 detects pen-up. Until this is done, the dot pattern on the screen 4 is photographed at predetermined time intervals, entry information including X and Y coordinate data is generated for each photographed image, and sequentially transmitted to the computer apparatus 2.

  When the computer apparatus 2 starts receiving the entry information (stroke information) transmitted from the electronic pen 1, the processing unit 24 sequentially stores the entry information in association with the pen ID in the storage unit 25 (step S201).

  Next, the coordinate conversion unit 242 sequentially converts the received coordinate data of each entry information into coordinates for display in the display area 201 of the display unit 26 based on the coordinate conversion function stored in the storage unit 25. Then, the calibration coordinates after the coordinate conversion are sequentially stored in the storage means 25 in association with the pen ID (step S202).

  Next, the character entry area control unit 243 corresponds to the coordinates indicating the start position of the stroke among the coordinates (calibration coordinates) transformed by the coordinate transformation unit 242, that is, the entry information immediately after the entry information including the pen-down information. It is determined whether the calibration coordinates to be performed (hereinafter referred to as “stroke start position coordinates”) are in any one of the coordinate areas of the rotation control marks 208A to 208D (that is, whether or not they are designated as reference marks). (Step S203). In this case, the rotation control marks 408A to 408D on the screen 4 correspond to the rotation control marks 208A to 208D on the display screen 201 of the display means 26. Therefore, the display screen 201 is rotated by coordinate conversion by the coordinate conversion unit 242 from the coordinate data of the entry information transmitted by the user specifying any of the rotation control marks 408A to 408D on the screen 4 with the electronic pen 1. It can be seen that among the control marks 208A to 208D, the corresponding rotation control mark 208 is designated as the reference mark.

  In the process of step S203, when the character entry area control unit 243 determines that any rotation control mark 208 is instructed by the user (step S203: Yes), the character entry area 206 of step S204 Shift to rotation processing. If the character entry area control unit 243 determines that none of the rotation control marks 208 are instructed by the user (step S203: No), the process proceeds to step S206.

  In the rotation process of the character entry area 206, the character entry area control unit 243 sets another rotation control mark 208 previously determined corresponding to the designated rotation control mark 208 as a center point mark, and sequentially receives it. The character entry area 206 is rotated until it is detected that the entry of one stroke is completed by receiving the entry information including the pen-up information PU based on the calibration coordinates stored in the step S204. During this time, since the same image as the display screen 201 of the display unit 206 is projected on the screen 4 by the projector 3 in synchronism, the character entry area 406 on the screen 4 is also synchronized with the rotation of the character entry area 206. The display is rotated while following the stroke of the electronic pen 1. The rotation of the character entry area 206 is performed by calculating the rotation angle for each entry information based on the respective coordinate positions in the entry information of the stroke, the coordinates of the center point mark, and the coordinates at the start position of the reference mark. Is called.

  When the stroke ends and entry information including pen-up information PU is received by the receiving means 22, the rotation of the character entry area 406 is ended. Next, the character entry area control unit 243 determines the coordinates of the reference mark when the rotation is completed (for example, the coordinates of the center point of the reference mark) and the coordinates of the center point mark and the start position of the reference mark (for example, the stroke start position). The final rotation angle θ of the character entry area 406 is calculated and stored based on the coordinates) (step S205), and this operation is terminated. The stroke for instructing the rotation of the character entry area 206 may be configured not to be displayed in the display area 201 or to be deleted after the rotation angle θ is determined.

  On the other hand, when the character entry area control unit 243 determines that none of the rotation control marks 208 is instructed by the user (step S203: No), each calibration coordinate is stored in the storage unit 25 and the display control is performed. The unit 245 causes the display unit 26 to display a predetermined image based on the calibration coordinates (step S206). During this time, the same image as the display screen 201 of the display means 206 is projected on the screen 4 by the projector 3 synchronously, so that the stroke is followed on the image projection area 403 of the screen 4 while following the stroke of the electronic pen 1. Is projected and displayed.

[Character recognition processing]
Next, the operation | movement of the character recognition process in the information processing system 10 is demonstrated using FIG. FIG. 9 is a flowchart showing the operation of the character recognition process.

  First, when the computer device 2 recognizes an instruction to start character recognition processing based on a predetermined operation, such as a recognition start key (not shown) provided in the computer device 2 is recognized (step S301), the character recognition processing unit 244 performs The character recognition target stroke (stroke entered with the electronic pen 1 in the character entry area 406 (206)) is rotated in reverse by the rotation angle (θ) calculated in step S205 (− Each stroke is normalized by applying a rotation matrix of θ (step S302). At this time, the character entry area 206 may be returned to the initial value, that is, the position of the initial coordinates stored in the storage means 25, or the position as it is may be held.

  Then, the character recognition processing unit 244 collates the pattern information recorded in the storage unit 25, and determines one or more from the pattern (the shape of each stroke) by the X and Y coordinate groups in the normalized character entry area 206. A recognition process for recognizing a plurality of characters or symbols is performed (step S303). Thereafter, characters, symbols, and the like that have been character-recognized are deleted from the character entry area 206, and the text data of the characters and symbols specified after the character recognition is displayed at a location that is determined as a character input position (step S304). . Then, this process is terminated.

[Effects of First Embodiment]
As described above, the information processing system 10 according to the present embodiment allows the user to draw the character entry area 406 based on the center point mark by drawing the stroke by penning the electronic pen 1 onto the rotation control mark 408 on the screen 4. Since the character entry area 406 can be rotated, the character entry area 406 can be directly rotated without performing other operations such as setting a center point when the character entry area 406 is rotated. Since the information processing system 10 rotates the character entry area 406 while projecting and displaying the character entry area 406, the character entry for eliminating the difficulty in writing the handwritten characters or symbols. The entry in area 406 can be reliably rotated to the position desired by the user. Therefore, the information processing system 10 can simplify the user's operation, eliminate the difficulty of writing the characters to be entered, and reliably reflect the request of the writer with respect to the rotation angle of the character entry area 406. it can.

  In the information processing system 10 according to the present embodiment, the rotation control mark 408 is displayed so as to be visible. Therefore, the rotation image of the character entry area 406 can be easily inspired by the writer, and the character entry area 406 Since the center point mark is arranged in addition to the center of the character entry area, the character entry area 406 can be rotated according to various patterns, and the character entry area 406 can be rotated according to each user's request.

  Further, the information processing system 10 according to the present embodiment can rotate the character entry area 406 without performing other operations such as setting the center point when rotating the character entry area 406. The operation can be simplified, and if the rotation control mark 408 is changed when the character entry area 406 is rotated, the rotation of the character entry area 406 can be executed in different patterns. Therefore, the information processing system 10 can reliably rotate the character entry area 406 according to the user's request.

  In addition, the information processing system 10 according to the present embodiment converts the movement path (stroke) of the electronic pen 1 into a movement path corresponding to the character entry area 406 before rotation based on the rotation angle of the character entry area 406. Therefore, it is possible to execute a recognition process more quickly and improve the recognition accuracy than determining whether or not the information is rotated from the entered entry information itself.

  The information processing system 10 according to the present embodiment can be configured to identify the recognized character or symbol based on the confirmation instruction of the user who is the writer, and is linked to an external application such as a word processor. It can also be used for entry.

[Modification]
In the above embodiment, the character entry area 206 is displayed at the lower left of the screen of the display means 26 of the computer apparatus 2, but is not limited to this position, and is arranged at the upper right of the screen, the lower right of the screen, or the upper left of the screen. Alternatively, the position (coordinates) where the character entry area 406 is disposed can be set using the electronic pen 1 or the input unit 21 of the computer device 2. You may do it. In this case, the coordinates after the setting are stored in the storage means 25.

  Further, the rotation control mark 208 is disposed at each corner of the character entry area 206 so as to be visible, but the rotation control mark 208 may be set so as not to be visible. However, in this case, for example, when the rotation control mark 208 is set at the same location as in the present embodiment and the vicinity is designated by the electronic pen 1, the character entry area 206 is rotated as in the present embodiment. Will come to let you.

  In the above embodiment, the rotation control mark 208 adjacent in the horizontal direction with respect to the character entry area 206 is set as the center point mark. For example, the upper right rotation control mark 208C is designated as the reference mark. In this case, the rotation control mark 208 diagonally to the reference mark may be set as the center point mark, such as setting the lower left rotation control mark 208B as the center point mark. In addition, as shown in FIG. 6B, a plurality of rotation control marks 208 (408) are set at each corner in the rectangular character entry area 206 (406) described above, but the present invention is not limited to this. The entry area 206 is not limited to a rectangle. Furthermore, not only such a reference mark and center point mark but also any combination may be used.

  In addition, the dot pattern (coded pattern) of the above embodiment is not limited to the Anoto method.

Second Embodiment
Next, a second embodiment of the information processing system according to the present invention will be described with reference to FIG. FIG. 10 is a system configuration diagram showing the configuration of the information processing system 100 in the second embodiment.

  The information processing system 100 according to the second embodiment replaces the point that the projector 3 is used to display an image on the screen 4 and strokes are entered using the screen 4 in the first embodiment. This is characterized in that strokes are entered using a transparent or translucent light-transmitting sheet disposed on the surface. In addition, in this embodiment, about the member same as 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  As shown in FIG. 10, the information processing system 100 according to the second embodiment includes a light transmissive sheet 9 on which a dot pattern (coded pattern) that can be read by the electronic pen 1 is printed. The light transmissive sheet 9 is pasted on the front surface of the display screen 201 of the computer apparatus 2, and an image displayed on the display screen 201 is visibly displayed from the front surface of the light transmissive sheet 9. This dot pattern is printed on the light transmissive sheet 9 with ink having a characteristic of selectively reflecting infrared rays.

  In the electronic pen 1, the processor 108 is determined by providing a threshold value from the image data captured by the CMOS camera 106 so as to recognize a partial region with strong infrared reflection as a dot. The threshold value is set so as to be able to distinguish between the case where only the infrared rays transmitted through the light-transmitting sheet 9 from the display and the case where the infrared rays irradiated from the LEDs 105 of the electronic pen 1 are reflected by the dots are included. Is done.

  Further, in order to make it easy to recognize dots from the image data captured by the CMOS camera 106 of the electronic pen 1, an infrared transmission filter is provided on the opening of the electronic pen 1 so that only the infrared light is irradiated to the CMOS camera 106. You may provide near 102.

  Furthermore, the dot pattern of the present embodiment is not limited to the Anoto method.

  The information processing system of the present invention can be used for pen input operations in external applications such as school classes, business meetings, lectures, presentations, and word processors.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 3 ... Projector 4 ... Screen 9 ... Light-transmitting sheet 21 ... Input means 22 ... Reception means 24 ... Processing means 25 ... Storage means 26 ... Display means 27 ... Transmission means 201 ... Display screen 206 ... Character entry area 207 ... Delimitation mark 208 ... Rotation control mark 241 ... Calibration processor 242 ... Coordinate converter 243 ... Character entry area controller 244 ... Character recognition processor 245 ... Display controller 401 ... Magnet board (white board)
402 ... Paper 403 ... Coordinate input area (image projection area)
406 ... Character entry area 407 ... Delimitation mark 408 ... Rotation control mark 10, 100 ... Information processing system

Claims (8)

Reading means for reading the coded pattern along the movement path when moving on the screen on which the coded pattern indicating the position coordinates is formed;
Calculating means for calculating the coordinates of the movement path based on the data of the coded pattern read by the reading means;
A projection output means for outputting to the projection means for projecting the shape of the movement path as an image on the screen based on the coordinates of the calculated movement path;
Rotation control means for rotating the character entry area using a rotation control mark as a reference when the character entry area is rotated while displaying a demarcation mark for defining a character entry area for entering a character on the screen. And
When the reading unit moves on the screen from the position of the rotation control mark, the rotation control unit sets a predetermined point as a rotation center point, and the set center point and the movement of the reading unit An information processing system, wherein the character entry area is rotated based on a route. Reading means for reading the coded pattern along the movement path when moved on the light-transmitting sheet on which the coded pattern indicating the position coordinates is formed;
Calculating means for calculating the coordinates of the movement path based on the data of the coded pattern read by the reading means;
Display output means for outputting the shape of the movement path as an image based on the calculated coordinates of the movement path from the back surface of the light transmissive sheet to a display means for visual display from the front surface of the light transmissive sheet; ,
Rotation control for rotating the character entry area using a rotation control mark as a reference when the character entry area is rotated while displaying a demarcation mark for defining a character entry area for entering characters on the display means. Means and
When the reading unit moves on the light-transmitting sheet from the position of the rotation control mark, the rotation control unit sets a predetermined point as a rotation center point, and the set center point and the reading An information processing system, wherein the character entry area is rotated based on a movement path of the means. The information processing system according to claim 1 or 2,
There are a plurality of the rotation control marks,
The rotation control means sets, when the character entry area rotates, a rotation control mark that is different from the rotation control mark having the coordinates of the start position of the movement path as the rotation center point. Processing system. The information processing system according to any one of claims 1 to 3,
Character recognition processing means for executing character recognition based on the coordinates of the movement path included in the character entry area;
When the character recognition processing means rotates the character entry area, the movement path corresponding to the character entry area before rotating the movement path of the reading means based on the rotation angle of the character entry area. An information processing system that performs the character recognition after conversion. The information processing system according to claim 1,
The projection output means outputs an image signal to be displayed on the display screen of the display means,
A coordinate conversion unit that converts the coordinates calculated by the calculation means into coordinates on a display screen of the display means;
The rotation control means recognizes that the coordinates of the rotation control mark are instructed based on the coordinates converted by the coordinate conversion unit. The information processing system according to claim 2,
A coordinate conversion unit that converts the coordinates calculated by the calculation means into coordinates on a display screen of the display means;
The rotation control means recognizes that the coordinates of the rotation control mark are instructed based on the coordinates converted by the coordinate conversion unit. When the electronic pen that reads the coding pattern indicating the position coordinates and calculates the coordinates of the movement path moves on the screen on which the coding pattern is formed, the shape indicating the movement path of the electronic pen is displayed on the screen. A display processing program executed by a computer that performs information processing for
The computer,
A projection output means for outputting to the projection means for projecting the shape of the movement path as an image on the screen based on the coordinates of the movement path calculated by the electronic pen;
Rotation control means for rotating the character entry area using a rotation control mark as a reference when the character entry area is rotated while displaying a demarcation mark for defining a character entry area for entering a character on the screen. ,
And function as
When the electronic pen moves on the screen from the position of the rotation control mark, a predetermined point is set as a rotation center point, and the electronic pen is moved based on the set center point and the movement path of the electronic pen. A display processing program for causing the computer to function as the rotation control means so as to rotate a character entry area. When the electronic pen that reads the coding pattern indicating the position coordinates and calculates the coordinates of the movement path moves on the light-transmitting sheet on which the coding pattern is formed, the shape indicating the movement path of the electronic pen is A display processing program executed by a computer that performs information processing for displaying on a light transmissive sheet,
The computer,
Based on the coordinates of the movement path calculated by the electronic pen, a display that outputs the shape of the movement path as an image from the back surface of the light transmissive sheet to a display unit that visually displays from the front surface of the light transmissive sheet. Output means,
Rotation control for rotating the character entry area using a rotation control mark as a reference when the character entry area is rotated while displaying a demarcation mark for defining a character entry area for entering characters on the display means. means,
And function as
When the electronic pen moves on the light transmissive sheet from the position of the rotation control mark, a predetermined point is set as the rotation center point, and the set center point and the movement path of the electronic pen are set. A display processing program for causing the computer to function as the rotation control unit so as to rotate the character entry area based on the computer program.

Images