JP2005310149A - Code information, code information generation method, code information generator, code information display medium, code information reproducing device and code information reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide new code information capable of efficiently processing multimedia information. <P>SOLUTION: From the multimedia information obtained by performing A/D conversion to at least one of digital code data including audio information, image information and text data and the like, the code information is generated to be visibly displayed by two-dimensionally arranging binary information in a square. The code information has a marker 310 provided on at least one of corner parts of the square of the code information to image and reproduce the code information and information for correcting an error when reproducing the code information. The size of the marker 310 is set to be at least seven times as large as each information of minimum unit for forming the code information which is binary information. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention generates so-called multimedia information including audio information such as voice and music, video information obtained from a camera, video, etc., and digital code data (text data) obtained from a personal computer, a word processor, etc. Reproduction etc.

  2. Description of the Related Art Conventionally, various media such as a magnetic tape and an optical disk are known as recording media for voice and music.

  However, even if these media are duplicated in large quantities, the unit price is somewhat expensive, and a large space is required for storage.

  Furthermore, if it is necessary to deliver the sound recording medium to another person at a remote location, it may take time and effort even if it is mailed or taken directly. There was also.

Therefore, it is considered to record voice information on paper in the form of image information that can be transmitted by facsimile and can be copied in large quantities at a low cost. For example, as disclosed in Japanese Patent Laid-Open No. 2004-228561, there has been proposed a technique in which some sound is converted into optical information by converting some sound into an optical code and can be sent by facsimile.
JP 60-244145 A

  However, in the apparatus disclosed in Patent Document 1, the facsimile apparatus has a sensor for reading the voice recorded so as to be optically readable, and the voice is reproduced according to the sensor output. Yes. Therefore, optically readable audio information transmitted by facsimile can only be heard at the location where the facsimile machine is installed, and the usage of transferring the facsimile output paper to another location to reproduce the sound is assumed. Was not.

  Therefore, if the recording capacity of voice information is increased, it may affect other facsimile transmission / reception, and if the recorded contents of the voice itself are difficult, the first one is It is possible that you will forget. Furthermore, the recording capacity is limited by the recording density and the compression method, and only a few seconds of audio can be transmitted. Therefore, in order to send a large amount of audio information, it has been necessary to rely on magnetic tapes and optical disks.

  Further, even for short-time voice information, since the reproduction apparatus itself is built in the facsimile apparatus, it is inconvenient for repeated reproduction of the voice information.

  In addition to audio information, information that can be processed efficiently is also available for so-called multimedia information including video information obtained from cameras, videos, etc., and digital code data obtained from personal computers, word processors, etc. There is still room for improvement in terms of generation.

  The present invention has been made in view of the above points. Novel code information capable of efficiently processing multimedia information including audio information, video information, digital code data, and the like, and such code. An object of the present invention is to provide an information generation method and a generation apparatus.

  It is another object of the present invention to provide a code information display medium, a code information reproducing apparatus, and a code information reproducing method effective for improving the efficiency of reading such code information.

The code information according to the present invention is:
In order to display binary information in a two-dimensionally rectangular manner from multimedia information obtained by A / D conversion of at least one of digital code data information such as audio information, video information, and text data. Generated code information,
A marker provided in at least one corner of a square corner of the code information for imaging and reproducing the code information, and information for performing error correction when reproducing the code information,
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
It is characterized by that.

The code information generation method according to the present invention includes:
In order to display binary information in a two-dimensionally rectangular manner from multimedia information obtained by A / D conversion of at least one of digital code data information such as audio information, video information, and text data. Code information generation method,
In order to capture and reproduce the code information, a marker is provided in at least one corner of the square of the code information, and includes information for error correction when reproducing the code information,
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
It is characterized by that.

In addition, the code information generation device according to the present invention includes:
Information acquisition means for acquiring information of digital code data such as audio information, video information, and text data;
Digital multimedia information generating means for generating digital multimedia information obtained by A / D converting at least one of audio information, video information, and digital code data information acquired by the information acquiring means;
Code information generating means for generating code information visually displayed in a manner in which binary information is two-dimensionally arranged in a two-dimensional manner from the digital multimedia information generated by the digital multimedia information generating means;
Comprising
The code information includes markers provided at at least one corner of a square corner of the code information for imaging and reproducing the code information, and information for performing error correction when reproducing the code information. Have
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
It is characterized by that.

Further, the code information display medium according to the present invention includes:
Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker, the minimum unit than the the size dimensions of the individual information is set to at least 7 times the dimension, the code information generating apparatus that forms the code information is binary information,
A code information conversion device for converting code information generated by the code information generation device into visible information;
The code information is visualized by a system including:

Moreover, the code information reproducing apparatus according to the present invention includes:
Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker is set to a size that is at least 7 times larger than the size of each piece of minimum information forming the code information that is binary information, An imaging means for imaging a code information display medium in which the code information is visualized by a system having a code information conversion device that converts code information generated by the information generation device into visible information;
Means for processing and reproducing the code information imaged by the imaging means based on the marker, and acquiring the multimedia information;
It is characterized by comprising.

The code information reproducing method according to the present invention includes:
Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker is set to a size that is at least 7 times larger than the size of each piece of minimum information forming the code information that is binary information, An imaging step of imaging a code information display medium in which the code information is visualized by a system having a code information conversion device that converts code information generated by the information generation device into visible information;
A reproduction step of processing and reproducing the code information imaged in the imaging step based on the marker to obtain the multimedia information;
It is characterized by having.

  In the code information, code information generation method, code information generation device, code information display medium, code information reproduction device, and code information reproduction method according to the present invention, the code visually displayed in a manner in which binary information is squarely arranged in a two-dimensional manner The code information is generated and used, and when the code information is reproduced, the marker is provided in at least one corner of the square corner of the code information in order to capture and reproduce the code information. The size of the marker is set to at least 7 times the size of each piece of information of the smallest unit forming the code information which is binary information. Yes. By setting the odd number to 7 times, there is no reading error in distinguishing from the individual information of the smallest unit forming the code information, and the reading pixel can be positioned when the center position of the marker is imaged and read. Thus, it is possible to improve the efficiency of the reading operation processing, and by recognizing the presence of a marker that is clearly different from the individual information of the smallest unit, it is possible to recognize that the information is the code information according to the present invention and The information area of the multimedia information itself does not become too narrow due to the marker area ratio becoming too large, and it is possible to improve the reading efficiency and optimize the area arrangement as a whole of the code information. Can be processed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, embodiments of multimedia information related to audio information such as voice and music will be described.

  FIG. 1 is a block diagram of an audio information recording apparatus for recording audio information such as voice and music on paper as optically readable digital signals in the first embodiment of the present invention.

  An audio signal input from an audio input device 12 such as a microphone or an audio output device is amplified by a preamplifier 14 (AGC is applied in the case of microphone audio) and then converted to digital by an A / D converter 16. The digitized audio signal is subjected to data compression by the compression circuit 18 and then an error correction code is added by an error correction code addition circuit 20.

  Thereafter, the memory circuit 22 performs interleaving. This interleaving distributes the data array in a two-dimensional manner according to a predetermined rule. Thus, when the data is returned to the original array by the reproducing apparatus, the paper burst-like stains and scratches, that is, Errors themselves are distributed, making it easier to correct errors and interpolate data. This interleaving is performed by appropriately reading out and outputting the data stored in the memory 22A by the interleaving circuit 22B.

  The output data of the memory circuit 22 is then supplied by the data adding circuit 24 for each block according to a predetermined recording format as will be described in detail later. , And the error determination code, the modulation circuit 26 performs modulation for recording. Then, after the data such as image data recorded together with the output data of the audio information is superimposed by the synthesis circuit 27, the printer system or the printing plate making system 28 performs a printing process.

  Thereby, for example, the data is recorded on the paper 30 as a recording medium in a format as shown in FIG. That is, the sound data converted into a digital signal is printed as the recording data 36 together with the image 32 and the characters 34. Here, the recording data 36 includes a plurality of blocks 38, and each block 38 includes a marker 38A, an error correction code 38B, audio data 38C, x address data 38D, y address data 38E, and an error determination code. 38F.

  The marker 38A also functions as a synchronization signal, and uses a pattern that does not normally come out by recording modulation, such as DAT. The error correction code 38B is used for error correction of the audio data 38C. The audio data 38C corresponds to an audio signal input from the audio input device 12 such as the microphone or the audio output device. The x and y address data 38D and 38E are data representing the position of the block 38, and the error determination code 38F is used for error determination of these x and y addresses.

  The recording data 36 in such a format is a printer system in which “1” and “0” data are set such that “1” has black dots and “0” has no black dots, for example, as in the case of a barcode. Alternatively, printing is recorded by the printing plate making system 28. Hereinafter, such recording data is referred to as a dot code.

  FIG. 2B shows a scene in which the sound data recorded on the paper 30 as shown in FIG. 2A is read by the pen-type information reproducing device 40. By tracing over the dot code 36 with a pen-type information reproducing apparatus 40 as shown in the figure, the dot code 36 can be detected, converted into sound, and heard by an audio output device 42 such as an earphone.

  FIG. 3 is a block configuration diagram of the information reproducing apparatus 40 in the first embodiment of the present invention. In the information reproducing apparatus of the present embodiment, parts other than the audio output device 42 such as headphones and earphones are housed in a portable pen-type housing (not shown). Of course, it is good also as what incorporates a speaker in a housing | casing.

  The detection unit 44 basically has the same function as an imaging unit such as a television camera. That is, the light source 44A illuminates the dot code 36 on the paper surface, which is the subject, and the reflected light is imaged by the imaging unit 44D such as a semiconductor area sensor via the imaging system 44B such as a lens and the spatial filter 44C. Is amplified by the preamplifier 44E and output.

  Here, the pixel pitch of the area sensor is set to be equal to or less than the dot pitch of the dot code 36 on the imaging surface by the sampling theorem. Furthermore, the spatial filter 44C installed on the imaging surface is also inserted to prevent a moire phenomenon (aliasing) on the imaging surface based on this theorem. In addition, the number of pixels of the area sensor is determined in the vertical direction of a predetermined dot code 36 that is defined as readable at a time in consideration of camera shake when the detection unit 44 is manually scanned as shown in FIG. It is set to be larger than the width of. That is, (A) and (B) in FIG. 4 show the moving state of the imaging area for each period when the detection unit 44 is manually scanned in the direction of the arrow. The manual scanning state when the vertical width of the code 36 is within the imaging area (taking camera shake into consideration) is shown, and (B) shows that the amount of the dot code 36 is large and the vertical width is one time. The case where it does not fit in the imaging area is shown. In the latter case, a manual scanning mark 36A is printed at a position where manual scanning of the dot code 36 is started. Therefore, a large amount of dot codes 36 can be detected by performing manual scanning a plurality of times along the manual scanning mark 36A.

  The image signal detected by the detection unit 44 as described above is then input to the scan conversion and lens distortion correction unit 46. In the scan conversion and lens distortion correction unit 46, the input image signal is first converted into a digital signal by the A / D converter 46A and stored in the frame memory 46B. The frame memory 46B has an 8-bit gradation.

  The marker detection circuit 46C scans the image information stored in the frame memory 46B as shown in FIG. 4C to detect the marker 38A. The θ detection circuit 46D detects which address value on the imaging surface each marker 38A detected by the marker detection circuit 46C corresponds to, and the inclination of the imaging surface with respect to the dot code arrangement direction from the address value. Calculate θ. In the scan only in the direction as shown in FIG. 4C, the marker detection circuit 46C rotates about 90 ° as shown in FIG. When the code 36 is imaged, the inclination θ may not be obtained correctly. That is, when scanning in the short direction of the block 38, θ may not be obtained correctly. Therefore, the marker detection circuit 46C also scans in the orthogonal directions as shown in FIG. The correct one of the results obtained by the two-way scan is selected.

  On the other hand, the lens aberration information memory 46E stores aberration information measured in advance for the lens used in the imaging system 44B of the detection unit 44 for correcting the distortion of the lens. When the address control circuit 46F next reads out the data stored in the frame memory 46B, the value of the inclination θ calculated by the θ detection circuit 46D and the lens aberration stored in the lens aberration information memory 46E. A read address according to the information is given to the frame memory 46B, and the data is subjected to scan conversion in the array direction while data interpolation is performed by the interpolation circuit 46G.

  FIG. 5A shows the principle of data interpolation performed by the interpolation circuit 46G. Basically, interpolation data is created by a convolution filter and LPF using pixels around the position Q where data is interpolated. The pixel pitch and the scanning line pitch after the scan conversion are set below the dot pitch of the dot code based on the sampling theorem as in the case of imaging.

  In the case of simple data interpolation using four pixels around the position Q to be interpolated, Q = (D6 × F6) + (D7 × F7) + (D10 × F10) + (D11 × F11), In the case of relatively accurate data interpolation using 16 surrounding pixels, interpolation data is created by the calculation of Q = (D1 * F1) + (D2 * F2) + ... + (D16 * F16). . Here, Dn is a data amplitude value of the pixel n, and Fn is a coefficient of an interpolation convolution filter (LPF) determined according to the distance to the pixel n.

  The dot code 36 image read from the frame memory 46B after undergoing scan conversion as described above is then binarized by the binarization circuit 48 constituted by the latch 48A and the comparator 48B. The threshold for binarization is determined by the threshold determination circuit 50 using the value of a histogram for each screen or each block in the screen. That is, the threshold is determined according to the stain on the dot code 36, the distortion of the paper 30, the accuracy of the built-in clock, and the like. As this threshold value judgment circuit 50, it is preferable to use, for example, a circuit using a neural network disclosed in Japanese Patent Application No. 4-131051 by the present applicant.

  In parallel with this, the image of the dot code 36 read from the frame memory 46B is input to the PLL circuit 52, and a clock pulse CK synchronized with the reproduction data is generated. This clock pulse CK is used as a reference clock for binarization and demodulation after scan conversion, and an error determination circuit 56A, x, y address detection circuit 56B and memory unit 56C in the data string adjustment unit 56 described later. .

  The binarized data is demodulated by the demodulation circuit 54 and input to the error determination circuit 56A and the x, y address detection circuit 56B in the data string adjustment unit 56. The error determination circuit 56A uses the error determination code 38F in the block 38 to determine whether or not the x and y address data 38D and 38E have an error. If there is no error, the demodulated data from the demodulating circuit is recorded in the audio data string adjusting memory unit 56C in accordance with the address detected by the x, y address detecting circuit 56B. If there is an error, the audio data 38C of the block 38 is not recorded in the audio data string adjusting memory unit 56C.

  The purpose of the data string adjustment unit 56 is that the scan conversion and lens distortion correction unit 46 performs scanning conversion accuracy (depending on the accuracy of the reference clock and the S / N of the image sensor), paper distortion, and the like. The purpose is to correct a slight deviation occurring in the array direction and the scan direction after scan conversion. This will be described with reference to FIG. In the figure, dot codes D1, D2, and D3 indicate data for each block. The pitch of the scanning lines 1, 2, 3,... After scanning conversion may be set to be equal to or less than the dot pitch of the data based on the sampling theorem as described above, but in FIG. As a matter of fact, the dot pitch is set to 1/2. Therefore, as apparent from the drawing, the dot code D1 is detected without error on the scanning line 3 after the scan conversion. D2 is detected without error on the scan line 2 after scan conversion, and D3 is similarly detected without error on the scan line 1 after scan conversion.

  Then, according to the x and y addresses 38D and 38E in the respective blocks 38, they are stored in the data string adjusting memory unit 56C.

  Next, as shown in FIGS. 4A and 4B, the detection unit 44 is manually scanned, so that the voice dot code 36 on the paper 30 is not leaked into the memory unit 56C for data string adjustment. Can be stored.

  The voice dot code whose data string is adjusted by the data string adjusting unit 56 is then used for data string adjustment in accordance with a reference clock CK ′ generated by a reference clock generating circuit 53 different from the PLL circuit 52. Read from the memory portion 56C. At this time, de-interleaving is performed by the de-interleaving circuit 58 and converted into a formal data string. Next, error correction using the error correction code 38 </ b> B in the block 38 is performed by the error correction circuit 60. Then, the data compressed by the decoding circuit 62 is decoded, and further, the data interpolation circuit 64 performs interpolation of audio data that cannot be error-corrected. Thereafter, the signal is converted into an analog audio signal by the D / A conversion circuit 66, amplified by the amplifier 68, and converted into sound by the sound output device (earphone, headphone, speaker, etc.) 42.

  As described above, audio information such as voice and music can be recorded on paper, and the playback device is a small portable device so that it can be printed out, faxed, or printed. You will be able to listen to what is printed in book format by plate making anywhere and any number of times.

  The data string adjusting memory 56C in the data string adjusting unit 56 is not limited to a semiconductor memory, and other storage media such as a floppy (registered trademark) disk, an optical disk, and a magneto-optical disk may be used. Is possible.

  There are various possible application examples of the audio information recorded as described above. For example, for general use, language teaching materials, music scores, various texts such as correspondence courses, product specifications, manuals for repair, foreign language dictionaries, encyclopedias, books such as picture books, product catalogs, travel guides, direct mail and guidance Letters, newspapers, magazines, flyers, albums, telegraphs, postcards, etc. For business use, FAX (voice and fax) business instructions, minutes, electronic blackboard, OHP, ID card (voice print), business cards, telephone memos, sticky notes, and high-quality paper supply products (Consumables), etc. can be considered. Here, as shown in FIG. 5 (B), the consumable is provided with a double-sided tape or a glue that can be easily peeled off like a sticky note on the back surface of the rolled paper 30A. The dot code 36 is recorded on the sheet, and the dot code 36 is cut off as much as necessary so that it can be attached to various items (hereinafter referred to as a reel seal). Further, as shown in FIG. 6C, the width of the paper 30A is widened so that a plurality of dot codes 36 can be recorded, and a manual scanning mark 36B as a manual scanning guideline of the detection unit 44 is provided. May be printed vertically and horizontally. This mark 36B can also be used as a guide for the recording position of the dot code 36 at the same time. That is, if a sensor is provided in the printer system 28, and the mark 36B is read by the sensor to cue the printout, the dot code 36 is always printed in the area surrounded by the mark 36B. Therefore, the recorded audio information can be reliably reproduced by performing manual scanning along the mark 36B. Of course, when the dot code 36 is printed, the mark 36B may also be printed.

  Note that the recording time of the audio information is, in the case of a general facsimile of 200 dpi, for example, when data is recorded in an area of 1 inch × 7 inches (2.54 cm × 17.78 cm) along one side of the paper. The total number is 280 kbit. From now on, a marker, an address signal, an error correction code, and an error determination code (however, in this case, the error determination code includes the audio data 38C in addition to the x and y addresses 38D and 38E) (30%) Is subtracted to 196 kbit. Accordingly, the recording time when audio is compressed to 7 kbit / s (bit rate of mobile communication) is 28 seconds. When recording on the entire back side of A4 size double-sided facsimile paper, an area of 7 inches × 10 inches (17.78 cm × 25.4 cm) can be taken, so that audio recording of 4.7 minutes is possible.

  In the case of a 400 dpi G4 facsimile, as a result of calculation similar to the above, it is possible to record 18.8 minutes of audio in an area of 7 inches × 10 inches.

  In the case of high-quality printing of 1500 dpi, when printing is performed in an area of 5 mm × 30 mm, as a result of calculation similar to the above, audio recording of 52.3 seconds is possible. Also, when printing on a 10 mm × 75 mm tape-like area, audio recording of 1 minute is possible when calculated with a high sound quality (compressed, 30 kbit / s) audio signal capable of music.

  FIG. 7 is a diagram showing a configuration of the second exemplary embodiment of the present invention. The second embodiment is an example in which a memory and a randomly accessible xy address type image pickup unit such as CMD are used as the image pickup element. The detection unit 44 of the reproduction apparatus and the scan conversion and lens distortion correction circuit 46 are used. Only the first embodiment is different from the first embodiment. That is, the detection unit and scan conversion unit 70 detects the marker of the imaging data stored in the xy address type imaging unit 70A in the same manner as in the first embodiment, and outputs four pieces of data to be interpolated when reading. Are sequentially read out by the decoder address generator 70B and the x and y decoders 70C and 70D and input to the interpolator 72. The interpolator 72 sequentially reads out the coefficients from the coefficient generation circuit 70E and multiplies them by the multiplier 70F with respect to the input data, and further to an analog cumulative addition circuit composed of an adder 70G, a sample and hold circuit 70H, and a switch 70I. The cumulative addition is performed, the sample and hold circuit 70J performs the sample and hold, and the scan converted dot code is supplied to the binarization circuit 48, the threshold determination circuit 50, and the PLL circuit 52.

  With such a configuration, the same function as in the first embodiment can be achieved, the frame memory 46 can be eliminated, and cost reduction and downsizing can be realized. Furthermore, the xy address type image pickup unit 70A, the address generation unit 70B, the decoders 70C and 70D, and the interpolation unit 72 are integrated on a single substrate to be integrated into an IC, thereby further reducing the size.

  FIG. 8 is a diagram showing the configuration of the third exemplary embodiment of the present invention. In the present embodiment, the dot code 36 is recorded on the paper 30 on which pictures and characters are printed, using a transparent paint (ink) 74 that is easily regularly reflected (totally reflected). Then, polarizing filters 44F and 44G are provided in the detection unit 44 between the light source 44A and the imaging system 44B, and the polarization planes of these polarizing filters 44F and 44G are matched so that the inside (the surface of the paper 30) can be obtained. And the reflected light from the opening of the hole 74A through which the transparent paint 74 is removed according to the code, the polarization direction is dispersed and 1/2 is cut by the polarizing filter 44G. Since the difference in the amount of light is originally large between the reflected light and the totally reflected light, the contrast of the dot code recorded with the transparent paint 74 is emphasized and an image is taken.

  Further, the paper 30 is subjected to a surface treatment such as mirror finishing so that the surface is easily regularly reflected, and the transparent paint 74 is made of a material having a refractive index higher than the refractive index of the surface-treated surface and is about 1 / 4λ ( Considering the change in the optical path length due to the incident angle, if it is a film with a thickness (such that the optical path length in the transparent paint becomes 1/4), the light that has been obliquely applied can be further enhanced by the effect of the reflection amplification coating. Amplified and easily reflected on the surface (regular reflection).

  In this case, for example, the dot code is formed by fine chemical etching or the like, and the hole corresponding to the dot is roughened to reduce the reflectance.

  If the dot code 36 is recorded with the transparent paint 74 as described above, it can be recorded on a character or picture. Therefore, when used together with a character or picture, the recording capacity is increased as compared with the first embodiment. can do.

  Further, instead of the transparent paint, a transparent fluorescent paint may be used, or the color may be multiplexed. When this color is used, a normal color ink can be used, or a color can be obtained by mixing a pigment with a transparent ink.

  Here, as an example, the transparent ink can be an ink composed of a volatile liquid and a binder (for example, phenol resin varnish, linseed oil varnish, alkyd resin), and the pigment can be a pigment.

  Next, a portable voice recorder to which the audio information recording apparatus is applied will be described. 9A and 9B are external views. This portable voice recorder comprises a main body 76 and a voice input section 80 that can be attached to and detached from the main body 76 by means of main body side and voice input section side detachable members (surface fasteners, Velcro (registered trademark), etc.) 78A, 78B. . In addition, a recording start button 82 and a print sheet discharge portion 84 are provided on the surface of the main body 76. The main body 76 and the voice input unit 80 are connected by a cable 86. Of course, a signal may be transmitted from the voice input unit 80 to the main body 76 by radio or infrared rays.

  FIG. 10 is a block diagram of such a portable voice recorder. The sound input from the microphone 88 is amplified by the preamplifier 90, converted to digital by the A / D converter 92, and supplied to the compression processing unit (ADPCM) 94. The data subjected to the compression process is added with an error correction code by an error correction code adding unit 96, the result is supplied to an interleaving unit 98, each data is stored, and then an interleaving process is performed. The interleaved data is further added by the address data adding unit 100 with the block address and address error determination code (CRC, etc.), and the result is input to the modulation circuit 102. The modulation circuit 102 converts 8-bit data such as 8-10 modulation into another 10-bit number. Thereafter, the marker adding unit 104 generates and adds a marker using a data sequence that is not included in the 256 data sequences associated with the modulation circuit 102.

  The data thus added with the marker is sent to the simple printer system 106, printed on the reel seal 108 as shown in FIGS. 11A and 11B, and discharged from the print sheet discharge portion 84. In this case, the simple printer system 106 prints the date / time counted by the timer 110 on the reel seal 108.

  Note that the above-described units are controlled by the control unit 112 in accordance with the operation of the recording start button 82. In addition, there is no particular limitation on how far from the microphone 88 to the voice input unit 80 is configured, and for example, the microphone 88, the preamplifier 90, and the A / D are included in the voice input unit 80 here. It is assumed that a converter 92 is incorporated.

  FIG. 12 is an operation flowchart of the portable voice recorder having such a configuration. That is, when the recording start button 82 provided on the main body 76 is pressed (step S12), while the button is pressed (step S14), processing from voice input to dot code 114 printing processing on the reel seal 108 is performed. Performed (step S16). When the pressing of the recording start button 82 is stopped, it is determined whether or not the recording start button 82 has been pressed again within a predetermined time (step S18). Return to and repeat the above process. However, if the recording start button 82 is not pressed within a predetermined time, the current date and time are referred from the timer 110 (step S20), and the reel seal 108 is referred to while feeding the blank portion 116. The date and time are printed (step S22).

  In such a portable voice recorder, when the main body 76 and the voice input unit 80 are connected as shown in FIG. 9A, the user holds the main body 76 with his hand and brings the voice input unit 80 close to his / her mouth. The sound is recorded on the reel seal 108 as the dot code 114. Further, as shown in FIG. 9B, the main body 76 and the voice input unit 80 are separated, and the voice input unit 80 is attached to the receiver side of the telephone handset by using the detachable member 78B. Instead of writing down the contents, the other party's message can be directly recorded on the reel seal 108 as the dot code 114. In addition, in this case, as shown in FIGS. 11A and 11B, not only the date and time are printed on the reel seal 108, but also a blank portion 116 is formed. You can write comments such as who the person is for.

  In addition to the configuration in which the voice input unit 80 is attached to and detached from the main body by the attaching and detaching member as described above, various modes can be considered. For example, as shown in FIGS. 11C and 11D, an earphone type can be used. In the case of such an earphone-type voice input unit 80, as shown in FIG. 4D, the voice input unit 80 is pulled out from the voice input unit storage unit 118 of the main body 76 and inserted into the user's ear, While listening to the voice of the other party that can be heard from the handset side of the telephone handset, it can be recorded in the form of a dot code.

  In the above description, the dot code printing is performed only while the recording start button 82 is continuously pressed. However, a separate recording end button is provided on the main body 76, and the recording ends after the recording start button 82 is pressed once. Until the button is pressed, dot code printing may be performed.

  The recording device may be a recording / reproducing device by incorporating a reproducing function as shown in FIG. At that time, the earphone type voice input unit 80 may also have an earphone function.

  In the above embodiment, audio information such as voice and music has been described as an example of recorded information. However, video information obtained from a camera, video, etc. is not limited to audio information. An embodiment that handles so-called multimedia information including digital code data such as text data obtained from a personal computer (hereinafter referred to as a personal computer), a word processor (hereinafter referred to as a word processor), and the like will be described.

  FIG. 13 is a block diagram of a multimedia information recording apparatus for recording such multimedia information.

  In the multimedia information, audio information is input from a microphone or audio output device 120, amplified by a preamplifier 122, converted to digital by an A / D converter 124, and compressed as in the case of FIG. Supplied to the unit 126.

  In the compression processing unit 126, the input digital audio signal is selectively supplied to a voice compression circuit 130 such as an ADPCM circuit and a voice synthesis coding circuit 132 by a switch 128. The audio compression circuit 130 performs data compression by performing adaptive differential PCM on input digital audio information. The voice synthesis coding circuit 132 recognizes one voice for the input digital audio information, and then converts it into a code. This is because the ADPCM encodes it in the form of speech information and reduces the amount of data, i.e., the raw data is processed while it is changed to a different composite code. The amount of data is reduced. The switch 128 is switched manually, for example, according to the purpose of the user. Alternatively, for example, high-quality sound such as information from an audio output device is passed through the voice compression circuit 130, and for example, a person's voice or comment from a microphone is passed through the voice synthesis coding circuit 132. If it is determined in advance as described above, it is possible to adopt a configuration in which the input audio information is recognized and recognized automatically at the previous stage of the switch.

  In addition, various types of data that have already been formed as digital code data from a personal computer, word processor, CAD, electronic notebook, communication, and the like are first sent to a data form discrimination circuit 136 via an interface (hereinafter referred to as I / F) 134. Is input. The data form determination circuit 136 basically determines whether or not the subsequent compression processing unit 126 can compress the data. The data has already been subjected to some compression processing, and the subsequent compression processing unit 126. For the information that cannot be obtained in the above, the compression processing unit 126 is bypassed and directly passed to the subsequent stage of the compression processing unit 126. If the input data is uncompressed data, it is sent to the compression processing unit 126. send.

  The data determined to be uncompressed code data by the data form determination unit 136 is input to the compression processing unit 126, and the code data is optimally compressed by the compression circuit 138 such as Huffman, arithmetic code, or dibrempel. Compression processing is performed. The compression circuit 138 also performs a compression process on the output of the speech synthesis coding circuit 132.

  The speech synthesis coding circuit 132 may recognize character information other than speech and convert it to speech synthesis code.

  Also, image information of the camera, video output device 140, etc. is supplied to the compression processing unit 126 after amplification by the preamplifier 142 and A / D conversion by the A / D converter 144.

  In the compression processing unit 126, the image area determination and separation circuit 146 determines whether the input image information is a binary image such as a handwritten character or a graph or a multi-value image such as a natural image. This image area determination and separation circuit 146 uses, for example, a discriminant image area separation method using a neural network as shown in Japanese Patent Application No. 5-163635 by the applicant of the present application, and binary image data and Separate multi-valued image data. The binary image data is compressed by a binary compression processing circuit 148 such as a general MR / MH / MMR as a binary compression by JBIG or the like. For multi-value image data, a still image such as DPCM or JPEG is used. Are compressed by the multi-value compression processing circuit 150 using the above-described compression function.

  The data subjected to the compression processing as described above is appropriately synthesized by the data synthesis processing unit 152.

  Note that it is not always necessary to provide all of the information input and compression processing systems in parallel, and one or a plurality of systems may be appropriately combined depending on the purpose. Therefore, the data composition processing unit 152 is not necessarily required, and those having only one data system are omitted and are directly input to the error correction code adding unit 154 in the next stage. Can do.

  The error correction code adding unit 154 adds an error correction code and inputs it to the data memory unit 156. In the data memory unit 156, each data is stored, and then an interleaving process is performed. This is actually recorded as a dot code, and when it is played back, continuous data is used to reduce errors as much as possible, for example, block errors due to noise, etc. This is a process of distributing the rows to positions that are appropriately separated. In other words, the task of reducing the degree of danger by using a burst error as a bit error unit is performed.

  Further, the address data adding unit 158 adds a block address and an error determination code (CRC) for the address to the interleaved data, and the result is input to the modulation circuit 160. In the modulation circuit 160, for example, 8-10 modulation is performed.

  In the above embodiment, it goes without saying that a code for error correction may be added after interleaving.

  After that, the marker adding unit 162 generates and adds a marker using a data sequence that is not included in the 256 data sequences associated with the modulation circuit 160. By adding the marker after the modulation in this way, there is an effect of eliminating the fact that even the marker is modulated and it is difficult to recognize it as a marker.

  Data thus added with the marker is sent to the synthesis and editing processing unit 164 and recorded on recording paper other than the generated data, for example, synthesized with an image, a title, a character, or the like, or a layout or the like. The data is edited, converted into a printer output format or a data format compatible with printing plate making, and sent to the next printer system or printing plate making system 166. Then, with this printer system or printing plate making system 166, printing is finally performed on a sheet, a tape, a printed matter, and the like.

  Note that the editing process in the composition and editing processing unit 164 is performed by appropriately adjusting the code length in units of words, content delimiters, etc. to match the page information and dot code layout, the dot size of the code to the resolution of the printer, printer, etc. This includes editing work such as changing the breaks, that is, changing the line to the next line.

  The printed matter printed in this way is transmitted by FAX 168, for example. Of course, instead of printing the data generated by the compositing and editing processing unit 164, it may be directly transmitted by FAX.

  Here, the concept of the dot code 170 in the present embodiment will be described with reference to FIG. In the data format of the dot code 170 of the present embodiment, one block 172 includes a marker 174, a block address 176, address error detection / error correction data 178, and a data area 180 in which actual data is stored. Yes. That is, in the embodiment described with reference to FIG. 2A, one block is configured one-dimensionally in the line direction, but in this embodiment, it is expanded two-dimensionally. It is formed in the shape. The blocks 172 are arranged two-dimensionally in the vertical, horizontal, and two-dimensional directions, and are gathered to form a dot code 170.

  Next, the configuration of the multimedia information reproducing apparatus will be described with reference to the block diagram of FIG. This information reproducing apparatus detects a dot code from a sheet 182 as a recording medium on which the dot code 170 is printed, and scans that recognize image data supplied from the detection unit 184 as a dot code and perform normalization. Conversion unit 186, binarization processing unit 188 for converting multi-level data into binary, demodulation unit 190, adjustment unit 192 for adjusting a data string, data error correction unit 194 for correcting read errors and data errors during reproduction, data The data separation unit 196 separates the data according to the respective attributes, the decompression processing unit for the data compression processing according to the respective attributes, the display unit or the reproduction unit, or other input devices.

  In the detection unit 184, the light source 198 illuminates the dot code 170 on the sheet 182, and the reflected light passes through the imaging optical system 200 such as a lens and the spatial filter 202 for removing moire and the like. For example, an image signal such as a CCD or CMD that converts light information into an electrical signal is detected as an image signal, amplified by a preamplifier 206, and output. The light source 198, the imaging optical system 200, the spatial filter 202, the imaging unit 204, and the preamplifier 206 are configured in an external light shielding unit 208 for preventing disturbance to external light. The image signal amplified by the preamplifier 206 is converted into digital information by the A / D conversion unit 210 and supplied to the scanning conversion unit 186 at the next stage.

  The imaging unit 204 is controlled by the imaging unit control unit 212. For example, when an interline transfer type CCD is used as the imaging unit 204, the imaging unit control unit 212 resets the V blank signal for vertical synchronization and the information charge as a control signal of the imaging unit 204. Image sensor reset pulse signal, charge transfer gate pulse signal for sending charges stored in two-dimensionally arranged charge transfer storage units to multiple vertical shift registers, horizontal shift for transferring charges in the horizontal direction and outputting them to the outside A horizontal charge transfer CLK signal that is a transfer clock signal of the register, a vertical charge transfer pulse signal for transferring the plurality of vertical shift register charges in the vertical direction and sending them to the horizontal shift register, and the like are output. The timing of these signals is shown in FIG.

  Then, the imaging unit control unit 212 provides the light source with a light emitting cell control pulse for timing the light emission of the light source 198 in accordance with this timing.

  Basically, the timing chart of FIG. 16 is a conceptual diagram for one field. The image data is read between the V blank and V blank of this one field. The light source 198 does not illuminate continuously but illuminates in pulses, and performs subsequent pulse illumination while synchronizing in units of fields. In this case, the timing is controlled so that the exposure is performed during the V blanking period, that is, while the image charge is not being output, so that the clock noise during the pulse lighting does not enter the signal output. In other words, the light emitting cell control pulse is a very thin digital clock pulse that is generated instantaneously and gives a large amount of power to the light source, so that noise caused by it does not enter the analog image signal. As a measure for this, the light source is pulsed during the V blanking period. By doing so, the S / N can be improved. Further, turning on the pulse means shortening the light emission time, and thus has a great effect of eliminating the influence of blurring due to shaking and movement of manual operation. This makes it possible to scan at high speed.

  In addition, in the case where a disturbance such as external light enters due to some reason even though the reproducing apparatus is tilted and the external light shading unit 208 is present, the V block is used to minimize the S / N degradation. Immediately before the light source 198 emits light during the ranking period, an image sensor reset pulse is output to reset the image signal, light is emitted immediately thereafter, and reading is performed immediately thereafter.

  Here, returning to FIG. 15, the scan conversion unit 186 will be described. The scan conversion unit 186 is a part that recognizes the image data supplied from the detection unit 184 as a dot code and performs normalization. As the technique, first, the image data from the detection unit 184 is stored in the image memory 214, read once therefrom, and sent to the marker detection unit 216. The marker detection unit 216 detects a marker for each block. Then, the data arrangement direction detection unit 218 detects the rotation or inclination and the data arrangement direction using the marker. The address control unit 220 reads out image data from the image memory 214 based on the result and supplies it to the interpolation circuit 222 so as to correct it. At this time, the lens aberration information is read out from the memory 224 for correcting the distortion of the lens aberration in the imaging optical system 200 of the detection unit 184, and the lens is also corrected. Then, the interpolation circuit 222 performs an interpolation process on the image data and converts it into a form of an original dot code pattern.

  The output of the interpolation circuit 222 is given to the binarization processing unit 188. Basically, as can be seen from FIG. 14, the dot code 170 is a white and black pattern, that is, binary information, and is binarized by the binarization processing unit 188. At that time, the threshold determination circuit 226 performs adaptive binarization while determining the threshold in consideration of the influence of disturbance, the influence of signal amplitude, and the like.

  Since the modulation as described with reference to FIG. 13 is performed at the time of recording, the demodulator 190 first demodulates it, and then the data is input to the data string adjuster 192.

  In this data string adjustment unit 192, the block address detection unit 228 first detects the block address of the above-described two-dimensional block, and then performs block address error detection and correction unit 230 to perform block address error detection and correction. The address control unit 232 stores the data in the data memory unit 234 in units of blocks. By storing the data in units of block addresses in this way, data can be stored without waste even if it is lost or entered from the middle.

  Thereafter, an error correction is performed on the data read from the data memory unit 234 by the data error correction unit 194. The output of the error correction unit 194 is branched into two, and one is sent to a personal computer, word processor, electronic notebook, etc. as digital data via the I / F 236. The other is supplied to the data separation unit 196, where it is divided into images, handwritten characters and graphs, characters and line drawings, and sounds (two types of sound as it is and synthesized speech).

  The image corresponds to a natural image and is a multivalued image. The decompression processing unit 238 performs decompression processing corresponding to the compressed JPEG, and the data interpolation circuit 240 interpolates data that cannot be error-corrected.

  Also, for binary image information such as handwritten characters and graphs, decompression processing unit 242 performs decompression processing on MR / MH / MMR, etc., performed by compression, and data interpolation circuit 244 cannot perform error correction. Interpolation is performed.

  Characters and line drawings are converted into other patterns for display via a PDL (page description language) processing unit 246. In this case, line drawings and characters that have been subjected to code compression processing after being encoded are expanded (Huffman, Dibrempel, etc.) in the corresponding expansion processing unit 248, The data is supplied to the PDL processing unit 246.

  The outputs of the data interpolation circuits 240 and 244 and the PDL processing unit 246 are combined or selected by the combining or switching circuit 250 and converted into analog signals by the D / A conversion unit 252, and then the CRT (TV monitor) or FMD It is displayed on a display device 254 such as (face mounted display). Note that the FMD is a spectacle-type monitor (handy monitor) for wearing on the face, and is effective when, for example, a virtual reality or the like is used, or when viewing a large screen in a small place.

  For the audio information, the decompression processing unit 256 decompresses the ADPCM, and the data interpolation circuit 258 interpolates data that cannot be error-corrected. Alternatively, in the case of speech synthesis, the speech synthesizer 260 obtains the speech synthesis code and actually synthesizes the speech from the code and outputs it. In this case, when the code itself is compressed, the speech synthesis is performed after the decompression processing unit 262 performs decompression processing such as Huffman or Dibrempel, as in the case of the character and line drawing.

  Further, as shown in FIG. 17, the character information may be output as speech information by the speech synthesis unit 260 after the text recognition unit 271 recognizes the text.

  The decompression processing unit 262 can also be used as the same 248. In this case, the data is appropriately switched by the switches SW1, SW2, and SW3 according to the attribute of the data to be decompressed, and the PDL processing unit 246 or the voice synthesizer 260.

  The outputs of the data interpolation circuit 258 and the voice synthesis unit 260 are synthesized or selected by the synthesis or switching circuit 264, converted into an analog signal by the D / A conversion unit 266, and then output to a speaker, headphones, or other similar voice output device. It is output to 268.

  Characters, line drawings, and the like are directly output from the data separation unit 196 to a page printer, plotter, etc. 270, characters are printed on paper as word processor characters, or line drawings, etc. are output to a plotter as drawings, etc. You can also.

  Of course, the image can be printed not only by CRT and FMD but also by a video printer or the like, and the image can be taken.

  Next, the data string adjustment unit 192 will be described. Here, in order to apply to the above-described audio information reproducing apparatus (see FIG. 3), the dot code includes a block address 272A indicated by reference numeral 272 and its error correction data 272B as shown in FIG. Are arranged in a two-dimensional manner, and line-shaped markers 274 as shown in FIG. 5B are arranged in the vertical direction, and the reference number 276 is assigned to each line of each block. In the following description, it is assumed that a line address 276A and error detection data 276B are arranged.

  In the present embodiment, as shown in FIG. 18C, the pitch is doubled for each line and the marker center is detected as compared with the scanning method described with reference to FIG. The center line of the marker is equally divided by twice the number of dots. That is, as shown in FIG. 4D, first, in the first scanning, the dots 278 are finely captured in the vertical, horizontal 1/2, or 1/4. In this case, the pitch is taken at the same interval as that of the dots 278. Therefore, data is taken every other dot. Thus, data up to the CRC error detection data 276B, for example, if one block is 64 dots, 64 dots are captured every other dot.

  First, it is checked whether the line address is actually read by using the rear line address 276A and the CRC error detection data 276B for the line address. If this line address can be read, it is determined that the previous data dot itself has also been read correctly. If it is determined that it is wrong, the second scanning is performed by shifting one dot, for example, to the right (black circle in (D) of the figure). This is taken in for all 64 dots, and it is checked in the same manner whether the line address can actually be read. If it is wrong, it is shifted from the first dot by 1 dot to the third scan. If it is still wrong, it is shifted to the right by 1 dot and the fourth scan is performed.

  As described above, if scanning of one line is repeated four times, it is considered that the data can be read correctly at least once. Therefore, when it is determined that the data is correctly read, the data is written into the data memory unit 234.

  In this case, when the line address of the fetched line is recognized as, for example, “0” (start address), that is, the first address is recognized, it is determined that the previous data is the block address 272A and the error correction data 272B. The error correction data 272B can be error correction of block address Reed-Solomon in addition to error correction according to the purpose, for example, CRC of block address error detection. When the first address line 0 is recognized, the block address 272A is first read, and it is determined from this address data that the block is the numbered block. On the other hand, since the actual data is entered from the next line, they are read and written in the block of the data memory unit 234 corresponding to the block.

  In the above description, if there is no error when scanning one line, it is assumed that the next line is scanned. However, the scanning may be repeated four times per line. . At that time, it is determined that there is no error a plurality of times. However, since the same data is simply written to the data memory unit 234 at the same address, there is no problem. When trying to simplify the process, the scan is repeated four times. In addition, when priority is given to speed, the former scanning method is adopted.

  The actual configuration of the block address detection unit 228 and the block address error detection / correction unit 230 for realizing the operation of the data string adjustment unit 192 will be described with reference to FIG.

  The demodulating unit 190 converts 10-bit binarized interpolation data into 8 bits by using a look-up table (LUT) 190B when 10 bits are input on the shift register 190A.

  In the data string adjustment unit 192, the demodulated data is temporarily stored in the buffer memory (all 64 dots are entered) 282 under the control of the write address control unit 280. Then, only the line address information and address CRC information are read out by the data read address control unit 284, and error detection is performed by the line address error detection circuit 286. When the determination signal indicating the error detection result is true, that is, when there is no error, the data read address control unit 284 reads information before the line address information from the buffer memory 282, that is, actual data information.

  On the other hand, the start address detection circuit 288 confirms whether or not the line address on which the error is detected by the line address error detection circuit 286 is the start address. When the start address is detected, the start address detection circuit 288 informs the block address detection circuit 290 that the line has a block address as information, and in response to this, the block address detection circuit 290 receives the buffer memory. A block address is detected from the data read from 282, and an error detection circuit 292 detects and corrects the error. Then, the result is latched in the address control unit 232 of the data memory unit 234 as a block address.

  Note that only error detection is added to the line address in order to obtain an accurate read position. However, since the block address is used as address information, an error correction code is added.

  Since the next line thereafter becomes a data line sequentially, it is written as data in the data memory unit 234. At that time, depending on the processing, a line address is also output if necessary. Alternatively, if there is a counter inside, the line address can be automatically counted up internally.

  When the next start address “0” is detected, the next block is recognized and the same process is repeated for all the blocks.

  On the other hand, the determination signal output from the line address error detection circuit 286 is also supplied to the address control unit 220 of the image memory 214. This signal is necessary when the data is true and the next line is skipped in order to shorten the time in the four scans per line.

  In the above example, the line address error detection circuit 286 performs address detection on the interpolation data using the same address information for four times until it becomes true. When the data becomes true, the address is temporarily skipped to the data line of the next dot of the new next line, the interpolation data is created, and four of the data are read out. Therefore, for such control, a determination signal is passed to the address control unit 220 of the image memory 214, whereby the same address is generated four times to be interpolated, read while changing the order of interpolation, or A process is performed in which the address is rewritten to the next line, the data on that line is output, and the data is output four times while interpolating.

  Although not specifically shown, the address control unit 232 of the data memory unit 234 performs mapping to the data memory unit 234. When further reading is performed, the address control unit 232 also controls de-interleaving. Again, for example, when an address for each dot is generated using a look-up table, etc., the data obtained by combining the block, line, and dot address is actually output in the look-up table using a ROM or the like. The conversion is performed so that the memory data string comes. That is de-interleaving (de-shuffling), and data is read out in the form of the original data string only after the processing is performed. Of course, this de-interleaving may be performed at the time of reading from the data memory unit 234, or at the time of writing, such conversion is performed once and data is written (mapped) in such an order. Also good.

  In this example, the marker 274 is in a line shape, but it may be a circle as shown in FIG. 14 or a square marker. Once the marker is detected, the block is read on the line, so that the marker does not necessarily have to be a line. For example, as shown in FIGS. 20A to 20C, markers 294, 296, and 298 such as circles, squares, and rectangles can be considered.

  Note that if the printed code is almost precise with no partial blurring or misalignment, it can be said that (rough center = accurate center). Processing can be performed only by center detection processing. However, in this case, in order to detect the arrangement direction, dots 294A, 296A, and 298A for arrangement direction detection are provided in the marker portion.

  FIG. 20D shows another aspect of the multimedia information reproducing apparatus. This is because the A / D conversion unit 210 of the detection unit 184 is moved to the scan conversion unit 186, and the function of the block address detection unit 228 and the block address error detection / correction unit 230 of the data string adjustment unit 192 is changed to the scan conversion unit 186. The data error correction unit 194 and the subsequent parts are the same as those shown in FIG.

  That is, in FIG. 20D, the most different point from the configuration shown in FIG. 15 is the scan conversion unit 186 and the data string adjustment unit 192. In this embodiment, the function of the data string adjustment unit 192 is performed simultaneously from the marker detection unit 216 to the address control unit 220 in the scan conversion unit 186. That is, the marker detection unit 216 detects the marker, and the data arrangement direction detection unit 218 detects the data arrangement direction, that is, the inclination, rotation, and direction. Then, the block address detection, error determination, and accurate center detection unit 300 detects the block address, performs the error determination, and detects the correct center, that is, the true center depending on whether it is incorrect or not. In this case, since the block address is detected in detecting the true center, the marker and block address are interpolated by the interpolation unit 302 for the next marker and block address, and then the block address information is stored as data. The data is also given to the address control unit 232 of the memory unit 234.

  Similarly to the configuration of FIG. 15, the address control unit 220 performs address control based on block address interpolation processing data, and controls address, writing, and output to the image memory 214.

  Other than that, it is not functionally different from the embodiment of FIG.

  In FIG. 15 and FIG. 20D, the A / D conversion unit 210 converts the data into, for example, 8-bit multi-value digital data in the detection unit 184, and the subsequent processing is performed. Instead of the D conversion unit 210, a binarization processing unit (comparator) 188 and a threshold value determination circuit 226 may be arranged at the A / D conversion unit 210, and all subsequent processing may be performed with binary data.

  In this case, the interpolation circuit 222 uses so-called interpolation processing of 4-point or 16-point interpolation using pixel data around the interpolation address coordinates obtained from the address control unit 220 as shown in FIG. Instead, pixel data closest to (neighboring) the interpolation address coordinates can be used as the data.

  By performing binarization and processing instead of A / D conversion, for example, the number of signal lines and the amount of data are reduced to 1/8 compared to the case of 8 bits. Accordingly, the memory capacity of the image memory 214 and the data memory unit 234 is also reduced to 1/8, and the processing of each unit is simplified. For example, the circuit scale is greatly reduced, the processing amount is greatly reduced, and the processing time is greatly reduced. This contributes to downsizing, low cost, and speedup of the device.

  In the case of FIGS. 15 and 20D, the address output of the address control unit 220 is, for example, four pixel addresses around the interpolation address coordinates when the image data is output to the interpolation circuit 222. For 222, distance information for calculating a weighting coefficient for each pixel address is obtained by a signal line (not shown). Alternatively, each pixel address and interpolation address coordinate data may be sent, and a distance from each pixel address may be obtained by the interpolation circuit 222 to obtain a weighting coefficient.

  Further, as described above, at the time of processing with binary data, the address control unit 220 outputs a pixel address in the vicinity of the interpolation address coordinates. Therefore, in this case, the data output from the image memory 214 is directly input to the demodulator 190.

  A specific example of the dot code shown in the conceptual diagram of FIG. 14 will be described with reference to FIGS.

  As shown in the conceptual diagram of FIG. 14, the blocks 304 are two-dimensionally arranged, and each has a block address 306 added thereto. The block address 306 has addresses corresponding to the X address and the Y address. For example, the upper left block in FIG. 21A is (X address, Y address) = (1, 1). On the other hand, the block address of the block on the right is (2, 1), and in the same manner, the X address is incremented as it goes to the right, and the Y address is incremented as it goes down. Thus, the block address 306 is added to all the blocks 304.

  Here, the lowermost marker and the rightmost marker are dummy markers 308. That is, the block 304 for a certain marker 310 is the data on the lower right side surrounded by the four markers 310 including the marker 310, and the lowest and rightmost markers are the second row from the bottom and the second row from the right. An auxiliary marker, or dummy marker 308, arranged to define a block for the marker.

  Next, the contents of the block 304 will be described. As shown in FIG. 21B, a block address 306 and an error detection code 312 of the block address are added between the marker 310 of the block 304 and the lower marker. Similarly, the block address 306 and its error detection code 312 are added between the marker 310 and the right marker. In the conceptual diagram of FIG. 14, there is a marker at the upper left of the block and the block address is arranged at the lower right, but in this embodiment, the block address 306 is arranged at the left and upper sides, and the marker 310 is at the upper left. The shape is arranged at the corner. In addition, although the block address 306 has shown the example recorded in two places in one block, this may be one place. However, by recording in two locations, even if noise occurs on one block address and an error occurs, it can be detected reliably by detecting the other address, so record in two locations. Is preferred.

  The position of the block data with respect to a certain marker, the position of the block address, the position of the dummy marker on the code determined by the position, etc. are not limited to the previous examples.

  Next, a pattern example of the marker 310 will be described. As shown in FIG. 20C, in the present embodiment, a circular black pattern 310 </ b> A having a diameter of 7 dots is employed as the marker 310. Then, the portion 310B around the black circle 310A is set to white so that the black portion of the marker can be easily identified. Reference numeral 310C in FIG. 21C is an auxiliary line for explanation.

  The range of the white portion 310B is desired to be as small as possible in order to increase the recording density, but in order to perform the marker detection process easily and at high speed, there is a demand to increase the range. Therefore, a range 310C for sufficiently discriminating the black pattern 310A when the rotation is 45 ° is set to fall within the portion 310B.

  Note that the image magnification of the imaging optical system 200 in FIGS. 15 and 20D will be described below with respect to the size of the data dots 316 in the data area 314 as shown in FIG. It is assumed that an image is formed on 1.5 pixels under the conditions. Here, the pixel means one pixel of the image sensor of the imaging unit 204. That is, one dot recorded on the sheet 182, for example, a dot of 30 to 40 μm, is imaged through an imaging system lens on 1.5 pixels of an image sensor that is usually 7 μm or 10 μm in size. Shall. In the sampling theorem, the pixel pitch may be equal to or less than the dot pitch, but here it is set to 1.5 pixels for safety reasons. Note that, in the case of binarization instead of the above-described A / D conversion, two pixels are used for further safety.

Employing the two-dimensional block division method as described above has the following advantages. That is,
If the dot pitch for each dot is less than or equal to the resolution of the image sensor, the code (set of unit data blocks) can be read even if the data dot size is different;
Reading is possible even if the imaging unit 204 is inclined with respect to the code;
It can be reproduced even when the sheet is locally stretched and contracted, and can be read even when it is rotated;
The unit block can be freely expanded two-dimensionally according to the total amount of data, and as a result, the code size can be changed freely;
Since each block address is added, playback is possible even if you start reading from the middle of the code;
If it is a block unit, the shape of the code can be freely laid out in accordance with other information on the paper, such as characters, pictures, graphs, etc., and a rectangular dot code is shown in FIG. Can be key-shaped or even slightly modified;
A predetermined start code and stop code as in a bar code are not required, and a clock code is also unnecessary.

  Also, taking advantage of these features, playback is possible even with camera shake. Therefore, it is very easy to handle the handy playback device.

  That is, although details will be described later, the playback device detects normal four markers and divides the markers equally by the number of dots, so it is resistant to enlargement, reduction, deformation, etc. Also, there is an advantage that it is strong against camera shake.

  As for the dots 316 in the data area 314, for example, one dot has a size of several tens of μm. This can be up to several μm level depending on the application and use, but generally it is 40 μm, 20 μm, or 80 μm. The data area 314 has a size of 64 × 64 dots, for example. These can be freely enlarged or reduced to the extent that the error due to the equal division can be absorbed. The marker 310 has not only a function as a synchronization signal but also a function as a position index. The marker 310 has a size that is not included in the modulated data. In the case of the present embodiment, the marker 310 has a round shape, for example, 7 dots or more with respect to the dots in the data area 314, or a circular shape having a diameter of about 7 × 7 dots. The black marker 310A is used.

  Here, the tilt and rotation during reproduction will be described.

  The inclination of the image pickup unit 204 is that the playback device originally has to be vertically opposed to the sheet 182 on which the dot code is printed. However, when the user holds the playback device obliquely, the sheet 182 is inclined. Refers to the state that has become slanted. The rotation refers to a state in which the imaging area (see FIG. 4A) is not parallel to the dot code written on the sheet 182.

  When the inclination occurs, an image obtained by the imaging unit 204 is reduced as compared with an image in the case of being opposed vertically. For example, when an inclination of 30 degrees occurs, an apparent projected image is reduced to 86.5%. That is, for example, if the block 304 is a square and tilted in the horizontal direction with respect to the vertical direction by 30 degrees, the horizontal portion becomes 0.865 times even if the vertical direction is 1: 1. It becomes a rectangle. If there is such an inclination, each part operates with the equally-spaced clock if it has the original internal synchronization clock, and the resulting data may not match the original data. .

  Also, if you think about rotation as an image of horizontal and vertical, the real data will go up diagonally or go down diagonally, so you will not get real information. . Furthermore, when a combined state of tilt and rotation occurs, the imaging result of the square block becomes rhombus, and the condition that the horizontal and vertical data arrays are orthogonal is not satisfied.

  Hereinafter, the marker detection unit 216 for solving these problems will be described. As shown in FIG. 22, the marker detection unit 216 detects a marker determination unit 318 that determines by extracting a marker from a code, a marker area detection unit 320 that detects an area where the marker exists, and an approximate center thereof. The approximate center detection unit 322 includes:

  The marker determination unit 318 searches for continuous black pixels of 7 or more and 13 or less, and recognizes the case where the continuous black pixels continue for 7 rows as a circular black marker 310A. As shown in FIG. 2 is binarized, and black and white are identified for each pixel (step S32). Then, black pixels continuous in the X-axis direction are detected on the image memory 214 (step S34). That is, continuous black pixels having a continuous black of 7 pixels or more and 13 pixels or less are detected. Next, it is checked whether the point shifted by one pixel in the Y-axis direction from the middle pixel of the first continuous black pixel and the last pixel is black (step S36). If it continues seven times in the Y-axis direction (step S38), it is determined as a circular black marker 310A (step S40). If it is not detected in step S34 or if it is not a black pixel in step S36, it is not determined as a marker (step S42).

  That is, it is assumed that the marker is checked on the image memory, and for example, there is a line in which seven black pixels are continued. Then, it is checked whether the point shifted by one pixel with respect to the Y-axis direction from the middle of the first black pixel and the last black pixel is black, and if it is black, the left and right Check if the pixels are continuous 7 pixels to 13 pixels are black, and look in the same way while shifting one pixel at a time in the Y-axis direction, and finally if it lasts 7 times in the Y-axis direction Then, it is determined as a circular black marker 310A.

  The minimum value 7 when checking the continuous black in the X-axis and Y-axis directions is for distinguishing and distinguishing the black portion of the marker 310 (circular black marker 310A) from the modulated data. Therefore, the lower limit value is set so that the data area 314 portion and the circular black marker 310A can be distinguished from each other even when the paper shrinks or shrinks due to inclination. The maximum value 13 is an upper limit value set in consideration of paper elongation, ink bleeding, and the like. This prevents noise such as dust or scratches larger than the marker from being erroneously detected as a marker.

  In addition, since the marker pattern 30A has a circular shape, there is no need to consider rotation. Therefore, the difference between the lower limit value and the upper limit value can be minimized, and erroneous marker detection can be reduced.

  In the marker area detection unit 320, the range of the circular black marker 310A determined by the marker determination unit 318 is slightly expanded or contracted or deformed due to a change in inclination or image magnification of the image. It is for detecting whether it is in.

  As shown in FIG. 24, the marker area detection unit 320 first detects the temporary center pixel of the circular black marker 310A determined by the marker determination unit 318 (step S52). That is, one pixel near the center of the range determined by the marker determination unit 318 is set as a temporary center pixel.

  Then, check that the pixel is black in the upward direction (minus direction on the Y axis) from the provisional center pixel. The check is made up to the Y address where black does not exist, and the Y address is set in the Ymin register (see FIG. 25A) (step S54). Similarly, check that the pixel is black in the downward direction (plus direction on the Y axis) from the temporary center pixel, check several pixels on the left and right when it is white, and check the downward direction in the same manner as above if it is black, A check is made up to the Y address where black does not exist, and the Y address is set in the Ymax register (step S56).

  Next, from the temporary center pixel, check that it is black in the left direction (minus direction on the X axis) this time. If it becomes white, check that several pixels above and below are black. The direction is checked in the same manner as described above, and the X address where black does not exist is checked, and the X address is set in the Xmin register (step S58). Similarly, check that the pixel is black in the right direction (plus direction on the X axis) from the temporary center pixel, check the upper and lower pixels when it is white, and if it is black, check the right direction as above, Check is made up to an X address where black does not exist, and the X address is set in the Xmax register (step S60).

  Based on the Xmin, Xmax, Ymin, and Ymax register values thus obtained, the marker area 324 is selected as shown in the table of FIG. 25B (step S62). That is, the area indicated by hatching in FIG. 6A with the end removed, not the square area including the circular black marker 310A, is the marker area 324. The marker area 324 may be a square. Actually, however, there is data around the white portion 310B of the marker 310, and the data includes information on the black data portion inside the white portion 310B due to the influence of the spatial filter or the like. It is conceivable that the marker area 324 for calculating the approximate center is entered. In order to avoid it as much as possible, it is desirable to make the marker area 324 as small as possible, and in this case, it is only necessary to set a round area larger than the circular black marker 310A in the same shape as the circular black marker 310A. In the present embodiment, the circular black marker 310A is a small circle composed of 7 dots in diameter, and thus becomes a marker area 324 as shown in FIG.

  The approximate center detection unit 322 is for finding the approximate center of the marker black circle in the marker area detected by the marker area detection unit 320 in this way. In general, in printing or the like, there is a phenomenon that dots expand beyond the target size (this is called dot gain) or become smaller (this is called dot reduction) due to the swelling of ink. In addition, it is assumed that the ink spreads around the periphery or the ink is stained on one side. In order to cope with such dot gain, dot reduction, or ink stain, the approximate center detection unit 322 obtains a center in the image of the circular black marker 310A, a so-called center of gravity, and performs processing based on the center. I do. Here, it is a process for obtaining the center with an accuracy smaller than one pixel pitch.

  First, the marker area 324 on the image is divided into the X-axis direction and the Y-axis direction of the image memory 214, and the center line on the X-axis and the center line on the Y-axis are searched for. Find the final or approximate center. (C) and (D) in FIG. 25 are diagrams showing values obtained by accumulating each pixel, each pixel in the vertical direction, and in the horizontal direction in FIG. The center of gravity is the half of the total accumulated value, that is, the part where the accumulated values of the top, bottom, left and right are equal.

  First, in the case of (C) in the figure, for example, the result Sxl of each cumulative addition of the hatched parts in the figure still does not satisfy 1/2 of the total area S. However, if the next Sxc portion is added to it and exceeds an area of 1/2, it can be determined that the center line X including the approximate center is included in the column Sxc. That is, the approximate center X address accumulates the accumulated value of each column (Xk) from the left side (Xmin direction), and exceeds 1/2 of the total accumulated value when the X ′ + 1 column is accumulated. Sometimes there is an approximate center between the X ′ and X ′ + 1 columns. When the X ′ + 1 columns are divided to the left and right so as to be added to the accumulated values up to X ′ and become 1/2 of the entire area S, the approximate center is included on the dividing line.

  Therefore, the ratio of the portion excluding the portion accumulated from the 1/2 area to the X column, that is, (1/2) S-Sxl, and the accumulated value Sxc of the middle column is Δx (rough center = X ′ + Δx )

  This will be described with reference to the flowchart of FIG.

  First, normalization is performed (step S72). That is, the white data portion is set to 0, the black data is set to 1 and the data on the image memory 214 is set to multi-value data so that adding the periphery to each data in the marker area 324 does not affect the accumulation. It normalizes as data with the gradation. This is for the purpose of accurately detecting the center of gravity accurately by recognizing the state since the periphery is blurred by a spatial filter or the like. Next, the accumulated value Sk of each column Xk (k = min, min + 1,..., Max) is obtained (step S74), and the center-of-gravity calculation subroutine is called (step S76).

  In the center-of-gravity calculation subroutine, as shown in (B) of the figure, the entire area S is obtained, half of which is set to Sh and S1 is set to 0 (step S92), i = min, that is, the leftmost It is set from the column (step S94), and is obtained by calculating S1 ′ = S1 + Si (step S96). Since S1 = 0 at the beginning, this is Si itself, and S1 ′ = Smin. Next, the Sl ′ is compared with Sh, that is, half the size of the entire area (step S98). When Sl ′ does not exceed Sh, i is incremented (step S100), and Sl ′ is set to S1. (Step S102), the next column is accumulated by repeating from Step S96. Then, when the accumulated result exceeds half of the total area, Δx is obtained by subtracting S1 from S / 2 and dividing by Si (step S104), i, that is, X ′ plus Δx is C (Step S106), the process returns to the upper routine.

  In the upper routine, the value of C is set as the approximate X coordinate (step S78).

  Thereafter, the same processing is performed in each row direction in steps S80 to S84, the Y coordinate is obtained, and X and Y are set as the approximate centers of the markers (step S86).

  A configuration for realizing such processing is as shown in FIG.

  The normalization circuit 326 normalizes white data as 0 and black data as 1. The output of the normalization circuit 326 is accumulated so that the total area S is calculated by the accumulation unit 328, is halved by the ½ multiplication unit 330, and is latched by the latch circuit 332.

  On the other hand, the output of the normalization circuit 326 is delayed by the delay circuits 334 and 336 with respect to the block in the X-axis direction, the columns are accumulated in the order from the left by the accumulating unit 338, and each column is accumulated by the accumulating unit 340. Accumulation at is done. At the time of outputting the result, the portion of the center column Sxc is output.

  The comparator 342 compares the ½ area latched by the latch circuit 332 with the accumulated value of each column accumulated by the accumulating unit 338. The latch 344 stores the determination timing and the accumulation of columns up to that time. When the comparator 342 determines that the area exceeds 1/2, the X address calculation unit 346 accumulates the 1/2 area latched by the latch circuit 332, the Sxl latched by the latch 344, and the accumulation. From the accumulated value Sxc from the unit 340 and the address corresponding to X ′ supplied from the address control unit 220 via the delay circuit 348, the final X address of the approximate center of the marker is calculated.

  Similarly, the Y address of the marker approximate center is calculated using the delay circuits 350 and 352, the accumulating units 354 and 356, the comparator 358, the latch 360, and the Y address calculating unit 362. In this case, the delay circuits 350 and 352 are constituted by line memories.

  The delay circuits 334, 336, 350, and 352 here adjust the output timings of S / 2, Sxl, Sxc, Syl, and Syc to the necessary timings of the X address calculation unit 346 and the Y address calculation unit 362, respectively. Circuit.

  Next, the data arrangement direction detection unit 218 will be described. For convenience of explanation, the detailed arrangement of each dot code block 304 will be described first. The dot code block 304 is arranged as shown in FIG. 21B. More specifically, the dot code block 304 is shown in FIG. That is, the block address 306 is divided into an upper address code 306A and a lower address code 306B, and the error detection code 312 is also divided into an upper address CRC code 312A and a lower address CRC code 312B. A lower address code 306B is disposed beside the marker 310, and an upper address code 306A is disposed beside the lower address code 306B. Next, the CRC code 312A for the upper address having the same size as the upper address code 306A is added, and then the CRC code 312B for the lower address having the same size as the lower address code 306B is added.

  Below the marker 310, the block address and the error detection data are arranged in the above order toward the lower marker.

  Here, the upper address code 306A and the upper address CRC code 312A are collectively referred to as step 1 code, and the lower address code 306B and the lower address CRC code 312B are collectively referred to as step 2 code.

  When the lower address code 306B is disassembled, on the right side of the marker 310, the data of each dot for indicating the lower address data is inverted with respect to the data (both left and right in the case of the lower side of the marker 310). The code to be written is described. Further, a data margin part 364 is provided for distinguishing from the upper and lower data areas 314. The data margin 364 may be omitted. Further, the inversion code is added not only to the lower address but also to the upper address code. Here, in order to make the data easy to understand, the dots are shown as circles, but the white circles actually indicate that there are no dots to be printed. In other words, it is not printing a white circle. Hereinafter, the white circles shown in the drawings indicate the same thing.

  Here, the upper address and the lower address are, for example, when all addresses are composed of 12 bits, the first 4 bits are assigned to the upper address and the next 8 bits are assigned to the lower address. It is a thing. The data length can be appropriately changed according to the apparatus. Basically, for all block addresses, it is divided into what number from the beginning to the upper address and from there to the last address.

  By providing the address code horizontally and vertically as described above, there is an advantage that even if the address cannot be detected with the address code in one direction, it can be detected with the other address code.

  Another dot code arrangement will be described with reference to FIG. In FIG. 28, the vertical address code in FIG. 28A is omitted. Since the address code is only in one direction, the data area can be increased and the processing speed can be increased. If the address code is in one direction and the address code cannot be detected, the address of the block is unknown, but can be captured by address interpolation processing as described later.

  In FIG. 29A, the block address code is provided only between the horizontal markers. However, a dot code having a block address code only in the vertical direction may be used.

  Alternatively, as shown in FIG. 28B, the upper address code 306A may be added between the lower address codes 306B, and the upper address CRC code 312A may be added between the lower address CRC codes 312B. .

  The processing will be described below based on the dot code shown in FIG. Supplementary explanation is added only in the case of processing unique to the dot code of FIG.

  30 and 31 are a block diagram of the data array direction detection unit 218 in FIG. 20D and a flowchart showing its operation.

  The data array direction detection unit 218 obtains the data of the approximate center of the marker from the approximate center detection unit 322 of the marker detection unit 216, and the adjacent marker selection unit 366 selects the adjacent marker. That is, the center address of each marker has already been mapped on one screen by the processing of the approximate center detection unit 322, and a representative marker to be processed, that is, a marker of interest, is set for this (step S112). An adjacent marker is selected to detect which marker is closest to the representative marker (step S114).

  In the adjacent marker selection process, as shown in FIG. 32A, the distance d between the representative marker and the adjacent marker is calculated, and the adjacent marker within the range of d ≦ dmax is designated (step S142). In this case, however, dmax is the length of the long side of the data block + α (α is determined by the expansion / contraction of the paper). Then, the approximate center addresses are sent to the step 1 sample address generation circuit 368 in the order of the shortest distance d from the designated adjacent markers (step S144). For example, in FIG. 32B, the approximate center address at the distance D2 is the closest from the representative marker, then the distances D1 and D4, and the approximate center addresses of D3 and D5 are in this order. First, the approximate center address at the closest distance D2 is sent. If the distances d are the same, the marker is searched in the clockwise direction from the distance calculation start address, and the direction is detected in the order of appearance (step S146). That is, the approximate center addresses at the distances D1, D4, D3, and D5 are sequentially sent to the step 1 sample address generation circuit 368 to perform direction detection described later.

  That is, the step 1 sample address generation circuit 368 generates a step 1 sample address centering on the approximate center of the representative marker and the selected adjacent marker (step S116), and generates a scanning line connecting the step 1 sample addresses (step S116). In step S118, a read address is generated so that the data in the image memory 214 is sampled at a point equally divided on the scanning line (step S120). The address control unit 220 gives the address of the sample point to the image memory 214 as a read address, and reads the data.

  In the above description, the sample point data is approximated and output (from the image memory). However, as shown in FIG. 5A, it is determined that the sample point is between the image memory data. Sometimes, it may be obtained by interpolation from data of surrounding four pixels.

  As a result, the read data, that is, the upper address code is detected by the error detection circuit 370 and then supplied to the upper block address calculation and center calculation circuit 372. The upper block address calculation and center calculation circuit 372 causes the next adjacent marker selection process to be performed if there is an error as a result of the error detection by the error detection circuit 370, and when a marker in two directions is detected. Since it is no longer necessary to detect the adjacent marker, the address calculation result is sent to the adjacent marker selection unit 366 in order to end the adjacent marker selection process.

  When the dot code shown in FIG. 29A is used, the marker selection process is terminated when an upper address code in one direction is detected.

  If the address calculation result indicates that there is an address error (step S122), it is determined whether or not scanning of all sample points has been completed (step S124), and if not, the process proceeds to step S118. If all the sample point scans have been completed, the presence / absence of unsearched adjacent markers is confirmed (step S126). If there is any, the process proceeds to step S114. If not, the same processing is performed for all markers. After the processing is completed for all markers, the process proceeds to marker and address interpolation processing (step S128).

  Note that the error detection circuit 370 is based on the TV Society Journal Vol. 44, no. 11, p. 1549-P. A general one such as error detection based on a cyclic code as disclosed in “Code Theory Solving” of 1555 may be used.

  On the other hand, if there is no address error in step S122, it is determined whether or not all sample points have been scanned (step S130). If not, the process proceeds to step S118, and all sample points have been scanned. If so, the upper address is determined (step S132), and the step1 center address is calculated (step S134) and determined (step S136).

  That is, the direction is detected from a marker closest to the representative marker (in FIG. 32B, the approximate center address is at the distance D2). In the detection method, it is determined in which direction the peripheral marker is present depending on whether the address recorded in the dot code (step 1 code) larger than the data dot for direction detection can be recognized. It is assumed that the step 1 code is recorded if the upper block address and its CRC code are recorded, and there is no error when the code is scanned.

  When the direction is detected, the slope of the data block can be predicted. The step 1 code has directionality, and the block address is normally recognized only when scanning from the representative marker toward the peripheral markers. Therefore, when no recognition error occurs, a block address code in two directions is always detected. Processing is performed until a block address code in two directions is detected. Further, the data arrangement can be estimated from the positional relationship in the two directions (see FIG. 32C).

  In the case of the dot code in FIG. 29A, the address code is detected only in one direction. At that time, the data area can be recognized from the detected line and the scanning direction (see FIG. 29B).

  In actual operation, the direction is detected from the distance D2 which is the shortest distance from the representative marker, and if the address is not recognized, the search is performed clockwise, so the same operation is performed at the next closest distance D1. repeat. If the detection is performed clockwise, the detection continues with distances D4, D3, and D5. Processing is performed until two directions are detected.

  In the case of FIG. 29A, processing is performed until one direction is detected.

  If one direction can be detected, the other direction may be predicted. For example, assuming that D4 and D5 are forward, D2 does not exist, and a search is started from D4, when the address is confirmed at D4, it is predicted that the address can be recognized by either D3 or D5.

  The direction detection process as described above will be described in more detail with reference to FIG.

  The approximate center of the representative marker detected by the approximate center detection unit 322 of the marker detection unit 216 is defined as a dot A5 on the upper left side of the figure, and then 8 dots separated by 1.5 dots (this can be appropriately changed by processing). Sample points A1 to A4 and A6 to A9 are generated by a step1 sample address generation circuit 368. Similarly, a sample address is generated around a marker whose direction is to be detected, for example, the approximate center of the distance D2 (dot B5 on the upper right side of the figure).

  Here, the reason for the 1.5 dot interval will be described.

  As described above, in the process of obtaining the approximate center of the marker, the description is made so that the difference from the center is within one dot, but it is assumed that there is no problem such as ink bleeding. The detection range is set to ± 1.5 dots in consideration of ink bleeding.

  The address control unit 220 draws a certain line between the addresses of both markers. Initially, scanning lines are drawn on the dots A1 and B1. Then, a sample clock is provided so that the higher address can be sampled, and data sampling of the image memory 214 is performed.

  As shown in FIG. 28A, since the CRC code 312A is added next to the upper address code 306A, when it can be read correctly by the data sample, If the error detection result in the error detection circuit 370 is detected in the form of no problem and cannot be read correctly, it is determined that there is an error.

  In the same manner, scanning lines are sequentially drawn like dots A1 and B2, A1 and B3, and A1 and B4, and a check is made for whether or not an error is detected. In total, there are nine positions on the representative marker side and nine positions on the detection marker side, so 81 types of processing are performed.

  When an error occurs in all 81 processes, it is determined that there is no direction code in that direction, that is, the detection side marker is a marker other than an array (an erroneously detected marker).

  For example, in FIG. 33A, when data is taken at each sample point in the scanning lines (shown by dotted lines) drawn for dots A1 and B7, the sample points indicated by broken-line circles in FIG. Since it is off, it is a false detection. In particular, as described above, since inversion codes are provided on the upper and lower sides of the address data dots, an error always occurs.

  On the other hand, when the dots A5 and B5 are connected, since the data is properly taken, there is no detection error, so that it is recognized that there is a code in this direction.

  Note that inversion codes are provided above and below to facilitate error detection. However, this is not necessarily provided above and below. For example, white code is written above and below address data dots, and the number of address data dots is the latter half. The format can be such that black data continues for the number of dots. In this way, the end on the detection marker side always becomes black data, and the outside becomes a white margin, so that a data error can be detected correctly. Also, in the case of an inverted code, it is not necessary to provide the entire inverted code portion, and it may be provided on a part of both sides ((C) of FIG. 28).

  Here, the dot size will be described. As shown in FIG. 33B, assuming that the size of each dot of the upper address code 306A is n dots and the width of the step 1 code is m dots, the relationship between m and n is determined at the inner end of the step 1 sample address. In addition, a width of 2 dots is provided with respect to the center, a diagonal line is drawn, a width m determined by how much the upper address code 306A is provided is a long side, and the height of a rectangle having the diagonal line as its diagonal line is n. . That is, if m is determined, n is inevitably determined. Even if all the space between the inner ends of the step 1 sample address is used as this address code, there are only 2 dots, so the n dot has a width of up to 2 dots. Further, although the width of one dot is not determined, a width that facilitates data recognition is preferable.

  Note that the above two dots can be obtained, for example, in a range that hits the scanning line connecting the dots A5 and B5 but does not hit the line connecting the dots A6 and B4 and the line connecting the dots A2 and B8. It stipulates that If it is made larger than that, for example, when hitting with dots A5 and B5, the hit may occur even when A2 and B8 are subtracted, and the detection as the center spreads. This value can also be changed according to the apparatus.

  In the example of FIG. 33A, the dots A5 and B5 are hit, but if the dot A4 and the line connecting, for example, B4 are also hit, the next center detection step 2 is performed. At this stage, processing such as starting from the center of the dots A4 and A5 and performing the same search centering on the center is performed.

  Another method is also conceivable. This will be described with reference to FIG. Here, when A4 and A5 and B4 and B5 hit on one side, the sample addresses (A41 to A45, A51 to A55, B41 to B45, B51 to B55) shown in the figure may be used as the sample address of the next step2. . In this case, since the number of sample address points in step 2 is increased from 9 to 10, the number of processes increases from 81 to 100 (the number of scanning lines). However, the process of deriving the midpoint of A4 and A5 and the use of predetermined sample points eliminate the process of generating 9 step2 sample addresses centered on the midpoint. Overall, processing seems to be reduced.

  Further, assuming that there is an accurate center of step 2 between A4 and A5, if address detection processing is performed on the scanning line connecting A42 to A44, A52 to A54 and B42 to B44, B52 to B54, It can be considered that the number is reduced from 81 to 36 (6 × 6).

  In the above processing, a rough center at step 1 is obtained.

  As described above, by detecting the CRC, it is detected whether or not the data blocks are properly arranged in that direction. In FIG. 32B, naturally, the marker at the distance D2 is an erroneously detected marker, and therefore, when looking at the direction of data in that direction, there is no code for the higher address. Therefore, after 81 ways are detected, all errors occur in that direction, and it is determined that there is no direction.

  When it is determined that there is no D2, the next closest distance is D1 and D4. However, since the rotation is clockwise with respect to the marker of interest, the process for the distance D1 is performed next. As described above, since it is possible to determine only from the left to the right and from the top to the bottom in terms of the data arrangement, in this case, the processing is performed in the direction from the representative marker to the marker at the distance D1. Since the address code is read from the reverse direction, that is, from the CRC code first, this is naturally determined to be an error. Therefore, it is determined that there is no direction for the distance D1.

  Next, the distance D4 is determined. When D4 is read along the distance D4 from the representative marker, it is read in the order of address code and CRC code, so that it is determined that D4 has directionality. That is, no error occurs.

  Next, the determination slip is equal distances D3 and D5. On the other hand, since it is clockwise, processing is first performed from the distance D3. As for D3, since the CRC code is read first as described above, it is detected that there is no directionality. Finally, the distance D5 is read, and it is determined that there is a direction here.

  As a result, since the distances D4 and D5 are read, it is recognized that the data corresponding to the block addresses described in the distances D4 and D5 are written in the hatched portions in FIG. can do. Eventually, if two directions are detected for one representative marker, the direction of the block can be detected, and therefore processing is performed until two directions can be detected.

  In the case of the dot code in FIG. 29A, only one direction is detected. Processing is performed until one direction is detected (D5 in FIG. 29B).

  In addition, when processing is performed for all of the above five directions and an error occurs, the above direction detection processing is performed on the marker in the diagonal direction. In this case, in order to prevent an increase in the number of processing, Those outside the certain range are not processed, and address information that cannot be obtained is obtained by marker and block address interpolation processing.

  Further, as described above, the block address is not modulated. However, when the modulation is applied, the process of demodulation is naturally necessary after the block address code is recognized.

  In the above description, whether or not there is directionality is determined using error detection of the upper address, but for example, a directional pattern such as “11100001” is used instead of the upper address CRC code. Also, when “11100001” is detected in pattern matching, a method of recognizing that there is a marker having directionality in that direction can be adopted.

  In the above-described direction detection, it is not necessary for all the markers to search for the adjacent marker in the clockwise direction, and the next block may perform an operation for recognizing the upper address code in that direction. This reduces the number of processes. Further, even when an abnormality occurs in the detection of the upper address, it may be recognized that there is a code in the direction obtained by the peripheral direction detection.

  Next, block address detection, error determination, and accurate center detection unit 300 will be described with reference to the block diagram of FIG. 35A and the flowchart of FIG.

  The upper block address calculation and center calculation circuit 372 of the data arrangement direction detection unit 218 detects the upper block address, detects the next block address, determines an error, and accurately detects the upper block address. This is sent to the block address calculation and center calculation circuit 374. Further, since the rough center at the time of detecting the upper address is known, this center address is led to the step 2 sample address generation circuit 376 (step S152).

  The step 2 sample address generation circuit 376 generates the rough center sample address (step S154). That is, as shown in FIG. 35B, the sample addresses are placed outside the eight points as described above with respect to the rough center (center of direction detection) obtained earlier. Then, eight points are provided in the same manner for the marker in which the directionality is found, and the scanning line is similarly drawn (step S156), and processing is performed to determine whether or not the lower address can be detected. In this case, the data interval for creating the sample address is defined every 0.5 dots in this embodiment, but can be changed as appropriate according to the specifications of the apparatus.

  Then, the address control unit 220 reads data from the image memory 214 based on the generated sample address, and derives data according to this sample point to the error detection circuit 378 (step S158). As in the case of direction detection (as shown in FIG. 5A), when the sample point is between the data in the image memory, it is not a method that represents one data on the memory, but is interpolated from surrounding data. Also good. If an error occurs in the error determination (step S160), it is determined whether or not all sample points have been scanned (step S162). If not, the process proceeds to step S156, where all sample point scans are completed. If so, after the addresses are detected for all the blocks, the process proceeds to the marker / block address interpolation process (step S164).

  On the other hand, if there is no address error in step S160, it is determined whether or not all sample points have been scanned (step S166). If not, the process proceeds to step S156 and all sample points have been scanned. If so, the lower address is determined (step S168), and an accurate center (step 2 center) is determined (step S170).

  That is, error detection is performed by the error detection circuit 378, and if an error occurs in error determination, the process proceeds to the next process. The block address calculation and center calculation circuit 374 is given a signal from the address control unit 220 indicating the start and end addresses at the time of center detection, that is, which point is connected to which point. Judgment is made. When there is no error detection, the block address calculation and center calculation circuit 374 combines the derived lower address with the upper address sent from the upper block address calculation and center calculation circuit 372 as a block address. , The next marker and address interpolation unit 302 is derived. Similarly, the center address is derived to the marker / block address interpolation unit 302.

  In FIG. 35B, 0.5 dot is set because the sample point is detected in the range of 0.5 dot, and the center (direction detection direction) finally obtained by this processing is detected. This is because the difference between the center) and the true center falls within the 1/4 dot range. If it falls within the 1/4 dot range, the data at the data area can be reproduced properly by taking the sample points formed by the above processing.

  Further, since the smallest dot of the step 2 code is 1 dot, a data arrangement smaller than that is not meaningful as data, and therefore it is formed by 1 dot.

  As in the case of the step 1 code, inversion codes may be provided above and below the address data dots, or black data may be provided at the last few dots so that the surrounding area is a blank portion. Further, since the data margin part 364 for distinguishing between the address code and the data code has a very low probability of being mistaken for a marker even if the area to be distinguished from the data area 314 overlaps with, for example, black, the data margin part 364 It is also possible to enter the data area 314 directly from the inversion layer.

  Further, as shown in FIG. 35B, as a result, a CRC code is added with a data length of almost ½ of the total data length in the form of a lower address and an upper address, and the same size. The reason for this is that the data length is set so that it is possible to detect a burst error in such a state that noise has been added to the address length or ink has been applied. The ratio of the data length can be changed as appropriate.

  The accurate center and the block address for sampling the data in the data area 314 have been recognized by the tree search process as described above, that is, by detecting the rough center and detecting the finer center. become. That is, by performing a process called tree search, the process is greatly reduced, and the amount of processing and the processing time are reduced, compared with the case of sampling at a fine pitch from the beginning. Further, by using the block address for direction detection and accurate center detection, the redundancy of the total data amount can be reduced.

  Next, the marker / address interpolation unit 302 will be described with reference to FIG. Now, in the figure, it is assumed that the surrounding black marker portion is detected in response to an error that the marker for the block B2 is not detected or the address is not detected.

  In this case, first, a line connecting the determined center of the marker of block B1 and the marker of block B3 is drawn, and a line connecting the determined center of the marker of block A2 and the marker of block C2 is drawn, and the intersection is defined as the predicted center. To do. Then, address detection and processing can be performed from the predicted center point toward the marker of block C2 and the marker of block B3. In addition, since the arrangement is known without performing address detection, if block B2 exists below block B1, the address of block B2 is set from the surrounding addresses. Can also be estimated. That is, it is possible to detect the address and marker center of a block that has been focused on and cannot be predicted from the surrounding processing.

  The marker and block address interpolation unit 302 guides the address data that has been normally read, the center position to the interpolated address, and the prediction center information to the address control unit.

  In the case where the image data is captured in the image memory 214 as shown in the figure and the scanning direction is the direction of the arrow, the process is performed from the upper left as the first representative marker. The center is sequentially detected in the vertical direction, and the centers of eight (the markers of the blocks A1 to A4 and the markers of the blocks B1 to B4) are obtained by performing the first vertical detection. Then, when the center detection of the next column is performed, since the centers of the markers of the blocks B1 to B4 are already known, no processing is performed on them, and the markers of the blocks C1 to C4 are targeted for those centers. The approximate center of step 1, the center of step 1, and the center of step 2 are obtained. Therefore, as described above, 81 scanning lines are not necessary, and once the center is obtained, it is sufficient to perform processing so as to sample the 9 points in the subsequent stage. That is, the center is obtained by 18 kinds of processing. Thus, there are many processes only at the beginning, but there is an advantage that the subsequent processes are reduced.

  In the case of the dot code in FIG. 29A, first, direction detection processing is performed in the horizontal direction with A1, B1, and C1 using A1 in the upper left as a representative marker. When the marker centers of A1 and B1 are obtained, the center detection processing of C1 may be nine types of processing. In order to determine that the block under A1 is A2, since there is no address code, processing is performed as described below.

  That is, the block size is judged from the lengths of the A1 marker and the B1 marker, and detection may be started from a marker at an appropriate position from the predicted block size. First, the marker immediately below A1 is representative. Processing may be performed as a marker. A block whose horizontal block address matches the detected block address may be set as A2. When the two-stage direction detection (A1 and A2 stages in the figure) is completed, the direction can be predicted in the vertical direction (A3 marker selection process), so only the marker in that direction is detected. What is necessary is just to make it process. Even if there is an erroneously detected marker, it is possible to perform the process by removing it.

  Next, the address control unit 220 in FIG. 20A will be described with reference to the block diagram of FIG.

  First, in the address control unit 220, the address generated by the write address generation unit 380 that generates an address when data from the A / D conversion unit 210 is written to the image memory 214. Data of the / D conversion unit 210 is stored.

  As described above, the marker detection unit 216, the data arrangement direction detection unit 218, the block address detection, the error determination, the accurate center detection unit 300, and the marker and address interpolation unit 302 generate addresses. The address generation units 382 to 388 are configured for this purpose. In this case, in the marker detection address generation unit 382, the data arrangement direction detection address generation unit 384, the block address detection, the error determination, and the accurate center detection address generation unit 386, the corresponding marker detection unit 216 is used. (Internal marker determination unit 318, marker area detection unit 320, approximate center detection unit 322), data array direction detection unit 218, block address detection, error determination, and accurate center detection unit 300 exchanges information and addresses Is generated. In addition, the interpolation processing address generation unit 388 has an address (hereinafter referred to as a marker address) and the number of data corresponding to the exact center of each marker on the image memory for a block in which four markers around the block exist. Further, interpolation address coordinate data obtained by equally dividing the inside of the block and memory read addresses of the surrounding pixel data are generated.

  The selection circuit 390 selects these address generation units 382 to 388 at the respective timings and supplies them to the lens aberration distortion correction circuit 392. Then, the lens aberration distortion correction circuit 392 receives lens aberration distortion information from the lens aberration distortion memory 224 and converts (corrects) the supplied address selectively, via the selection circuit 394. The read address is given to the image memory 214.

  Next, another embodiment of the marker determination unit 318 in the marker detection unit 216 will be described with reference to FIGS.

  In the above-described embodiment, when the size of the dot code is determined, the imaging optical system 200 forms an image so that one dot corresponds to 1.5 pixels of the image sensor of the imaging unit 204, and the marker determination unit 318. In this case, two-dimensionally continuous black pixels are found and determined as markers. In contrast, the present embodiment does not change the image magnification in the imaging optical system 200 when there are codes having different dot sizes, for example, codes having a dot size of 20 μm, codes of 40 μm, and codes of 80 μm. Each code can be played back.

  That is, in various applications, the paper quality, sheet properties, ink, and printing level are different, and therefore a dot size code corresponding to each application is used. For example, when the recording density can be increased extremely, 20 μm is used, and depending on the application using a very rough low-cost sheet with poor sheet quality, 80 μm may be used. In such a situation, the purpose is to reproduce the code correctly by judging its size.

  That is, as shown in FIG. 5B, there are a circular dot size marker of 20 μm, a dot size marker of 40 μm, and a dot size of 80 μm, and the reproducing apparatus to which this embodiment is applied is, for example, 20 μm. Is an apparatus for efficiently reproducing the above code, that is, an apparatus having a magnification of an imaging system capable of decoding more information by one imaging. Then, in an apparatus that captures the 20 μm dot at an image magnification of 1.5 times, each code of 40 μm and 80 μm can reproduce the imaging system without changing the image magnification. Is the purpose. However, the size of the marker shown in (B) of the figure was 7 times the diameter of each dot size.

  Therefore, as shown in FIG. 6A, first, the code of the maximum dot size to be selected is initialized (step S182). For example, when there are 80 μm, 40 μm, and 20 μm codes, and all of them are to be reproduced, the maximum size is set to 80 μm. This may be set by key input by the user, or when it is determined that there are three types of 80 μm, 40 μm, and 20 μm and only the size can be dealt with, the device itself is the best. You may make it set as 80 micrometers of big size.

  Then, the provisional center is obtained by performing determination with the marker determination formula in FIG. 5B (step S184).

  That is, if a code is created using 7 dots of each dot size as a marker, the image forming optical system has an image magnification of 1.5 times as an image at that time. In the case of a code having a diameter of 10.5 dots and a code of 40 μm, the code is 21 dots, and in the case of a code of 80 μm, the code is 42 dots. Accordingly, if the pixel is 7 to 12 pixels and the black pixel is two-dimensionally continuous, it is determined as a marker of a code of 20 μm, and if it is 14 to 24 pixels, it is determined as a marker of a code of 40 μm. Those below the pixel are determined to be 80 μm code markers.

  The value of this pixel is calculated by the following equation.

r = s × d × m
int (r × 0.7) ≦ R ≦ int (r × 1.1 + 1)
However,
r: Number of pixels corresponding to the diameter of the marker (= 7)
s: dot size (20 μm, 40 μm, 80 μm)
m: imaging system image magnification (= 1.5)
d: Number of dots with marker diameter R: Number of pixels with marker diameter in binary image 0.7: Reduction ratio due to inclination, dot rejection, etc. 1.1: Expansion ratio due to dot gain, etc.

  First, since the marker of 80 μm code is initially set in step S182, in this step S184, it is checked whether or not it is a marker of 80 μm code by the marker judgment formula, and a marker of that size (80 μm dot The provisional center is obtained with respect to what is determined to be a marker composed of

  Next, the number of markers is checked, and it is checked that there are four or more (step S186). This means that it is determined whether or not there is one or more blocks from the meaning that one block is surrounded by four markers.

  Then, it is confirmed whether or not the marker is in a predetermined positional relationship with the adjacent marker as shown in FIG. 8C (ie, aligned) (step S188). That is, based on the marker B in the vicinity of the marker A of interest, the marker C in the vicinity of the distance D in the direction perpendicular to the direction connecting the markers A and B to the marker A of interest, and the marker B A marker D is detected in the vicinity of a position separated by a distance D in the same direction as the direction of markers A to C. If they exist, for example, it is determined that the code is 80 μm in this case.

  If there are not four or more 80 μm code markers in step S186, or if it is determined in step S188 that they are not aligned, this is not an 80 μm code. Is determined to be one smaller code, in this case 40 μm (step S190), the process returns to step S184, and the marker is determined once again.

  If it is not possible to determine even in the smallest size determination, the processing ends because it is not a code or it is impossible to reproduce even a code. In this case, it is preferable to proceed to a process of issuing a warning such as issuing an alarm.

  Next, another embodiment in the marker determination unit 318 will be described. That is, a method for determining a marker pattern and modulated data by dilation, which is a general image processing, will be described. Here, the dilation processing is processing for converting a black pixel in the vicinity of a white pixel into a white pixel. Specifically, for example, a pixel around a pixel of interest (a 7 × 7 pixel area centered on the pixel of interest) is checked (black and white determination). The conversion process is performed for all pixels on the image.

  First, binarization processing is performed on the data in the image memory.

  Next, by the dilation processing, only the data portion of the code image is converted into white pixels, and the marker pattern portion is converted into an image that is smaller than the original size by the number of dilated pixels.

  Next, the address in the image memory of the change point from the white pixel to the black pixel on the image and the continuous number of black pixels from the pixel are counted, and the information is classified for each marker based on the information. The center address and marker presence range are detected. Thereafter, an approximate center detection process is performed.

  As a result, marker determination and marker presence range can be detected at high speed.

  Further, in the case of a code in which the marker center is uniformly deformed like the dot gain and dot reduction described above with respect to the marker, the temporary center address obtained by the marker determination can be used as the approximate center. .

  The process of step S184 in FIG. 38A may be the above process.

  When the A / D conversion unit described above is performed by binarization using a comparator, the binarization process can be omitted in the marker determination process.

  Next, a light source integrated image sensor that can be applied to the detection unit 184 of the reproducing apparatus shown in FIG. 15 or 20D will be described. FIG. 39 is a diagram showing the configuration. For example, a light emitting cell 398 is formed on a chip next to the light receiving cell 396 by using a compound semiconductor such as an LED or an electroluminescence element. Between the light receiving cell 396 and the light emitting cell 398, there is provided an isolation (shading) portion 400 in which a cutter is actually put on the wafer to form a groove, and a non-transparent material, for example, metal is embedded therein. The isolation unit 400 can eliminate the problem that light emitted from the light emitting cell 398 directly enters the light receiving cell 396.

  In such a configuration, the light emission of the light emitting cell 398 is controlled according to the light emitting cell control pulse signal as shown in the timing chart of FIG. The light receiving cell 396 sends the accumulated charge to the adjacent vertical charge transfer register 402 by applying a charge transfer gate pulse signal to a charge transfer gate (not shown). The vertical charge transfer register 402 sends the accumulated charges line by line to the horizontal charge transfer register 404 by a vertical charge transfer pulse. The horizontal charge transfer register 404 outputs accumulated charges pixel by pixel through the buffer amplifier 406 in response to a horizontal transfer clock signal.

  Next, with reference to FIG. 40, a description will be given of an embodiment in which, in the circuit of the reproducing apparatus described above, an analog circuit is implemented up to the preceding stage of the demodulating circuit and a single chip is used. In this embodiment, by using an XY addressing imaging unit 408 typified by CMD as disclosed in, for example, Japanese Patent Laid-Open No. 61-4376 as the imaging unit, a memory is not required, and therefore a circuit system Therefore, it can be configured with one chip. An X decoder 410 and a Y decoder 412 are prepared for address scanning of the XY address imaging unit 408.

  In an ordinary XY address type imaging unit, unlike a CCD, after reading one line, this line is reset and the next line is read, that is, while one line is being read, the other lines are exposed during the exposure period. It is common to use a reading method such as entering. However, in such a readout method, there is a demerit that an extra portion is exposed when external light enters during the imaging time. In combination with the element shutter, the exposure is performed only when external light enters, that is, when exposure is to be performed, and the other portions are not exposed.

  The imaging element scanning address generation / element shutter control unit 414 generates an element shutter pulse for providing an element shutter-like operation in the XY address type, and generates a reset pulse for resetting all pixels.

  The X decoder 410 and the Y decoder 412 are circuits that turn on one of the elements in response to the X address and Y address from the image sensor scanning address generation and element shutter control unit 414. Normally, it is composed of a shift register or the like, but in this embodiment, it is a type of selector in which any one element can be turned on by a signal from the image sensor scanning address generation and the element shutter control unit 414.

  The reset pulse in this embodiment corresponds to the image sensor reset pulse in the timing chart of FIG. 16, and the image sensor is reset before exposure and the reset pulse is set to high during this reset period. As a result, the switch 416 is switched to draw all charges toward the negative power source 418.

  The element shutter pulse is generated in such a way that the gate can be applied from the end of the reset pulse to the end of exposure, as shown by the broken line waveform in FIG.

  In reading, each element is sequentially turned on as in a normal pulse, and the signal charge is amplified by the current-voltage conversion amplifier 420 via the reset selection switch 416 and then supplied to the marker detection unit 422. . The marker detection unit 422 is the same as that described above, and the data detected by the marker is stored in the register 424. The θ detection unit 426 obtains the inclination like the direction detection unit as described above based on the contents of the register 424. For example, in the circuit shown in FIG. 20D, the θ detection unit 426 corresponds to the data arrangement direction detection unit 218, and the next data interval control unit 428 and the image sensor scanning address generation / element shutter control unit 414 have addresses. It corresponds to the control unit 220.

  Then, the coefficient for interpolation generated from the coefficient generation unit 430 by the control of the data interval control unit 428 is multiplied by the electric charge read out by the multiplication circuit 432, and all are added by the addition circuit 434. That is, the output of the adder circuit 434 is sampled and held by a sample and hold (S & H) circuit 436 and returned to the adder circuit 434 via the switch 438. This operation is performed in order to perform data interpolation as shown in FIG. 5A when data is sampled after the direction and scanning line are determined. In FIG. 5A, interpolation is performed by applying coefficients to D6, D7, D10, and D11 in order to obtain Q data. The interpolated value is further sampled and held by the S & H circuit 440, and binarization is performed on the sampled and held value by the comparator 442 and the threshold determination circuit 444.

  Each image pickup element (pixel) of the XY address type image pickup unit 408 will be described in more detail. As shown in FIG. 41A, each pixel is composed of two CMD elements, and the element shutter pulse enters the first CMD element 446 and the capacitor 448 stored for the element shutter is stored. Charges are accumulated there. After that, the second CMD element 450 is driven by a read pulse from the Y decoder 412 to select a line, and the charge for each pixel is read from the horizontal selection switch 452.

  At the time of exposure, the first CMD element 446 is operated as an element shutter by an element shutter pulse, and charges are accumulated in the element shutter capacitor 448. When the charges are accumulated in this way, the light is shielded, a read pulse is applied from the Y decoder 412 to select a line, and the second CMD element 450 is turned on by the horizontal selection switch 452 to read out pixel by pixel.

  When resetting the charges, all the horizontal selection switches 454 are turned on by the reset pulse output from the image sensor scanning address generation and element shutter control unit 414, and the reset selection switch 416 is set to the negative power source 418 side. Since the source of the CMD element 450 becomes a negative voltage, the charge accumulated in the gate of the element shutter capacitor 448 and the CMD element 446 moves to the negative power source and is reset.

  In addition to the above operation, the voltage of the element shutter pulse and the readout pulse can be reset by applying a higher voltage at the same time.

  In the case of a normal image sensor, dark current becomes a problem. However, in the case of the present embodiment, exposure is performed only during a period when the element shutter pulse shown in FIG. Since it is in such a state that it is immediately read out, the dark current accumulation time is actually very short. Therefore, the S / N ratio is more advantageous than the operation of other image sensors. Since the exposure can provide a sufficient amount of light even in this short exposure period, the signal level remains as it is and the S / N level with respect to the dark current is reduced. By applying this embodiment, A considerably large gain can be set for the gain of the output level of the subsequent current-voltage conversion amplifier 420.

  In the present embodiment, the pixel configuration for performing the element shutter operation as described above is used. However, a CMD element capable of the element shutter operation as disclosed in Japanese Patent Application Laid-Open No. 61-4376 can also be used. is there.

  Next, with reference to FIG. 42, an embodiment in which a circuit using the XY address imaging unit 408 as described above is constructed like a three-dimensional IC will be described. This embodiment is a case of an audio information reproducing apparatus.

  This includes an imaging unit layer 454 having a CMD 408, an X decoder 410, and a Y decoder 412 on the paper surface of the sheet 182, and a detection unit layer 456 that detects data formed by being stacked on the imaging unit layer 454. The output processing layer 458 is formed by being laminated on the detection portion layer 456. The output processing layer 458 includes a demodulation unit 190, an error correction unit 194, an expansion processing unit 256, a data interpolation circuit 258, a D / A conversion unit, an output buffer 266, and the like. The decoded audio information is an audio output device 268 such as an earphone. To play as sound.

  Of course, as described above, the output processing layer 458 can be configured to reproduce multimedia information including image information.

  By using a three-dimensional IC in this way, processing up to sound output can be performed with a single chip, so the circuit scale becomes very small and the cost is reduced.

  Next, various configuration examples of the pen-type multimedia information reproducing apparatus will be described.

  For example, the pen-type information reproducing apparatus can be provided with a switch for instructing the timing for taking in the dot code.

  FIG. 41B shows an example of this, and this pen-type information reproducing apparatus includes a light source 198 and an imaging optical system 200 in the reproducing apparatus as shown in FIG. 15 or 20D. , A spatial filter 202, an imaging unit 204, a preamplifier 206, and a detection unit 184 including an imaging unit control unit 212 are provided at the tip thereof, a scan conversion unit 186, a binarization processing unit 188, a demodulation unit 190, a data error correction unit 194, an expansion processing unit 256, a data interpolation circuit 258, and the like are incorporated as an image processing unit 460, a data processing unit 462, and a data output unit 464. And it has an earphone as the audio output device 268. In this figure, only an audio information output device is shown. However, when a processing unit such as an image, a character, or a line drawing is incorporated, it is needless to say that an output device corresponding to the processing unit can be connected (the following). The same applies to the description of the pen-type information reproducing device).

  A touch sensor 466 is provided on the side surface of the pen-type information reproducing apparatus. As the touch sensor 466, for example, a piezoelectric switch, a micro switch, a piezoelectric rubber, or the like can be used, and a switch having a small thickness of 0.6 mm or less is known. The control unit as the imaging unit control unit 212 starts capturing the dot code as described above in response to the touch sensor 466 being pressed by a finger. Then, when the finger is released from the touch sensor 466, the capturing is finished. That is, the touch sensor 466 is used to control the start and end of dot code fetching.

  Note that reference numeral 468 in the figure is a battery as an operating power source for each unit in the pen-type information reproducing apparatus.

  Further, the touch sensor 466 can perform the same function as a configuration in which the touch sensor 466 is not only pressed with a finger but also attached to the tip of the pen-type information reproducing apparatus as shown in FIG.

  That is, when the user places the pen-type information reproducing apparatus on the sheet 182 in order to manually scan the dot code printed on the sheet 182, the touch sensor 466 is turned on, and the control unit 212 recognizes that. And start reading the dot code.

  In this case, the tip of the pen-type information reproducing apparatus moves in contact with the sheet surface during scanning. In this example, the tip of the touch sensor 466, that is, the surface in contact with the sheet surface is coated with a smooth resin or the like. Thus, it is preferable to be configured so as to move smoothly during manual scanning (movement).

  Further, a mechanism for removing regular reflection may be further provided in the detection unit of the pen-type information reproducing apparatus.

  44A is a diagram showing the configuration, and a first polarizing filter (polarizing filter 1) 470 is disposed on the front surface, that is, the irradiation side of a light source (light source such as an LED) 198, and then imaging optics. A second polarizing filter (polarizing filter 2) 472 is disposed in front of the system (lens) 200.

  For example, the first polarizing filter 470 is formed by cutting out the polarizing filter film 474 into a donut shape as shown in FIG. 5B, and the second polarizing filter 472 is a different polarizing filter film. 476 can be used, and for example, as shown in FIG. 5C, an inner portion of the polarizing filter film 474 where the first polarizing filter 470 is cut out can be used.

  The first and second polarizing filters 470 and 472 thus formed have the pattern surface (polarization plane) of the second polarization filter 472 with respect to the pattern surface (polarization direction) of the first polarization filter 470. Arranged orthogonally.

  As a result, the random light emitted from the illumination light source 198 has its polarization plane limited by the first polarizing filter 470 and is irradiated with, for example, P waves. The specular reflection component preserves the polarization plane as it is and returns from the sheet plane as a P wave. However, since the polarization plane of the second polarization filter 472 is orthogonal to the first polarization filter 470, this regular reflection component is The reflected component is blocked by the second polarizing filter 472. On the other hand, the polarization plane is random for the light that has emerged from the first polarizing filter 470 and returned on the actual dots, that is, on the sheet surface as the luminance information of the paper surface. Therefore, the signal that once enters the paper surface and returns as monochrome information or color information has both a P component and an S component. Among them, the P component is similarly cut by the second polarizing filter 472, but the S component orthogonal to the P component passes through the second polarizing filter 472 and actually passes through the lens 200. The image is formed on the imaging unit 204. That is, the reflected light from which the regular reflection component is removed is guided to the imaging unit 204.

  In this case, a 1 / 4λ plate 1230 is disposed on the front surface of the spatial filter 202, and the image light once incident as linearly polarized light is converted into circularly polarized light and input to the spatial filter 202. This is because the effect is not obtained with linearly polarized light because the spatial filter normally uses the birefringence of quartz. In this example, the quarter λ plate 1230 is disposed on the front surface of the spatial filter 202, but the present invention is not limited to this, and an arbitrary portion between the second polarizing filter 472 and the spatial filter 202 is used. What is necessary is just to arrange | position in the place where it is easy to install.

  As a configuration for removing the regular reflection component in this way, a configuration as shown in FIG. 45 can be considered. This is because, instead of arranging the first polarizing filter 470 in the vicinity of the light source 198, for example, a light guide material 480 made of a transparent resin with a surface mirror coat 478 is used, and the light from the light source 198 is very sheeted. The sheet (dot code) is illuminated by guiding it to a state close to the surface, and is arranged in the light emitting portion of the optical waveguide member 480. In this case, the first polarizing filter 470 is disposed so that light orthogonal to the second polarizing filter 472 is transmitted.

  Incidentally, when the transparent resin optical waveguide material 480 is used here, there are advantages that the light source 198 and the outer shape can be made as thin as possible, and that the regular reflection component can be reduced because the incident angle becomes shallow.

  However, since the specular reflection component still remains due to the rise of ink, the rise of the sheet, etc., a polarizing filter is provided in order to eliminate it more efficiently.

  Further, instead of the second polarizing filter 472, an electro-optical element shutter 1220 such as a liquid crystal shutter or a PLZT shutter may be provided. As shown in FIG. 44D, the electro-optical element shutter 1220 includes a polarizer 1221 as a polarizing filter, an electro-optical element 1222 such as liquid crystal or PLZT, and an analyzer 1223 as a polarizing filter. In this case, by arranging the shutter 1220 so that the light distribution direction of the polarizer (polarizing filter) 1221 of the shutter 1220 is the same as that of the second polarizing filter 472, a regular reflection removal effect can be obtained. .

  Furthermore, the shutter function enables frame reading with an image sensor that supports field reading such as IT-CCD, or all pixels can be exposed simultaneously with an XY addressing image sensor such as CMD. .

  Next, an example in which the light source 198 is made more efficient and the apparatus is slimmed will be described.

  46A is a diagram showing the configuration, and similarly to the example of FIG. 45A, an acrylic transparent resin optical waveguide material 480 having a mirror coat 478 on the surface is provided. As shown in FIG. 46 (B), this acrylic transparent resin optical waveguide material 480 is formed in a truncated cone shape, and a screw portion 482 is provided on the upper portion (the widened end portion). The pen-type information reproducing apparatus is attached to the casing 484 by screwing. In addition, the surface mirror coat 478 is not applied to the inner portion in the vicinity of the screw portion 482, and the light source 198 is provided in the portion 486. That is, the light source 198 is provided as an LED array in which LEDs are mounted on a thinly cut flexible substrate 488 and formed into a ring shape, and this is attached by bonding to the portion 486 without the surface mirror coat. . And the lower part (tip part) of the acrylic transparent resin optical waveguide material 480 is cut as shown in (C) of the figure, and the part 490 where the surface mirror coat 478 is not applied is formed. Accordingly, light from the light source 198 enters the transparent resin optical waveguide material 480 from the non-mirror-coated portion 486, is reflected by the surface mirror coating 478, passes through the optical waveguide material 480, and is surface mirror coated at the tip. It exits from the non-existing portion 490 and is irradiated to the dot code on the sheet.

  The acrylic transparent resin optical waveguide material 480 is more easily manufactured, as shown in FIG. 4D, with the surface mirror coat 478 only applied to the outer portion, as shown in FIG. It is good also as a simple shape. In this case, it is more preferable that the tip is rounded to make it slippery.

  Next, an example of a pen-type information reproducing apparatus using a light source integrated image sensor will be described (see FIG. 47).

  That is, in the present embodiment, a light source integrated image sensor 492 as described above with reference to FIG. 39 is used, and a rod lens (for example, a cell-hook lens or a convex lens) as an imaging system is formed on the exposure surface. 494 and a thin glass plate 496 are arranged and formed. Here, the glass thin plate 496 has a role of a protective glass for an actual contact surface, and also has a role of giving a certain distance to make the illumination as flat as possible.

  As described above, by using the light source integrated image sensor 492, it is possible to reduce the shape of the pen-type information reproducing apparatus, and it is also possible to shorten the shape in the length direction.

  Next, a pen type information reproducing apparatus for dealing with color-multiplexed dot codes will be described.

  48A shows the configuration of the touch sensor 466 shown in FIG. 41B and the first and second polarizing filters shown in FIG. 44A. 470, 472. Furthermore, the pen-type information reproducing apparatus of the present embodiment reads a color multiplexed dot code that is color-multiplexed by synthesizing a plurality of dot codes of different colors as shown in FIG. In addition, a color liquid crystal 498 controlled by the control unit 212 is disposed on the pupil plane of the lens 200.

  Here, in order to explain the control method of the color liquid crystal 498 in the control unit 212, first, a usage example of a color multiple dot code will be described.

  For example, as shown in FIG. 6C, a color multiplex dot code 502 is arranged on an A4 sheet 500, and the characters “Good Morning” are written in correspondence therewith, and a predetermined position, for example, lower right In addition, an index 504 and an index code 506 are considered. When the color multiplex dot code 502 is played back with this pen-type information playback device, it is pronounced as “Good morning” in Japanese, pronounced “Good Morning” in English, or “ In order to select whether or not to pronounce “Gouten Morgen”, as shown in (D) of the figure, the index code 506 arranged corresponding to the index 504 indicating the option is scanned and recognized. After that, when the color multiplex dot code 502 is scanned, the following explanation will be made for the purpose of producing a voice like “Good morning”.

  First, as shown in (B) of the figure, a dot code for sounding in Japanese is generated, and this is assigned as a code 1 to red (R). Similarly, a dot code that is pronounced in English is created as code 2 and assigned to green (G), and a dot code that is pronounced in German is created as code 3 and assigned to blue (B). The color multiple dot code 502 is recorded on the sheet 500, with the color of the overlapping portion of each information as the color of the additive color of each color. In this case, the portions where the colors do not overlap are recorded as black dots. That is, as described above, the dot code is composed of the marker and the data dot, but the marker is black, and the data dot is recorded in another color by the additive color method. Thus, recording with the color multiplex dot code 502 means that the recording density is increased.

  It should be noted that not only the three colors of RGB but also a plurality of different pieces of information may be assigned to different narrow-band wavelengths, and therefore four types, five, More information such as types can be multiplexed. As the color ink in this case, in addition to conventional inks such as cyan, yellow, and magenta, a mixture of pigments (inks that reflect light of only a narrow band wavelength) can be considered.

  The index code 506 is arranged in the underlined portion of the index 504 indicated by characters or pictures so that the user can recognize and select it, and the print can be read regardless of which color is selected. Printed with black.

  The color liquid crystal 498 is configured by pasting RGB light-transmitting mosaic filters in accordance with liquid crystal pixels, and is for separating information of each color of the color multiple dot code 502. In other words, the control unit 212 controls so that only the pixels corresponding to the color of the information selected by the scan of the index code 506 are in a transmissive state. Further, the liquid crystal may not be in a mosaic shape, but may be configured so that the optical path is divided into planes. At that time, it is preferable to make the divided area ratio of each color inversely proportional to the sensitivity of the pixel because the sensitivity for each color becomes uniform. That is, when the sensitivity of B is low, the area is made larger than other colors. The color liquid crystal may be placed on the light source side.

  Next, an operation for reading the index code 506, selecting a color and generating it in a desired language will be described with reference to the flowchart of FIG.

  First, when the green color is temporarily selected by the initial setting (step S202) and the touch sensor 466 is pressed (step S204), the control unit 212 controls the liquid crystal transmission portion of the color liquid crystal 498 in accordance with the color selection (step S206). ). For example, since green is selected in the initial state, only dots with a green filter are made transparent. Next, the light source 198 is controlled by the control unit 212, and the dot code is read by the image processing unit 460 (step S208). Then, the data processing unit 462 decodes the code (step S210), recognizes whether all the codes have been completed, that is, whether all the reading has been completed (step S212), and if the reading has been completed, generates a sound for notifying it. (Step S214). Next, the control unit 212 determines whether the index code 506 or the sound information (color multiplex dot code 502) is read based on the decoding result (step S216). The color indicated by the index code 506 is selected (step S218), and the process returns to step S204. If it is sound information, the data output unit 464 causes the sound output device 268 to reproduce the sound (step S220).

  After the sound reproduction at step S220, it is further determined whether or not the sound is repeatedly generated a predetermined number of times (step S222). If the number of times is preset by the repeat switch 467, A predetermined number of times are repeated.

  Of course, the number of repetitions may be one, and may be set with various switches as appropriate. Alternatively, the number of repetitions may be recorded in the index code 506 or the dot code 502 in advance.

  The repeat reproduction here can be performed by repeatedly reading from the data memory unit 234 in FIG. 15 or 20D.

  The image pickup unit 204 includes a monochrome image pickup device and a color image pickup device in which a color mosaic filter is generally mounted on the image pickup device portion. In the above example, a black and white image pickup unit is used. However, by using a color image pickup device, the image processing unit 460 can separate the colors and reproduce the color. In this case, the color liquid crystal 498 can be dispensed with.

  FIG. 49B is a diagram showing the configuration of the image memory unit of the image processing unit 460 when a color image sensor is used. That is, a signal input from the color image sensor is separated into respective colors by the color separation circuit 508 and stored in the memories 510A, 510B, and 510C, which is selected by the multiplexer (MPX) 512, and the subsequent processing is performed. Like that.

  Of the first and second polarizing filters 470 and 472 for the purpose of preventing regular reflection, the same polarizing filter is used in the polarizer portion of the color liquid crystal 498 as the second polarizing filter 472. So it can be combined with it. Therefore, the second polarizing filter 472 can be omitted by combining with the polarizing filter of the color liquid crystal 498. However, at that time, the angle of the color liquid crystal in the horizontal plane must be rotated so as to cut the same arrangement as that of the second polarizing filter 472, that is, the component in the same direction.

  Further, as shown in FIG. 50A, the color liquid crystal 498 is removed, and instead of a white light source, an RGB light source such as an LED shown in FIG. The color multiple dot code 502 can be read. That is, in the case of dividing the RGB into the above three colors, among the RGB light sources 198, when reading the code 1 corresponding to red, only the LED corresponding to red is turned on. In the case of code 3, it is only necessary to turn on only the blue LED to reproduce.

  Further, instead of using RGB LEDs, it is conceivable to add a color filter to each part as a white light source to make each color light source.

  As described above, by using light sources of RGB different colors as the light source 198 and controlling the lighting of the light source of the color selected by the index code 506, the same effect as the configuration of FIG. 48A can be obtained. it can. Furthermore, by having a plurality of light sources that emit light having a narrow band of wavelengths, it is not necessary to have a color liquid crystal or its control circuit, and the size can be reduced at a low cost. In particular, some LEDs have a narrow band, for example, a certain wavelength of about ± 27 nm. If such an LED is used, a narrower band can be reproduced.

  Next, a stealth dot code pen-type information reproducing apparatus will be described.

  FIG. 51A shows a dot data seal 516 with a title on which an infrared light emitting paint dot code 514 as a stealth type dot code is printed. The dot data seal 516 prints, for example, a title in normal color or black and white printing on a printing press or printer, for example, and then prints a dot code below it using invisible paint. It is what. Of course, since the dot code 514 is invisible, that is, transparent printing, the dot data seal 516 uses the transparent ink for the dot code 514 on the title of the visible information as shown in FIG. It is also possible to print in an overlapping manner. For example, in the case of an ink jet printer, this printing is realized by adding four inks of cyan, magenta, yellow, and black to the ink of the infrared light emitting paint as the fifth ink, and printing them by overlapping them. it can.

  FIG. 51A is an example in which a title is printed on the margin of a stealth dot code. Of course, a dot code of visible light is printed on the title-attached dot data seal, and the margin is printed on the margin. A title may be printed.

  As a pen-type information reproducing device for reproducing the infrared light emitting paint dot code 514 as such a stealth type dot code, for example, as shown in FIG. Since it is printed, an infrared light emitting element 518 is used as the light source 198 and an infrared band-pass optical filter 520 is arranged in front of the imaging unit 204.

  That is, when the infrared light emitting paint dot code 514 is irradiated with light in the infrared region from the infrared light emitting element 518, the light is reflected in the infrared region, that is, in a certain narrow waveband wavelength. In order to detect the intensity of the reflection by the imaging unit 204, the reflected light is guided through the infrared band-pass optical filter 520 and separated from the visible light information.

  In addition, since several kinds of light emission bands of the paint used for printing the infrared light emitting paint dot code 514 can be prepared, for example, by changing the characteristics of the bandpass optical filter 520 little by little, this transparent printing is also performed. Multiplexing is possible.

  Next, instead of configuring all playback functions within the pen-type information playback device, various optional functions are provided for various devices such as electronic notebooks, PDAs, word processors, personal computers, copiers, printers, and electronic projectors. A ROM card is generally used for adding. An example in which the function is partially distributed to a card type adapter that can be connected to the connector of the ROM card will be described.

  FIG. 52 shows an example in which the pen-type information reproducing apparatus is provided with up to the image processing unit 460, and the output of the image processing unit 460 is supplied to the card-type adapter 524 via the output connector 522. . The card type adapter 524 in this case has a data processing unit 462, a data output unit 464, a signal processing unit 526 including a D / A, and an audio connection terminal 528, and outputs reproduced audio information from the audio output device 268 as sound. In addition, it is possible to supply multimedia information such as reproduced images to an external device 532 such as an electronic notebook via the I / F 530.

  That is, a dot-coded image or the like connected to a ROM card connection terminal (not shown) of an external device 532 that does not have an audio output mechanism such as a speaker such as an electronic notebook, etc. At the same time as inputting the multimedia information, an audio output device 268 such as an earphone is connected to the audio connection terminal 528 of the card type adapter 524 to listen to the dot-coded audio.

  Further, as the external device 532, it is possible to assume a video game machine that has been widely used in each household in recent years. 53A and 53B show the configuration of a card type (in this case, a cassette type) adapter 524 for such a video game machine. In the case of (A), pen type information reproduction is shown. This is a case where up to the data processing unit 462 is configured in the apparatus, and (B) is a case where only the detection unit 184 is configured. The ROM 534 stores a control program executed by a CPU (not shown) built in the main body of the video game machine, and is loaded to the main body when the cassette is inserted. The RAM 536 is used for storing the processing result in the data processing unit 462. The memory control unit 538 controls the ROM 534 and the RAM 536 in accordance with an instruction from the CPU in the video game machine main body.

  Normally, a video game machine is equipped with a high-performance CPU. Therefore, rather than performing all the processing in the pen-type information playback device, the game machine main body CPU performs a part of the processing so that high-speed processing is possible. Is possible. In addition, since the operation unit of the game machine can be used as various control input units, it is not necessary to provide a reading start instruction switch such as a touch sensor in the pen-type information reproducing apparatus, and the size can be reduced. In this case, a control program for processing that is handled by the CPU of the main body of the game machine, or a control program for the CPU of the main body and the operation unit of the game machine that is responsible for the control of the pen-type information reproducing device and the user interface function for operation, Stored in the ROM 534. Furthermore, since the game machine is configured with a speaker, an audio output terminal, a monitor output terminal, and the like, these can be omitted from the pen-type information reproducing apparatus and the card-type adapter, so that the cost can be reduced.

  Next, operation switches when the card type adapter 524 is used will be described.

  An electronic notebook as the external device 532 usually has a slit for mounting a card called a ROM card or an IC card. When a card adapter is inserted into the slit, the card is recorded on the surface of the card adapter. The displayed characters and symbols can be seen through under the transparent touch panel 560 of the electronic notebook main body, and touching a place written on the card-type adapter, a function corresponding to that will work, for example, an operation that is displayed on the display 562 Some of them are designed to do this.

  Therefore, in the case of such a card-type adapter 524 for an electronic notebook, as shown in FIG. 54A, the control system switch of the pen-type information reproducing device 564, for example, turning on / off the light source 198, etc. Without providing such operation switches, characters and symbols representing these switches are simply written at predetermined positions on the surface.

  In addition, since the external device 532 such as a personal computer or a word processor has a built-in keyboard, when connecting the pen-type information reproducing apparatus to such a device, the card-type adapter 524 is not provided with a control system switch. Can be controlled from either side.

  However, in the case of an external device 532 that has a dedicated control switch for operating itself, such as a printer, but does not have any other control system switch, the card type adapter 524 has a control system switch. It is necessary to provide it. For example, as shown in FIG. 54 (B), the switch 566 is provided in a portion that is longer than the normal card length and protrudes outside the device when it is attached to the device 532. As the switch 566 in this case, for example, a tact switch or a touch panel can be used.

  Next, an apparatus for printing a dot code will be described.

  First, as shown in FIG. 55, a reel seal printer 572 that converts data edited by a personal computer, a word processor, etc. 568 into a dot code by a multimedia information recorder 570 and prints the dot code on a reel seal will be described.

  FIG. 56 is a diagram showing an internal configuration of the reel sticker printing machine.

  After the dot code from the multimedia information recorder 570 is temporarily stored in the dot pattern memory 574, the LED driver 576 causes the LED arrays 578 and 580 to emit light based on the dot pattern. Light from these LED arrays 578 and 580 is guided onto a photosensitive paper extending from the photosensitive paper reel 584 by a rod lens 582 provided in close contact with each pixel. Further, the timing of light emission is managed by the CPU 588 according to the speed and position of the photosensitive paper detected by the sensor 586. Similarly, the photosensitive paper feed speed is controlled by controlling a driver 594 of a rotary motor 592 that drives an output stage roller 590.

  On the other hand, in order to protect the printed dot code, a surface coat seal 596 is added at the output stage, and the photosensitive paper and the surface coat seal are simultaneously bonded and output. Here, photographic paper, film, or the like can be used as the photosensitive paper. In this case, the back surface of the photosensitive paper is provided with adhesiveness.

  If the photosensitive paper is an ordinary film or the like, as shown in FIG. 56, the LED array 578 is a red LED array and the LED 580 is a yellow LED array. You may make it do. With regard to multiplexing, two types of LEDs may be shifted in position to form a two-color dot code, or two types of LEDs may emit light at the same position to create different colors for further multiplexing. May be.

  Such a reel seal printing machine 572 has a feature that it is high-resolution and low-cost by using photosensitive paper. In addition, the configuration of the exposed portion does not require expensive processing such as scanning with a laser or the like, and is performed using a small LED array, so that the apparatus becomes very inexpensive. Furthermore, while a mirror or the like is required for a laser or the like, a fine positioning accuracy is required. On the other hand, since this printing machine 572 uses a close contact optical path, such a fine positioning accuracy is not necessary. Can also avoid problems.

  In this figure, for convenience of drawing, the arrangement direction of the LED arrays 578 and 580 and the rod lens 582 is shown as the traveling direction of the photosensitive paper, but in reality, it is perpendicular to the paper surface, that is, in the width direction of the photosensitive paper. To be arranged. Of course, a large number of dot codes may be formed at once as a two-dimensional array arranged in the width direction as it is.

  In the reel seal printer 572 as described above, the photosensitive paper on which the dot code is printed is output from the roller 590 in the form as shown in FIG. 55. In this case, white is printed at the boundary with the next data. It is preferable to insert a blank portion so that the user can see and understand at which portion the cutting process such as a cutter should be performed. Furthermore, the code length that can be pasted varies depending on the size of the sheet on which the reel seal is to be pasted, that is, whether it is A4 or B4. Anyway. In such a case, for example, a control method such as controlling the timing of reading the dot pattern on the dot pattern memory 574 in accordance with the manually set sheet size and changing the length adaptively is adopted. To do.

  FIG. 57 shows the configuration of a word processor provided with a function for recording a multimedia dot code.

  In this configuration, the configuration other than the multimedia information recording processing unit 598 that generates a dot code for the edited text is a general word processor configuration. That is, a ROM 604 such as a program and a character generator, a RAM 606 as a work area, a calendar 608, a bus control 610, a video RAM 612, a CRT control 616 that displays data on the CRT 614, and a keyboard 618 are displayed on the bus 602 from the CPU 600. An I / O control 620, a disk control 624 for controlling the FDD 622, a printer control 628 for controlling the printer 626, various I / Fs 630, and the like are hung.

  The multimedia information recording processing unit 598 can access the bus 602 exclusively, and basically has the same contents as the multimedia information recording machine 570 in FIG. That is, the data supplied from the bus 602 via the bidirectional I / O 632 is separated into a character, a graph, and a picture by the separation circuit 634, and is compressed by the compression circuits 636 and 638, respectively, and synthesized by the synthesis circuit 640. To do. On the other hand, layout information of characters, pictures, and graphs is directly input to the synthesis circuit 640. An error correction code is added to the synthesized data by an error correction code addition circuit 642, processing such as interleaving is performed on the memory 644, a block address is added by an address addition circuit 646, and then the modulation circuit At 648, modulation is applied. After that, a marker is added by the marker adding circuit 650, the title of the dot code is synthesized by the edit synthesis circuit 652, and the size of the dot pattern is changed by the dot pattern shape conversion circuit 654. Return it to bus 602 via I / O 632.

  Then, according to the data returned to the bus 602, the printer control 628 controls the printer 626 to obtain a printout as indicated by reference numeral 656 in the drawing.

  As shown in the figure, a basic printout 656 includes a text 658 entered (typed) on a word processor, a picture 660 and a graph 662 added thereto, and the contents of the text 658, the picture 660 and the graph 662. A dot code 664 is printed at a predetermined position, for example, below.

  By using such a printout 656, a user who has received this printout 656 directly or by FAX reads the dot code 664 with the pen-type information reproducing apparatus as described above, thereby corresponding to the document 658, There is a merit that the picture 660 and the graph 662 can be taken into the word processor of the user and can be arbitrarily edited.

  Note that the multimedia information recording processing unit 598 may be realized by software processing by the CPU 600.

  Further, the multimedia information recording processing unit 598 may take a form incorporated in the printer 626 instead of being mounted in the word processor as described above. That is, when the printer 626 receives font or graph information or the like, printing may be performed by adding such recording modulation to the information. In that case, it may be supplied in the form of a card-type adapter without being incorporated in the printer 626.

  It should be noted that the dot pattern shape conversion circuit 654 in the multimedia information recording processing unit 598 performs conversion according to the resolution of the printer 626, and when transmitting the printed contents by FAX, the resolution or Since the definition is determined as GII or GIII, it may be converted into a form that can be adapted to the resolution of the other, that is, the process of changing the size may be performed.

  FIG. 58 shows that the function of the multimedia information recording processing unit is built in the optical copying machine 666, and when the original is copied, the content is copied onto the paper and the dot code corresponding to the content is printed at a predetermined position on the paper. It is a figure which shows the structure at the time of being made to do.

  That is, similarly to a normal copying machine, it has a document table 668, an illumination 670, a mirror 672, a lens 674, a photosensitive drum 676, and the like, and copies an image on the document onto a sheet.

  In addition to this, the optical copying machine 666 of this embodiment inserts a half prism 678 in front of the lens 674 in the optical path to split the light, and passes it to the image sensor 682 such as a line sensor via the optical component 680. Lead. A signal from the image sensor 682 is amplified by an amplifier 684 and subjected to various analog processes, and then digitally converted by an A / D converter 686 and recorded in a memory 688. The data recorded in the memory 688 is subjected to image area determination and data character recognition in the image area determination and data character recognition circuit 690. Here, for the image area determination, the technique described in Japanese Patent Application No. 5-163635 by the present applicant can be used.

  Data subjected to image area determination, data character recognition, and the like is compressed by a compression circuit 692. In this case, since the compression method differs depending on the type of character, picture, graph, etc., compression corresponding to each is performed, and thereafter, the data composition circuit 694 performs data composition including layout information. The error correction code adding circuit 696 adds an error correction code to the synthesized data, and then the data is stored in the memory 698 and subjected to processing such as interleaving again. The address adding circuit 700 adds an address. Then, modulation is performed by the modulation circuit 702. Thereafter, a marker is added by the marker addition circuit 704 and the dot pattern shape conversion circuit 706 converts the dot pattern shape. Then, according to the dot pattern, the light emitting element driver 708 causes the light emitting element 710 to emit light and raises the mirror shutter 712 to guide the light from the light emitting element 710 to the lens 674 and the photosensitive drum 676.

  Further, as described above, when the data is output to a FAX or the like, the FAX resolution selection unit 714 selects the FAX resolution, and the dot pattern shape conversion circuit 706 changes the dot code pattern shape accordingly.

  Further, the image area determination and data character recognition circuit 690 may treat the character as a binary image and perform general binary image compression processing such as MR or MH, or the character. After recognizing it and converting it into a code used in an ordinary word processor such as an ASCII code, compression may be performed using a compression method such as dibrempel. When character code is recognized and ASCII code conversion is performed in this way, and compression is further applied to the character code, the compression rate is considerably increased and a large amount of data can be recorded with a small number of dot codes.

  In the dot code printing, due to the processing speed of the signal processing system, after the original image is once written on the photosensitive drum 676 and exposed to light, the mirror shutter 712 is set up and the light emitting element 710 rewrites the drum image again. And so on. Alternatively, a dot code may be generated in the first original scan in the form of pre-scan, and the original image and dot code may be written on the photosensitive drum 676 in the second original scan. In the future, if the processing speed of the signal processing system is improved, the processing divided into a plurality of times may not be necessary. However, when a document is placed horizontally on the document table 668 or placed upside down, in order to obtain a copy result in which a dot code is printed on the lower part of the sheet printed in the vertical direction as indicated by reference numeral 656. Still needs to be divided into multiple processes.

  FIG. 59 shows a configuration when applied to a digital copying machine 716. In the figure, components having the same functions as those in FIG. 58 are denoted by the same reference numerals as in FIG. In addition, in the input portion, it is described every time the optical mirror is moved, but the line sensor may be moved to read the original.

  That is, in the digital copying machine 716, the dot code whose shape has been changed by the dot pattern shape conversion circuit 706 as described above and the original image data captured in the memory 688 are synthesized by the editing synthesis circuit 718. Printing is output by the printer 720. Such a digital copying machine has the memory 688 without performing the processing divided into a plurality of times as described above, and can therefore print the dot code at any position on the paper in one scan. .

  Next, the flow of broken lines in the figure will be described. This is the opposite of reading the original image and dropping it into a dot code as described above, and reading only the dot code from the original on which the dot code has been printed together with the text or picture, and playing it from the dot code. It is a flow of contents such as printing out a document in the form of a combined text, picture and dot code.

  That is, similarly, the dot code is read from the document by the image sensor 682, A / D converted, and recorded in the memory 688. Further, the output of the A / D converter 686 is also input to the dot code player 722. The dot code regenerator 722 includes, for example, a circuit configuration after the scan conversion unit 186 in FIG. 15, and can reproduce text, pictures, and graphs from the dot code. The dot code image stored in the memory 688 is given to the dot pattern shape conversion circuit 706 in the state of the dot code, and after being changed in size, is input to the edit synthesis circuit 718. The editing / synthesizing circuit 718 adds the dot code from the dot pattern shape conversion circuit 706 to the text, picture, graph, etc. reproduced by the dot code player 722, and inputs it to the printer 720 for printing.

  In this way, the time required to scan the document is only the time required to read the dot code portion, so that the time can be shortened. Furthermore, there is an effect that when a sentence, a picture, a graph, or the like is enlarged or reduced, the dot code size can be printed without change.

  Next, FIG. 60 shows an example in which the pen-type information reproducing apparatus is also used as an input unit for character and picture data.

  That is, a signal from the image processing unit 460 of the pen type information reproducing apparatus is input to the multimedia information recording apparatus 724. In the multimedia information recording device 724, the input, that is, the imaged data is input to the frame memory 728A or 728B via the selector 726. In this case, the selector 726 selects such that first screen is taken into the frame memory 728A and then the next one screen is taken into the frame memory 728B. The image data taken into the frame memories 728A and 728B are subjected to lens distortion such as peripheral aberrations by distortion correction circuits 730A and 730B, respectively, and then input to the deviation amount detector 732. The deviation amount detector 732 correlates both images so that when the image captured in the frame memory 728A and the image captured in the frame memory 728B are combined at a later stage, the overlapping portion of both images overlap as a picture. And how much it is displaced in which direction. As this deviation amount detector 732, for example, those described in Japanese Patent Application Nos. 5-63978 and 5-42402 by the present applicant can be used. Then, according to the detected shift amount, one image, for example, an image taken into the frame memory 728B is interpolated by the interpolation calculation circuit 734, and is enhanced by the enhancer 736, and then the other image is synthesized by the image composition circuit 738. The image is combined with the image fetched into the frame memory 728A, and the result is stored in the image synthesis memory 740.

  Then, the next one screen is taken into the frame memory 728A, the same processing as described above is performed, and this time, the image taken into the frame memory 728A is interpolated.

  Thereafter, by repeating this alternately, the screen can be enlarged.

  That is, the pen-type information reproducing apparatus is originally for reading a fine code such as a dot code, and therefore the imaging area is very small. Thus, in order to use a small imaging area as a scanner for capturing a character or picture image, it is necessary to capture the image in multiple times and paste them together. Therefore, in the present embodiment, a plurality of frame memories are provided, the amount of deviation is detected, the deviation is corrected, and the images are pasted together.

  The data recorded in the composite image memory 740 is subjected to image area determination or the like by the image area determination circuit 742. If it is a character, the character recognition circuit 744 performs character recognition. Is input to the multimedia information recording processing unit 598 as described above. Then, the multimedia information recording processing unit 598 performs processing such as compression to convert it into a dot code, and guides it to the reel seal printer 572 as described above. Alternatively, instead of inputting to the multimedia information recording processing unit 598, it is also possible to input to an external device 532 such as a personal computer or a word processor via the I / F 746.

  For the pen-type information reproducing device, the output terminal may be provided with an earphone terminal and two terminals for outputting an image, or a system for manually outputting sound through one connector. It is also possible to adopt a configuration in which the system is switched to a system for outputting images.

  FIG. 61 is a modification of FIG. FIG. 60 describes the case where the area of the imaging unit 204 when reading the dot code is the same as the imaging area when used as a scanner. In the case of this embodiment, a wide angle is used when used as a scanner. Thus, the imaging optical system 200 is changed so as to perform macroscopic imaging when reading the dot code.

  That is, the imaging optical system 200 is configured by a zoom or bifocal lens group used in a normal camera, and the lens barrel 748 is slid to switch between wide angle and macro. A scanner switch 750 is provided so that the contact is closed and turned on when the lens barrel 748 is contracted. When the scanner switch 750 is turned on, the data processing unit 462 and the data output unit 464 operate as a scanner. When it is stopped, the control unit 212 is caused to perform processing such as operating them in order to perform macro-like operations.

  When the imaging optical system 200 is set to the wide-angle side, the imaging area becomes large, assuming that the focal depth at that time is ± 120 μm and the imaging magnification is 0.08, the depth of field is ± 19 mm. Even if there is vertical camera shake, there is no problem if there is such a depth.

  In addition to sliding the lens barrel 748 to change the wide angle and the macro, the lens itself is replaced, that is, the macro lens is mounted with a wide angle lens, It can be implemented similarly.

  FIG. 62 is a diagram for outputting information corresponding to the dot code to an external device 532 such as a personal computer or a word processor when the dot code is read into the card type adapter 524 by the pen type information reproducing apparatus as shown in FIG. And a data processing unit for combining images and generating dot codes when the pen-type information reproducing apparatus as shown in FIG. 60 is used as a scanner for texts and pictures. The example which incorporated the data processing part of is shown. In other words, the card type adapter 524 that includes two data processing units for the scanner and data processing unit for reading the dot code is shown.

  In FIG. 61, selectors 752 and 754 switch between a scanner data processing unit and a dot code reading data processing unit, and the switching selection may be performed manually. It may be interlocked with the on / off state of the scanner switch 750 as shown in FIG. 5 or may be driven directly from the external device 532 side.

  The image composition processing circuit 756 includes a selector 726, frame memories 728A and 728B, distortion correction circuits 730A and 730B, a deviation amount detector 732, an interpolation operation circuit 734, an enhancer 736, and an image composition circuit 738 as shown in FIG. The output processing circuit 758 is for adjusting the data to be output to the format of the external device 532.

  Next, an embodiment in which the read dot code information is output to the electronic projector will be described. That is, as shown in FIGS. 63A and 63B, the dot code is scanned by the pen-type information reproducing device 760, the original information is restored by the output processing unit 762, and the RGB input terminal or electronic unit of the projector 764 is restored. This is input to the video input terminal of the OHP 766 and projected onto the screen 768.

  In this case, the pen-type information reproducing device 760 has a built-in configuration from the detecting unit 184 to the data error correcting unit 194 in the configuration of the reproducing system shown in FIG. 15 or FIG. The processing unit 762 includes a configuration after the data separation unit 196 and other processing circuits.

  The actual configuration of the output processing unit 762 is as shown in FIG. That is, the multimedia information from the pen-type information playback device 760 is separated into image, graph, character, voice, and header information by the separation unit 196, and the image, graph, and character are decompressed by the decompression processing units 238, 242, and 248. After that, the image and the graph are subjected to interpolation processing by the data interpolation circuits 240 and 244, and the character is subjected to PDL processing by the PDL processing unit 246. The interpolated or PDL processed image, graph, and character are combined by the combining circuit 250 and stored in the memory 770. The data stored in the memory 770 is data that can be projected on the screen 768, and is thus D / A converted by the D / A converter 252 and output to the projector 764 and the electronic OHP 766. In this case, the memory 770 is controlled by the address control unit 772. On the other hand, the voice is decompressed as it is by the decompression processing unit 256, interpolated by the data interpolation circuit 258, then D / A converted by the D / A conversion unit 266, and incorporated in the projector 764 and the electronic OHP 766 via the selector 774. Or output to an external speaker 776.

  Further, the speech synthesis code data is converted into speech by the speech synthesizer 260 and input to the D / A converter 266.

  Also, for example, in the case where a sentence is read as it is during a presentation, it is recognized as a sentence by a sentence recognition unit 271 from a display character code, converted into a voice by a speech synthesis unit 260, Finally, sound is output from the speaker 776.

  In this case, since there is no need to record a separate speech synthesis code for reading, more information can be put in the dot code accordingly.

  Also, in this case, a projector selection means 778 is provided so that the connection can be made with any electronic projector system. For example, the projector 764 is compatible with high vision or only with NTSC. You can choose such things. In other words, processing such as the size of characters allocated on the memory 770 varies depending on the electronic projector system as an output system. Therefore, the processing in the data interpolation circuits 240 and 244 and the PDL processing unit 246 is changed or the clock supplied to the address control unit 772 and the D / A conversion unit 252 according to the selection by the projector selection unit 778. The signal CK is changed by the reference clock selection unit 780.

  Also, in the usage status of electronic projectors such as the projector 764 and the electronic OHP 766, for example, as shown in the figure, it is desired to project only texts in a manuscript including text, pictures, graphs, etc. In some cases, it is desired to perform selective projection such as projecting only a graph. In such a case, the output control unit 782 can select the user, or the dot code can be projected by sentence, only a picture can be projected, or only a graph can be projected. This information is written as header information, and the output control unit 782 can select a portion to be output according to the header information. Then, according to the selection by the output control unit 782, the output editor unit 784 performs a separation operation of which part is projected, and causes the address control unit 772 to access that part of the memory 770 and output the data for projection. Let In addition to the area division process, the output editor unit 784 projects an electronic zoom, that is, first projects the entire document, and then enlarges only a part of the text or a picture. It is also possible to perform an editing process in such a manner that only a part of a sentence or a part of a picture is focused and enlarged at that time. When performing such processing, the output processing unit 762 is provided with an input unit and a display unit, and is configured to perform processing such as a graphical user interface so as to actually specify an enlarged portion. preferable.

  In addition, the voice is input not only as a dot code and output from the D / A conversion unit 266 but also from the external microphone 786 so that the selector 774 can select the voice.

  It should be noted that the pen type information reproducing apparatus 760 may include only the detection unit 184, and the subsequent processing from the scan conversion unit 186 may be included in the output processing unit 762. 760 may be configured such that the separated data is sent to the output processing unit 762 in some form. Actually, it is preferable to make the pen-type information reproducing device 760 as small as possible considering that it is held by hand, so that only the detection unit 184 is provided and the subsequent processing is performed by the output processing unit 762. Is preferred.

  FIG. 65 (A) shows a case where output is made to a copying machine 788, a magneto-optical disk unit (MO) 790, and a printer 792 instead of the electronic projector. It shows a situation in which the output of the output processor is supplied to the copier 788, the MO 790, and the printer 792 online or offline by a floppy 796 or the like. Further, (B) of the figure shows a case where the output processing unit is configured as a card type adapter 800 that is attached to the printer 792 or the electronic notebook 798.

  The actual configuration of the output processing unit 762 in this case is as shown in FIG.

  As in the previous embodiment of the projector, multimedia information is input, images, graphs, and characters are separated by the separation unit 196 and decompressed by the decompression processing units 238, 242, and 248, respectively. The graph is interpolated by the data interpolation circuits 240 and 244, and the character is subjected to PDL processing by the PDL processing unit 246, synthesized by the synthesis circuit 250, and stored in the memory 770. The memory 770 is controlled by the address control unit 772, and the read data is output to the edit monitor 804 to confirm the data actually output via the interpolation unit 802 and the D / A conversion unit 252. Note that the editing monitor 804 may be omitted.

  Data read from the memory 770 is also input to the combining unit 806. The synthesizing unit 806 converts the multimedia information from the pen-type information reproducing device 760 into a dot code again at the encoding unit 808, and outputs it at the output adaptive interpolation unit 810 according to the resolution of the printer 792 to be output. Interpolation is performed and the data from the memory 770 is synthesized. That is, a dot code is added to a sentence or a picture and output to a printer 792 or a copier 788 via an I / F 812.

  The output selection means 814 automatically enters the resolution setting when the printer 792 is connected to the output unit 762 and the printer 792 is connected to the output unit 762, and is offline with the floppy 796 or the like. Since it is not possible to know the model if it is sent in the case of, it is assumed that it is switched manually in such a case.

  In such a configuration, the text or the like is copied or printed as it is, and the dot code can be output in accordance with the resolution of the output medium.

  Further, when connecting to the electronic notebook 798, no dot code is input, so that a system for recording the dot code becomes unnecessary. The configuration is almost the same as in FIG.

  FIG. 67 shows an embodiment in which a format conversion unit 816 is provided to correct the format for each model in order to cope with the fact that the data format of the word processor is currently different for each model. The format conversion unit 816 has a word processor select switch as the model selection unit 818, reads the dot code with the pen type information reproducing device 760, converts the data based on the selection, and inputs the data to the word processor 820.

  The format conversion unit 816 is actually configured as shown in FIG. That is, after processing by the data interpolation circuits 240, 244, 258, the PDL processing unit 246, and the speech synthesis unit 260, the respective data is converted by the corresponding format conversion circuits 822, 824, 826, 828 in the model selection means 818. The format is converted in accordance with the selection.

  FIG. 69 is a system diagram in the case where a sheet on which a dot code is recorded (hereinafter referred to as multimedia paper) is transmitted / received by FAX. In this case, the dot code generated by the FAX multimedia information recorder 830 is printed out by the printer 792 and transmitted from the transmission side FAX 832 to the reception side FAX 834 through the telephone line 836. The receiving FAX 834 receives this, returns it to paper information, and reproduces the dot code using the pen-type information reproducing device 838.

  As shown in FIG. 70, the FAX multimedia information recorder 830 includes a multimedia information recorder 840, a dot pattern shape conversion circuit 842, FAX selection means 844, and a composite editing circuit 846. The multimedia information recorder 840 includes the configuration up to the marker adding unit 162 in the configuration of the recording system of FIG. 13, and the composition editing circuit 846 corresponds to the composition and editing processing unit 164. The dot pattern shape conversion circuit 842 and the FAX selection unit 844 correspond to the dot pattern shape conversion circuit 706 and the FAX resolution selection unit 714 in FIGS.

  In this case, when a line is connected from the transmission side FAX 832 to the reception side FAX 834 via the telephone line 836, the status of the incoming call is returned from the reception side FAX 834 to the transmission side FAX 832. Therefore, this data can be selected manually or directly. The unit 844 selects the resolution of the FAX, that is, the resolution, and the dot pattern shape conversion circuit 842 changes the shape itself according to the size of the dot code pattern or the amount that can be written in one line, and the composite editing circuit 846 Is combined with the page information and printed out by the printer 792, thereby printing the multimedia paper to be transmitted by FAX.

  FIG. 71 shows a FAX built-in multimedia information recorder 848 in which all such processes are automated and the FAX transmitter / receiver is provided to the recorder from the beginning.

  In this case, the resolution information of the other party's FAX is directly confirmed at the time when the telephone line 836 is connected, the dot pattern shape is optimized using the information, and the information is combined with the page information and transmitted.

  FIG. 72A shows an overwrite type MMP card for recording / reproducing a card (hereinafter referred to as a multimedia paper (MMP) card) on which a dot code as shown in FIGS. It is a figure which shows the structure of a recording / reproducing apparatus.

  The recording / reproducing apparatus 850 transports the MMP card 852 inserted into a card insertion slit (not shown) to the dot code detection unit 856 by the card transport roller unit 854, and the dot code already written on the back surface of the MMP card 852 is transferred. The data is read and converted to the original multimedia information by the data code reproduction unit 858, and is output to an I / F (not shown) or a data separation unit. That is, the dot code detection unit 856 corresponds to the detection unit 184 in the configuration shown in FIG. 15 or FIG. 20D, and the data code reproduction unit 858 also changes from the scan conversion unit 186 to the data error correction unit. It has a circuit configuration up to 194. However, the dot code detection unit 856 is provided with imaging units on both sides of the card, and the one for the back side of the card is used as the imaging unit 204 of the detection unit 184. Here, the MMP card 852 has a dot code recording area 852A on the back side of the card as shown in FIG. 72B, and a title, name, picture, etc. on the front side as shown in FIG. It is assumed that the image is recorded.

  The recording / reproducing apparatus 850 is supplied with information other than information already written on the card via an I / F 860 from an external personal computer or storage device, and information to be written on the back side of the card as a dot code is For example, when new information that does not exist in the conventional data is input from the I / F 860, it is combined with the information supplied to the data composition editing unit 862 and reproduced by the data code reproduction unit 862. When a new address is added or a partial change is made, the data is combined and edited by replacing only the part that is partially changed. The information thus combined and edited is input to the code pattern generation unit 864 and converted into a dot code. The code pattern generation unit 864 has a configuration as shown in FIG. 13, and combines and edits the generated dot code and data to be printed in addition to the code from the I / F 860 and prints it on the printing unit 866. Pass the data that should be. The printing unit 866 is also supplied with the pattern data on the surface of the MMP card 852 from the dot code detection unit 856, and prints on both the front and back sides of the unprinted card fed from the paper feed cartridge 868 to create a new one. The MMP card is conveyed to a card discharge slot (not shown) by the card conveying roller unit 870 and discharged. Note that double-sided printing in the printing unit 866 may be a format in which the card is reversed and printed on the other side after printing on one side of the card, or may be printed on both sides at the same time. .

  On the other hand, after passing through the dot code detection unit 856, the old card is applied with, for example, black ink by the subsequent application roller 872, and the code recording area 852A is painted black. Discharged. As a result, the user can return the filled original card, so that there is no fear that the old card will be abused.

  As described above, according to the overwrite type MMP card recording / reproducing apparatus 850 of the present embodiment, when a card that has already been recorded to some extent is inserted into the recording / reproducing apparatus 850, the information is read, and a new one is added. The new card is issued in combination with the information to be added to the card. From the user's point of view, it looks as if the card has come out with data added to the old card. Since the old card still remains, the old card is returned to the user. Therefore, in the form of card replacement, it looks as if it was overwritten.

  FIG. 73 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing apparatus. The recording / reproducing apparatus 874 is basically the same as the recording / reproducing apparatus 850 in FIG. 72A, but is an apparatus for an application in which it is not necessary to return an old card to the user. Therefore, the recording / reproducing apparatus 874 is provided with a shredder 876 for cutting an old card in the subsequent stage of the dot code detection unit 856.

  FIG. 74A is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus. In the case of this recording / reproducing apparatus 878, the structure of the MMP card is different from that of the MMP card 852. That is, the previous MMP card 852 was printed directly on the card base itself, but the MMP card 880 of this embodiment is made of cardboard, plastic or the like as shown in FIG. The card base 882 is configured with a very thin code pattern recording thin paper (film) 884 on which a dot code is recorded. That is, a thin film-like sheet printed as shown in (C) of FIG.

  In such a recording / reproducing apparatus 878 using the MMP card 880, the data read by the dot code detection unit 856 is combined with data coming from a personal computer or the like in the same manner as before, and enters the printing unit 866 as a code pattern. . At this time, the printing unit 866 does not print on the back side of the card, but prints on the code pattern recording paper 888 from the paper supply cartridge 886 and newly attaches it to the card base 882. In this case, the code pattern recording paper 888 is not on the printing surface 890 side where the code pattern recording thin paper 884 is actually printed, as shown in FIG. An adhesive surface 892 is provided, and a protective paper 894 for the adhesive surface 892 is provided thereon. Then, after printing, the adhesive surface protective paper 894 is peeled off by the adhesive surface protective paper peeling bar 896 and wound on the used adhesive surface protective paper take-up reel 898. The adhesive surface 892 of the code pattern recording thin paper 884 from which the adhesive surface protective paper 894 has been peeled is exposed, and is pressed against the card base 882 by the card conveyance and code pattern recording thin paper pressing roller unit 900 and pasted to form a recorded card. to go out.

  In this case, since the code pattern recording thin paper 884 is a very thin film, the code pattern recording thin paper 884 may be stacked on the card base 882. Therefore, the old code pattern recording thin paper is peeled off by providing an old code pattern recording thin paper peeling unit 902 in the middle of the card transport path from the dot code detection unit 856 to the pressure contact roller unit 900. The peeled old code pattern recording thin paper may be discharged as it is or may be shredded.

  Note that the additional information adding unit 904 in FIG. 6A displays, for example, information indicating the time relationship of when the recording / reproducing device 878 recorded on the original card or the recording / reproducing device 878 as a service center. This is for adding information such as which terminal is used when the terminal is connected to. As a result, it can be seen which recording / reproducing device 878 is used and how many blanks are placed for recording.

  FIG. 75 is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus. The recording / reproducing apparatus 906 is basically the same as the recording / reproducing apparatus 850 in FIG. 72A, and instead of blacking, the recording / reproducing apparatus 906 is painted in white and made a new printing surface again. is there. Therefore, the white ink cartridge 908 and the white ink applying roller 910 are arranged downstream of the dot code detection unit 856.

  As a result, the back side of the MMP card once becomes white, and printing is newly performed by the printing unit 866 there. Since a new card may be issued, the paper supply cartridge 868 is provided, but this is not necessary.

  Next, a write-once type MMP card recording / reproducing apparatus will be described. In the write-once type, old information is left as it is, and only new information is added to an unrecorded area as long as there is still an unrecorded area. In this case, it is not necessary to perform all dot code reproduction processing as in the above-described overwrite type device, except when the card data reproduction is intended, that is, at the time of recording.

  FIG. 76A shows a configuration of a write-once type MMP card recording / reproducing apparatus 912. At the time of recording, the data code reproducing unit 858 reproduces only the marker information and address information of the two-dimensional block, and the code pattern generating unit 864 generates a block address of the additional recording part to generate an additional recording dot code pattern. The recorded area detection unit 914 detects a recorded area of the card. The printing unit 866 prints the pattern from the code pattern generation unit 864 on an unrecorded area (addable area) of the card based on information from the recorded area detection unit 914.

  The recorded area detection unit 914 includes a recording area detection unit 916, a marker detection unit 918, a last marker coordinate calculation unit 920, and an additional recording start coordinate output unit 922, as shown in FIG. . That is, since the sizes of the marker and the block are known, the recording area detection unit 916 and the marker detection unit 918 can detect how much the code recording area has been automatically written. Therefore, the last marker coordinate calculation unit 920 calculates the coordinates of the start of additional writing, and outputs them from the additional writing start coordinate output unit 922.

  Further, the recorded area detection unit 914 may be configured as shown in FIG. However, in this case, as shown in FIG. 5B, it is necessary to record a recorded mark 924 indicating how far it has been recorded in the card margin.

  In the recorded area detection unit 914, the recorded mark detection unit 926 detects this recorded mark, calculates how far the last recorded mark coordinate calculation unit 928 has written, Is output from the additional write start coordinate output unit 922. That is, even if it does not go to see the fine dot code marker, it is easy to detect by detecting a larger recorded mark 924.

  The recorded mark 924 can also be used for alignment in the printing unit 866. That is, in the previous example, the dot code must be read again in the alignment in the printing unit 866. However, when the recorded mark 924 is used, the processing is performed only by the mark 924. it can. That is, by detecting the recorded mark 924, recording may be performed with a distance of, for example, about 1 mm between the recorded area and the additional recording portion, or about 1 mm in the vertical direction in the direction shown in FIG. Since it does not matter if it is shifted, it can be added very easily. However, depending on the content of additional writing, if the block address of the recorded block is read, the block address next to the final block address is added, so that the block address of the additional writing portion has continuity as one code. Can be made.

  FIG. 78A shows a business card card reading system as one application example using the above-described overwrite type or write-once type MMP card. In this system, an MMP business card card 930 in which multimedia information is written in dot code is read by an MMP business card card reader 932, an image is displayed on a CRT 936 of a personal computer or the like 934, and sound is generated from a speaker 938. The MMP business card card reader 932 is not different from the information reproducing apparatus described so far, particularly in configuration, and merely reads a business card card, so that it is configured as a stationary type rather than a pen type. Of course, as described above, the information may be provided in the form of a pen-type information reproducing device and a card-type adapter, and displayed or reproduced in an electronic notebook or the like.

  The MMP business card card 930 has a dot code printed on the back side of the card with the company name, affiliation, name, address, and telephone number on the front side, like the above-described overwrite or write-once MMP card. In the case of a business card with English text on the back side, as shown in (B) of the figure, the dot code is stealth-printed using infrared luminescent ink or fluorescent ink as described above. 940 may be used.

  Next, the MMP card formed by the semiconductor wafer etching method will be described. In this case, a very fine dot pattern is recorded on a semiconductor wafer by using a semiconductor etching technique. The mirror-finished wafer surface and the etched pattern portion have different light reflectivities, and the dot code can be read with the contrast. Here, in order to further improve the contrast and improve the S / N, it is possible to embed aluminum or other members having greatly different reflectances and colors in the etched dot code pattern.

  79 (A) and 79 (B) and FIGS. 80 (A) to (C) are diagrams showing the configuration, and a wafer portion 942 on which a dot code pattern is recorded is embedded in the base 946 of the card body 944. It is. In this case, since the dot code pattern is recorded with a dot size of several μm or a sub-μm level, very high density recording can be performed. Thereby, for example, a ROM card in units of gigabytes can be made.

  Further, unlike the ROM-IC, it is not necessary to operate normally electrically, so even if a part of the pattern is defective, it can be corrected by the error correction process in the playback device, so that the yield is much higher than that of the ROM-IC. In addition, since there are far fewer processes than IC, there is an advantage that it can be supplied at a very low cost.

  However, since the pitch is very fine, attention should be paid to slight dirt and dirt such as fingerprints. In order to protect it, for example, as shown in FIGS. 79A and 79B, a plurality of sliding protective covers 948 are attached to the surface of the wafer portion 942 of the card 944, or ( One protective shutter 950 as shown in A) to (C) is attached.

  In this case, the protective cover 948 is composed of, for example, four sheets, and it is possible to select several types of opening methods, such as opening only necessary portions or opening the lid, and all of them can be placed on one side when the card is inserted. It may be opened.

  On the other hand, in the case of the protective shutter 950, it is configured such that it is fully opened when the card is inserted and is closed at the same time as the card is removed. For example, as shown in FIGS. 80B and 80C, a wafer portion 942 is dropped into a card base 946, and grooves 952 are cut into the card base 946 on both sides, respectively. A protective shutter 950 is inserted so as to sandwich the area. A stopper 956 is provided at the tip of the claw portion 954 on the side of the protective shutter 950, and the card base 946 to be received is stopped when the stopper 956 reaches a predetermined position so that the protective shutter 950 does not open beyond the predetermined position. Therefore, the depth of the groove 952 is shallow.

  When the dot code is reproduced from the MMP card formed by such a semiconductor wafer etching method, the pen type information reproducing apparatus as described above may be used. However, at that time, the imaging optical system needs to be of a microscope level. is there. Alternatively, it may be configured such that it is mechanically moved in the form of a line sensor.

  81A shows a new dot code playback function and record function in a disk device 958 with a dot code decoding function, that is, a known disk device for recording and reproducing audio information such as music on a magneto-optical disk. Is attached. For example, the dot code on the sheet 960 as shown in FIG. 5B is scanned by the operation unit 962 to reproduce the code and output it to the information device 964 such as a personal computer or an electronic notebook or the earphone 966. To do.

  As shown in FIG. 82, the disk device 958 includes a known configuration such as a spindle motor 968, an optical pickup 970, a feed motor 972, a head drive circuit 974, an address decoder 976, an RF amplifier 978, a servo control circuit 980, an EFM (Eight). to Fourteen Modulation), ACIRC (Advanced Cross Interleave Read Solomon Code) circuit 982, earthquake-resistant memory controller 984, memory 986, display unit 988, key operation panel 990, system controller 992, compression / decompression processing unit 994, A / D converter 996 , An audio input terminal 998, a D / A converter 1000, and an audio output terminal 1002.

  Here, the EFM and ACIRC circuit 982 is a part that performs encoding and decoding at the time of writing and reading of the disk. The earthquake-resistant memory controller 984 is for interpolating data using the memory 986 to prevent sound skipping due to vibration. The compression / decompression processing unit 994 performs compression / decompression processing using an audio high-efficiency encoding method called ATRAC (Adaptive Transform Acoustic Coding), which is a type of transform encoding method that converts from the time axis to the frequency axis for encoding. Do.

  The disk device 958 with the dot code decoding function receives such an image signal from the operation unit 962 and performs processing such as the image processing unit 460 in FIG. A connection terminal 1006 between the image processing unit 1004 and the information device 964 and its I / F 1008 are provided, and the compression / decompression processing unit 994 is composed of an ASIC-DSP or the like. In addition, functions of the data processing unit 462 such as demodulation and error correction for data, processing for compressing / decompressing data for other information devices 1008, and the like are also included.

  Note that the operation unit 962 includes, for example, the imaging optical system 200, the imaging unit 204, the optical system 1010 corresponding to the preamplifier 206, the imaging element 1012 and the amplifier 1014 in FIG.

  In an information reproducing apparatus that reproduces a dot code, reproduction of high-capacity information such as music usually requires a large-capacity memory. A memory having a capacity can be eliminated. In addition, the sound reproduction part, here, the sound compression / decompression processing unit 994, the D / A converter 1000, etc. can be used in common, and the sound compression / decompression unit 994 is shared with the data processing part of the code reproduction process. By designing with an ASIC-DSP, low cost and downsizing can be achieved.

  The disk device 958 with a dot code decoding function having such a configuration can use functions such as sound recording and reproduction as a normal disk device, and music selection, and can also be used as a dot code reproducing device. This switching is controlled by the system controller 992 by operating the key operation panel 990.

  When used as a dot code reproducing device, for example, the following usage is assumed. That is, as shown in FIG. 81B, the A4 sheet 960 is written with a music selection index consisting of a music title and a singer name, and a dot code corresponding to the music is recorded. In this case, since the music is information on the order of 3 minutes or 4 minutes, for example, it becomes considerably long. Therefore, the dot code is divided and recorded in a plurality of stages, in FIG. That is, each piece of music is divided into a plurality of stages of dot codes, and the block address is, for example, a block whose X address is 1 and Y address is 1 as described above in each stage's dot code. Are recorded on the sheet with addresses indicating the divided positions in the music. At the time of reproduction, all the dot codes of the plurality of stages are scanned and recorded on the disk 1016.

  At that time, even if the scanning order is performed randomly, the music can be written in consideration of the recording position of the disk 1016 by the address indicating the position in the music, that is, the music is recorded in the correct order. For example, as shown in the figure, when one piece of music is divided into four stages of dot codes, even if the dot code of the second stage is scanned with the operation unit 962 first, what number, that is, the second dot Since it is known from the address whether it is a code or not, when the audio information reproduced from the dot code is recorded on the disk 1016, the recording part of the first dot code is opened and recorded so that it is reproduced in the correct order at the time of reproduction. can do.

  In addition, for example, when a user makes an original disc such as recording music A and music C and then recording music D, another audio player such as a tape deck or a CD player may be used. You can do it without it. For example, when the user views the dot codes of a plurality of pieces of music recorded on the sheet 960 and scans the dot codes in the order of reproduction at the time of reproduction, for example, the pieces of music A, C, D,. Can be recorded in this order, and if they are played normally, they will be played in that order. That is, programming is possible.

  Note that an image output device can be used as the information device 964. For example, using FMD, the compression / decompression processing unit 994 performs JPEG, MPEG, and 3D image decompression processing as described in Japanese Patent Application No. Hei 4-81673, for example, and converts to a video signal using the I / F 1008 By doing so, a three-dimensional image corresponding to the read dot code can be displayed. Thus, this embodiment is not limited to audio information.

  Similarly, it is of course applicable to other digital recording / reproducing apparatuses such as DAT.

  Next, an example in which the dot code recording function is incorporated into a silver salt camera will be described.

  83A and 83B are diagrams showing the configuration of the back cover 1018 of the multimedia information dot code recording compatible camera. This is a configuration in which date information such as date is recorded using a LED array 1020 in the form of a conventional data back, and a two-dimensional LED array 1022 for recording a dot code is arranged next to it. It has become. On the back side of the data back, there is a circuit built-in unit 1024, which contains, for example, a circuit for lighting control of the LED array 1020, and further incorporates a circuit system for recording multimedia information dot codes, As a dot code, the image is copied onto a silver salt film (not shown) by the LED array 1022. For example, a tie-pin type microphone 1026 is connected to the circuit built-in unit 1024, and voice is picked up from the microphone 1026, and the information is exposed on the film in the form of dot codes by the dot code recording two-dimensional LED array 1022.

  Since the data back 1018 is controlled using the CPU of the camera body in addition to the LED arrays 1020 and 1022, an electrical contact 1028 with the body camera body side is prepared. Further, the claw portion 1032 of the hinge portion 1030 is slidable and can be detached from the camera body using the claw portion slide lever portion 1034. That is, the data back 1018 can be attached in place of the original back cover of the camera.

  This embodiment is an example in which a dot code is recorded all at once with a two-dimensional LED array 1022. On the other hand, FIG. 84A shows a case where the dot code recording LED unit 1036 is moved to record the dot code two-dimensionally. The LED unit 1036 includes a line-shaped LED array 1038 and a lens 1040 for converging light, ie, reducing the light therefrom, as shown in FIG. Electric signal electrodes 1042 for receiving control signals for the LED array 1038 extend on both sides thereof, and the signal electrodes 1042 are moved as shown in FIG. It is configured such that it always comes into contact with the signal electrode plate 1044 on the data back 1018 side so as to slide and the data signal enters from there. The film pressing plate 1046 of the data back 1018 is provided with a scanning window 1048 made of transparent glass, acrylic, or the like, from which only the LED unit 1036 is configured to face a film (not shown).

  When using a two-dimensional LED array, it is only necessary to electrically flash each necessary part without physically moving it, but when using such a one-dimensional LED array 1038, The LED unit 1036 must be moved. As the moving mechanism, for example, the one shown in FIG. That is, this is basically the same structure as a well-known tuner needle moving mechanism. When the pulley 1052 is rotated by the motor 1050, the wire wire 1054 wound around the pulley 1052 is associated therewith. The LED unit 1036 having both ends fixed moves left and right. The wire line 1054 has no expansion / contraction, and thus the LED unit 1036 can be moved with high accuracy. Further, the pulley 1052 and the wire 1054 are configured on both sides with respect to the LED unit 1036 so as to accurately translate.

  Further, as the moving mechanism of the LED unit 1036, an ultrasonic motor 1056 can be used as shown in FIG. The ultrasonic motor 1056 applies vibrations to the vibration plate 1058 that transmits ultrasonic waves as if the waves are moving in the right and left directions while shifting the phase well. The moving body 1060 moves to the right or to the left in the form of a shape. As the moving body 1060 moves, the LED unit 1036 connected to the moving body 1060 also moves to the right or moves to the left. Move to.

  FIG. 85 is a diagram showing a circuit configuration of the data back 1018 shown in FIGS. 83A and 84A. In particular, a portion surrounded by a broken line is the configuration of the data back 1018. FIG.

  A CPU (for example, a one-chip microcomputer) 1062 provided in the camera body controls the entire camera. The exposure control unit 1064 performs exposure control based on the photometric data from the photometric unit 1066. The shutter control unit 1068 and the aperture control unit 1070 control the shutter speed and / or the aperture according to the purpose, or Control is performed according to the mode, and control is performed so as to obtain an optimal exposure as appropriate.

  Further, the CPU 1062 calculates the lens control amount using lens information held on the lens side or the main body side, and causes the lens control unit 1074 to perform necessary lens control. This includes focus control and zoom control. Further, the CPU 1062 performs a shutter operation in response to operations of the focus lock button 1076 and the release button 1078 (usually, it is mechanically used as one button and comes out independently). Control. Further, the CPU 1062 controls the motor 1082 for winding the film by the motor control unit 1080.

  Further, the CPU 1062 exchanges data with the multimedia information recording / reproducing unit 1084, the multimedia information LED controller 1086, and the date LED controller 1088 in the data back 1018 via the electrical contact 1028 with the camera body side. It can be done. The date LED controller 1088 controls the date LED array 1020 to emit light and imprints the shooting date and time on the film. The data back 1018 has a date for generating a time pattern for it. A clock generator 1090 is built in.

  The multimedia information recording / reproducing unit 1084 has a configuration related to the recording system, for example, from the voice input in the configuration of FIG. 13 to immediately before the code synthesis editing, that is, the portion for generating the pattern constituting the dot code. The reproduction system has, for example, a configuration from the scan conversion unit 186 to the D / A conversion unit 266 in FIG. The multimedia information LED controller 1086 controls the light emission of the LDE array 1022 or 1038 in accordance with the dot code pattern output from the multimedia information recording / reproducing unit 1084. In this case, in the example of FIG. 83A, since it is the two-dimensional LED array 1022, the dot code pattern is exposed only with this configuration. On the other hand, in the example of FIG. 84A, since it is necessary to move the one-dimensional LED array 1038 further, the motor 1050 is driven by the LED array moving motor controller 1092 to move the LED unit 1036. Let The multimedia information LED controller 1086 provides the LED array 1038 with code information to be recorded, which is necessary at that position, and emits light at any time while matching the timing of the movement by the motor 1050.

  Various camera mode setting keys 1094 are provided on the camera body side. This may consist of several buttons, or may be divided into a mode switching button and a setting button. Further, this may be provided on the data back side, and in this case, a key operation signal is supplied to the CPU 1062 via an electrical contact.

  In the above configuration, the dot code is exposed to the film as follows, for example. In other words, when an operation signal of the focus lock 1076 button that becomes one index for starting shooting becomes active, the CPU 1062 captures audio from the microphone 1026 into the multimedia information recording / reproducing unit 1084, and records / records multimedia information. A predetermined amount of time is sequentially stored in a storage unit (not shown) inside the playback unit 1084. For example, the predetermined time is determined in the form of 5 seconds or 10 seconds, and the maximum capacity of a memory (not shown) is set in accordance with the fixed time, and is sequentially and cyclically stored in the same manner as a general voice recorder. . When the release button 1078 is pressed, the CPU 1062 notifies the multimedia information recording / playback unit 1084 accordingly, for example, several seconds before (for example, five seconds) or before and after (for example, one second after, three seconds before). Second) sound is converted to dot code. This setting can be set by the user using a mode setting key 1094, for example. Then, the audio stored in the multimedia information recording / reproducing unit 1084 is actually encoded and burned onto the film by the LED array 1022 or 1038. After the operation is completed, the CPU 1062 performs a film winding operation. Of course, the LED array moving motor controller 1092 and the film winding motor control unit 1080 can be well synchronized so that the film can be wound at the same time with the moving speed and timing adjusted. In that case, it is possible to cope with high-speed continuous shooting. Further, the LED unit 1036 can be fixed and recording can be performed when the film is wound. At this time, there is an advantage that one motor is reduced.

  In addition to recording audio as dot code information on the film as described above, naturally, information on various cameras provided from the CPU 1062, for example, what kind of lens is used now, or the shutter speed is It is also possible to record information on how much the aperture is at what aperture. In other words, for example, it will be understood later what conditions the photograph was taken with respect to the completed photograph. Normally, such information is stored in the head by the user. However, according to the present embodiment, the dot code on the film that has been printed later or on the photographic paper on which it is printed is used. When the information is reproduced by the multimedia information dot code reproducing apparatus, the information can be selectively displayed, and the conditions of the camera at the time of photographing can be understood. Therefore, for example, the same setting can be easily performed when it is desired to shoot under the same conditions next time. In particular, when taking pictures on a routine basis, for example, taking a change of a specific landscape through the moon or the like, it is very useful.

  FIG. 83C shows an example in which the film on which the dot code is printed as described above is printed. This is an example in which the dot code 1096 and date code 1098 written on the film are used as they are as pictures and printed together with other picture parts 1100. In this case, sound information or various kinds of camera information can be reproduced by scanning the dot code 1096 with the multimedia information dot code reproducing apparatus, for example, a pen-type information reproducing apparatus. If, for example, only this dot code is removed on the DPE side and printed on the back side, only the photograph on the front side can be obtained, and the same photograph as the conventional photograph can be obtained. Furthermore, as one piece of camera information, if DMP trimming information, for example, zooming or panorama switching information is recorded on the film, the DPE scans the dot code on the film, By reading this information, panorama can be printed in the form of a panorama or zoomed.

  When dot codes are printed on a film, double exposure is made with the actual scenery, so there is a risk that the dot codes will not be captured well if the external light is strong at that time. Therefore, for example, in a conventional panorama camera, there is a structure in which a light-shielding plate is inserted at the top and bottom when switching to panorama, and that part is configured so as not to capture a landscape, but the same function may be included. . That is, the light shielding plate is automatically inserted, or when the dot code is supported from the beginning, the light shielding plate may be fitted immediately before the film or after the lens. Furthermore, a code may be recorded in a blank portion (a portion not exposed) of the film.

  In FIG. 85, by connecting the pen-type information reproducing apparatus 1102 to the data back 1018 and reproducing the dot code 1096 of FIG. 83C, camera information, that is, aperture, shutter information, lens information, and the like are obtained. For example, it may be displayed on the back side of the camera back or on the LCD mode display unit 1104 or the in-finder LED display unit 1106 that is originally held on the camera body. Further, by scanning the dot code 1096, the mode may be set to the same condition. In other words, when a dot code 1096 is scanned with a film or a photograph, each condition on the camera side is automatically set to the mode, and the same shutter speed, the same aperture, and the same lens magnification are obtained.

It is a block block diagram of the recording apparatus of the audio information by which the dot code was formed in the 1st Embodiment of this invention. (A) is a figure which shows the recording format of a dot code, (B) is a figure which shows the use condition of the reproducing | regenerating apparatus in 1st Embodiment. It is a block block diagram of the reproducing | regenerating apparatus in 1st Embodiment. (A) and (B) are explanatory diagrams of manual scanning, and (C) and (D) are explanatory diagrams of scanning conversion, respectively. (A) is a figure for demonstrating the data interpolation accompanying scanning conversion, (B) and (C) are figures which show the example of a recording medium, respectively. It is explanatory drawing of data row adjustment. It is a figure which shows the structure of the reproducing | regenerating apparatus in 2nd Embodiment. It is a figure which shows the structure of the reproducing | regenerating apparatus in 3rd Embodiment. (A) And (B) is an external perspective view of a portable voice recorder, respectively. It is a circuit block diagram of a portable voice recorder. (A) And (B) is a figure which shows the example of printing on a recording medium, (C) And (D) is an external appearance perspective view of another example of a portable voice recorder. It is a flowchart of the dot code printing process in the voice recorder of FIG. It is a block block diagram of a multimedia information recording device. It is a conceptual diagram of a dot code. It is a block block diagram of a multimedia information reproducing device. FIG. 16 is a light source light emission timing chart in the multimedia information reproducing apparatus of FIG. 15. FIG. It is a figure which shows the other structural example of a multimedia information reproduction apparatus. (A) is a diagram showing a dot code applied to the playback apparatus of FIG. 3 for explaining a data string adjustment unit in the multimedia information playback apparatus of FIG. 15, and (B) is a dot code of (A). The figure which shows a line-shaped marker, (C) The figure for demonstrating the scanning method, (D) is a figure for demonstrating the scanning pitch of an image pick-up element. It is a figure which shows the actual structure of a data sequence adjustment part. (A) thru | or (C) is a figure which shows the marker which has the dot for arrangement | positioning direction detection, (D) is a figure which shows another structural example of a multimedia information reproducing | regenerating apparatus. (A) is an explanatory diagram of a block address, (B) is a diagram showing a block configuration, (C) is a diagram showing an example of a marker pattern, and (D) is a diagram for explaining a magnification of an imaging system. It is. It is a block block diagram of the marker detection part in a multimedia information reproduction apparatus. It is a process flowchart of the marker determination part in FIG. It is a process flowchart of the marker area detection part in FIG. (A) is a figure which shows a marker area, (B) is a figure which shows the memory | storage format of the table which memorize | stores the detected marker area, (C) and (D) are in (A) of the figure. It is a figure which shows the value which accumulated each pixel. (A) is a process flowchart of the approximate center detection unit in FIG. 22, and (B) is a flowchart of the center of gravity calculation subroutine in (A). It is a block block diagram of an approximate center detection part. (A) is a figure which shows the actual structure of the data block of a dot code, (B) is a figure which shows another structure, (C) is a figure for demonstrating other arrangement | positioning of a data inversion dot. (A) is a figure which shows another example of the actual structure of the data block of a dot code, (B) is a figure for demonstrating adjacent marker selection. It is a block block diagram of the data arrangement direction detection part in a multimedia information reproducing apparatus. It is an operation | movement flowchart of a data arrangement direction detection part. (A) is a flowchart of an adjacent marker selection subroutine in FIG. 31, and (B) and (C) are diagrams for explaining adjacent marker selection, respectively. (A) is explanatory drawing of direction detection, (B) is a figure for demonstrating the relationship between m and n in (A). It is explanatory drawing of another method of direction detection. (A) and (B) are a block configuration diagram and an explanatory diagram of block address detection, error determination, and accurate center detection unit in the multimedia information reproducing apparatus, respectively. It is an operation flowchart of block address detection, error determination, and accurate center detection unit. (A) is a figure for demonstrating operation | movement of the marker and address interpolation part in a multimedia information reproducing | regenerating apparatus, (B) is a block block diagram of the address control part in a multimedia information reproducing | regenerating apparatus. . (A) is a figure for demonstrating the other processing method of a marker determination part, (B) is a figure for demonstrating a marker determination formula, (C) is a figure for demonstrating a marker alignment detection. It is a figure which shows the structure of a light source integrated type image sensor. It is a block block diagram of 1 chip IC using an XY address type image pick-up part. (A) is a circuit configuration diagram of a pixel of an XY address type imaging unit, and (B) is a diagram showing a configuration of a pen-type information reproducing apparatus having a switch for dot code capturing control. It is a block block diagram of 3D IC using an XY address type image pick-up part. It is a figure which shows another structure of the pen-type information reproducing apparatus which has the switch for dot code taking-in control. (A) is a figure which shows the structure of the pen-type information reproducing apparatus corresponding to regular reflection removal, (B) is a figure for demonstrating the structure of a 1st and 2nd polarizing filter, (C) is a 2nd polarizing filter. FIG. 4D is a diagram illustrating another configuration example of the above, and FIG. 4D is a diagram illustrating a configuration of an electro-optical element shutter. It is a figure which shows another structure of the pen-type information reproducing apparatus corresponding to regular reflection removal. (A) is a figure which shows the structure of the pen-type information reproducing | regenerating apparatus which used the transparent resin optical waveguide material for the light source, (B) is an enlarged view of the connection part of an optical waveguide material and a reproducing | regenerating apparatus housing | casing, (C) And (D) are diagrams each showing a configuration of the tip portion of the optical waveguide material. It is a figure which shows the structure of the pen-type information reproduction apparatus using the image sensor of a light source integrated type. (A) is a diagram showing the configuration of a pen-type information reproducing apparatus that supports color multiplexing, (B) is a diagram for explaining a color multiplexing code, and (C) is a diagram for explaining an example of using a color multiplexing code. (D) is a diagram showing an index code. (A) is an operation | movement flowchart of a color type | mold corresponding | compatible pen-type information reproducing apparatus, (B) is a figure which shows the structure of the image memory part at the time of using a color image pick-up element. (A) is a figure which shows another structure of the pen type | mold information reproducing apparatus corresponding to a color multiplex, (B) is a figure which shows the structure of a light source. (A) is a diagram showing a dot data sticker on which a stealth type dot code is written, (B) is a diagram showing a configuration of a pen type information reproducing device corresponding to a stealth type dot code, and (C) is a diagram showing a stealth type dot code. It is a figure which shows the dot data seal in which the dot code was described in another aspect. It is a figure which shows the structure of the card type adapter provided with the audio output terminal. (A) And (B) is a figure which shows the structure of the card type adapter for video game machines. (A) is a figure which shows the usage example of the card type adapter for electronic notebooks, (B) is a figure which shows the external appearance and usage example of the card type adapter for apparatuses which do not have an input means. It is a figure for demonstrating the usage method of the reel seal | stick printer for printing a dot code on a reel seal | sticker. It is a figure which shows the internal structure of a reel sticker printing machine. It is a figure which shows the structure at the time of providing the function which records a multimedia dot code in the inside of a word processor. FIG. 58 is a diagram showing a configuration when the function of the multimedia information recording processing unit in FIG. 57 is built in an optical copying machine. FIG. 58 is a diagram showing a configuration when the function of the multimedia information recording processing unit in FIG. 57 is built in a digital copying machine. It is a figure which shows the structure at the time of making it utilize a pen-type information reproduction apparatus also as an input part of the data of a character or a picture. It is a figure which shows another structure at the time of making it utilize a pen-type information reproduction apparatus also as an input part of the data of a character or a picture. It is a figure which shows the structure of a scanner and a data reading corresponding | compatible card type | mold adapter. (A) And (B) is a figure which shows the system which each scans a dot code with a pen-type information reproducing device, and projects it on a screen with a projector. FIG. 64 is a diagram illustrating a specific configuration of an output processing unit in FIGS. 63 (A) and 63 (B). (A) is a diagram showing a case where data is output to a copying machine, a magneto-optical disk device, and a printer instead of the projector, and (B) is a diagram showing a case where the output processing unit is configured as a card type adapter. It is a figure which shows the specific structure of an output process part. It is a figure which shows the structure of the example which provided the format conversion part which changes into the format for every word processor model. It is a figure which shows the actual structure of a format conversion part. FIG. 3 is a system diagram when a sheet on which a dot code is recorded is transmitted / received by FAX. It is a figure which shows the structure of the multimedia information recording machine for FAX. It is a figure which shows the structure of the multimedia information recording machine with a FAX. (A) is a figure which shows the structure of an overwrite type | mold MMP card recording / reproducing apparatus, (B) and (C) are the figures which show the back surface and front surface of an MMP card | curd. It is a figure which shows the other structure of an overwrite type | mold MMP card recording / reproducing apparatus. (A) is a figure which shows another structure of an overwrite type | mold MMP card recording / reproducing apparatus, (B) and (C) is a figure which shows the back surface and cross section of an MMP card | curd, (D) is a code | cord | chord pattern recording paper It is a figure which shows a structure. It is a figure which shows the other structure of an overwrite type | mold MMP card recording / reproducing apparatus. (A) is a figure which shows the structure of a write-once type MMP card recording / reproducing apparatus, (B) is a block block diagram of the recorded area | region detection part in (A). (A) is a figure which shows the other structure of the recorded area | region detection part, (B) is a figure which shows the MMP card | curd with which the recorded marker was recorded. (A) is a figure which shows an MMP business card card system, (B) and (C) are the figures which show the back surface and front surface of an MMP business card card. (A) And (B) is a top view of the MMP card | curd formed by the semiconductor wafer etching type, (A) has shown the state which closed the protective cover, (B) has shown the open state. (A) The top view of the MMP card of another structure formed by the semiconductor wafer etching type, (B) is a side view, (C) is a figure for demonstrating the structure of a nail | claw part. (A) is a diagram showing a disk device with a dot code decoding function, and (B) is a diagram showing an example of dot code and index recording. It is a block diagram of a disk device with a dot code decoding function. (A) is a diagram showing the configuration of the back cover of a camera that can record multimedia information dot codes, (B) is a side view thereof, and (C) shows an example of photographic paper on which multimedia information dot codes are recorded. FIG. (A) is a figure which shows the other structure of the back cover of a multimedia information dot code recording corresponding camera, (B) is a figure which shows the structure of an LED unit, (C) is a figure which shows a data back side signal electrode, (D) And (E) is a figure which shows the moving mechanism of an LED unit, respectively. It is a block block diagram of the camera corresponding to a multimedia information dot code recording.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 12 ... Voice input device 16, 124, 144 ... A / D converter 18, 138 ... Compression circuit, 20 ... Error correction code addition circuit, 22 ... Memory circuit, 24 ... Data addition circuit, 26, 102, 160 ... Modulation circuit, 27 ... Synthesis circuit, 28 ... Printer system or printing plate making system, 36, 170 ... Dot code, 36A, 36B ... Manual scanning mark, 38, 172, 304 ... Block, 38A, 174, 274, 310 ... Marker, 38B ... error correction code, 38C ... audio data, 38D ... x address data, 38E ... y address data, 38F ... error determination code, 40 ... pen-type information reproducing device, 42 ... audio output device, 76 ... portable type Voice recorder main unit, 80 ... voice input unit, 82 ... recording start button, 94 ... compression processing unit (AD PCM), 96, 154 ... error correction code adding unit, 98 ... interleaving unit, 100, 158 ... address data adding unit, 104, 162 ... marker adding unit, 106 ... simple printer system, 110 ... timer, 112 ... control unit, DESCRIPTION OF SYMBOLS 120 ... Microphone and audio output equipment, 126 ... Compression processing part, 130 ... Speech compression circuit, 132 ... Speech synthesis coding circuit, 134, 236 ... Interface (I / F), 136 ... Data form discrimination circuit, 140 ... Camera or 146 ... Image area determination and separation circuit, 148 ... Binary compression processing circuit, 150 ... Multi-value compression processing circuit, 152 ... Data composition processing section, 156, 234 ... Data memory section, 164 ... Composition and editing Processing unit, 166... Printer system or printing plate making system, 16 ... FAX, 176,272A, 306 ... block address, 178 ... address error detection, error correction data, 180,314 ... data area, 278,316 ... dot, 306A ... upper address code, 306B ... lower address code, 308 ... Dummy marker, 310A ... circular black marker, 310B ... white portion of marker, 312 ... error detection code, 312A ... higher address CRC code, 312B ... lower address CRC code, 364 ... data margin part.

Claims (6)

In order to display binary information in a two-dimensionally rectangular manner from multimedia information obtained by A / D conversion of at least one of digital code data information such as audio information, video information, and text data. Generated code information,
A marker provided in at least one corner of a square corner of the code information for imaging and reproducing the code information, and information for performing error correction when reproducing the code information,
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
Code information characterized by In order to display binary information in a two-dimensionally rectangular manner from multimedia information obtained by A / D conversion of at least one of digital code data information such as audio information, video information, and text data. Code information generation method,
In order to capture and reproduce the code information, a marker is provided in at least one corner of the square of the code information, and includes information for error correction when reproducing the code information,
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
A code information generation method characterized by the above. Information acquisition means for acquiring information of digital code data such as audio information, video information, and text data;
Digital multimedia information generating means for generating digital multimedia information obtained by A / D converting at least one of audio information, video information, and digital code data information acquired by the information acquiring means;
Code information generating means for generating code information visually displayed in a manner in which binary information is two-dimensionally arranged in a two-dimensional manner from the digital multimedia information generated by the digital multimedia information generating means;
Comprising
The code information includes markers provided at at least one corner of a square corner of the code information for imaging and reproducing the code information, and information for performing error correction when reproducing the code information. Have
The size of the marker is set to a size that is at least 7 times larger than the size of each piece of individual information that forms the code information that is binary information.
A code information generation apparatus characterized by the above. In the code information display medium,
Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker, the minimum unit than the the size dimensions of the individual information is set to at least 7 times the dimension, the code information generating apparatus that forms the code information is binary information,
A code information conversion device for converting code information generated by the code information generation device into visible information;
A code information display medium characterized in that the code information is visualized by a system including: Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker is set to a size that is at least 7 times larger than the size of each piece of minimum information forming the code information that is binary information, An imaging means for imaging a code information display medium in which the code information is visualized by a system having a code information conversion device that converts code information generated by the information generation device into visible information;
Means for processing and reproducing the code information imaged by the imaging means based on the marker, and acquiring the multimedia information;
A code information reproducing apparatus comprising: Information acquisition means for acquiring digital code data information such as audio information, video information, text data, etc., and at least one of the audio information, video information, and digital code data information acquired by the information acquisition means is A / D Digital multimedia information generating means for generating digital multimedia information obtained by conversion, and visible in a manner in which binary information is two-dimensionally arranged from the digital multimedia information generated by the digital multimedia information generating means. Code information generating means for generating code information to be displayed, and the code information is provided in at least one or more corners of the square of the code information in order to capture and reproduce the code information A marker and information for error correction when the code information is reproduced. The size of the marker is set to a size that is at least 7 times larger than the size of each piece of minimum information forming the code information that is binary information, An imaging step of imaging a code information display medium in which the code information is visualized by a system having a code information conversion device that converts code information generated by the information generation device into visible information;
A reproduction step of processing and reproducing the code information imaged in the imaging step based on the marker to obtain the multimedia information;
A method for reproducing code information, comprising:

Images