JP2017041271A - Sticker - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information reading device that can more accurately grasp association between information codes and information.SOLUTION: The information reading device according to an embodiment is provided with a first image data specification part, a second image data specification part, a correspondence determination part, an information code specification part, and an information specification part. The first image data specification part specifies, from imaged image data, first image data corresponding to an information code applied to an item. The second image data specification part specifies, from the imaged image data, second image data corresponding to a sticker stuck on the item. The correspondence determination part determines that the first image data and the second image data correspond to each other, when the first image data is positioned, with respect to the second image data, in a direction specified on the basis of the second image data. The information code specification part specifies an information code from the first image data. The information specification part specifies information from the second image data.SELECTED DRAWING: Figure 4

Description

  Embodiments of the present invention relate to a patch.

  2. Description of the Related Art Conventionally, there is known an information reading device that reads information code provided to a product and information such as discount information from photographed image data.

  In this type of information reading apparatus, it is desired to grasp the association between an information code and information with higher accuracy.

  The patch of the embodiment is an image recognition patch that is pasted on the product on which the information code is displayed, and displays additional information that is information to be added to the product, in the display area of the additional information. The base portion provided with a margin area on the outer periphery, the information arranged in a position protruding from the base portion, in a multi-circular shape, indicating that the paste is attached to the product, and corresponding the additional information A mark for image recognition indicating the presence of a code and having a blank area on the outer periphery of the multiple circle.

FIG. 1 is a diagram illustrating an example of a schematic configuration of a merchandise sales information processing system including an information reading apparatus according to an embodiment. FIG. 2 is a block diagram illustrating an example of a POS terminal as an information reading apparatus according to the embodiment. FIG. 3 is a block diagram illustrating an example of a CPU of a POS terminal as an information reading apparatus according to the embodiment. FIG. 4 is a schematic diagram illustrating an example of a product provided with an information code and information read by the information reading apparatus according to the embodiment. FIG. 5 is a conceptual diagram illustrating movement of a product when an information code and information are read by the scanner of the information reading apparatus according to the embodiment. FIG. 6 is a flowchart illustrating an example of a calculation process related to reading of an information code and information by the information reading apparatus according to the embodiment. FIG. 7 is a diagram exemplifying determination of correspondence between information code and information by the information reading apparatus according to the embodiment, and is a diagram illustrating an example in which it is determined that the information code corresponds to information. . FIG. 8 is a diagram illustrating an example of determination of correspondence between an information code and information by the information reading apparatus according to the embodiment, and illustrates an example in which it is determined that the information code does not correspond to information. . FIG. 9 is a diagram exemplifying determination of correspondence between information code and information by the information reading apparatus according to the embodiment, and is a diagram illustrating another example in which it is determined that the information code corresponds to information It is. FIG. 10 is a diagram illustrating a modification of the sticking used in the information reading apparatus according to the embodiment. FIG. 11 is a diagram illustrating a modification of the sticking used in the information reading apparatus according to the embodiment. FIG. 12 is a view showing a modification of the patch used in the information reading apparatus according to the embodiment. FIG. 13 is a diagram illustrating a modification of the sticking used in the information reading apparatus according to the embodiment. FIG. 14 is a view showing a modification of the patch used in the information reading apparatus according to the embodiment. FIG. 15 is a diagram illustrating a modification of the sticking used in the information reading apparatus according to the embodiment.

  As shown in FIG. 1, in one embodiment, the product sales information processing system 1 is configured as a store system, and includes a store server 2 and a POS (Point Of Sales) terminal 3. The store server 2 and the POS terminal 3 are electrically connected via an electric communication line 4 such as a LAN (Local Area Network).

  As shown in FIG. 2, the POS terminal 3 includes a central processing unit (CPU) 31, a read only memory (ROM) 32a, a random access memory (RAM) 32b, a clock unit 32c, an input / output (I / O). Output) port 32d, network interface 32g, keyboard controller 32h, touch panel controller 32i, display controller 32j, printer controller 32k, scanner controllers 32m and 32n, storage device controller 32p, and the like. As shown in FIG. 2, these components are connected to each other via a bus line 32q such as an address bus or a data bus. The POS terminal 3 is an example of an information reading device and a merchandise sales information processing device.

  The CPU 31 controls the POS terminal 3 by executing various computer-readable programs stored in the ROM 32a or the like. The ROM 32a stores various data executed by the CPU 31, various programs (BIOS program, application program, device driver program, etc.) and the like. The RAM 32b temporarily stores data and programs when the CPU 31 executes various programs.

  In the present embodiment, a program for the POS terminal 3 includes a module for receiving image data captured by an imaging unit such as a barcode scanner 33f or a CCD scanner 33g, a module for performing preprocessing, and a captured image data to an information code. A module for identifying corresponding first image data, a module for identifying second image data corresponding to the paste from the captured image data, and the identified first image data and second image data A module for determining whether or not to perform information, a module for reading an information code, a module for reading information displayed on a sticker, a module for performing sales registration, a module for performing settlement, and the like. Therefore, the CPU 31 of the POS terminal 3 follows the program, as shown in FIG. 3, the image data receiving unit 31a, the preprocessing unit 31b, the first image data specifying unit 31c, and the second image data specifying unit 31d. , The correspondence determination unit 31e, the information code identification unit 31f, the information identification unit 31g, the sales registration unit 31h, the settlement unit 31i, and the like.

  Further, the clock unit 32c measures the current date and time. The I / O port 32d inputs a mode selection signal from the mode switch 32e and outputs a signal to a drawer opening device 32f that automatically opens a drawer (not shown). The network interface (I / F) 32g controls data communication with other devices connected through the telecommunication line 4 or the like. The keyboard controller 32h receives a key signal corresponding to the operation key from the keyboard 33a and sends it to the CPU 31. The touch panel controller 32 i controls the customer display 33 c to display an image corresponding to the data received from the CPU 31, and receives a signal from the touch panel sensor 33 b provided on the display 33 c and sends it to the CPU 31. The display controller 32j controls the operator display 33d to display an image or the like corresponding to the data received from the CPU 31. The printer controller 32k controls a receipt / journal (R / J) printer 33e to perform receipt printing and journal printing based on data supplied from the CPU 31. The scanner controllers 32m and 32n receive data signals read by the barcode scanner 33f or the CCD scanner 33g and send them to the CPU 31. The barcode scanner 33f and the CCD scanner 33g are examples of an imaging unit (imaging element, imaging means).

  The storage device controller 32p controls writing and reading of data to and from the storage device 33h as a nonvolatile storage unit based on an instruction signal from the CPU 31. The storage device 33h stores various data in addition to an OS (Operating System) program, an application program, a device driver program, and the like.

  Further, the CCD scanner 33g reads an information code 51 (for example, a one-dimensional code) or a sticker 52 attached to the product 50 as shown in FIG. In the example of FIG. 5, the CCD scanner 33 g reads the information code 51 and the paste 52 of the product 50 that the operator has passed from the left side to the right side of FIG. 5, for example, on the front side (front side in FIG. 5) of the CCD scanner 33 g. .

  The patch 52 is affixed to the surface of the product 50 with, for example, an adhesive applied to the back surface of a sheet such as a mount, and is specifically configured as a discount seal or point seal. As shown in FIG. 4, the paste 52 includes additional information (information) 54 and an image 53.

  The additional information 54 is information related to the product 50, the service of the store or manufacturer, and the like. Further, the additional information 54 is information that is added by pasting the paste 52 on the product 50. The additional information 54 can be, for example, letters, numbers, images, information codes, and the like. Further, it is desirable that the additional information 54 can be visually identified by an operator, a store clerk, a customer, and the like. The additional information 54 can indicate, for example, the product 50 to be discounted, the discount amount, the product to be given points, the value of points, and the like.

  The image 53 is an image different from the additional information 54. As an example, the image 53 can have a function of easily specifying the association between the paste 52 (additional information 54) and the information code 51 by image processing. Moreover, the image 53 can also have a function which makes the sticking thing 52 stand out visually as an example. In the present embodiment, the image 53 includes, for example, an enclosing portion 53a and an extending portion 53b. The surrounding portion 53a surrounds the additional information 54. For example, the surrounding portion 53a can be formed in an annular shape (annular or rectangular). Further, the surrounding portion 53a can be provided with one or more cutouts. Further, the surrounding portion 53a can be a line such as a dotted line or a broken line. In the present embodiment, as an example, the inner edge of the surrounding portion 53a is formed in a sawtooth shape.

  The extending portion 53b extends along one direction. In the present embodiment, the extending portion 53b is, for example, a protrusion protruding in a triangular shape from the surrounding portion 53a toward one side. In the present embodiment, the width of the extending portion 53b becomes narrower toward the one side. Further, the extending portion 53b has a pointed portion 53c.

  The image 53 is formed symmetrically with respect to the straight line L as the center line of the extending portion 53b. The straight line L can pass through the center of the image 53 and the paste 52, for example. The image 53 (particularly the extended portion 53b) is an example of a direction presenting image that indicates the direction in which the information code 51 related to the paste 52 is present.

  The patch 52 has a base portion 52a and a protruding portion 52b. The base portion 52a includes additional information 54 related to the product and a surrounding portion 53a. The protruding part 52b protrudes from the base part 52a. An extension 53b of the image 53 is displayed on the protrusion 52b. Therefore, an operator (a store clerk, a customer, etc.) pastes the paste 52 in a state in which it is easy to visually determine the association with the information code 51 (the direction in which the information code 51 corresponding to the paste 52 exists). Easy to put on. Further, the CPU 31 can easily determine the correspondence between the information code 51, the image 53, and the additional information 54 on the image-processed data.

  Further, the image 53 and the additional information 54 are colored with, for example, a color or density having a remarkable contrast with the background of the image 53 and the additional information 54 in the paste 52. In addition, the image 53 and the additional information 54 are arranged so as not to overlap each other (so that a gap is formed), for example. The background color of the patch 52, the color of the image 53, and the character color of the additional information 54 can be different from each other. Specifically, for example, the background color of the patch 52 can be yellow, the color of the image 53 can be red, and the character color of the additional information 54 can be blue.

  Further, a blank area g is provided between the outer edge of the extended portion 53 b of the image 53 and the outer edge of the protruding portion 52 b of the patch 52. As a result, as shown in FIG. 4, even when the paste 52 and the information code 51 overlap each other, there is an advantage that the image 53 and the image of the information code 51 are easily recognized separately in the image processing. .

  Here, with reference to FIG. 6, an example of a calculation process related to reading of the information code 51, the image 53, and the additional information 54 in the POS terminal 3 according to the present embodiment will be described. FIG. 6 is a flowchart at one timing when pixel information of the imaging region is acquired by the CCD scanner 33g as the imaging unit.

  First, the CPU 31 of the POS terminal 3 operates as the image data receiving unit 31a and controls the CCD scanner 33g as an imaging unit, for example, image data (luminance value) of all pixels in the imaging region of the CCD scanner 33g. Data) is received (step S1).

  Next, the CPU 31 operates as the preprocessing unit 31b, and performs predetermined image processing (preprocessing for specifying a predetermined image in the next step S3) on the image data (step S2). In the pre-processing in this step S2, for example, binarization, filtering, hole filling (closing), grouping (binarized values (eg, “0” or “1”) adjacent to or adjacent to each other) Pixel blocks are grouped together), labeling (labeling each group (for example, a serial number)), and the like are included.

  The processing of step S2 to step S7 is executed, for example, for a pixel block (not shown) having a single shape (for example, a square shape) arranged in a grid pattern as a collection of a plurality of adjacent pixels. sell. In this case, the CPU 31 operating as the first image data specifying unit 31c, in this step S2, prior to the preprocessing, the total value or average value of the luminance values of a plurality of pixels constituting the pixel block (pixel block, etc.) The block image data corresponding to the image data is calculated in advance, and the image processing can be performed on the block data. Thereby, it is possible to reduce the calculation load of the CPU 31 of the POS terminal 3 as compared with the case where image processing is performed in units of pixels.

  Next, the CPU 31 operating as the first image data specifying unit 31c checks whether there is image data (first image data) that satisfies a predetermined condition corresponding to the information code 51 (step S3). In step S3, the first image data specifying unit 31c corresponds to, for example, part or all of the shape of the information code 51 as the image data corresponding to the information code (one-dimensional code in the example of FIG. 5) 51. Check for image data. Specifically, for example, when image processing is performed on a relatively large pixel block, as shown in FIG. 7, the first image data corresponding to the information code 51 (divided into the same group) A group of pixels or pixel blocks) D1 has a rectangular shape in which a plurality of bars of the information code 51 as a one-dimensional code are blurred. Therefore, the first image data specifying unit 31c can specify (detect and extract) the first image data D1 corresponding to the overall rectangular shape of the information code 51. Alternatively, for example, when the image processing is performed on a relatively small pixel block or the pixel itself, the first image data specifying unit 31c includes a characteristic one included in the information code 51 as a one-dimensional code or A plurality of bars can be specified (detected and extracted).

  When the first image data D1 is not specified in step S3 (No in step S4), the CPU 31 ends the arithmetic processing at this timing.

  On the other hand, if the first image data D1 is specified in step S4 (if there is first image data D1 that meets the conditions in step S3, Yes in step S4), the CPU 31 It operates as the image data specifying unit 31d and checks whether or not there is image data (second image data) that satisfies a predetermined condition corresponding to the paste 52 (step S5). In step S5, the second image data specifying unit 31d checks whether there is second image data corresponding to part or all of the shape of the image 53, for example, as the image data corresponding to the paste 52. Specifically, for example, as shown in FIG. 7, the second image data D2 corresponding to the image 53 includes an annular portion D2a corresponding to the surrounding portion 53a, and a radially outward direction from the annular portion D2a. Therefore, the second image data specifying unit 31d can specify the second image data D2 having the shape. . For example, the second image data specifying unit 31d specifies the second image data D2 by checking the degree of coincidence (match rate, mismatch rate, etc.) with the pattern shape stored in advance in the storage device 33h ( Detection, extraction).

  When the second image data D2 is specified in step S5 (Yes in step S6), the CPU 31 operates as the correspondence determination unit 31e, and the first image data D1 and the second image data D2 correspond to each other. It is determined whether the information code 51 corresponding to the first image data D1 corresponds to the image 53 corresponding to the second image data D2 (step S7).

  In step S7, the correspondence determining unit 31e, as an example, displays an image 53 on a two-dimensional coordinate (orthogonal coordinate plane corresponding to the imaging region) in which each pixel of the imaging region is two-dimensionally arranged by the CCD scanner 33g as the imaging unit. The data of each pixel constituting the second image data D2 corresponding to (for example, “1” data corresponding to the image among the binarized “0” or “1” data of each pixel) Then, by regression analysis (for example, least square approximation, etc.), a straight line L that minimizes the sum of the distances on the coordinates from each pixel constituting the second image data D2 is calculated, and an image 53 (in particular, a direction presenting image) The direction indicated by the extended portion 53b) can be detected. That is, when the first image data D1 (for example, a part thereof) is on the straight line L or within a predetermined distance from the straight line L, the correspondence determining unit 31e calculates the first image data D1 and the straight line L. It can be determined that the calculated second image data D2 corresponds to the original. Note that the correspondence determining unit 31e may exclude a region on the opposite side of the straight line L from the protruding portion D2b with respect to the center of gravity M of the image 53.

  In step S7, the correspondence determining unit 31e displays the first image data D1 when the first image data D1 exists on the straight line L or within a certain distance from the straight line L, as shown in FIGS. Is determined to correspond to the second image data D2. On the other hand, as shown in FIG. 8, when the first image data D1 does not exist on the straight line L or within a certain distance from the straight line L, the correspondence determining unit 31e and the first image data D1 It is determined that the image data D2 does not correspond.

  Note that, as shown in FIG. 7, the first image data D1 and the second image data D2 may partially overlap. Therefore, the correspondence determination unit 31e can distinguish between the two images D1 and D2 by performing image reduction processing or the like before performing the correspondence determination. Further, as shown in FIG. 4, by providing a blank area g, even when the paste 52 is pasted on the information code 51, the two images D1 and D2 are recognized and recognized by the blank area g. It is also possible to do so.

  When the second image data D2 cannot be extracted in step S5 (No in step S6), and when it is determined in step S7 that the first image data D1 and the second image data D2 do not correspond ( In step S8, No), the CPU 31 operates as the information code specifying unit 31f, and specifies the information code 51 corresponding to the first image data D1 (step S11).

  On the other hand, when it is determined in step S7 that the first image data D1 and the second image data D2 correspond to each other (Yes in step S8), the CPU 31 determines that the first image data D1 and the second image data are the same. Information indicating that D2 corresponds is stored in the storage device 33h, thereby associating them (step S9). The CPU 31 operates as the information specifying unit 31g, specifies the additional information 54 corresponding to the second image data D2 (step S10), and operates as the information code specifying unit 31f to The identification of the information code 51 corresponding to the image data D1 is executed (step S11). In step S <b> 10, the CPU 31 performs OCR (Optical Character Recognition) to obtain the content of the additional information 54.

  The CPU 31 operates as the sales registration unit 31h and the settlement unit 31i, adds the read information code 51 to the storage device 33h and registers it, and after completing the registration process for all the products 50, the settlement (cash Or settlement with electronic money, credit card, etc.). In the registration process, the CPU 31 reflects the contents of the additional information 54 corresponding to the information code 51 (such as discounting and giving points).

  As described above, in this embodiment, the paste 52 of the product 50 indicating the additional information 54 has the image 53. Therefore, as an example, in the image processing of the captured image data in the CPU 31, the image corresponding to the information code 51 (related to the paste 52 (image data corresponding to the second image data) on the coordinates) The direction in which the data, the first image data) exists is easily determined. Therefore, as an example, in the image processing, the association between the information code 51 and the additional information 54 can be more accurately or easily grasped. Further, the image 53 including the extension 53b is displayed on the patch 52, so that an operator who pastes the patch 52 on the product 50 determines the position where the patch 52 is attached to the information code 51 by the extension 53b. There is also an advantage that it becomes easy.

  In the present embodiment, the direction in which the corresponding information code 51 exists for the image 53 is a direction along the straight line L obtained by regression analysis (for example, least square approximation) on the image data of the image 53. is there. Therefore, as an example, in the image processing, the association between the information code 51 and the additional information 54 can be more accurately or easily grasped based on the shape characteristics of the image data of the image 53.

  In the present embodiment, the image 53 is formed in a substantially line-symmetric shape. In the present embodiment, the image 53 has an extending portion 53b. Therefore, as an example, the straight line L is easily obtained from the image data of the image 53 in the image processing. Therefore, as an example, the association between the information code 51 and the additional information 54 can be easily grasped with higher accuracy or more easily. As an example, in the image processing, it is easy to specify the straight line L used for determining the association between the additional information 54 and the information code 51. Therefore, as an example, in the image processing, the association between the information code 51 and the additional information 54 can be more accurately or easily grasped.

  Moreover, in this embodiment, the width | variety of the extension part 53b is so narrow that it goes to one direction. In the present embodiment, the extending portion 53b has a pointed portion 53c. Therefore, as an example, in image processing, due to the change in the width, one side of the straight line L (for example, the narrow side) is made valid and the other side (for example, the wide side) is made invalid. Therefore, the association between the information code 51 and the additional information 54 can be easily grasped with higher accuracy or more easily.

  Further, in the present embodiment, the paste 52 is provided with a blank area g around at least a part of the image 53. Therefore, the image 53 and the information code 51 are easily separated in the image processing. Therefore, as an example, in the image processing, the association between the information code 51 and the additional information 54 can be more accurately or easily grasped.

  In the present embodiment, the image 53 has a surrounding portion 53 a that surrounds the additional information 54. Therefore, as an example, the area of the additional information 54 is easily specified in the image processing.

  The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the above embodiments, and various modifications can be made.

  For example, the extending portion 53b of the image 53 is not limited to the above embodiment, and may be a linear image whose width does not change as shown in FIG. 10, for example, or as shown in FIG. An arrow-shaped image may be used.

  As shown in FIG. 12, the image 53 can include a background portion 53d that is a partial background of the additional information 54, and an extending portion 53b. The image 53 can also include both the surrounding portion 53a and the background portion 53d.

  Further, as shown in the modified examples of FIGS. 13 to 15, the image 53 can have a mark 53 e. In these modified examples, the mark 53e is, as an example, spaced apart from the surrounding portion 53a and formed as a multiple circle (in this example, a double circle). However, FIGS. 13 to 15 are merely examples, and the mark 53e can be formed in any predetermined shape (for example, a star shape, a square shape, a triangle shape, a rectangular ring shape, a rectangular multiple ring shape, etc.). Also in these modified examples, as in the above embodiment, in the image processing, the direction in which the association of the information code 51 with respect to the image 53 is made effective is obtained from the image data of the surrounding portion 53a and the image data of the mark 53e. Can do. As an example, data of each pixel constituting the image data of the surrounding portion 53a and the mark 53e (for example, “1” corresponding to the image among binarized “0” or “1” data of each pixel) The straight line L that minimizes the sum of the distances on the coordinates from the pixels constituting the image 53 is calculated by regression analysis (for example, least square approximation), and the direction indicated by the image 53 is detected. can do. In addition, the part 52c to which the mark 53e is provided in the sticking object 52 can be separated from the protruding part 52b with a cut line (perforation or the like) 52d as a boundary. Moreover, the mark 53e can represent that the sticking object 52 is affixed. Therefore, it is easy for a person (operator, customer, etc.) or an information reading device (POS terminal 3, etc.) to determine whether or not processing (discounting operation, the above-described image processing, arithmetic processing, etc.) is necessary depending on the presence / absence of the mark 53e. Become. In addition, when the portion 52c to which the mark 53e is provided is separated from the paste 52 with the cutting line 52d as a boundary, the portion of the paste 52 to which the base portion 52a as the portion including the additional information 54 and the mark 53e is provided. 52c can be spaced apart. Therefore, it becomes easy to raise the freedom degree of the sticking position of the part including the additional information 54 in the product 50.

  In addition, specifications (methods, etc.) of each component (information reading device, product sales processing system, product sales information processing device, POS terminal, imaging unit, product, information code, information, sticker, image, direction presentation image, etc.) The structure, shape, size, arrangement, position, number, number of pixels, etc.) can be changed as appropriate.

  According to the information reading apparatus according to the above-described embodiment, the association between the information code and the information related to the product displayed on the sticker can be grasped more accurately.

3 POS terminal (information reading device, merchandise sales information processing device)
31c 1st image data specific part 31d 2nd image data specific part 31e Corresponding judgment part 31f Information code specific part 31g Information specific part 31h Sales registration part 31i Settlement part 50 Merchandise 51 Information code 52 Paste 53 Image (Direction presentation image) )
53a Surrounding part 53b Extension part (direction presenting image)
53e mark 54 information D1 first image data D2 second image data

JP 2008-33640 A

Sticking of embodiment, a base portion a patch of image recognition to be affixed to the product information code is displayed, displaying the additional information is information to be added to the product, from the base portion disposed at a position separated, and a mark for indicates to picture image recognized that the attached material before Symbol product is affixed.

Claims (3)

It is a sticker for image recognition that is pasted on the product for which the information code is displayed,
Displaying additional information, which is information to be added to the product, and a base portion provided with a blank area around the display area of the additional information;
It is arranged at a position protruding from the base part, is a multi-circular shape, indicates that the sticking material is affixed to the product, indicates the presence of the information code corresponding to the additional information, and the outer periphery of the multi-circular shape A mark for image recognition with a margin area in the
A patch with   The patch according to claim 1, wherein the mark indicates a direction in which the information code exists. The base part is circular, the display area of the base part has a surrounding frame on an outer edge part, and the outside of the surrounding frame is the margin area,
The mark is a double circle, and is provided on the lower right side of the circle of the base portion.
The patch according to claim 1 or 2.