JP4220556B2 - Table type information terminal - Google Patents

Description

  The present invention relates to a table type information terminal provided with a screen on a table top and providing contents requested by a user on the screen.

  As a method for providing a desired content to a user, conventionally, a list of menus (content list) is first displayed on a display surface, and this content list is selected by selecting a menu of the desired content from the content list. There is known a method in which a server selects and displays selected content on the same display surface.

  As a conventional example of such a method, a method has been proposed in which the content list is scroll-displayed on the display surface so as to flow from right to left, for example (see, for example, Patent Document 1).

In a coffee shop, a cafe, a bar, etc., for example, a video display surface is provided on a table surface of a table, such as a game machine, and a desired video is displayed on the table to provide a user with a video for a game or the like. Something has been done. By applying the content providing method described in Patent Document 1 on such a table type information terminal, it is conceivable that the user can selectively receive the content desired by the user.
Japanese Patent Laid-Open No. 2001-273298 (FIGS. 9 to 11)

  By the way, when the method described in Patent Document 1 is applied to video display on a table surface of a table, in order to make it easier for the user to use such a table type information terminal, a desired content list is displayed from the content list displayed on the table surface. It is conceivable that the menu can be selected by touch operation.

  However, in order to select a desired menu from the scrolling content list, it is necessary to touch this menu with a fingertip, and it is necessary to be able to detect that the menu has been touched.

  In addition, when a menu is selected by such a touch operation, the menu is selected even when an object other than a fingertip such as a cup is placed on the table surface, and such an object is placed. If this is done, a part of the content list will be hidden, and the user will not be able to see some menus. If there is such a problem, there is a possibility that it will not be used easily by the user.

  Furthermore, when a desired menu is selected from the content list, the content for this menu is displayed on the display surface, and the content list is not displayed. An operation for switching to the list display screen is required, and the operation becomes complicated. In particular, even if the operation is complicated as described above, there is a possibility that the user may not use it easily.

  An object of the present invention is to provide a table type information terminal that solves such problems and can be easily used by a user and can easily and reliably provide desired contents.

  In order to achieve the above object, the present invention provides a table-type information terminal in which a screen is provided on a table surface of a table and an image is projected and displayed on a screen from a projection device provided in the table. A camera unit for imaging the screen, and means for detecting a silhouette of an object placed on a table surface on the screen from a video signal from the camera unit and determining a type of the object causing the silhouette, Displays an information operation screen including a content list display area that scrolls and displays a content list composed of content menus in a horizontal direction, and when an object that causes a silhouette is placed in the content list display area, The flow of the content list projected by the projection device according to the judgment result It is provided with a control means.

  According to the present invention, the determination of the type of the object causing the silhouette is determination of whether the object is an object for manipulating an image displayed on the screen or other object, and the control means displays the content list When an object other than an image is placed in the area, the content list projected by the projection device is controlled according to the determination result of the determination unit, and the content list is displayed so as to avoid the object. It is something to be made.

  According to the present invention, even if the content menu is displayed on the table surface, if the touch is selected with the fingertip, the content for the selected content menu can be reliably acquired, and objects other than the fingertip can be obtained. Even if it is placed on the table surface, it is possible to prevent malfunction such as selection of content.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing an embodiment of an information display terminal according to the present invention. FIG. 1 (a) is an external perspective view, FIG. 1 (b) is a longitudinal sectional view in the depth direction, and FIG. 1 is a table, 2 is a chair, 3 is a table surface, 4, 4a and 4b are screens, 5 is a partition, 6 is an infrared LED (Light-Emitting Diode), and 7 is a wireless ID tag. , A wireless IC card reader (card reader), 9a and 9b are proximity sensors, 10 is a seating sensor, 11 is a front outer surface, 12 is a projection device, and 13 is a camera unit.

  In this figure, this embodiment is composed of a table 1 and a chair 2 for sitting in front of it, and the chair 2 is arranged in a fixed positional relationship with respect to the table 1.

  On the upper surface of the horizontally long top plate of the table 1, that is, the table surface 3, screens 4 a and 4 b are arranged in parallel over almost the entire table surface 3. The screens 4a and 4b are provided with touch sensors (not shown) and have a touch panel function. Here, although two screens 4a and 4b are provided, one screen or three or more screens may be used. Further, a partition 5 is provided on the side of the table surface 3 opposite to the chair 2 side (hereinafter referred to as the rear side, whereas the chair 2 side is referred to as the front side) substantially over the entire side. A plurality of infrared LEDs are attached to the partition 5 along the arrangement direction of the screens 4a and 4b. By the infrared LED, the entire screen 4a, 4b is irradiated with infrared rays with a substantially uniform intensity.

  A tag reader 7 that reads a wireless ID tag is provided at the right end of the table surface 3, and a card reader 8 that reads a wireless IC card is provided at the left end of the table surface 3. Both the tag reader 7 and the card reader 8 are provided inside the table surface 3, and when the wireless ID tag is placed on the table surface 3 at a position where the tag reader 7 is provided, the tag reader 7 causes the wireless ID tag to be placed. Similarly, when the wireless IC card is placed on the table surface 3 at a position where the card reader 8 is provided, the card reader 8 reads the wireless IC card.

  Proximity sensors 9a and 9b for detecting a user (customer) approaching the table 1 are provided on the front outer surface 11 of the table 1, and a seating sensor 10 is provided on a portion on which the waist of the chair 2 is placed. ing.

  As shown in FIG. 1B, a projection device 12 and a camera unit 13 are provided inside the table 1. An image projected by the projection device 12 is enlarged by a lens (not shown) and projected onto the screen 4. The camera unit 13 is used to detect the silhouette of an object such as a fingertip placed on the screen 4 by photographing the screen 4 irradiated with infrared rays from the infrared LED 6 through an infrared filter (not shown) from the back side. By capturing this silhouette and performing pattern recognition processing, the type and moving direction of the object on the screen 4 that causes the silhouette are determined.

  Moreover, as shown in FIG.1 (c), each infrared LED6 radiates | emits infrared at a wide angle, and it is made to overlap with the radiation | emission area | region of the adjacent infrared LED6. Here, as the projection device 12, two projection devices 12a and 12b are provided, the projection device 12a projects an image on the screen 4a, and the projection device 12b projects an image on the screen 4b. Although not shown in FIG. 1C, two camera units 13 (FIG. 1B) are also used here.

  Here, FIG. 2 demonstrates the effect | action by infrared LED6 radiating | emitting infrared rays to a wide angle.

  2 (a1), (b1), and (c1) show the illumination states of infrared rays (indicated by arrows) according to the distance of the object 14 from the surface of the screen 4, respectively. The object 14 approaches the screen 4 in the order of (b1), and the object 14 is on the screen 4 in FIG.

  2 (a2), (b2), and (c2) show video signals obtained by the camera unit 13 in the state of FIGS. 2 (a1), (b1), and (c1), respectively.

  First, as shown in FIG. 2 (a1), when the object 14 is away from the screen 4, the infrared light radiated at a wide angle from the infrared LED 6 directly above the object 14 is irradiated on the upper surface of the object 14. The side surface and the lower surface of the object 14 are not irradiated. However, for example, infrared rays radiated at a wide angle from the adjacent infrared LEDs 6 a and 6 b that are shifted from directly above the object 14 enter the lower side of the lower surface of the object 14. For this reason, as shown in FIG. 2A2, the video signal obtained from the camera unit 13 has a level V that decreases at the portion of the object 14, but the level is not so large, and the level V is somewhat large. Yes.

  Next, as shown in FIG. 2 (b1), when the object 14 is closer to the screen 4 than in the case shown in FIG. 2 (a1), from the adjacent infrared LEDs 6a and 6b that enter under the lower surface of the object 14. The amount of infrared light decreases, and the silhouette of the object 14 on the screen 4 becomes darker. As shown in FIG. 2 (b2), the level V of the video signal further decreases at the object portion. The differential value in the spatial direction of the level V at the edge of the portion where the level V is lowered (the portion where the level is lowered or raised; hereinafter referred to as the boundary portion where the level is lowered) is larger than in the case of FIG. growing. Note that as the object 14 approaches from the screen 4, the differential value increases.

Then, as shown in the figure (c1), when the lower surface of the object 14 is in contact with the screen 4 and the object 14 gets on the screen 4, no infrared rays enter under the object 14, so that the video signal at that portion of the image 14 As shown in FIG. 2 (c2), the level V is almost zero, and the differential value at the boundary of the level drop to the level V = 0 is also as shown in FIG. 2 (c). ) Is larger than Further, as shown in FIGS. 2 (a2) to (c2), a threshold value of level V _T close to level V = 0 is set, and this is compared with the video signal, so that it is shown in FIG. 2 (c1). Thus, when the object 14 is in contact with the screen 4, the level V of the video signal in this portion is V <V _{T as} shown in FIG. 2 (c2).

In this way, it is possible to determine whether the object 14 is approaching or moving away from the screen 4 based on the change in the differential value of the boundary portion of the video signal level drop, and the threshold V close to the level V = 0. _{By T} , it can be determined that the object 14 is on the screen 4.

  FIG. 2 (d1) shows a state in which an object 14 ′ having the same thickness as the object 14 shown in FIG. 2 (c1) and having a different height is on the screen 4, and FIG. 2 (c1) As is clear from the above case, the higher object 14 ′ has a smaller amount of infrared light that irradiates the periphery of the object 14 ′ on the screen 4. For this reason, as is clear from the comparison with FIG. 2C1, the higher object 14 'has a smaller differential value at the boundary portion where the level is lowered. Therefore, from this, it is possible to estimate the degree of height such as whether the object on the screen 4 is high or low.

  Note that the size of the cross-sectional area and the shape of the lower surface of the object riding on the screen 4 can be determined by the size and shape of the silhouette on the screen 4, and the position of the silhouette on the screen 4 can also be determined.

  As described above, by using the infrared LED 6 that emits infrared light at a wide angle, it is possible to determine and estimate the above-described matters related to the object 14 based on the silhouette of the object 14.

  FIG. 3 is a diagram showing the division of the display area of the information operation screen 15 displayed on the screens 4a and 4b in FIG.

  In the figure, an information operation screen 15 is displayed on the screens 4a and 4b so that the user can perform content acquisition operations (the vertical broken lines indicate the boundaries between the screens 4a and 4b). ) On the upper side of the information operation screen 15, the horizontally long content list display area 16 over the entire horizontal direction of the information operation screen 15, and on the lower side of the information operation screen 15, It is divided into a horizontally long content reproduction area 17 that forms a part of the direction, and a remaining content storage area 18 on the lower side of the information operation screen 15. In the content list display area 16, a list of content menus consisting of character strings (that is, a content list) is scrolled so as to flow sequentially from the right side to the left side, for example, and when a desired content menu is touched with a fingertip, Content for this content menu is reproduced from a database (not shown) and displayed in the content reproduction area 17. Further, the content reproduced and displayed in the content reproduction area 17 is stored in an IC card (not shown) by the card reader 8 (FIG. 1) by moving to the content storage area 18 by, for example, performing a chitter operation with a fingertip. It can also be transferred to a PC (personal computer) owned by the customer.

  Here, when the content list in the content list display area 16 is in the scroll display state that is flowing as described above and the content display area 16 is touched with a fingertip, the flow state of the content list does not change. However, when an object other than a fingertip such as a glass is placed on the table surface 3 information operation screen 15 because the information display terminal of this embodiment is installed in a coffee shop or a bar, for example, the river The content list will appear to flow around this object, just as water flows around it to avoid obstacles. For this purpose, the shape of the silhouette of the screens 4a and 4b captured by the camera unit 13 (FIG. 1) is pattern-recognized to determine whether or not the object causing the silhouette is a fingertip.

As shown in FIG. 4A, when the content menu 19 "MOVIE" flowing in the content list display area 16 is touched with the fingertip of the tip of the hand 20, the display portion of the content menu 19 is enlarged. As shown in FIG. 4B, a silhouette 20a of the hand 20 is formed on the screen 4 (4a, 4b). In order to recognize a silhouette pattern, as an example, the screen 4 is virtually divided into unit areas (hereinafter referred to as cells) 21 having a small area, and the silhouette is determined from the arrangement relationship of the cells 21 included in the silhouette 20a. Therefore, the type of the object causing the silhouette 20a, that is, the tip 20 of the hand or the other object is determined. In this case, since the content menu 19 is touched with the fingertip, the silhouette 20a is determined to be the silhouette of the hand tip 20, and the content menu 19 scrolls (flows) in the same direction as it is. In this case, since the content menu “MOVIE” 19 is touched, the content is displayed in the content reproduction area 17 (FIG. 3). The silhouette 20a is a part of the hand 20 touching the screen 4, and a method using the threshold V _T described in FIGS. 2 (c1) and (c2) and FIGS. 2 (d1) and (d2). Is detected.

  Here, the size of the cell 21 is set to a size (for example, 8 × 8 pixels) including one character constituting the content menu 19, and each cell 21 is individually displayed on the screen 4, and thus the content list display. Its position in the area 16 is managed. Therefore, the silhouette generated in the content list display area 16 is detected in association with the position of the cell 21, and the position of each character constituting the content menu for scrolling the content list display area 16 is also as follows. Management is performed in relation to the position of the cell 21. In this way, the position of the detected silhouette and the position of each character in the content list are managed.

Note that the video signal from the camera unit 13 is converted into a digital video signal, and then binarized so that the pixel value at a level equal to or lower than the threshold V _T is “0” at the threshold V _T described above. When the number of “0” pixels in the cell is equal to or higher than a specified value (for example, 20%), it is assumed that the cell is in the silhouette.

  Further, the position of each cell is defined by, for example, the pixel position at the upper left corner of this cell. Accordingly, if the cell size is 8 × 8 pixels and the arrangement of the cells 21 shown in FIG. 4B is the display surface by the screens 4a and 4b, the mth horizontal and vertical pixels with the pixel position on the display screen as a unit. The position of the nth cell is {1 + 8 (m−1), 1 + 8 (n−1)}.

  Each content menu 19 follows the trajectory (originally the trajectory in the horizontal direction) along which the first character (character “M” in the content menu 19 shown in FIG. 4) moves (that is, after the first character). Then, the remaining characters (in the content menu 19 shown in FIG. 4, the characters “O”, “V”, “I”, “E”) move after the first character. Then, with respect to the first character, it is determined whether or not a cell that is one forward in the moving direction of the cell in which this character is included is included in the silhouette, and the preceding cell is not included in the silhouette. Or even if it is included in the silhouette of the fingertip, the leading cell therefore advances to the cell one cell ahead. In this way, in the cell area not included in the silhouette, the content menu moves along its original horizontal flow.

  As shown in FIG. 5A, if an object 22 other than a fingertip such as a cup is placed in the content display area 16 where the content list scrolls, for example, the silhouette 22a is as shown in FIG. 5B. Thus, it can be recognized by pattern recognition that this is something other than a fingertip.

  Therefore, in this case, if the content menu “MOVIE” 19 flows so as to hit the silhouette 22a, the character “M” at the head of the content menu “MOVIE” 19 is just before it hits the silhouette 22a. If it is determined that the cell one forward of “” is included in the silhouette 22a, as shown in FIG. 6A, the leading character “M” does not hit the silhouette 22a ( For example, as shown in FIG. 6B, the next character “O” also flows in the same direction that does not hit the silhouette 22a following the character “M”. change. In this way, the characters of the content menu “MOVIE” 19 sequentially change the flow so as not to hit the silhouette 22a. When the position reaches the position where it does not hit the silhouette 22a in the original flow direction, the original regularity is again displayed. The direction of flow is returned to the direction (i.e., the longitudinal direction of the content list display area 16). Of course, depending on the shape of the silhouette 22a, as a result of changing the direction as described above, when the bumper further strikes the silhouette, the flow direction is changed to a direction not to strike. Therefore, there may be a case of reversing temporarily.

  The direction of the content new flow with respect to the silhouette is determined according to a predetermined rule. As an example, first, when it is detected that a cell that is one forward in the moving direction (horizontal direction) with respect to the current cell of the first character is included in the silhouette, If it is not included in the silhouette, the movement is changed in that direction. If it is included, the next cell is moved downward. It is determined whether or not the preceding cell is included in the silhouette. By such determination, the content menu 19 flows while avoiding objects other than fingers. Of course, the remaining characters of the same content menu following the first character also move along the trajectory of the first character.

  As described above, when a silhouette other than when the fingertip is touched is detected, the content menu flows so as to avoid this silhouette. Even if an object such as a cup is placed on the screen 4 of the table surface 3 without being hidden, it is displayed and flows as it is without being hidden by it. In addition, the content list flow is similar to the river flow and is different from the conventional menu list display method. Therefore, the possibility that the menu list is used increases.

  FIG. 7 is a system configuration diagram showing the first embodiment shown in FIG. 1 and a specific example of a system using the first embodiment, where is a control unit, 31 is a video composition unit, 32 is a storage unit, and 33 is a touch sensor. , 34 is a communication unit, 35 is a server, 36 is a user database, 37 is a brochure database, 38 is a content database, 39 is an external control unit, 40 is an external communication unit, 41 is a communication network, 42 is a PC (personal computer), 43 Is an IC card reader / writer, and parts corresponding to those in the previous drawings are given the same reference numerals and redundant description is omitted. Here, although the touch sensor 33 is also shown, this is used in an embodiment described later, and is not provided in the first embodiment.

  In this figure, the video signals from the camera units 13a and 13b are supplied to the video synthesis unit 31, and these video signals are synthesized to produce a video signal for the entire information operation screen 15 (FIG. 3) by the screens 4a and 4b. Formed and supplied to the control unit 30. For this purpose, for example, first, the camera unit 13a images the screen 4a in the 1/2 field period, and then the camera unit 13b images the screen 4b in the next 1/2 field period. The camera parts 13a and 13b respectively image the screens 4a and 4b. The video synthesizing unit 31 stores the video signals from the camera units 13 a and 13 b in the memory for each field, synthesizes them, creates a video of the information operation screen 15, and supplies it to the control unit 30.

  The control unit 30 includes a CPU (Central Processing Unit) and the like, and performs control and signal processing of each unit using the storage unit 32. Also, each cell 21 (see FIG. 4) on the information operation screen 15 ) On the display screen 15 is managed. Then, the video signal from the video synthesizing unit 31 is processed, and the silhouette generated on the screens 4a and 4b is detected by the above-described method, and the position and shape of the silhouette are detected using the cell 21 included in the silhouette. ,judge.

  Note that the video composition unit 31 is not necessarily required, and the video signals from the camera units 13 a and 13 b may be directly supplied to the control unit 30.

  When the tag information (here, brochure ID) is read from the user's wireless ID tag by the tag reader 7, the control unit 30 takes in the brochure ID as the tag information, and stores information on the server 35 as described later. Originally, a content list corresponding to this pamphlet ID is created and supplied to the projection devices 12a and 12b, and displayed in the content list display area 16 (FIG. 3) of the display screen 15. The control unit 30 then flows the content menu 19 in the content list display area 16 according to the silhouette detected based on the video signal from the video synthesis unit 31 as described with reference to FIGS. (Scroll) is also controlled.

  Further, when the card reader 8 reads the user ID from the user's wireless IC card, the control unit 30 captures the user ID and, as will be described later, based on the information of the server 35, the content menu corresponding to the user ID Is supplied to the projection device 12a and displayed in the content storage area 18 (FIG. 3) of the display screen 15.

  Further, the control unit 30 reads the content list displayed in the content list display area 16 and the content selected in the content menu displayed in the content storage area 18 from the server 35 and holds it in the storage unit 32. Is supplied to the projection devices 12a and 12b and displayed in the content reproduction area 17 (FIG. 3) of the information operation screen 15. Such communication with the server 35 is performed using the communication unit 34.

  Furthermore, the control unit 30 takes in the detection outputs of the proximity sensors 9a and 9b and the seating sensor 10 and controls each unit.

  The server 35 includes an external communication unit 40 and can communicate with the user PC 42 via the control unit 30 and the communication network 41 of the table 1, and also includes a user database 36, a brochure database 37, and a content database. 38 and can provide content list information and content in response to a request from the control unit 30 of the table 1.

  Here, in the content database 38, as shown in FIG. 8A, contents such as movie files and text files are stored with unique content IDs attached thereto.

  The wireless IC card stores an ID (user ID) unique to the card. In the user database 36, as shown in FIG. 8B, for each user ID of the wireless IC card, an ID (content ID) of content that can be provided from the content database 38 with this user ID is stored. Yes. In this case, for example, for the user ID “U-00001”, the contents with the content IDs “C-002”, “C-004”, “C-006”, and “C-008” can be provided. Further, based on the content ID, the control unit 30 creates a content list for the wireless IC card read by the card reader 8 and displays it in the content list display area 16 of the information operation screen 15. .

  The wireless ID tag stores an ID (brochure ID) unique to the tag. In the brochure database 37, as shown in FIG. 8C, for each brochure ID of the wireless ID tag, an ID (content ID) of content that can be provided from the content database 38 with this brochure ID is stored. Yes. Here, for example, content IDs “C-001”, “C-002”, “C-003”, and “C-004” can be provided for the brochure ID “P-00001”. Based on the content ID, the control unit 30 creates a content list for the wireless ID tag read by the tag reader 7 and displays it in the content list display area 16 of the information operation screen 15.

  Therefore, when the user causes the tag reader 7 to read the wireless ID tag owned by the user, if the pamphlet ID read thereby is “P-00001”, the control unit 30 transmits the pamphlet ID to the server via the communication unit 34. Send to 35. In the server 35, the brochure ID is received by the external communication unit 40 and supplied to the external control unit 39. When the external control unit 39 performs a process for determining the input information and determines that this is a pamphlet ID, the content ID “C-001”, “C-002”, “ C-003 "and" C-004 "are read and transmitted from the external communication unit 70 to the table 1. In Table 1, this is received by the communication unit 34 and sent to the control unit 30. As described above, the control unit 30 stores the received content IDs “C-001”, “C-002”, “C-003”, and “C-004” in the storage unit 32, and these content IDs. Is created and supplied to the projection units 12a and 12b to be displayed as a content list that flows (scrolls) in the content list display area 16 (FIG. 3) of the information operation screen 15. When the user selects a content menu from the content list, the content of the selected content menu is read from the content database 38 of the server 35 and displayed in the content reproduction area 17 (FIG. 3) of the information operation screen 15.

  For the user ID read from the wireless IC card by the card reader 8, the control unit 30 reads the content ID for the user ID from the user database 36 of the server 35, creates a content menu for the content ID, and projects the content menu. Are supplied to the units 12a and 12b and displayed in the content storage area 18 (FIG. 3) of the information operation screen 15. When the user selects one of these content menus, the content of the selected content menu is read from the content database 38 of the server 35 and displayed in the content reproduction area 17 (FIG. 3) of the information operation screen 15. .

  The external communication unit 40 of the server 35 is connected to a user-owned PC 42 via a communication network 41, thereby enabling communication between the server 35 and the PC 42. The PC 42 is provided with a card reader 43 for a wireless IC card. By reading the user ID of a wireless IC card that can be read by the card reader 8 of the table 1, the content ID (ID) of this user ID from the user database 36 of the server 35 is read. 8B), a list of content menus is displayed on the display surface of the PC 42, and by selecting a predetermined content menu from this list, the corresponding content is captured from the content database 38 of the server 35. It can be displayed on this display screen. That is, by using the wireless IC card used for the table 1, the content of the content database 38 of the server 35 can be acquired even by the PC 42.

  The server 35 may be installed in the same building 44 as the table 1 (for example, a store such as a coffee shop or an exhibition hall), or may be connected to the table 1 via a network such as the Internet. Alternatively, it may be stored in a table.

  Next, the operation of the first embodiment having the above configuration will be described.

  FIG. 9 is a flowchart showing the overall operation of the first embodiment.

  In the table 1 shown in FIG. 1, when the user (customer) does not approach this and the proximity sensors 9a and 9b do not detect the user, nothing is displayed on the screens 4a and 4b. When the proximity sensor 9a, 9b detects that the user has approached (step 100 in FIG. 9), the control unit 30 (FIG. 7) operates to display the standby screen 50 (FIG. 10 (a)) on the screens 4a, 4b. (Step 101 in FIG. 9). On the standby screen 50, for example, a guidance message such as “Please sit down” is only displayed. When the user sits on the chair 2 according to this guidance, this is detected (step 102 in FIG. 9), and the operation explanation screen 51 (FIG. 10 (b)) is displayed on the screens 4a and 4b (step 103 in FIG. 9). . Although the detailed explanation is omitted, the operation explanation screen 51 is for explaining the operation method on the information operation screen displayed in the next step 104 of FIG. 9, and is displayed on the operation explanation screen 51. For example, when one of the keywords 51a displayed while flowing on the content list display screen 16 of the operation explanation screen 51 is touched according to a guide such as “Please select a flowing keyword by hand”, as described above, The display shifts to the display state of the information operation screen 15 (FIG. 3) on which an operation for browsing content can be performed (step 104 in FIG. 9).

  The information operation screen 15 includes an information operation screen when the tag reader 7 reads the brochure ID from the wireless ID tag, an information operation screen when the card reader 8 reads the user IC from the wireless IC card, There is an automatic information operation screen that is automatically displayed when reading is not performed.

  When the user sits on the chair 2 and operates the operation explanation screen 51, the automatic operation screen is displayed. By operating this, the contents of the content list displayed in the content list display area 16 of the automatic information operation screen are displayed. It can be acquired from the content database 38 of the server 35 and displayed in the content reproduction area 17.

  Then, while the automatic information operation screen is displayed, when the tag reader 7 reads the brochure ID from the wireless ID tag or the card reader 8 reads the user IC from the wireless IC card (step 105 in FIG. 9). The content ID or content corresponding to the brochure ID or user ID is read from the server 35 (step 106 in FIG. 9), and an information operation screen on which such information is displayed is displayed on the information operation screen 15.

  Even when the above information operation screen is displayed, the detection output of the seating sensor 10 is taken into the control unit 30 almost periodically (step 102 in FIG. 9), and when the user stands up from the chair 2, the ID is displayed. A recognition process for determining whether or not a wireless ID tag remains in the tag 7 and a recognition process for determining whether or not a wireless IC card remains in the card reader 8 are performed (step 107 in FIG. 9). The information on the information operation screen is cleared (step 109 in FIG. 9), and if any of them remain, the user is notified by voice or the like (step 108 in FIG. 9), and the information operation screen Is cleared (step 109 in FIG. 9). Then, it waits for the next user to approach (step 100 in FIG. 9).

  In this way, when the user leaves the chair 2, the seating sensor 10 detects this and clears the display screen so far on the screens 4a and 4b, so the history of the previous screen operation is refreshed. Is done.

  Here, the wireless ID tag and the wireless IC card will be described. As an example, only the content of the same genre can be viewed with the same wireless ID tag, and the genre of the content that can be browsed for each wireless ID tag is as follows. Make it different. For example, in order to view content of a sports genre, a wireless ID tag of this genre may be used. When the table 1 is installed in a store such as a coffee shop, the store may lend the wireless ID tag to the user.

  The wireless IC card allows the user to browse favorite content regardless of the genre. As will be described later, the content that can be browsed with the wireless IC card can be selected from the content list displayed in the content list display area 16 of the information operation screen 15 by using the wireless IC tag.

  The automatic information operation screen described above may be recommended content or, in the case of a store, content such as advertisements / advertisements there or commercials of other companies requested.

  Next, the information operation screen 15 in the first embodiment will be described.

(1) Automatic information operation screen 15a:
When the keyword 51a is touched on the operation explanation screen 51 shown in FIG. 10, an automatic information operation screen 15a shown in FIG. 11A is displayed, and a content list including a plurality of content menus 19 is displayed in the content list display area 16. Flowing in the direction (in the following, it is assumed to flow from the right to the left (scroll)), and this display is repeated. In FIG. 11, the content menu 19 shows seven items of “A ++++”, “B ++++”, “C ++++”, “D ++++”, “E ++++”, “F ++++”, and “G ++++”. The contents are A, B, C, D, E, F, and G, respectively.

  In this display state, as shown in FIG. 11B, when one content menu 19 (for example, “A ++++”) of this content list is touch-operated and selected with the fingertip 52, the server is processed as described above. The content corresponding to the content menu “A ++++” 19 is read from the 35 content database 38 (FIG. 7), and as shown in FIG. 11C, the content screen of the content A is displayed in the content reproduction area 17 of the automatic information operation screen 15a. 54a. In the content reproduction area 17, a “save” button 53a and a “close” button 53b are further displayed. On the content list display screen 16, the selected content menu “A ++++” 19 is removed. When the content menu 19 is selected and removed, a new content menu “F ++++” 19 is added to the content list and displayed.

  Therefore, as shown in FIG. 11D, when the “save” button 53a is touched with the fingertip, the content A icon (content icon) 55a is displayed in the content storage area 18 as shown in FIG. 11E. In addition, the display of the content screen 54a in the content reproduction area 17 ends.

  Next, when another content menu “B ++++” 19 in the content list display area 16 is touched and selected on the automatic information operation screen 15a shown in FIG. 11E, as shown in FIG. Similarly to the above, the content B corresponding to the content menu “B ++++” 19 is read from the content database 38 (FIG. 7) of the server 35, and this content is displayed in the content reproduction area 17 of the automatic information operation screen 15a as shown in FIG. A content screen 54b of content B is displayed. In the content reproduction area 17, a “save” button 53a and a “close” button 53b are further displayed. On the content list display screen 16, the newly selected content menu “B ++++” 19 is removed. When the content menu 19 is selected and removed, a new content menu “G ++++” 19 is added to the content list and displayed.

  Then, as shown in FIG. 12C, when the “save” button 53a is touched with the fingertip, the content icon “B” 55b of the content B is displayed in the content storage area 18, as shown in FIG. In addition, the display of the content B in the content reproduction area 17 ends. At this time, the content icon “A” 55a already displayed in the content storage area 18 by the operation shown in FIG. 11D is also displayed as it is, indicating that the two contents A and B are stored.

  Note that the content IDs are stored in the storage unit 32 (FIG. 7) for the content (contents A and B for FIG. 12D) whose content icons are displayed in the content storage area 18, This distinguishes stored content. In this way, content whose content ID is stored in the storage unit 32 is referred to as content being stored.

  Further, on the automatic information operation screen 15a shown in FIG. 12D, the content icon displayed in the content storage area 18, for example, the content icon “A” 55a is touched with the fingertip 52 as shown in FIG. 13A. Then, the content ID for the content icon “A” 55a is read from the storage unit 32 (FIG. 7), and the content A is read from the content database 38 of the server 35 based on the content ID. As shown in FIG. 13B, a content screen 54a is displayed in the content reproduction area 17 together with a “save” button 53a and a “close” button 53b. At the same time, the content ID of the content A is removed from the storage unit 32, and the selected content icon “A” 55a is deleted in the content storage area 18.

  In this display state, when the “close” button 53b is touched with the fingertip 52, the display of the content screen 54a in the content playback area 17 is stopped as shown in FIG. 16, the content menu “A ++++” 19 of this content A is added to the content list, and the content menu 19 that has been displayed so far (for example, the content menu “G ++++” added last) is 1 Are removed from this content list.

  In this way, by touching the content icon displayed in the content storage area 18, the content corresponding to the content icon is displayed in the content reproduction area 17, and the content desired by the user is displayed in this way. By saving the content, the desired content can be reproduced and browsed at any time without being selected from the content list.

  Further, in the automatic information operation screen 15a shown in FIG. 11C in which the content screen 54a of the content A is displayed in the content reproduction area 17, the content in the content list display area 16 as shown in FIG. When the menu 19 (for example, the content menu “B ++++”) is selected with the fingertip 52, the content icon “A” 55a is displayed as the content A displayed in the content reproduction area 17, as shown in FIG. In the content playback area 17, the content screen 54b of the content B of the selected content menu “B ++++”) 19 is displayed in place of the content screen 54a. Is done.

  14B, when the content icon “A” 55a in the content storage area 18 is touched with the fingertip 52 as shown in FIG. 14C on the automatic information operation screen 15a shown in FIG. ), The content screen 54a of the content A that has been stored in place of the content screen 54b is displayed in the content playback area 17, and at the same time, the content B is stored in place of the content A, and the content storage area 18 The content menu “B” 55b of the content B is displayed.

  In this way, a plurality of stored contents can be viewed alternately at any time, and unnecessary contents can be canceled by using the “Close” button 53b. it can.

(2) Information operation screen 15b by wireless ID tag:
As shown in FIG. 15 (a), when the wireless ID tag 56a is placed at a position opposite to the tag sensor 7 on the table surface 3 (FIG. 1) (specified by a mark, a frame, etc.), the tag sensor 7 reads the brochure ID. As described above, the information operation screen 15b is displayed in the content list display area 16 so that the content list by the content menu 19 corresponding to the brochure ID flows. Then, when the content menu is displayed in this way, as shown in FIG. 15B, if it is removed from the position opposite to the tag sensor 7, the content menu 19 is not displayed. The automatic information operation screen 15a described with reference to FIGS. 11 to 14 is displayed. Before the predetermined time elapses, as shown in FIG. When placed, a content list for this wireless ID tag is displayed. When the wireless ID tag 56b at this time is different from the wireless ID tag 56a in FIG. 15A, the displayed content list is also different.

  The information operation screen 15b can be operated in the same manner as the automatic information operation screen 15a described with reference to FIGS. 11 to 14, thereby allowing the contents list to be browsed and stored with respect to the wireless ID tag. it can.

(3) Information operation screen 15c by wireless IC card:
For example, now, in the display state of the automatic information operation screen 15a shown in FIG. 12D or the display state of the similar information operation screen 15b by the wireless ID tag 56 (this is shown in FIG. 16A), FIG. As shown in FIG. 16B, when the wireless IC card 57 is placed at a position on the table 3 facing the card reader 8 (marks, frames, etc. are shown), the card reader 8 causes the wireless IC card to be placed. 57, the user ID is read from the user database 36 (FIGS. 7 and 8B) of the server 35 and the content corresponding to the content ID is stored in the content storage area 18 as described above. An information operation screen 15c showing icons is displayed on the screens 4a and 4b. Here, in addition to the content icons “A” 55a and “B” 55b of the contents A and B originally stored, content icons “I” 55d and “L” 55d by the wireless IC card 57 are displayed. At this time, a “mail transmission” button 58 is also displayed in the content storage area 18.

  The functions of the content icons displayed in the content storage area 18 are all the same. As shown in FIG. 16C, when the content icon “RO” 55d is selected with the fingertip 52, as shown in FIG. In addition, the content screen 54 c of the content “RO” corresponding to the content icon “RO” 55 d is displayed on the content reproduction screen 17. Of course, the content icon “RO” 55 d is removed from the content storage area 18. At this time, a “save” button 53a and a “close” button 53b are also displayed. When the “close” button 53b is touched as shown in FIG. 16E, the content is displayed as shown in FIG. The content screen 54c and the respective buttons 53a and 53b in the playback area 17 are no longer displayed. Instead, the content menu “RO ++++” 19 of the content “RO” is added to the content list in the content list display area 16 and displayed. The

  In this display state, for example, when the wireless IC card 57 is removed from the position opposite to the card reader 8, as shown in FIG. 17B, the content icons “A” 55a and “B” in the content storage area 18 are displayed. The contents “A”, “B”, and “I” for 55 b and “I” 55 c are registered in the wireless IC card 57. However, this content is registered in the user database 36 (FIGS. 7 and 8B) in the server 35 (FIG. 7) with respect to the user ID of the wireless IC card 57. "," By registering the content ID of "I". Accordingly, when the wireless IC card 57 is placed again at the position opposite to the card reader 8, the contents “A”, “B”, and “I” are retrieved from the user data base 36 by the user ID of the wireless IC card 57. After the ID is read, as shown in FIG. 17 (c), content icons “A” 55a, “B” 55b of content “A”, “B”, “I” are displayed in the content storage area 18 of the information operation screen 15c. , “I” 55c is displayed.

  Also, for example, as shown in FIG. 17C, when the “mail transmission” button 58 is touched on the information operation screen 15c of the wireless IC card 57 as shown in FIG. In FIG. 7, the content IDs for the content icons “A” 55a, “B” 55b, and “I” 55c in the content storage area 15c are the communication unit 34 and the external communication unit 40 of the server 35 in FIG. It is also possible to send the data to the PC 42 of the mail address stored in the wireless IC card 57 via the communication network 41. In the PC 42, these content IDs can be written on the IC card by the card reader / writer 43. Then, by using this IC card for this PC 42, a desired content is requested from the PC 42 to the server 35, and the content requested from the server 35 to the content database 38 is provided to the PC 42.

  As shown in FIG. 17A, the wireless IC card 57 is inserted into the card reader 8 in a state where the content menu “RO ++++” 19 for the content “RO” from the wireless IC card 57 is displayed in the content list display area 16. When removed from the facing position, the content menu “RO ++++” 19 is also removed from the content list in the content list display area 16. Further, for example, the content menus “A” and “B” for the content icons “A” 55 a and “B” 55 b from the content list on the automatic information operation screen 15 a displayed in the content storage area 18 are displayed in the content list display area. Return to the 16 content list. The content “RO” that has been removed can be browsed by using the wireless ID tag including the content as described above, and can be registered in the wireless IC card at this time.

  In this way, the contents that can be browsed with the wireless IC card can be changed.

  In the above description, the “save” button 53a and the “close” button 53b are displayed at the same time as the content screen 54 on the content playback area screen 17 of the information operation screen 15. However, as shown in FIG. Thus, the “save” button 53a and the “close” button 53b are not displayed on the normal content screen 54, and when the fingertip 52 touches the content screen 54 as shown in FIG. When the “close” button 53b is displayed and the fingertip 52 is released, the display state shown in FIG. 18 is restored, and the fingertip 52 is moved in the touched state. As shown in FIG. When the button 53a is touched, this functions, and the content icon 55 is displayed in the content storage area 18 as described above and as shown in FIG. It is also possible to to be.

  FIG. 19 is a diagram showing a specific example of a method in which when the content screen is displayed in the content playback area 17, the display direction of the content screen can be changed depending on the direction of the fingertip touching the content screen. is there.

  In FIG. 19A, when the fingertip 52 touches the content screen 54 with the hand 20 facing left as shown in FIG. 19A, the touching starts and the fingertip 52 as shown in FIG. The silhouette 52a appears, and when the elongated silhouette 52a becomes substantially maximum as shown in (c), the center of gravity 59 is obtained. Then, when the fingertip moves away from the content screen 54, the movement of the center of gravity is detected ((d) indicates the middle), and the reception 59 when the silhouette 52a shown in (c) is re-enlarged. The movement direction of the delayed center of gravity is detected (e), and the content screen 54 is displayed in the direction of the movement direction. As a result, the content screen 54 is displayed in the direction of the hand 20, that is, leftward as shown in FIG.

  In FIG. 19B, the hand 20 is oriented to the right as shown in FIG. 19B. In the same manner as described above, the content screen 54 is shown in FIGS. Will be displayed to the right.

  In the first embodiment described above, the infrared LED 6 is used in FIG. 1 to obtain the silhouette of the object. However, the present invention is not limited to this, and an illumination lamp such as an incandescent bulb may be used as long as it includes infrared rays. You may make it use. Further, as long as the position of an object placed on the table surface 3 of the top plate of the table 1 can be detected, for example, as shown in FIG. You may make it give a touch function using touch sensors, such as a sensor. However, in this case, in FIG. 7, the infrared LED 6, the camera units 13 a and 13 b, and the video composition unit 31 are not provided, and the position of the silhouette on the screens 4 a and 4 b is detected using the touch sensor 33. Become.

It is a figure which shows one Embodiment of the table-type information terminal by this invention. It is a figure for demonstrating the effect by the infrared irradiation from the infrared LED in FIG. It is a figure which shows the area | region division of the display surface by the screen in FIG. FIG. 4 is a diagram illustrating a flow of a silhouette and a content menu when the content list display area in FIG. 3 is touched with a fingertip. FIG. 4 is a diagram showing a silhouette when an object other than a fingertip is placed in the content list display area in FIG. 3. It is a figure which shows the flow of the content menu with respect to the silhouette shown in FIG. FIG. 2 is a diagram illustrating an internal configuration of the first embodiment illustrated in FIG. 1 and a specific example of a system using the same. It is a figure which shows typically one specific example of each database in FIG. 2 is a flowchart showing a specific example of the overall operation of the first exemplary embodiment shown in FIG. 1. It is a figure which shows a specific example of the standby screen and operation description screen in 1st Embodiment shown in FIG. It is a figure which shows a part of specific example of the transition of the automatic information operation screen displayed on the screen of FIG. It is a figure which shows the transition of the automatic information operation screen following FIG. It is a figure which shows the transition of the automatic information operation screen following FIG. It is a figure which shows the transition of the automatic information operation screen following FIG. It is a figure which shows a part of one specific example of the transition of the information operation screen by the wireless ID tag displayed on the screen of FIG. It is a figure which shows a part of one specific example of the transition of the information operation screen by the wireless IC card displayed on the screen of FIG. It is a figure which shows the transition of the information operation screen following FIG. It is a figure which shows an example of the operation method on the information operation screen displayed on the screen of FIG. It is a figure which shows the other specific example of the operation method on the information operation screen displayed on the screen of FIG. It is an external appearance perspective view which shows the principal part of 2nd Embodiment of the table-type information terminal by this invention.

Explanation of symbols

1 Table 2 Chair 3 Table surface 4, 4a, 4b Screen 5 Screen 6 Infrared LED
7 Tag reader 8 Card reader 9a, 9b Proximity sensor 10 Seating sensor 11 Front outer surface 12 Projector 13 Camera unit 14 Object 15, 15a-15c Information operation screen 16 Content list display area 17 Content display area 18 Content storage area 19 Content menu 20 Hand Tip 20a silhouette 21 cell 22 object 22a silhouette 30 control unit 31 video composition unit 32 storage unit 33 touch sensor 35 server 36 user database 37 brochure database 38 content database 52 fingertip 52a silhouette 53a "save" button 53b "close" button 54, 54a to 54c Content screen 55a to 55d Content icon 56a, 56b Wireless ID tag 57 Wireless IC card 58 “Send mail” button 59 the center of gravity 60 touch sensor

Claims (2)

In a table type information terminal that provides a screen on a table surface of a table, and projects and displays an image on the screen from a projection device provided in the table,
In the table,
A camera unit for imaging the screen;
Detects the silhouette of an object from the video signal from the camera unit instructions are built on the table surface in the screen, and a determining means for determining the type of the object causing the silhouette,
The screen is virtually divided into a plurality of cell regions arranged in a grid, and position information is set for each of the cell regions, each of the cell regions is composed of a collection of a plurality of pixels,
The determination means includes
Detecting a luminance level for each pixel of a video signal imaged by the camera unit, and determining that the cell region in which a predetermined number of pixels having the luminance level equal to or lower than a predetermined threshold exists in the silhouette;
The set of cell regions determined to be present in the silhouette is defined as the shape of the silhouette, and the type of the object is determined by determining whether the shape of the silhouette is the shape of the tip of the hand or the shape of another object. And determining the position of the cell region corresponding to the fingertip of the tip of the hand when the determined type of the object is the tip of the hand,
The screen displays information operations including a content list display area that is scrolled so that a content list including a content menu sequentially flows in the horizontal direction.
Control means for controlling the flow of the content list projected by the projection device according to the determination result of the determination means when an object that causes a silhouette is placed in the content list display area ;
When the shape of the silhouette is a shape other than the shape of the tip of the hand, the control means is configured to prevent the content list from being displayed in the cell area determined to exist in the silhouette. A table type information terminal characterized by controlling a flow . In claim 1,
The content list is text information,
The cell area is an area where one character in the character information can be displayed .

Images