JP2015210509A - Display divice - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of changing an image to be superposed on a mirror image without performing any troublesome operation.SOLUTION: A display device (101) includes a display control part (25) which displays an image, acquired according to only a movement of an operation region, in a specific area, corresponding to a selection region specified by a selection region specification part (26), in a person area where an image of a person transmitted through a half-mirror is displayed on a display surface.

Description

  The present invention relates to a display device, and more particularly to a display device having a light transmission / reflection function of transmitting part of light and reflecting part of light on a display surface.

  As a display device having a light transmission / reflection function of transmitting part of light and reflecting part of the light on the display surface, a display device with a so-called mirror function, for example, Patent Document 1 discloses a back having a half mirror on the display surface A light-type image display device is disclosed.

JP 11-015392 A (published January 22, 1999)

  By the way, in the conventional display device with a mirror function, the position, size, and shape are fixed in advance on the display by the system so as not to interfere with the image of the user reflected in the mirror. .

  Therefore, there arises a problem that the user cannot dynamically respond to the desire to display the combined and displayed image superimposed on the mirror image.

  Therefore, it is conceivable to use a remote control or a touch panel as means for the user to operate the display position and size of the image displayed on the display, but the following problems arise.

  When the touch panel is used, there is a restriction that it cannot be installed in a place where the touch panel cannot be reached. On the contrary, if the touch panel is installed in a place where the hand can reach, a fingerprint may be attached to the screen and the function as a mirror may be impaired.

  Further, when a remote controller is used, the remote controller is operated every time the user wants to perform an operation, and the troublesomeness may hinder the function as a mirror.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to superimpose an image on a mirror image without performing troublesome operations when the image on the display surface is superimposed on the mirror image. Is to provide a display device with a mirror function.

  In order to solve the above-described problem, a display device according to one embodiment of the present invention is a display device in which a light-transmitting / reflecting member that transmits part of light and reflects part of the light is reflected over the display surface. A region detecting means for detecting a person region in which an image of a person existing on the light reflecting surface side of the light transmitting and reflecting member is reflected on the light reflecting surface side; and a person existing on the light reflecting surface side of the light transmitting and reflecting member. Display control means for displaying a human image obtained by photographing so as to transmit the light transmitting / reflecting member in a person area detected by the area detection means, and each part of the human body detected from the person video Specifying a part including an area that overlaps at least a part of the display area of the operation part as a selection part, and the display control means includes: Special features corresponding to the selected part In the region, it is characterized in that to display an image for updating acquired in accordance with only the movement of the operation site.

  According to one embodiment of the present invention, when a person image is displayed superimposed on a mirror image, an update image can be displayed only by the movement of the operation part. Therefore, the mirror image can be displayed without performing a troublesome operation. There is an effect that the image to be overlaid can be changed.

1 is a schematic configuration block diagram of a display device according to Embodiment 1 of the present invention. It is a schematic block diagram of the display apparatus shown in FIG. 3 is a flowchart showing a flow of image display processing in the display device shown in FIG. 1. It is a flowchart which shows the flow of the image update process in the image display process shown in FIG. It is a figure explaining the flow of the image update process in the display apparatus shown in FIG. (A) and (b) are the figures for demonstrating the adjustment method of the image size at the time of an image update, and a display position. It is a schematic block diagram of the display apparatus which shows the modification of this Embodiment 1. It is a schematic block diagram of the display apparatus which concerns on Embodiment 2 of this invention. (A) and (b) are the figures for demonstrating the expansion process in the display apparatus shown in FIG. (A) and (b) are the figures for demonstrating the reduction process in the display apparatus shown in FIG. It is a schematic block diagram of the display apparatus which concerns on Embodiment 3 of this invention. (A)-(c) is a figure for demonstrating the replacement display of the mirror image and image in the display apparatus which concerns on Embodiment 4 of this invention.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail. In the present embodiment, a half mirror will be described as an example of a light transmitting and reflecting member that functions as a mirror.

(Outline of display device)
FIG. 1 is a diagram for explaining an overview of a display device with a mirror function (hereinafter referred to as a display device) 101 according to the present embodiment.

  As shown in FIG. 2, the display device 101 includes a display unit (display unit) 11, a half mirror (light transmitting / reflecting member) 12 disposed on the display surface 11 a of the display unit 11, and a display unit 11. A camera 13, a microphone 14, and a speaker 15 are provided around the camera.

  The display unit 11 is a display means for displaying an image, and includes a liquid crystal display panel. Other than the liquid crystal display panel, an EL (organic or inorganic), PDP (Plasma Display Panel), SED (Surface-conduction Electron-emitter Display) is used. FPD (Flat Panel Display) such as the above may be used.

  The half mirror 12 is a light transmitting / reflecting member formed by forming a very thin reflective film on a plate glass or an organic glass such as acrylic so that the incident rate and reflectance of light are the same, and making it semitransparent. is there. As the half mirror 12, a commercially available one can be used.

  As described above, since the half mirror 12 is arranged so as to overlap the display surface 11a of the display unit 11, the image displayed on the display surface 11a is transmitted through and projected from the outside toward the display surface 11a. A part of the incident light is reflected to generate a mirror image.

  The camera 13 is a photographing unit for photographing a person in front of the display device 101 from the display surface 11 a side, and is provided at two places on the left and right sides of the peripheral part that does not contribute to the display of the display unit 11. The two cameras 13 are provided in order to measure the distance between the person in front of the display device 101 and the display surface 11 a of the display unit 11.

  The camera 13 is a general small digital camera using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like as an image sensor, and can photograph a person in front of the display device 101. Anything is acceptable.

  Furthermore, in the present invention, means (operation part detection means) for detecting an operation part (a hand in this embodiment) of a person in front of the display device 101 is essential. Therefore, in the present embodiment, a person in front of the display device 101 is photographed by the camera 13, and each part of the human body (head, neck, arms, hands, legs, feet, torso, waist, etc.) is taken from the photographed image. ) And the fingertip 16a is detected as an operation part from the detected parts.

  The microphone 14 is a means for capturing sound produced by a person in front of the display device 101, and is configured by a general microphone used for a smartphone, a mobile phone, or the like. Further, an individual may be specified from the voice captured by the microphone 14.

  The speaker 15 is a unit that emits voice to a person in front of the display device 101, and is configured by a general speaker used for a smartphone, a mobile phone, or the like. The speaker 15 is also used as a means for notifying a user of information necessary for the person in front of the display device 101 by voice. For example, the speaker 15 emits information corresponding to the images 17 a to 17 d displayed on the display surface 11 a of the display unit 11 and notifies the person in front of the display device 101.

  The camera 13 may be used to detect the movement of a person in front of the half mirror 12. The result of the motion detection is input to the control device 20, and a command corresponding to the motion is executed (a gesture input process). For example, the fingertip of a person may be detected, its movement detected, and customization information displayed at the position pointed by the fingertip may be selected.

(Details of display device)
Details of the display device 101 will be described below with reference to FIG.

  As shown in FIG. 2, the display device 101 is connected to the management server 2 via a communication network (not shown), and includes a display unit 11, a camera 13, a microphone 14, a speaker 15, and a control device that controls these. 20 is provided.

  The control device 20 includes an information acquisition unit (image acquisition unit) 21, a human body part detection unit 22, an operation part detection unit 23, a person region detection unit (region detection unit) 24, a display control unit (display control unit) 25, and a selected part. A specifying unit (specifying means) 26 is included.

  The human body part detection unit 22 detects each preset part of the human body from the photographed image of the person photographed by the camera 13. Specifically, each part of the human body (head, neck, arms, hands, legs, toes, torso, waist, etc.) is detected from the captured video of the person using the existing image recognition processing as described above. To do.

  The operation part detection unit 23 detects an operation part used for an operation instruction among the parts of the human body detected by the human body part detection unit 22. Specifically, a part corresponding to the hand of the human body among the parts of the human body is detected as an operation part. Reference numeral 16a in FIG. 2 indicates a portion corresponding to the hand.

  The information acquisition unit 21 acquires necessary information from the management server 2 connected via a communication network such as the Internet. Here, the necessary information is an image (an image of a jacket, trousers, shoes, a hat, a skirt, etc.) to be changed, which will be described later, and may be other information to be changed.

  Further, the information acquisition unit 21 acquires information from the management server 2 based on an instruction from the display control unit 25 according to the instruction content of the operation part detected by the operation part detection unit 23. For example, if the instruction content of the operation part indicates content indicating the user's head, the hat image is acquired from the management server 2.

  The information acquisition unit 21 sends the acquired information to the display control unit 25.

  As shown in FIG. 2, the person area detection unit 24 detects an area (person area 11b) in which an image of a person who has passed through the half mirror 12 is displayed on the display surface 11a. Here, for example, the distance between the display device 101 and the person is obtained from the photographed image of the person in front of the display device 101 photographed by the two cameras 13, and the mirror image 16 projected on the half mirror 12 from this distance. The display position of the mirror image 16 projected on the display surface 11a of the display unit 11 of the display device 101 is detected as the person region 11b.

  The person area detection unit 24 sends the detected person area 11 b to the display control unit 25.

  The selected part specifying unit 26 specifies, as the selected part, a part displayed in the specific area that is a display area at least partially overlapping the display area of the operation part detected by the operation part detecting unit 23 in the person region 11b. . That is, the specified selected part is a part to be operated. Here, for example, assuming that the operation part is a person's fingertip 16a, the degree of overlap between the display area of the person area 11b on the display surface 11a of the fingertip 16a and the display area on the display surface 11a of each part of the human body is detected. A display area having the largest degree is set as a specific area, and a part displayed in the specific area is specified as a selected part.

  The selected part specifying unit 26 sends the specified selected part to the display control unit 25.

  The display control unit 25 controls the display position of the video to be displayed on the display surface 11 a of the display unit 11. Specifically, the display control unit 25 specifies the display position of the person region 11b from the person region detection unit 24, and displays a photographed image (person image) of the person photographed by the camera 13 in the person region 11b. Let As a result, the mirror image of the person displayed on the half mirror 12 and the photographed video of the person are displayed in an overlapping manner in the person area 11b on the display surface 11a.

  The display control unit 25 can also convert the captured image from the camera 13 to a desired size and display it as a captured image of a person at a desired position on the display surface 11 a of the display unit 11.

  Further, the display control unit 25 extracts an area (specific area) corresponding to the display coordinates of the selected part specified by the selected part specifying part 26 on the display surface 11a from the person area 11b detected by the person area detecting unit 24. Then, the extraction area is highlighted, synthesized with a photographed image of a person from the camera 13, and output to the display unit 11 as display data. Thereby, the person in front of the display apparatus 101 can confirm that the part of his / her body instructed (selected) by himself / herself is highlighted. Here, the highlight display is realized by superimposing the highlight image on the selected part.

  The display control unit 25 receives an operation instruction by the operation part detected by the operation part detection unit 23 in a highlighted state, acquires information according to the received operation instruction from the information acquisition unit 21, and The acquired information (update image) is displayed in the highlighted area (specific area). That is, the display control unit 25 displays an update image acquired in accordance with the movement of the operation part in the specific region.

  Here, for example, if the operation part is a hand, the operation instruction for acquiring an image for update can be obtained by rotating the hand (movement of the operation part). This operation instruction is transmitted to the display control unit 25 by analyzing a photographed image of a person by the camera 13. This can be realized by associating an operation instruction with a corresponding command (acquiring information). Note that the operation instruction may be not only the rotation of the hand but also an action of shaking the hand, and is not particularly limited.

(Image update processing)
In the following, regarding the flow of processing for identifying and highlighting a part of the human body by the user and displaying an update image in the highlighted specific area, the flowcharts shown in FIGS. 3 and 4 and the table shown in FIG. This will be described with reference to examples.

  First, the display position of the mirror image is detected (step S11). Specifically, the person area detection unit 24 detects an area (person area 11b) in which an image of a person transmitted through the half mirror 12 is displayed on the display surface 11a.

  Next, the human body part is detected (step S12). Specifically, each part of the human body is detected by the human body part detection unit 22 from the captured video of the person using an image recognition processing technique.

  Subsequently, the operation site is detected (step S13). Specifically, the operation part detection unit 23 detects a preset part as an operation part from the detected parts. In the present embodiment, a human fingertip 16a will be described as an operation part.

  Through the processing so far, the user designates a body part with the fingertip 16a in a state where the mirror image 16 is projected as shown in FIG.

  Subsequently, the selected part is specified (step S14). Specifically, the selected part specifying unit 26 specifies, as a selected part, a part designated by the operation part detected by the operation part detecting unit 23 among the parts detected by the human body part detecting unit 22.

  Then, the highlighted part is highlighted (step S15). For example, as shown in FIG. 5B, a region corresponding to the selected portion 16b pointed to by the fingertip 16a is highlighted. Here, when the highlighted portion is a desired portion, that is, when it is correct, the user forms an OK mark using the fingertip 16a. Thereby, the area to be highlighted is determined. In this case, the OK mark formed using the fingertip 16a is captured by the camera 13, and is recognized by analyzing the captured image. In addition to instructing the OK mark with the fingertip 16 a, “OK” may be uttered. In this case, an existing voice recognition process is performed, “OK” is recognized, and an area to be highlighted is determined.

  If the part indicated by the fingertip 16a is not a desired part, the body part is indicated again using the fingertip 16a.

  Subsequently, an image update process is executed. Here, the image update process refers to exchanging an image already displayed in a region corresponding to the highlighted selected region 16b with another image according to a user instruction.

  That is, in step S21 shown in FIG. 4, if an image acquisition operation by the operation part is detected, image acquisition is performed (step S22). The image acquisition operation by the operation part indicates performing a gesture such as rotating the fingertip 16a. Here, by associating the rotation of the fingertip 16a as an image acquisition operation, the user can acquire an image for update by rotating the fingertip 16a.

  Subsequently, the acquired image is displayed in a region corresponding to the selected region highlighted (step S23). Here, as shown in FIG. 5C, the image 17 (hat) to be displayed in the region corresponding to the highlighted selected part 16b is displayed side by side in the horizontal direction across the part 16b. . By rotating the fingertip 16a, the user sequentially displays the displayed image 17 in a region corresponding to the highlighted selected portion 16b while scrolling.

  Therefore, by using the display device 101 having the above configuration as a mirror at home, a state in which the user wears the product is displayed on the display device 101 without actually wearing the product, and the coordinates of the clothing and the product are displayed. You can consider purchasing.

  In other words, if the display device 101 having the above configuration is used as a home mirror, the user designates a position for displaying clothes while looking at the image reflected in the mirror, and for example, looks at the mirror image and moves the hand to a part where the clothes are to be changed. Or by pointing a part of his / her body, it is detected by the camera that acquires the user's figure which part of the mirror image the user is specifying. Then, the size and shape of the clothes corresponding to the selected part (part designated by the user) are changed to the size of the mirror image, and are displayed superimposed on the area corresponding to the selected part.

(Adjusting the size of the superimposed image)
Next, the adjustment of the size of the image to be superimposed on the selected part and the adjustment of the display position will be described below with reference to FIGS. Hereinafter, for convenience of explanation, “selected part” is referred to as “selected part”, and “displaying an update image in a display area for displaying the selected part” is referred to as “overlaying an image on the selected part”. .

  First, as shown in FIG. 6A, the height (length in the vertical direction) A of the selected portion on the screen of the display device viewed from the user standing on the half mirror side is obtained.

  A can be obtained by the following equation.

A = {E− (H + V)} / 2+ (H + V) − (E + H) / 2 = V / 2
Here, E indicates the height of the user's eyes, V indicates the height of the selected portion of the mirror image, and H indicates the height obtained by subtracting the height V of the selected portion from the distance from the mirror image to the ground.

  Next, the position (height from the ground) B of the selected part on the screen of the display device as viewed from the user standing on the half mirror side is obtained.

  B can be obtained by the following equation.

B = H + (E−2H) / 2 = (E + H) / 2
Subsequently, as shown in FIG. 6B, the width (lateral length) C of the selected portion on the screen of the display device viewed from the user standing on the half mirror side is obtained.

  C can be obtained by the following equation.

C = W / 2
Here, W indicates the width of the selected part of the mirror image of the user.

  The image size to be displayed on the display device is adjusted so as to be the height A and width C of the selected part obtained as described above, and is displayed at the position B of the selected part. By matching the shape, the user can see the image superimposed on his mirror image without a sense of incongruity.

  In addition, the highlight display is realized by overlaying the highlight image on the selected part in the mirror image, but the highlight display can be realized by blinking the selected part instead of overlaying the highlight image. Good.

  When the mirror image moves while the image is superimposed on the selected part, the superimposed image may be continuously displayed following the movement of the mirror image. In this case, when the mirror image moves and the selected part is hidden, that is, the selected part is not projected on the half mirror, the image displayed on the selected part is also hidden.

  Alternatively, the user may move the image by performing a gesture such as touching the image displayed over the selected region. For example, when the image is clothing, the user moves the clothing image with a gesture of touching the clothing while looking at the mirror image.

  Note that the image to be superimposed on the selected part is acquired from the management server 2 via the communication network as described above. Thereby, when the acquired image is a garment, the user can acquire an image of a product such as a garment that has not yet been purchased and can virtually coordinate it.

  Further, the image to be superimposed on the selected part can be an image obtained by photographing clothes and the like owned by the user, not from the management server 2. In this case, the image acquired by the information acquisition unit 21 may be stored in the apparatus instead of the management server 2 and the image captured by the user may be read out as necessary.

  As a result, the clothes that the user has can be virtually coordinated, so that the trouble of actually wearing the clothes can be saved.

  In addition, the user wears clothes that the user owns, captures the image with the camera 13 of the display device 101, identifies the selected region by the user himself from the captured image, and corresponds to the identified selected region. May be extracted and stored as an image for coordination. In this case, it is possible to coordinate without wearing the clothes that you have.

(Modification)
(Details of display device)
FIG. 7 is a block diagram showing an outline of the display device 102 having a configuration for specifying a selected part not by a gesture but by a voice.

  The display device 102 basically has the same configuration as the display device 101 shown in FIG. 1, but as a configuration for specifying by voice, instead of the operation site detection unit 23, a voice recognition processing unit 27, a voice recognition database. 28.

  The voice recognition processing unit 27 recognizes voice data input from the microphone 14 and outputs a command corresponding to the recognized voice data to the selected part specifying unit 26. The command is stored in the voice recognition database 28 in association with the voice data. Here, the command is a command for specifying the selected part. That is, by recognizing the voice data input from the microphone 14, the command corresponding to the recognized voice data is read from the voice recognition database 28 and sent to the selected site specifying unit 26, so that the selected site specifying unit 26 transmits the command. A part corresponding to the given command is specified as a selected part.

  Thus, the processes other than specifying the selected part by voice are the same processes as those of the display device 101 described above.

  In the above explanation, it was assumed that the user did not wear the hat to be coordinated first, but when the user has previously worn the hat, display of the hat image coordinated by the hat that has been worn beforehand There is a risk of disturbing.

  In addition, even when the outer garment worn by the user is a long sleeve and the outer garment to be coordinated is a short sleeve, the original long sleeve garment may interfere with the display of the image of the outer garment to be coordinated. .

As described above, the clothing or hat that the user first wears may be subjected to image processing so as to be hidden by the highlight display image at the stage when it is specified as the selected portion. As a result, images of clothes and hats to be coordinated can be displayed without being disturbed by the original clothes and hats.
[Embodiment 2]
The following will describe another embodiment of the present invention. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

(Details of display device)
FIG. 8 is a block diagram illustrating an outline of the display device 103 according to the present embodiment.

  The display device 103 is substantially the same as the display device 101 shown in FIG. 1 of the first embodiment, and uses a liquid crystal display panel as the display unit 11 and further irradiates the liquid crystal display panel with light from the back side. The difference is that (light amount adjusting means) 30 is provided.

  In the present embodiment, an example will be described in which a captured image obtained by photographing a person (user) standing in front of the display device 103 is enlarged or reduced. Normally, in the display device 103, the mirror image and the captured image have the same size and overlap. However, when the captured image of the user who captured the user is enlarged or reduced, the mirror image of the user is different from the size of the captured image of the user. It is necessary to devise so as not to project.

  Here, a liquid crystal display panel is used as the display unit 11, and the back surface of the liquid crystal display panel is irradiated with light by the backlight device 30, thereby adjusting the function as a mirror in the half mirror 12 disposed on the front surface of the display unit 11. May be. In this case, by increasing the intensity of light irradiation by the backlight device 30 and increasing the light irradiated from the display unit 11, the function as a mirror in the half mirror 12 is reduced, and the display unit 11 displays the light. The displayed video can be shown to a person standing in front of the display device 103 without being disturbed by the mirror image. In particular, in a place where it is desired to increase the light intensity, it is effective to reduce the function as a mirror if the display on the liquid crystal display panel is close to white. Conversely, by reducing the intensity of light irradiation by the backlight device 30 and weakening the light irradiated from the display unit 11, the function as a mirror in the half mirror 12 is improved and displayed on the display unit 11. It can be shown to a person standing in front of the display device 103 with a mirror image superimposed on the video. As in the case of increasing the intensity of light, it is effective for improving the function as a mirror to make the display of the liquid crystal display panel close to black especially in a position where it is desired to decrease the intensity of light.

  Depending on the size of the display surface of the display device 103 and the position where the person stands, the mirror image projected on the display surface may be the upper body of the person or the whole body. For example, when the mirror image is the whole body or upper body, if the image to be displayed on the selected part is clothing, it is easy to specify the selected part desired by the user, but in the case of small items such as glasses and watches, the user However, there is a possibility that a desired selection site cannot be appropriately selected.

(Enlargement process of selected part)
Therefore, when the user specifies the selected part, it is conceivable to enlarge and display the user's captured video displayed on the display device 103.

  FIG. 9A is a diagram illustrating a state in which the user's mirror image 16 and the user's captured image 16 ′ overlap each other, and FIG. 9B is an enlarged view of the user's mirror image 16 without being projected. It is a figure which shows the state which displayed only the user's picked-up image | video 16 '.

  That is, when the user intends to specify glasses as the selected part, as shown in FIG. 9A, the user's captured video 16 ′ displayed on the display surface 11a of the display device 103 is enlarged, and The amount of irradiation light of the backlight device 30 is increased so as not to reflect a mirror image, and the state shown in FIG. 9B is set, and the selected portion 16b corresponding to the glasses is specified. Of course, the specified selected part 16b is highlighted.

  In this way, by enlarging the captured video 16 ', even if the selected part is small, it can be easily identified.

  After specifying the selected portion 16b ′ corresponding to the glasses, the state is returned to the state shown in FIG. 9A again, and an image corresponding to the glasses displayed on the selected portion 16b ′ is acquired, and the image is displayed. Change sequentially to check the coordinates of the glasses.

  Note that after specifying the selected portion 16 b ′, the coordinate adjustment of the glasses may be performed in the state shown in FIG. 9B instead of returning to the state shown in FIG.

  On the other hand, as shown in FIG. 9 (a), when the user wants to coordinate shoes without the lower body of the mirror image 16 being projected, the process opposite to the above process, that is, the reduction of the photographed image 16 ′ is performed. Process.

(Selection part reduction processing)
Therefore, when the user specifies the selected part, it is conceivable to display the whole body by reducing the captured video of the user displayed on the display device 103.

  FIG. 10A is a diagram showing a state in which the user's mirror image 16 and the user's captured image 16 ′ overlap each other, and FIG. 10B is a view showing that the user's mirror image 16 is not projected and is reduced. It is a figure which shows the state which displayed only the user's picked-up image | video 16 '.

  In other words, when the user intends to specify the currently worn shoe as the selected part, as shown in FIG. 10A, the user's captured video 16 ′ displayed on the display surface 11a of the display device 103 is reduced. In addition, the amount of irradiation light of the backlight device 30 is increased so that the mirror image 16 is not reflected, and the state shown in FIG. 10B is obtained, and the shoe corresponds to the shoe by the operation part 16a ′. The selected part 16c ′ is specified. Of course, the specified selected part 16c 'is highlighted.

  Thus, if the captured video 16 'is reduced, it is possible to display the lower half of the person that is not projected on the display surface 11a. As a result, it is possible to specify the selected part in the area of the person that is not projected on the display surface 11a.

  After specifying the shoes, in the state shown in FIG. 10B, images corresponding to the shoes are acquired, the images are sequentially changed, and the coordinates of the shoes are confirmed.

  As described above, according to the display devices 101 to 103 of the first and second embodiments, the user can select a hat, clothes, shoes, and the like to be coordinated in a state where his / her mirror image is displayed. For this reason, there exists an effect that the user can select the target object of coordination intuitively.

  In the following third embodiment, an example in which a white image is displayed in a region other than a region (person region) where a mirror image of a person in front of the display device 101 is projected will be described as auxiliary light.

[Embodiment 3]
The following will describe another embodiment of the present invention. Note that, as the display device according to the present embodiment, any of the display device 101 (102) of the first embodiment and the display device 103 of the second embodiment can be used. Therefore, the display device 101 will be described as an example.

  FIG. 11 shows an example of a display surface on the display device 101 that displays a white image in an area 11c other than the person area 11b, which is a display area of the mirror image 16 of the person, and serves as auxiliary light.

  When the display device 101 is used as a mirror of a table, a part of the region 11c that is not reflected by the user is converted into a white image and used as auxiliary light. The area 11c used as auxiliary light may be set to a fixed area in advance or may be set arbitrarily. For example, it is conceivable that the user designates the region 11c used as auxiliary light by moving his / her hand so as to designate the region on the display surface 11a.

  Thus, by designating the region 11c used as auxiliary light, the user can confirm how light is irradiated in his / her mirror image 16.

  Moreover, the color of auxiliary light can be changed by making the image displayed on the area | region 11c utilized as auxiliary light into the image of the color from which hues, such as a light bulb color, differ instead of a white image. Thereby, for example, the user who is applying makeup on the table can check the appearance of the makeup for each color by using auxiliary light of different colors.

  In a fourth embodiment below, an example in which life information (traffic information, news, etc.) is displayed in an area other than an area (person area) where a mirror image of a person in front of the display device 101 is displayed will be described.

[Embodiment 4]
The following will describe another embodiment of the present invention. Note that, as the display device according to the present embodiment, any of the display device 101 (102) of the first embodiment and the display device 103 of the second embodiment can be used. Therefore, the display device 101 will be described as an example.

  In the present embodiment, on the display device, the user selects an image displaying life information (traffic information, news articles) displayed in an area other than the mirror image surface area, and moves to a position where the user can easily view the information. I will explain the point of changing the size.

  For example, an image displaying life information is selected while viewing the mirror image 16 of the user reflected on the display device 101 (mirror). For example, the user puts his hand on an image displaying desired life information while looking at a mirror. When the images overlap for a certain period of time, the image moves following the movement of the hand. For example, the image displaying the news article can be moved in front of itself (the area where the mirror image 16 is displayed). The image that follows the movement of the user's hand should be placed under the chin when brushing teeth, placed on the face when tightening the tie, and reduced to the corner of the mirror, especially when news is not available. Can be driven.

  (A)-(c) of FIG. 12 is a figure which shows the flow of a process of the image by which life information is displayed on areas other than a person area.

  For example, FIG. 12A shows a state in which the image 17d on which traffic information is displayed is designated by the movement of the user's hand among the images 17a to 17d on which life information is displayed.

  In this state, the user moves his / her hand to move the image 17d to a position in front of himself / herself (an area where the mirror image 16 is projected (person area 11b)), and as shown in FIG. The image 17d ′ enlarged so that the details are displayed is displayed in the person area 11b. At this time, instead of the mirror image 16, a photographed video 16 'obtained by photographing the person in front of the display device 101 with the camera 13 is displayed at the position where the original image 17d is displayed.

  Then, after confirming the life information, the mirror image 16 is again displayed on the front, and when the user's hand is placed on the photographed image 16 ′, the photographed image 16 ′ is selected as shown in FIG. 12 (c). When a predetermined time elapses in this state, a mirror image 16 is displayed again as shown in FIG.

  By repeating the above processing, a person in front of the display device 101 can confirm necessary information at a position where it can be easily seen while confirming his / her appearance.

  In each of the above embodiments, the display devices 101 to 105 use the half mirror 12 as a means for realizing the mirror function, but the means for realizing the mirror function is limited to the half mirror 12. is not. The half mirror 12 may be a light-transmitting / reflecting member in which the light transmittance and the light reflectance are equal, but the light transmittance and the light reflectance are different.

  For example, since the display devices 101 to 105 use a mirror image to be reflected, the reflectance over the entire visible wavelength range is at least 30% or more by adjusting the mirror material or thickness of the half mirror 12. It is desirable that it be 50% or more.

[Example of software implementation]
The control blocks (control device 20) of the display devices 101 to 103 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or software using a CPU (Central Processing Unit). It may be realized by.

  In the latter case, the control device 20 includes a CPU that executes instructions of a program that is software that implements each function, a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by a computer (or CPU), or A storage device (these are referred to as “recording media”), a RAM (Random Access Memory) that expands the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
In the display device according to the first aspect of the present invention, in the display device in which a light transmitting / reflecting member (half mirror 12) that transmits part of light and reflects part of the light is reflected on the display surface 11a, A region detecting means (person region detecting unit 24) for detecting a person region in which an image of a person existing on the light reflecting surface side of the transmitting / reflecting member is reflected on the light reflecting surface side; and a light transmitting / reflecting member (half mirror 12) Display control means for displaying a person image obtained by photographing a person existing on the light reflecting surface side so that the person area 11b detected by the area detecting means transmits the light transmitting / reflecting member (half mirror 12). (Display control unit 25) and a display region that overlaps at least a part of the display region of the operation region in the human region 11b with one of the regions of the human body detected from the person image as the operation region. is there Specifying means (selected part specifying part 26) for specifying a part displayed in the specific area as a selected part, and the display control means (display control part 25) only moves the operation part in the specific area. It is characterized by displaying an image for update acquired according to the above.

  According to the above configuration, the part of the human body specified by the operation part that is one part of the human body among the human regions displayed on the display surface so that the image of the person passes through the light transmitting and reflecting member. By displaying the image acquired according to the operation of the operation part in the area corresponding to the user, the user can move the operation part (hand) that is a part of his body to the desired part. A desired image can be displayed.

  As a result, when a human image is displayed superimposed on a mirror image, an image for updating can be displayed only by the movement of the operation part, so that a troublesome operation such as a remote control operation or a touch panel operation is not performed. The image superimposed on the mirror image can be changed.

  Therefore, there is an effect that the image to be superimposed on the mirror image can be arbitrarily changed without hindering the function as a mirror.

  The display device according to aspect 2 of the present invention is the display apparatus according to aspect 1, in which the display control unit (display control unit 25) displays the image acquired according to the movement of the operation part in the specific area. An image for highlight display may be displayed.

  According to the above-described configuration, the user can easily determine whether or not the selected part is just by looking at the highlighted part.

  In the display device according to aspect 3 of the present invention, in the aspect 2, the display control unit (display control unit 25) instructs the specific area to display an image while the specific area is highlighted. May be displayed in the specific area.

  According to the above configuration, an update image can be displayed in the specific area at a timing intended by the user.

  The display device according to aspect 4 of the present invention is the display device according to any one of the aspects 1 to 3, wherein the display control unit (display control unit 25) is configured to adjust the size of the image for update according to the size of the specific area. May be adjusted.

  According to the above configuration, by adjusting the image size for update in accordance with the size of the specific area, it is possible to reduce the uncomfortable feeling when the image for update is superimposed on the mirror image.

  In the display device according to aspect 5 of the present invention, in any one of aspects 1 to 4, the display control means (display control unit 25) may change the display size of the person video.

  According to the above configuration, it is possible to display a person image having a size corresponding to the size of the display surface by changing and displaying the display size of the person image. For example, when only the upper body of a person is displayed on the display surface and you want to check the lower body, display the person image with the display size reduced so that the whole body is displayed, and display the whole body of the person on the display surface. When it is desired to do so, it is possible to display a human image whose display size is enlarged so that a certain part is enlarged.

  Thereby, the user can easily specify an area for displaying a desired image.

  The display device according to aspect 6 of the present invention further includes a light amount adjusting means (backlight device 30) for adjusting the amount of light emitted from the display surface 11a toward the light transmitting / reflecting member in the above aspect 5. The adjusting means (backlight device 30) preferably increases the amount of light emitted toward the light transmitting / reflecting member when the display control means (display control unit 25) changes the display size of the person video.

  According to the above configuration, when the display size of the person image is changed by the display control unit, the mirror image projected on the light transmission / reflection member is confirmed by increasing the amount of light irradiated toward the light transmission / reflection member. It becomes difficult. As a result, since only the person video can be displayed on the display surface, the user can check the person video regardless of whether the person video is enlarged or reduced.

  A display device according to aspect 7 of the present invention is the display apparatus according to any one of aspects 1 to 6, further comprising an image acquisition unit (information acquisition unit 21) that acquires an image to be displayed in the specific region. (Information acquisition part 21) may acquire an image from management server 2 which manages an image via a communication network.

  According to the above configuration, the same image can be acquired regardless of where the display device is held, and therefore, clothes and the like can be coordinated everywhere.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  INDUSTRIAL APPLICABILITY The present invention can be used for a display device with a mirror function, and in particular, can be used for a display device that displays an image superimposed on a region designated by a user in addition to a mirror image and a captured video.

2 management server 11 display unit 11a display surface 11b person region 11c region 12 half mirror (light transmission / reflection member)
13 Camera 14 Microphone 15 Speaker 16 Mirror image 16 'Shooting image 16a Fingertip 16a' Operation part 16b Selection part 16b 'Selection part 16c' Selection part 17a-17d Image 18 Ring 20 Control device 21 Information acquisition part (image acquisition means)
22 human body part detection unit 23 operation part detection unit 24 human region detection unit (region detection means)
25 Display control unit (display control means)
26 Selected part specifying part (specifying means)
27 Voice recognition processing unit 28 Voice recognition database 30 Backlight device (light quantity adjusting means)
101 display device 102 display device 103 display device

Claims (5)

In a display device in which a light transmitting / reflecting member that transmits part of light and reflects part of the light is disposed on the display surface,
Area detecting means for detecting a person area in which an image of a person existing on the light reflecting surface side of the light transmitting and reflecting member is reflected on the light reflecting surface side; and
Display control means for displaying a person image obtained by photographing a person existing on the light reflecting surface side of the light transmitting / reflecting member so that the person area detected by the area detecting means is transmitted through the light transmitting / reflecting member. When,
Among the parts of the human body detected from the person image, one part is set as the operation part, and the part displayed in the specific area that is a display area at least partially overlapping the display area of the operation part in the person area A specifying means for specifying the selected part;
With
The display control means includes
A display device, wherein an update image acquired according to only the movement of the operation part is displayed in the specific region. The display control means includes
The display device according to claim 1, wherein a highlight display image is displayed before the update image is displayed in the specific area. The display control means includes
The image for update is displayed in the specific area when an instruction to display an image in the specific area is received while the image for highlight display is displayed in the specific area. Item 3. The display device according to Item 2. The display control means includes
The display device according to claim 1, wherein a size of the update image is adjusted in accordance with a size of the specific area. The display control means includes
The display device according to claim 1, wherein a display size of the person video is changed.

Images