JP5975606B2 - Image processing apparatus and control method thereof - Google Patents

Description

  The present invention relates to an image processing apparatus and a control method thereof.

  An organic EL display using an organic electroluminescence (organic EL) element has been realized. By using a transparent electrode as the electrode of the organic EL element, an organic EL display (transparent display) in which the background of the display can be seen through the screen in a non-display state can be realized.

  Since the organic EL display is a self-luminous display, the transparent display cannot perform black display. Therefore, when an image is displayed on a transparent display, the background of the display may be seen through a part of the image. If the background of the display can be seen through a part of the image, the image may be difficult to see.

  Patent Document 1 discloses a transparent display further having a transmissive liquid crystal panel. In the technique of Patent Document 1, transmission of light (light to the back of the display) is blocked in a region where the organic EL element does not emit light by using a transmissive liquid crystal panel. If this technique is used, black display is possible.

JP 2008-083510 A

  However, in the technique of Patent Document 1, since it is necessary to use a liquid crystal panel for blocking light transmission, the manufacturing cost, power consumption, and thickness of the display are increased.

  An object of the present invention is to provide a technique capable of suppressing the background from being seen through a partial area of an image when the image is displayed on a transparent display with a simple configuration.

Images processing device of the present invention,
An image processing apparatus connected to a display means and outputting an image displayed on the display means,
First determination means for determining whether the input image is a specific image created on the assumption that the input image is displayed on a transparent display capable of transmitting the background;
Obtaining means for obtaining performance information indicating the performance of the display means;
Second determination means for determining whether or not the display means is a transparent display based on the performance information;
When the first determination unit determines that the input image is not the specific image, and the second determination unit determines that the display unit is a transparent display, the input image has a predetermined luminance. Detection means for detecting a low-luminance region;
The area detected by the detection means when the first determination means determines that the input image is not the specific image and the second determination means determines that the display means is a transparent display Conversion means for applying a conversion process for setting the luminance of the input image to the predetermined luminance or higher,
When the first determination unit determines that the input image is not the specific image, and the second determination unit determines that the display unit is a transparent display, the conversion unit performs the conversion process. the image after being, and output means for outputting to said display means,
It is characterized by having .
The display device of the present invention includes:
The image processing device;
Display means for displaying an image output from the image processing device;
It is characterized by having.

The method of images processing device of the present invention,
A control method for an image processing apparatus that is connected to a display means and outputs an image displayed on the display means,
A first determination step of determining whether or not the input image is a specific image created on the assumption that the input image is displayed on a transparent display capable of transmitting the background;
An acquisition step of acquiring performance information indicating the performance of the display means;
A second determination step of determining whether the display means is a transparent display based on the performance information;
If it is determined in the first determination step that the input image is not the specific image, and if it is determined in the second determination step that the display means is a transparent display, from the input image, a predetermined luminance is obtained. A detection step for detecting a low luminance region;
The area detected in the detection step when it is determined in the first determination step that the input image is not the specific image, and the second determination step determines that the display means is a transparent display. Converting the input image to a conversion process for setting the luminance of the input image to be equal to or higher than the predetermined luminance;
It is determined in the first determination step that the input image is not the specific image , and the table
If the shown section is determined in the second determination step that the transparent display, and an output step of an image after the conversion processing has been performed in the conversion step, and outputs to said display means,
It is characterized by having .

  According to the present invention, when an image is displayed on a transparent display with a simple configuration, it is possible to prevent the background from being seen through a part of the image.

Example of functional configuration of image processing apparatus according to embodiment 1 Example of color conversion processing according to embodiment 1 Example of processing flow of image processing apparatus according to embodiment 1 Example of processing flow of image processing apparatus according to embodiment 2 Example of processing flow of image processing apparatus according to embodiment 3

<Example 1>
The image processing apparatus according to the first embodiment of the present invention will be described below.
FIG. 1 is a block diagram illustrating an example of a functional configuration of the image processing apparatus according to the present embodiment.
The image processing apparatus 1 can be connected to a transparent display and displays an image on the connected display. The transparent display is, for example, an organic EL display using a transparent electrode as an electrode of the organic EL element. The transparent display is not limited to this. In a self-luminous display, if a transparent member is used as each constituent member, a transparent display can be configured.

  In this embodiment, the image processing apparatus 1 converts the image so that the color (black) that the background can be seen through becomes a color that cannot be seen through the background when the image is displayed on the transparent display. To display. Specifically, in a region of an image having a luminance lower than a predetermined luminance (region where the luminance of the organic EL element is lower than the predetermined luminance), the amount of external light transmitted through the transparent display is relative to the light emission amount of the organic EL element. The background of the transparent display can be seen through. On the other hand, in a region of an image having a luminance equal to or higher than a predetermined luminance (region where the luminance of the organic EL element is higher than a predetermined luminance), the amount of external light transmitted through the display is relatively small with respect to the light emission amount of the organic EL element. The background of the display cannot be seen through. Therefore, in this embodiment, the image processing apparatus 1 converts the image so that the luminance lower than the predetermined luminance is higher than the predetermined luminance.

The image processing apparatus 1 can be applied to an apparatus that displays an image on a connected display, such as a Blu-ray player. The image processing apparatus 1 can be applied to a distribution apparatus that displays an image on a display via a network in a portal service, digital signage, or the like.
In this embodiment, the case where the image processing device 1 and the display are separate devices will be described. However, the image processing device 1 and the transparent display may be an integrated device.

The display information acquisition unit 2 acquires performance information from a display connected to the image processing apparatus 1. The display information acquisition unit 2 acquires performance information, for example, when the image processing apparatus 1 is turned on or when the image processing apparatus 1 is connected to the display. The display information acquisition unit 2 may acquire performance information at regular time intervals.
The performance information indicates whether the display is a transparent display. In the present embodiment, the transparency information representing the transparency of the display (the light transmittance to the back of the transparent display) is acquired as the performance information. In addition to performance information, information such as the display model name (for example, model name and model number), various display settings (for example, adjustment values such as display brightness and display color), and the maximum display resolution of the display are acquired. May be. The display model name may be acquired as performance information.
The display information acquisition unit 2 determines whether or not the connected display is a transparent display from the acquired transparency information.

The specific color area detection unit 3 detects a specific color area from an image (input image) displayed on the transparent display when the connected display is a transparent display. The specific color area is an area in which the background can be seen through the connected transparent display (an area having a luminance lower than a predetermined luminance).
It should be noted that the color range that becomes the specific color region changes according to the transmittance of the transparent display. In this embodiment, the specific color area detection unit 3 determines the color range (that is, the predetermined luminance) as the specific color area from the transmittance represented by the transparency information acquired by the display information acquisition unit 2. . For example, the specific color area detection unit 3 sets a higher value as the predetermined luminance as the transmittance of the transparent display is higher.

When the connected display is a transparent display, the color conversion unit 4 is configured so that the color of the specific color area detected by the specific color area detection unit 3 becomes a color that cannot be seen through the background on the transparent display. Convert the image (color conversion process). Specifically, the color conversion unit 4 converts the image so that the luminance of the specific color region is equal to or higher than the predetermined luminance.
The color conversion unit 4 may perform color conversion processing using the detection result input from the specific color region detection unit 3 as a trigger, or color conversion processing using the performance information input from the display information acquisition unit 2 as a trigger. May be performed.
When performance information is input to the color conversion unit 4, the specific color region may be detected by the color conversion unit 4.

  When the connected display is a transparent display, the output unit 5 outputs the image converted by the color conversion unit 4 to the transparent display. If the connected display is not a transparent display, the input image is output to the display as it is. Thereby, the image (output image) output from the output unit 5 is displayed on the display.

The control unit 6 controls each functional unit (block) of the image processing apparatus 1. The control unit 6 includes, for example, a CPU (Central Processing Unit) and a memory.
Data transmission between the functional units is performed via a bus.

The color conversion process of this embodiment will be described with reference to FIG.
The pre-conversion image 30 (image before color conversion processing) is an image produced on the premise that the image is displayed on a normal organic EL display or liquid crystal display (display whose back is shielded; non-transparent display). When the pre-conversion image 30 is an RGB image, black is expressed by R value = 0, G value = 0, and B value = 0. In an organic EL display whose rear surface is shielded from light, black display can be realized by setting the state of the organic EL element to a non-light emitting state. However, in a transparent display whose back is not shielded, if the organic EL element is set to a non-light emitting state, the background of the display can be seen through in that region. This makes it difficult to see the image. Depending on the transmittance of the transparent display, black (R value = 0, G value = 0, B value = 0)
The background may be seen through in low-luminance areas (areas where the R value, G value, and B value are smaller than a predetermined value). Therefore, in this embodiment, the color of such a region (a region where the background of the display can be seen through) is converted.

The pre-conversion image 30 is composed of black characters 31 and a green background 32.
The pre-conversion image 30 is converted into the post-conversion image 40 by the color conversion process. Specifically, the black character 31 is converted into a white character 41 (R value = 255, G value = 255, B value = 255). Since the color of the background 32 is a color that can be displayed on the transparent display, it is not converted (the color of the background 32 is left as it is).

  2 illustrates the case where the area of the character (black character 31) is the specific color area, the specific color area is not limited to the character area. A region such as a code, a symbol, and an image object (icon) may be a specific color region. For example, the barcode area may be a specific color area. The area of an icon shaped like a car or clothes may be a specific color area. Any region may be the specific color region as long as the background is a color (luminance) region that can be seen through.

A processing flow of the image processing apparatus according to the present embodiment will be described with reference to the flowchart of FIG.
Processing is started in step S10.
Next, in step S11, the display information acquisition unit 2 acquires performance information (transparency information) from the connected display.
In step S12, the display information acquisition unit 2 determines whether the connected display is a transparent display using the transparency information acquired in step S11 (first determination). If the connected display is a transparent display, the process proceeds to step S13. If the connected display is not a transparent display, the process proceeds to step S16.

  In step S13, whether the specific color area detection unit 3 is an image (transparent display image) created on the assumption that the input image (image displayed on the connected display) is displayed on the transparent display. It is determined whether or not (second determination). The determination in step S13 is performed using metadata attached to the input image (image displayed on the connected display). The given metadata is, for example, a signal T that is input together with a pixel value (R value, G value, B value, etc.) of the input image, and indicates whether or not the input image is a transparent display image. It is. Here, the signal T = 1 is given to the transparent display image, and the signal T = 0 is given to the non-transparent display image (an image created assuming that the image is displayed on the non-transparent display). It shall be. The specific color area detection unit 3 determines that the image is a transparent display image when the signal T is 1, and determines that the image is a non-transparent display image when the signal T is 0. If the input image is a transparent display image, the process proceeds to step S14. If the input image is not a transparent display image, the process proceeds to step S16.

In step S14, the specific color area detection unit 3 detects the specific color area from the pixel values (R value, G value, B value, etc.) of the input image.
After step S14, in step S15, the color conversion unit 4 converts the color of the specific color area detected in step S14 into a color that cannot be seen through the background on the transparent display. For example, black is converted to white. Then, the process proceeds to step S16.

In step S16, the output unit 5 outputs the image to the connected display. If the connected display is a transparent display, the image (converted image) converted in step S15 is output. If the connected display is not a transparent display, the image before conversion (pre-conversion image) is output in step S15. Note that the converted image may be output regardless of whether or not the connected display is a transparent display. Further, the converted image may be output regardless of whether the input image is a transparent display image.
In the above description, it is determined in step S13 whether or not the image is a transparent display image based on the metadata. However, the process in step S13 is not limited thereto. For example, the user may be inquired whether the input image is a transparent display image. Further, the user may be inquired whether or not to perform color conversion of the input image. In this case, steps S14 and S15 may be performed based on a user instruction (instruction according to a user operation) input from an input unit (not shown). Specifically, when there is an instruction indicating that the input image is a transparent display image or an instruction indicating performing color conversion of the input image, the processes of steps S14 and S15 may be performed.

  After step S16, in step S17, the control unit 6 determines whether or not to end the image display. For example, the control unit 6 determines whether there is an instruction from the user to end the image display. When the image display is continued, the process returns to step S12. When the image display is to be ended, the process proceeds to step S18, and this flow is ended.

As described above, according to the present embodiment, when an image is displayed on a transparent display with a simple configuration in which the image is converted so that the brightness of an area where the background of the display can be seen through is high, the image is displayed. It is possible to prevent the background from being seen through in a part of the area.
In this embodiment, white is exemplified as the color after the color conversion process, but the color after the color conversion process is not limited to white. The color after the color conversion process may be determined according to the color before the color conversion process. For example, only the luminance may be increased without changing the balance of the R value, the G value, and the B value, or the R value, the G value, and the color after the color conversion process may be complementary to the color before the color conversion process. You may change the balance of B value.

<Example 2>
In the second embodiment, color conversion processing is performed with reference to pixel values around a specific color area.
The configuration of the image processing apparatus according to the present embodiment is the same as that of the first embodiment (FIG. 1). In the present embodiment, the processes of the specific color area detection unit 3 and the color conversion unit 4 are different from those in the first embodiment.
The specific color area detection unit 3 performs a process of acquiring information about colors around the specific color area in addition to the process of the first embodiment. Specifically, the specific color area detection unit 3 acquires pixel values around the specific color area. The pixel values around the specific color area are, for example, pixel values adjacent to the specific color area or pixel values existing within a predetermined range from the specific color area.
The color conversion unit 4 converts the color of the specific color region based on the pixel value acquired by the specific color region detection unit 3. Specifically, when the color after the conversion of the specific color area is the same as the surrounding color, it is difficult to detect the boundary between the specific color area after the color conversion process and the peripheral area. Therefore, the color conversion unit 4 converts the image so that the color of the specific color region is different from the surrounding colors. Specifically, the color conversion unit 4 converts the image so that the pixel value of the specific color region is different from the pixel value acquired by the specific color region detection unit 3.
Since the processing of other functional units is the same as that of the first embodiment, the description thereof is omitted.

A processing flow of the image processing apparatus according to the present embodiment will be described with reference to the flowchart of FIG.
Steps S40 to S44 and Steps S47 to S49 are the same as those in the first embodiment (Steps S10 to S14 and Steps S16 to S18 in FIG. 3), and thus description thereof is omitted.

After step S44, in step S45, the specific color area detection unit 3 acquires pixel values around the specific color area.
In step S46, the color conversion unit 4 determines that the color of the specific color area detected in step S44 is a color whose background cannot be seen through the transparent display and is different from the pixel value acquired in step S45. Convert to pixel value color. For example, the color of the specific color area is converted into its complementary color. If the complementary color of the color in the specific color area (the color before conversion) is the same color as the surrounding color, the color in the specific color area is converted to a color different from the surrounding color. Specifically, if the complementary color of black (R = 0, G = 0, B = 0) is white (R = 255, G = 255, B = 255), and the color of the specific color region is black , The color of the specific color region is converted to white which is a complementary color. Thereafter, when the color around the specific color area is white, one of the R value, G value, and B value of the specific color area is converted to 0, and the color of the specific color area is changed to the surrounding color. Converted to a different color. For example, the B value of the specific color area is set to 0, and finally the color of the specific color area is set to yellow (R value = 255, G value = 255, B value = 0).

As described above, according to the present embodiment, similar to the first embodiment, when an image is displayed on a transparent display with a simple configuration, it is possible to prevent the background from being seen through a part of the image. can do.
In this embodiment, the image is converted so that the color of the specific color region is different from the color of the surrounding pixels. Thereby, the visibility of the boundary between the specific color region and the surrounding region (visibility of the specific color region) can be improved.

<Example 3>
In Example 3, the background color of the connected transparent display is monitored (detected) using an external light sensor, and color conversion processing is performed using the color sampled by the external light sensor.
The image processing apparatus according to the present embodiment further includes an external light sensor (background color detection unit) in addition to the configuration of the first embodiment (FIG. 1). In the present embodiment, the processing of the color conversion unit 4 is different from those in the first and second embodiments.
The ambient light sensor detects the background color of the transparent display. Specifically, the external light sensor is installed so as to face the background (back) of the connected transparent display, and detects external light irradiated on the back surface of the transparent display.
The color conversion unit 4 converts the color of the specific color region based on the detection result of the external light sensor. Specifically, when the converted color of the specific color region is the same as the background color of the display, the effect obtained by the color conversion process is small. Therefore, the color conversion unit 4 converts the image so that the color of the specific color region is different from the background color of the display.

A processing flow of the image processing apparatus according to the present embodiment will be described with reference to the flowchart of FIG.
Since Steps S100 to S103 and Steps S107 to S109 are the same as those in the first embodiment (Steps S10 to S13 and Steps S16 to S18 in FIG. 3), description thereof is omitted.

  When the connected display is a transparent display and the input image is a transparent display image, in step S104, the color conversion unit 4 determines the sample value of the external light sensor (that is, the background of the connected transparent display). Information representing color). The external light sensor may sample the background color in this step, or may always perform sampling while the image processing apparatus is activated.

Next, in step S105, the specific color area detection unit 3 detects the specific color area from the image.
In step S106, the color conversion unit 4 uses the color of the specific color area detected in step S105 as a color whose background cannot be seen through the transparent display and the color (transparent) acquired in step S104. The display background color is changed to a different color.

As described above, according to the present embodiment, similar to the first embodiment, when an image is displayed on a transparent display with a simple configuration, it is possible to prevent the background from being seen through a part of the image. can do.
In this embodiment, the image is converted so that the color of the specific color region is different from the background color of the connected transparent display. Thereby, the visibility of the specific color region can be improved.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 3 Specific color area detection part 4 Color conversion part 5 Output part

Claims (12)

An image processing apparatus connected to a display means and outputting an image displayed on the display means,
First determination means for determining whether the input image is a specific image created on the assumption that the input image is displayed on a transparent display capable of transmitting the background;
Obtaining means for obtaining performance information indicating the performance of the display means;
Second determination means for determining whether or not the display means is a transparent display based on the performance information ;
Is determined by the entering-force image is not said specific image said first determining means, and, when the display means is determined by said second determining means to be a transparent display, from the input image, a predetermined brightness Detecting means for detecting a lower luminance area;
The area detected by the detection means when the first determination means determines that the input image is not the specific image and the second determination means determines that the display means is a transparent display Conversion means for applying a conversion process for setting the luminance of the input image to the predetermined luminance or higher,
When the first determination unit determines that the input image is not the specific image, and the second determination unit determines that the display unit is a transparent display, the conversion unit performs the conversion process. Output means for outputting the image after being performed to the display means;
An image processing apparatus comprising: The performance information includes information representing light transmittance to the back surface of the display means,
The image processing apparatus according to claim 1 , wherein the detection unit determines the predetermined luminance according to the transmittance. The image processing apparatus according to claim 2 , wherein the detection unit determines a higher value as the predetermined luminance as the transmittance is higher. The conversion process, the color of the detected area by the detection means, to any one of claims 1 to 3, characterized in that a process of a different color from the surrounding of the region color The image processing apparatus described. A background color detecting means for detecting a background color of the display means;
The conversion process, the color of the detected area by the detection means, any of claims 1 to 4, wherein the the detected color with the background color detection means is a process of a different color The image processing apparatus according to claim 1. An image processing apparatus according to any one of claims 1 to 5 ,
Display means for displaying an image output from the image processing device;
A display device comprising: The display device according to claim 6 , wherein the display unit is a transparent display capable of transmitting a background. A control method for an image processing apparatus that is connected to a display means and outputs an image displayed on the display means,
A first determination step of determining whether or not the input image is a specific image created on the assumption that the input image is displayed on a transparent display capable of transmitting the background;
An acquisition step of acquiring performance information indicating the performance of the display means;
A second determination step of determining whether the display means is a transparent display based on the performance information ;
It is judged in the first judgment step and the entering-force image is not said specific image, and, when the display means is determined in the second determination step that the transparent display, from the input image, a predetermined brightness A detection step for detecting areas of lower brightness;
The area detected in the detection step when it is determined in the first determination step that the input image is not the specific image, and the second determination step determines that the display means is a transparent display. Converting the input image to a conversion process for setting the luminance of the input image to be equal to or higher than the predetermined luminance;
If it is determined in the first determination step that the input image is not the specific image, and it is determined in the second determination step that the display means is a transparent display, the conversion process is performed in the conversion step. An output step of outputting the image after being performed to the display means;
A control method for an image processing apparatus, comprising: The performance information includes information representing light transmittance to the back surface of the transparent display,
The method according to claim 8 , wherein in the detecting step, the predetermined luminance is determined according to the transmittance. The method according to claim 9 , wherein, in the detection step, a higher value is determined as the predetermined luminance as the transmittance is higher. The said conversion process is a process which makes the color of the area | region detected by the said detection step different from the color of the circumference | surroundings of this area | region, The any one of Claims 8 thru | or 10 characterized by the above-mentioned. A control method of the image processing apparatus described. A background color detecting step of detecting a background color of the display means;
The conversion process, the color of the detected region in the detecting step, any of claims 8 to 11, characterized in that a process of a different color from that of the detected background color detecting step color A method for controlling the image processing apparatus according to claim 1.

Images