JP2017151141A - Image display device, image display system, information processing device, control method for image display device, and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology for improving display quality in an image display device with a limited display time.SOLUTION: An image display device having a limited state in which a time of display with display luminance in a second luminance range as a range of display luminance higher than display luminance in a first luminance range as a range of display luminance is limited to a threshold or less comprises: acquisition means for acquiring assumed luminance information related to assumed luminance as display luminance estimated in input moving image data; and control means for controlling display such that the time of display with the display luminance in the second luminance range becomes the threshold or less on the basis of the input moving image data, the estimated luminance information and the limited state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display device, an image display system, an information processing device, a control method for the image display device, and an information processing method.

There has been proposed a technique for controlling display luminance (screen luminance) in image display based on image data according to metadata included in the image data, a data format of the image data, and the like. For example, SMPTE ST. In 2084, display luminance up to 10,000 cd / m ² is defined. And SMPTE ST. When 2084 image data is used, an image is displayed with a display luminance of up to 10,000 cd / m ² . Hereinafter, image data having a very high upper limit luminance of display luminance, for example, image data having an upper limit luminance of display luminance of several thousand cd / m ² or more will be referred to as “HDR (High Dynamic Range) image data”.

  In an image display device, in order to display a very high display luminance for a long time, it is necessary to take measures against temperature rise due to heat generation, high power consumption, and the like. These measures increase the cost of the image display device. Therefore, there has been proposed an image display device in which the display time at the display brightness (second display brightness) higher than the normal display brightness (first display brightness) is limited to a time equal to or shorter than a predetermined time limit. For example, there has been proposed an image display device that performs display at the second display luminance only for 30 seconds when an instruction to increase the display luminance is given to the user. This limits the display time with high display luminance, but enables display with high display luminance while suppressing an increase in cost.

  Further, in general HDR image data (HDR moving image data), a very high display luminance is assumed only for some scenes. For example, a very high display luminance is assumed only for a scene where it is desired to enhance a sense of reality, an outdoor scene under a clear sky, a scene where a glittering feeling such as the sun, lighting, etc. is desired. That is, it is not assumed that general HDR moving image data is always displayed with very high display luminance. For this reason, in the case of displaying general HDR video data using the above-described technology that limits the display time with high display luminance, there is a high possibility that display with the assumed display luminance can be performed in all scenes. Therefore, the generalization of the above technique for limiting the display time with high display luminance is expected.

  As a conventional technique related to an image display apparatus, techniques disclosed in Patent Documents 1 and 2 have been proposed. In the technique disclosed in Patent Document 1, the light emission luminance of the backlight module is controlled according to content information related to image content. In the technique disclosed in Patent Document 2, the average luminance value of each frame of moving image data is calculated, and the light emission amount of the backlight module is controlled according to the temporal change tendency of the average luminance value.

  However, it is assumed that the display time is not limited in the conventional techniques such as the technique for controlling the display luminance according to the metadata included in the image data, the data format of the image data, and the techniques disclosed in Patent Documents 1 and 2. Display is performed. For this reason, in such a prior art, there exists a possibility that unnecessary display quality (display quality of an image display apparatus) may fall. For example, although the display with the assumed display brightness (assumed brightness) can be performed in all scenes, the scene with the assumed second display brightness may be displayed with the first display brightness. In addition, although the display according to the assumed brightness is performed even though the display with the assumed brightness cannot be performed, blackening, overexposure, a decrease in contrast, a temporal change in contrast, and the like may occur in the display.

JP 2008-244818 A JP 2011-81084 A

  An object of the present invention is to provide a technique capable of improving display quality in an image display device having a display time limit.

The first aspect of the present invention is:
An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. Because
An acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data;
Control means for controlling display based on the input moving image data, the assumed luminance information, and the restriction state so that a display time at a display luminance within the second luminance range is equal to or less than the threshold value;
It is an image display apparatus characterized by having.

The second aspect of the present invention is:
An image display system having the above-described image display device and an information processing device,
The information processing apparatus includes:
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data, based on input moving image data input to the image display device;
Output means for outputting the assumed luminance information to the image display device;
It is an image display system characterized by having.

The third aspect of the present invention is:
An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. And an image display system having an information processing device,
The image display device includes:
Obtaining means for obtaining display brightness information relating to display brightness;
Control means for controlling display based on input moving image data and the display luminance information;
Have
The information processing apparatus includes:
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data based on the input moving image data;
Restriction acquisition means for acquiring restriction information on the restriction state;
Correcting means for correcting the assumed luminance information based on the restriction information to generate the display luminance information that causes a display time in the display luminance within the second luminance range to be equal to or less than the threshold;
Output means for outputting the display luminance information generated by the correction means to the image display device;
It is an image display system characterized by having.

The fourth aspect of the present invention is:
An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. An information processing apparatus that can be connected to
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data, based on input moving image data input to the image display device;
Restriction acquisition means for acquiring restriction information on the restriction state;
Correcting means for correcting the assumed luminance information based on the restriction information to generate the display luminance information that causes a display time in the display luminance within the second luminance range to be equal to or less than the threshold;
Output means for outputting the display luminance information generated by the correction means to the image display device;
It is an information processing apparatus characterized by having.

According to a fifth aspect of the present invention,
An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. Control method,
Obtaining assumed brightness information related to assumed brightness, which is display brightness assumed in the input video data;
Controlling the display based on the input moving image data, the assumed luminance information, and the restriction state so that the display time at the display luminance within the second luminance range is equal to or less than the threshold value;
It is a control method of the image display apparatus characterized by having.

The sixth aspect of the present invention is:
An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. An information processing method in an information processing apparatus connectable with
Based on input moving image data input to the image display device, obtaining assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data;
Obtaining restriction information regarding the restriction state;
Generating the display luminance information by correcting the assumed luminance information based on the restriction information so that a display time at a display luminance within the second luminance range is equal to or less than the threshold;
Outputting the generated display luminance information to the image display device;
It is the information processing method characterized by having.

A seventh aspect of the present invention is a program that causes a computer to execute each step of the above-described control method of the image display apparatus.
An eighth aspect of the present invention is a program that causes a computer to execute each step of the information processing method described above.

  According to the present invention, it is possible to improve display quality in an image display device that has a display time limit.

FIG. 1 is a block diagram illustrating an example of a functional configuration of an image display device according to a first embodiment. The figure which shows an example of the moving image data which concern on Example 1. The figure which shows an example of the moving image data which concern on Example 1. The figure which shows an example of the moving image data which concern on Example 1. The figure which shows an example of the restriction | limiting information which concerns on Example 1. FIG. The figure which shows an example of the moving image data which concern on Example 1. The figure which shows an example of ID which is assumption brightness | luminance information which concerns on Example 1. FIG. The figure which shows an example of ID which is the restriction information which concerns on Example 1. FIG. FIG. 3 is a flowchart illustrating an example of a processing flow of the image display apparatus according to the first embodiment. FIG. 7 is a block diagram illustrating an example of a functional configuration of an image display system according to a second embodiment. FIG. 9 is a flowchart illustrating an example of a processing flow of the image display system according to the second embodiment. The figure which shows an example of the moving image data which concern on Example 2. The figure which shows an example of the moving image data which concern on Example 2. FIG. 9 is a block diagram illustrating an example of a functional configuration of an image display system according to a third embodiment. FIG. 10 is a flowchart illustrating an example of a processing flow of the image display system according to the third embodiment.

<Example 1>
Embodiment 1 of the present invention will be described below. In the image display apparatus according to the present embodiment, the display time in the display brightness (screen brightness) within the first brightness range is not limited, and the display time in the display brightness within the second brightness range is not limited. Has a restricted state that is restricted below the threshold. The first luminance range and the second luminance range are display luminance ranges, and the second luminance range is a display luminance range higher than the display luminance in the first luminance range.

  Note that the display time at the display luminance within the first luminance range may be limited. For example, a very long time may be set as the maximum time during which the display luminance within the first luminance range can be maintained. In the following, an example in which the image display device is a transmissive liquid crystal display device will be described, but the image display device is not limited to a liquid crystal display device. The image display device may be another device having a light emitting unit and a display panel that displays an image by modulating light from the light emitting unit. For example, the image display device may be a reflective liquid crystal display device, a MEMS shutter type display device having a MEMS (Micro Electro Mechanical System) shutter as a display element, a projector, or the like. The image display device may be a self-luminous display device such as an organic EL display device or a plasma display device.

  FIG. 1 is a block diagram illustrating an example of a functional configuration of the image display apparatus 100 according to the present embodiment. As illustrated in FIG. 1, the image display device 100 includes an image acquisition unit 101, an assumed luminance information acquisition unit 102, a restricted state management unit 103, a display control unit 109, a liquid crystal panel 106, and a backlight module 108. Note that each of the assumed luminance information acquisition unit 102, the restricted state management unit 103, and the display control unit 109 may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware.

  The backlight module 108 is a light emitting unit that irradiates light to the back surface of the liquid crystal panel 106. The backlight module 108 has one or more light sources. The light source has one or more light emitting elements. As the light emitting element, a light emitting diode, an organic EL element, a plasma element, a cold cathode tube, or the like can be used. The liquid crystal panel 106 is a display panel that displays an image (a moving image or a still image) by transmitting light from the backlight module 108. Specifically, the liquid crystal panel 106 includes a plurality of liquid crystal elements, and an image is displayed when light from the backlight module 108 passes through each liquid crystal element.

  The image acquisition unit 101 acquires image data. The image data acquired by the image acquisition unit 101 is referred to as “input image data”. Then, the image acquisition unit 101 outputs the input image data to the assumed luminance information acquisition unit 102 and the display control unit 109. In the present embodiment, the image acquisition unit 101 acquires input image data from the outside of the image display device 100. Input image data may be acquired via a cable or may be acquired wirelessly. As the image acquisition unit 101, an input terminal, a communication interface, or the like can be used. In addition, the acquisition method of input image data is not specifically limited. For example, a storage unit that stores image data may be provided in the image display device. Then, the image data stored in the storage unit may be read from the storage unit as input image data. In the following, an example in which the input image data is moving image data (input moving image data) will be described. However, the input image data may be still image data.

  The assumed brightness information acquisition unit 102 acquires information (assumed brightness information) related to the assumed brightness, which is the display brightness assumed in the input moving image data. Then, the assumed luminance information acquisition unit 102 outputs the assumed luminance information to the display control unit 109. In the present embodiment, auxiliary data is included in the input moving image data, and assumed luminance information is included in the auxiliary data. Then, the assumed luminance information acquisition unit 102 acquires the assumed luminance information by extracting auxiliary data from the input moving image data. The auxiliary data is transmitted, for example, stored in a metadata area, an auxiliary signal area, or the like of various image interface standards. In addition, the acquisition method of assumption brightness information is not specifically limited. For example, data that is independent of the input moving image data may be input to the image display device 100 as the assumed luminance information data. And the said data input into the image display apparatus 100 may be acquired as assumption brightness | luminance information. Assumed luminance information (auxiliary data) may be acquired by communication supported by various image interface standards.

  The restriction state management unit 103 manages information (restriction information) regarding the restriction state of the image display apparatus 100. The restriction state management unit 103 outputs restriction information to the display control unit 109. In this embodiment, predetermined restriction information is recorded in advance in the restriction state management unit 103. The restriction information indicates, for example, the upper limit luminance of the display luminance of the image display device 100, the correspondence relationship between the display luminance and the displayable time, and the like. The displayable time is a time during which the display with the corresponding display luminance can be continuously performed. From the restriction information, it is determined that the display time at the display luminance within the first luminance range is not restricted, the display time at the display luminance within the second luminance range is restricted to a threshold value or less, etc. can do.

  Based on the input moving image data, the assumed luminance information, and the restriction information, the display control unit 109 displays the image display device 100 so that the display time at the display luminance within the second luminance range is equal to or less than the threshold value. Control. In the present embodiment, the display control unit 109 corrects the assumed luminance information so that the display time at the display luminance within the second luminance range is equal to or less than the threshold based on the restriction information. Then, the display control unit 109 controls the display of the image display device 100 based on the input moving image data and the postulated corrected luminance information (corrected luminance information; display luminance information). In this embodiment, the display control unit 109 controls the display of the image display device 100 by controlling the light emission luminance of the backlight module 108 and the modulation factor (transmittance) of the liquid crystal panel 106. In the present embodiment, the display control unit 109 includes a parameter determination unit 104, an image processing unit 105, and a backlight control unit 107. Note that each of the parameter determination unit 104, the image processing unit 105, and the backlight control unit 107 may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware.

The parameter determination unit 104 acquires the display luminance information by correcting the assumed luminance information based on the restriction information. Although details will be described later, in this embodiment, the display brightness of the image display device 100 is controlled so that the display time at the display brightness within the second brightness range is equal to or less than the threshold value.
Therefore, it can be said that the display luminance information is “information for specifying display luminance at the time of reproduction of input moving image data”. The process of correcting the assumed brightness information can be said to be “a process of determining display brightness at the time of reproduction of input moving image data”. The parameter determination unit 104 determines the image correction parameter and the backlight control parameter based on the display luminance information, outputs the image correction parameter to the image processing unit 105, and outputs the backlight control parameter to the backlight control unit 107. In this embodiment, the image correction parameter and the backlight control parameter are determined so that the display with the display brightness indicated by the display brightness information is realized.

  The image correction parameter is a parameter for correcting the input moving image data. For example, the image correction parameter is a parameter indicating a correspondence relationship between the gradation value before correction and the gradation value after correction. Specifically, the image correction parameter is a gamma coefficient for correcting the gradation characteristics of the input moving image data. The backlight control parameter is a parameter indicating the light emission luminance (light emission amount; light emission intensity) of the backlight module 108.

  The display control method is not limited to the above method. For example, the correction of the assumed luminance information may be omitted. Specifically, the image correction parameter and the backlight control parameter may be generated without generating the corrected luminance information (display luminance information) based on the input moving image data, the assumed luminance information, and the restriction information.

  The image processing unit 105 generates display moving image data by performing image processing using the image correction parameter on the input moving image data. Then, the image processing unit 105 outputs the display moving image data to the liquid crystal panel 106. When display image data is input to the liquid crystal panel 106, the transmittance of each liquid crystal element of the liquid crystal panel 106 is individually controlled according to the display moving image data. Therefore, “the process of outputting the display moving image data to the liquid crystal panel 106” can be said to be “the process of controlling the transmittance of the liquid crystal panel 106”.

  The backlight control unit 107 determines a light emission control value indicating a drive signal of the backlight module 108 (light emitting element of the backlight module 108) based on the backlight control parameter. Then, the backlight control unit 107 outputs the light emission control value to the backlight module 108. When the light emission control value is input to the backlight module 108, a drive signal corresponding to the light emission control value is supplied to the light emitting element of the backlight module 108. As a result, the light emission luminance (light emission amount; light emission intensity) of the light emitting element is controlled according to the light emission control value. Therefore, “the process of outputting the light emission control value to the backlight module 108” can be said to be “the process of controlling the light emission luminance of the backlight module 108”. When a pulse signal is used as the drive signal, the light emission luminance of the backlight module 108 can be changed by changing at least one of the pulse width of the drive signal and the pulse amplitude of the drive signal. Therefore, a value indicating the pulse width, a value indicating the pulse amplitude, a value indicating both the pulse width and the pulse amplitude, and the like can be used as the light emission control value.

  An example of moving image data (moving image content) according to the present embodiment will be described with reference to FIGS. As shown in FIGS. 2 to 4, the moving image data according to the present embodiment includes a main stream, a substream, and metadata. The main stream in FIGS. 2 to 4 is a stream including a synchronization signal, image data of each frame, etc., and is so-called “moving image data”. The substream and metadata are the auxiliary data described above. Although details will be described later, in this embodiment, backlight luminance (light emission luminance of the backlight module 108) is used as the assumed luminance in the assumed luminance information. The backlight luminance is substantially equal to the upper limit luminance of display luminance. Specifically, the backlight luminance is substantially equal to the display luminance when the transmittance of the liquid crystal panel 106 is controlled to the upper limit value. Therefore, there is no problem even if the backlight luminance is used as the assumed luminance. Rather, when the light emission time of the backlight module 108 is limited, it is preferable that the backlight luminance is used as the assumed luminance.

  The sub-streams in FIGS. 2 to 4 are streams indicating the assumed brightness of each scene of the moving image data. That is, the substream is assumed luminance information indicating the assumed luminance of each scene of the moving image data. Hereinafter, such assumed luminance information is referred to as “scene assumed luminance information”. The assumed scene luminance information is added, for example, by a producer of moving image data, an editor of moving image data, and the like to specify display luminance at the time of reproducing moving image data. 2 to 4, gradation information indicating gradation characteristics (gamma characteristics) and backlight luminance information indicating backlight luminance are used as the assumed scene luminance information. The scene specific luminance information is not limited to the information shown in FIGS. For example, information (function, lookup table, etc.) indicating the correspondence between the gradation value before correction by the image processing unit 105 and the gradation value after correction may be used as the gradation information.

  The metadata in FIGS. 2 to 4 includes information on the entire moving image data (moving image content). For example, the metadata includes time of the entire moving image data, genre information indicating the genre of the moving image data, and the like. In this embodiment, as shown in FIGS. 2 to 4, the metadata includes assumed luminance information indicating the correspondence between the luminance range (display luminance range) and the maximum duration. Hereinafter, such assumed luminance information is referred to as “content assumed luminance information”. The maximum duration is the maximum time for which the assumed luminance within the corresponding luminance range lasts. In the examples of FIGS. 2 to 4, the backlight luminance range is used as the luminance range, and the maximum time of the backlight luminance within the corresponding luminance range is used as the maximum duration.

The content assumed luminance information in FIG. 2 indicates that a scene having a backlight luminance of 0 cd / m ² or more and 1999 cd / m ² or less continues for 600 seconds at the longest. Then, the backlight luminance is 2000 cd / ^{m 2} or more 3999cd / ^{m 2} is at a scene or less continuously for 20 seconds at the longest, and, no backlight luminance is 4000 cd / ^{m 2} or more ~7999cd / ^{m 2} or less scenes It is shown that. The content assumed luminance information in FIG. 3 indicates that a scene having a backlight luminance of 0 cd / m ² or more and 1999 cd / m ² or less continues for 600 seconds at the longest. Then, the backlight luminance is 2000 cd / ^{m 2} or more 3999cd / ^{m 2} or less is the scene continues for 40 seconds at the longest, and, no backlight luminance is 4000 cd / ^{m 2} or more ~7999cd / ^{m 2} or less scenes It is shown that. The content assumed luminance information in FIG. 4 indicates that a scene having a backlight luminance of 0 cd / m ² or more and 1999 cd / m ² or less continues for 600 seconds at the longest. Then, the backlight luminance is continued for 20 seconds at 2000 cd / ^{m 2} or more 3999cd / ^{m 2} or less is scene longest, and, the scene backlight luminance is 4000 cd / ^{m 2} or more ~7999cd / ^{m 2} or less at maximum It shows that it continues for 10 seconds.

  Note that the content assumed luminance information may be information that is automatically added by editing software when editing moving image data, or information that is manually added by an editor. In addition, a photographing device such as a video camera may automatically specify display luminance (assumed luminance) at the time of reproduction based on photographing data, photographing settings, and the like. In that case, the content assumed luminance information is obtained based on various information (photographing data, photographing settings, display luminance at the time of reproduction, etc.) used or generated by the photographing device from the photographing start to the photographing end. It may be generated and added.

  Next, an example will be described in which display is performed based on only assumed luminance information and input moving image data without considering restriction information.

  First, the assumed luminance information acquisition unit 102 extracts the assumed luminance information from the input moving image data. Specifically, the assumed luminance information acquisition unit 102 extracts gradation information and backlight luminance information from the substream of the input moving image data for each scene of the input moving image data.

  Next, the display control unit 109 controls the display of the image display apparatus 100 based on the extracted scene assumed luminance information. Specifically, the parameter determination unit 104 outputs an image correction parameter corresponding to the extracted gradation information to the image processing unit 105, and performs backlight control on the backlight control parameter corresponding to the extracted backlight luminance information. Output to the unit 107. The image processing unit 105 generates display moving image data from the input moving image data by image processing using the image correction parameter, and outputs the display moving image data to the liquid crystal panel 106. As a result, the transmittance of the liquid crystal panel 106 is controlled to the transmittance according to the extracted gradation information and input moving image data. Then, the backlight control unit 107 determines a light emission control value based on the backlight control parameter, and outputs the light emission control value to the backlight module 108. As a result, the light emission luminance (backlight luminance) of the backlight module 108 is controlled to the light emission luminance corresponding to the extracted backlight luminance information.

By the above method, display based on the assumed luminance information becomes possible. However, in the above method, when the assumed luminance of the input moving image data exceeds the upper limit luminance of the display luminance of the image display device 100, the display quality is degraded (image quality degradation). As an example, it is assumed in the input moving image data that the backlight luminance of 2400 cd / m ² is maintained for 40 seconds, and the image display device 100 can maintain the backlight luminance of 2400 cd / m ² only for a maximum of 20 seconds. Think. In this case, display is performed at a backlight luminance of 2400 cd / m ² for the first 20 seconds. However, in the subsequent 20 seconds, the backlight luminance is reduced to a luminance lower than 2400 cd / m ² . Furthermore, the image correction parameter corresponding to the extracted gradation information is continuously used without considering the decrease in backlight luminance. For this reason, in the display, image quality deterioration such as blackening, a decrease in contrast, a temporal change in contrast, and a temporal change in display luminance occurs.

  Therefore, in this embodiment, the restriction information is further used. That is, the restricted state of the image display apparatus 100 is considered. Hereinafter, an example of a processing flow according to the present embodiment will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of a processing flow of the image display apparatus 100 according to the present embodiment. As described above, in this embodiment, the display is controlled based on the limit information, the assumed luminance information, and the input moving image data.

  First, the assumed luminance information acquisition unit 102 extracts assumed luminance information (scene assumed luminance information and content assumed luminance information) from the input moving image data acquired by the image acquisition unit 101 (S901). Then, the assumed luminance information acquisition unit 102 outputs the extracted assumed luminance information to the parameter determination unit 104. Further, the restriction state management unit 103 outputs restriction information to the parameter determination unit 104 (S902; transmission of restriction information). Note that the order of the processing in S901 and the processing in S902 is not particularly limited. The processing of S902 may be performed after the processing of S901, the processing of S901 may be performed after the processing of S902, or the processing of S901 and the processing of S902 may be performed in parallel.

  FIG. 5 is a diagram illustrating an example of restriction information according to the present embodiment. The format of the limit information is not particularly limited, but in this embodiment, limit information indicating the correspondence between the luminance range (display luminance range) and the sustainable time is used as shown in FIG. The sustainable time is the maximum time during which the display luminance within the corresponding luminance range can be maintained. In the example of FIG. 5, the backlight luminance range is used as the luminance range, and the maximum time during which the backlight luminance within the corresponding luminance range can be maintained is used as the sustainable time.

The restriction information in FIG. 5 indicates that “the backlight module 108 can output light with a backlight luminance of 0 cd / m ² or more and 1999 cd / m ² or less (first luminance range) without limitation”. Restriction information of FIG. 5, "the backlight module 108, if 30 seconds or less, 2000 cd / ^{m 2} or more 3999cd / ^{m 2} or less (second luminance range) continuously outputs light of the backlight luminance of It can also be shown. The restriction information of FIG. 5, "the backlight module 108 can not output the light of the backlight luminance of 4000 cd / ^{m 2} or more 7999cd / ^{m 2} or less (third luminance range)" also show that.

  The first luminance range to the third luminance range may be wider or narrower than the above range. The time threshold may be longer or shorter than 30 seconds. A plurality of luminance ranges may be used as the second luminance range (luminance range in which the time during which display luminance can be maintained is limited to a threshold value or less). In that case, the threshold value (time threshold value) may be the same or different between the plurality of luminance ranges. The third luminance range (luminance range in which display luminance cannot be realized) may not be determined.

  Next, the parameter determination unit 104 compares the content assumed luminance information input by the process of S901 with the restriction information input by the process of S902. Specifically, the maximum duration is compared with the maintainable time for each of the plurality of luminance ranges. Then, the parameter determination unit 104 displays the display performance (restricted performance) corresponding to the restricted state of the image display device 100 based on the comparison described above, with the minimum display performance (assumed performance) required to realize display at the assumed brightness. It is determined whether or not the following is true (S903). If it is determined that the assumed performance is less than or equal to the limit performance of the image display device 100, the process proceeds to S904, and if it is determined that the assumed performance exceeds the limit performance of the image display device 100, The process proceeds to S905.

  Here, an example in which the input moving image data is the moving image data of FIG. 2 will be described. In this case, since the maximum duration is “600 seconds” and the sustainable time is “unlimited” for the first luminance range, the assumed performance is less than the limited performance of the image display device 100. Also in the second luminance range, since the maximum duration is “20 seconds” and the sustainable time is “30 seconds”, the assumed performance is below the limit performance of the image display device 100. Also, regarding the third luminance range, since the maximum duration is “0 seconds” and the sustainable time is “output impossible (0 seconds)”, the assumed performance is below the limit performance of the image display device 100. is there. Therefore, when the input moving image data is the moving image data of FIG. 2, it is determined that the assumed performance is equal to or lower than the limit performance of the image display device 100, and the process proceeds from S903 to S904.

  An example in which the input moving image data is the moving image data of FIG. 3 will be described. In this case, for the first luminance range and the third luminance range, the assumed performance is less than the limit performance of the image display device 100. However, regarding the second luminance range, the maximum duration is “40 seconds” and the sustainable time is “30 seconds”, and thus the assumed performance exceeds the limit performance of the image display device 100. Therefore, when the input moving image data is the moving image data of FIG. 3, it is determined that the assumed performance exceeds the limit performance of the image display device 100, and the processing proceeds from S903 to S905.

  An example in which the input moving image data is the moving image data of FIG. 4 will be described. In this case, for the first luminance range and the second luminance range, the assumed performance is less than or equal to the limit performance of the image display device 100. However, regarding the third luminance range, the maximum duration is “10 seconds” and the sustainable time is “output impossible”, and thus the assumed performance exceeds the limit performance of the image display device 100. Therefore, when the input moving image data is the moving image data of FIG. 4, it is determined that the assumed performance exceeds the limit performance of the image display device 100, and the process proceeds from S903 to S905.

Note that when the content assumed luminance information described above is not included in the input moving image data, the image display device 100 may generate information equivalent to the content assumed luminance information. For example, the assumed luminance information acquisition unit 102 may generate information equivalent to the content assumed luminance information by analyzing the scene assumed luminance information (backlight luminance information) of all scenes of the input moving image data. Specifically, the assumed luminance information acquisition unit 102, for each of a plurality of scenes, the duration of the first luminance range (the duration for which the assumed luminance of the first luminance range continues), the duration of the second luminance range, and The duration of the third luminance range may be determined using the scene assumed luminance information. Then, the assumed luminance information acquisition unit 102 performs processing for determining the maximum duration of a plurality of durations corresponding to a plurality of scenes as the maximum duration, as a first luminance range, a second luminance range, and a third luminance range. You may do about each of. By such processing, information equivalent to the assumed content luminance information can be obtained.

  The process of S904 is performed when the image display apparatus 100 can realize display at the assumed luminance. Therefore, in S904, the parameter determination unit 104 determines the assumed luminance information input by the processing in S901 as display luminance information. Then, the process proceeds from S904 to S906.

  The process of S905 is performed when the image display apparatus 100 cannot realize display at the assumed luminance. Therefore, in S905, the parameter determination unit 104 corrects the assumed luminance information input by the processing in S901 so that the assumed performance is equal to or lower than the limit performance of the image display device 100. In this embodiment, the parameter determination unit 104 reduces the backlight luminance indicated by the backlight luminance information for all scenes of the input moving image data. As a result, the display luminance of the image display device 100 is controlled to the display luminance obtained by reducing all the assumed luminances of the input moving image data through the processing described later. In the present embodiment, a plurality of backlight luminances (backlight luminances indicated by the backlight luminance information) are reduced at the same reduction rate. Specifically, each of the plurality of backlight luminances is halved. Thereby, the assumed luminance in the first luminance range is associated with the scene associated with the assumed luminance (assumed backlight luminance) in the second luminance range, and the assumed luminance in the third luminance range corresponds to the scene. An assumed luminance within the second luminance range is associated with the attached scene. Then, the process proceeds from S905 to S906. The reduction rate may be larger or smaller than 1/2.

  Here, an example in which the input moving image data is the moving image data of FIG. 3 will be described. In this case, the assumed luminance within the second luminance range is associated with the correction, and the assumed luminance within the first luminance range is associated with the scene having the maximum duration of “40 seconds”. It becomes. As a result, since the sustainable time of the first luminance range is “unlimited”, the assumed performance is equal to or less than the limited performance of the image display device 100. An example in which the input moving image data is the moving image data of FIG. 4 will be described. In this case, the assumed luminance within the third luminance range is associated with the correction, and the assumed luminance within the second luminance range is associated with the scene having the maximum duration of “10 seconds”. It becomes. As a result, since the sustainable time of the second luminance range is “30 seconds”, the assumed performance is less than the limit performance of the image display device 100.

  In S906, the parameter determination unit 104 determines an image correction parameter and a backlight control parameter based on the display luminance information determined by the processing in S904 or S905. Then, the parameter determination unit 104 outputs the determined image correction parameter to the image processing unit 105, and outputs the determined backlight control parameter to the backlight control unit 107. In this embodiment, the parameter determination unit 104 outputs the gradation information included in the display luminance information to the image processing unit 105 as an image correction parameter. Then, the parameter determination unit 104 outputs the backlight luminance information included in the display luminance information to the backlight control unit 107 as a backlight control parameter.

Next, the image processing unit 105 and the backlight control unit 107 perform processing based on the parameters determined in S906 (S907). Specifically, the image processing unit 105 generates display moving image data by performing image processing using the image correction parameter determined in S906 on the input moving image data. The image processing unit 105 outputs the generated display moving image data to the liquid crystal panel 106. Then, the backlight control unit 107 determines a light emission control value based on the backlight control parameter determined in S906. The backlight control unit 107 outputs the determined light emission control value to the backlight module 108.

  The liquid crystal panel 106 and the backlight module 108 display a moving image based on the display moving image data and the light emission control value obtained in S907 (S908). Specifically, the transmittance of the liquid crystal panel 106 is controlled to the transmittance corresponding to the display moving image data generated in S907. Then, the light emission luminance of the backlight module 108 is controlled to the light emission luminance corresponding to the light emission control value determined in S907.

  According to the above method, when the assumed performance exceeds the limit performance, the display brightness of the image display device 100 is controlled to the display brightness obtained by reducing all the assumed brightness of the input moving image data at the same reduction rate. Specifically, all assumed backlight luminances are reduced at the same reduction rate, and the light emission luminance of the backlight module 108 is controlled to the reduced backlight luminance. Thereby, display quality can be improved. For example, it is possible to suppress a decrease in display quality such as a temporal change in contrast and a temporal change in display luminance.

  Note that tone information is not corrected in the above method, but tone information may be corrected according to corrected backlight luminance information (backlight luminance after correction). Thereby, it is possible to suppress other deterioration in display quality such as blackout.

  As described above, according to the present embodiment, the display of the image display device is controlled in consideration of not only the input moving image data and the assumed luminance information but also the restricted state of the image display device. Thereby, it is possible to improve the display quality in an image display device having a display time limit. Further, it is possible to perform display that fully utilizes the limiting performance of the image display device. Specifically, display using not only the first luminance range but also the second luminance range is possible.

  In this embodiment, an example in which the time for maintaining the backlight luminance is limited has been described. However, the time for maintaining the transmittance of the liquid crystal panel may be limited. In this case, for example, the gradation information may be corrected so that the assumed performance is equal to or lower than the limit performance of the image display device.

  In the present embodiment, the example in which the display brightness of the image display apparatus is controlled to the display brightness obtained by reducing all the assumed brightness of the input moving image data with the same reduction rate is described, but the present invention is not limited to this. For example, the reduction rate may be different among a plurality of assumed luminances. Specifically, the reduction rate (assumed reduction rate of the backlight luminance) may be different among a plurality of assumed backlight luminances.

  Only a part of the assumed luminance of the input moving image data may be reduced. For example, the display luminance of the image display device may be controlled to the assumed luminance within the first luminance range, and the display luminance of the image display device may be controlled to the display luminance obtained by reducing the assumed luminance within the second luminance range. In that case, all the assumed luminances in the second luminance range may be reduced, or some assumed luminances in the second luminance range may be reduced. For example, the display brightness in which the display brightness of the image display device is controlled to the assumed brightness within the second brightness range whose duration is equal to or less than the threshold, and the assumed brightness within the second brightness range whose duration is longer than the threshold is reduced. In addition, the display brightness of the image display device may be controlled. A specific example of the display brightness control method is as described above.

Further, for the assumed brightness within the second brightness range whose duration is longer than the threshold, after the display brightness of the image display device is controlled to the assumed brightness for a time equal to or less than the threshold, the image is displayed with the reduced display brightness. The display brightness of the display device may be controlled. That is, the display may be controlled so that the assumed performance is equal to or lower than the limit performance at a timing when the assumed performance exceeds the limit performance of the image display device. Here, as a processing example when the sustainable time of the second luminance range is “30 seconds”, a processing example for a scene in which the assumed luminance in the second luminance range continues for “40 seconds” will be described. To do. In this case, the backlight luminance information is used without correction for the first 30-second period of the scene. The backlight luminance information is corrected and used for the last 10 seconds of the scene. Such processing can be realized, for example, by using a measurement unit that measures the time during which the display is performed. Note that it is desirable to further correct the gradation information for the last 10 seconds of the scene in order to suppress temporal changes in display brightness in the scene, temporal changes in contrast in the scene, and the like. .

  In the present embodiment, the example in which the display brightness of the image display apparatus is controlled has been described, but the present invention is not limited to this. For example, the playback speed of the input moving image data may be controlled so that the display time at the display brightness within the second brightness range is less than or equal to the threshold value. Specifically, when the input moving image data is the moving image data of FIG. 3, the playback speed may be increased at a magnification larger than 4/3 times. Accordingly, the maximum duration “40 seconds” of the second luminance range can be reduced to a time equal to or shorter than the sustainable time “30 seconds” of the second luminance range. The method for changing the playback speed is not particularly limited. For example, in a configuration in which moving image data is stored in the storage unit and the moving image data is read from the storage unit and processed, the playback speed is changed by changing the speed (reading speed) of reading the moving image data from the storage unit. Can do.

  Note that the display of the image display device is such that a display closest to the display assumed in the input moving image data is obtained from the plurality of displays in which the display time at the display brightness within the second brightness range is equal to or less than the threshold. Preferably it is controlled. For example, the assumed luminance within the second luminance range may be corrected to the maximum luminance of the display luminance within the first luminance range. The playback speed may be increased so that the duration of the assumed brightness within the second brightness range is shortened from a time longer than the threshold to the same time as the threshold. As a result, it is possible to convey to the user of the image display device a sense of presence, sparkle, and the like intended by the producer of input moving image data.

Note that the assumed luminance information is not limited to scene assumed luminance information, content assumed luminance information, and the like. For example, information indicating at least one of the following 10 types of information may be used as the assumed luminance information.
(A1) Assumed luminance of each scene of input moving image data (A2) Assumed luminance of each frame of input moving image data (A3) Assumed luminance of each pixel of input moving image data (A4) Assumed luminance of each pixel group of input moving image data ( A5) Maximum luminance of a plurality of assumed luminances (A6) Upper limit luminance of the assumed luminances (A7) One or more high luminance durations that are durations of the assumed luminances in the second luminance range (A8) Multiple high luminance durations (A9) Presence or absence of assumed luminance within the second luminance range (A10) Data format of input moving image data

The information (A1) is the same information as the assumed scene brightness information. When the assumed luminance differs between a plurality of frames included in one scene, it is preferable to use the information (A2). When the assumed luminance differs among a plurality of image areas in one frame, it is preferable to use information (A3), information (A4), and the like. Specifically, when the assumed luminance differs among a plurality of pixels, it is preferable to use the information (A3). When the assumed luminance differs among a plurality of pixel groups, it is preferable to use the information (A4). A pixel group is a set of two or more pixels. If the information of (A2) is used, the temporal change of the assumed luminance can be grasped in units of frames, and if the information of (A3) is used, the temporal change of the assumed luminance can be grasped in units of pixels. If used, it is possible to grasp the temporal change in the assumed luminance in units of pixel groups. Therefore, if the information of (A2) to (A4) is used, it is possible to determine with high accuracy whether or not the assumed performance exceeds the limit performance of the image display device, compared to the case of using the information of (A1). Can do.

  Note that the backlight module may include a plurality of light sources respectively corresponding to a plurality of regions in the screen. And the light emission brightness | luminance of each light source may be controlled separately. For example, when the final assumed brightness (assumed backlight brightness) is different among a plurality of image areas, each of the plurality of image areas is changed to the image area according to the assumed brightness of the image area. The emission luminance of the corresponding light source may be controlled. The light emission luminance of the backlight module (each light source) may be controlled in consideration of the input image data.

FIG. 6 shows an example in which the information (A5) is used as the content assumed luminance information. The content assumed luminance information (information of (A5)) in FIG. 6 indicates that the maximum luminance of the plurality of assumed luminances (backlight luminances) is 1500 cd / m ² . When the image display apparatus has the restricted state of FIG. 5, the maximum luminance 1500 cd / m ² of the plurality of backlight luminances belongs to the first luminance range in which the sustainable time is “unlimited”. Therefore, from the maximum luminance of 1500 cd / m ² , it can be determined that the assumed performance is below the limit performance of the image display device. On the other hand, when the maximum brightness of the assumed plurality of backlight brightness is 3000 cd / m ² , the assumed performance may exceed the limit performance of the image display device. Therefore, in that case, it is determined that the assumed performance is higher than the limit performance of the image display device, and the assumed backlight brightness is reduced or reproduced so that the assumed performance is less than or equal to the limit performance of the image display device. You can change the speed.

  In FIG. 6, the assumed scene brightness information is used, but the assumed scene brightness information may not be used. That is, only the information (A5) may be used as the assumed luminance information. In that case, for example, the maximum brightness (information of (A5)) of a plurality of assumed brightnesses may be used as the assumed brightness of all scenes.

  When the information (A6) is used, for example, the same processing as that when the information (A5) is used is performed. The information (A8) is the same information as the assumed content luminance information shown in FIGS. When the information of (A7) is used, for example, after the information of (A8) is obtained from the information of (A7), the same processing as the case of using the information of (A8) is performed. When the information of (A9) is used, for example, a determination result as to whether the assumed performance is equal to or lower than the limit performance of the image display device is obtained according to the presence / absence of the assumed luminance within the second luminance range. . Specifically, when there is an assumed brightness within the second brightness range, it is determined that the assumed performance is higher than the limit performance of the image display device, and when there is no assumed brightness within the second brightness range, the assumed performance is It is determined that the performance is below the limit performance of the image display device. The upper limit luminance of the assumed luminance may be determined by the data format of the moving image data. Therefore, it is possible to determine whether or not the assumed performance is equal to or lower than the limit performance of the image display device using the information of (A10).

Note that the restricted state of the image display device may or may not be a predetermined fixed state. For example, the restricted state may be a state set according to a user operation or a state set according to the operation mode of the image display device. Further, the restriction state may depend on at least one of the following seven types of information.
(B1) Temperature of the image display device (B2) Remaining battery power of the image display device (B3) Total time of display by the image display device (total display time)
(B4) Number of times the image display device has performed display (high brightness display) with display brightness within the second brightness range (high brightness display count)
(B5) Elapsed time (interval time) after the image display device ends high-luminance display
(B6) Size of a region where high luminance display is performed on the screen of the image display device (high luminance display size)
(B7) Feature value of gradation value of input moving image data

  In this case, the restriction state management unit may determine the restriction state based on at least one of the seven types of information. For example, the restriction state may be determined using predetermined information (function, lookup table, etc.) indicating the correspondence between at least one of the seven types of information and the restriction state. Specifically, when the temperature of the image display device is high, the threshold value may be reduced or the maximum luminance and the minimum luminance in the luminance range may be reduced in order to prevent the temperature from rising. When the temperature of the image display device is low, a slight increase in temperature may be allowed, the threshold value may be increased, and the maximum luminance and the minimum luminance in the luminance range may be increased. When the remaining battery level is low, the threshold value may be reduced or the maximum luminance and the minimum luminance in the luminance range may be reduced in order to reduce power consumption. When the total display time is long, the number of high-luminance display times is large, the high-luminance display size is large, etc., the threshold value is reduced to prevent aging of the image display device, temperature rise of the image display device, etc. Or the maximum luminance and the minimum luminance of the luminance range may be reduced. When the interval time is short, the threshold value may be reduced or the maximum luminance and the minimum luminance of the luminance range may be reduced in order to prevent the temperature of the image display apparatus from increasing. When the high-luminance display size is large, the threshold value is reduced or the maximum and minimum luminance of the luminance range are reduced to prevent the temperature of the image display device from rising and reduce power consumption. Also good.

  The temperature, the remaining battery level, etc. are detected using various sensors, for example. The total display time, the number of high-luminance display times, the interval time, and the like are detected using, for example, various counters. The high luminance display size is determined using, for example, a backlight control parameter indicating the light emission luminance of each light source of the backlight module. For the determination of the high luminance display size, input moving image data, image correction parameters, and the like may be further used.

  The pixel value, feature amount, etc. of the input moving image data are not particularly limited. The pixel value is, for example, an RGB value, a YCbCr value, or the like. The feature amount is, for example, a representative value of a gradation value (maximum value, minimum value, average value, mode value, intermediate value, etc.), a gradation value histogram, or the like. Here, an example in which an average gradation value (average value of gradation values; APL) is used as the feature amount will be described. When the APL (Average Picture Level) is large, the temperature rise rate of the image display device, the power consumption of the image display device, and the like are high. Therefore, when the APL is large, a shorter time may be set as a threshold than when the APL is small, or a lower value may be set as the maximum luminance and the minimum luminance of the luminance range than when the APL is small.

An identifier (such as ID) may be used as the assumed luminance information. FIG. 7 shows an example of ID that is assumed luminance information. ID = 1 in FIG. 7, the backlight luminance is continued for 30 seconds at 2000 cd / ^{m 2} or more 3999cd / ^{m 2} or less is scene longest, and the backlight luminance is 4000 cd / ^{m 2} or more ~7999cd / ^{m 2} or less This means that there is no scene. ID = 2 is the backlight brightness is continued for 30 seconds at 2000 cd / ^{m 2} or more 3999cd / ^{m 2} or less is scene longest, and the backlight luminance is 4000 cd / ^{m 2} or more ~7999cd / ^{m 2} or less scenes Means a maximum of 30 seconds. Therefore, when the assumed luminance information is ID = 1 and the restricted state is the restricted state in FIG. 5, it may be determined that the assumed performance is less than or equal to the restricted performance of the image display device 100. Then, when the assumed luminance information is ID = 2 and the restricted state is the restricted state in FIG. 5, it may be determined that the assumed performance is higher than the restricted performance of the image display device 100.

An identifier may be used as the restriction information. FIG. 8 shows an example of an ID that is restriction information. ID = 1, 2 in FIG. 8 means that the backlight module 108 can output light with a backlight luminance of 0 cd / m ² or more and 1999 cd / m ² or less without limitation. ID = 1, 2 in FIG. 8, "the backlight module 108 can not output the light of 4000 cd / ^{m 2} or more 7999cd / ^{m 2} or less of the backlight luminance" is also meant. ID = 1 in FIG. 8, "the backlight module 108, if 30 seconds or less, the light of 3000 cd / ^{m 2} or more 3999cd / ^{m 2} or less of the backlight luminance can be output continuously" also mean To do. Then, ID = 2 in FIG. 8, "the backlight module 108, if 60 seconds or less, can be output continuously the light of 3000 cd / ^{m 2} or more 3999cd / ^{m 2} or less of the backlight luminance" it Also means. When both the assumed luminance information and the restriction information are IDs, the assumed performance is the image display device according to the combination of the assumed luminance ID (ID that is the assumed luminance information) and the restriction ID (ID that is the restriction information). It is possible to determine whether or not the performance is below the limit performance. For example, when the assumed luminance ID is ID = 1 in FIG. 7 and the restriction ID is ID = 1 in FIG. 8, it is possible to determine that the assumed performance is equal to or less than the restriction performance of the image display device 100. . When the assumed luminance ID is ID = 2 in FIG. 7 and the restriction ID is ID = 1 in FIG. 8, it can be determined that the assumed performance is higher than the restriction performance of the image display device 100.

When the assumed luminance information is not acquired, the display of the image display device may be controlled based on the input moving image data, the predetermined assumed luminance information, and the restriction information. For example, when the restricted state is the restricted state of FIG. 5, the sustainable time of the first luminance range is “unlimited”, and therefore the backlight luminance within the first luminance range is assumed to be the assumed luminance (assumed backlight). Brightness). Specifically, the maximum luminance 1999 cd / m ^{2 in} the first luminance range is used as the assumed luminance.

  If the assumed luminance information is not input to the image display device (image display device), the assumed luminance information acquisition unit generates the assumed luminance information based on the feature value of the gradation value of the input moving image data. Also good. For example, the assumed luminance information acquisition unit determines a higher assumed luminance as the APL is higher. As described above, the feature amount is not particularly limited.

<Example 2>
Embodiment 2 of the present invention will be described below. In the following, configurations and processes different from those in the first embodiment will be described in detail, and descriptions of the same configurations and processes as those in the first embodiment will be omitted. In addition, processing for moving image data will be described below, but still image data can also be used.

  FIG. 10 is a block diagram illustrating an example of a functional configuration of the image display system according to the present embodiment. As shown in FIG. 10, the image display system according to the present embodiment includes an image display device 110 and an information processing device 1000. Each of the image display device 110 and the information processing device 1000 can be connected to an external device. In FIG. 10, the image display apparatus 110 and the information processing apparatus 1000 are connected to each other. As the information processing apparatus 1000, an image reproducing apparatus (Blu-ray recorder, Blu-ray player, hard disk recorder, etc.), PC, photographing apparatus, or the like can be used. 10, the same reference numerals as those in FIG. 1 are attached to the same functional units as those in FIG. 1 (Example 1).

  The image display device 110 further includes a communication unit 1005 in addition to the functional units included in the image display device 100 of FIG. A communication unit 1005 communicates with an external device. In this embodiment, the communication unit 1005 communicates with the information processing apparatus 1000 (a communication unit 1004 described later). In this embodiment, the communication unit 1005 acquires the restriction information from the restriction state management unit 103 and outputs the restriction information to the information processing apparatus 1000. In addition, the communication unit 1005 acquires the assumed luminance information from the information processing apparatus 1000 and outputs the assumed luminance information to the parameter determination unit 104.

  Thus, in this embodiment, the assumed luminance information is acquired by the communication unit 1005. Therefore, the image display device 110 may not have the assumed luminance information acquisition unit 102. However, as in the first embodiment, the assumed luminance information may not be acquired by the communication unit 1005, and the assumed luminance information may be included in the input moving image data. In such a case, the assumed luminance information acquisition unit 102 is necessary. Further, the assumed luminance information may be acquired by the communication unit 1005, and the assumed luminance information may be included in the input moving image data. In that case, it is only necessary to select one of the two assumed luminance information so that the assumed luminance information obtained by the assumed luminance information acquisition unit 1003 described later is used.

  The information processing apparatus 1000 includes an image reading unit 1001, an image output unit 1002, an assumed luminance information acquisition unit 1003, and a communication unit 1004. The image reading unit 1001 reads moving image data from a storage medium, a storage device, or the like. The image output unit 1002 outputs the moving image data read by the image reading unit 1001 to the outside. In this embodiment, the image output unit 1002 outputs moving image data to the image display device 110 (image acquisition unit 101). The moving image data may be output to the image display device 110 via a cable, or may be output to the image display device 110 wirelessly. As the image output unit 1002, an output terminal, a communication interface, or the like can be used.

  The assumed luminance information acquisition unit 1003 acquires the assumed luminance information based on the moving image data read by the image reading unit 1001 (luminance acquisition). In the present embodiment, the assumed luminance information acquisition unit 1003 acquires the assumed luminance information by the same processing as the processing of the assumed luminance information acquisition unit 102 of the first embodiment. A communication unit 1004 communicates with an external device. In this embodiment, the communication unit 1004 communicates with the image display device 110 (communication unit 1005). In the present embodiment, the communication unit 1004 acquires restriction information from the image display device 110 (restriction acquisition), and outputs the restriction information to the assumed luminance information acquisition unit 1003. Further, the communication unit 1004 acquires the assumed luminance information from the assumed luminance information acquisition unit 1003 and outputs the assumed luminance information to the image display device 110.

  Note that the assumed luminance information obtained by the assumed luminance information acquisition unit 1003 may be output from the image output unit 1002 as auxiliary data of moving image data. In the present embodiment, an example in which moving image data is output from the information processing apparatus 1000 to the image display apparatus 110 has been described, but the present invention is not limited to this. If input moving image data input to the image display device 110 is acquired by the information processing device 1000, the image display device 110 may acquire moving image data from a device different from the information processing device 1000. In the present embodiment, an example in which the information processing apparatus 1000 acquires restriction information from the image display apparatus 110 has been described, but the present invention is not limited thereto. For example, the information processing apparatus 1000 may acquire restriction information of the image display apparatus 110 from another apparatus (such as a server) connected to the Internet.

  Next, the processing flow of the image display system according to the present embodiment will be described with reference to the flowchart of FIG. First, the user instructs processing (for example, reproduction of moving image data) to the information processing apparatus 1000 (S1101). When the instruction of S1101 is performed, the information processing apparatus 1000 (a control unit (not illustrated) of the information processing apparatus 1000) inquires of the image display apparatus 110 about the restriction state of the image display apparatus 110 via the communication unit 1004 (S1102). . When the image display device 110 (a control unit (not shown) of the image display device 110) receives an inquiry of S1102 from the information processing device 1000 via the communication unit 1005, the image display device 110 notifies the restriction information. Specifically, the image display device 110 (a control unit (not shown) of the image display device 110) reads the restriction information from the restriction state management unit 103 (S1103), and sends the read restriction information to the information via the communication unit 1005. The processing apparatus 1000 is notified (S1104). As a result, the assumed luminance information acquisition unit 1003 of the information processing apparatus 1000 acquires restriction information of the image display device 110 from the image display device 110 via the communication unit 1004.

  When the instruction in S1101 is performed, the image reading unit 1001 reads moving image data. Then, the assumed luminance information acquisition unit 1003 extracts assumed luminance information from the read moving image data (S1105). When the processes of S1104 and S1105 are performed, the assumed brightness information acquisition unit 1003 edits the assumed brightness information extracted by the process of S1105 (S1106). Specifically, in S1106, the data format of the assumed luminance information extracted by the process of S1105 is converted into a data format corresponding to the data format of the restriction information acquired by the process of S1104.

  Note that the moving image data may be read at any timing as long as it is performed before the processing of S1105. The process of S1105 may be performed at any timing as long as it is performed after reading of moving image data and before the process of S1106. For example, the process of S1105 may be performed before the process of S1104. Further, when the assumed luminance information having a data format corresponding to the data format of the restriction information is acquired from the moving image data, the processes of S1102 to S1104, the process of S1106, and the like may be omitted.

  A specific example of the process of S1106 will be described. First, an example in which the restriction information is the restriction information in FIG. 5 will be described. In this case, for example, the assumed content luminance information extracted from the moving image data is converted into information indicating the maximum duration for each of the first luminance range, the second luminance range, and the third luminance range. 2 to 4 indicate the maximum duration for each of the first luminance range, the second luminance range, and the third luminance range. Therefore, when the content assumed luminance information of FIGS. 2 to 4 is extracted from the moving image data, the process of S1106 is omitted.

12 and 13 show an example of moving image data according to the present embodiment. The data format of the assumed content brightness information included in the moving image data in FIG. 12 does not correspond to the data format of the restriction information in FIG. 12 Content assumed luminance information, only the backlight brightness ^{1000cd / m 2, 3000cd / m} 2 is assumed, and a maximum duration of 1000 cd / ^{m 2} is 600 seconds, and, 3000 cd / ^{m 2} Indicates that the maximum duration is 40 seconds. Therefore, when the moving image data of FIG. 12 is read, the process of S1106 is necessary.

From the assumed content luminance information in FIG. 12 and the restriction information in FIG. 5, it can be seen that 1000 cd / m ² belongs to the first luminance range and 3000 cd / m ² belongs to the second luminance range. The maximum duration of the first luminance range (1000 cd / m ² belonging to the first luminance range) is 600 seconds and the maximum duration of the second luminance range (3000 cd / m ² belonging to the second luminance range). Is 40 seconds. Furthermore, it can be seen that the backlight luminance within the third luminance range is not assumed, that is, the maximum duration of the third luminance range is 0 seconds. Therefore, the content assumed luminance information in FIG. 12 is converted into the content assumed luminance information in FIG. 3 by the processing of S1106.

  Content assumed luminance information is not added to the moving image data of FIG. Therefore, when the moving image data of FIG. 13 is read, the process of S1106 is necessary. In this case, for example, in S1106, the assumed content brightness information corresponding to the restriction information in FIG. 5 is generated by analyzing the assumed scene brightness information. Note that the processing when content assumed luminance information is not added to moving image data is not limited to this. For example, predetermined content assumed luminance information may be used, or content assumed luminance information may be generated based on the feature value of the gradation value of the read moving image data.

Next, an example in which the restriction information is the restriction ID in FIG. 8 will be described. In this case, for example,
The assumed content brightness information extracted from the moving image data is converted into an ID. Specifically, when the assumed performance is less than or equal to the limit performance of the image display device 110, the content assumed luminance information is converted to the same ID as the limit ID. When the restriction ID is ID = 1 in FIG. 8 and the moving image data in FIG. 2 is read, the assumed performance is equal to or less than the restriction performance, so the content assumed luminance information in FIG. Converted. The determination as to whether or not the assumed performance is equal to or lower than the limit performance can be realized using information indicating a correspondence relationship between the limit ID and the limit performance (limit state), for example. When the assumed performance exceeds the limit performance of the image display device 110, the assumed content brightness information is converted to an ID different from the limit ID. For example, the content assumed luminance information is converted into the same ID as the restriction ID corresponding to the restriction performance that is higher than the assumed luminance. When there are a plurality of restriction IDs corresponding to the restriction performance equal to or higher than the assumed brightness, the content assumed brightness information is converted into a plurality of IDs that are the same as the restriction ID corresponding to the lowest restriction performance among the plurality of restriction IDs. Also good. The assumed content luminance information may be converted into a plurality of IDs that are the same as a plurality of restriction IDs.

  After S1106, the assumed luminance information acquisition unit 1003 notifies the assumed luminance information to the image display device 110 via the communication unit 1004 (S1107). When the assumed brightness information is converted by the process of S1106, the assumed brightness information after the conversion is notified, and when the assumed brightness information is not converted by the process of S1106, the assumed brightness extracted by the process of S1105 Information is notified. Then, the parameter determination unit 104 of the image display device 100 determines a parameter based on the assumed luminance information notified by the process of S1107 and the restriction information managed by the restriction state management unit 103 (S1108). Specifically, the image correction parameter and the backlight control parameter are determined by the same processing as in the first embodiment.

  Next, the image output unit 1002 outputs the moving image data read by the image reading unit 1001 to the image display device 110 (S1109). Then, the image display device 100 displays the moving image data (main stream) output from the image output unit 1002 in S1109 using the parameters determined in S1108 by the same processing as in the first embodiment. Note that the processing of S1109 may be performed at any timing as long as it is performed after reading of moving image data.

  In the present embodiment, as in the first embodiment, not only the input moving image data and the assumed luminance information but also the display state of the image display device is controlled in consideration of the restricted state of the image display device. Thereby, it is possible to improve the display quality in an image display device having a display time limit.

In this embodiment, the example in which the information processing apparatus acquires the restriction information in response to a user operation on the information processing apparatus has been described, but the present invention is not limited to this. For example, the restriction information may be acquired according to at least one of the following seven types of phenomena (actions).
(C1) User operation on the information processing apparatus,
(C2) Connection of image display device to information processing device (C3) Change in image display device connected to information processing device (C4) Change in number of image display devices connected to information processing device (C5) Input moving image data (C6) Request from image display device (C7) Change in restricted state

The process of acquiring the restriction information according to (C1) is as described above. The process of acquiring the restriction information according to (C2) to (C4) can be realized by providing each of the information processing apparatus and the image display apparatus with a communication mechanism that detects the connection between the source device and the sink device. . For example, by using a communication mechanism provided in each of the information processing apparatus and the image display apparatus, the information processing apparatus can detect the connection of the image display apparatus to the information processing apparatus. The information processing apparatus can acquire the restriction information in response to the detection of the connection of the image display apparatus to the information processing apparatus. (C4) “Change in image display device connected to information processing device” means “Change in image display device connected to information processing device to other image display device”, “Change in image display device connected to information processing device” Change in firmware of the image display apparatus ”and the like.

  The process of acquiring the restriction information according to (C5) can be realized by providing the information processing apparatus with a playback mode setting unit that sets the playback mode. The playback mode is a mode corresponding to a playback method such as slow playback, quick playback, and pause. When the playback mode changes, the time required for playback of moving image data (the time required to play back the entire moving image data) changes. Therefore, by acquiring the restriction information according to the change in the reproduction mode, it is possible to notify the image display apparatus of the assumed luminance information corresponding to the reproduction mode after the change. Note that the playback mode setting unit may be provided in the image display device. In that case, the image display device may notify the information processing device of a change in the reproduction mode (corresponding to (C6)).

  The process of acquiring the restriction information according to (C7) can be realized by the restriction state management unit determining the restriction state of the image display device. The method for determining the restriction state is as described in the first embodiment. For example, the restricted state management unit can detect a change in the restricted state by determining the restricted state. The image display apparatus can output a request to the information processing apparatus in response to detection of a change in the restricted state (corresponding to (C6)). Then, the information processing apparatus can acquire restriction information in response to a request from the image display apparatus. By acquiring the restriction information according to the change in the restriction state, it is possible to notify the image display apparatus of the assumed luminance information corresponding to the restriction state after the change (restriction information after the change).

<Example 3>
Embodiment 3 of the present invention will be described below. In the first and second embodiments, the example in which display luminance information (corrected assumed luminance information) is generated by the image display device has been described. In this embodiment, an example in which display luminance information is generated by the information processing apparatus will be described. In the following, the configuration and processing different from those in the first and second embodiments will be described in detail, and the description of the same configuration and processing as those in the first and second embodiments will be omitted.

  FIG. 14 is a block diagram illustrating an example of a functional configuration of the image display system according to the present embodiment. As illustrated in FIG. 14, the image display system according to the present embodiment includes an image display device 110 and an information processing device 1200. 14, the same reference numerals as those in FIGS. 1 and 10 are assigned to the same functional units as those in FIGS.

The information processing device 1200 further includes an assumed luminance information correction unit 1201 and a display luminance information synthesis unit 1202 in addition to the functional units included in the information processing device 1000 of FIG. The assumed luminance information correction unit 1201 corrects the assumed luminance information acquired by the assumed luminance information acquisition unit 1003 based on the restriction information acquired by the communication unit 1004. As a result, display luminance information is generated so that the display time at the display luminance within the second luminance range is less than or equal to the threshold value. The method for correcting the assumed luminance information, that is, the method for correcting the display luminance information is the same as in the first embodiment. In the case where the playback speed is changed so that the display time at the display brightness within the second brightness range is equal to or less than the threshold value, for example, if information about the changed playback speed is generated as the display brightness information Good. The playback speed may be changed by changing the speed at which the image reading unit 1001 reads moving image data from the storage unit, the speed at which the image output unit 1002 outputs moving image data, and the like. The display luminance information combining unit 1202 combines the display luminance information generated by the assumed luminance information correction unit 1201 with the moving image data read by the image reading unit 1001 as auxiliary data. As a result, the moving image data including the display brightness information generated by the assumed brightness information correction unit 1201 is output from the image output unit 1002 of the information processing device 1200 to the image acquisition unit 101 of the image display device 110. Note that the display luminance information may be output from the communication unit 1004 of the information processing device 1200 to the communication unit 1005 of the image display device 110. In that case, the information processing apparatus 1200 does not have to include the display luminance information combining unit 1202.

  As described above, in this embodiment, the display brightness information is generated by the information processing apparatus 1200, and the display brightness information is output from the information processing apparatus 1200. Therefore, the image display apparatus 110 (102, communication unit 1005, etc.) acquires display luminance information instead of assumed luminance information. Then, the display control unit 109 controls the display of the image display device 110 based on the input moving image data and the display luminance information. Specifically, the parameter determination unit 104 determines the image correction parameter and the backlight control parameter according to the display luminance information without correcting the assumed luminance information.

  Next, the processing flow of the image display system according to the present embodiment will be described with reference to the flowchart of FIG. 15, the same processes as those in FIG. 11 (Example 2) are denoted by the same reference numerals as those in FIG. First, similarly to the second embodiment, the processes of S1101 to S1106 are performed. Next, the assumed luminance information correction unit 1201 compares the assumed luminance information with the restriction information acquired by the process of S1104 (S1301). Then, the assumed brightness information correction unit 1201 generates display brightness information based on the comparison result of S1301 (S1302). Specifically, when the assumed performance is below the limit performance of the image display device 110, the same information as the assumed brightness information is generated as the display brightness information. When the assumed performance exceeds the limit performance of the image display device 110, display brightness information is generated by correcting the assumed brightness information by the same method as in the first embodiment. When the assumed luminance information is converted by the processing in S1106, the converted assumed luminance information is used in S1301 and 1302. When the assumed luminance information is not converted by the process of S1106, the assumed luminance information extracted by the process of S1105 is used in S1301 and 1302.

  Next, the display luminance information combining unit 1202 combines the display luminance information generated by the process of S1302 with the moving image data read by the image reading unit 1001. Then, the image output unit 1002 outputs the moving image data after the display luminance information is combined to the image display device 110 (S1303). Next, the image display apparatus 100 displays the moving image data output from the image output unit 1002 in S1303 (S1304). Specifically, display luminance information is extracted from input moving image data (moving image data output from the image output unit 1002), and parameters are determined according to the extracted display luminance information. Then, the input moving image data (main stream) is displayed using the determined parameters.

  As described above, in this embodiment as well, the display of the image display device is controlled in consideration of not only the input moving image data and the assumed luminance information but also the restricted state of the image display device, as in the first embodiment. . Specifically, display luminance information is generated from the assumed luminance information and the restriction information in the same manner as in the first embodiment, and the display of the image display device is controlled based on the input moving image data and the display luminance information. Thereby, it is possible to improve the display quality in an image display device having a display time limit.

Note that when the image display device does not have a communication unit, when the communication between the image display device and the information processing device cannot be performed, the information processing device cannot acquire the restriction information. In such a case, the assumed luminance information correction unit may employ predetermined information as the display luminance information. The predetermined information is, for example, display luminance information related to display luminance that can be performed by the image display apparatus with high probability (including 100% (including certainty)). It is considered that a general image display device can perform unlimited display with a display luminance of 100 cd / m ² . Therefore, when the information processing apparatus cannot acquire the restriction information, the assumed luminance information correction unit generates information indicating that the display luminance is 100 cd / m ² for the entire moving image data as the display luminance information. May be. As a result, it is possible to display with high probability display luminance related to the display luminance information.

  In addition, Examples 1-3 are an example to the last, and the structure obtained by changing suitably and changing the structure of Examples 1-3 within the range of the summary of this invention is also contained in this invention. Configurations obtained by appropriately combining the configurations of Examples 1 to 3 are also included in the present invention.

<Other examples>
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100, 110: Image display device 102, 1003: Assumed luminance information acquisition unit 104: Parameter determination unit 105: Image processing unit 107: Backlight control unit 109: Display control unit 1000, 1200: Information processing device 1002: Image output unit 1004 , 1005: Communication unit 1201: Assumed luminance information correction unit

Claims (26)

An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. Because
An acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data;
Control means for controlling display based on the input moving image data, the assumed luminance information, and the restriction state so that a display time at a display luminance within the second luminance range is equal to or less than the threshold value;
An image display device comprising: The control means includes
Based on the restricted state, the assumed luminance information is corrected so that the display time at the display luminance within the second luminance range is equal to or less than the threshold value,
The image display device according to claim 1, wherein the display is controlled based on the input moving image data and the corrected assumed luminance information. The assumed luminance information is
Assumed brightness of each scene of the input moving image data,
Assumed luminance of each frame of the input moving image data,
Assumed luminance of each pixel of the input moving image data,
Assumed luminance of each pixel group of the input moving image data,
Maximum brightness of multiple assumed brightness,
Upper limit brightness of the assumed brightness,
One or more high brightness durations that are durations of the assumed brightness within the second brightness range;
Maximum time of multiple high intensity durations,
The presence or absence of an assumed luminance within the second luminance range; and
A data format of the input video data;
3. The image display device according to claim 1, wherein the image display device displays at least one of the following. The image display apparatus according to claim 1, wherein the assumed luminance information is an identifier. The said control means controls display brightness | luminance so that the display time with the display brightness | luminance within the said 2nd brightness | luminance range may become the said threshold value or less. Image display device. The image display apparatus according to claim 5, wherein the control unit controls the display luminance to display luminance obtained by reducing all assumed luminances of the input moving image data. The control means controls the display brightness to an assumed brightness within the first brightness range, and controls the display brightness to a display brightness obtained by reducing the assumed brightness within the second brightness range. The image display device according to claim 5. The control means controls the display luminance to an assumed luminance within the second luminance range whose duration is equal to or less than the threshold, and sets the assumed luminance within the second luminance range whose duration is longer than the threshold. The image display apparatus according to claim 7, wherein the display brightness is controlled to a reduced display brightness. For the assumed brightness within the second brightness range whose duration is longer than the threshold, the control means controls the display brightness to the assumed brightness for a time equal to or less than the threshold, and then reduces the assumed brightness. The image display device according to claim 8, wherein the display brightness is controlled. The said control means controls the reproduction speed of the said input moving image data so that the display time with the display brightness | luminance within the said 2nd brightness | luminance range may become below the said threshold value. The image display device according to claim 1. The temperature of the image display device,
The battery level of the image display device;
The total time of the display,
The number of displays at a display brightness within the second brightness range;
An elapsed time since the display at the display luminance within the second luminance range was terminated,
On the screen of the image display device, the size of a region where display is performed with display luminance within the second luminance range, and
A feature value of a gradation value of the input moving image data;
Determining means for determining the restricted state based on at least one of:
The image display device according to claim 1, further comprising: The control means is configured to obtain a display closest to the display assumed in the input moving image data among a plurality of displays in which the display time at the display brightness within the second brightness range is equal to or less than the threshold. The image display apparatus according to claim 1, wherein the display is controlled. The image display device includes a light emitting unit, and a display panel that displays a moving image by modulating light from the light emitting unit,
The control means controls emission luminance of the light emitting unit and modulation factor of the display panel based on the input moving image data, the assumed luminance information, and the restriction state. The image display apparatus of any one of -12. When the assumed brightness information is not obtained by the obtaining means, the control means controls the display based on the input moving image data, predetermined assumed brightness information, and the restriction state. The image display device according to any one of claims 1 to 13. The said acquisition means produces | generates assumption brightness information based on the feature-value of the gradation value of the said input moving image data, when the said assumption brightness information is not input into the said image display apparatus. 14. The image display device according to any one of. The assumed luminance information is auxiliary data included in the input moving image data,
The image display device according to claim 1, wherein the acquisition unit acquires the assumed luminance information by extracting the auxiliary data from the input moving image data. An image display system comprising the image display device according to any one of claims 1 to 16 and an information processing device,
The information processing apparatus includes:
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data, based on input moving image data input to the image display device;
Output means for outputting the assumed luminance information to the image display device;
An image display system comprising: The information processing apparatus includes:
Restriction acquisition means for acquiring restriction information on the restriction state of the image display device;
Conversion means for converting the data format of the assumed luminance information acquired by the luminance acquisition means into a data format corresponding to the data format of the restriction information;
The image display system according to claim 17, wherein the output unit outputs assumed luminance information after conversion by the conversion unit. An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. And an image display system having an information processing device,
The image display device includes:
Obtaining means for obtaining display brightness information relating to display brightness;
Control means for controlling display based on input moving image data and the display luminance information;
Have
The information processing apparatus includes:
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data based on the input moving image data;
Restriction acquisition means for acquiring restriction information on the restriction state;
Correcting means for correcting the assumed luminance information based on the restriction information to generate the display luminance information that causes a display time in the display luminance within the second luminance range to be equal to or less than the threshold;
Output means for outputting the display luminance information generated by the correction means to the image display device;
An image display system comprising: 20. The image display system according to claim 18, wherein the restriction information is an identifier. The restriction acquisition means is
A user operation on the information processing apparatus;
Connection of the image display device to the information processing device;
A change in an image display device connected to the information processing device;
A change in the number of image display devices connected to the information processing device;
A change in playback mode related to playback of the input video data;
A request from an image display device connected to the information processing device, and
A change in the restricted state;
21. The image display system according to claim 18, wherein the restriction information is acquired according to at least one of the following. An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. An information processing apparatus that can be connected to
Luminance acquisition means for acquiring assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data, based on input moving image data input to the image display device;
Restriction acquisition means for acquiring restriction information on the restriction state;
Correcting means for correcting the assumed luminance information based on the restriction information to generate the display luminance information that causes a display time in the display luminance within the second luminance range to be equal to or less than the threshold;
Output means for outputting the display luminance information generated by the correction means to the image display device;
An information processing apparatus comprising: An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. Control method,
Obtaining assumed brightness information related to assumed brightness, which is display brightness assumed in the input video data;
Controlling the display based on the input moving image data, the assumed luminance information, and the restriction state so that the display time at the display luminance within the second luminance range is equal to or less than the threshold value;
A control method for an image display device, comprising: An image display apparatus having a restriction state in which a display time in a display brightness within a second brightness range that is higher than a display brightness within a first brightness range that is a display brightness range is limited to a threshold value or less. An information processing method in an information processing apparatus connectable with
Based on input moving image data input to the image display device, obtaining assumed luminance information related to assumed luminance that is display luminance assumed in the input moving image data;
Obtaining restriction information regarding the restriction state;
Generating the display luminance information by correcting the assumed luminance information based on the restriction information so that a display time at a display luminance within the second luminance range is equal to or less than the threshold;
Outputting the generated display luminance information to the image display device;
An information processing method characterized by comprising:   24. A program for causing a computer to execute each step of the control method for an image display device according to claim 23.   A program for causing a computer to execute each step of the information processing method according to claim 24.

Images