JP5743048B2 - Image display device, electronic device, image display system, image display method, and program - Google Patents

Description

  The present invention relates to an image display device, an electronic device, a measurement jig, an image display system, an image display method, a display correction device, a display correction method, and a program. More specifically, the present invention relates to a display brightness calibration technique.

  As a display element of a pixel, there is a display device using an electro-optical element whose luminance changes depending on an applied voltage or a flowing current. For example, a liquid crystal display element is a typical example of an electro-optical element whose luminance changes depending on an applied voltage, and an organic electroluminescence (Organic Electro Luminescence, Organic EL, Organic) Light Emitting Diode, OLED; hereinafter referred to as organic EL) A typical example is an element (see Patent Document 1). The organic EL display device using the latter organic EL element is a so-called self-luminous display device using an electro-optic element which is a self-luminous element as a pixel display element.

  By the way, the display element has a problem that the actual luminance is reduced with respect to the original luminance corresponding to the display data due to aging or continuous lighting. For this reason, if the degree of deterioration differs for each pixel, it is visually recognized as uneven luminance or uneven color, and the appearance of the display image deteriorates.

  For example, a light-emitting body that constitutes a self-luminous display device has a characteristic that it deteriorates depending on a light emission time (energization time) or a light emission amount, and display efficiency (light emission efficiency) is lowered. The content of the displayed image is not uniform. For this reason, the deterioration of the light emitter does not proceed uniformly. Conventionally, due to this decrease in efficiency, the lifetime until the brightness is reduced to half is short, and not only the display image quality problem such as display unevenness, but also the problem that it is difficult to continue using the display device for a long period of time. There is also. For example, the light emitting body in the time display area progresses faster than the light emitting bodies in the other display areas. For this reason, the brightness | luminance of the light-emitting body of a time display area falls relatively compared with the brightness | luminance of another display area. In general, partial deterioration of the light emitter is referred to as “burn-in”.

  Various methods are being studied for improving “burn-in”. For example, Patent Document 1 discloses a method of measuring deterioration using dummy pixels.

JP 2002-351403 A

  However, since the dummy pixel is different from the display pixel in the method described in Patent Document 1, it is merely predicting the deterioration, and the actual luminance deterioration amount of each pixel cannot be accurately grasped.

  In addition, for example, a method of predicting the luminance deterioration from the integration time of the video signal can be considered. However, in the method of predicting from the integration time of the video signal, if there is a deviation in the luminance degradation curve that is the basis of the prediction, the luminance correction cannot be performed accurately.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a mechanism that can alleviate a problem given to a display image due to a change in characteristics of a display element. In particular, an object of the present invention is to provide a mechanism that can alleviate the influence of luminance changes at individual display pixel positions.

  In one embodiment of the present invention, a plurality of pixels including a display element are arranged, and a detection portion that detects reflected light of a display image through a light transmission portion provided in the image display portion can be arranged on the back side. An image display unit, and a display correction unit that corrects display data based on information detected by the luminance measurement detection unit. In short, the reflected light of the image information on the display surface of the image display unit is detected on the back side of the image display unit, and display is performed after correcting the display data based on the detection information.

  Here, at the time of acquisition of calibration information, the detection unit is a light transmission unit provided in the image display unit with reflected light of the calibration image reflected by the reflection plate disposed at a position facing the display surface of the image display unit. Detect through. The display correction unit acquires correction information for each of the display elements for suppressing the influence of the characteristic variation of the display element based on the information of the calibration image detected by the detection unit.

  During normal image display, the display correction unit corrects display data with reference to correction information for each display element.

  Preferably, an imaging unit (imaging device) that images a subject on the display surface side is provided on the back side of the image display unit, and this imaging unit is used as a detection unit that detects information of a calibration image.

  In such a mechanism of the present invention, when acquiring calibration information, a calibration image is copied on a reflection surface and detected from the back side of the image display unit, and correction information is acquired based on the detection information. Then, at the time of normal image display, the display data can be corrected for each display element so as to obtain a desired image quality (in order to suppress the influence of the characteristic variation of the display element) with reference to the correction information. In other words, the image display unit is provided with a light transmission unit that allows light to reach the back surface, a detection unit (such as an imaging device) is installed at the corresponding position, and a calibration image is displayed on the image display unit when calibration information is acquired. By detecting the reflected light on the back surface, calibration for changes in the characteristics of the display element can be performed.

  According to one embodiment of the present invention, the influence of luminance changes at individual display pixel positions due to changes in the characteristics of display elements can be reduced. That is, at the time of acquisition of calibration information, it is possible to acquire correction information by measuring the state of change in characteristics of the display element for each display element. Therefore, at the time of normal image display, the change in characteristic of the display element for each display element is obtained. Appropriate correction can be made so that the influence is mitigated.

FIG. 1 is a conceptual diagram of an image display device and an image display system according to the present embodiment. FIG. 2 is a schematic diagram of the most typical arrangement of a plurality of pixels constituting the image display unit. FIG. 3 is a diagram illustrating details of the image display unit. FIG. 4 is a diagram illustrating an example of a calibration jig. FIG. 5 is a conceptual diagram showing an example of the shape of the calibration jig. FIG. 6 is a schematic diagram for explaining the influence of the diffraction phenomenon on the captured image. FIG. 7 is a diagram illustrating an example of an image captured by placing a glass plate in front of the imaging device. FIG. 8 is a diagram illustrating an example of a calibration image and an example of the captured image. FIG. 9 is a block diagram of the image display apparatus of the present embodiment. FIG. 10 is a block diagram of the image display system of this embodiment. FIG. 11 is a flowchart for explaining an example of the brightness correction process. FIG. 12 is a diagram illustrating an example of an electronic apparatus to which the image display device of the present embodiment is applied.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Various numerical values and materials in the embodiments are examples, and are not limited thereto.

The description will be made in the following order.
1. Basic concept (overall outline, display calibration, image display unit, light transmission area, imaging device)
2. Device and system configuration (overview, cross-sectional structure of image display)
3. Configuration corresponding to brightness correction (calibration jig, diffraction phenomenon and countermeasures, brightness calibration device / system)
4). 4. Brightness correction processing Alternative to electronic equipment monitoring devices

<Basic concept>
[Overview]
In the image display device with an image pickup device (hereinafter simply referred to as “image display device”) of the present embodiment, an image pickup device (or image pickup unit: the same applies hereinafter) is disposed on the back of the image display unit, and the image display unit A minute light transmission part is provided in a light transmission region corresponding to the imaging device. Preferably, a plurality of light transmission parts are provided. Then, the subject on the display surface side is imaged through the light transmission part.

  The light that has passed through the light transmission part is condensed on the imaging device. Since the imaging device is arranged on the back side of the image display unit, it is possible to accurately capture the face, eyes, movements, etc. of the user facing the display with the imaging device. By providing the image display unit (display panel of the display device) with a light transmitting part that allows light to reach the back surface and installing the imaging device at the corresponding position, the face and eyes of the user facing the display Since the operation and the like can be accurately grasped by imaging with the imaging device, the added value of the display device can be increased easily and inexpensively.

  Although not essential, the light condensing unit is disposed between the image display unit and the imaging device so that the light that has passed through the light transmitting unit is reliably condensed on the imaging device. By arranging the condensing unit, a high-precision minute lens is not required to accurately connect the image to the imaging device, and the manufacturing cost of the image display device is not increased, and the imaging device has a sufficient amount of light. Light can be collected.

[Display calibration]
The image display device of the present embodiment has a light detection unit disposed on the back surface of the image display unit, measures the luminance of the calibration image reflected on the reflecting mirror of the calibration jig disposed on the display surface side through the image display unit, Based on the measurement result, the display luminance of the image display unit is corrected (luminance calibration). Although the actual brightness changes with respect to the original brightness due to aging deterioration of the display element, etc., a brightness calibration method that copes with it by displaying and measuring a calibration image and correcting the display data to achieve the desired display brightness take.

  For the luminance calibration measurement for this purpose, a luminance measurement unit for measuring the luminance of the calibration image reflected on the measurement jig on the display surface side is provided on the back surface of the image display unit. As the luminance measurement unit, for example, a light detection unit (sensor: for example, a so-called white balance sensor) capable of measuring the luminance of the calibration image is provided, and a minute amount of light is applied to the light transmission region corresponding to the light detection unit of the image display unit. It is conceivable to provide a transmission part.

  Preferably, as the luminance measurement unit, an imaging device (or imaging unit: the same applies hereinafter) is arranged on the back surface of the image display unit, and a minute light transmission unit is provided in a light transmission region corresponding to the imaging device of the image display unit. It is conceivable to provide it. In such an image display device, the luminance of the calibration image (specifically, the calibration image reflected on the reflecting mirror of the measuring jig) displayed on the image display unit 10 through the light transmission unit of the image display unit is measured. In other words, the imaging device provided on the back surface of the display device not only images the subject on the display surface side, but also uses it as a light detection unit for measuring the luminance of the calibration image.

[Image display area]
The image display unit used in the image display apparatus according to the present embodiment only needs to be able to form a light transmission part in the gap between the pixels (display part thereof), and display an electro-optical element whose luminance changes depending on the applied voltage or flowing current. Any device may be used as long as it is used as an element.

  For example, a liquid crystal display element is a typical example of an electro-optical element whose luminance changes depending on an applied voltage, and an organic electroluminescence (Organic Electro Luminescence, Organic EL, Organic) A typical example is a light emitting diode (OLED) element. The organic EL display device using the latter organic EL element is a so-called self-luminous display device using a self-luminous light-emitting element (self-luminous element) as a pixel display element. On the other hand, the liquid crystal display element that constitutes the liquid crystal display device controls the passage of light from the outside (light from the front or back surface, or external light in the case of the front surface), and the pixel includes a light emitting element. is not.

  For example, in recent years, interest in organic EL display devices has increased as flat panel display devices (FP display devices). At present, a liquid crystal display (LCD) dominates as an FP display device, but a member such as a backlight or a polarizing plate is required instead of a self-luminous device. Therefore, there are problems such as an increase in the thickness of the FD display device and insufficient luminance. On the other hand, the organic EL display device is a self-luminous device, and does not require a member such as a backlight in principle, and has many advantages compared to an LCD, such as being thin and having high luminance. In particular, an active matrix organic EL display device in which a switching element is arranged in each pixel can keep current consumption low by holding each pixel in a hold state, and relatively large screen and high definition are relatively easy. Because it is possible to do so, development is progressing in each company, and it is expected to become the mainstream of next-generation FP display devices.

  As a self-luminous display device, in addition to an organic EL display device, a plasma display panel (PDP), a field emission display (FED), a surface conduction electron-emitting device display device (SED: Surface-conduction Electron-emitter Display) and the like can be applied to the image display unit of the present embodiment.

  However, in the image display device of the present embodiment, the light emitting element of the image display unit is preferably a self-luminous light emitting element, and more preferably an organic EL element. When the light emitting element is composed of an organic EL element, the organic layer (light emitting portion) constituting the organic EL element includes a light emitting layer made of an organic light emitting material. Specifically, for example, a hole transport layer and a light emitting layer are provided. And electron transport layer, a hole transport layer and a light emitting layer that also serves as an electron transport layer, a hole injection layer, a hole transport layer, a light emitting layer, an electron transport layer, and an electron injection layer It can consist of a structure.

  When the electron transport layer, the light-emitting layer, the hole transport layer, and the hole injection layer are “tandem units”, the organic layer is formed by stacking the first tandem unit, the connection layer, and the second tandem unit 2 It may also have a tandem structure of stages, and may also have a tandem structure of three or more stages in which three or more tandem units are stacked. In these cases, an organic layer that emits white light as a whole can be obtained by changing the luminescent color of each tandem unit to red, green, and blue.

  By optimizing the thickness of the organic layer, for example, the light emitted in the light emitting layer is resonated between the first electrode and the second electrode, and a part of this light is transmitted to the outside through the second electrode. It can also be set as the structure which radiate | emits.

  In the image display device of the present embodiment, when the light emitting element of the image display unit is an organic EL element, the first substrate, the driving circuit provided on the first substrate, the interlayer insulating layer covering the driving circuit, and the interlayer insulating layer The light emitting part provided, the protective layer provided on the light emitting part, the light shielding layer provided on the protective layer, and the second substrate covering the protective layer and the light shielding layer may be provided.

  Further, each pixel includes a drive circuit and a light emitting portion, and the light shielding layer is provided with an opening, and the opening, the portion of the protective layer located below the opening, and the interlayer insulating layer The light transmission part is comprised by the part, and it can be set as the form by which the imaging device is arrange | positioned on the surface side of the 1st board | substrate which does not oppose the 2nd board | substrate.

Here, examples of the pixel arrangement include a stripe arrangement, a diagonal arrangement, a delta arrangement, and a rectangle arrangement. Further, as the first substrate and the second substrate, a high strain point glass substrate, a soda glass (Na ₂ O · CaO · SiO ₂ ) substrate, a borosilicate glass (Na ₂ O · B ₂ O ₃ · SiO ₂ ) substrate, Stellite (2MgO · SiO ₂ ) substrate, lead glass (Na ₂ O · PbO · SiO ₂ ) substrate, various glass substrates with an insulating film formed on the surface, quartz substrate, quartz substrate with an insulating film formed on the surface, surface A silicon substrate having an insulating film formed thereon, polymethyl methacrylate (polymethyl methacrylate, PMMA), polyvinyl alcohol (PVA), polyvinyl phenol (PVP), polyethersulfone (PES), polyimide, polycarbonate, polyethylene terephthalate (PET) Organic polymers (flexible plastic film composed of polymer material) And plastic sheets, the form of polymeric material such as a plastic substrate) may be mentioned.

The drive circuit may be composed of, for example, one or a plurality of thin film transistors (TFTs). As a constituent material of the interlayer insulating _{layer, SiO 2, BPSG, PSG,} BSG, AsSG, PbSG, SiON, SOG ( spin on glass), low-melting glass, SiO ₂ based materials such glass paste; insulation, such as polyimide; SiN-based materials Resins can be used alone or in appropriate combination. When the pixel is composed of an organic EL element, the light emitting unit is as described above. As a material constituting the protective film, it is preferable to use a material that is transparent to the light emitted from the light emitting portion, is dense, and does not transmit moisture. Specifically, for example, amorphous silicon (α-Si), Amorphous silicon carbide (α-SiC), amorphous silicon nitride (α-Si _1-x N _x ), amorphous silicon oxide (α-Si _1-y O _y ), amorphous carbon (α-C), amorphous silicon oxide / silicon nitride (Α-SiON) and Al ₂ O ₃ can be mentioned. The light shielding film (black matrix) may be made of a known material. You may provide a color filter as needed.

  The image display unit includes a plurality of pixel units including display elements (light emitting elements). Here, when the number of pixel units is represented by (M, N), VGA (640, 480), S- VGA (800, 600), XGA (1024, 768), APRC (1152, 900), S-XGA (1280, 1024), U-XGA (1600, 1200), HD-TV (1920, 1080), Q- In addition to XGA (2048, 1536), some of the image display resolutions such as (1920, 1035), (720, 480), (854, 480), (1280, 960) can be exemplified. It is not limited to the value of.

  In an image display unit that performs color display, one pixel unit includes, for example, a red pixel that displays a red (R) color component, a green pixel that displays a green (G) color component, and a blue (B) color component. It is composed of three types of blue pixels to be displayed. Alternatively, in addition to these three types of pixels, pixels that display white light for improving luminance, pixels that display complementary colors to expand the color reproduction range, and pixels that display yellow to expand the color reproduction range In order to expand the color reproduction range, it may be composed of four or more types of pixels such as pixels displaying yellow and cyan.

[Light transmission area]
The light transmission region provided in the image display unit of the image display device of the present embodiment may be formed in a portion corresponding to a portion where a light detection unit (for example, an imaging device) that detects a calibration image is provided. In the light transmissive region, a plurality of light transmissive portions in which minute openings through which light representing the subject image on the display surface side passes are preferably provided.

  Here, the light transmission region may be a first configuration example in which a light transmission portion is provided in a plurality of pixels. The light transmission region may be a second configuration example in which a light transmission part is provided around at least one or more (preferably at least two) pixels. In this case, the light transmission part is May be provided all around the pixel, or may be provided on a part of the periphery of the pixel (specifically, on two or more consecutive sides of the side corresponding to the boundary of the pixel). In the latter case, a light transmission region is provided over a length of 1/4 times or more of the entire circumference of the pixel (in the case of two consecutive sides, it is 1/2 times the length of each side). It is preferable.

  In such a configuration, the light that has passed through the light transmission portions provided in the plurality of pixels is collected on the imaging device, or passes through the light transmission portions provided around at least one pixel. The collected light is collected on the imaging device. Therefore, a high-precision microlens is not required to accurately connect the image to the imaging device, and the manufacturing cost of the image display device with the imaging device is not increased, and a sufficient amount of light is condensed on the imaging device. Can be made.

  In the case of the first configuration example, the light transmission portion is provided in a plurality of pixels. For example (but not limited to), it is preferable that the light transmission portion is provided in three or more pixels. The outer shape of the light transmitting portion is essentially arbitrary, and examples thereof include a rectangle such as a rectangle or a square.

  In the case of the second configuration example, the light transmission region is provided with a light transmission part around at least one or more pixels. For example (but not limited to), the light transmission region is provided around three or more pixels. It is desirable that the outer shape of the light transmission portion is essentially arbitrary. For example, an “L” shape (in which the light transmission part is provided on two consecutive sides corresponding to the pixel boundary), and a “U” shape (the light transmission part corresponds to the pixel boundary) 3), a “B” shape (a shape in which the light transmission part is provided on all sides corresponding to the pixel boundaries), and a cross-shaped shape ( For example, the light transmitting portion is provided on all the sides corresponding to the boundaries of the pixels, and is provided in common between adjacent pixels. Alternatively, a configuration in which a light transmission part is provided around a pixel group including a projection image of a lens provided in the imaging device may be considered.

[Imaging device]
In the image display device of the present embodiment, the imaging device (imaging unit) may be arranged on the back side of the image display unit, but is preferably arranged in the center of the image display unit. There may be one imaging device or a plurality of imaging devices. As the imaging device, for example, a known and commercially available solid-state imaging device including a CCD element and a CMOS sensor may be used.

  In the image display device of the present embodiment, it is preferable to provide a condensing unit that condenses the light that has passed through the light transmission part of the light transmission region on the imaging device between the image display unit and the imaging device. A well-known lens can be mentioned as a condensing part. Specifically, the lens can be composed of either a biconvex lens, a plano-convex lens, or a meniscus convex lens, or can be composed of a reflecting mirror or a Fresnel lens, or a combination of these various convex lenses. It is also possible to combine a concave lens and these various convex lenses.

  As the imaging device, a well-known and commercially available solid-state imaging device such as a video camera or a web camera can be used. In these cases, the light collecting unit and the imaging device are integrated.

  In the image display device of the present embodiment, a color filter may not be disposed in the optical path of light that enters the image display unit, passes through the light transmission unit, exits from the image display unit, and enters the light collection unit. It is also preferable not to arrange an imaging system such as a microlens.

  The image display device according to the present embodiment is an example of an electronic device, and it is sufficient that a light detection unit such as an imaging device can be arranged on the back side of the display panel portion. It may be good or it may be fixedly attached.

  The image display device can be used, for example, as a substitute for a monitor device constituting a personal computer, or as a substitute for a monitor device incorporated in a notebook personal computer. Furthermore, it can be used as a substitute for a mobile phone, a PDA (Personal Digital Assistant), a monitor device incorporated in a game machine, or a conventional television receiver.

<Apparatus and system configuration>
[Overview]
1 to 2 are views for explaining the concept of the image display device and the image display system of the present embodiment. Here, FIG. 1 (1) is a conceptual diagram of an image display device, and FIG. 1 (2) is a conceptual diagram of an image display system. FIG. 1 (1-1) is a conceptual diagram of the image display device viewed from the front, and FIG. 1 (1-2) is a conceptual diagram of the image display device viewed from the side. FIG. 1 (2-1) is a conceptual diagram of the image display system viewed from the front, and FIG. 1 (2-2) is a conceptual diagram of the image display system viewed from the side. FIG. 2 is a diagram schematically showing the most typical arrangement of a plurality of pixels constituting the image display unit.

  As shown in FIG. 1A, the image display device 1 of the present embodiment includes an image display unit 10, an imaging device 20 disposed on the back side of the image display unit 10, and light transmission formed on the image display unit 10. The light collecting part 21 which condenses the light which passed the part 30 and the light transmission part 30 on the imaging device 20 is provided. The imaging device 20 may be configured to be detachable from the back surface of the image display device 1. A portion corresponding to the imaging device 20 of the image display unit 10 is a light transmission region 12. For example, at least a portion of the image display unit 10 corresponding to the effective imaging region of the imaging device 20 is the light transmission region 12. When the light transmission region 12 is narrower than the effective imaging region of the imaging device 20, the actual imaging region in the imaging device 20 is narrowed.

  Although details will be described later, a calibration jig 450 is placed on the display surface of the image display unit 10 when the luminance of the image display unit 10 is calibrated. In the calibration jig 450, a reflecting mirror 452 is arranged in parallel with the display surface at a portion of the inner surface of the enclosure 451 facing the display surface of the image display unit 10.

  The imaging device 20 is disposed on the back side of the image display unit 10, more specifically, on the center of the back side of the image display unit 10, and the number of the imaging device 20 provided is one. Here, the imaging device 20 and the light collecting unit 21 may be formed of a well-known and commercially available video camera in which they are integrated, that is, provided with a CCD element or the like, or provided on the back surface of the image display unit. A configuration optimized as described above may be used.

  The image display device 1 is used, for example, as an alternative to a monitor device that constitutes a personal computer. That is, as shown in FIG. 1B, in the image display system 2 of the present embodiment, a peripheral device 70 such as a main body of a personal computer (electronic computer) is connected to the image display device 1_2. The peripheral device 70 is an example of an electronic device. The image display device 1_2 functions as a monitor device for the peripheral device 70. The image display device 1_2 is obtained by removing some functional units from the image display device 1. The removed functional unit is incorporated in the peripheral device 70. The peripheral device 70, the image display unit 10, and the imaging device 20 are connected by cables 72 and 73.

  As the pixel 11 of the image display unit 10, a self-luminous light emitting element, specifically, an organic EL element is used. The image display unit 10 includes a color display XGA type organic EL display device. That is, when the number of pixel units is represented by (M, N), it is (1024, 768).

  As shown in FIG. 2, one pixel unit is composed of three pixels: a red light emitting pixel 11R that emits red light, a green light emitting pixel 11G that emits green light, and a blue light emitting pixel 11B that emits blue light. . Note that the outer edge of the pixel is indicated by a dotted line (the same applies to other examples described later).

  The image display unit 10 includes a plurality of pixels 11 (11R, 11G, and 11B) including display elements, and the plurality of pixels 11 in the light transmission region 12 of the image display unit 10 are provided with a light transmission unit 30. ing. In this example, the light transmission part 30 is different for each pixel 11, but this is not essential, and the light transmission part 30 may straddle a plurality of pixels 11. In this example, the light transmission unit 30 is provided for each pixel 11 (for all the pixels 11 in the light transmission region 12). However, this is not essential, and at least the plurality of pixels 11 in the light transmission region 12 are provided. It is only necessary that the light transmission part 30 is provided. For example, some pixels 11 in the light transmission region 12 such as every two pixels may not be provided with the light transmission part 30.

  Although not limited, the light transmission part 30 is provided in, for example, 6 × 3 = 18 pixels 11. One light transmitting portion 30 is provided for one pixel. The condensing unit 21 condenses the light that has passed through the light transmitting unit 30 in the 6 × 3 = 18 pixels 11 on the imaging device 20. The shape of each light transmission part 30 is a rectangle.

  Although not shown, the image display unit 10 is provided with a scanning signal supply IC that drives each scanning line and a video signal supply IC that supplies a video signal. A scanning line control circuit is connected to the scanning signal supply IC, and a signal line control circuit is connected to the video signal supply IC. A color filter is not disposed in the optical path of light that enters the image display unit 10, passes through the light transmission unit 30, exits from the image display unit 10, and enters the light collection unit 21. There is no image system.

[Cross-sectional structure of image display section]
FIG. 3 is a diagram for explaining the details of the image display unit 10. Here, FIG. 3A is a schematic partial cross-sectional view of the image display unit 10. FIG. 3B is a chart summarizing the detailed configuration of the light emitting elements of the image display unit 10.

  The image display unit 10 includes a first substrate 40, a drive circuit including a plurality of TFTs provided on the first substrate 40, an interlayer insulating layer 41 that covers the drive circuit, and an organic layer provided on the interlayer insulating layer 41. 63 (light emitting portion), a protective layer 64 provided on the organic layer 63, a light shielding layer 65 provided on the protective layer 64, a second layer 67 covering the protective layer 64 and the light shielding layer 65.

  Each pixel 11 includes a drive circuit and a light emitting unit, and the light shielding layer 65 is provided with an opening 65A, and the opening 65A and a portion of the protective layer 64 positioned below the opening 65A, The light transmitting portion 30 is configured by the second electrode 62 portion, the interlayer insulating layer 41 portion, and the like. The condensing unit 21 and the imaging device 20 are disposed on the side of the first substrate 40 that does not face the second substrate 67.

  More specifically, a drive circuit is provided on the first substrate 40 made of soda glass. The TFT constituting the driving circuit includes a gate electrode 51 formed on the first substrate 40, a gate insulating film 52 formed on the first substrate 40 and the gate electrode 51, and a semiconductor layer formed on the gate insulating film 52. The portion of the semiconductor layer located between the source / drain region 53 and the source / drain region 53 and above the gate electrode 51 is composed of a corresponding channel formation region 54. In the illustrated example, the TFT is a bottom gate type, but may be a top gate type.

The gate electrode 51 of the TFT is connected to a scanning line (not shown). The interlayer insulating layer 41 (41A, 41B) covers the first substrate 40 and the drive circuit. The first electrode 61 constituting the organic EL element, SiO _X and SiN _Y, is provided on the interlayer insulating layer 41B made of a polyimide resin. The TFT and the first electrode 61 are electrically connected via a contact plug 42, a wiring 43, and a contact plug 44 provided in the interlayer insulating layer 41A. In the drawing, one TFT is shown for one organic EL element driving unit.

  On the interlayer insulating layer 41, an insulating layer 45 having an opening 46 and having the first electrode 61 exposed at the bottom of the opening 46 is formed. The insulating layer 45 is excellent in flatness, and is made of an insulating material having a low water absorption rate, specifically, a polyimide resin in order to prevent the organic layer 63 from being deteriorated by moisture and maintain the light emission luminance. An organic layer 63 including a light emitting layer made of an organic light emitting material is formed over the portion of the insulating layer 45 surrounding the opening 46 from above the portion of the first electrode 61 exposed at the bottom of the opening 46. The organic layer 63 is composed of, for example, a stacked structure of a light-emitting layer that also serves as a hole transport layer and an electron transport layer, but is represented by one layer in the drawing.

An insulating protective layer 64 made of amorphous silicon nitride (α-Si _1-x N _x ) is provided on the second electrode 62 based on the plasma CVD method for the purpose of preventing moisture from reaching the organic layer 63. It has been. A light shielding layer 65 made of black polyimide resin is formed on the protective layer 64, and a second substrate 67 made of soda glass is disposed on the protective layer 64 and the light shielding layer 65. The protective layer 64, the light shielding layer 65, and the second substrate 67 are bonded by an adhesive layer 66 made of an acrylic adhesive.

  The first electrode 61 is used as an anode electrode, and the second electrode 62 is used as a cathode electrode. Specifically, the first electrode 61 is made of a light reflecting material composed of aluminum (Al), silver (Ag), or an alloy thereof having a thickness of 0.2 μm to 0.5 μm, and the second electrode 62. Is made of a transparent conductive material such as ITO or IZO having a thickness of 0.1 μm, or a metal thin film (semi-transparent metal thin film) having a thickness of about 5 nm such as silver (Ag) or magnesium (Mg). The second electrode 62 is not patterned and is formed in a single sheet. In some cases, an electron injection layer (not shown) made of LiF having a thickness of 0.3 nm may be formed between the organic layer 63 and the second electrode 62.

  In summary, the detailed configuration of the light emitting elements of the image display unit 10 in the image display device 1 of the present embodiment is as shown in FIG.

  From the first substrate 40 to the protective layer 64 and the light shielding layer 65 are display element substrates. The second substrate 67 functions as a sealing substrate. Here, the opening 65A forming the light transmitting portion 30 provided in the second substrate 67 is in a portion where the pixel electrode (first electrode 61), TFT (including the gate electrode 51) and wiring of the display element substrate are absent. In addition, a protective layer 64 that functions as a sealant, a second electrode 62 that functions as an EL common electrode, an insulating layer 45 that functions as a pixel separation film, an interlayer insulating layer 41 (41A, 41B) that functions as a planarization insulating film, The source / drain regions 53 and the gate insulating film 52 are light transmissive. Accordingly, external light incident from the display surface (second substrate 67) side can reach the back surface (first substrate 40 side) through the opening 65A.

  The imaging device 20 installed on the rear surface of the panel is installed so that the imaging surface is close to the rear surface of the panel where the light transmission unit 30 (opening 65A) is located (in this example, the light collecting unit 21 is interposed). Therefore, the external light incident from the display surface side is imaged by a lens (not shown) of the imaging device 20 and enters a solid-state image sensor such as a CCD or a CMOS, so that a subject existing on the display surface side is imaged. be able to.

  Thus, in the image display apparatus 1 of the present embodiment, an organic EL element is used as a display element, and the imaging device 20 is installed on the back surface (first substrate 40) side only by providing the light transmission unit 30. As a result, it is possible to image the subject existing on the display surface (second electrode 62) side.

  For example, when the imaging device is fixed to the outside of the image display unit 10, the imaging device images the user of the image display device 1 from an oblique direction. When the image is displayed on the image display unit 10, The display unit 10 displays an image of the user taken from an oblique direction. Therefore, it is impossible to accurately display the user's face, and it is not possible to accurately determine where in the image display unit 10 the user is gazing. Furthermore, when the user approaches the image display unit 10, there is a high possibility that the user will be outside the imaging range.

  On the other hand, in the image display device 1 according to the present embodiment, since the imaging device 20 is disposed at the center on the back side of the image display unit 10, the user of the image display device 1 is referred to as the front side of the imaging device 20. When the image is displayed on the image display unit 10, the image of the user captured from the front is displayed on the image display unit 10. Therefore, the user's face can be accurately displayed, and it is possible to easily and accurately determine where in the image display unit 10 the user is gazing. Further, even when the user approaches the image display unit 10, the user can be imaged.

  In the image display device 1, the light that has passed through the light transmission units 30 (the plurality of light transmission units 30) provided in each of the plurality of pixels 11 in the light transmission region 12 is collected on the imaging device 20. Therefore, a high-precision microlens is not required to accurately connect an image to the imaging device 20, and the manufacturing cost of the image display device 1 is not increased, and a sufficient amount of light is condensed on the imaging device 20. Can be made.

  For example, when the observer (the subject for the imaging device 20) is pointing with the pen while looking at the display image of the image display unit 10, the face, eyes, and hand of the observer facing the display surface And a pen can be imaged. Thereby, for example, the line of sight of the observer can be detected from the captured image. In addition, since the corresponding indication point of the image display unit 10 can be specified from the direction of the hand or pen, a so-called pointer function can be easily added to the image display device 1. Furthermore, in addition to the pointer function, the user's face, eyes, hand movements, peripheral brightness, and the like can be known from the captured image, so various information is obtained from the image display device 1 and sent to various systems. The added value of the image display device 1 can be increased.

  A simple configuration as shown here is difficult, if not impossible, with a so-called LCD, and a structure that transmits light including visible wavelengths is even more difficult. On the other hand, the image display apparatus 1 according to the present embodiment only includes the light transmission unit 30 and can capture a subject on the display surface side from the back surface with a simple configuration.

  In addition, by taking a calibration image (bright spot image for calibration) reflected on the reflection boundary of the calibration jig, correcting the display data, and displaying it, it is possible to display a suitable image that has been subjected to brightness calibration. . That is, the image display unit 10 is provided with a light transmission unit that allows light to reach the back surface of the image display unit 10, and the imaging device 20 that functions as a light detection unit is installed at a corresponding position, and reflected on the inner surface during luminance calibration. The brightness of the display device can be easily calibrated by capturing brightness while displaying a calibration image with a calibration jig having a mirror (preferably black except for the reflecting mirror). As a result, it is possible to suppress luminance fluctuations due to changes (deterioration) of the display element over time, environmental changes, continuous lighting, and the like, and it is possible to display a high-quality image without (unless) luminance unevenness and color unevenness.

  Although not directly related to the mechanism of the present embodiment, generally, when an image is taken through a small light transmission opening, a so-called illumination light reflection phenomenon occurs in the light transmission opening. That is, when the imaging device 20 is installed on the back surface of an object (image display unit 10) provided with minute light transmission units 30 at a predetermined pitch, and the image is transmitted through the light transmission unit 30, the light transmission unit 30 acts as a light slit. To do. For this reason, the same false image as the original image appears at an equal pitch due to the illumination light reflection phenomenon, resulting in blurring of the image. The intensity and distribution of the diffracted light depends on the shape, size, distribution, and wavelength of incident light (external light) of the light transmission part. When the blur due to diffraction is small, it is not necessary to correct (compensate) the diffraction for the captured image. However, when a high-quality captured image is required, the influence of the diffraction phenomenon is corrected (compensated). ) Is preferable.

<Configuration for brightness calibration>
The image display apparatus 1 of the present embodiment can be mounted with an imaging device 20 on the back surface of the image display unit 10 and can image a subject on the display surface side. By using this characteristic, a calibration jig can be used. The brightness can be calibrated by covering the display side. Hereinafter, the mechanism of luminance calibration will be specifically described.

[Calibration jig]
FIG. 4 is a diagram illustrating an example of a measurement jig (calibration jig) used when performing luminance calibration. FIG. 4A is a conceptual diagram (perspective view) showing a state when the calibration jig 450 is put on the display surface side of the image display unit 10, and FIG. It is the conceptual diagram seen from the side. FIG. 4 (3) is a diagram illustrating the mounting structure.

  The calibration jig 450 includes an enclosure 451 (shielding body) in which the display surface side of the image display unit 10 is opened, and a flat reflector 452 on a portion of the inner surface of the enclosure 451 facing the display surface of the image display unit 10. (Reflector, flat mirror) is arranged in parallel with the display surface. At the time of luminance calibration, such a calibration jig 450 is placed on the display surface of the image display unit 10 such that the open end side is the display surface side. In the brightness calibration of the present embodiment, the image on the display surface side of the image display unit 10 is copied (reflected) to the reflecting mirror 452 of the calibration jig 450 and the mirror image (reflected image) is captured by the imaging device 20. The calibration jig 450 used for luminance calibration is a simple one that does not require so-called electrical connection.

  Attachment (mounting) of the calibration jig 450 to the image display unit 10 (display surface thereof) uses, for example, a fitting structure. The image display unit 10 and the calibration jig 450 include a concavo-convex shape component as a fitting structure. Either one of the concave component and the convex component is provided on the image display unit 10 side, and the other of the concave component and the convex component is provided on the calibration jig 450 side. For example, a mounting (convex) protrusion 462 (hanging protrusion) is provided on the mounting portion of the calibration jig 450 with the image display unit 10 (upper side, upper left and right corners, etc.). A hooking (concave) groove 464 (depression) is provided on the side corresponding to the image display unit 10. That is, in the image display unit 10, when the calibration jig 450 is mounted, a groove 464 that is a concave component is provided in a portion corresponding to the position of the protrusion 462 that is a convex component. The projections 462 and the grooves 464 fix the calibration jig 450 to the image display unit 10 and align the two.

  The calibration jig 450 is preferably a non-reflective plate except for the reflecting mirror 452 on its inner surface so that unnecessary light components are not detected. “Reflection” and “non-reflection” are relative and not absolute, and it is sufficient that a means for preventing light reflection is provided on the inner surface other than the reflecting mirror 452. This means that the reflectance of the reflecting mirror 452 is higher than that of the non-reflecting plate. For example, a portion other than the reflecting mirror 452 on the inner surface of the enclosure 451 may be black to prevent light reflection.

  Preferably, in order to make the calibration jig 450 have a compact structure, the inner reflecting mirror 452 has a shorter depth, the aspect ratio is the same as the display surface, and the size is smaller than the display surface. preferable. For example, in the example of FIG. 4B, the size of the reflecting mirror 452 is set to 1 / M (for example, 1/2) of the display surface. A virtual screen (virtual screen) when the virtual screen (size V) enters the entire field of view of the imaging device 20 when the imaging device 20 images a panel having the same screen as the display surface (size V) without placing the calibration jig 450 Let L be the distance between the light emitting surface) and the imaging device 20 (specifically, the light collecting unit 21). With the calibration jig 450 placed on the display surface, the distance (detection distance, imaging distance) between the reflecting mirror 452 and the imaging device 20 (specifically, the light collecting unit 21) is L / M (in this example, L / 2). ), When the calibration image is displayed on the display surface, the entire display surface is reflected on the reflecting mirror 452. For this reason, it is possible to acquire luminance information on the display surface and to reduce the size of the calibration jig 450 by capturing the reflection mirror 452 (image captured in the image) with the imaging device 20.

  FIG. 5 is a conceptual diagram (sectional view) showing an example of the shape of the calibration jig 450. The first example shown in FIG. 5 (1) has a trapezoidal cross-sectional shape, and the angle formed between the oblique side and the long side is set to 45 degrees. The second example shown in FIG. 5 (2) has a rectangular cross section. In any case, the reflection mirror 452 has a reflectance set to 90%, for example, and functions as a so-called mirror. The shape is not limited as long as the display surface 10a and the reflecting mirror 452 are in a parallel state with the calibration jig 450 placed on the image display unit 10, and the inner surface of the jig other than the reflecting mirror 452 is black.

[Diffraction phenomenon and countermeasures]
6-8 is a figure explaining a diffraction phenomenon and its countermeasure. Here, FIG. 6 is a schematic diagram for explaining the influence of the diffraction phenomenon on the captured image. FIG. 7 is a diagram illustrating an example of an image obtained by imaging by placing a glass plate in front of the imaging device 20. FIG. 8 is a diagram illustrating an example of a calibration image that is not affected by the diffraction phenomenon (the effect is reduced) and an example of the captured image.

  The calibration image is preferably one or more multi-point images that are not continuous (not connected). The reason will be described below. In the image display device 1 of the present embodiment, when the imaging device 20 is provided on the back surface of the image display unit 10 and a subject on the display surface side (a mirror image reflected on the reflecting mirror 452 at the time of luminance calibration) is imaged, the image display unit 10 is provided. In addition, diffraction occurs in the light transmitting portion 30 and a problem arises that the captured image is blurred due to the influence. The situation is shown in FIGS.

  In general, when an image is taken through a small light transmission opening, a so-called diffraction phenomenon occurs in the light transmission opening. That is, as shown in FIG. 6, when the imaging device 20 is installed on the back of an object (image display unit 10) provided with minute light transmission units 30 at a predetermined pitch, and the image is transmitted through the light transmission unit 30, the light transmission The part 30 acts as an optical slit. For this reason, the same image as the image “C” appears as an image “A” and an image “B” at an equal pitch due to the diffraction phenomenon, resulting in blurring of the image.

  FIG. 7A shows an image obtained by imaging a transparent glass plate that is not provided with a light transmission portion in front of the imaging device 20. FIG. 7B shows an image obtained by arranging and imaging a transparent glass plate provided with a light transmission part having a shape, size, and distribution in front of the imaging device 20. Blur is observed in the image shown in FIG. On the other hand, no blur is observed in the image shown in FIG.

  The intensity and distribution of the diffracted light depends on the shape, size, distribution, and wavelength of incident light (external light) of the light transmission part. When the blur due to diffraction is small, it is not necessary to correct (compensate) the diffraction for the captured image. However, when a highly accurate measurement image is required, the influence of the diffraction phenomenon is corrected (compensated). ) Is preferable. When the signal processing does not deal with such a diffraction phenomenon, it is preferable to display a calibration image that reduces the influence of diffracted light.

  FIG. 8 (1-1) shows a one-point image that is a first example of a calibration image in which the influence of diffracted light is reduced. The one-point image is an image in which only one point on the display surface 10a of the image display unit 10 is displayed (emitted). At the time of luminance calibration, the imaging device 20 captures the reflection information of the reflecting mirror 452 (mirror image shown in the image) while changing the position of one point image by one (one pixel), thereby obtaining luminance information of all pixels. At this time, as shown in FIG. 8 (1-2), the picked-up image includes a component of diffracted light, but only one point is displayed. Therefore, the luminance information of all the pixels can be accurately obtained by imaging while changing the display position of the point of one point image one by one (one pixel).

  However, luminance calibration using a one-point image has a problem that it takes time to measure when the number of pixels is large. It is preferable to use a multipoint image as a calibration screen for this measure.

  FIG. 8 (2-1) shows a multi-point image which is a second example of a calibration image in which the influence of diffracted light is reduced. The illustrated example is an example in which two dots are displayed vertically (vertical direction) with respect to the central dot, and two dots are displayed left and right (horizontal direction), respectively. This example is only an example, and how many dots are displayed in addition to the center dot is arbitrary. However, it is preferable to set the position and the number so that it is easy to avoid overlapping imaging when imaging while changing the display position.

  Here, the feature of the multipoint image as the calibration image is composed of a plurality of non-continuous points, and the minimum value of the point pitch (minimum display pitch Pm) is set larger than the diffraction pitch. is there. This is to increase measurement accuracy by setting the minimum display pitch Pm larger than the diffraction pitch so that the diffracted light and the lighting light are not mixed. By capturing the reflecting mirror 452 (a mirror image reflected on the reflecting mirror 452) while changing the display positions of the dots of the multipoint image, it is possible to accurately acquire the luminance information of all the pixels.

  In addition, by using a multipoint image, the shortage of light amount to the imaging device 20 can be solved, and the measurement time can be shortened. For example, since a plurality of dots are displayed, it is observed brighter as a whole than when one dot is displayed, so that exposure control is facilitated and the problem of insufficient measurement accuracy due to insufficient light quantity is solved. Also, when imaging while changing the display position of the dots, the brightness of each dot is measured at each display position, and the display position is changed so as to avoid duplication of dots, thereby reducing the measurement time. be able to. If it is in a range that does not overlap due to diffraction, it is possible to separate each piece of luminance information (based on the information of the actual position) after imaging by lighting multiple pixels at the same time. Can be adjusted and the measurement time is shortened. For example, if there are 100 × 100 = 10000 pixels, if one-point images are to be displayed sequentially, 10,000 measurement operations are required, but there are 100 pixels in a positional relationship that do not overlap due to diffraction. If each is selected and turned on at the same time, measurement can be performed 100 times.

  Regardless of whether one-point images or multi-point images are used, the image display unit 1 is once covered with the calibration jig 450 and the calibration image is captured by the imaging device 20 before the image display device 1 is used. The luminance information of all pixels is acquired. By comparing this luminance information with the display data of the calibration image, the difference (brightness change amount, in particular luminance degradation amount) from the luminance amount that should be obtained can be known, so that the luminance calibration can be performed.

  The correction mechanism for display data based on the amount of change in luminance acquired by the luminance calibration measurement is to change the luminance of each display element so that the luminance amount should be originally obtained based on the amount of luminance change acquired by the luminance calibration measurement. Any known method such as Patent Document 1 can be applied.

[Luminance calibration system / system]
FIG. 9 is a block diagram of the image display apparatus 1 according to the present embodiment corresponding to luminance calibration. FIG. 10 is a block diagram of the image display system 2 of the present embodiment corresponding to luminance calibration.

  The image display apparatus 1 of the present embodiment shown in FIG. 9 includes a control unit 90 that controls the operation of the entire apparatus, a display timing controller 92 that controls the display operation of the image display unit 10, and the imaging device 20 (imaging unit 20a). An imaging timing controller 94 that controls the imaging operation is included.

  The control unit 90 supplies display data, timing signals, and the like to the display timing controller 92. The control unit 90 supplies an imaging timing signal, a shutter control signal, a gain control signal, and the like to the imaging timing controller 94.

  The display timing controller 92 includes a signal line control circuit (not shown), and the signal line control circuit supplies display data and a horizontal timing signal to the image display unit 10 via a video signal supply IC (not shown). The display timing controller 92 includes a scanning line control circuit (not shown), and the scanning line control circuit supplies a vertical timing signal to the image display unit 10 via a scanning signal supply IC (not shown).

  The image display device 1 according to the present embodiment includes a display correction unit 400 that corrects a change in luminance with respect to display data based on a measurement image acquired via the imaging device 20 during luminance calibration measurement. That is, the image display device 1 has the function of a luminance correction device (an example of a display correction device) provided with the display correction unit 400.

  When the imaging device 20 (an example of an electronic device) is separated from the image display device 1, the display correction unit 400 (also an imaging timing controller 94 in some cases) is connected to the imaging device as shown by a dashed line in the figure. Arrangement on the 20 side is also conceivable. In this case, the imaging device 20 is configured to have the function of the luminance correction device including the display correction unit 400, and the luminance correction device is configured to include the imaging device 20 functioning as a light detection unit.

  The display correction unit 400 includes a luminance calculation unit 402 and a correction information storage unit 404. The control unit 90 receives various instructions from the user and controls the operations of the display correction unit 400 and other functional units. The control unit 90 supplies a timing signal (and also display data for calibration image when calibration information is acquired) to the display timing controller 92 and supplies display data to the display correction unit 400. The display correction unit 400 corrects the display data received from the control unit 90 and supplies it to the display timing controller 92. The control unit 90 supplies an imaging timing signal, a shutter control signal, a gain control signal, and the like to the imaging timing controller 94.

  The display timing controller 92 includes a signal line control circuit (not shown), and the signal line control circuit supplies display data and a horizontal timing signal to the image display unit 10 via a video signal supply IC (not shown). The display timing controller 92 includes a scanning line control circuit (not shown), and the scanning line control circuit supplies a vertical timing signal to the image display unit 10 via a scanning signal supply IC (not shown).

  The luminance calculation unit 402 calculates luminance information at each position on the display surface from image information acquired via the imaging device 20 during luminance calibration measurement. The correction information storage unit 404 stores the luminance information calculated by the luminance calculation unit 402 in the image storage memory. The processing operation of the display correction unit 400 is controlled by the control unit 90.

  For example, image information acquired via the imaging device 20 is sent to the luminance calculation unit 402 that constitutes the display correction unit 400. The luminance calculation unit 402 calculates a correction amount (correction information) for the display data based on the imaging data acquired by the imaging device 20 during the luminance calibration measurement. The correction amount is an amount by which the luminance of the display element is changed so that the luminance amount should be obtained originally.

  The image display in the image display unit 10 is performed under the control of the control unit 90. That is, display data, timing signals, and the like are sent from the control unit 90 to the display timing controller 92, and display data and horizontal timing signals are sent from the display timing controller 92 to a signal line control circuit (not shown). Is sent to a scanning line control circuit (not shown). Then, the image display unit 10 displays an image based on a known method. On the other hand, an imaging timing signal, a shutter control signal, a gain control signal, and the like are sent from the control unit 90 to the imaging timing controller 94, and these signals are sent from the imaging timing controller 94 to the imaging device 20. Operation is controlled.

  FIG. 10 shows the image display system 2 of the present embodiment corresponding to luminance calibration. The difference from the image display device 1 shown in FIG. 9 is that the control unit 90 and the display correction unit 400 are removed from the image display device 1 to form the image display device 1_2. It is incorporated in the peripheral device 70 (an example of an electronic device). In this case, the peripheral device 70 has a function of the brightness correction device including the display correction unit 400, and the imaging device 20 that functions as a light detection unit is configured separately from the brightness correction device.

  That is, the control unit 90 may be provided in the image display device 1 or in a peripheral device 70 such as a personal computer connected to the image display device 1_2. The display correction unit 400 may also be provided in the image display device 1 or may be provided in a peripheral device 70 such as a personal computer connected to the image display device 1_2.

  The control functions of the display correction unit 400 and the control unit 90 (particularly the function of controlling the display correction unit 400) in the image display device 1 and the image display system 2 can be realized by software, and programs and programs for this purpose are stored. The recorded medium can also be extracted as an invention. That is, in the present embodiment, the mechanism of the control configuration for performing the luminance correction processing and the control processing related to this processing is not limited to being configured by a hardware processing circuit, but is based on a program code that realizes the function. ), And can be realized by software. In the mechanism executed by software, the processing procedure and the like can be easily changed without changing hardware. The program may be provided by being stored in a computer-readable storage medium, or may be provided by distribution via wired or wireless communication means.

  The program is provided as a file in which program codes for realizing each function of brightness correction processing and control processing related to this processing are described. In this case, the program is not limited to being provided as a batch program file, and is configured by a computer. It may be provided as an individual program module according to the hardware configuration of the system.

  Specific means of each unit (including functional blocks) for realizing each function of brightness correction processing and control processing related to this processing uses hardware, software, communication means, a combination thereof, and other means. This is obvious to those skilled in the art. Moreover, the functional blocks may be combined and integrated into one functional block. Also, software that causes a computer to execute program processing is installed in a distributed manner according to the combination.

  Although the mechanism performed by software can flexibly cope with parallel processing and continuous processing, the processing time becomes longer as the processing becomes complicated, so that a reduction in processing speed becomes a problem. On the other hand, when constructed with a hardware processing circuit, even if the processing is complicated, a reduction in processing speed is prevented, and an accelerator system is constructed that achieves high speed to obtain high throughput.

  Matters related to these software processes include the improvement of the accuracy of the image information acquired through the imaging device (for example, the color information) by reflecting the measurement result of the wavelength distribution of the external light when performing the process related to the diffraction correction process. The same applies to the case of improving the accuracy of the MTF inverse transform process.

<Brightness correction processing>
FIG. 11 is a diagram (flow chart) for explaining an example of luminance correction processing by the display correction unit 400 of the present embodiment. The brightness correction processing of this example measures the brightness of the calibration image at the time of brightness calibration measurement, and corrects display data based on the result.

  At the time of luminance calibration measurement (when calibration information is acquired), the calibration jig 450 is put on the image display unit 10 (S100). In this state, a calibration image is displayed on the display surface of the image display unit 10, the calibration image is copied to the reflecting mirror 452 of the calibration jig 450, captured by the imaging device 20 from the back of the image display unit 10, and an imaging signal is obtained. Store (S102). When the image display device 1 is color-compatible, it is assumed that achromatic dots are displayed as a whole in pairs of R, G, and B. The brightness level of the dots is not questioned, but for example, in order to increase the measurement sensitivity, the maximum brightness that can be adopted by the image display device 1 is preferably set.

  For example, from the imaging device 20, R, G, B color image data (imaging R data, imaging G data, imaging B data: collectively captured RGB data) as imaging data obtained by imaging a calibration image reflected on the reflecting mirror 452. Is supplied to the luminance calculation unit 402 of the display correction unit 400. The luminance calculation unit 402 stores the captured image data (imaging data reflecting the luminance of the calibration image) supplied from the imaging device 20 in the image storage memory.

  The luminance calculation unit 402 converts the image data R, RGB data, image data B, and display data representing the calibration image representing the measurement image acquired in step S102 into other color spaces (for example, XYZ color space, The image data is converted into image data in the Yuv color space (S110). Such color conversion processing is performed by displaying and measuring achromatic dots as a whole in pairs of R, G, and B in the case of color correspondence, and correcting the influence of the luminance change by correcting the luminance component and the color component. This is considered to be performed separately.

  The luminance calculation unit 402 obtains the luminance of the dot obtained by measuring the calibration image displayed based on the color-converted data for the measurement image, and the original calibration image dot based on the color-converted data for the calibration image display data. Is determined (S130). The luminance calculation unit 402 calculates the correction coefficient by comparing the luminance of the dots in the measurement image with the luminance of the original dots in the calibration image (S140). For example, when RGB color space data is converted into XYZ color space or Yuv color space data, the Y data after color conversion may be used as dot luminance data. As the correction coefficient, for example, the difference or ratio of the respective luminance data is used. The luminance calculation unit 402 stores the calculated correction coefficient in the correction information storage unit 404 (S142).

  By repeating such processing while changing the pixel positions of the dots displayed in the calibration image, luminance information of all the pixels is obtained (S144, S146). After step S146, the process returns to step S102.

  In normal image display, the luminance calculation unit 402 calculates the display luminance on the display surface based on the original display data before correction. For example, R, G, B color image data (display R data, display G data, display B data: collectively displayed RGB data) is displayed in the image display unit 10 as display data in the luminance calculation unit 402 of the display correction unit 400. It shall be supplied (S150). The luminance calculation unit 402 stores the display image data supplied from the control unit 90 in the image storage memory.

  The luminance calculation unit 402 converts the display R data, display G data, and display B data in the RGB color space acquired in step S150 into image data in another color space (for example, an XYZ color space or a Yuv color space) ( S160). Such color conversion processing is performed by displaying and measuring achromatic dots as a whole in pairs of R, G, and B in the case of color correspondence, and correcting the influence of the luminance change by correcting the luminance component and the color component. This is considered to be performed separately.

  The luminance calculation unit 402 uses the correction coefficient information stored in the correction information storage unit 404 for the color-converted display data so that the original luminance corresponding to the luminance of the original display data is obtained. Data correction is performed (so that display unevenness does not occur) (S180). Then, the display data after the data correction is supplied to the display timing controller 92 and displayed on the image display unit 10 (S190).

  By returning to step S150 and repeating the same processing, the display data is corrected so as to be displayed at the original luminance based on the correction coefficient information of each dot of the calibration image acquired at the time of luminance calibration measurement. Therefore, it is possible to always display an image in which the influence of the luminance characteristic variation of the display element is suppressed.

  According to such a mechanism, even if there is a change in the characteristics of the display element (for example, due to deterioration), the chromaticity coordinates of the final image are equal to the chromaticity coordinates obtained from the input data, and are affected by the change in the characteristics of the display element. Absent. In addition, since correction is performed on each pixel in the display surface, correction can be made in accordance with a change in each characteristic of the display element, and luminance unevenness and color unevenness are not visually recognized (difficult to be visually recognized) and have good appearance. A high-quality display image can be presented.

  Note that the luminance correction direction shown here increases the luminance of the display element when the luminance decreases. Since the decrease in display efficiency is compensated for even if there is a characteristic deterioration, the life of the display element can be extended until the decrease in efficiency cannot be compensated, and the image display device 1 can be used for a longer period. .

  However, although such a direction of luminance correction can be used for a long period of time (the lifetime of the display element can be further extended), in reality, the deterioration of the display element is accelerated. Such a mechanism is effective in delaying the appearance of “burn-in” or preventing the increase in the brightness difference that has occurred, but as time passes, “burn-in” appears and the brightness difference increases. Inevitable.

  As a countermeasure, the display brightness of the element that has deteriorated is decreased, and conversely, the display brightness of the element that has not deteriorated is increased, thereby suppressing the display unevenness and extending the substantial lifetime. it is conceivable that. That is, the purpose is to correct the deterioration degree (life) of the display element corresponding to each pixel so as to be equal for each pixel. By doing so, the burn-in phenomenon can be solved by recovering the partial deterioration of the display capability.

  As a specific aspect of this method, the correction amount is determined based on what, and the display data input using the correction amount is used so as to contribute to burn-in correction. Various methods can be considered for conversion. For example, a correction value is obtained using the cumulative light emission amount of the pixel having the largest cumulative light emission amount as a reference value, and the correction value is added to the corresponding original input display data. The correction value has a larger value as the deviation degree of the accumulated light emission amount with respect to the reference value is larger. In other words, the correction value is large for pixels with low light emission frequency and low light emission amount, and conversely, the correction value is small for pixels with high light emission frequency and large light emission amount. Conversely, a correction value is obtained using the cumulative light emission amount of the pixel having the smallest cumulative light emission amount as a reference value, and the correction value is subtracted from the corresponding original input display data. The correction value has a larger value as the deviation degree of the accumulated light emission amount with respect to the reference value is larger. In other words, the correction value is small for pixels with low light emission frequency and low light emission amount, and conversely, the correction value is large for pixels with high light emission frequency and large light emission amount. In any case, the luminance data obtained by measuring the dots of the calibration image in the luminance calibration processing of the present embodiment can be used as a substitute value for the accumulated light emission amount. Not only can it be corrected so that the deterioration (life) of the illuminant corresponding to each pixel is the same for each pixel, but also calculations necessary for burn-in correction (correction amount calculation processing and data conversion processing using the correction amount). Since addition and subtraction are sufficient, it is very simple, does not require complicated operations and memory, and does not require a high-performance CPU or a large-scale logic circuit.

<Replacement of electronic device monitoring device>
FIG. 12 is a diagram illustrating an example of an electronic apparatus to which the image display device 1 of the present embodiment is applied. The image display device 1 according to the present embodiment is not limited to a monitor device constituting a personal computer, for example, but can be used as a monitor device for various electronic devices. For example, it can be used as an alternative to a monitor device incorporated in a notebook personal computer (see FIG. 12A). Further, it is used as an alternative to a mobile phone (see FIG. 12 (2)), although not shown, a PDA (personal digital assistant, personal digital assistant), a monitor device incorporated in a game machine, a conventional television receiver or the like. be able to. In any case, the image display unit 10 is provided with a light transmission region 12 in which a light transmission unit 30 (not shown) is formed, and an imaging device 20 is provided on the back surface opposite to the display surface side.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various changes or improvements can be added to the above-described embodiment without departing from the gist of the invention, and embodiments to which such changes or improvements are added are also included in the technical scope of the present invention.

  Further, the above embodiments do not limit the invention according to the claims (claims), and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. Absent. The embodiments described above include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. Even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, as long as an effect is obtained, a configuration from which these some constituent requirements are deleted can be extracted as an invention.

  For example, on the back side of the image display unit 10, as a specific means of the light detection unit that measures the brightness of the dots of the calibration image reflected on the reflecting mirror 452 of the calibration jig 450 placed on the image display unit 10, the back side Although the example using the imaging device 20 that images the subject on the display surface side from the above has been specifically described, the light detection unit is not limited to this. It is also conceivable to provide a light detection unit such as a white balance sensor on the back of the image display unit 10 for measurement.

  Although an example is shown in which the calibration jig 450 is placed on the image display unit 10 at the time of luminance calibration measurement, this is not essential, and a reflector (such as a mirror) that reflects the image displayed on the display surface is used. It is conceivable to measure it.

  In the above-described embodiment, in the case of color support, achromatic dots are displayed and measured as a whole in pairs of R, G, and B, color conversion processing is performed, and the correction of the influence of the luminance change is corrected with the luminance component and the color. This was done separately for each component, but this is not essential. For example, it is conceivable to correct the color image data of R, G, B. In this case, instead of displaying and measuring achromatic dots as a whole in pairs of R, G, and B, an R pixel and a G pixel are applied by applying the same concept as in the case of the monochrome image display device 1. It is preferable to perform measurement by displaying chromatic color dots separately from the B pixels.

  In the above-described embodiment, the example in which the luminance calculation unit 402 corrects display data has been described, but this is not essential. For example, it is conceivable that the control unit 90 performs data correction. In this case, the control unit 90 takes in the correction coefficient information stored in the correction information storage unit 404 at the time of image display so that it visually corresponds to the luminance and chromaticity of the original display data ( Data correction is performed so that display unevenness does not occur.

  Furthermore, the image display device 1 and the image display system 2 described in the above embodiment can be further modified, and further inventions can be extracted. For example, you may make it provide the position detection part which calculates | requires the positional information on a to-be-photographed object based on the image information acquired via the imaging device 20. FIG. If position information of a subject (for example, a hand, a finger, an eyeball, a rod-like object (for example, a pen or a pencil)) is continuously obtained in time series by the position detection unit, the movement of the subject can be obtained. For this reason, it is possible to perform various processes corresponding to the movement of the subject (for example, moving the image up and down, moving left and right, closing the screen, opening another screen, etc. on the monitor device of the personal computer).

  In addition, a plurality (typically two) of imaging devices 20 are arranged on the back side of the image display unit 10, and the distance from the image display unit 10 to the user is determined based on image information from each of the imaging devices 20. The detection unit may obtain it. The position information of the observer can be the position data of both eyes of the observer, or the distance data from the image display unit 10 to the observer. In addition, the position information of the observer can be obtained based on the observer's eyes of the image data captured through the plurality of imaging devices. The position information of the observer can be configured to be displayed on the image display unit 10, so that the optimum three-dimensional image observation position is clearly shown to the observer so that the observer can easily observe the three-dimensional image. The user can be instructed or guided to the optimum three-dimensional image observation position. Or it can be set as the structure which optimizes the image displayed on the image display part 10 based on an observer's positional information.

  It is also conceivable to apply the mechanism of the above embodiment to a so-called video telephone conference system (video telephone apparatus). Since the imaging device 20 is arranged on the back side of the image display unit 10, the face of the user positioned in front of the image display unit 10 can be imaged, and the other user displayed on the image display unit 10 Since the face of the person is facing towards the user, there is no sense of incongruity that the lines of sight of the conventional TV phone system do not match each other. Since the function and effect of the configuration provided with the display correction unit 400 can also be enjoyed, an image of the user's face and the like in a state where the influence of illumination light is suppressed is displayed on the image display unit 10 on the other side.

  It is also conceivable to cause the image display device 1 of the embodiment to function as a so-called digital mirror. To realize this function, an image information storage unit that stores image information acquired via the imaging device 20, and image information and images acquired via the imaging device 20 (including the acquired status) A display control unit for displaying an image based on the image information stored in the information storage unit on the image display unit 10 is further provided. In the digital mirror function, the image display unit 10 can display the comparison result between the past and the current user in separate windows. Since the function and effect of the configuration provided with the display correction unit 400 can also be enjoyed, an image of the user's face and the like in a state where the influence of illumination light is suppressed is displayed on the image display unit 10.

  DESCRIPTION OF SYMBOLS 1 ... Image display apparatus, 2 ... Image display system, 10 ... Image display part, 11 ... Pixel, 12 ... Light transmission area, 20 ... Imaging apparatus, 20a ... Imaging part (functions as light detection part of illumination light distribution measurement part) , 21 ... Condensing unit, 30 ... Light transmission unit, 68 ... Light diffusion sheet, 70 ... Peripheral device, 90 ... Control unit, 400 ... Display correction unit, 402 ... Luminance calculation unit, 404 ... Correction information storage unit, 450 ... Calibration jig, 452 ... reflecting mirror, 462 ... projection (an example of a fitting structure)

Claims (12)

An image in which a plurality of pixels including a display element are arranged, a detection unit that detects a displayed image can be disposed on the back side, and a light transmission unit is provided in a region corresponding to the detection unit A display unit;
A display correction unit that corrects display data based on image information detected by the detection unit;
With
When the calibration information is acquired, the image display unit is configured so that a minimum interval between the display elements that are discontinuous among the display elements and perform display is larger than a diffraction pitch generated by the light transmission unit. Select the display element to display a calibration image,
The detection unit is provided with reflected light of the calibration image reflected by a reflection plate disposed at a position facing the display surface of the image display unit when the calibration information is acquired. Detect through the light transmission part,
The display correction unit acquires correction information for each of the display elements for suppressing the influence of the characteristic variation of the display element based on the information of the calibration image detected by the detection unit when acquiring the calibration information. In normal image display, the display data is corrected with reference to the correction information for each of the display elements.
Image display device. The display correction unit corrects display data so as to suppress the influence of characteristic variation of the display element in an image displayed on the image display unit.
The image display device according to claim 1. The detection unit further detects reflected light of an image displayed on the display surface of the image display unit through the light transmission unit provided in the image display unit.
The image display device according to claim 1. The image display unit can be arranged with an imaging unit that captures an image on the back side, and a light transmission unit is provided in a region corresponding to the imaging unit,
The detection unit detects reflected light of an image displayed on a display surface of the image display unit using the imaging unit;
The image display device according to claim 3. The image display unit sequentially changes the positions of the display elements that perform display so that the correction information is acquired for all the display elements in the display area of the image display unit,
The display correction unit is configured to acquire all the display elements in the display area based on each information of the calibration image detected by the detection unit every time the position of the display element is sequentially changed when the calibration information is acquired. Obtaining the correction information with respect to
The image display device according to any one of claims 1 to 4. The display element is a light emitting element.
The image display device according to any one of claims 1 to 5. The light emitting element is an organic electroluminescence element.
The image display device according to claim 6. A light collecting unit for collecting the light that has passed through the light transmitting unit on the detection unit;
The image display device according to claim 1. An image in which a plurality of pixels including a display element are arranged, a detection unit that detects a displayed image can be disposed on the back side, and a light transmission unit is provided in a region corresponding to the detection unit A display unit;
The detection unit that detects the reflected light of the calibration image reflected by the reflection plate disposed at a position facing the display surface of the image display unit through the light transmission unit provided in the image display unit;
A display correction unit that corrects display data based on image information detected by the detection unit;
With
When the calibration information is acquired, the image display unit is configured so that a minimum interval between the display elements that are discontinuous among the display elements and perform display is larger than a diffraction pitch generated by the light transmission unit. Select the display element to display a calibration image,
The detection unit is provided with reflected light of the calibration image reflected by a reflection plate disposed at a position facing the display surface of the image display unit when the calibration information is acquired. Detect through the light transmission part,
The display correction unit acquires correction information for each of the display elements for suppressing the influence of the characteristic variation of the display element based on the information of the calibration image detected by the detection unit when acquiring the calibration information. In normal image display, the display data is corrected with reference to the correction information for each of the display elements.
Electronics. An image display device including an image display unit in which a plurality of pixels including display elements are arranged;
A detection device that detects the reflected light of the calibration image reflected by the reflecting plate disposed at a position facing the display surface of the image display unit through a light transmission unit provided in the image display unit;
A device including a display correction unit that corrects display data based on information of an image detected by the detection device;
With
When the calibration information is acquired, the image display unit is configured so that a minimum interval between the display elements that are discontinuous among the display elements and perform display is larger than a diffraction pitch generated by the light transmission unit. Select the display element to display a calibration image,
The detection device is provided with reflected light of the calibration image reflected by a reflecting plate disposed at a position facing the display surface of the image display unit in the image display unit when the calibration information is acquired. Detect through the light transmission part,
The display correction unit acquires correction information for each of the display elements for suppressing the influence of the characteristic variation of the display element based on the information of the calibration image detected by the detection unit when acquiring the calibration information. In normal image display, the display data is corrected with reference to the correction information for each of the display elements.
Image display system. When obtaining calibration information,
An image in which a plurality of pixels including a display element are arranged, a detection unit that detects a displayed image can be disposed on the back side, and a light transmission unit is provided in a region corresponding to the detection unit In the display unit, the display element is selected and calibrated so that the minimum interval between the display elements that are not continuous among the display elements and display is larger than the diffraction pitch generated by the light transmission unit. Display an image,
Detecting the reflected light of the calibration image reflected by the reflecting plate disposed at a position facing the display surface of the image display unit through the light transmission unit provided in the image display unit,
Obtaining correction information for each of the display elements for suppressing the influence of characteristic fluctuations of the display elements based on the detected calibration image information,
During normal image display, display data is corrected with reference to the correction information for each of the display elements,
The display data after correction is supplied to the image display unit to perform image display.
Image display method. A plurality of pixels including display elements that perform image display are arranged, and a detection unit that detects reflected light of the display image is arranged on the back side. The detection unit detects the light through a light transmission unit of the image display unit. While performing display correction processing for correcting display data based on information,
In the display correction process, when the calibration information is acquired, the minimum interval between the display elements that are discontinuous among the display elements and perform display is larger than the diffraction pitch generated by the light transmission unit. The display element is selected to display the calibration image on the image display unit, and the correction information for suppressing the influence of the characteristic variation of the display element based on the information of the calibration image detected by the detection unit A program that is acquired for each display element and causes a computer to execute a process of correcting display data with reference to the correction information for each display element during normal image display.