JP7358909B2 - Stereoscopic display device and head-up display device - Google Patents

Description

The present invention relates to a stereoscopic display device that provides stereoscopic vision by projecting parallax images to a user's eyes, and a head-up display (HUD) device that displays a virtual image on a vehicle windshield, combiner, etc. Regarding etc.

Patent Document 1 describes a HUD device that performs image rendering and selectively uses 3D display and 2D display.

Patent Document 2 discloses that in a HUD device using a stereoscopic display device having a display section (liquid crystal display, etc.) and an image separation section (lenticular lens), a stereoscopic image can be normally viewed even if the driver's viewpoint position moves. In order to achieve this, it is described that the left and right separation angles of the odd-numbered rows and even-numbered rows of the lenticular lens are made different to provide two stereoscopic viewing areas for the same image. In the example described in FIGS. 3A to 3C of Patent Document 2, even-numbered rows and odd-numbered rows in the lenticular lens have the same pitch in the lateral direction but different radii of curvature of the lens.

JP2019-62532A International Publication No. 2018/142610

The inventors have recognized the new problem described below. For example, when displaying various displays over a fairly wide range from 1 m to 100 m in front of the vehicle, for example, a vehicle speed display displayed near the vehicle, and a display extending over a wide range in the direction of travel of the vehicle along the road surface. If navigation arrow figures, etc., are displayed with the same clarity, the sense of perspective may become unnatural and the user may feel uncomfortable. In the above example, if the clarity is set to match the navigation arrow in the distance (usually a slightly lower resolution considering the natural blur caused by parallax), the clarity of the vehicle speed display etc. that can be seen in the foreground is insufficient. I tend to do it. Conventional HUD devices capable of stereoscopic viewing do not address such issues.

In Patent Document 1, 3D display and 2D display are switched and used depending on the contents of the displayed content, and the above-mentioned problems considered by the inventor (for example, unnatural perspective when displaying over a wide area) are used. There is no mention of the issue of the occurrence of sensual sensations, nor is there any mention of countermeasures.

Note that in a method that uses 3D and 2D display separately, separate image rendering is required to display the different methods, which undeniably increases the burden on the display control device.

Furthermore, in Patent Document 2, in order to prevent stereoscopic images from becoming invisible due to a shift in the driver's viewpoint, the separation angle of light rays is made different between the odd-numbered rows and the even-numbered rows of the lenticular lens, and two stereoscopic viewing areas are created. There is only a description that the range of stereoscopic visibility can be expanded by providing them in an overlapping manner, and the problem considered by the above-mentioned inventors (for example, the problem of creating an unnatural sense of perspective when displaying a wide area) There is no mention of this, and no mention of countermeasures.

In the example of Patent Document 2, lenticular lenses are used that have the same pitch and different curvature radii for odd and even rows. As a result, 3D images with different horizontal resolutions (different clarity) will be displayed together for the same image, and in this case, it is undeniable that the display quality may deteriorate due to crosstalk, etc. do not have.

An object of the present invention is to provide a three-dimensional display device (3D display) or the like that allows viewing of a three-dimensional image with reduced discomfort caused by perspective, etc., without increasing the burden on the display control unit.

Other objects of the invention will become apparent to those skilled in the art upon reference to the following illustrative aspects and best embodiment, and the accompanying drawings.

Below, embodiments according to the present invention will be illustrated in order to easily understand the outline of the present invention.

In a first aspect, the stereoscopic display device includes:
A stereoscopic display device that provides stereoscopic vision by projecting parallax images onto both eyes of a user,
a display unit including a display surface that displays the parallax image;
an optical member that is disposed in contact with or in close proximity to the display section and has a light beam separation function that separates each light beam of a left-eye parallax image and a right-eye parallax image;
a display control unit that controls image display on the display unit;
has
The optical member is
a first light beam separation section in which first optical elements that refract light are arranged at a first pitch along the lateral direction and have a first resolution in the lateral direction;
When the direction perpendicular to the horizontal direction is defined as the vertical direction, a second beam separating section that is arranged at a different position in the vertical direction from the first beam separating section and that refracts light is arranged in the horizontal direction. a second light beam separating section, which is arranged at a second pitch that is larger than the first pitch, so that the resolution in the lateral direction is a second resolution that is lower than the first resolution; ,
has
The display control section includes:
displaying a left-eye parallax image and a right-eye parallax image of a first display target in a first region of the display surface corresponding to the first light beam separation section;
A left-eye parallax of a second display object, which may have lower clarity in stereoscopic vision than the first display object, is provided in a second region of the display surface corresponding to the second light beam separation section. Display the image and the right eye parallax image.

In a first aspect, in a three-dimensional display device (3D display), an optical member (3D optical member: a lenticular lens, a parallax barrier (parallax shield), etc.) is connected to at least two light beam separation units (first, second The lateral pitch (the lateral arrangement interval of optical elements such as lenses and shields) in each part is made different.

The display control unit also displays images of different resolutions (parallax images) for different display targets in each area (first and second areas) of the display unit corresponding to the first and second beam separation units. Display (arrange).

There is a trade-off relationship between the pitch of optical elements (in other words, the number of optical elements arranged in the horizontal direction) and the resolution of the displayed 3D image, and the smaller the pitch (in other words, the number of optical elements arranged in the horizontal direction), the more the resolution of the displayed 3D image. The larger the number of optical elements), the higher the lateral resolution, and the larger the pitch (in other words, the fewer the number of optical elements arranged laterally), the lower the lateral resolution. Note that the resolution in the horizontal direction is sometimes referred to as horizontal resolution in the field of image processing.

For example, assume that the first area of the display surface is an area where priority is given to resolution, and parallax images such as small characters such as numbers can be displayed here. In this case, it is preferable to set the pitch of the first beam separation section corresponding to the first area to be small (narrow) to realize accurate presentation of information to the user using a clear 3D image, for example.

In addition, when displaying an image of a sign (parallax image) that is displayed at a position quite far from the vehicle in the second area, or when displaying an image of a sign that is displayed at a position quite far from the vehicle, or when displaying a sign that extends along the road surface over a fairly wide range in front of the vehicle in a HUD device, etc. When displaying an image (parallax image) such as an existing navigation arrow figure, this second area can be said to be an area where priority is given to expressing visual perspective or depth. In this case, the pitch of the second beam separation section corresponding to the second area is set larger (wider) than the first beam separation section, so that the resolution is lower than that of the 3D image consisting of the above-mentioned characters, etc. It is preferable to create a 3D image with an emphasis on perspective (or depth) (for example, a 3D image with natural blur).

In this way, for example, a 3D image for which high resolution is preferable and a 3D image for which the resolution may be slightly lowered (which may be said to be preferable) with emphasis on perspective (sense of depth) etc. are displayed at the same time. Even in such a case, when the user compares and views each video, each display target can be displayed at an appropriate resolution so that the user does not feel particularly uncomfortable. Therefore, for example, the burden on the user's eyes is reduced, making it possible to suppress fatigue and the like.

Furthermore, in this aspect, since the resolution is controlled by the structural design of the optical member, resolution control by image processing is basically unnecessary. Therefore, it is possible to provide a stereoscopic display device that allows viewing of a stereoscopic image with reduced discomfort due to perspective, etc., without increasing the burden on the display control unit.

In a second aspect subordinate to the first aspect,
The optical member may be a lenticular lens or a parallax barrier.

In the second aspect, a lenticular lens or a parallax barrier is used as the optical member. By using optical members, which are said to be the mainstream technology in the current field of 3D displays, the quality of displayed images can be stably maintained.

Here, the lenticular lens is, for example, a 3D image display in which a plurality of optical elements are arranged (arranged) at a predetermined pitch in the horizontal direction, and the optical element is a cylindrical lens that is elongated in the vertical direction (vertical direction). It is a type of optical member that can be used for.

In addition, a parallax barrier is a device in which, for example, narrow strip-shaped (rectangular) shielding objects are arranged horizontally at a predetermined pitch with gaps (slits) between them. , is an optical element that generates different image display light (directional display light) for each of the left and right eyes by blocking a portion of the image display light with a shielding object.

In a third aspect, the head-up display device includes:
A head-up display (HUD) device that projects display light onto a reflective transparent member provided on a vehicle, and generates and displays a virtual image using the light reflected by the reflective transparent member,
A stereoscopic display device according to the first or second aspect,
an optical system of a HUD device having at least one light reflecting member and reflecting light from the stereoscopic display device at least once and projecting the reflected light onto the reflective transmissive member as the display light;
has
Regarding the first display object obtained as a result of the light separated through the first light beam separating section in the stereoscopic display device being reflected by the optical system of the HUD device and the reflective translucent member. Let the virtual image of be the first virtual image,
Regarding the second display object obtained as a result of the light separated through the second light beam separating section in the stereoscopic display device being reflected by the optical system of the HUD device and the reflective translucent member. When the virtual image of is the second virtual image,
A first convergence angle based on the left and right eyes of the user at the end point of the first virtual image farthest from the vehicle is θa, and the user at the end point of the second virtual image closest to the vehicle When θb is the second convergence angle with respect to each of the left and right eyes, θa>θb.

In the third aspect, the light emitted from the stereoscopic display device is reflected at least once in the optical system of the HUD device, and is projected (projected) onto a reflective transparent member (such as a windshield) of the vehicle as display light. As a result, an image is formed in front of the vehicle (in a direction along the road surface and away from the vehicle).

Here, based on the light emitted from the first beam separation section of the stereoscopic display device, a virtual image (a first virtual image, in other words, a first stereoscopic virtual image) of a first display target is displayed, for example, in front of the vehicle. be done. Furthermore, a virtual image of a second display target (a second virtual image, in other words, a second three-dimensional virtual image) is displayed based on the light emitted from the second beam separation section.

The first display target is, for example, an information image composed of characters and the like that requires high image clarity (specifically, for example, a vehicle speed display composed of letters and numbers). Further, the second display target is, for example, a navigation arrow figure that extends superimposed on the road surface, a road sign or a billboard located far away from the vehicle speed display, etc. As mentioned above, this can be said to be an information image in which perspective or depth is important.

A large convergence angle means that a virtual image is recognized closer to the user, and a small convergence angle means that a virtual image is recognized further away. In this aspect, the virtual image (first virtual image) regarding the first display target (vehicle speed display, etc.) is perceived as being located close to the user of the HUD device, and at this time, accurate information presentation using the clear virtual image is possible. It will be done.

Further, the virtual image (second virtual image) of the second display target (distant sign or signboard such as a navigation arrow) is recognized further away, and at this time, the second virtual image is more distant than the first virtual image. The sharpness is relatively reduced compared to the virtual image, and therefore a natural blur (blur) due to being far away or extending from near to far is appropriate for the second virtual image. will occur. Therefore, even in the case where virtual images are displayed simultaneously, each virtual image is displayed with appropriate clarity depending on the distance from the user (or vehicle), and the user does not feel any discomfort.

In a fourth aspect subordinate to the third aspect,
The difference between the minimum and maximum possible convergence angles for the first virtual image is a first difference, and the second difference is the difference between the minimum and maximum possible convergence angles for the second virtual image. , the second difference may be larger than the first difference.

In the fourth aspect, the displayed virtual image has a relatively large difference between the possible minimum value and maximum value of the convergence angle as the second virtual image (virtual image whose sharpness is slightly reduced), The one for which the difference is relatively small is the first virtual image (virtual image with higher clarity).

For example, in front of a vehicle, there is a virtual image that extends over a wide area and has a long depth (includes images that are superimposed on the road surface, etc., and in a broad sense, the concept of "tilted image" gives the impression that it is tilted with respect to the road surface). (which can also be regarded as a included virtual image) can be used as the second virtual image. A virtual image that extends along the road surface has a large distance between the near end on the side closer to the vehicle and the far end on the far side, and the difference in perspective is large. The difference between the convergence angle and the minimum convergence angle at the far end increases.

On the other hand, the first virtual image includes, for example, a virtual image with a short depth (a virtual image that is displayed perpendicular to the road surface or at an angle close to orthogonal to the user and directly faces the user; in a broad sense, it is close to the road surface). It can also be seen as a virtual image included in the concept of ``standing image,'' which gives the illusion of standing in front of someone. A virtual image that gives the illusion of standing against the road surface has a small difference between the maximum convergence angle at the near end and the minimum convergence angle at the far end.

Therefore, a display object with a large difference between the minimum and maximum possible convergence angles is set as the second display object, and the virtual image (second virtual image) is displayed at a farther distance from the vehicle, for example, so that the difference is smaller. By setting a small display object as the first display object and displaying the virtual image (first virtual image) closer to the vehicle, it is possible to obtain the effect of creating or easily creating a natural sense of perspective. can.

In a fifth aspect dependent on the third or fourth aspect,
The first virtual image is a virtual image that is preferably displayed directly facing the user,
The second virtual image is a virtual image that is preferably displayed to the user so as to extend along the road surface, or a virtual image that is preferably displayed so as to be superimposed on the road surface.

In the fifth aspect, the first virtual image can be a standing image that gives the user a standing vision, facing the user, and the second virtual image can be arranged along the road surface (in the direction of travel of the vehicle). ) It can be a virtual image that extends or is superimposed on the road surface. According to this aspect, the first and second display targets can be displayed with natural perspective.

In a sixth aspect subordinate to any one of the third to fifth aspects,
The first virtual image is displayed at a first angle θ1 with respect to the road surface on which the vehicle is traveling,
the second virtual image is displayed at a second angle θ2 with respect to the road surface on which the vehicle is traveling;
The first angle θ1 satisfies 45°<θ1≦90°,
The second angle θ2 may satisfy 0≦θ2≦45°.

In the sixth aspect, an example of the range of angles θ1 and θ2 with respect to the road surface is shown for the standing image and the inclined image. 45°, which is half of the right angle (90°), is used as the threshold angle, and θ1 and θ2 are divided depending on whether they are less than 45° or greater than 45°. Further, θ1 may have an angle of 90° with the road surface (perpendicular to the road surface), and θ2 may have an angle of 0° with the road surface (superimposed on the road surface). By properly using a standing image in a wide sense and a tilted image in a wide sense, various displays can be displayed simultaneously with a natural sense of perspective.

For example, by dividing a virtual image into multiple parts and assigning an appropriate lateral (horizontal) resolution to each virtual image, you can create a display with depth, display more text information, and make them look unnatural. This makes it possible to display images without any need for information. This makes it possible to display a variety of high-quality three-dimensional virtual images on the HUD, which has been difficult with the prior art, and achieves higher functionality of the HUD device.

In a seventh aspect subordinate to any one of the third to sixth aspects,
The first display target is an information image that is at least one of information about the vehicle, information about the surroundings of the vehicle, and navigation information, including at least one of characters, graphics, and symbols;
The second display target may be an information image including an arrow figure or a figure other than an arrow regarding the progress of the vehicle or another vehicle.

In this aspect, an image, etc. for which accuracy of information transmission is important is set as the first display target (display target corresponding to the virtual image displayed on the near side of the own vehicle), and a visual sensation that does not feel strange is provided (without feeling strange). An image, etc., in which emphasis is placed on the visibility of the sense of perspective and depth) is set as the second display target (the display target corresponding to the virtual image displayed on the far side of the host vehicle).

Examples of the first display target include characters, icons, etc. that indicate information about the vehicle, information about the surroundings of the vehicle, navigation information, and the like. Specifically, vehicle speed display, road speed limit information, turn-by-turn information (for example, intersection name information, POI (specific point on a map) information, etc.) can be exemplified.

These require display accuracy or quick recognition, and since vehicle speed displays are often displayed all the time, it is important to display a focused virtual image in front of the user for easy viewing. Since this is preferable, it is preferable to include it in the first display target.

Furthermore, examples of the second display target include information including arrow figures related to the progress of the own vehicle or other vehicles, figures other than arrows, and the like. These are mainly based on figures, and it is important that they can be grasped intuitively and that distance information can be sensed without any discomfort. Further, it is preferable that signs and the like located far away be displayed with an amount of blur that matches the degree of blur of the surrounding actual scene, so that the user does not feel uncomfortable. In addition, there is arrow information as a route guide, colored graphic information indicating frozen road surface areas, and ADAS (Advanced Driving Assistance System) information that supports the user, the driver, in operating the steering wheel and equipment. The same is true. Therefore, it is preferable to include these in the second display target and use the area on the back side of the virtual image display surface (slanted surface) to display a display that gives a sense of depth and is moderately out of focus. Thereby, it is possible to realize a display with proper visibility without eye fatigue.

In an eighth aspect subordinate to any one of the third to seventh aspects,
The display control unit may perform display control such that the second virtual image moves closer to the vehicle over time.

In the eighth aspect, specific examples of display control in which the virtual image approaches the own vehicle over time include a case where various displays for navigation are moved on the road surface in accordance with the progress of the vehicle; An example of this is when a sign indicating a speed limit is moved from a distant place to a nearby place.

For example, when a moving display is located at a far or intermediate position of the vehicle, the resolution is kept slightly lower, and when the display reaches closer as a result of movement, the resolution increases to provide clearer vision. This makes it possible to perform dynamic and natural virtual image display control.

In a ninth aspect subordinate to any one of the third to eighth aspects,
When it is determined that the second display target includes information with a higher degree of urgency or importance than usual, the display control unit displays a left-eye parallax image and a right-eye parallax image of the second display target. When displaying a parallax image in the second area of the display surface, the left-eye parallax image and the right-eye parallax image of the second display target may be subjected to image processing to suppress a decrease in resolution. .

In this aspect, when the display control unit displays the parallax images on the display surface of the display unit, the display control unit individually performs image processing, for example, suppresses blurring, emphasizes shadows and outlines, etc. Further corrections can be made.

As described above, in the present invention, optical members (lenticular lenses, parallax barriers, etc.) used for stereoscopic display are provided with a plurality of parts with different resolutions, and the left-eye light beam/right-eye light beam is separated by each part. The first and second virtual images formed based on the ophthalmic light beam are individually set to appropriate resolutions.

However, even if the virtual image is to be displayed and is better to have a relatively low resolution, in some cases, a relatively low resolution may not be necessary. For example, notifications in important driving situations, such as when displaying a warning mark in the distance to notify of a traffic accident that has occurred in front of the vehicle, or in the case of a danger warning to notify that an intervening vehicle remains in a dangerous position. This is the case in the case of a highly important display that cannot be missed, such as a time display or an expressway exit notification.

In such a case, the display control unit performs individual image processing and individually performs corrections to increase sharpness (including emphasis processing, etc.) to provide individual relief, and the optical system of this embodiment It is possible to prevent adverse effects from occurring when the member is used. Even in this case, since the image processing is done individually, the load on the image processing software and hardware does not increase significantly, so no problem occurs.

Those skilled in the art will readily understand that the embodiments according to the invention as illustrated may be further modified without departing from the spirit of the invention.

FIG. 1(A) is a diagram showing an example of a virtual image viewed by a user through a windshield, and FIG. 1(B) is a diagram showing a convergence angle in stereoscopic vision. FIG. 2(A) is a diagram showing an example of the configuration of the HUD device of the present invention using a stereoscopic display device, and FIG. 2(B) is a diagram showing the angle (inclination angle) of each virtual image separated into two with respect to the road surface. FIG. 2C is a diagram showing an example of the configuration of a HUD device that projects an image onto a screen to generate display light, as a comparative example. FIG. 3(A) is a diagram showing a configuration example of a stereoscopic display device, and FIG. 3(B) is a diagram showing the display principle of a virtual image (stereoscopic virtual image) in a HUD device using the stereoscopic display device. FIG. 4(A) is a diagram for explaining the reproduction of light rays of a three-dimensional image in a three-dimensional display device using a flat panel display (display part) and a lenticular lens (optical member), and FIG. FIG. 2 is a diagram showing an example of the configuration of a stereoscopic display device having two light beam separation sections with different resolutions. FIG. 2 is a diagram illustrating a configuration example of a control unit (including a display control unit) in a stereoscopic display device, a pixel configuration, etc. in a display unit (flat panel display); 6(A) and 6(B) are diagrams showing display examples when a virtual image is displayed so as to stick to the road surface, and FIGS. 6(C) to 6(E) are diagrams showing display examples in which a virtual image is displayed so as to stick to the road surface. It is a figure showing an example. FIG. 7(A) is a diagram showing an example of the system configuration of the HUD device, and FIG. 7(B) is a diagram showing an example of the configuration of the display control section. FIG. 8 is a diagram showing an example of the overall configuration of the HUD device. FIG. 9 is a flowchart illustrating an example of the procedure of display processing by the display control unit.

The best embodiment described below is used to facilitate understanding of the present invention. Therefore, those skilled in the art should note that the invention is not unduly limited by the embodiments described below.

Please refer to FIG. FIG. 1(A) is a diagram showing an example of a virtual image viewed by a user through a windshield, and FIG. 1(B) is a diagram showing a convergence angle in stereoscopic vision. In FIG. 1A, the width direction of the vehicle (lateral direction, left-right direction, or horizontal direction) is defined as the x direction, and the height direction of the vehicle (vertical direction, vertical direction, or vertical direction perpendicular to the road surface 40) is defined as the x direction. The y direction is defined as the y direction, and the direction along the traveling direction of the vehicle (front-back direction) is defined as the z direction. Note that this point also applies to other drawings.

Vehicle 1 is traveling on a straight road. Note that the user of a HUD device (stereoscopic HUD device) using a 3D display device (3D display) can see the side lines 51, 53 and center line 55 of the road as a real view (background) through the windshield (windshield). , and the traffic light 71 can be visually recognized.

In FIG. 1(A), a windshield of a vehicle (self-vehicle) 1 functions as a projection target member (a member having light reflectivity and translucency). In other words, the projection target member is the reflective translucent member 2. Note that the windshield, which is the projection target member (reflective translucent member 2), may be a combiner or the like. The HUD device projects display light onto a reflective transparent member 2 provided on the vehicle 1, and generates and displays a virtual image using the display light reflected by the reflective transparent member 2.

The virtual image in Fig. 1 (A) is a three-dimensional virtual image (stereoscopic virtual image) that is displayed by entering display light of different images (parallax images) for the left eye and right eye into the left and right eyes of the user. be. For example, if the difference (disparity) between the left-eye image and the right-eye image is small, the user perceives the images as being nearby; on the other hand, if the difference (parallax) between the left-eye image and the right-eye image is large, For example, the user perceives the image to be far away.

A HUD device (not shown in FIG. 1; reference numeral 101 in FIG. 2) is arranged, for example, inside a dashboard (not shown in FIG. 1; reference numeral 41 in FIG. 8).

Further, in the example of FIG. 1A, an operation section 9 is provided near the steering wheel (steering handle in a broad sense) 7, which can turn on/off the HUD device, etc., and set the operation mode, etc. ing. Further, a display device (for example, a liquid crystal display device) 13 is provided at the center of the front panel 11. The display device 13 can be used, for example, to assist display by a HUD device. Note that this display device 13 may be a composite panel having a touch panel or the like.

The virtual image is displayed in a virtual image display area 3 within a windshield (reflective translucent member) 2. The virtual image display area 3 is determined according to the vertical viewing angle and the horizontal viewing angle of a stereoscopic display device (3D display; details will be described later).

In the example of FIG. 1(A), a virtual image SP with a clear vehicle speed display (display of "50 km/h") is displayed. In a broad sense, this virtual image of the vehicle speed display SP is "a clear first virtual image V1 with high resolution in the width direction of the vehicle or with little blur."In other words, accurate information transmission to the user is important. This can be said to be the first virtual image V1 of the image (image with high clarity).

The first virtual image V1 of this "image with high clarity" is non-superimposed content (not intended to be superimposed on the target, such as the state of the vehicle 1 or the surroundings of the vehicle 1) that is always displayed on the near side when viewed from the user. It may be a display (indicating a situation, etc.), or it may be a navigation display consisting of at least one of characters, figures, symbols, etc.

On the other hand, a virtual image 69 in the shape of a navigation arrow extending in the traveling direction of the vehicle 1 along the road surface 40 (for example, superimposed on the road surface 40) further than the vehicle speed display SP and a sign indicating the speed limit A virtual image 65 of (traffic sign) is displayed.

These virtual images 69 and 65 can be said to be second virtual images whose resolution is set slightly lower than that of the first virtual image V1. In other words, the second virtual image V2 is appropriately blurred (in other words, out of focus), and this provides the user with a natural vision that does not feel strange.

In the example of FIG. 1A, the degree of blurring (blurring amount) is, for example, the same as that of the traffic light 71, which is a real scene. As a result, the part of the arrow at the tip of the virtual image 69 or the virtual image 65 of the traffic sign does not stand out, and is more natural compared to the virtual image SP with a clear vehicle speed display displayed on the front side. A sense of perspective is expressed, which prevents the user from feeling uncomfortable and reduces fatigue in both eyes.

In a broad sense, the second virtual image V2 is "a virtual image whose resolution in the lateral direction, which is the width direction of the vehicle 1, is lower than that of the first virtual image displayed on the near side (near side)". In other words, it can be said to be a virtual image of an image where it is important to provide the user with a natural sense of vision (an image that provides a natural sense of perspective (distance)).

The second virtual image V2 is information including, for example, an arrow figure related to the progress of the vehicle 1 or another vehicle, and a figure other than the arrow (for example, a triangular figure indicating the direction of travel or a circular figure that is a traffic sign) It may be an image, or it may be a figure (road surface superimposed figure) such as an arrow that is superimposed on the road surface 40 and extends for a considerable length along the traveling direction of the vehicle 1, for example.

Here, in FIG. 1(A), the end point (near end) closest to the vehicle 1 of the first virtual image V1 (vehicle speed display SP) is designated as U0, and the end point (far end) farthest from the vehicle 1 is designated as U1. do. That is, in this case, the parallax between the left and right images at the near end U0 of the first virtual image V1 may be set to be larger than the parallax between the left and right images at the far end U1.

In addition, among the second virtual images V2, the end point closest to the vehicle 1 in the virtual image 69 of the arrow (in other words, the end point that appears lowest) is U2, and the farthest end point (in other words, the end point that appears highest) is U3. shall be. That is, in this case, the parallax between the left and right images at the near end U2 of the second virtual image V2 may be set to be larger than the parallax between the left and right images at the far end U3.

Refer to FIG. 1(B). The first convergence angle based on the left and right eyes AL and AR of the user at the farthest end point U1 from the vehicle 1 of the virtual image SP displaying the vehicle speed as the first virtual image V1 is θa, and the second virtual image V2 When θb is the second convergence angle of the virtual image 69 of the arrow at the end point U2 closest to the vehicle 1, with reference to the left and right eyes AL and AR of the user, θa>θb. As a result, the user (person) perceives (perceives or senses) the virtual image SP representing the vehicle speed as being closer, while perceiving the virtual image 69 of the arrow as being further away.

Here, attention is paid to the end points U0 to U3 in FIG. 1(A). The difference between the minimum value (convergence angle at end point U1) and the maximum value (convergence angle at end point U0) of the convergence angle for the first virtual image V1 is defined as the first difference, and the convergence angle for the second virtual image V2 is set as the first difference. When the difference between the possible minimum value (convergence angle at end point U3) and maximum value (convergence angle at end point U2) is defined as a second difference, the second difference is larger than the first difference.

The virtual image 69 in the shape of an arrow, which is the second virtual image V2 extending along the road surface 40, has a distance between the near end U2 on the side closer to the vehicle 1 and the far end U3 on the far side of the virtual image 69. Since the distance difference is large, the difference between the left and right images of the near end U2 and the left and right images of the far end U3 becomes large, and the maximum convergence angle of the near end U2 and the minimum convergence of the far end U3 are large. The difference with the angle becomes larger.

On the other hand, the vehicle speed display SP as the first virtual image V1 is a virtual image with a short depth, and specifically, it is displayed perpendicular to the road surface 40 or at an angle close to orthogonal to the road surface 40, and is displayed directly facing the user. It can also be seen as a virtual image included in the concept of ``standing statue,'' which is preferable to face. In the virtual image SP of the vehicle speed display that gives the impression that the vehicle is standing on the road surface 40, the difference between the maximum convergence angle at the near end U0 and the minimum convergence angle at the far end U1 becomes small.

Therefore, a display object (such as an image of an arrow shape) with a large difference between the minimum and maximum possible convergence angles is set as a second display object (an image whose resolution (sharpness) is relatively reduced). The virtual image (virtual image 69 in the shape of an arrow, which is the second virtual image V2) is displayed further away from the vehicle 1, and the display object (vehicle speed display) with a smaller difference is displayed as the first display object (the resolution (clarity) is relative). By displaying the virtual image (virtual image SP of the vehicle speed display, which is the first virtual image V1) closer to the vehicle 1, a natural sense of perspective is created or easily created. effect can be obtained.

Next, refer to FIG. 2. FIG. 2(A) is a diagram showing an example of the configuration of the HUD device of the present invention using a stereoscopic display device, and FIG. 2(B) is a diagram showing the angle (inclination angle) of each virtual image separated into two with respect to the road surface. FIG. 2C is a diagram showing an example of the configuration of a HUD device that projects an image onto a screen to generate display light, as a comparative example.

First, a comparative example (HUD device using a 2D display) shown in FIG. 2(C) will be described. However, FIG. 2(C) was conceived by the present inventor and is not a known example. In the driving scene shown in FIG. 1A described above, a virtual image is displayed over a fairly wide range, for example, 10 m to 100 m in front of the vehicle 1. A configuration example in which a HUD device using a 2D display displays such a wide-ranging virtual image is shown as a comparative example in FIG. 2(C).

The HUD device 100 shown in FIG. 2(C) includes a light projection unit (projection unit or projector) 151 and a display unit (sometimes referred to as an image display unit) having a display surface 164 that displays an image. includes a screen) 161, a reflecting mirror (folding mirror) 174, a curved mirror (concave mirror) 171, a cover glass 176, and an exterior (casing) 121.

A virtual image display over a wide range is achieved by installing a large screen 160 inclined with respect to the optical axis, and displaying a virtual image in front of the vehicle 1 that is tilted with respect to the road surface 40 and determined corresponding to the display surface 164 of the inclined screen 160. This is realized by providing a surface (imaging surface) PS1 and displaying the virtual image Z1 at a position on the virtual image display surface PS1 according to the virtual image display distance.

However, in the comparative example of FIG. 2C, the vertical distance (height) H2 of the 2D display 151 (the part indicated by the broken line in the figure) is quite long, and if the display range is made wider than this, A problem may arise that it does not fit inside the exterior casing 121. This problem is solved by the HUD device (stereoscopic HUD device) using the 3D display of this embodiment shown in FIG. 2(A).

That is, in FIG. 2A, a three-dimensional display device (3D display) is employed, and this three-dimensional display device is capable of high-density display, and is also small and thin. In addition, since the display is thin, the 3D display is rotated more clockwise and installed at a greater inclination in FIG. 2(A) than in FIG. 2(C). Due to these, the height H1 of the 3D display is sufficiently reduced compared to H2 in FIG. 2(C), and can be easily accommodated in the exterior 121. Therefore, the HUD device can be downsized.

The configuration of FIG. 2(A) will be described in more detail below. In addition, in FIG. 2(A), the same reference numerals are given to the parts common to FIG. 2(C). A stereoscopic display device 231 employed in the HUD device of FIG. 2A is a stereoscopic display device that provides stereoscopic vision by projecting parallax images onto the user's eyes, and is a display surface that displays the parallax images. a display unit (for example, a flat panel display) 210, which is disposed in contact with or in close proximity to the display unit 210, and has a light beam separation function that separates each light beam of the left-eye parallax image and the right-eye parallax image. It includes a lenticular lens 220 as an optical member, and a display control section 300 that controls image display on the display section 210. In addition, a stereoscopic display section (3D display section) 230 is configured by the display section 210 and the lenticular lens 220 as an optical member.

Here, the lenticular lens 220 as an optical member is not shown in FIG. 2, but as shown in FIG. , 220b. Note that details of these structures will be described later.

In FIG. 2A, three light rays e1, e2, and e3 are shown as light rays emitted from the stereoscopic display device (3D display) 231. Here, the light ray e1 is light corresponding to an image with relatively high clarity (resolution) (as it is also the light that reproduces the image, it can also be referred to as reproduction light (or reproduction light)), and on the other hand, The light rays e2 and e3 are light (reproduction light) corresponding to an image with relatively low clarity (resolution). Hereinafter, explanation will be made using the term "reproduced light".

The reproduced lights e1 to e3 are transmitted at least once (two times in total in FIG. 2A) by the optical system of the HUD device 101 (including a folding mirror 174 as a reflecting member and a curved mirror (concave mirror, magnifying mirror) 171). ) are reflected, thereby becoming display lights E1 to E3 (in other words, display lights E1 to E3 are generated), and are projected onto the windshield 2.

As a result, the first virtual image V1 (resolution α) and the second virtual image (resolution β: β<α) are displayed. Since the virtual image is separated into two parts and each virtual image is displayed at an appropriate resolution, the user is prevented from feeling uncomfortable and the fatigue of both eyes is reduced.

Note that in FIG. 2A, a reflecting mirror (returning mirror) 174 is a mirror that reflects light and is made of molded resin, such as polycarbonate, and metal, such as aluminum, deposited thereon. The curved mirror (concave mirror) 171 is a mirror made of resin, such as polycarbonate, molded to have a concave surface (which may be a free-form surface), and metal, such as aluminum, deposited on it, and functions as a kind of magnifying glass. By projecting the display lights E1 to E3 toward the windshield 2, an image (video) is projected. The cover glass 176 is a sheet made of transparent resin, such as polycarbonate. Moreover, the exterior 121 is a housing that houses the components of the HUD device.

Note that in the configuration of FIG. 2A, the curved mirror 171 can be rotated by the rotating part (actuator) 175 to adjust the inclination as appropriate. Further, the adjustment unit (actuator) 173 can also adjust the tilt, etc. of the stereoscopic display device (3D display) 230.

In the example of FIG. 2A, the virtual image display distance (view point A, Alternatively, the distance from the reference point on the vehicle 1) is L1, and regarding the end point U2 of the second virtual image V2 (specifically, the virtual image 69 in the shape of the arrow in FIG. 1(A)) near the vehicle 1. The virtual image display distance is L2, and L2>L1.

Further, in FIG. 2(A), a virtual stereoscopic image (original stereoscopic image) corresponding to the first virtual image V1 is indicated by the symbol M(V1). Further, a virtual stereoscopic image (original stereoscopic image) corresponding to the second virtual image V1 is indicated by the symbol M (V2).

The virtual three-dimensional images M(V1) and M(V2) are created, for example, by assuming that the left and right eyes of a person are located at the position of the folding mirror 174 (the position where the reproduced light emitted from the lenticular lens etc. forms an image). If so, it can be recognized by that person. In other words, as a result of light rays being reproduced by the light ray reproduction type stereoscopic display device 231, it is an apparent 3D image that can be perceived by a person whose both eyes are located at the imaging point.

Refer to FIG. 2(B). In FIG. 2(B), the angle between the first virtual image V1 and the road surface 40 is θ1, and the angle between the second virtual image V2 and the road surface 40 is θ2. θ2>θ1.

As explained above, the second virtual image V2 (the virtual image 69 in the shape of an arrow) is a virtual image that is preferably displayed to the user so as to extend along the road surface 40, or The virtual image is preferably displayed superimposed on the road surface 40. In other words, it is a virtual image that is preferably displayed as a tilted image.

On the other hand, it is preferable that the first virtual image (vehicle speed display virtual image SP) be a standing image that gives the user a standing visual sensation, as if directly facing (facing) the user. By selectively using the upright image and the tilted image depending on the visual properties of the display object, the first and second display objects can be displayed with natural perspective.

Furthermore, although there is no particular definition regarding "stereoscopic image" and "tilted image," if expressed objectively, in the example of FIG. 2(B), the first virtual image V1 is The second virtual image θ2 is displayed at a first angle θ1 with respect to the road surface 40 on which the vehicle 1 is traveling, and the second virtual image θ2 is displayed at a second angle θ2 with respect to the road surface on which the vehicle 1 is traveling. This means that the second angle θ2 may satisfy 45°<θ1≦90°, and the second angle θ2 may satisfy 0≦θ2≦45°.

In this case, 45°, which is half of the right angle (90°), is used as the threshold angle for distinguishing between a standing image and a tilted image, and θ1 and θ2 are divided depending on whether they are less than 45° or greater than 45°. . Further, θ1 may have an angle of 90° with the road surface 40 (perpendicular to the road surface), and θ2 may have an angle of 0° with the road surface (superimposed on the road surface). By selectively using a standing image and a tilted image, a variety of displays can be displayed simultaneously with a natural sense of perspective.

For example, by dividing a virtual image into multiple parts and assigning an appropriate lateral (horizontal) resolution to each virtual image, you can create a display with depth, display more text information, and make them look unnatural. This makes it possible to display images without any need for information. This makes it possible to display a variety of high-quality three-dimensional virtual images on the HUD, which has been difficult with the prior art, and achieves higher functionality of the HUD device. Furthermore, even if an error occurs when installing a stereoscopic display device, for example, it is possible to adjust the position of the light emitting pixels in the display unit (flat panel display, etc.) 210 by shifting the position where the image is generated. In addition to relaxing tolerances, manufacturing costs can also be reduced.

Next, refer to FIG. FIG. 3(A) is a diagram showing a configuration example of a stereoscopic display device, and FIG. 3(B) is a diagram showing the display principle of a virtual image (stereoscopic virtual image) in a HUD device using the stereoscopic display device.

In FIG. 3A, an image for the right eye (parallax image) QR and an image for the left eye (parallax image) QL are displayed on a display surface 211 of a flat panel display (liquid crystal display device, etc.) 210. Note that the "parallax image" is an image that reproduces the parallax (difference between images perceived by each eye) caused by the left and right eyes being in different positions.

When the light emitting side of the display section 210 is the front side, an optical member (indicated by the symbol RS in the example of FIG. 3A) is arranged in front of the display section 210. The optical member RS functions as a light beam separating member, and can be specifically constituted by a lenticular lens 220 or a parallax barrier 225, as shown on the upper left side. However, these are examples and are not limited to these. The lenticular lens will be described later.

Further, a parallax barrier is one in which, for example, narrow strip-shaped (rectangular) shielding objects 225a to 225n are arranged at a predetermined pitch in the lateral direction while providing gaps (slits) SL. Even if it is an image, by blocking part of the image display light with a blocking object, different image display light (directional display light) is generated for each eye. It is similar to a lenticular lens in that it separates light rays for each eye. However, since the light is blocked, the image may become somewhat dark, so lenticular lenses are more advantageous in this respect.

By using a lenticular lens or a parallax barrier, which is said to be the mainstream technology in the current 3D display field, as an optical member, the quality of displayed images can be stably maintained.

The light separated by the optical member RS having a beam separation function (reproduction light E(L1), E(R1) for each eye that reproduces the image) is transmitted to the binoculars AL and AR located at the light imaging point. When light enters, a person sees an apparent three-dimensional image IM (specifically, M(V1), M shown in FIG. 2(A) (V2) etc.) are visible. In other words, this can also be seen as the stereoscopic image IM being generated by the 3D display. Note that in the example of FIG. 3(A), the convergence angle is θc.

Refer to FIG. 3(B). In FIG. 3(B), an eyebox EB is set in front of a viewer (such as a driver of a vehicle), and an eyepoint EP(C) is located at the center of the eyebox EB. Assuming that virtual imaging planes PS (L) and PS (R) corresponding to the left and right eyes are set in front of the windshield 2, the virtual image V (C) is located in the center of the overlapping area. . The convergence angle of the virtual image V(C) is θd, and the virtual image V(C) is recognized by the viewer (user) as a three-dimensional image.

This three-dimensional virtual image V(C) is displayed (formed) as follows. That is, the optical system of the HUD device includes reproduction lights e(L1) and e(R1) for the left and right eyes of the virtual stereoscopic image IM generated by the 3D display shown in FIG. 3(A). The reflected light is reflected by a curved mirror (concave mirror, etc.) 171 (the number of reflections is at least once), and is thereby projected (projected) onto the windshield 2 as display light E (L1) and E (R1). reaches both eyes of the viewer and forms an image in front of the windshield 2, whereby a virtual image V(C) is displayed (formed).

Next, refer to FIG. 4. FIG. 4(A) is a diagram for explaining the reproduction of light rays of a three-dimensional image in a three-dimensional display device using a flat panel display (display part) and a lenticular lens (optical member), and FIG. FIG. 2 is a diagram showing an example of the configuration of a stereoscopic display device having two light beam separation sections with different resolutions.

In FIG. 4A, a 3D display unit (stereoscopic display unit) 230 is in contact with or in close proximity to a display unit (such as a flat panel display) 210 that includes a display surface 215 that displays a parallax image. A lenticular lens 220 is arranged as an optical member and has a light beam separation function of separating each light beam of the left-eye parallax image and the right-eye parallax image.

In the lenticular lens 220 as an optical member, a plurality of cylindrical lenses F1 to Fn as optical elements are arranged (arranged) at a predetermined pitch along the lateral direction (direction W in FIG. 4(B)). It is constructed by forming a horizontally periodic lens array structure. The cylindrical lens (F1 to Fn) as an optical element is a flat surface through which light passes, and a spherical lens (however, an aspherical lens) on the front surface, when the display unit 210 side is the rear side and the opposite side is the front side. It is a vertically elongated cylindrical lens (cylindrical lens). In the example of FIG. 4(A), the curvature of the spherical surface of the lens is uniform.

Note that the above-mentioned “lateral direction W (see FIG. 4(B))” is the horizontal direction in the stereoscopic display device, and this “lateral direction W” is the horizontal direction of the HUD device 101 in the width direction of the vehicle 1 (horizontal direction, x direction). Further, the "vertical direction H (see FIG. 4(B))" is a direction perpendicular to the lateral direction, and is a direction corresponding to the height direction (y direction) of the vehicle 1 of the HUD device 101.

The display unit 210 displays pixels L (L1 to Ln) of the image for the left eye (parallax image) and pixels R (R1 to Rn) of the image for the right eye (parallax image) horizontally on the display surface 215. It has a configuration in which a two-dimensional image plane consisting of a plurality of pixels is formed by arranging the pixels alternately in the direction to form pixel rows and also arranging the pixel rows in the vertical direction (see also FIG. 5).

In FIG. 4A, each of the left eye pixels (L pixels) L1 to Ln is arranged (formed) at a position corresponding to the left half of each of the cylindrical lenses F1 to Fn as optical elements. Each of the right-eye pixels (R pixels) R1 to Rn is arranged (formed) at a position corresponding to the right half of each of the cylindrical lenses F1 to Fn as optical elements. Note that one pixel further includes R (red), G (green), and B (blue) subpixels.

As previously explained with reference to FIG. 3(A), if the human eyes AL and AR are located at the light imaging points 911 and 913 in front of the 3D display unit 230, the location where the light rays converge is , the stereoscopic image IM can be visually recognized. In FIG. 4A, E(L4) to E(L6) are shown as the reproduced lights of the left eye pixels L4 to L6, and E(R4) to E(R4) are shown as the reproduced lights of the right eye pixels R4 to R6. (R6) is shown.

Next, refer to FIG. 4(B). In the lenticular lens 220 shown in FIG. 4(B), first optical elements (cylindrical lenses) F1a to F8a that refract light are arranged at a first pitch CW1 along the lateral direction. It has a first light beam separation section (in other words, a first lenticular lens section) 220a having a resolution of 1.

Further, when the direction perpendicular to the horizontal direction is defined as the vertical direction, the position in the vertical direction is different from the first beam separating section 220a (specifically, at a predetermined distance below the first beam separating section 220a). The second optical elements F1b to F4b, which refract light, are arranged at a second pitch CW2 (here, a position apart from the DH) and which is larger than the first pitch CW1 along the lateral direction. CW2 is twice as large as CW1), so that the resolution in the lateral direction is a second beam separation section (in other words, a second lenticular beam) having a second resolution lower than the first resolution. lens portion) 220b. In the example of FIG. 4B, the resolution of the first beam separation section 220a is set to twice the resolution of the second beam separation section 220b.

Note that the above-mentioned "pitch" is, for example, the distance from the center position of one cylindrical lens to the center position of an adjacent cylindrical lens.

Further, in FIG. 4(B), reference numeral 210a indicates a first display section corresponding to the first light beam separation section (first lenticular lens section) 220a. Further, reference numeral 210b indicates a second display section corresponding to the second light beam separation section (second lenticular lens section) 220b.

Further, in FIG. 4(B), the reference numeral 215a indicates the display surface of the first display section 210a, and the reference numeral 215b indicates the display surface of the second display section 210b.

In this way, by making the resolutions in the lateral direction of the first and second beam separation members (lenticular lens parts) 220a and 220b different, a virtual image with relatively high sharpness (resolution) (as shown in FIG. 1(A)) is created. Even when a first virtual image V1) and a relatively low virtual image (second virtual image V2 in FIG. 1A) are displayed simultaneously, the user is given a natural sense of perspective, and the eyes fatigue is also reduced.

Next, refer to FIG. 5. FIG. 5 is a diagram showing a configuration example of a control unit (including a display control unit) in a stereoscopic display device, a pixel configuration, etc. in a display unit (flat panel display).

In FIG. 5 , the display control unit 300 includes an image generation unit (left eye/right eye parallax image generation unit) 310 .

The display control unit 300 controls the image generation unit 310 to display a first display target on the display surface 215a of the first display unit 210a corresponding to the first beam separation unit (first lenticular lens unit) 220a. The left eye parallax image GLa and the right eye parallax image GRa (for example, the image of the vehicle speed display in FIG. 1(A)) are displayed.

On the other hand, on the second display surface 215b of the second display section 210b corresponding to the second beam separation section 220b, a second display object whose clarity in stereoscopic viewing may be lower than that of the first display object is displayed. The left eye parallax image GLb and the right eye parallax image GRb (for example, the image of the navigation arrow or the image of the sign in FIG. 1(A)) are displayed.

Here, in the above expression, it is written that "the left-eye parallax image GLa and the right-eye parallax image GRa are displayed on the display surface 215a of the first display unit 210a", but this does not mean " In other words, the left-eye parallax image GLa and the right-eye parallax image GRa are displayed in the first region Z1 (indicated by a broken-line ellipse in FIG. 5) of the display surface 215 of the display unit 210. can. Both are equivalent in content.

Similarly, the phrase "on the second display surface 215b corresponding to the second display section 210b" means "on the second area Z2 of the display surface 215 of the display section 210 (indicated by a dashed ellipse in FIG. 5)". ) can be rephrased as "to". Both are equivalent in content.

Further, in FIG. 5, on the display surface 215a of the first display section 210a, pixels PXa consisting of RGB sub-pixels are arranged in the row direction and the column direction, thereby creating a two-dimensional pixel surface (image display surface) is formed. Furthermore, on the display surface 215b of the second display section 210b, pixels PXb (the pixel size in the horizontal direction is twice that of PXa) consisting of RGB sub-pixels are arranged in the row and column directions. This forms a two-dimensional pixel surface (image display surface).

Next, refer to FIG. 6(A) and 6(B) are diagrams showing display examples when a virtual image is displayed so as to stick to the road surface, and FIGS. 6(C) to 6(E) are diagrams showing display examples in which a virtual image is displayed so as to stick to the road surface. FIG. In FIG. 6, the same reference numerals are given to parts common to those in the above-mentioned drawings. FIG. 6 shows an example in which the present invention is applied to a technology called road surface HUD (road surface superimposed HUD) that displays a virtual image superimposed on a road surface.

In the example of FIG. 6(A), the second virtual image V2 is displayed extending horizontally overlapping the road surface 40.

Further, in the example of FIG. 6(B), the second virtual image V2 is set near the road surface 40 with a slight inclination.

Further, in the example of FIG. 6(C), in the virtual image display area 3 of the windshield 2, a vehicle speed display SP as the first virtual image V1 is displayed on the right side, and a vehicle speed display SP as the first virtual image V1 is displayed on the left side in the traveling direction of the vehicle 1. A navigation arrow 71 that urges a left turn is displayed, extending from the front side to the back side along the screen.

Since the vehicle speed display SP is displayed as the first virtual image V1, it has high clarity and excellent visibility. Further, the navigation arrow 71 has a base end 71a on the side closer to the vehicle 1, and a tip end 71b on the far side. The proximal end portion 71a is clearly displayed as the first virtual image V1, and the distal end portion 71b is displayed as the second virtual image V2 in a blurred manner with slightly reduced clarity. Therefore, a display with a natural sense of perspective is achieved over a considerable wide range.

In the example of FIG. 6(D), a vehicle guidance display 73 is displayed superimposed on the road surface 40. The vehicle guidance display 73 has a base end 73a and a tip end 73b. The proximal end portion 73a is clearly displayed as a first virtual image V1, and the distal end portion 73b is displayed as a second virtual image V2 in a blurred manner with slightly reduced clarity. Therefore, a display with a natural sense of perspective is achieved over a considerable wide range.

In the example of FIG. 6E, a sign 75 is displayed in the far upper right corner, and a circular mark 78 indicating an expressway exit 77 is displayed on the left side in front of the sign 75.

Further, at a certain point in time, a vehicle guidance sign 79 indicating an exit (EXIT) is superimposed on the road surface 40 and displayed as a second virtual image V2. As time passes (in other words, as the vehicle 1 advances), the sign 79 moves closer to the vehicle 1. As the sign 79 moves, the sign 79 comes to be displayed as the first virtual image V2 and its clarity increases, giving the user a natural and easy-to-see vision.

On the other hand, there is a circular mark 78 indicating the exit (exit) 77 of the expressway, but if the user is unable to enter at exit 77 and passes by, the user will have to go to the next exit and come back again, which is a huge burden. Therefore, this driving scene is a driving scene with high severity (or urgency). This circular mark is displayed as a second virtual image.

Here, if it is better to display the circular mark 78 clearly even if the exit 77 is far away, the display control unit 300 performs image processing on the circular mark 78 individually. , image processing to create a clear virtual image without blurring (for example, a virtual image with a resolution equivalent to or higher than the first virtual image V1), or image processing to emphasize circular marks (in other words, to reduce blurring). display control) may also be implemented.

For example, in the case of important driving scenes such as those mentioned above, or when displaying a caution mark to notify of an obstacle in the distance (in the case of danger warning), or when notifying an exit of an expressway. In the case of a highly important display such as the above, it is thought that the display control unit 300 will increasingly perform individual image processing and perform individual image correction to increase clarity. Even in this case, since the image processing is done individually, the load on the image processing software and hardware does not increase significantly, so no problem occurs.

Next, refer to FIG. FIG. 7(A) is a diagram showing an example of the system configuration of the HUD device, and FIG. 7(B) is a diagram showing an example of the configuration of the display control section. In FIG. 7, the same reference numerals as possible are attached to the light beam separation portions that are common to the previous figures.

The system shown in FIG. 7A includes a display control unit (display control device) 300 included in the control unit 290, an object detection unit 801, a vehicle information detection unit 803, and the like shown in FIGS. The stereoscopic display device 230 (including the display section (display) 210) shown in FIG.

The display control unit (display control device) 300 includes an I/O interface 741, a processor 742, and a memory 743. The display control unit (display control device) 300, the object detection unit 801, and the vehicle information detection unit 803 are connected to a communication line (BUS, etc.).

Further, the first actuator 177 and the second actuator 179 can be used as the rotating section (rotating mechanism) 175 and the adjusting section 173 shown in FIG. 2(A). These can also be called an optical system or an adjustment system for the display section.

Further, the object detection unit 801 can be configured with, for example, an external sensor, an external camera, etc. provided in the vehicle 1. The vehicle information detection unit 803 may include, for example, a speed sensor, a vehicle ECU, an external communication device, a sensor that detects the position of the eyes, a yaw rate sensor that detects the pitch angle (inclination angle) of the vehicle 1, or a height sensor. It can be configured by The display control unit (display control device) 300 performs, for example, image processing to individually adjust the degree of blurring of the display target based on the detection information of the target object detection unit 801 and the information from the vehicle information detection unit 803. It is preferable to implement this method to achieve both display of appropriate perspective and reliable notification of information to the user.

Further, one or more processors 742 may, for example, acquire positional information on the road surface 40, drive at least one of the first and second actuators 177 and 179 based on the acquired information, and drive the virtual image. It is also possible to adjust the display position, etc.

Refer to FIG. 7(B). As shown in FIG. 7B, the display control unit (display control device) 300 includes an image generation unit (left eye/right eye parallax image generation unit) 310 and an image storage unit (image database) 312. , a left eye image buffer 332, a right eye image buffer 334, and an image interface (I/F) 336. The image storage unit (image database) 302 stores parallax image samples and the like corresponding to the virtual image display distance for the display target. The image generation unit 310 reads out the parallax image sample, makes fine adjustments as appropriate, and generates a parallax image to be displayed. The parallax images are temporarily stored in the image buffers 332 and 334 for the left and right eyes, and then displayed on the display unit ( display) 210.

The vehicle 1 is also equipped with a pupil detection camera 900 that captures images of the user's eyes, and a line-of-sight position detection unit 902 that detects the user's viewpoint position (see FIG. 8 for the overall configuration). Information on the viewpoint position detected by the line-of-sight position detection unit 902 is supplied to the image generation unit 310 as appropriate. The image generation unit 310 can finely adjust each left-eye/right-eye parallax image based on the information on the viewpoint position.

Next, refer to FIG. FIG. 8 is a diagram showing an example of the overall configuration of the HUD device. The same parts as in the previous figure are given the same symbols. Further, although an optical system 52 is provided in FIG. 8, a configuration similar to that shown previously in FIG. 2(A) may be adopted as the configuration of this optical system 52. Further, regarding the internal configuration of the optical system 52, the same reference numerals are given to the same parts as the configuration shown in FIG. 2(A).

In the example of FIG. 8, an optical system 52, a driving scene determination unit 19 having an image processing unit 21 that performs image processing based on an image captured by the front imaging camera 17, and a navigation unit (navigation ECU) 400 are provided. .

The optical system 52 includes a display unit (such as a flat panel display) 210 having a display surface 215 on which an image is formed, and a lenticular lens (comprising at least two light beam separation units with different resolutions) 220 as an optical member. It has a stereoscopic display device 230 and a curved mirror (concave mirror) 171. The display light K (corresponding to the light rays E1 to E3 in FIG. 2A) is emitted from the optical system 52 toward the windshield (reflective translucent member 2), and as a result, the resolution is different as described above. First and second virtual images V1 and V2 are displayed.

The display control unit 300 operates with an image interface (I/F) 336, a drive unit 33, a virtual image display position control unit 34, and an image generation unit 310 to determine the appropriate resolution of the display target and to A display target attribute determination unit 36 determines which virtual image is preferable to display, or determines its importance, urgency, etc.; and a various information acquisition unit 39 (the pitch angle of the vehicle 1). (including a pitch angle acquisition unit 38 that acquires the pitch angle by calculation or the like).

Further, the pupil detection camera 900 images the eyes of the user 22, and the viewpoint position detection unit 902 detects the viewpoint position of the user 22 based on the pupil imaging information. Information on the detected viewpoint position is supplied to the image generation unit 310 as appropriate.

The navigation unit (navigation ECU) 400 includes a depth mapping unit 402, a navigation information (road guide information, road sign information, etc.) generation unit 404, a driving route information acquisition unit 406, an own vehicle position information acquisition unit 408, and a map generation unit 404. It includes an information acquisition section 410 and a storage section 412 (functioning as a database of maps, road guide information, road signs, etc.). The navigation unit (navigation ECU) 400 is supplied with vehicle information and the like collected by the in-vehicle ECU 700 via a bus (BUS).

Further, the communication unit 500 may transmit various information acquired through wireless communication with a driving support system 600 installed outside the vehicle 10 (or an ADAS system installed in another vehicle, etc.) as appropriate to the navigation system. The information may be supplied to the own vehicle position information acquisition section 408 and the map information acquisition section 410 of the section 400. Further, the position information etc. received by the GPS reception unit 502 from the GPS satellites may be supplied to the host vehicle position information acquisition unit 408 and the map information acquisition unit 410 of the navigation unit 400 as appropriate.

The vehicle 1 is also provided with various sensors 505 (including a yaw rate sensor for pitch angle detection, etc.). Further, various types of information collected by the in-vehicle ECU 700 are supplied to the navigation section 400 via the BUS, and some of the various information (indicated by reference numeral J0) is transmitted to the pitch angle acquisition section 38 and various information acquisition section 38. It is also supplied to section 39. The information J0 can also include danger information in front, behind, around the vehicle, etc. in the current driving scene, and the results of determining the importance of information to be notified to the user.

The display control unit 300 refers to the information on the degree of danger and the degree of importance, and increases the resolution (clarity) of a display regarding an event with a high degree of danger or importance, regardless of the distance of the display. It is also possible to provide accurate and quick information to the user by performing special emphasis processing. Further, when it is determined that the user's visibility is lower than usual due to bad weather, etc., image processing such as increasing the sharpness of the virtual image display can be performed as appropriate.

In the display control unit 300, the pitch angle acquisition unit 38 included in the various information acquisition unit 39 determines the pitch angle of the vehicle 1 based on the image information supplied from the image processing unit 21, the information of various sensors supplied from the in-vehicle ECU 700, etc. The current pitch angle (in other words, the inclination of the vehicle 1) of the vehicle 1 is calculated.

Further, when it is determined that the vehicle 1 is approaching an uphill slope (or a downhill slope), for example, based on information provided from the driving scene determination unit 19, the virtual image display position control unit 34 adjusts the pitch angle, etc. Taking this into consideration, the display position of the virtual image (relative position to the road surface) is adjusted (corrected). Furthermore, the display position of the virtual image is adjusted as appropriate based on the depth information of the information image (navigation information, etc.) to be displayed, which is supplied from the navigation unit (navigation ECU) 400.

The image generation unit 35 generates a parallax image (original parallax image) to be displayed on the display surface 165 based on various input information. The generated parallax image (original parallax image) is supplied to the image I/F 336. The image I/F 336 supplies data cv of the parallax image (original parallax image) to the display unit 210 of the optical system 52. Further, the drive unit 33 supplies, for example, a control signal rvs for rotating the curved mirror (concave mirror) 170 to an actuator (at least one of the symbols 177 and 179 in FIG. 7(A)).

Next, refer to FIG. FIG. 9 is a flowchart illustrating an example of the procedure of display processing by the display control unit.

First, the pitch angle of the vehicle is acquired (step S1). Next, the display position of the virtual image is adjusted (corrected) in consideration of the pitch angle (tilt angle) of the vehicle, etc. (step S2).

Subsequently, the process of step S3 is executed. In step S3, the first virtual image V1, which is preferably of high resolution (and is a standing image), is displayed on the display surface 215a (first region Z1) corresponding to the first beam separation section 220a. Further, a second virtual image V2, which is preferably a relatively low resolution (and tilted image), is displayed on the display surface 215b (second region Z2) corresponding to the second beam separation section 220b (see FIG. 5). ). In addition, even for the second virtual image V2, if it should be displayed clearly in terms of importance and urgency, the resolution (clarity) is individually improved through image processing (resolution increase processing, emphasis processing, etc.) .

As explained above, according to the embodiments of the present invention, for example, even when a display that is close to the own vehicle and a display that is far away are displayed at the same time, the user can compare and view them. The clarity of the display is not uniform, but the display is naturally blurred depending on the distance, which does not cause discomfort and can reduce eye fatigue.

In addition, even when one display approaches the own vehicle over time (display movement control), the user can compare the past display with the current display, so in the above case However, according to this embodiment, a natural sense of perspective can be obtained, and the same effect as in the above case can be obtained, and no particular problem occurs.

Furthermore, according to the embodiments of the present invention, by using both a high-definition display and a naturally blurred display, a variety of displays are possible, and the expressive power (or production power) of the HUD device is improved. is also possible.

As described above, according to the embodiments of the present invention, there is provided a three-dimensional display device (3D display) capable of viewing a three-dimensional image with reduced discomfort caused by perspective, etc., without increasing the burden on the display control unit, and the same. It is possible to provide a HUD device using

In this specification, the term vehicle can also be broadly interpreted as a vehicle. In addition, terms related to navigation (for example, signs, etc.) shall be interpreted in a broad sense, taking into account, for example, the perspective of navigation information in a broad sense that is useful for vehicle operation. Further, HUD devices include those used as simulators (for example, aircraft simulators). Further, the types of the display section and optical members are not limited to those in the above embodiments, and various types can be adopted.

The invention is not limited to the exemplary embodiments described above, and those skilled in the art will be able to easily modify the exemplary embodiments described above to the extent that they fall within the scope of the claims. .

DESCRIPTION OF SYMBOLS 1... Vehicle (own vehicle), 2... Reflective transparent member (windshield etc.), 3... Virtual image display area, 7... Steering wheel, 9... Operating unit, 11... Front panel, 13...Display device (display panel, etc.), 17...Front imaging camera, 19...Driving scene determination unit, 21...Image processing unit, 22...User, 336...Image I/F, 33...Drive unit, 34...Virtual image display position control unit, 310...Image generation unit, 36...Display target attribute determination unit, 38...Pitch angle acquisition unit, 39. ...Various information acquisition unit, 40... Road surface, 52... Optical system, 101... HUD device (stereoscopic HUD device), 210... Display unit (flat panel display, etc.), 210a. ...first display section, 210b...second display section, 215...display surface, 215a...first display surface, 215b...second display surface, 220...optics Lenticular lenses as members, 220a...first light beam separation section (lenticular lens section), 220b...second light beam separation section (lenticular lens section), 230...stereoscopic display section (3D display section) , 231... Stereoscopic display device (3D display), 171... Curved mirror (concave mirror, etc.), 290... Control section, 300... Display control section (display control device), 400... Navigation section (Navigation ECU), 500...Communication unit, 502...GPS reception unit, 505...Various sensors, 600...Driving support system, 700...In-vehicle ECU, Z1...No. 1 area, Z2... second area of the display surface, RS... optical member (stereoscopic optical member), V1... first virtual image, V2... second virtual image, GL... Parallax image for left eye, GR... parallax image for right eye

Claims (7)

A head-up display (HUD) device that projects display light onto a reflective transparent member provided on a vehicle, and generates and displays a virtual image using the light reflected by the reflective transparent member,
Provides stereoscopic vision by projecting parallax images onto the user's eyes,
a display unit including a display surface that displays the parallax image;
disposed in contact with or in close proximity to the display unit, and has a light beam separation function that separates each light beam of a left-eye parallax image and a right-eye parallax image;
a first beam separation section in which first optical elements that refract light are arranged at a first pitch in the lateral direction and have a first resolution in the lateral direction;
When the direction orthogonal to the horizontal direction is defined as the vertical direction, a light beam separating section that is arranged at a different vertical position from the first beam separating section and that refracts the light, along the horizontal direction, a second light beam separating section arranged at a second pitch larger than the first pitch, so that the resolution in the lateral direction is a second resolution lower than the first resolution; an optical member;
controlling image display on the display unit;
displaying a left-eye parallax image and a right-eye parallax image of a first display target in a first region of the display surface corresponding to the first light beam separation section;
A left-eye parallax of a second display object, which may have lower clarity in stereoscopic vision than the first display object, is provided in a second region of the display surface corresponding to the second light beam separation section. a display control unit that displays an image and a right-eye parallax image, a stereoscopic display device comprising:
an optical system of a HUD device having at least one light reflecting member and reflecting light from the stereoscopic display device at least once and projecting the reflected light onto the reflective transmissive member as the display light;
has
Regarding the first display object obtained as a result of the light separated through the first light beam separating section in the stereoscopic display device being reflected by the optical system of the HUD device and the reflective translucent member. Let the virtual image of be the first virtual image,
Regarding the second display object obtained as a result of the light separated through the second light beam separating section in the stereoscopic display device being reflected by the optical system of the HUD device and the reflective translucent member. When the virtual image of is the second virtual image,
A first convergence angle based on the left and right eyes of the user at the end point of the first virtual image farthest from the vehicle is θa, and the user at the end point of the second virtual image closest to the vehicle A head-up display device characterized in that θa>θb, where θb is a second convergence angle with respect to each of the left and right eyes. The difference between the minimum and maximum possible convergence angles for the first virtual image is a first difference, and the second difference is the difference between the minimum and maximum possible convergence angles for the second virtual image. The head-up display device according to claim 1 , wherein the second difference is larger than the first difference. The first virtual image is a virtual image that is preferably displayed directly facing the user,
The second virtual image is preferably a virtual image that is preferably displayed to the user so as to extend along the road surface, or a virtual image that is preferably displayed so as to be superimposed on the road surface. The head-up display device according to claim 1 or 2 . The first virtual image is displayed at a first angle θ1 with respect to the road surface on which the vehicle is traveling,
the second virtual image is displayed at a second angle θ2 with respect to the road surface on which the vehicle is traveling;
The first angle θ1 satisfies 45°<θ1≦90°,
The head-up display device according to any one of claims 1 to 3 , wherein the second angle θ2 satisfies 0≦θ2≦45°. The first display target is an information image that is at least one of information about the vehicle, information about the surroundings of the vehicle, and navigation information, including at least one of characters, graphics, and symbols;
5. The second display target is an information image including an arrow figure or a figure other than an arrow regarding the progress of the vehicle or another vehicle . head-up display device. The head-up device according to any one of claims 1 to 5 , wherein the display control unit executes display control to move the second virtual image closer to the vehicle over time. display device. When it is determined that the second display target includes information with a higher degree of urgency or importance than usual, the display control unit displays a left-eye parallax image and a right-eye parallax image of the second display target. When displaying a parallax image in the second area of the display surface, the left-eye parallax image and the right-eye parallax image of the second display target are subjected to image processing to suppress a decrease in resolution. A head-up display device according to any one of claims 1 to 6 .

Images