CN114019697B - Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof - Google Patents
Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof Download PDFInfo
- Publication number
- CN114019697B CN114019697B CN202111385907.0A CN202111385907A CN114019697B CN 114019697 B CN114019697 B CN 114019697B CN 202111385907 A CN202111385907 A CN 202111385907A CN 114019697 B CN114019697 B CN 114019697B
- Authority
- CN
- China
- Prior art keywords
- pupil
- area
- path channel
- entrance pupil
- waveguide
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002441 reversible effect Effects 0.000 title claims abstract description 61
- 239000011521 glass Substances 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 20
- 210000001747 pupil Anatomy 0.000 claims abstract description 230
- 210000001508 eye Anatomy 0.000 claims abstract description 77
- 230000003287 optical effect Effects 0.000 claims abstract description 57
- 238000003384 imaging method Methods 0.000 claims abstract description 50
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 14
- 230000008859 change Effects 0.000 claims abstract description 9
- 230000002911 mydriatic effect Effects 0.000 claims description 8
- 239000004065 semiconductor Substances 0.000 claims description 8
- 230000000295 complement effect Effects 0.000 claims description 4
- 229910044991 metal oxide Inorganic materials 0.000 claims description 4
- 150000004706 metal oxides Chemical class 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000000007 visual effect Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 4
- 208000006550 Mydriasis Diseases 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C7/00—Optical parts
- G02C7/02—Lenses; Lens systems ; Methods of designing lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Ophthalmology & Optometry (AREA)
- Optics & Photonics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Otolaryngology (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses a reverse light path channel waveguide assembly, AR glasses and a brightness adjusting method thereof, wherein the reverse light path channel waveguide assembly comprises a waveguide body, and a forward light path channel and a reverse light path channel are arranged on the waveguide body; an imaging device for shooting human eye state images is arranged on the outer side of the waveguide body; the forward optical path channel comprises a first entrance pupil area arranged above the waveguide body, a pupil expansion area which is positioned at the same horizontal height as the first entrance pupil area, and a first exit pupil area arranged below the pupil expansion area; the reverse optical path channel comprises a second entrance pupil area which is arranged in the first exit pupil area and is close to the first entrance pupil area, and a second exit pupil area which is arranged below the first entrance pupil area. According to the embodiment of the invention, the fixation point of human eyes is positioned through the imaging device, so that eyeball tracking is realized; and meanwhile, the change of the size of the pupil is measured, so that the light intensity of a picture displayed in the AR glasses can be automatically adjusted.
Description
Technical Field
The invention relates to the technical field of optical display, in particular to a reverse light path channel waveguide assembly, AR (augmented reality) glasses and a brightness adjusting method thereof.
Background
Along with the higher and higher use experience expectations of people on AR glasses, display brightness, picture position, imaging position, quality and the like can influence the visual experience of human eyes, so that how to improve the display quality of the AR glasses and increase the use function is a direction capable of improving the use experience sense of the AR glasses.
In designing AR glasses, eye tracking is generally used to locate a person's gaze point. The eyeball tracking technology is that the characteristics of an eyeball image are calculated in real time through a customized eyeball tracking sensor, and then the directions of the gaze point and the visual axis of a user are calculated. Therefore, the real-time fixation point rendering can be performed, and the real human eye experience is simulated. In addition, real-time eyeball tracking can be performed to repair distortion and the like generated by eyeball movement. While in locating the gaze point, the AR user interface may be operated directly using the eye.
The AR glasses can sense the ambient light condition through the ambient light sensor, and the AR display brightness is automatically adjusted. However, the brightness of the environment sensed by the ambient light sensor is not necessarily the brightness of the environment seen by the human eyes, and the brightness outside the visual line range of the human eyes can be directly irradiated to the ambient light sensor or the glasses glass, so that the brightness and the ambient light brightness adjusted by the ambient light sensor have large difference, and the virtual picture and the real scene cannot be well fused.
Disclosure of Invention
The embodiment of the invention provides a reverse light path channel waveguide assembly, AR glasses and a brightness adjusting method thereof, aiming at improving the fusion degree of a virtual picture and a real scene.
The embodiment of the invention provides a waveguide assembly of a reverse light path channel, which comprises a waveguide body, wherein a forward light path channel and a reverse light path channel are arranged on the waveguide body; an imaging device for shooting human eye state images is arranged on the outer side of the waveguide body;
the forward optical path channel comprises a first entrance pupil area arranged above the waveguide body, a pupil expansion area which is positioned at the same horizontal height as the first entrance pupil area, and a first exit pupil area arranged below the pupil expansion area; the reverse optical path channel comprises a second entrance pupil area which is arranged in the first exit pupil area and is close to the first entrance pupil area, and a second exit pupil area which is arranged below the first entrance pupil area.
Further, the imaging device is fixedly connected to the waveguide body through a connecting piece.
Further, the imaging device is arranged opposite to the second exit pupil area, and the distance between the center of the imaging device and the center of the second exit pupil area is 1-2 mm.
Further, the second entrance pupil area and the second exit pupil area are rectangular areas with the same size, and the length and the width of the rectangular areas are 3-6 mm;
the centers of the second entrance pupil area and the second exit pupil area are positioned on the same horizontal line, and the center distance is 20-30 mm.
Further, the reverse optical path channel waveguide component is a single-entrance-pupil double-exit-pupil waveguide or a single-entrance-pupil single-exit-pupil waveguide.
Further, a first entrance pupil area in the single entrance pupil double exit pupil waveguide is arranged in the center of the waveguide body, two expansion pupil areas are arranged, the two expansion pupil areas are symmetrically arranged on two sides of the first entrance pupil area, two first exit pupil areas are arranged, and the two first exit pupil areas are respectively arranged below the two expansion pupil areas;
the second entrance pupil areas are arranged in two, the two second entrance pupil areas are respectively arranged at one corner, close to the first entrance pupil areas, of each first exit pupil area, and the second exit pupil areas are arranged below the first entrance pupil areas.
Further, a first entrance pupil area and a pupil expansion area in the single entrance pupil and single exit pupil waveguide are positioned at the same horizontal height, and the first exit pupil area is arranged below the pupil expansion area;
the second entrance pupil area is arranged at one corner, close to the first entrance pupil area, in the first exit pupil area, and the second exit pupil area is arranged below the first entrance pupil area and is at the same horizontal height with the second entrance pupil area.
Further, the imaging device is any one of a charge coupled device image sensor, a complementary metal oxide semiconductor or an N-type metal-oxide-semiconductor.
The embodiment of the invention also provides AR glasses, which adopts the reverse optical path channel waveguide assembly.
The embodiment of the invention also provides a brightness adjusting method adopting the AR glasses, which comprises the following steps:
shooting a human eye state image by using an imaging device;
calculating according to the human eye state image to obtain the human eye pupil diameter D and the picture brightness L in the pupil;
the ratio of the internal luminous intensity I1 of the AR glasses to the external ambient luminous intensity I2 is calculated as follows:
I1/I2＝4*I1/(L*D2-4*I1)
and adjusting the internal luminous intensity I1 of the AR glasses according to the ratio to ensure that the ratio meets 2.5> I1/I2>1.5 or 2.5> I1/I2>1.
The embodiment of the invention provides a reverse optical path channel waveguide assembly, AR glasses and a brightness adjusting method thereof, wherein the reverse optical path channel waveguide assembly comprises a waveguide body, and a forward optical path channel and a reverse optical path channel are arranged on the waveguide body; an imaging device for shooting human eye state images is arranged on the outer side of the waveguide body; the forward optical path channel comprises a first entrance pupil area arranged above the waveguide body, a pupil expansion area which is positioned at the same horizontal height as the first entrance pupil area, and a first exit pupil area arranged below the pupil expansion area; the reverse optical path channel comprises a second entrance pupil area which is arranged in the first exit pupil area and is close to the first entrance pupil area, and a second exit pupil area which is arranged below the first entrance pupil area. According to the embodiment of the invention, on the basis of the forward light path channel and the reverse light path channel, the imaging device is used for detecting the state of a user in the process of using the AR glasses, and positioning the fixation point of human eyes, so that eyeball tracking is realized; simultaneously, the imaging device is used for shooting the state of human eyes, the change of the size of pupil holes can be measured, then the light intensity of a display picture in the AR glasses can be automatically adjusted according to the change of the pupil holes, so that the AR glasses are better fused with the environment and are comfortable for human eyes, and the problem that an ambient light sensor automatically adjusts light under the condition that bright light outside the visual line of the human eyes irradiates a sensor or glasses glass but does not irradiate the human eyes can be solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a reverse optical path channel waveguide assembly according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of another structure of a reverse optical path waveguide assembly according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a light propagation vector in a reverse optical path waveguide assembly according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a single-entrance-pupil double-exit-pupil waveguide in a reverse optical path channel waveguide assembly according to an embodiment of the present invention;
FIG. 5 is another schematic diagram of a single-entrance-pupil dual-exit-pupil waveguide in a reverse-path channel waveguide assembly according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a single-entrance-pupil single-exit-pupil waveguide in a reverse optical path channel waveguide assembly according to an embodiment of the present invention;
fig. 7 is another schematic structural diagram of a single entrance pupil and single exit pupil waveguide in a reverse optical path channel waveguide assembly according to an embodiment of the present invention;
FIG. 8 is another schematic diagram of a single entrance pupil and single exit pupil waveguide in a reverse optical path channel waveguide assembly according to an embodiment of the present invention;
fig. 9 is a flowchart of an AR glasses brightness adjustment method according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be understood that the terms "comprises" and "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
Referring to fig. 1 and fig. 2, a waveguide assembly with a reverse optical path channel according to an embodiment of the present invention includes a waveguide body, where a forward optical path channel and a reverse optical path channel are disposed on the waveguide body; an imaging device 301 for shooting human eye state images is arranged on the outer side of the waveguide body; the forward optical path channel comprises a first entrance pupil area 101 arranged above the waveguide body, a pupil expansion area 102 which is at the same horizontal level with the first entrance pupil area 101, and a first exit pupil area 103 arranged below the pupil expansion area 102; the reverse optical path channel includes a second entrance pupil area 201 disposed within the first exit pupil area 103 and close to the first entrance pupil area 101, and a second exit pupil area 202 disposed below the first entrance pupil area 101.
In this embodiment, the reverse optical path channel waveguide assembly includes a forward optical path channel and a reverse optical path channel; the forward optical path channel is composed of the first entrance pupil area 101, the mydriasis area 102 and the first exit pupil area 103; the reverse optical path channel is composed of the second entrance pupil area 201 and the second exit pupil area 202. According to the principle of reversibility of the light path, light entering human eyes through the waveguide body can also return to the waveguide according to the original path. Thus, in this embodiment, a small rectangular grating (i.e. the second entrance pupil area 201) is disposed in the first exit pupil area 103, and this grating can couple light that is visible to the human eye into the waveguide, and the light with the human eye information propagates through total reflection in the waveguide to the coupling-out grating of the second exit pupil area 202. Subsequently, the light diffracted by the coupling-out grating of the second exit pupil area 202 enters the imaging device 301, and the imaging device 301 and the human eye are respectively located at two sides of the waveguide body (i.e., the imaging device 301 is disposed at the outer side of the waveguide body, and the human eye is located at the inner side of the waveguide body), so that the imaging device 301 can capture the state of the human eye, thereby positioning the gaze point of the human eye, and sequentially measuring the size of the pupil.
The reverse optical path channel waveguide assembly provided in this embodiment is applied to AR glasses, and the light seen by the human eye is led out of the waveguide reversely through the grating by using the reverse optical path channel in the reverse optical path channel waveguide assembly, and enters the external imaging device 301, so that the state of the human eye can be detected in real time, then the characteristics of the eyeball image can be calculated through a program, the gaze point, the direction of the visual axis, and the like of the user are positioned, and the effect of tracking the eyeball of the human eye is achieved. In addition, for the human eye state detected in real time, the change of the size of the pupil is measured according to the shot image, and the AR glasses automatically adjust the intensity of the display image light according to the change of the pupil, so that the AR glasses are better fused with the light intensity of the environment, and human eyes feel comfortable. And can also solve the problem that the ambient light sensor automatically adjusts the light under the condition that the bright light outside the visual line of the human eyes irradiates the sensor or the glasses glass but does not irradiate the human eyes.
The reversibility of the optical path in this embodiment means that the optical path is reversible, that is, light energy is emitted from a to an end point B in one path, and light is reflected from the end point B in the same direction, so that the light also reaches the point a in the same path in the complete reverse direction. As shown in fig. 3, the light diffracted by the exit pupil grating of the first exit pupil area 103 enters the human eye, and the light seen by the human eye can be returned to the first exit pupil area 103, so that the second entrance pupil area 201 of the reverse optical path channel in the upper left corner can receive the light from the human eye state. After the light from the human eye state enters the second entrance pupil area 201 of the reverse optical path along the light propagation vector direction S1, the light diffracted by the diffraction grating on the second entrance pupil area 201 is totally reflected in the waveguide body along the vector direction S2 to the second exit pupil area 202, and the light diffracted by the diffraction grating on the second exit pupil area 202 enters the imaging device 301 along the vector direction S3, so that the imaging device 301 can capture the human eye state.
Referring to fig. 2, in one embodiment, the imaging device 301 is fixedly connected to the waveguide body by a connector 302.
Further, the imaging device 301 is disposed opposite to the second exit pupil area 202, and the distance between the center of the imaging device 301 and the center of the second exit pupil area 202 is 1-2 mm.
The imaging device 301 is any one of a charge coupled device image sensor, a complementary metal oxide semiconductor, or an N-type metal-oxide-semiconductor.
The imaging device 301 of this embodiment may be a CCD (charge coupled device image sensor), a CMOS (complementary metal oxide semiconductor), an NMOS (N-type metal-oxide-semiconductor), or the like, and is located on both sides of the waveguide body with respect to the human eye, and is mounted at a position facing the second exit pupil area 202 through the connection member 302, and the distance between the center of the imaging device 301 and the center of the second exit pupil area 202 is 1-2 mm.
In an embodiment, the second entrance pupil area 201 and the second exit pupil area 202 are rectangular areas with the same size, and the length and the width of the rectangular areas are 3-6 mm;
the centers of the second entrance pupil area 201 and the second exit pupil area 202 are on the same horizontal line, and the center distance is 20-30 mm.
In this embodiment, the second entrance pupil area 201 and the second exit pupil area 202 of the reverse optical path channel both use diffraction gratings (such as surface relief gratings, or volume hologram gratings), and the shapes of the second entrance pupil area 201 and the second exit pupil area 202 are rectangular, and the specific values of the length L and the width H are 3-6 mm, and of course, the length L is greater than the width H. Meanwhile, the center distance between the second entrance pupil area 201 and the second exit pupil area 202 is 20-30 mm, and the centers of the second entrance pupil area 201 and the second exit pupil area 202 are on the same horizontal line.
In an embodiment, the reverse optical path channel waveguide assembly is a single-entry-pupil dual-exit-pupil waveguide or a single-entry-pupil single-exit-pupil waveguide. While the profile of the waveguide may vary depending on the shape of the eyeglass frame.
In an embodiment, as shown in fig. 4, a first entrance pupil area 101 in the single entrance pupil dual exit pupil waveguide is disposed at the center of the waveguide body, two of the mydriatic areas 102 (or 112) are disposed, two mydriatic areas 102 (or 112) are symmetrically disposed at two sides of the first entrance pupil area 101, two of the first exit pupil areas 103 (or 113) are disposed, and two of the first exit pupil areas 103 (or 113) are respectively disposed below the two mydriatic areas 102 (or 112);
the second entrance pupil areas 201 (or 202) are two, the two second entrance pupil areas 201 (or 202) are respectively arranged at one corner, close to the first entrance pupil area 101, of each of the two first exit pupil areas 103 (or 113), and the second exit pupil area 211 (or 212) is arranged below the first entrance pupil area 101.
Referring to fig. 5, the single-entry-pupil dual-exit-pupil waveguide includes a forward optical path channel and a reverse optical path channel; wherein the forward optical path channel is composed of the first entrance pupil area 101, the right-eye mydriasis area 102, the left-eye mydriasis area 112, the right-eye first exit pupil area 103, and the left-eye first exit pupil area 113; the reverse optical path channel is composed of a right eye second entrance pupil area 201, a left eye second optical path entrance pupil area 211, and a second exit pupil area 202 at an intermediate position. The second exit pupil area 202 is provided with an imaging device 301 at a position opposite to the light exit aperture, the imaging device 301 is fixed on the single-entrance pupil double-exit pupil waveguide through a connecting piece 302, the imaging device 301 and human eyes are respectively positioned at two sides of the single-entrance pupil double-exit pupil waveguide and used for shooting the state of the human eyes so as to achieve the purposes of positioning the gaze point of the human eyes, realizing eyeball tracking, measuring the size of the pupil aperture and realizing the effect of pupil dimming.
In an embodiment, as shown in fig. 6, the first entrance pupil area 101 (or 111) and the mydriatic area 102 (or 112) in the single entrance pupil and single exit pupil waveguide are at the same horizontal level, and the first exit pupil area 103 (or 113) is disposed below the mydriatic area 102 (or 112);
the second entrance pupil area 201 (or 211) is disposed in the first exit pupil area 103 (or 113) near a corner of the first entrance pupil area 101 (or 111), and the second exit pupil area 202 (or 212) is disposed below the first entrance pupil area 101 (or 111) and at the same level as the second entrance pupil area 201 (or 211).
In this embodiment, referring to fig. 7 and 8, the single-entrance-pupil single-exit-pupil waveguide includes a forward optical path channel and a backward optical path channel; wherein the forward optical path channel consists of a first entrance pupil area 101 (or 111), a mydriatic area 102 (or 112) and a first exit pupil area 103 (or 113); the reverse optical path channel is composed of a second entrance pupil area 201 (or 211), a second exit pupil area 202 (or 212). And an imaging device 301 (or 311) is arranged at a position, opposite to the light outlet hole, of the second exit pupil area 202 (or 212), the imaging device 301 (or 311) is fixed on the single-entrance-pupil single-exit-pupil waveguide through the connecting piece 302 (or 312), and the imaging device 301 (or 311) and human eyes are respectively positioned at two sides of the waveguide. The imaging device 301 (or 311) and the human eye are respectively located at two sides of the single-entrance pupil and the double-exit pupil waveguide, and are used for shooting the state of the human eye so as to achieve the purposes of positioning the gaze point of the human eye, realizing eyeball tracking, measuring the size of the pupil and realizing pupil dimming.
The light diffracted by the grating of the first entrance pupil area 101 (or 111) enters the human eye, and the light seen by the human eye can be returned to the first exit pupil area according to the reversibility of the optical path, so that the second entrance pupil area 201 (or 211) in the upper left corner (or upper right corner) can receive the light from the human eye state. Light from the human eye state is returned to the second entrance pupil area 201 (or 211) along a forward propagating light path, light diffracted by the diffraction grating on the second entrance pupil area 201 (or 211) is totally reflected in the waveguide to the second exit pupil area 202 (or 212), and light diffracted by the diffraction grating on the second exit pupil area 202 (or 212) is normally incident into the imaging device 301 (or 311), so that the human eye state is photographed by the imaging device 301 (or 311).
Fig. 6 shows a single entrance pupil Shan Chutong waveguide with different shapes applied to AR glasses, and the state of human eyes is photographed by the imaging device 301 (or 311). The known internal luminous intensity of the AR glasses is I1, the luminous intensity of the external environment light is I2, and the I1 can be automatically adjusted. From the pupil image of the human eye captured by the imaging device 301 (or 311), the diameter of the pupil at this time is measured as D, and the brightness of the pupil image of the human eye at this time is calculated and analyzed as L, the ratio I1/i2=4xi1/(l×d2-4×i1) can be calculated according to the pupil diameter D. I1 is automatically adjusted so that the ratio satisfies the condition 2.5> I1/I2>1.5, or 2.5> I1/I2>1, while leaving the pupil at a comfortable diameter size. In addition, if the brightness of the AR glasses is at a maximum value under the condition that the brightness of the external environment is large, a portion of the external light can be blocked by using the sunglasses.
The embodiment of the invention also provides the AR glasses, and the reverse optical path channel waveguide assembly is adopted.
The reverse light path channel waveguide assembly is applied to AR glasses, light seen by human eyes is led out of the waveguide reversely through the grating and enters an external imaging device 301 (or 311) by utilizing a reverse light path channel in the reverse light path channel waveguide assembly, so that the state of the human eyes can be detected in real time, then the characteristics of eyeball images can be calculated through a program, the directions of the fixation point and the visual axis of a user are positioned, and the effect of tracking the eyeballs of the human eyes is achieved. In addition, for the human eye state detected in real time, the change of the size of the pupil is measured according to the shot image, and the AR glasses automatically adjust the intensity of the display image light according to the change of the pupil, so that the AR glasses are better fused with the light intensity of the environment, and human eyes feel comfortable. And can also solve the problem that the ambient light sensor automatically adjusts the light under the condition that the bright light outside the visual line of the human eyes irradiates the sensor or the glasses glass but does not irradiate the human eyes.
The embodiment of the invention also provides a brightness adjusting method adopting the AR glasses, as shown in fig. 9, which specifically comprises the following steps: steps S901 to S904.
S901, capturing a human eye state image with the imaging device 301 (or 311);
s902, calculating according to the human eye state image to obtain the human eye pupil diameter D and the picture brightness L in the pupil;
s903, calculating the ratio of the internal luminous intensity I1 of the AR glasses to the external ambient luminous intensity I2 according to the following formula:
I1/I2＝4*I1/(L*D2-4*I1)
s904, adjusting the internal luminous intensity 1I of the AR glasses according to the ratio to enable the ratio to meet 2.5> I1/I2>1.5 or 2.5> I1/I2>1.
In this embodiment, if the internal luminous intensity of the AR glasses is I1 and the luminous intensity of the external ambient light is I2, I1 can be automatically adjusted. From the pupil image of the human eye captured by the imaging device 301 (or 311), the diameter of the pupil at this time is measured as D, and the brightness of the pupil image of the human eye at this time is calculated and analyzed as L, the ratio I1/i2=4xi1/(l×d2-4×i1) can be calculated according to the pupil diameter D. I1 is automatically adjusted so that the ratio satisfies the condition 2.5> I1/I2>1.5, or 2.5> I1/I2>1, while leaving the pupil at a comfortable diameter size. In addition, if the brightness of the AR glasses is at a maximum value under the condition that the luminous intensity of the external ambient light is large, a portion of the external light may be blocked by using the sunglasses.
In the description, each embodiment is described in a progressive manner, and each embodiment is mainly described by the differences from other embodiments, so that the same similar parts among the embodiments are mutually referred. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section. It should be noted that it would be obvious to those skilled in the art that various improvements and modifications can be made to the present application without departing from the principles of the present application, and such improvements and modifications fall within the scope of the claims of the present application.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. The waveguide assembly of the reverse light path channel is characterized by comprising a waveguide body, wherein the waveguide body is provided with a forward light path channel and a reverse light path channel; an imaging device for shooting human eye state images is arranged on the outer side of the waveguide body;
the forward optical path channel comprises a first entrance pupil area arranged above the waveguide body, a pupil expansion area which is positioned at the same horizontal height as the first entrance pupil area, and a first exit pupil area arranged below the pupil expansion area; the reverse light path channel comprises a second entrance pupil area which is arranged in the first entrance pupil area and is close to the first entrance pupil area, and a second exit pupil area which is arranged below the first entrance pupil area;
the method for measuring the human eye state by adopting the reverse light path channel waveguide assembly and the imaging device is as follows:
the second entrance pupil area of the reverse light path channel couples light rays from the human eye state into the waveguide, then the light rays are totally reflected in the waveguide body to the second exit pupil area, and the light rays coupled out of the second exit pupil area enter the imaging device, and an image of the human eye state is shot by the imaging device;
positioning the fixation point of human eyes, so as to realize eyeball tracking;
and simultaneously, the imaging device is used for shooting the state of human eyes, the change of the size of the pupil can be measured, and then the light intensity of the waveguide display picture can be automatically adjusted according to the change of the pupil.
2. The reverse path channel waveguide assembly of claim 1 wherein said imaging device is fixedly connected to said waveguide body by a connector.
3. The reverse path channel waveguide assembly of claim 2, wherein the imaging device is disposed directly opposite the second exit pupil region and the center of the imaging device is 1-2 mm from the center of the second exit pupil region.
4. The reverse optical path channel waveguide assembly of claim 1, wherein the second entrance pupil region and the second exit pupil region are rectangular regions of the same size, and the length and width of the rectangular regions are 3-6 mm;
the centers of the second entrance pupil area and the second exit pupil area are positioned on the same horizontal line, and the center distance is 20-30 mm.
5. The reverse optical path channel waveguide assembly of claim 1, wherein the reverse optical path channel waveguide assembly is a single-entry-pupil dual-exit-pupil waveguide or a single-entry-pupil single-exit-pupil waveguide.
6. The reverse optical path channel waveguide assembly according to claim 5, wherein a first entrance pupil region in the single entrance pupil double exit pupil waveguide is arranged at the center of the waveguide body, two of the two pupil expansion regions are symmetrically arranged at two sides of the first entrance pupil region, two of the first exit pupil regions are arranged, and the two first exit pupil regions are respectively arranged below the two pupil expansion regions;
the second entrance pupil areas are arranged in two, the two second entrance pupil areas are respectively arranged at one corner, close to the first entrance pupil areas, of each first exit pupil area, and the second exit pupil areas are arranged below the first entrance pupil areas.
7. The reverse optical path channel waveguide assembly of claim 5, wherein a first entrance pupil region and a mydriatic region in the single entrance pupil single exit pupil waveguide are at the same level, the first exit pupil region being disposed below the mydriatic region;
the second entrance pupil area is arranged at one corner, close to the first entrance pupil area, in the first exit pupil area, and the second exit pupil area is arranged below the first entrance pupil area and is at the same horizontal height with the second entrance pupil area.
8. The reverse optical path channel waveguide assembly of claim 1, wherein the imaging device is any one of a charge coupled device image sensor, a complementary metal oxide semiconductor, or an N-type metal-oxide-semiconductor.
9. AR glasses characterized by the use of a reverse path channel waveguide assembly according to any one of claims 1 to 8.
10. A brightness adjustment method using the AR glasses according to claim 9, comprising:
shooting a human eye state image by using an imaging device;
calculating according to the human eye state image to obtain the human eye pupil diameter D and the picture brightness L in the pupil;
the ratio of the internal luminous intensity I1 of the AR glasses to the external ambient luminous intensity I2 is calculated as follows:
I1/I2＝4*I1/(L*D2-4*I1)
and adjusting the internal luminous intensity I1 of the AR glasses according to the ratio to ensure that the ratio meets 2.5> I1/I2>1.5 or 2.5> I1/I2>1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111385907.0A CN114019697B (en) | 2021-11-22 | 2021-11-22 | Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111385907.0A CN114019697B (en) | 2021-11-22 | 2021-11-22 | Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114019697A CN114019697A (en) | 2022-02-08 |
| CN114019697B true CN114019697B (en) | 2023-07-28 |
Family
ID=80065459
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111385907.0A Active CN114019697B (en) | 2021-11-22 | 2021-11-22 | Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114019697B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114694619A (en) * | 2022-04-25 | 2022-07-01 | 广州视享科技有限公司 | Brightness adjusting method and device for intelligent glasses and intelligent glasses |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3324231B1 (en) * | 2016-11-18 | 2023-05-03 | Nokia Technologies Oy | Optical apparatus and method |
| WO2018175776A1 (en) * | 2017-03-22 | 2018-09-27 | Magic Leap, Inc. | Wearable display device utilizing a composite field of view |
| US10393930B2 (en) * | 2017-06-30 | 2019-08-27 | Microsoft Technology Licensing, Llc | Large-field-of-view waveguide supporting red, green, and blue in one plate |
| FI129084B (en) * | 2018-02-06 | 2021-06-30 | Dispelix Oy | Diffractive display element with grating mirror |
| CN108873350A (en) * | 2018-07-24 | 2018-11-23 | 上海鲲游光电科技有限公司 | A kind of waveguide display device |
| CN109116566B (en) * | 2018-09-06 | 2020-08-04 | 北京理工大学 | Near-to-eye display device |
| CN110967166B (en) * | 2018-09-28 | 2022-07-01 | 舜宇光学（浙江）研究院有限公司 | Detection method, detection device and detection system of near-eye display optical system |
| CN110764261B (en) * | 2019-09-18 | 2022-03-11 | 深圳市光舟半导体技术有限公司 | Optical waveguide structure, AR equipment optical imaging system and AR equipment |
| CN111766704B (en) * | 2020-06-19 | 2024-10-25 | 深圳市光舟半导体技术有限公司 | Optical device, display equipment and method for outputting light and displaying image |
| CN112180589B (en) * | 2020-09-18 | 2021-08-27 | 深圳市光舟半导体技术有限公司 | Optical pupil expanding device, display equipment thereof and method for outputting light and displaying image |
| CN113189777B (en) * | 2021-04-25 | 2021-12-14 | 深圳市光舟半导体技术有限公司 | Binocular AR eyepiece vision correction system |
| CN113219671A (en) * | 2021-05-25 | 2021-08-06 | 深圳市光舟半导体技术有限公司 | Optical device and display apparatus |
| CN113406800B (en) * | 2021-06-21 | 2022-10-28 | 东南大学 | Method for automatically adjusting display brightness and color temperature of AR glasses |
| CN113568178B (en) * | 2021-08-06 | 2023-06-23 | 深圳市光舟半导体技术有限公司 | Waveguide sheet model and AR glasses |
-
2021
- 2021-11-22 CN CN202111385907.0A patent/CN114019697B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN114019697A (en) | 2022-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9967555B2 (en) | Simulation device | |
| CN103558909B (en) | Interaction projection display packing and interaction projection display system | |
| US10444481B2 (en) | Prism optical system, prism optical system-incorporated image display apparatus, and prism optical system-incorporated imaging apparatus | |
| US7144113B2 (en) | Virtual image display apparatus | |
| WO2015027599A1 (en) | Content projection system and content projection method | |
| US20090219386A1 (en) | Pupil detection device and pupil detection method | |
| CN102023383A (en) | Spectacles-type image display device | |
| CN106444042A (en) | Dual-purpose display equipment for augmented reality and virtual reality, and wearable equipment | |
| KR20150073853A (en) | Optical see-through glass type display device and corresponding optical unit | |
| KR20170118618A (en) | Eye capturing device | |
| WO2022017447A1 (en) | Image display control method, image display control apparatus, and head-mounted display device | |
| CN114019697B (en) | Reverse light path channel waveguide assembly, AR glasses and brightness adjusting method thereof | |
| CN108985291B (en) | Binocular tracking system based on single camera | |
| WO2016101861A1 (en) | Head-worn display device | |
| JPH08504556A (en) | Method and apparatus for generating a three-dimensional effect in a two-dimensional image | |
| JP2009240551A (en) | Sight line detector | |
| TW202238222A (en) | Reverse pass-through glasses for augmented reality and virtual reality devices | |
| CN212460199U (en) | Head-mounted display device | |
| CN205750141U (en) | A kind of stereo projection display apparatus | |
| US20150335241A1 (en) | Apparatus for obtaining status information of crystalline lens and equipment including the same | |
| CN203275755U (en) | Single screen reflection binocular perspective type optical system | |
| CN116917791A (en) | Reverse perspective glasses for augmented reality devices and virtual reality devices | |
| JP4102410B2 (en) | 3D image display device | |
| CN205750126U (en) | Virtual reality helmet | |
| Järvenpää et al. | Highly integrated near-to-eye display and gaze tracker |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |