JP7171727B2 - Augmented reality display system - Google Patents

Description

The present disclosure relates to apparatus and methods for display systems in augmented reality eyewear.

Head-mounted displays (HMDs) are being developed for a variety of applications, including military, commercial, industrial, firefighting, and entertainment. In many of these applications there is particular value in creating a virtual image that can be visually superimposed on the real image in the HMD user's field of view. Optical image light guides transmit image-bearing light to a user in a narrow space, direct a virtual image to the user's pupil, and enable the overlay function described above.

Currently, HMDs have many problems that reduce their effectiveness. For example, HMDs are very expensive, have heat issues, and can form condensation around the waveguide.

Advantageously, embodiments of the present disclosure can provide an optical imaging device that forms a virtual image. This virtual image is superimposed on the view of the real world that a user of the optical imaging device perceives when looking through the optical imaging device with at least one eye. The present disclosure can further coordinate and interact with multiple artificial intelligence (AI) systems to monitor the user and the user's environment and provide feedback information to the user. This feedback information is based, in part, on past user behavior, including online behavior and real-world behavior. This increases user safety and efficiency in the tasks, decisions, and entertainment performed.

Accordingly, there is a need for an augmented reality display system that more effectively assists users while reducing the cost of the augmented reality display system.

The present disclosure provides a personal display device for displaying virtual images to a wearer. The personal display device comprises a frame having a right temple portion, a left temple portion, a right rear portion, and a left rear portion; a projection display device coupled to said frame for projecting an image onto a wearer; and two waveguide stack modules, the at least one waveguide stack module transmitting an image-bearing light beam along its length and configured to receive an image from the projection display device. , an in-coupling diffractive optical element and an out-coupling diffractive optical element, said in-coupling optical element being formed along said at least one waveguide stack module for receiving image-bearing light from said projection display device. diffracting the beam into the at least one waveguide-stacked module to transmit the image-bearing light beam in angularly-encoded form along the length of the at least one waveguide-stacked module; An out-coupling diffractive optical element is spaced along the length of the at least one waveguide stack module from the in-coupling diffractive optical element for viewing an image from the projection display device, for viewing an image from the projection display device. a processor connected to the projection display device; a touchpad connected to the processor; at least one microphone connected to the processor, the processor configured to provide an image to the projection display device and the at least one waveguide stack module; sensing and providing an input touchpad signal to the processor, the input touchpad signal changing at least one state of the personal display device, sensing movement of the wearer with the touchpad, the at least one microphone is further configured to receive commands from the wearer and provide an input microphone signal to the processor, the input microphone signal being a personal display device; change the state of at least one of

Furthermore, the following configuration is disclosed.
The personal display device further comprises a vibrator coupled to the processor, the vibrator configured to receive an input vibrator signal from the processor and provide tactile feedback to the wearer.
The in-coupling diffractive optical element and the out-coupling diffractive optical element have a front surface and a back surface, the front surface of the in-coupling diffractive optical element is parallel to the back surface of the in-coupling diffractive optical element, and the The front surface of the outcoupling diffractive optical element is parallel to the back surface of said outcoupling diffractive optical element.
The personal display device further comprises a nose bridge assembly removably attached to the frame between the right eye see-through portion and the left eye see-through portion.
The personal display device further comprises an ambient light sensor located on the frame and connected to the processor for detecting changes in ambient light. The ambient light sensor is configured to provide a signal to the processor. The processor is configured to modify an image transmitted by the projection display device based on signals provided by the ambient light sensor.
The waveguide stack module further includes a waveguide housing, the waveguide housing configured to house the in-coupling diffractive optical element and the out-coupling diffractive optical element.
The waveguide stack module includes a blackened material for absorbing excess light from the projection display device that passes through the incoupling diffractive optical element. The blackening material is made from at least one of comoto, carbon feather, actar, and black paint.
The waveguide housing includes a waveguide-frame aligner for aligning the waveguide housing and the frame. The waveguide stack module further includes an outer cover and an inner cover for sealing the in-coupling diffractive optical element and the out-coupling diffractive optical element within the waveguide housing. The outer cover and the inner cover include a gasket surrounding the outer cover and the inner cover, the gasket sealing the outer cover and the inner cover to the waveguide housing.
The projection display device includes a projector, a projector mounting frame, and a display connection module. The projector mounting frame includes alignment pins and a projector frame aligner, the projector frame aligner aligning the projector mounting frame and the frame.
The waveguide stack module further includes a waveguide housing, the waveguide housing includes a waveguide and frame aligner for aligning the waveguide housing and the frame, and the projection display device includes a projector mounting frame. wherein the projector mounting frame includes a projector frame aligner for aligning the projector mounting frame and the frame, the frame positioning the waveguide frame aligner and the projector frame aligner to the frame. Includes projector, waveguide and frame aligner for alignment.
The personal display device comprises a left hinge system positioned between the left temple portion and the left rear portion of the frame and a right hinge system positioned between the right temple portion of the frame and the right rear portion. I have more. The left hinge system and the right hinge system include flexible cables, hinges, hinge housings, and hinge pins. The hinge includes a first half hinge and a second half hinge, and the first half hinge and the second half hinge are configured to be rotatably connected by the hinge pin. The flexible cable includes at least six bending points, and four of the at least six bending points of the flexible cable are configured to surround the hinge pin.

The accompanying drawings, which are included to provide a further understanding of the invention disclosed herein, are incorporated in and constitute a part of this specification, and represent aspects of the invention. , together with the description serve to explain the principles of the invention.

1 is a perspective view of augmented reality glasses; FIG.

Fig. 10 is a bottom view of the augmented reality glasses;

1 is a cross-sectional plan view of augmented reality glasses; FIG.

Fig. 2 is a side view of augmented reality glasses;

FIG. 11 is a rear view of the augmented reality glasses;

1 is a first virtual image transmitted by augmented reality glasses;

Fig. 2 is a second virtual image transmitted by augmented reality glasses;

FIG. 11 is a perspective view of the waveguide stack module of the augmented reality glasses;

FIG. 4 is an exploded view of the components included in the waveguide stack module of the augmented reality glasses;

FIG. 12 is an enlarged rear view showing the waveguide housing and blackening material of the waveguide stack module of the augmented reality glasses;

FIG. 4 is an exploded view of the components included in the waveguide assembly of the waveguide stack module;

FIG. 4 is a top cross-sectional view of a waveguide stack module including a gasket;

1 is a perspective view of a projection display device for augmented reality glasses; FIG.

1 is an exploded view of the components included in the projection display device of the augmented reality glasses; FIG.

Fig. 3 is a side view of the projection display device of the augmented reality glasses;

FIG. 10 is a perspective view of the waveguide stack module and projector module of the augmented reality glasses;

FIG. 12 is an enlarged perspective view of the waveguide stack module and projector module of the augmented reality glasses;

FIG. 10 is a perspective view showing the interior area of the housing of the augmented reality glasses that receives the waveguide stack module and the projector module.

1 is an exploded view of the components including the hinge system of the augmented reality glasses; FIG.

FIG. 2 is an exploded view of the components of the augmented reality glasses with some of the top layer omitted;

FIG. 3 is an exploded view of the components of the hinge system of the augmented reality glasses;

1 is a perspective view showing a hinge system of augmented reality glasses in cross section; FIG.

FIG. 3 is a perspective view showing the inside of the hinge system of the augmented reality glasses;

Fig. 3 is a perspective view showing the interior of the hinge system in the first position;

Fig. 10 is a perspective view showing the hinge system in a second position in cross section;

Fig. 2 is a cross-sectional view of the heat dissipation system of the augmented reality glasses;

Fig. 4 is an image with augmented reality glasses in one acquisition mode; Images with augmented reality glasses in different acquisition modes.

1 is a perspective view of an augmented reality near-eye display system that utilizes artificial intelligence and wireless communication; FIG.

1 is a perspective view of an augmented reality head-mounted display that utilizes artificial intelligence and wireless communications; FIG.

The detailed descriptions set forth below are intended as illustrations of various configurations of the invention, and are not intended to represent the only configurations in which the invention can be practiced. It will be apparent to those skilled in the art that the present invention is not limited to the specific details of construction described herein and may be practiced without such specific constructions.

As used herein, terms such as “first,” “second,” and the like do not necessarily imply an order, sequential, or priority relationship, and unless otherwise specified, merely refer to an element or set of elements. Used to distinguish clearly from other elements or sets of elements.

The word "exemplary" means "an example," and is not intended to suggest any preferred or ideal embodiment.

The term "set" as used herein refers to a non-empty set, as widely understood in elementary mathematics as the concept of a collection of elements or members.
The term "subset" is used herein to refer to a non-empty proper subset, ie, a subset of a larger set that has one or more members, unless otherwise stated.
For a set S, a subset can contain the complete set S. However, a "proper subset" of set S is exactly included in set S and excludes at least one member of set S.

For the purposes of this disclosure, the terms "wavelength band" and "wavelength range" are equivalent and have the standard meaning used by those skilled in the art of color imaging, representing the range of light wavelengths used to represent a multicolor image. Refers to a continuous range. In typical color imaging applications, different wavelength bands, such as the primary colors red, green, and blue, are directed through different color channels.

As used in this disclosure, the term "coupled" is intended to indicate a physical association, connection, relationship, or linkage between two or more components, and is intended to indicate a single component influences the spatial arrangement of the components with which it is associated.
In the case of mechanical coupling, the two components need not be in direct contact, but may be connected through one or more intermediate components.
Components for optical coupling allow optical energy to enter and exit optical devices.

The terms "beam expander" and "pupil expander" are considered synonymous and are used interchangeably herein. These terms are generally used herein to denote a grating planar waveguide used to form a virtual image, as will be explained later.

An essentially planar optical waveguide (eg, parallel-plate waveguide) is a physical structure that can be used to transmit image-bearing light from one region of the waveguide to another. A typical application for such image transmission waveguides is in head-mounted monocular or binocular display systems.

The terms "rigid" and "rigid connection" are used to denote mechanically rigid or rigid components.
It should be understood that all rigid mechanical materials and systems have the ability to deform to varying degrees without breaking.

The terms "flexible electronic circuit," "flexible cable," and "flexible circuit" refer to a flexible material capable of transmitting one or more electrical or optical signals from its proximal end to its distal end. used to indicate Additionally, electrical and/or optical energy may be transmitted from the proximal end to the distal end. Additionally, it should be understood that the signal and/or power may be transmitted in reverse from the distal end to the proximal end.

The terms “displaying an image”, “displaying a virtual image”, “projecting an image”, “projecting a virtual image”, “presenting an image”, “presenting a virtual image” are used herein to Used to describe the visual features of the disclosed augmented reality display system. It should be appreciated that augmented reality display systems generate and present virtual images to the user's eyes, rather than actual images.

The terms "user" and "wearer" may be used interchangeably to describe a person who utilizes an optical imaging system, also called an "augmented reality display system" or "near-eye display system", as disclosed herein. be.

An augmented reality display system 100 is shown in FIGS. 1-25. The augmented reality display system 100 comprises a frame 10 having a right side R and a left side L. As shown in FIG. The augmented reality display system 100 further includes a right-eye see-through section 20 , a left-eye see-through section 22 , and a nose bridge section 24 positioned between the right-eye see-through section 20 and the left-eye see-through section 22 . Frame 10 may include right temple portion 30 , left temple portion 32 , right rear portion 34 , and left rear portion 36 . The right rear portion 34 is connected to the right temple portion 30 , and the right temple portion 30 is connected to the right see-through portion 20 . The left rear portion 36 is connected to the left temple portion 32 , and the left temple portion 32 is connected to the left see-through portion 22 .

Augmented reality display system 100 further includes right pass-through hinge 40 and left pass-through hinge 42 . The right rear portion 34 is connected to a right pass-through hinge 40 , which is connected to the right temple portion 30 . The left rear portion 36 is connected to a left pass-through hinge 42 , which is connected to the left temple portion 32 . Right pass-through hinge 40 and left pass-through hinge 42 are further described below.

The right rear 34 of the augmented reality display system 100 may include a right rear battery 50, a right vibration device 52, and a right flexible cable (not shown). The right flexible cable can be an electrical cable or any other connector suitable for the intended purpose and understood by those skilled in the art. A right flexible cable may connect the right rear battery 50 and the right vibration device 52 . The right flex cable passes through the right rear portion 34 and the right pass-through hinge 40 and can be connected to the right circuit board 64 . Another flexible cable (not shown) connects to the right circuit board 64 in the right temple portion 30 and passes through the right eye see-through portion 20, nose bridge portion 24, and left eye see-through portion 22 to the augmented reality display. It can be connected to a processor 54 located in the left temple portion 32 of the system 100 . Processor 54 may be a quad core ARM A53, or any other processor suitable for the intended purpose and understood by those skilled in the art.

Left rear 36 of augmented reality display system 100 includes left rear battery 56, left vibration device 58, and left flexible cable (not shown). The left flexible cable can be an electrical cable or any other connector suitable for the intended purpose and understood by those skilled in the art. A left flexible cable may connect the left rear battery 56 and the left vibrating device 58 . A left flexible cable may pass through the left rear portion 36 and the left pass-through hinge 42 and connect to the processor 54 of the augmented reality display system 100 .

Right temple portion 30 of augmented reality display system 100 may further include projection display device 70 and touchpad 72 . Projection display device 70 and touchpad 72 may be connected to processor 54 of augmented reality display system 100 . Projection display device 70 is further described below.

Touchpad 72 allows a user to interact with augmented reality display system 100 to change the image projected by projection display device 70 . A user swipes (e.g., swiping a finger in an upward, downward, sideways, diagonal, or inward direction such as a tap) to signal processor 54 to change the image projected by projection display device 70. , and/or change the state of the augmented reality display system 100 . The touchpad 72 also senses changes in user pressure (eg, a user pressing on the touchpad 72) to alter the image projected by the projection display device 70 and/or augmented reality display system 100. change the state of Signals and/or data from the touchpad 72 can be configured to perform the following actions.
1) Initiate activation of software stored in the memory (not shown) of the augmented reality display system 100;
2) the software of a third party device (not shown) in direct (e.g. wired) or remote (e.g. wireless) communication with the augmented reality display system; WiFi and/or over Bluetooth), to start.
3) initiate or terminate network communications with third party devices;
4) Start or stop devices or subsystems (eg, cameras, video recordings, microphones, vibrators, projection systems, sensors, other devices or subsystems) incorporated into the augmented reality display system 100;

The right see-through portion 20 of the augmented reality display system 100 may include a right outer cover 76 , a right inner cover 78 and a waveguide stack module 80 . The right outer cover 76, right inner cover 78, and waveguide stack module 80 are further described below.

The left temple portion 32 of the augmented reality display system 100 includes a left temple battery 60 that can be connected to the processor 54 . Left temple battery 60 may be connected to processor 54 to provide additional power to augmented reality display system 100 .

The left see-through portion 22 of the augmented reality display system 100 may include a left outer cover 82 and a left inner cover 84 . Right outer cover 76, right inner cover 78, left outer cover 82, and left inner cover 84 may be protective covers or any other covers suitable for the intended purpose and understood by those skilled in the art. .

Right outer cover 76 and left outer cover 82 may be electrically coupled to processor 54 . Processor 54 may be electrically coupled to right rear battery 50 , left rear battery 56 , and left temple battery 60 . These batteries can be placed within the augmented reality display system 100 .

Right outer cover 76 and left outer cover 82 may comprise at least an electrochromic material, a photochromic material, or any other material suitable for the intended purpose and understood by those skilled in the art. Electrochromic or photochromic materials may be disposed between right outer cover 76 and right inner cover 78 and between left outer cover 82 and left inner cover 84 . An electrochromic or photochromic material may be disposed on the outer surface of the right outer cover 76 and the outer surface of the left outer cover 82 . The electrochromic or photochromic material is applied to the right outer cover 76 and the left outer cover 82 such that the right outer cover 76 and the left outer cover 82 are the farthest surfaces of the waveguide stack module 80 from the user's perspective. may be an additional surface of the waveguide stack module 80 positioned in front of the .

The right-eye see-through portion 20 of the augmented reality display system 100 may further include a polarizer (not shown) disposed between the right outer cover 76 and the waveguide assembly 89 . A polarizer may be placed between the waveguide assembly 89 and the right inner cover 78 . The polarizer may be a circular polarizer. The polarizer can help the augmented reality display system 100 block reflected light from the inner surface of the right outer cover 76 from returning to the waveguide assembly 89 and thus from entering the user's eyes. .

The nose bridge portion 24 of the augmented reality display system 100 may include a nose bridge assembly 90 . The nose bridge assembly 90 may be removable or fixed. The nose bridge assembly 90 may include a lens fixation assembly (not shown) for securing optional prescription lenses to the nose bridge portion 24 . The optional prescription lenses may be placed near the user's eyes, such as in front of the right inner cover 78 and left inner cover 84 of the augmented reality display system 100 .

Augmented reality display system 100 may further include camera assembly 12 . Camera assembly 12 may include a camera (not shown) and an ambient light sensor (not shown). Camera assembly 12 may be connected to processor 54 of augmented reality display system 100 . The camera can provide data to processor 54 to modify the image displayed by projection display device 70 of augmented reality display system 100 . The camera can be configured to acquire images at 1080p resolution at 30 frames per second (FPS), or any other resolution and speed suitable for the intended purpose and understood by those skilled in the art.

Multiple cameras can also be spaced apart from each other to provide additional benefits such as stereo imagery and front, side and back image acquisition. Camera assembly 12 may be positioned within right eye see-through portion 20 . Additional cameras may also be placed in each of left eye see-through portion 22 and right eye see-through portion 20 . A separate camera can also be positioned within the nose bridge 24 . Other cameras may be positioned at least one of right rear 34 , left rear 36 , right temple 30 , left temple 32 , right eye see-through 20 , left eye see-through 22 and nose bridge 24 .

At least one camera may be an infrared camera and/or an ultraviolet camera. At least another camera may have self-focus and zoom capabilities along with supporting software. A "zoom capable" camera may include a camera of camera assembly 12 that has the ability to change the optical power of the camera.

Processor 54 may be configured to receive data from the ambient light sensor to modify the image projected by projection display device 70 . For example, the contrast ratios and colors displayed by projection display device 70 when the ambient light is bright (e.g., a bright room, outdoors on a sunny day, etc.) may vary when the ambient light is not bright (e.g., a dim room, cloudy day, etc.). outdoors, outdoors at night, etc.). Data from the ambient light sensor may also be used to adjust the level of opacity of right outer cover 76 and/or left outer cover 82 .

The augmented reality display system 100 can provide an ambient lighting feature to make the transparent display more visible to the user during difficult lighting conditions. The ambient lighting feature can adjust the user's visual experience between different states (eg, "themes," etc.) based on ambient lighting conditions.

When the data from the ambient light sensor reaches a user-defined threshold, processor 54 can change the visual experience displayed to the user. The augmented reality display system 100 can display various themes on the waveguide stack module 80 that can accommodate changing lighting conditions. For augmented reality display system 100 , a “theme” can include various colors, icons, and transparencies that can be applied by processor 54 .

For example, FIGS. 6A and 6B are examples of “themes” utilizing ambient light sensors displayed and/or transmitted to waveguide stack module 80 . FIG. 6A is a "dark theme" that includes a more transparent "coloring" scheme used in dark ambient lighting. This can prevent the projection display device 70 from overwhelming the user's view with excessive brightness when in low lighting settings. FIG. 6B is a 'bright theme' that provides a high contrast 'coloring' scheme for use in bright environments. 6A, 6B, the black color is the transparent portion of the displayed image of the augmented reality display system 100. In FIG.

The augmented reality display system 100 may automatically utilize ambient lighting features rather than user selectable options. Additionally, the "Theme" settings include Always Dark, Always Light, or Auto. A user-defined threshold setting can be defined as the range of ambient light levels that can trigger a theme change. User-defined thresholds may also include the length of time sensed data is above or below the ambient light level threshold before the processor triggers a theme change. For example, if a "flash" suddenly occurs and exceeds a user-defined threshold, the "flash" is of short duration and the theme switch is not performed. The theme displayed by the waveguide stack module 80 is switched if the ambient threshold change continues for a defined period of time.

Augmented reality display system 100 may further include a third flexible cable (not shown). This third flexible cable can connect the processor 54 to the projection display system 70 and pass through cavities (not shown) in the left eye see-through portion 22, the nose bridge portion 24, and the right eye see-through portion 20. can be done. The third flexible cable may be an electrical cable or any other cable suitable for the intended purpose and understood by those skilled in the art.

Additional flexible cables (not shown) can be placed in the right temple portion 30 and passed through the right eye see-through portion 20 , nose bridge portion 24 , left eye see-through portion 22 and left temple portion 32 . Additional flexible cables may connect one or more components located on the right side R of the augmented reality display system 100 to one or more components on the left side L. FIG.

Augmented reality display system 100 further includes memory card slot 18, memory card slot cover 19, internal memory (not shown; e.g. 4 GB flash memory), system RAM (not shown; e.g. 512 MB), and access port 44 (e.g. micro USB access port). This access port 44 is for establishing an external connection (eg, a USB 2.0 high speed connection) to the processor 54 . Memory card slot 18 accepts a Secure Digital (SD) card, MiniSD card, CompactFlash card, Memory Stick, xD-Picture card, or any other storage medium suitable for the intended purpose and understood by those skilled in the art. configured to accept. A memory card slot cover 19 can provide sealed access to the memory card slot 18 . For example, memory card slot cover 19 can be waterproof or water resistant.

Left temple portion 32 of augmented reality display system 100 may further include an outward facing microphone port (not shown) and an inward facing microphone port (not shown). These microphone ports are used to modify the image displayed by projection display device 70 . That is, data may be sent to processor 54 that may alter the image displayed by projection display device 70 . For example, the user can say "next" to change the image displayed by projection display device 70 to the next image.

If a mic port is available, an associated mic can be placed in the mic port and connected to a power source (eg, left temple battery 60) and processor 54. Processor 54 can receive electrical audio signals from an associated microphone. An associated microphone receives audio primarily through the microphone port.

One or more microphone ports and associated microphones may also be located on the right temple portion 30 . Other locations for one or more mic ports and associated mics may include bridge portion 24 , right rear portion 34 , left rear portion 36 , right eye see-through portion 20 , and left eye see-through portion 22 . Multiple microphones can be used to filter out background and environmental noise, and can also be used to warn the wearer of potential environmental hazards.

Voice commands from the user can also initiate software stored in the augmented reality display system 100 and/or software on external (third party) devices that communicate directly or remotely with the augmented reality display system 100. . Voice commands may change the state of devices or subsystems incorporated into augmented reality display system 100 (eg, cameras in camera assembly 12 or projectors in projection display device 70), or power on/on augmented reality display system 100. can be turned off. A voice command may also change the state of the augmented reality display system 100 or initiate a change of the state of the augmented reality display system 100 . For example, if the microphone is "on," the voice command may initialize the microphone and provide data to processor 54 to change the state of augmented reality display system 100 . Other examples of changing the state of augmented reality display system 100 via voice commands may include changing the image displayed by waveguide stack module 80 and capturing an image by camera assembly 12 .

Left temple portion 32 of augmented reality display system 100 may further include indicator port 14 (eg, LED indicator port) and power button 16 for operating augmented reality display system 100 . Indicator port 14 can display power levels, status, or any other information suitable for the intended purpose and understood by those skilled in the art.

The circuit board 62 of the augmented reality display system 100 includes the processor 54, board memory module, orientation sensor, acceleration sensor, magnetic sensor, audio encoding module, wireless module, chip antenna module, camera connector, barometric pressure sensor, proximity sensor, etc. be able to.

25 shows a cross-sectional rear view of the left temple portion 32. FIG. The left temple portion 32 has a left temple portion outer surface 300 and a left temple portion inner surface 302 that defines an internal cavity 304 . Left temple portion 32 may include a heat dissipation system 310 that is utilized to distribute heat generated by processor 54 to left temple portion inner surface 302 . Heat dissipation system 310 provides one or more localized heat dissipation that may damage electrical components located on left temple portion 32 (eg, processor 54, left temple battery 60, or other components on circuit board 62). prevent hot spots from occurring. The heat dissipation system 310 can also prevent discomfort caused by localized hot spots for the wearer of the augmented reality display system 100 .

The heat dissipation system 310 can include a first heat transfer sheet 312 positioned between at least a portion of the circuit board 62 and the left temple inner surface 302 . The first heat transfer sheet 312 may be in thermal and/or physical contact with the left temple inner surface 302 . The heat dissipation system 310 may also include a second heat transfer sheet 314 positioned between at least a portion of the circuit board 62 and a portion of the left temple battery 60 . The second heat transfer sheet 314 may be in thermal and/or physical contact with a portion of the inner surface 302 of the left temple.

The heat dissipation system 310 may also have a heat insulator 316 positioned between the second heat transfer sheet 314 and the left temple battery 60 . Insulation 316 may be composed of airgel, rubber, or any other material suitable for the intended purpose and understood by those skilled in the art. The heat dissipation system 310 may also include a third heat transfer sheet 318 positioned between the left temple battery 60 and the left temple inner surface 302 . The third heat transfer sheet 318 may be in thermal and/or physical contact with the left temple inner surface 302 . The third heat transfer sheet 318 may also be in thermal and/or physical contact with at least a portion of the left temple battery 60 .

The first heat transfer sheet 312, the second heat transfer sheet 314, and the third heat transfer sheet 318 may be in thermal and/or physical contact with each other. The first heat transfer sheet 312, the second heat transfer sheet 314, and the third heat transfer sheet 318 may be copper, silver, gold, tin, aluminum, pure or composite materials, or suitable for the intended purpose. It can be constructed of any other material understood by those skilled in the art.

waveguide stack module

As shown in FIGS. 7-11, the waveguide stack module 80 of the augmented reality display system 100 can be sealed to the environment. This is to prevent moisture, dirt, and other particles from getting inside waveguide stack module 80 and ruining the image provided by projection display device 70 . For example, waveguide stack module 80 may be hermetically sealed. The waveguide stack module 80 of the augmented reality display system 100 may further include a waveguide housing 86 , a waveguide and frame aligner 87 , a blackening material 88 , and a waveguide assembly 89 .

The right outer cover 76 of the augmented reality display system 100 may also include an anti-reflective coating to help reduce unwanted reflections. As a result, a higher quality image can be displayed to the user. Right outer cover 76 may include a full perimeter seal with waveguide housing 86 to prevent debris from entering waveguide stack module 80 . For example, glue or adhesive may be applied around right outer cover 76 to seal right outer cover 76 to waveguide housing 86 .

The waveguide housing 86 of the waveguide stack module 80 allows stacking of other modules within the augmented reality display system 100 , thereby reducing stacking tolerances in the augmented reality display system 100 . Waveguide housing 86 may be formed of plastic, polycarbonate, polymer, or any other material suitable for the intended purpose and understood by those skilled in the art.

The blackened material 88 of the waveguide stack module 80 can absorb excess light from the projection display device 70 passing through the waveguide assembly 89 , thereby reflecting the excess light back into the waveguide assembly 89 . don't go back. The blackening material 88 may be made of comoto, carbon feather, actar, black paint, and any other material suitable for the intended purpose and understood by those skilled in the art. Blackening material 88 may be placed at a normal angle to waveguide assembly 89 .

Waveguide assembly 89 of waveguide stack module 80 may include at least one waveguide 92 . The waveguide assembly 89 of the waveguide stack module 80 also includes two waveguides 92, 96 (or any other material/optical element suitable for the intended purpose and understood by those skilled in the art) and a UV activated material. 94 (UV light activated material). The two waveguides 92 , 96 are separated by a UV activated material 94 while maintaining parallelism suitable for the optical performance of the waveguide assembly 89 . Increased parallelism results in little or no color separation in the image. The two waveguides 92, 96 can also have parallel front and back surfaces, and one or more diffraction gratings can be placed in these surfaces. The edges of the two waveguides 92, 96 and the UV activated material 94 can be blackened to help absorb light. The UV activated material 94 can also be a UV curable adhesive applied around or near the two waveguides 92,96. UV activated material 94 may provide a cavity between the two waveguides 92 , 96 of waveguide assembly 89 .

The two waveguides 92, 96 can have an in-coupling diffractive optical element and an out-coupling diffractive optical element. The two waveguides 92, 96 of the waveguide assembly 89 of the waveguide stack module 80 further include at least one rotating grating positioned between the in-coupling diffractive optical element and the out-coupling diffractive optical element. be able to. In-coupling diffractive optical elements, out-coupling diffractive optical elements, and/or rotating diffraction gratings include diffraction gratings, holographic optical elements, volume holograms, photonic crystals, photorefractive crystals, polymers, gelatin dichromates, and photosensitive tempered glass.

The right inner cover 78 of waveguide stack module 80 may include an anti-reflection coating and an anti-“dirt” coating. Different types of coatings may be applied to either side of right inner cover 78 . If dirt or oil is directly present on the two waveguides 92, 96, the image displayed on the waveguide stack module 80 will be degraded. The right inner cover 78 can make the image quality less sensitive to the environment.

Waveguide stack module 80 may also include a gasket 98 (eg, a place gasket) that may contact right inner cover 78 . This gasket 98 allows for a better seal with waveguide stack module 80 . An advantage of the gasket is that it does not apply excessive pressure directly to waveguide assembly 89 . Gasket 98 may be made from Dymax GA 142 gasket material, or any other material suitable for the intended purpose and understood by those skilled in the art.

Generally, waveguides (eg, parallel-plate waveguides) are associated with total internal reflectance (TIR), which involves reflection of light within the waveguide material. If the surface of the parallel-plate waveguide is dirty or if there are pressure points in the waveguide material, the TIR can be disturbed. A right inner cover 78 having an anti-reflective coating provides an additional layer of protection. Contamination of the right inner cover 78 does not affect the TIR as much as direct contamination of the waveguide assembly 89 . This also allows pressure to be applied to waveguide assembly 89 through gasket 98 . Gasket 98 helps create an environmental seal to keep dirt, moisture, and other unwanted particles from entering the optical path and degrading the image of augmented reality display system 100 . Gasket 98 allows flexing of frame 10 while maintaining an environmental seal.

projection display device

As shown in FIGS. 12-14, the projection display device 70 of the augmented reality display apparatus 100 can include a projector mounting frame 112, a projector 114, alignment pins 116, and alignment holes 118. As shown in FIG. Projector 114 may be a Vuzix Cobra 2 projector or any other projector suitable for the intended purpose and understood by those skilled in the art. Alignment holes 118 are adapted to receive alignment pins 116 to position projector 114 on projector mounting frame 112 .

Projection display device 70 may further include a display connection module 110 that connects projection display device 70 to waveguide stack module 80 . The display connection module 110 can be an optical connection module that can connect the projection display device 70 to the waveguide stack module 80 . In one embodiment, display connection module 110 can be a prism assembly. A prism assembly can optically connect the projection display system 70 to the waveguide stack module 80 . The prism assembly also redirects light from the projection display system 70 so that when the light hits the incoupling gratings of the parallel-plate waveguides of the waveguide stack module 80, the light is at the correct incoupling angle. guarantee to have

Projector mounting frame 112 may include prism alignment edge 120 and projector alignment edge 122 to align display connection module 110 and projector 114 to projector mounting frame 112 . The projector 114 can sit flush against the projector alignment edge 122 of the projector mounting frame 112 . Projector mounting frame 112 may also include projector frame aligner 124 .

Optical assembly and alignment

As shown in FIGS. 15-17, the frame 10 of the augmented reality display system 100 may include a projector-waveguide-frame aligner 126 to reduce tolerance stack-up within the augmented reality display system 100. can. This aligner 126 provides a reference surface for the projection display device 70 and waveguide stack module 80 . Waveguide-to-frame aligner 87 and projector-to-frame aligner 124 may abut projector-to-waveguide-to-frame aligner 126 to reduce the overall tolerance stack in augmented reality display system 100 .

hinge system

The augmented reality display system 100 can also include a hinge system 200, as shown in FIGS. 18-24. Hinge system 200 may include flexible cable 210 , hinge 220 , hinge housing 230 and hinge pin 240 . There are many challenges when designing a hinge system for flexible eyeglasses. The challenges include a hinge system that can pass through flexible electronic circuits while remaining small enough to fit in the temples of eyeglasses and strong enough to withstand abuse from the user.

The hinge system 200 of the augmented reality display system 100 overcomes the above problems with its design, remaining flexible and strong enough, yet small enough to fit in glasses. The hinge 220 of the hinge system 200 can include a pair of metal injection molded hinge pieces, each insert molded into the frame 10 of the augmented reality display system 100 . This allows the hinge 220 to be sufficiently small within the frame 10 and also provides the necessary strength for the augmented reality display system 100 .

The shape of hinge 220 allows flex cable 210 to pass through hinge 220 while allowing flex cable 210 and right rear 34 and/or left rear 36 of frame 10 to move from a first position to a second position. It is unique in that it can cover and protect the flexible cable 210 while it is rotated to the position. Hinge 220 can include an inner hinge portion 222 and an outer hinge portion 224 that are pivotally connected by hinge pin 240 and can remain rotatable. The shape of inner hinge portion 222 and outer hinge portion 224 of hinge 220 allows inner hinge portion 222 and outer hinge portion 224 to overlap each other (e.g., inner hinge portion 222 includes protective tabs 226 and outer hinge portion 224 includes protective tabs 226). 224 includes protective tab receivers 228 ) to allow flexible cable 210 to be engaged in an obscuring manner while still being pivotable about hinge pin 240 .

In FIG. 23, hinge 220 is shown in the first position. In this first position, inner hinge portion 222 and outer hinge portion 224 can form a solid stop position. Outer hinge portion 224 may include outer locking tabs 232 and inner hinge portion 222 may include inner locking tabs 234 . In the first position, inner hinge portion 222 and outer hinge portion 224 of hinge 220 are substantially parallel to each other in alignment with frame 10 . In a first position, augmented reality display system 100 is in an "open" position. A portion of the hinge 220 is exposed to the environment and can provide the hinge 220 with a rigid wall of the frame 10 against which it can be placed and/or aligned.

Flexible cable 210 may be covered by hinge 220 at the joint location of hinge system 200 . Flexible cable 210 can also be supported on either side by frame 10 and hinge housing 230 . Frame 10 and hinge housing 230 of augmented reality display system 100 may be pivotally connected to hinge pin 240 .

In FIG. 24, hinge system 200 is shown in a second position. A second position of hinge system 200 is a folded or tilted position. Flexible cable 210 passes from left rear 36 through a gap near the axis of hinge pin 240 , bends around hinge pin 240 , and enters left temple portion 32 of augmented reality display system 100 . Flexible cable 210 may also be attached to left circuit board 62 of augmented reality display system 100 . The left circuit board 62 of the augmented reality display system 100 is located on the left temple portion 32 . The right circuit board 64 of the augmented reality display system 100 is located on the right temple portion 30 . Frame 10, hinge 220, and hinge housing 230 may enclose flexible cable 210 and prevent exposure of flexible cable 210 to the environment.

18-24 show the hinge system 200 on the left side L of the augmented reality display system 100, a similar “mirror image” of the hinge system 200 may exist on the right side R of the augmented reality display system 100. FIG.

Software function

The augmented reality display system 100 can also display application information, including live data, without the user having to start or launch the application.

As shown in FIGS. 6A and 6B, the projection display device 70 and waveguide stack module 80 of the augmented reality display system 100 can be configured to display a A live view of the application can be automatically provided to the user. A "rail" of the augmented reality display system 100 can be a portion of the image that can provide a view of the icons (eg, the icons can be in vertical or horizontal columns). When the icon is in the active icon position, the application's widgets are automatically displayed in the widget area of the displayed screen (such as the home screen) and can provide read-only information available to the application.

Augmented reality display system 100 may further include at least one inductive charging coil circuit (not shown) disposed within frame 10 . The inductive charging coil circuit may be electrically connected to the left circuit board 62 and at least one battery (eg, right rear battery 50). An inductive charging coil circuit can be used to charge one or more batteries of the augmented reality display system 100 . The inductive charging coil circuit may include several loops of conductive material wrapped around the inner perimeter of right eye see-through portion 20 and/or left eye see-through portion 22 . The inductive charging coil circuit may also be located in at least one of the right temple portion 30, the left temple portion 32, the right rear portion 34, and the left rear portion 36.

This disclosure has been described with reference to an embodiment of an augmented reality display system 100 . The positions of the components of the augmented reality display system 100 are interchangeable from left L to right R and right R to left L, with appropriate mirroring of the shapes of the augmented reality display system 100 components. One thing is understood. For example, this disclosure describes projection display device 70 and waveguide stack module 80 as being on the right side of augmented reality display system 100 . However, the present disclosure also provides that the projection display device 70 and waveguide stack module 80 and other corresponding components necessary to achieve reorientation are used to provide a virtual image to the left eye of the user. It is also assumed to be on the left side of display system 100 .

artificial intelligence system

Artificial intelligence systems may be utilized in the augmented reality display system 100 . Artificial intelligence systems can be used for facial recognition, game play (eg, Go, chess, etc.), medical diagnosis, robot manipulation, and interaction with real-world objects. In addition, deep learning systems (a type of artificial intelligence) can monitor users' preferences and preferences based on data collected from their online interactions (including shopping from online stores, social media websites, email systems, etc.). Behavior can be analyzed.

A head-mounted display augmented reality system configured to simultaneously manage connections and interactions with multiple artificial intelligence systems benefits users. Such systems monitor a user's environment, behavior, health and well-being and provide feedback to the user to enhance user information, awareness and safety. These systems can provide personalized assistance to users by monitoring and learning user behavior and preferences and responding based on the learned user preferences and behaviors.

Augmented reality display system 100 may include additional sensors located on circuit board 62 and/or circuit board 64 . Additional sensors include proximity sensors (inward towards the wearer and/or outward towards the environment the wearer is in), ambient light intensity sensors, audio microphones, temperature sensors, humidity sensors, GPS location elements, magnetometers, These include, but are not limited to, accelerometers, head orientation sensors (eg, tilt and tip orientation), and wearer gaze orientation sensors. Data from the sensors can be collected by the processor 54 and applications running on the processor 54 . The data is organized, formatted, and displayed to the wearer as part of a virtual image that overlays the real-world scene within the wearer's field of view of the augmented reality display system 100 . Additional information and data (e.g., compass direction of the wearer's line of sight, GPS location, ambient temperature, names of objects within the wearer's field of view, etc.) may be provided to others in order to be formatted and displayed as part of the virtual image. can be obtained via a communication protocol (e.g., Bluetooth, Wi-Fi, or other communication protocol) with an external device or network.

FIG. 26A is a diagram of the image acquisition mode of the augmented reality display system 100 of FIG. Camera assembly 12 and processor 54 may provide different modes of operation for capturing images. In one mode of operation, camera assembly 12 can capture still images of a scene as shown in FIG. 26A. In another mode of operation, a continuous stream of images can be acquired by camera assembly 12 and processor 54 . In yet another mode of operation, the processor 54 can display the data in at least one of the wearer's two eyes as a virtual image superimposed on the real world scene. This information includes object identification data for objects appearing in the wearer's field of view, as well as data from sensors including the wearer's gaze direction, ambient temperature, GPS location, and the like. Camera assembly 12 and processor 54 combine real-world images captured by camera assembly 12 with data displayed as virtual images to the wearer for future retrieval and/or transmission to other devices. A final acquired image stored in .

FIG. 26B shows a camera-captured image of the real world. This camera acquired image contains a virtual image of the data superimposed to form the final acquired image. In another mode, camera assembly 12 and processor 54 can operate to provide continuous video capture. This video capture combines the real world images within the field of view of the camera assembly 12 with a virtual image that is superimposed on the captured real world images to form the final captured video.

FIG. 27 shows a head-mounted display augmented reality (HMD AR) near-eye display system 350 that includes an augmented reality (AR) near-eye display device 352 . AR near-eye display device 352 may include at least one internal artificial intelligence (AI) system implemented in hardware and/or software within AR near-eye display device 352 . The at least one internal AI system may be partially or wholly expert systems, machine learning systems, deep learning systems, neural network-based systems, and/or suitable for the intended purpose. may include and/or be combined with one or more of the other types of systems understood by . The AR near-eye display device 352 includes sensors such as GPS sensors, head direction sensors and/or gaze direction sensors, and may include network and inter-device communication modules including Bluetooth, WiFi and/or other communication protocols. can. Additionally, the AR near-eye display device 352 can include at least one camera and at least one audio microphone. The AR near-eye display device 352 may further include a display for conveying to the wearer a virtual image superimposed on the real-world view of at least a portion of the wearer's field of view. The at least one internal AI system is part of the at least one internal AI system in the AR near-eye display device 352 and at least one internal AI system accessible to the external device via a network using one or more communication protocols. part of the AI system. The latter is for example a database associated with at least one internal AI system located in the cloud service. A voice command AI interface to this database is located in the AR near-eye display device 352 .

At least one internal AI system can be a natural language processing system that utilizes at least one audio microphone of AR near-eye display device 352 . The natural language processing system enables the wearer of the AR near-eye display device 352 to initiate commands to change one or more operating parameters of the AR near-eye display device 352 by issuing voice commands.

The AR near-eye display device 352 can utilize Bluetooth and/or WiFi communication modules to communicate with external networks, the Internet, cloud applications, and the like. A wearer of the AR near-eye display device 352 can communicate with external AI applications via a natural language processing system internal to the AI system. The wearer can interact with both internal and external AI systems to enhance and/or assist the user's activities. By utilizing GPS sensors and image capture, as well as internal and external AI systems that process images for object identification, the user can identify objects in the wearer's environment, such as devices in need of repair. can be identified. Communicating with internal and/or external AI systems can help the wearer repair damaged devices. For example, after identifying a device based in part on its location and image of the device, at least one internal AI system determines the make and model of the device and, for additional data about the device, retrieves information from other networks. , databases, and AI systems. Additional data may include, for example, when the device was last serviced, common failures known for this type of device, and how to remedy current problems with the device. Internal and external AI systems interact with the wearer and provide instructions to the wearer to determine device faults and how to fix the device. Both audio and visual data from the AR near-eye display device 352 can be sent to one or more AI systems to help modify the device.

FIG. 28 shows an HMD AR display system 400 including at least one AR smart glasses 410 and at least one AI system 430 . At least one AI system 430 may include natural (e.g., human) intelligence, reasoning, knowledge of one or more topics, planning, learning, natural language processing (e.g., written language and/or spoken language), spatial recognition. , facial recognition, etc., may include hardware and/or software capable of processing and/or displaying one or more. AR smart glasses 410 can include at least two different categories of user and/or environment interaction: 1) data acquisition and 2) feedback.

Data acquisition can include: 1) Touch acquisition from one or more touchpads and/or touch buttons.
2) Image acquisition from one or more cameras.
3) Voice acquisition used to capture the wearer's voice and/or sounds from the environment.
4) WiFi data acquisition to enable communication between the AR smart glasses 410 and other WiFi devices and/or networks.
5) Bluetooth data acquisition to enable communication between the AR smart glasses 410 and other Bluetooth devices and/or networks.
6) Other data acquisition including sensors such as GPS, magnetometer, accelerometer, barometer, temperature sensor, heart rate sensor, gaze direction sensor, orientation sensor, motion sensor.

Feedback to the wearer of the AR smart glasses 410 can include any one or a combination of tactile, audio, visual, and/or olfactory.

AR display system 400 may further include coordination system 420 . Coordination system 420 may be part of at least one AI system 430 and may provide coordination and interface protocols to at least one AI system 430 . Coordination system 420 can also provide coordination and interfaces to other network systems, such as the Internet of Things (IoT) 432 . IoT 432 is an interconnection network that is connected via the Internet so that computing devices, software, sensors, and/or actuators embedded in physical objects can send and receive data. Coordination system 420 may be embedded or mounted within the hardware and/or software of AR smart glasses 410 . Coordination system 420 may be a cloud computing application accessible by AR smart glasses 410 via Bluetooth and/or WiFi connectivity. Coordination system 420 may be partially embedded in or onboard smartphone 412 . Smartphone 412 may communicate with AR smart glasses 410 via Bluetooth, WiFi, other wireless communication protocols, and/or is physically connected to AR smart glasses 410 via at least one wire cable. may Coordination system 420 may include hardware and/or software. Coordination system 420 may be partially distributed across AR smart glasses 410, smartphone 412, and/or cloud applications.

AR smart glasses 410 may include at least one camera for image acquisition that provides still images and/or a stream of images (eg, video) to coordination system 420 . The coordination system 420 can process the images for face recognition, real-space object identification, and the like. Coordination system 420 may initiate image and/or video processing by passing the images to at least one AI system 430 . In one example, the coordination system 420 initiates processing, passing images to an AI system of at least one AI system 430 for face recognition, passing images to a spatial recognition AI for object identification, and character recognition. and/or passed to a language processing AI for language translation. Information resulting from such possibly multiple AI processes is received by coordination system 420 . Coordination system 420 can coordinate and present the received information in one or more appropriate formats (eg, tactile, audio, visual, and/or olfactory) to the wearer of AR smart glasses 410. .

AR display system 400 may include a personal preference AI system, which is one of at least one AI system 430 . This AI system is suitable for learning the wearer's habits and/or preferences. Such learning data may include at least one of historical data of the wearer's usage of the AR smart glasses 410, usage of social media websites such as Facebook and Twitter, online shopping websites such as Amazon, and specialized websites such as LinkedIn. can be obtained from Additionally, the Personal Preference AI system can receive data suitable for learning the wearer's preferences and habits from multiple sensors and data sources, such as clocks, calendars, GPS sensors, and voice commands. By learning the wearer's habits, for example when the wearer goes to work or what type of music the wearer prefers to listen to while traveling, personal preference AI systems can music to the wearer and filter news and/or advertisements to present information that may be of interest to the user. These are based on behavioral and preference data. Other data for learning can be obtained from other AI systems that monitor the behavior of unidentified people wearing AR smart glasses 410 . Human behavior can be learned, in part, through statistics and other analyzes of human behavioral data involving large numbers of people (shopping data, online social media data, voting records, surveys, etc.). Use of such data can be part of a personal preference AI system.

Another AI system of the at least one AI system 430, or a combination of one or more AI systems of the at least one AI system 430, can include image processing, spatial recognition, and object recognition. Still other AI systems of the at least one AI system 430 are suitable for recognizing hand gestures of the wearer and/or other people. Another AI system of at least one AI system 430 is suitable for speech recognition. Still another AI system of the at least one AI system 430 is suitable for translation. Another AI system of at least one AI system 430 is suitable for botany. Coordination system 420 may be statically or dynamically configured, for example, to answer the question "What is the name of that tree" posed by the wearer while pointing at a particular tree. Using spatially aware AI, questions such as 'how far is that tree?' or 'how tall is that tree?' “Dynamically” means that the coordination system 420 is in immediate or constant communication with at least one AI system 430, all of which are necessary to understand and answer questions posed by the wearer. It can be defined as having the knowledge and ability to initiate communication with at least one AI system 430 that is suitable for answering a question. And once the question has been answered, there is no need to communicate with the particular AI system of the at least one AI system 430 . Coordination system 420 can then stop at least one AI system 430 from communicating with a particular AI system.

A hand gesture AI system of at least one AI system 430 can also be utilized to recognize sign language gestures (eg, American Sign Language). A hand gesture AI system can be utilized to recognize commands to the coordination system 420 or other components of the AR smart glasses 410 , such as the touchpad 72 .

One of the AI systems in the at least one AI system 430 can be a spatially aware AI that knows the environment in which the wearer is. A spatially aware AI can include a GPS location device to obtain the wearer's GPS location. The Bluetooth sensor in the AR smart glasses 410 can be used to identify Bluetooth beacons in the wearer's immediate environment. A Bluetooth beacon contains a hardware transmitter that transmits identification information. So, for example, a company can install Bluetooth beacons to identify the company. When the wearer of the AR smart glasses 410 comes within range of the Bluetooth beacon, the coordination system 420 is alerted to the Bluetooth beacon and initiates commands to at least one AI system 430 to other AI systems to obtain additional information. and format, and present the formatted information to the wearer. For example, coordination system 420 can query IoT, other networks, and/or databases for additional information about companies associated with a particular Bluetooth beacon. Coordination system 420 can also query a personal preference AI system to determine if the wearer is interested in the company. If the wearer is likely to be interested, the coordination system 420 can query the spatially aware AI for the distance and direction to the enterprise. Coordination system 420 then tells the wearer how close the business is to the wearer's current location, how to reach the business, and/or a short list of items offered by the business (e.g. , visual or audible) to warn. In addition, the coordination system 420 can also query the Internet to determine business hours and possible special sales information.

The location-aware AI of at least one AI system 430 can provide weather conditions, forecast weather conditions, and/or warnings (eg, tornado warnings) to the wearer. In addition, location-aware AI determines that acquaintances interacting via social media, email, and/or in person are nearby and alerts the wearer that acquaintances are close to the wearer. can also The wearer can then direct the coordination system 420 to contact the acquaintance by requesting a visitation. Additionally, the coordination system 420 can provide direction to acquaintances. Alternatively, the wearer can instruct the coordination system 420 to block further information about the acquaintance.

Coordination system 420 may determine that the requested information has been previously obtained by another person and is available on the Internet or some other accessible network. In such cases, coordination system 420 may choose to use available information rather than initiate communication with at least one AI system 430 to calculate the necessary information.

Coordination system 420 can initiate mapping of the wearer's immediate environment and may make such environmental information available to other users. In this way, the wearer can provide up-to-date data of the particular environment in which the wearer has moved to other wearers of similar AR display systems and/or other AI systems.

The behavioral AI system of at least one AI system 430 can also assist the wearer in modifying his or her own behavior. For example, a behavioral AI system can monitor how much exercise a wearer does in a day and plan additional exercises for the wearer according to health AI recommendations. Additionally, the behavioral AI system can be coupled with the diet/nutrition AI system of at least one AI system 430 to recommend meals based on previous meals the wearer has already eaten. Behavioral AI systems can assist the wearer in modifying "bad" habits such as "smoking" by suggesting alternatives to the wearer.

The spatially aware AI system of at least one AI system 430 can help identify and notify the wearer of hazards in the wearer's environment, such as oncoming vehicles as the wearer crosses a street. Additionally, coordination system 420 may coordinate data from sensors and/or camera assemblies 12 of AR smart glasses 410 . Monitors the wearer's environment for hazards including chemical hazards, environmental hazards (e.g., wild animals, poisonous snakes and spiders, etc.), holes in the ground, and environmental waste To that end, the coordination system 420 can further coordinate data from the AR smart glasses 410 with other sensors in the wearer's environment by passing the data to at least one AI system 430 .

Although the invention has been described in detail with particular reference to presently preferred embodiments, it will be understood that variations and modifications can be effected within the spirit and scope of the invention. Accordingly, the presently disclosed embodiments are considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.

It will be appreciated that features of the invention, which are for clarity described in separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in a single embodiment, may also be provided separately or in any appropriate combination.

Claims (21)

A personal display device for displaying a virtual image to a wearer, comprising:
a frame having a right temple portion, a left temple portion, a right rear portion, a left rear portion, a right eye see-through portion, and a left eye see-through portion;
a projection display device coupled to the frame and operable to project an image-bearing light beam;
at least one waveguide stack module coupled to the frame;
with
The at least one waveguide stack module is operable to transmit an image-bearing light beam along its length and is configured to receive the image-bearing light beam from the projection display device; including a ring diffractive optical element and an out-coupling diffractive optical element;
The in-coupling optical element is formed along the at least one waveguide stack module to convert at least a portion of an image-bearing light beam from the projection display device into angularly encoded form in the at least operable to diffract into one waveguide stack module;
The out-coupling diffractive optical element is spaced from the in-coupling diffractive optical element along the length of the at least one waveguide stack module for viewing the image-bearing light beam from the projection display device. and operable to diffract at least a portion of the image-bearing light beam from the at least one waveguide stack module into an angularly decoded form;
a processor connected to the projection display device, a touchpad directly fixed to the frame and connected to the processor, and at least one microphone connected to the processor;
the processor is configured to provide an image to the projection display device;
The touchpad is configured to sense a wearer's touch motion and provide an input touchpad signal to the processor, the input touchpad signal operating to change at least one state of the personal display device. A possibility, wherein sensing a wearer's motion with the touchpad includes sensing a direction of the wearer's touch motion;
The at least one microphone is configured to receive commands from the wearer and to provide an input microphone signal to the processor, the input microphone signal operating to change at least one state of the personal display device. is possible and
The at least one waveguide stack module includes a waveguide housing, the waveguide housing including a waveguide and frame aligner operable to align the waveguide housing and the frame of the personal display device. ,
said projection display device including a projector frame aligner, said projector frame aligner aligning said projection display device and said frame of a personal display device;
The frame of the personal display device includes a waveguide-frame aligner and a projector-waveguide-frame aligner for aligning the projector-frame aligner with the frame of the personal display device, the waveguide-frame. A personal display device , wherein an aligner and said projector-frame aligner abut said projector-waveguide-frame aligner . 2. The personal display of claim 1, further comprising a vibrator connected to said processor, said vibrator configured to receive an input vibrator signal from said processor and provide tactile feedback to a wearer. Device. The in-coupling diffractive optical element and the out-coupling diffractive optical element have a front surface and a back surface, the front surface of the in-coupling diffractive optical element is parallel to the back surface of the in-coupling diffractive optical element, and the 2. The personal display device of Claim 1, wherein a front surface of an outcoupling diffractive optical element is parallel to a back surface of said outcoupling diffractive optical element. 2. The personal display device of Claim 1, further comprising a nose bridge assembly removably attached to said frame between said right eye see-through portion and said left eye see-through portion. 2. The personal display device of claim 1, further comprising an ambient light sensor located on said frame and connected to said processor for detecting changes in ambient light. 6. The personal display device of claim 5, wherein said ambient light sensor is configured to provide a signal to said processor. 7. The personal display apparatus of Claim 6, wherein the processor is configured to modify images transmitted by the projection display device based on signals provided by the ambient light sensor. The waveguide stack module includes a blackening material operable to absorb at least a portion of excess light from the projection display device that passes through the incoupling diffractive optical element. , the personal display device of claim 1. 9. The personal display device of claim 8 , wherein the blackened material is made from at least one of como, carbon feather, actar, and black paint. 2. The waveguide stack module of claim 1 , further comprising an outer cover and an inner cover operable to seal the in-coupling diffractive optical element and the out-coupling diffractive optical element within the waveguide housing. Personal display device as described. the outer cover includes a seal disposed about a periphery of the outer cover, the seal sealing the outer cover to the waveguide housing;
11. The personal display device of claim 10 , wherein said inner cover includes a gasket sealing said inner cover to said waveguide housing. The personal display apparatus of Claim 1, wherein said projection display device comprises a projector, a projector mounting frame, and a display connection module. The projector mounting frame includes alignment pins and the projector frame aligner, the projector frame aligner operable to align the projector mounting frame and the frame of the personal display device , and the projector 13. The personal display device of claim 12 , wherein includes alignment holes configured to receive said alignment pins. 2. The personal display apparatus of claim 1, wherein the projector-waveguide-frame aligner comprises a reference plane for the projection display device and the at least one waveguide stack module. 4. The claim further comprising a left hinge system positioned between the left temple portion and the left rear portion of the frame, and a right hinge system positioned between the right temple portion of the frame and the right rear portion. 2. The personal display device according to claim 1. 16. The personal display device of claim 15 , wherein the left hinge system and the right hinge system comprise flexible cables, hinges, hinge housings and hinge pins. The hinge includes a first half hinge and a second half hinge, the first half hinge and the second half hinge are configured to be rotatably connected by the hinge pin, and the first half hinge has a tab and the second half-hinge has a tab-receiving portion that conceals the flexible cable when the second half-hinge is pivoted relative to the first half-hinge. 17. The personal display device of claim 16. a battery, wherein the flexible cable is configured to bend about the hinge pin, the flexible cable being positioned at least at the left rear portion or the right rear portion of the frame; and the left temple portion or the right temple. 17. The personal display device of claim 16 , connecting a circuit board located in the unit. 2. The personal display device of Claim 1, further comprising at least one rotating diffraction grating positioned between said in-coupling diffractive optical element and said out-coupling diffractive optical element. 13. The personal display device of claim 12 , wherein said display connection module is a prism assembly. The personal display device of claim 1, further comprising a first battery fixed to the right rear portion of the frame and a second battery fixed to the left rear portion of the frame.

Images