US20180308222A1 - Enhanced electronic dive mask system - Google Patents
Enhanced electronic dive mask system Download PDFInfo
- Publication number
- US20180308222A1 US20180308222A1 US15/786,467 US201715786467A US2018308222A1 US 20180308222 A1 US20180308222 A1 US 20180308222A1 US 201715786467 A US201715786467 A US 201715786467A US 2018308222 A1 US2018308222 A1 US 2018308222A1
- Authority
- US
- United States
- Prior art keywords
- diver
- enhanced
- underwater
- dive
- mask
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000009189 diving Effects 0.000 claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 11
- 230000004438 eyesight Effects 0.000 claims abstract description 4
- 238000012545 processing Methods 0.000 claims description 25
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 18
- 230000006870 function Effects 0.000 claims description 12
- 230000000007 visual effect Effects 0.000 claims description 9
- 230000000694 effects Effects 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 3
- 230000004304 visual acuity Effects 0.000 claims description 3
- 238000003491 array Methods 0.000 claims description 2
- 238000002156 mixing Methods 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 26
- 238000003384 imaging method Methods 0.000 abstract description 2
- 238000001356 surgical procedure Methods 0.000 abstract 1
- 230000003287 optical effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000003044 adaptive effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 210000003128 head Anatomy 0.000 description 4
- 230000029058 respiratory gaseous exchange Effects 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 230000002708 enhancing effect Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 239000002245 particle Substances 0.000 description 3
- 239000013049 sediment Substances 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 238000000638 solvent extraction Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 241000251730 Chondrichthyes Species 0.000 description 1
- 241001670157 Gymnura Species 0.000 description 1
- 208000004619 Inert Gas Narcosis Diseases 0.000 description 1
- 241000283203 Otariidae Species 0.000 description 1
- 241000283216 Phocidae Species 0.000 description 1
- 241000490567 Pinctada Species 0.000 description 1
- 206010047531 Visual acuity reduced Diseases 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 235000019994 cava Nutrition 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 239000007789 gas Substances 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004315 low visual acuity Effects 0.000 description 1
- 238000007620 mathematical function Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 235000013372 meat Nutrition 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001932 seasonal effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 239000003643 water by type Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G06T5/003—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B63—SHIPS OR OTHER WATERBORNE VESSELS; RELATED EQUIPMENT
- B63C—LAUNCHING, HAULING-OUT, OR DRY-DOCKING OF VESSELS; LIFE-SAVING IN WATER; EQUIPMENT FOR DWELLING OR WORKING UNDER WATER; MEANS FOR SALVAGING OR SEARCHING FOR UNDERWATER OBJECTS
- B63C11/00—Equipment for dwelling or working underwater; Means for searching for underwater objects
- B63C11/02—Divers' equipment
- B63C11/12—Diving masks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B63—SHIPS OR OTHER WATERBORNE VESSELS; RELATED EQUIPMENT
- B63C—LAUNCHING, HAULING-OUT, OR DRY-DOCKING OF VESSELS; LIFE-SAVING IN WATER; EQUIPMENT FOR DWELLING OR WORKING UNDER WATER; MEANS FOR SALVAGING OR SEARCHING FOR UNDERWATER OBJECTS
- B63C11/00—Equipment for dwelling or working underwater; Means for searching for underwater objects
- B63C11/02—Divers' equipment
- B63C11/12—Diving masks
- B63C11/14—Diving masks with forced air supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B63—SHIPS OR OTHER WATERBORNE VESSELS; RELATED EQUIPMENT
- B63C—LAUNCHING, HAULING-OUT, OR DRY-DOCKING OF VESSELS; LIFE-SAVING IN WATER; EQUIPMENT FOR DWELLING OR WORKING UNDER WATER; MEANS FOR SALVAGING OR SEARCHING FOR UNDERWATER OBJECTS
- B63C11/00—Equipment for dwelling or working underwater; Means for searching for underwater objects
- B63C11/02—Divers' equipment
- B63C11/12—Diving masks
- B63C2011/121—Diving masks comprising integrated optical signalling means or displays for data or images
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
Definitions
- scuba divers Unlike other modes of diving, which rely either on breath-hold or on breathing supplied under pressure from the surface, scuba divers carry their own source of breathing gas, usually compressed air, allowing them greater freedom of movement than with an air-line or diver's umbilical and longer underwater endurance than breath-hold.
- the disclosed invention is a specially constructed electronic dive mask (EDM) system that incorporates a transparent electronic display screen into the viewing window of a divers mask.
- EDM electronic dive mask
- the diver is then able to select either a normal view or an enhanced view or a combination of the two in order to increase visual clarity.
- the diver is able to select a blended view that combines the normal view with an enhanced view to create an augmented view of the surrounding environment to improve situational awareness.
- One of the key requirements for safe scuba diving is the improvement of visibility underwater.
- Low visibility can undermine the purpose of the dive, or make it more difficult or less enjoyable. If the purpose of the dive is discovery or inspection, without good visibility it is not possible to do a thorough job. Low visibility during a dive can be dangerous. It increases the risks and stresses of diving. Unfamiliarity and lack of visibility breed fear and increase stress and air consumption. Entanglements, overheads, and other hazards cannot be seen and are more difficult to escape. Gauges may be impossible to read. Murky waters are often polluted, increasing the risk of infection or disease from a minor scratch or cut. An obvious consideration is that when visibility is limited, divers must take care not to bump into objects that can cause serious injuries: reef structures and sharp edges on wrecks are examples.
- the Oceanic DATAMASK contains a miniature liquid crystal display (LCD) panel, proprietary digital optic system, microprocessor, depth transducer, wireless cylinder pressure receiver, diver replaceable battery, and controlling software.
- the miniature LCD allows you to keep your eyes focused on the dive while presenting critical dive data including: current depth, elapsed dive time, cylinder pressure, and dive time remaining.
- the digital optic system provides a clear, highly magnified image of the LCD, which is viewable regardless of environmental conditions and may be seen clearly by the vast majority of divers, regardless of vision. While this may be considered an advancement in the art, divers require more and more visibility as the scope of underwater tasks becomes more and more complex.
- the electronic dive mask (EDM) invention addresses these challenges with a unique combination of state-of-the-art technology.
- the EDM provides a device that significantly improves visual acuity, and in some embodiments includes the option to monitor critical resources, conditions, threats, provides increased situational awareness, and a capability to support multimodal communications with other divers and topside resources.
- the elements of import include the display mask, a system processing unit, a user interface with controls, and the display mask ancillary functions. According to the present invention, further image enhancement is provided over what has been offered in the past. Notably, advances in other fields such as the medical instrument imaging field have for the first time been incorporated into a diving mask.
- FIG. 1 illustrates the various elements of an enhanced electronic dive mask system according to the present invention.
- FIG. 2 illustrates one or more underwater divers in an environment where the invention may be used to enhance diving experiences and improve safety.
- FIG. 3 is a schematic diagram of a system according to the present invention.
- An enhanced diving mask according to the present invention has a number of critically important components.
- the display mask Central to the EDM (enhanced—electronic diving mask) as set forth herein is the display mask that mounts on the diver's head and through which the diver looks to observe the underwater environment.
- the principal component of the display mask is the transparent display panel (TDP).
- TDP transparent display panel
- the display mask is interconnected with a second critical system component, the system processing unit (SPU) which is discussed separately below.
- optical sensor array that consists of one or more optical sensors (cameras).
- the illustration shows two optical sensors positioned approximately above the diver's eyes to provide a human-like perspective. Additional optical sensors could be positioned to capture views from the sides, top, below, or behind the diver.
- Each optical sensor provides a digital video stream to the SPU that is routed through circuitry that contains mathematical algorithms that remove visual occlusions, enhance visual acuity, and perform other selectable enhancement and measurement functions.
- the enhanced digital video stream can be displayed in real time.
- enhanced imagery is displayed in a resizable “Picture-In-Picture” window on the TDP.
- the diver has parametric control of all aspects on the enhancement window, including size, position, brightness, intensity, and choice of algorithms.
- the diver is then able to select either a normal view or an enhanced view or a combination of the two blended to create an augmented view of the surrounding environment in order to increase visual clarity or improve situational awareness.
- Buttons for user controls are located on the top and side of the mask for easy access.
- Various embodiments optionally include on the mask an acoustical and optical communications receiver and transmitter, or ear bugs.
- imagery from the dive can be wirelessly transmitted from the EDM to viewed by other members of the dive team using nearby devices.
- the EDM thus provides the underwater diver a visually enhanced view as shown in FIG. 1 .
- a system processing unit SPU
- the system processing unit is compact computing platform with a removable battery enclosed in a waterproof case that is intended to be worn by the diver attached on a belt around the waist or arm, for example.
- the SPU is interconnect to the display mask. It provides power for the system. It receives video and still images from the camera and/or optical sensors on the mask. It sends processed video and still images to the display on the mask. It communicates other sensor data between the processing platform and the mask.
- the SPU typically includes a user interface and controls that allow user interaction through a keypad attached to the SPU and buttons on the display mask.
- an optional temperature sensor is included on the SPU.
- status and message indicators are shown on the display mask.
- the SPU includes a data storage device where imagery from the dive can be saved.
- the TDP can provide a general purpose computer display for many types of status messages, alerts, and special purpose software applications resident in the SPU.
- the EDM uses the transparent nature of the display to provide a unique capability for application software designed to assist the diver.
- the SPU provides an overlay capability that enables software applications to “alpha blend” their computer generated text and/or images onto the diver's view varying the visual intensity such that the diver's full field of view is preserved.
- a major advantage of the present invention is the addition of image enhancement algorithms. Enhancing live imagery in real time requires sophisticated image processing techniques and tremendous computational throughput. It requires applying these techniques to incoming video streams without introducing delays.
- the disclosed invention incorporates proprietary real-time video image enhancement technology that implements advanced image processing techniques as algorithms that run on high-performance field-programmable gate arrays (FPGAs). FPGAs provide a suitable processing platform because they allow sophisticated image processing algorithms to be implemented in hardware, where they will run much faster than in software. These image enhancement algorithms can be applied to incoming live video streams to produce dramatically better clarity.
- Standard-Definition (SD) video stream requires about 150 to 200 gigaflops, while a 1,080p stream requires about 1.2 teraflops.
- the disclosed invention utilizes FPGAs because they enable the algorithms to be implemented in hardware where they will operate much faster than in software.
- FPGAs offer deterministic performance, with latencies that are an order of magnitude less than that of GPUs.
- FPGAs require less power because they use parallel processing and, therefore, can achieve required performance at lower clock frequencies than software processors.
- the disclosed invention utilizes several advanced image processing algorithms that can be applied individually or in combination to dramatically improve image clarity and visibility in underwater applications.
- a global de-haze algorithm is also an important aspect of the present invention.
- One of the algorithms used in the present invention is the global de-haze algorithm.
- the global de-haze is designed to take into account the physical processes that go along with atmospheric haze and fog, and the different types of scattering of light underwater or similar phenomena. It tries to take into account the physics of the situation with regard to particular obscuring media that come between the object and the camera. Is it based on knowledge and experience with how different media typically affect the light in terms of treating different wavelengths, or different colors differently, e.g., preferentially using more of the blue or the red, and so on.
- a clarifier algorithm as used in the present invention is a locally adaptive algorithm. Locally adaptive image processing is typically done using a mathematical operation called a convolution kernel. While the underlying mathematics of convolution filtering are complex, performing an image convolution operation is straightforward.
- a convolution kernel generates a new pixel value based on the relationship between the value of the pixel of interest, and the values of those that surround it. In convolution, two functions are overlaid and multiplied by one another. One of the functions is the video frame image and the other is a convolution kernel. The frame image is represented by a large array of numbers that are pixel values in x- and y-axes.
- the convolution kernel is a smaller array, or a mask where values are assigned based on the desired filtering function, for example, blur, sharpen, and edge detection.
- the size of this array referred to as kernel size, determines how many neighboring pixels will be used to generate a new pixel.
- the kernel operates on the image to create one new pixel each time the mask is applied, and, therefore, the operation must be repeated for every pixel in the image.
- Convolutions are computationally intensive and, therefore, most implementations use only small kernels (3 ⁇ 3, 9 ⁇ 9, 16 ⁇ 16).
- the clarifier algorithm is able to implement very large convolution kernels that produce dramatically better results.
- the reason a very large kernel produces better results has to do with the range and variations in brightness over a given area, which is referred to as spatial frequency.
- spatial frequency the range and variations in brightness over a given area
- the clarifier algorithm uses a very large 400 ⁇ 400 kernel and is designed to clarify the image by removing haze and enhancing image detail. This clarifier algorithm is able to achieve remarkable clarity by removing environmental distortions to reveal more of the real image. It improves dynamic range and contrast.
- any multitude of complimentary and non-conflicting algorithms may be used in any combination or in concert to achieve optimal results.
- enhanced results may be achieved according to the present invention.
- the clarifier In many types of imagery, the clarifier on its own will provide excellent results, especially when the imagery already contains deep color. The clarifier produces remarkably clear images and brings out detail better than histogram algorithms. However, it does not improve color and if there is not sufficient color in the source imagery, the clarifier may produce images that appear washed out. Therefore, in some cases, such as in underwater imagery it is useful to first apply the global de-haze algorithm before using the clarifier.
- the global de-haze algorithm is good at enhancing color and especially useful with water, haze or fog, or other situations where there is not much color.
- another locally adaptive algorithm such as the clarifier
- the problem with running the locally adaptive clarifier first, is that it would filter out information necessary for the global operation. After the global de-haze removes environmental distortion, then the clarifier locally adaptive algorithm will be more effective working at improve the visibility of low local contrast features of the image than if it were run by itself.
- FIG. 2 An example of which is shown in FIG. 2 .
- images of the surrounding environment are captured by one of more cameras on the dive mask.
- the diver enables the image enhancement feature of the system through the user interface.
- Video streams from the camera are transmitted live to the system processing unit.
- the input video stream is routed through the image processing algorithms within the SPU where the imagery is enhanced to improve visual clarity.
- the enhanced imagery is transmitted to the display screen inside the dive mask.
- the diver can disable or enable the enhancement feature through the user interface. If the diver has enabled record of the video stream, then it will be saved to a data storage device within the SPU.
- FIG. 1 further illustrates the various elements of the electronic dive mask system according to an embodiment of the invention.
- the system includes an electronic dive mask 100 that is connected by an electrical cable 151 to the system processing unit (SPU) 150 .
- the dive mask 100 includes the transparent computer display 101 where a portion of the display is designated as the visual enhancement window 102 . A portion of the display may also be used to display status and messages 105 .
- One or more cameras may be built into the mask 104 or they may be attached separately (not shown).
- the mask may optional include earbuds 107 for communicating with members of the dive team. Control buttons 103 are conveniently located on the mask so the diver can interact with the user interface to enable or disable enhancement features.
- Acoustic and optical communications receivers and transmitters 106 to allow communications with members of the dive team.
- a head strap 159 is used to secure the mask to the diver's head.
- the SPU is included in a waterproof enclosure 150 which houses the electronic circuit board 152 .
- the electronic circuit board 152 includes an FPGA 157 which is programmed to contain the image processing algorithms and a CPU 158 which runs the user interface and other system control functions.
- Other electronic components such as memory and input/output interfaces which are typically part of an embedded computer are incorporated into the electronic circuit board (not shown).
- Also located within the enclosure is a removable battery 153 that provides power to the entire system.
- a keyboard 154 is attached to the SPU for the diver to interact with the system. Additional components are a temperature sensor 156 and a connector for other external sensors 156 .
- the SPU is attached to the diver's body using a belt or strap (not shown).
- FIG. 2 illustrates an underwater environment where the invention may be used by divers to improve the diver's visual clarity, enhance the diving experiences and improve safety.
- FIG. 3 further illustrates the various elements of the electronic dive mask system according to an embodiment of the invention.
- a diver may wish to view enhanced imagery of the surrounding scenery.
- the diver presses one of the push button controls 305 located on the electronic dive mask 300 .
- This sends a signal to the user interface software in the CPU unit 306 located in the system processing unit (SPU) 302 which sends instructions to the FPGA 303 to display a picture-in-picture window within the viewing window of the diver's mask.
- the user interface software will also send instructions to activate the camera 301 on the dive mask 300 if it is not already active.
- a video stream is sent from the camera 301 to the FPGA 303 which applies image enhancement algorithms to the imagery on a frame-by-frame basis.
- the enhanced imagery is then sent to the transparent display 304 on the electronic dive mask 300 where it is displayed within the picture-in-picture window of the transparent display 304 .
- the diver may wish to record the imagery captured by the camera. To do so, the diver presses one of the push button controls 305 located on the electronic dive mask 300 . This sends a signal to the user interface software in the CPU unit 306 located in the system processing unit (SPU) 302 which sends instructions to the data storage unit 307 to record or save any imagery sent from the camera 301 to the non-volatile storage media.
- the recorded imagery may be imagery from the camera 301 the is either enhanced or not enhanced depending on the instructions entered by the diver using the push buttons controls 305 on the electronic dive mask 300 or the keyboard 308 attached to the system processing unit (SPU) 302 .
- module does not imply that the components or functionality described or claimed as part of the module are all configured in a common package. Indeed, any or all of the various components of a module, whether control logic or other components, may be combined in a single package or separately maintained and can further be distributed in multiple groupings or packages or across multiple locations.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Ocean & Marine Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to an enhanced electronic diving mask with various image enhancement hardware and software integrated with a diving mask, whereby images may be enhanced to enable a diver to achieve greater visibility and clearer vision while underwater. Notably, the present invention combines techniques that have previously been used in connection with internal patient surgical procedures, so that medical instrument imaging technology used inside the human body may for the first time be used to afford divers clearer vision, more visibility and greater safety.
Description
- This application claims the benefit of U.S. Provisional Patent Application No. 62/409,315, filed on Oct. 17, 2016, the contents of which are incorporated herein by reference.
- The ocean covers 71 percent of the earth's surface. Since the dawn of human existence, people have entered the water to collect food. There are artifacts indicating that the people of Mesopotamia engaged in diving to collect pearl oysters as long as 4,500 years ago. The origins of diving trace back to the being of human history. Over time, divers learned to equalize ear pressure as they descended to deeper depths. Eventually, the desire to go deeper and stay underwater for longer periods of time led to the development of systems for underwater breathing, such as helmets supplied with pressurized air through an attached hose. Today one of the most popular means of underwater exploration is scuba diving, where a diver uses a self-contained underwater breathing apparatus (scuba) to breathe underwater. Unlike other modes of diving, which rely either on breath-hold or on breathing supplied under pressure from the surface, scuba divers carry their own source of breathing gas, usually compressed air, allowing them greater freedom of movement than with an air-line or diver's umbilical and longer underwater endurance than breath-hold.
- Scuba diving is popular recreationally and professionally in a number of applications including scientific, military and public safety roles. However, for commercial diving it is more common to use surface supplied diving equipment when this is practicable. In either case, with the ability to breathe underwater, divers can now function underwater for extended periods of time and descend to greater depths. However, in order to safely move freely and fully explore the underwater environment, divers also need to be able to see clearly in a wide variety of challenging conditions. Even in ideal conditions, it is generally more difficult to see underwater than through air and typically, underwater viewing conditions are far from ideal. The disclosed invention is a specially constructed electronic dive mask (EDM) system that incorporates a transparent electronic display screen into the viewing window of a divers mask. The diver is then able to select either a normal view or an enhanced view or a combination of the two in order to increase visual clarity. In some embodiments the diver is able to select a blended view that combines the normal view with an enhanced view to create an augmented view of the surrounding environment to improve situational awareness. One of the key requirements for safe scuba diving is the improvement of visibility underwater.
- The human eye sees better through air than through water. One of the reason for this is that water is 800 times denser than air. As result, when light enters water, it interacts with the water molecules and particles, resulting in loss of light intensity, color changes, diffusion, loss of contrast and other effects. To get a sense of this effect, consider that an underwater photo of an object one meter away, will be similar to a photo above water at 800 meters. Both photos will look bluish and lack contrast.
- Another factor affecting visibility underwater is that sunlight is reflected by the surface of the water and this causes significant changes in visibility and the perception of color underwater. Furthermore, different wavelengths are absorbed differently as the light passes through the water. The shorter the wavelength, the deeper (longer) it will reach before being absorbed. This causes objects to lose their color as a diver goes deeper down or further away.
- The most common cause of reduced visibility are particles—live or otherwise—in the water. Bright particles in water reflect and scatter light, resulting in diffusion. A sandy or muddy bottom can easily be kicked up and with small particles it can take a while before the sediment settles again. Shipwrecks and caves are particularly prone to fine silt.
- The impact of rough water also affects visibility. Waves and other turbulence will reflect light and cause it to scatter more than a smooth plane. Weather and seasonal factors also come into play. Water run-off from mountains in the spring can increase the velocity of water flow in rivers. This in turn results in more sediment being picked up and carried into nearby bodies of water. From there, prevailing currents can carry the sediment to the dive site. Low visibility creates a multitude of safety risks.
- Low visibility can undermine the purpose of the dive, or make it more difficult or less enjoyable. If the purpose of the dive is discovery or inspection, without good visibility it is not possible to do a thorough job. Low visibility during a dive can be dangerous. It increases the risks and stresses of diving. Unfamiliarity and lack of visibility breed fear and increase stress and air consumption. Entanglements, overheads, and other hazards cannot be seen and are more difficult to escape. Gauges may be impossible to read. Murky waters are often polluted, increasing the risk of infection or disease from a minor scratch or cut. An obvious consideration is that when visibility is limited, divers must take care not to bump into objects that can cause serious injuries: reef structures and sharp edges on wrecks are examples.
- Some sites are plagued by current as well as by low visibility. When current is present, it is easy to drift off course and become separated from diving buddies. Marine life can pose a serious hazard in low visibility. This can happen because often these animals are on high alert due to an inability to see well. If a diver surprises an animal, it is more likely to attack. Sharks, seals and sea lions, stingrays, and smaller animals are just a few creatures that might feel the need to defend themselves when startled. Panic can happen to anyone, particularly if nitrogen narcosis begins to set in during a low-visibility situation. Divers need to be extra cautious and pay close attention to how they feel while diving at low visibility to prevent problems.
- Companies like Oceanic offer diving masks with heads up displays. The Oceanic DATAMASK contains a miniature liquid crystal display (LCD) panel, proprietary digital optic system, microprocessor, depth transducer, wireless cylinder pressure receiver, diver replaceable battery, and controlling software. The miniature LCD allows you to keep your eyes focused on the dive while presenting critical dive data including: current depth, elapsed dive time, cylinder pressure, and dive time remaining. The digital optic system provides a clear, highly magnified image of the LCD, which is viewable regardless of environmental conditions and may be seen clearly by the vast majority of divers, regardless of vision. While this may be considered an advancement in the art, divers require more and more visibility as the scope of underwater tasks becomes more and more complex.
- Underwater divers work in a very difficult environment. Many challenges must be overcome to perform essential tasks—whether maintaining underwater structures, military missions, or recreational activities. As previously noted, a primary challenge divers must deal with is poor vision. Poor contrast, lack of light, cloudy water, and water turbulence all contribute to poor visual acuity. Additionally, a diver must maintain persistent awareness of the environment and monitor a multitude of threats. Temporal considerations limit exposure to depth pressure, remaining oxygen supply, and body temperature. Even external threats must be monitored, be they from predatory sea life, hostile military forces, or unexpected changes in the environment. Adding to these challenges is the difficulty of communicating with other divers and topside personnel. Working underwater is both physically and mentally challenging and characterized by high risk.
- The electronic dive mask (EDM) invention addresses these challenges with a unique combination of state-of-the-art technology. The EDM provides a device that significantly improves visual acuity, and in some embodiments includes the option to monitor critical resources, conditions, threats, provides increased situational awareness, and a capability to support multimodal communications with other divers and topside resources.
- The elements of import include the display mask, a system processing unit, a user interface with controls, and the display mask ancillary functions. According to the present invention, further image enhancement is provided over what has been offered in the past. Notably, advances in other fields such as the medical instrument imaging field have for the first time been incorporated into a diving mask.
- These and other aspects, objects, features and advantages of the present invention, are specifically set forth in, or will become apparent from, the following detailed description of an exemplary embodiment of the invention.
-
FIG. 1 illustrates the various elements of an enhanced electronic dive mask system according to the present invention. -
FIG. 2 illustrates one or more underwater divers in an environment where the invention may be used to enhance diving experiences and improve safety. -
FIG. 3 is a schematic diagram of a system according to the present invention. - An enhanced diving mask according to the present invention has a number of critically important components. Central to the EDM (enhanced—electronic diving mask) as set forth herein is the display mask that mounts on the diver's head and through which the diver looks to observe the underwater environment. The principal component of the display mask is the transparent display panel (TDP). The display mask is interconnected with a second critical system component, the system processing unit (SPU) which is discussed separately below.
- Also critical to the system is the optical sensor array that consists of one or more optical sensors (cameras). The illustration shows two optical sensors positioned approximately above the diver's eyes to provide a human-like perspective. Additional optical sensors could be positioned to capture views from the sides, top, below, or behind the diver.
- Each optical sensor provides a digital video stream to the SPU that is routed through circuitry that contains mathematical algorithms that remove visual occlusions, enhance visual acuity, and perform other selectable enhancement and measurement functions. The enhanced digital video stream can be displayed in real time. In one embodiment, enhanced imagery is displayed in a resizable “Picture-In-Picture” window on the TDP. The diver has parametric control of all aspects on the enhancement window, including size, position, brightness, intensity, and choice of algorithms. In an alternative embodiment, the diver is then able to select either a normal view or an enhanced view or a combination of the two blended to create an augmented view of the surrounding environment in order to increase visual clarity or improve situational awareness.
- Buttons for user controls are located on the top and side of the mask for easy access. Various embodiments optionally include on the mask an acoustical and optical communications receiver and transmitter, or ear bugs. In some embodiments, imagery from the dive can be wirelessly transmitted from the EDM to viewed by other members of the dive team using nearby devices.
- The EDM thus provides the underwater diver a visually enhanced view as shown in
FIG. 1 . In addition, according to the present invention, a system processing unit (SPU) is required. The system processing unit is compact computing platform with a removable battery enclosed in a waterproof case that is intended to be worn by the diver attached on a belt around the waist or arm, for example. The SPU is interconnect to the display mask. It provides power for the system. It receives video and still images from the camera and/or optical sensors on the mask. It sends processed video and still images to the display on the mask. It communicates other sensor data between the processing platform and the mask. - In addition, according to the present invention, user interface and controls are provided. The SPU typically includes a user interface and controls that allow user interaction through a keypad attached to the SPU and buttons on the display mask. In some embodiments, an optional temperature sensor is included on the SPU. In some embodiments, status and message indicators are shown on the display mask. In some embodiments, the SPU includes a data storage device where imagery from the dive can be saved.
- According to the present invention, a display mask with ancillary functions is taught and disclosed. In addition to the EDM's capability of providing an algorithmically enhanced view, in some embodiments the TDP can provide a general purpose computer display for many types of status messages, alerts, and special purpose software applications resident in the SPU.
- The EDM uses the transparent nature of the display to provide a unique capability for application software designed to assist the diver. The SPU provides an overlay capability that enables software applications to “alpha blend” their computer generated text and/or images onto the diver's view varying the visual intensity such that the diver's full field of view is preserved.
- A major advantage of the present invention is the addition of image enhancement algorithms. Enhancing live imagery in real time requires sophisticated image processing techniques and tremendous computational throughput. It requires applying these techniques to incoming video streams without introducing delays. The disclosed invention incorporates proprietary real-time video image enhancement technology that implements advanced image processing techniques as algorithms that run on high-performance field-programmable gate arrays (FPGAs). FPGAs provide a suitable processing platform because they allow sophisticated image processing algorithms to be implemented in hardware, where they will run much faster than in software. These image enhancement algorithms can be applied to incoming live video streams to produce dramatically better clarity.
- Using sophisticated algorithms to apply mathematical functions to the image matrix, it is possible to reveal hidden layers of visual information without losing detail. This is a purely mathematical approach that utilizes all of the available image information, including portions that are not normally visible to the human eye. A large body of image processing algorithms exists that use techniques including histogram manipulation, convolution, morphology, over- and under sampling, quantization, and spectral processing, including Fourier transforms and Discrete Cosine Transforms (DCTs). These algorithms are in general computationally intensive. Conventional processor technology does not offer the performance necessary to keep pace with the demands of full motion video at up to 60 frames per second (fps), or one frame every 16.67 milliseconds. Processing a Standard-Definition (SD) video stream requires about 150 to 200 gigaflops, while a 1,080p stream requires about 1.2 teraflops. The disclosed invention utilizes FPGAs because they enable the algorithms to be implemented in hardware where they will operate much faster than in software. FPGAs offer deterministic performance, with latencies that are an order of magnitude less than that of GPUs. Furthermore, FPGAs require less power because they use parallel processing and, therefore, can achieve required performance at lower clock frequencies than software processors.
- The disclosed invention utilizes several advanced image processing algorithms that can be applied individually or in combination to dramatically improve image clarity and visibility in underwater applications. A global de-haze algorithm is also an important aspect of the present invention. One of the algorithms used in the present invention is the global de-haze algorithm. The global de-haze is designed to take into account the physical processes that go along with atmospheric haze and fog, and the different types of scattering of light underwater or similar phenomena. It tries to take into account the physics of the situation with regard to particular obscuring media that come between the object and the camera. Is it based on knowledge and experience with how different media typically affect the light in terms of treating different wavelengths, or different colors differently, e.g., preferentially using more of the blue or the red, and so on. It then attempts to organize the reconstruction of the image in ways that make sense with the physics in the situation. Like histogram-based algorithms, global de-haze looks at the statistics of the data from the entire image, decides what types of corrections to make, and then applies those corrections by doing the same operation to the entire image. The difference is that it with global de-haze, the gains and offsets applied tend to be more linear because the processes in the physics that degrade image data are correspondingly linear, and the algorithm attempts to mirror those effects.
- In addition to a de-haze algorithm, the present invention utilizes a clarifier algorithm. A clarifier algorithm as used in the present invention is a locally adaptive algorithm. Locally adaptive image processing is typically done using a mathematical operation called a convolution kernel. While the underlying mathematics of convolution filtering are complex, performing an image convolution operation is straightforward. A convolution kernel generates a new pixel value based on the relationship between the value of the pixel of interest, and the values of those that surround it. In convolution, two functions are overlaid and multiplied by one another. One of the functions is the video frame image and the other is a convolution kernel. The frame image is represented by a large array of numbers that are pixel values in x- and y-axes. The convolution kernel is a smaller array, or a mask where values are assigned based on the desired filtering function, for example, blur, sharpen, and edge detection. The size of this array, referred to as kernel size, determines how many neighboring pixels will be used to generate a new pixel. In convolution, the kernel operates on the image to create one new pixel each time the mask is applied, and, therefore, the operation must be repeated for every pixel in the image.
- Convolutions are computationally intensive and, therefore, most implementations use only small kernels (3×3, 9×9, 16×16). However, using unique, nontraditional programming techniques, the clarifier algorithm is able to implement very large convolution kernels that produce dramatically better results. The reason a very large kernel produces better results has to do with the range and variations in brightness over a given area, which is referred to as spatial frequency. By considering the data in a large neighborhood that is centered around each pixel as it is being processed, a large kernel includes a much greater range of spatial frequencies.
- Traditional small kernel processing can only enhance details in the very highest spatial frequencies, which typically contain little of the spectral content (full range of color) of the image, and where noise is prevalent. Hence, small kernel processors must employ high gain to have much noticeable effect on the image. High gain tends to produce sharp outlining artifacts and increases visible noise. Large kernel processing (operating on much more of the “meat” of the image) can produce dramatic results with much lower gain, with the additional benefits of large area shading, yielding much more natural-appearing images with increased local contrast, added dimensionality, and improved visibility of subtle details and features.
- The clarifier algorithm uses a very large 400×400 kernel and is designed to clarify the image by removing haze and enhancing image detail. This clarifier algorithm is able to achieve remarkable clarity by removing environmental distortions to reveal more of the real image. It improves dynamic range and contrast.
- Naturally, according to the present invention, any multitude of complimentary and non-conflicting algorithms may be used in any combination or in concert to achieve optimal results. By combining algorithms, enhanced results may be achieved according to the present invention. In many types of imagery, the clarifier on its own will provide excellent results, especially when the imagery already contains deep color. The clarifier produces remarkably clear images and brings out detail better than histogram algorithms. However, it does not improve color and if there is not sufficient color in the source imagery, the clarifier may produce images that appear washed out. Therefore, in some cases, such as in underwater imagery it is useful to first apply the global de-haze algorithm before using the clarifier.
- The global de-haze algorithm is good at enhancing color and especially useful with water, haze or fog, or other situations where there is not much color. When using the global de-haze with another locally adaptive algorithm such as the clarifier, it is usually preferable to apply it first. This is because, by its nature, it attempts to undo what the physics of the haze or other distortion did to the light initially. The problem with running the locally adaptive clarifier first, is that it would filter out information necessary for the global operation. After the global de-haze removes environmental distortion, then the clarifier locally adaptive algorithm will be more effective working at improve the visibility of low local contrast features of the image than if it were run by itself.
- Before describing the invention in detail, it is useful to describe an exemplary environment within which the invention can be implemented. One such example is that of a diver or divers on a military mission, an example of which is shown in
FIG. 2 . While executing an underwater dive mission, images of the surrounding environment are captured by one of more cameras on the dive mask. The diver enables the image enhancement feature of the system through the user interface. Video streams from the camera are transmitted live to the system processing unit. The input video stream is routed through the image processing algorithms within the SPU where the imagery is enhanced to improve visual clarity. The enhanced imagery is transmitted to the display screen inside the dive mask. At any time during the dive, the diver can disable or enable the enhancement feature through the user interface. If the diver has enabled record of the video stream, then it will be saved to a data storage device within the SPU. -
FIG. 1 . further illustrates the various elements of the electronic dive mask system according to an embodiment of the invention. The system includes anelectronic dive mask 100 that is connected by anelectrical cable 151 to the system processing unit (SPU) 150. Thedive mask 100 includes thetransparent computer display 101 where a portion of the display is designated as thevisual enhancement window 102. A portion of the display may also be used to display status andmessages 105. One or more cameras may be built into themask 104 or they may be attached separately (not shown). The mask may optional includeearbuds 107 for communicating with members of the dive team.Control buttons 103 are conveniently located on the mask so the diver can interact with the user interface to enable or disable enhancement features. Acoustic and optical communications receivers andtransmitters 106 to allow communications with members of the dive team. Ahead strap 159 is used to secure the mask to the diver's head. - The SPU is included in a
waterproof enclosure 150 which houses theelectronic circuit board 152. Theelectronic circuit board 152 includes anFPGA 157 which is programmed to contain the image processing algorithms and aCPU 158 which runs the user interface and other system control functions. Other electronic components such as memory and input/output interfaces which are typically part of an embedded computer are incorporated into the electronic circuit board (not shown). Also located within the enclosure is aremovable battery 153 that provides power to the entire system. Akeyboard 154 is attached to the SPU for the diver to interact with the system. Additional components are atemperature sensor 156 and a connector for otherexternal sensors 156. The SPU is attached to the diver's body using a belt or strap (not shown). -
FIG. 2 . illustrates an underwater environment where the invention may be used by divers to improve the diver's visual clarity, enhance the diving experiences and improve safety. -
FIG. 3 . further illustrates the various elements of the electronic dive mask system according to an embodiment of the invention. During an underwater dive, a diver may wish to view enhanced imagery of the surrounding scenery. To enable enhanced imagery, the diver presses one of the push button controls 305 located on theelectronic dive mask 300. This sends a signal to the user interface software in theCPU unit 306 located in the system processing unit (SPU) 302 which sends instructions to theFPGA 303 to display a picture-in-picture window within the viewing window of the diver's mask. The user interface software will also send instructions to activate thecamera 301 on thedive mask 300 if it is not already active. Once the image enhancement feature is enabled, a video stream is sent from thecamera 301 to theFPGA 303 which applies image enhancement algorithms to the imagery on a frame-by-frame basis. The enhanced imagery is then sent to thetransparent display 304 on theelectronic dive mask 300 where it is displayed within the picture-in-picture window of thetransparent display 304. In some cases, the diver may wish to record the imagery captured by the camera. To do so, the diver presses one of the push button controls 305 located on theelectronic dive mask 300. This sends a signal to the user interface software in theCPU unit 306 located in the system processing unit (SPU) 302 which sends instructions to thedata storage unit 307 to record or save any imagery sent from thecamera 301 to the non-volatile storage media. The recorded imagery may be imagery from thecamera 301 the is either enhanced or not enhanced depending on the instructions entered by the diver using the push buttons controls 305 on theelectronic dive mask 300 or thekeyboard 308 attached to the system processing unit (SPU) 302. - While various embodiments of the disclosed technology have been described above, it should be understood that they have been presented by way of example only, and not of limitation. Likewise, the various diagrams may depict an example architectural or other configuration for the disclosed technology, which is done to aid in understanding the features and functionality that may be included in the disclosed technology. The disclosed technology is not restricted to the illustrated example architectures or configurations, but the desired features may be implemented using a variety of alternative architectures and configurations. Indeed, it will be apparent to one of skill in the art how alternative functional, logical or physical partitioning and configurations may be implemented to implement the desired features of the technology disclosed herein. Also, a multitude of different constituent module names other than those depicted herein may be applied to the various partitions. Additionally, with regard to flow diagrams, operational descriptions and method claims, the order in which the steps are presented herein shall not mandate that various embodiments be implemented to perform the recited functionality in the same order unless the context dictates otherwise.
- Although the disclosed technology is described above in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead may be applied, alone or in various combinations, to one or more of the other embodiments of the disclosed technology, whether or not such embodiments are described and whether or not such features are presented as being a part of a described embodiment. Thus, the breadth and scope of the technology disclosed herein should not be limited by any of the above-described exemplary embodiments.
- Terms and phrases used in this document, and variations thereof, unless otherwise expressly stated, should be construed as open ended as opposed to limiting. As examples of the foregoing: the term “including” should be read as meaning “including, without limitation” or the like; the term “example” is used to provide exemplary instances of the item in discussion, not an exhaustive or limiting list thereof; the terms “a” or “an” should be read as meaning “at least one,” “one or more” or the like; and adjectives such as “conventional,” “traditional,” “normal,” “standard,” “known” and terms of similar meaning should not be construed as limiting the item described to a given time period or to an item available as of a given time, but instead should be read to encompass conventional, traditional, normal, or standard technologies that may be available or known now or at any time in the future. Likewise, where this document refers to technologies that would be apparent or known to one of ordinary skill in the art, such technologies encompass those apparent or known to the skilled artisan now or at any time in the future.
- While various embodiments of the disclosed technology have been described above, it should be understood that they have been presented by way of example only, and not of limitation. Likewise, the various diagrams may depict an example architectural or other configuration for the disclosed technology, which is done to aid in understanding the features and functionality that may be included in the disclosed technology. The disclosed technology is not restricted to the illustrated example architectures or configurations, but the desired features may be implemented using a variety of alternative architectures and configurations. Indeed, it will be apparent to one of skill in the art how alternative functional, logical or physical partitioning and configurations may be implemented to implement the desired features of the technology disclosed herein. Also, a multitude of different constituent module names other than those depicted herein may be applied to the various partitions. Additionally, with regard to flow diagrams, operational descriptions and method claims, the order in which the steps are presented herein shall not mandate that various embodiments be implemented to perform the recited functionality in the same order unless the context dictates otherwise.
- Although the disclosed technology is described above in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead may be applied, alone or in various combinations, to one or more of the other embodiments of the disclosed technology, whether or not such embodiments are described and whether or not such features are presented as being a part of a described embodiment. Thus, the breadth and scope of the technology disclosed herein should not be limited by any of the above-described exemplary embodiments.
- Terms and phrases used in this document, and variations thereof, unless otherwise expressly stated, should be construed as open ended as opposed to limiting. As examples of the foregoing: the term “including” should be read as meaning “including, without limitation” or the like; the term “example” is used to provide exemplary instances of the item in discussion, not an exhaustive or limiting list thereof; the terms “a” or “an” should be read as meaning “at least one,” “one or more” or the like; and adjectives such as “conventional,” “traditional,” “normal,” “standard,” “known” and terms of similar meaning should not be construed as limiting the item described to a given time period or to an item available as of a given time, but instead should be read to encompass conventional, traditional, normal, or standard technologies that may be available or known now or at any time in the future. Likewise, where this document refers to technologies that would be apparent or known to one of ordinary skill in the art, such technologies encompass those apparent or known to the skilled artisan now or at any time in the future.
- The presence of broadening words and phrases such as “one or more,” “at least,” “but not limited to” or other like phrases in some instances shall not be read to mean that the narrower case is intended or required in instances where such broadening phrases may be absent. The use of the term “module” does not imply that the components or functionality described or claimed as part of the module are all configured in a common package. Indeed, any or all of the various components of a module, whether control logic or other components, may be combined in a single package or separately maintained and can further be distributed in multiple groupings or packages or across multiple locations.
- Additionally, the various embodiments set forth herein are described in terms of exemplary block diagrams, flow charts and other illustrations. As will become apparent to one of ordinary skill in the art after reading this document, the illustrated embodiments and their various alternatives may be implemented without confinement to the illustrated examples. For example, block diagrams and their accompanying description should not be construed as mandating a particular architecture or configuration.
- Embodiments presented are particular ways to realize the invention and are not inclusive of all ways possible. Therefore, there may exist embodiments that do not deviate from the spirit and scope of this disclosure as set forth by appended claims, but do not appear here as specific examples. It will be appreciated that a great plurality of alternative versions are possible.
Claims (5)
1. A user programmable computer for use by an underwater diver, for processing visual data obtained underwater or related to underwater activities, comprising:
a computer processor coupled to one or more data storage devices, volatile and non-volatile memory devices, one or more data input devices, and an enhanced display device for displaying images from an underwater source;
a housing capable of withstanding dive pressures while protecting said enhanced display device and associated electronics from the ambient environment;
a dive helmet adapted to secure said enhanced display device within eyesight of a diver such that the display device is readily visible to said diver, and whereby said diver, while under water, utilizes the one or more data input devices or to input data, store data in the data storage device and process the data so as to cause said programmable computer to function providing a display of such functions visibly to the diver; and
wherein said diver may actuate various image enhancement functions provided by said programmable computer to create enhanced images to be displayed upon said enhanced display device.
2. The device according to claim 1 wherein said programmable computer includes visual acuity software for providing an enhanced image to said diver.
3. The device according to claim 1 wherein a de-hazing function is provided by said programmable computer wherein said diver may eliminate the effects of a diving mask that is cloudy due to usage in a moist environment.
4. The device according to claim 1 wherein high performance filed-programmable gate arrays provide said enhanced images.
5. The device according to claim 1 wherein alpha-blending is used to provide images and messages for display to said diver.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/786,467 US20180308222A1 (en) | 2016-10-17 | 2017-10-17 | Enhanced electronic dive mask system |
US16/542,052 US10902565B2 (en) | 2016-10-17 | 2019-08-15 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/127,756 US20210209736A1 (en) | 2016-10-17 | 2020-12-18 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/991,828 US20230177657A1 (en) | 2016-10-17 | 2022-11-21 | Enhanced electronic dive mask display system incorporating an image enhancement and clarification processor with data storage |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662409315P | 2016-10-17 | 2016-10-17 | |
US15/786,467 US20180308222A1 (en) | 2016-10-17 | 2017-10-17 | Enhanced electronic dive mask system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/542,052 Continuation US10902565B2 (en) | 2016-10-17 | 2019-08-15 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180308222A1 true US20180308222A1 (en) | 2018-10-25 |
Family
ID=63852330
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/786,467 Abandoned US20180308222A1 (en) | 2016-10-17 | 2017-10-17 | Enhanced electronic dive mask system |
US16/542,052 Active US10902565B2 (en) | 2016-10-17 | 2019-08-15 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/127,756 Abandoned US20210209736A1 (en) | 2016-10-17 | 2020-12-18 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/991,828 Pending US20230177657A1 (en) | 2016-10-17 | 2022-11-21 | Enhanced electronic dive mask display system incorporating an image enhancement and clarification processor with data storage |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/542,052 Active US10902565B2 (en) | 2016-10-17 | 2019-08-15 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/127,756 Abandoned US20210209736A1 (en) | 2016-10-17 | 2020-12-18 | Enhanced electronic dive mask system incorporating image enhancement and clarification processing |
US17/991,828 Pending US20230177657A1 (en) | 2016-10-17 | 2022-11-21 | Enhanced electronic dive mask display system incorporating an image enhancement and clarification processor with data storage |
Country Status (1)
Country | Link |
---|---|
US (4) | US20180308222A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111669516A (en) * | 2020-06-19 | 2020-09-15 | 江苏镭博智能科技有限公司 | Method for realizing transverse splicing of eight paths of video data and real-time synchronization of IMU (inertial measurement Unit) data based on FPGA (field programmable Gate array) |
CN112363680A (en) * | 2020-10-10 | 2021-02-12 | 深圳闪闪亮亮科技有限公司 | Electronic mask control system |
US11760451B1 (en) * | 2019-08-22 | 2023-09-19 | Preferred Industries, Inc. | Full face diving mask with breathing tube and still photo and video imaging capability |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11710245B2 (en) * | 2020-02-25 | 2023-07-25 | Jack Wade | Real-time marine snow noise removal from underwater video |
KR102549902B1 (en) * | 2021-03-05 | 2023-06-29 | 신현실 | Underwater AR display device for marine safety education |
CN113189927B (en) * | 2021-04-19 | 2022-04-29 | 杭州电子科技大学 | Intelligent diving monitoring system based on multi-mode technology |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6008780A (en) * | 1993-02-19 | 1999-12-28 | Bg Plc | Diver communication equipment |
US6694911B1 (en) * | 2002-04-05 | 2004-02-24 | The United States Of America As Represented By The Secretary Of The Navy | Enhanced display- underwater combat swim board |
US7477207B2 (en) * | 2000-06-23 | 2009-01-13 | Trilithic, Inc | Diving mask with embedded computer system |
US20090279269A1 (en) * | 2008-05-08 | 2009-11-12 | Qbas Co., Ltd. | Waterproof method for electronic device and waterproof electronic device |
US20100091195A1 (en) * | 2008-10-09 | 2010-04-15 | Mstar Semiconductor, Inc. | De-ringing Device and Method |
US20100259651A1 (en) * | 2009-04-08 | 2010-10-14 | Raanan Fattal | Method, apparatus and computer program product for single image de-hazing |
US20120281054A1 (en) * | 2011-05-06 | 2012-11-08 | David Dwight Cook | Integrated System for Underwater Viewing and Communications in Turbid Water |
US20140254943A1 (en) * | 2013-03-11 | 2014-09-11 | Adobe Systems Incorporated | Optical Flow Accounting for Image Haze |
US9047873B2 (en) * | 2012-12-21 | 2015-06-02 | Draeger Safety, Inc. | Self contained breathing and communication apparatus |
US20150379772A1 (en) * | 2014-06-30 | 2015-12-31 | Samsung Display Co., Ltd. | Tracking accelerator for virtual and augmented reality displays |
US20160099751A1 (en) * | 2014-10-02 | 2016-04-07 | Raytheon Company | Methods and apparatus for underwater electrical near-field signal system |
US20170006039A1 (en) * | 2015-06-30 | 2017-01-05 | Mist Systems, Inc. | Access enforcement at a wireless access point |
US20170060399A1 (en) * | 2015-08-25 | 2017-03-02 | Evolution Optiks Limited | Vision correction system, method and graphical user interface for implementation on electronic devices having a graphical display |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6208354B1 (en) * | 1998-11-03 | 2001-03-27 | Ati International Srl | Method and apparatus for displaying multiple graphics images in a mixed video graphics display |
US7180476B1 (en) * | 1999-06-30 | 2007-02-20 | The Boeing Company | Exterior aircraft vision system using a helmet-mounted display |
GB2418094B (en) * | 2004-09-10 | 2010-05-12 | Medicsight Plc | User interface for CT scan analysis |
US8724919B2 (en) * | 2012-09-21 | 2014-05-13 | Eastman Kodak Company | Adjusting the sharpness of a digital image |
US10319116B1 (en) * | 2014-12-02 | 2019-06-11 | Amazon Technologies, Inc. | Dynamic color adjustment of electronic content |
US9830713B1 (en) * | 2015-12-17 | 2017-11-28 | Rockwell Collins, Inc. | Surveillance imaging system and method |
US10667981B2 (en) * | 2016-02-29 | 2020-06-02 | Mentor Acquisition One, Llc | Reading assistance system for visually impaired |
-
2017
- 2017-10-17 US US15/786,467 patent/US20180308222A1/en not_active Abandoned
-
2019
- 2019-08-15 US US16/542,052 patent/US10902565B2/en active Active
-
2020
- 2020-12-18 US US17/127,756 patent/US20210209736A1/en not_active Abandoned
-
2022
- 2022-11-21 US US17/991,828 patent/US20230177657A1/en active Pending
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6008780A (en) * | 1993-02-19 | 1999-12-28 | Bg Plc | Diver communication equipment |
US7477207B2 (en) * | 2000-06-23 | 2009-01-13 | Trilithic, Inc | Diving mask with embedded computer system |
US6694911B1 (en) * | 2002-04-05 | 2004-02-24 | The United States Of America As Represented By The Secretary Of The Navy | Enhanced display- underwater combat swim board |
US20090279269A1 (en) * | 2008-05-08 | 2009-11-12 | Qbas Co., Ltd. | Waterproof method for electronic device and waterproof electronic device |
US20100091195A1 (en) * | 2008-10-09 | 2010-04-15 | Mstar Semiconductor, Inc. | De-ringing Device and Method |
US20100259651A1 (en) * | 2009-04-08 | 2010-10-14 | Raanan Fattal | Method, apparatus and computer program product for single image de-hazing |
US20120281054A1 (en) * | 2011-05-06 | 2012-11-08 | David Dwight Cook | Integrated System for Underwater Viewing and Communications in Turbid Water |
US9047873B2 (en) * | 2012-12-21 | 2015-06-02 | Draeger Safety, Inc. | Self contained breathing and communication apparatus |
US20140254943A1 (en) * | 2013-03-11 | 2014-09-11 | Adobe Systems Incorporated | Optical Flow Accounting for Image Haze |
US20150379772A1 (en) * | 2014-06-30 | 2015-12-31 | Samsung Display Co., Ltd. | Tracking accelerator for virtual and augmented reality displays |
US20160099751A1 (en) * | 2014-10-02 | 2016-04-07 | Raytheon Company | Methods and apparatus for underwater electrical near-field signal system |
US20170006039A1 (en) * | 2015-06-30 | 2017-01-05 | Mist Systems, Inc. | Access enforcement at a wireless access point |
US20170060399A1 (en) * | 2015-08-25 | 2017-03-02 | Evolution Optiks Limited | Vision correction system, method and graphical user interface for implementation on electronic devices having a graphical display |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11760451B1 (en) * | 2019-08-22 | 2023-09-19 | Preferred Industries, Inc. | Full face diving mask with breathing tube and still photo and video imaging capability |
CN111669516A (en) * | 2020-06-19 | 2020-09-15 | 江苏镭博智能科技有限公司 | Method for realizing transverse splicing of eight paths of video data and real-time synchronization of IMU (inertial measurement Unit) data based on FPGA (field programmable Gate array) |
CN112363680A (en) * | 2020-10-10 | 2021-02-12 | 深圳闪闪亮亮科技有限公司 | Electronic mask control system |
Also Published As
Publication number | Publication date |
---|---|
US20230177657A1 (en) | 2023-06-08 |
US20200074599A1 (en) | 2020-03-05 |
US20210209736A1 (en) | 2021-07-08 |
US10902565B2 (en) | 2021-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230177657A1 (en) | Enhanced electronic dive mask display system incorporating an image enhancement and clarification processor with data storage | |
US10863163B2 (en) | Vision enhancing system and method | |
US8766999B2 (en) | Systems and methods for local tone mapping of high dynamic range images | |
CN110152291A (en) | Rendering method, device, terminal and the storage medium of game picture | |
CA2884855C (en) | Face mounted extreme environment thermal sensor system | |
US20080266669A1 (en) | Electronic Day and Night Vision Spectacles | |
EP3092615B1 (en) | Artificial vision system | |
GB2372168A (en) | Automatic enhancement of facial features in images | |
JP2009194644A (en) | Image processor, image processing method and image pick-up device | |
CN109325924B (en) | Image processing method, device, terminal and storage medium | |
WO2003041011A3 (en) | Method and apparatus for the computation of panoramic views and _perspective projections from omnidirectional images | |
US6977671B1 (en) | Underwater wireless imaging method and system | |
JPWO2019031005A1 (en) | Information processing apparatus, information processing method, and program | |
FR2975073A1 (en) | METHOD AND DEVICE FOR VISUALIZING COMPUTER CONTENT ASSOCIATED WITH PROPULSION. | |
FR2914196A1 (en) | Mobile multimedia marine device for professional diver in military application, has central core carrying computing enclosure, motive enclosure and chassis, and wings carrying discharge pipeline and fixed in chassis | |
US20210325679A1 (en) | System for augmenting fishing data and method | |
US6837240B1 (en) | Display system upgrade for a full face mask | |
US11665319B2 (en) | Augmented reality display device, and apparatus comprising same | |
CN106510080A (en) | Underwater ultrasonic detection helmet | |
Zhu et al. | Semi-supervised advancement of underwater visual quality | |
EP3281858A1 (en) | Small-sized floating means, primarily floating board or boat, capable of observing underwater area | |
GB2561852A (en) | Watercraft | |
RU2593462C1 (en) | Information means for water-based recreation (versions) | |
Calisti et al. | A rotating polarizing filter approach for image enhancement | |
KR20090107182A (en) | Underwater monitoring method and apparatus thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |