CN104952045A - Defogging system and defogging method - Google Patents
Defogging system and defogging method Download PDFInfo
- Publication number
- CN104952045A CN104952045A CN201410659623.XA CN201410659623A CN104952045A CN 104952045 A CN104952045 A CN 104952045A CN 201410659623 A CN201410659623 A CN 201410659623A CN 104952045 A CN104952045 A CN 104952045A
- Authority
- CN
- China
- Prior art keywords
- value
- demist
- input picture
- level
- threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 239000003595 mist Substances 0.000 claims description 40
- 230000001186 cumulative effect Effects 0.000 claims description 30
- 238000001514 detection method Methods 0.000 claims description 22
- 230000006870 function Effects 0.000 description 21
- 238000005286 illumination Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000010257 thawing Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 230000006866 deterioration Effects 0.000 description 4
- 108010022579 ATP dependent 26S protease Proteins 0.000 description 3
- 230000000712 assembly Effects 0.000 description 3
- 238000000429 assembly Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001962 electrophoresis Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
Provided are a defogging system and a defogging method. The defogging system includes: an illuminance sensor configured to detect a surrounding illuminance; a level determiner configured to determine a defogging level of the input image based on the detected surrounding illuminance; and a defogger configured to determine a fog state of the input image based on a histogram of the input image, and adaptively defog the input image according to the determined fog state and defogging level.
Description
This application claims and be submitted to the right of priority of the 10-2014-0036126 korean patent application of Korean Intellectual Property Office on March 27th, 2014, the open of this application is all contained in this by reference.
Technical field
The equipment consistent with the exemplary embodiment that the present invention conceives and method relate to a kind of demister system and defogging method.
Background technology
Because closed-circuit television (CCTV) must 24 hours monitoring room exterior domains, therefore use based on defrosting function the method improving picture quality when there is mist etc.
The CCTV video camera that great majority have defrosting function is manually controlled.In other words, there is not the now way of self-verifying mist, even if or there is this defrosting function, defrosting function is out of true also.Therefore, when defrosting function time or when being even performed when not there is mist at dead of night, picture quality can deterioration.
Summary of the invention
One or more exemplary embodiment of the present invention's design provides a kind of demister system and defogging method, removes image mist adaptively thus based on current vaporific state and illumination.
Various aspect will be partly articulated in the following description, and part will be apparent from description, or is learnt by the enforcement of embodiment presented.
According to the one side of exemplary embodiment, provide a kind of demister system, described demister system can comprise: illuminance transducer, is configured to detect ambient illuminance; Level determiner, is configured to the demist level based on the ambient illuminance determination input picture detected; Mist eliminator, is configured to the vaporific state of the histogram determination input picture based on input picture, and carries out demist to input picture adaptively according to the demist level determined and vaporific state.
If the value of magnification of the luminance detection signal of illuminance transducer is less than first threshold, the then exportable maximum demist horizontal signal of level determiner, if described value of magnification is higher than Second Threshold, the then exportable minimum demist horizontal signal of level determiner, if described value of magnification is between first threshold and Second Threshold, then the exportable corresponding demist horizontal signal of level determiner.
Along with described value of magnification changes into Second Threshold from first threshold, level determiner can reduce demist level.
Mist eliminator can comprise: histogram generator, produces the histogram of input picture; Fog detector, detects the first minimum luminance value and the first maximum brightness value from histogram, the first minimum luminance value and the first maximum brightness value corresponding with preset cumulative probability; Unit for scaling, the first minimum luminance value and the first maximum brightness value are re-set as the second minimum luminance value to the demist level determined based on the ambient illuminance detected by basis respectively and the second maximum brightness value carries out convergent-divergent to input picture.
The brightness value that histogrammic preset cumulative probability can be the first reference value by fog detector is defined as the first minimum luminance value, is that the brightness value of the second reference value is defined as the first maximum brightness value by preset cumulative probability.
First reference value can be preset cumulative probability 5%, second reference value can be preset cumulative probability 95%.
Along with demist level reduces, unit for scaling can reduce the adjustment width between the first minimum luminance value and the second minimum luminance value and the adjustment width between the first maximum brightness value and the second maximum brightness value.
Demister system also can comprise: edge detector, detects the edge amount of input picture; Gamma tucker, if the edge amount of input picture is less than or equal to the 3rd threshold value, then by gamma curve being applied to based on the relation between predetermined luminance and edge amount the contrast being improved input picture by the input picture of demist.
According to the one side of another exemplary embodiment, provide a kind of defogging method, described defogging method can comprise: detect ambient illuminance by illuminance transducer; Based on the demist level of the ambient illuminance determination input picture detected; Based on the vaporific state of the histogram determination input picture of input picture, and adaptively demist is carried out to input picture according to the demist level determined and vaporific state.
Determine that the step of demist level can comprise: if the value of magnification of the luminance detection signal of illuminance transducer is less than first threshold, then export maximum demist horizontal signal; If described value of magnification is higher than Second Threshold, then export minimum demist horizontal signal; If described value of magnification is between first threshold and Second Threshold, then export corresponding demist horizontal signal.
Along with described value of magnification changes into Second Threshold from first threshold, demist level can be lowered.
Determine that the step of vaporific state demist adaptively can comprise: the histogram producing input picture; Detect the first minimum luminance value and the first maximum brightness value from histogram, wherein, the first minimum luminance value and the first maximum brightness value corresponding with preset cumulative probability; First minimum luminance value and the first maximum brightness value are re-set as the second minimum luminance value to the demist level determined based on the ambient illuminance detected by basis respectively and the second maximum brightness value carries out convergent-divergent to input picture.
The step detecting the first minimum luminance value and the first maximum brightness value can comprise: the brightness value being the first reference value by histogrammic preset cumulative probability is defined as the first minimum luminance value, is that the brightness value of the second reference value is defined as the first maximum brightness value by preset cumulative probability.
First reference value can be preset cumulative probability 5%, second reference value can be preset cumulative probability 95%.
The step of input picture being carried out to convergent-divergent can comprise: along with demist level reduces, reduce the adjustment width between the first minimum luminance value and the second minimum luminance value and the adjustment width between the first maximum brightness value and the second maximum brightness value.
Defogging method also can comprise: the edge amount detecting input picture; If the edge amount of input picture is less than or equal to the 3rd threshold value, then by gamma curve being applied to based on the relation between predetermined luminance and edge amount the contrast being improved input picture by the input picture of demist.
Accompanying drawing explanation
From the description carried out embodiment below in conjunction with accompanying drawing, these and/or other side will become clear and be easier to understand, in the accompanying drawings:
Fig. 1 is the block diagram of the demister system exemplarily illustrated according to exemplary embodiment;
Fig. 2 is the block diagram of the structure of the image processing equipment schematically shown according to exemplary embodiment;
Fig. 3 is the block diagram of the structure of the image processing equipment schematically shown according to another exemplary embodiment;
Fig. 4 illustrates the curve map according to the relation between the value of magnification of the luminance detection signal of exemplary embodiment and demist level;
Fig. 5 illustrates the histogrammic example of the logarithmic scale relevant to the data of the input picture of 12 bits according to exemplary embodiment;
Fig. 6 is the histogram according to exemplary embodiment;
Fig. 7 illustrates the curve map according to the relation between the brightness of exemplary embodiment and edge amount;
Fig. 8 illustrates the example of the gamma curve according to exemplary embodiment;
Fig. 9 is the process flow diagram of the defogging method schematically shown according to exemplary embodiment;
Figure 10 is the process flow diagram of the defogging method schematically shown according to another exemplary embodiment.
Embodiment
Below describe only citing and the principle that the present invention conceives is shown.Therefore, even if when described principle is not clearly described or illustrates in this manual, those of ordinary skill in the art also can recognize that the present invention conceives and understands the various equipment in the present invention's design.In addition, all terms presented here and exemplary embodiment are fundamentally clearly intended for the understanding to the present invention's design, and the present invention's design not limited by exemplary embodiment described herein and condition.In addition, principle, viewpoint and embodiment that not only the present invention conceives should be interpreted as comprising 26S Proteasome Structure and Function equivalent, and all embodiments enumerating specific embodiment also should be understood to include 26S Proteasome Structure and Function equivalent.In addition, this 26S Proteasome Structure and Function equivalent should be interpreted as not only comprising current known equivalent, and comprises the following equivalent that will be developed, that is, be used for performing all component of identical function by invention, and no matter their structure is how.
Therefore, the function not only by use specialized hardware but also by using the hardware of the ability had for running appropriate software to provide various assembly shown in the accompanying drawing of the functional block comprising the similar concept being shown as processor or processor.When a function is provided by a processor, function can be provided by single application specific processor, single share processor or multiple independent processor, and some functions can be shared.The hardware that the processor proposed with its similar concept, control or term should not had for the ability of operating software by specific reference is explained, and should be interpreted as implicit and comprise digital signal processor (DSP) hardware or ROM (read-only memory) (ROM), random access memory (RAM) or the nonvolatile memory for storing software without limitation.Also can comprise other known hardware.
Object, the feature and advantage of the present invention's design are illustrated via following embodiment by reference to the accompanying drawings.In the description of exemplary embodiment, when think prior art specific detailed explanation can unnecessarily fuzzy the present invention's design essential time, omit the specific detailed explanation to prior art.
In addition, when region " comprises " element, unless otherwise noted, otherwise region also can comprise another element, and other element of non-excluded.
Below, one or more exemplary embodiment is described with reference to the accompanying drawings in detail.
Fig. 1 is the block diagram of the demister system 1 exemplarily illustrated according to exemplary embodiment.
With reference to Fig. 1, imageing sensor 100, illuminance transducer 200, image processing equipment 300 and display device 400 can be comprised according to the demister system 1 of exemplary embodiment.
Imageing sensor 100 can be any type video camera (such as, distant take the photograph tilt zoom (PTZ) video camera) and wirelessly or via being wiredly connected to image processing equipment 300.Imageing sensor 100 can use electrooptical device, such as, and charge-coupled image sensor (CCD) or complementary metal oxide semiconductor (CMOS) (CMOS).Imageing sensor 100 obtains image information by shooting frontal scene.Camera lens (not shown) for receiving optical signals can be disposed in the front of imageing sensor 100.
Illuminance transducer 200 detects illumination in shooting area and illumination changes.Illuminance transducer 200 amplifies the luminance detection signal relevant with ambient brightness, and the detection signal after amplifying is outputted to image processing equipment 300.When dark, the value of magnification (or gain) of luminance detection signal increases.Therefore, the level of the luminance detection signal of illuminance transducer 200 and value of magnification are inversely proportional to.
Image processing equipment 300 detects mist by the Luminance Distribution analyzing the picture signal inputted from imageing sensor 100.Image processing equipment 300 determines whether to carry out demist and demist degree to picture signal based on the luminance detection signal inputted from illuminance transducer 200.If the luminance state of surrounding environment is low-light (level), then image processing equipment 300 does not perform demist algorithm to input picture.Therefore, the deterioration of the picture quality produced by carrying out demist to low-light (level) image can be prevented.Even if when performing demist algorithm to input picture, image processing equipment 300 also adjusts demist degree to remove mist adaptively gradually by changing based on illumination.
Display device 400 processes the picture signal exported from image processing equipment 300, and the picture signal after process is supplied to user, thus enables user monitor the image of display.Display device 400 can comprise liquid crystal display (LCD) panel, organic light emitting display (OLED) panel or electrophoresis showed (EPD) panel.Display device 400 can be the touch-screen of the input for receiving the touch via user, therefore can be used as the operation of user's inputting interface.
Fig. 2 is the block diagram of the structure of the image processing equipment 300a schematically shown according to exemplary embodiment.Image processing equipment 300a can be identical with the image processing equipment shown in Fig. 1.
With reference to Fig. 2, level determiner 310 and mist eliminator 330 can be comprised according to the image processing equipment 300a of the present embodiment.
The demist level of the value of magnification determination input picture of the luminance detection signal that level determiner 310 can input based on the illuminance transducer 200 from Fig. 1.Level determiner 310 exports maximum demist horizontal signal in response to the luminance detection signal with the value of magnification being less than first threshold.Maximum demist horizontal signal is the control signal for demist degree being increased to maximal value.Level determiner 310 exports minimum demist horizontal signal in response to the luminance detection signal with the value of magnification being greater than Second Threshold.Minimum demist horizontal signal is the control signal for not removing mist.If value of magnification is between first threshold and Second Threshold, then level determiner 310 exports respective demist horizontal signal.
Fig. 4 illustrates the curve map according to the relation between the value of magnification of the luminance detection signal of exemplary embodiment and demist level.Curve map or the look-up table of the value of magnification of predetermined luminous intensity detection signal and the database of each demist level can be prestored.
The value of magnification of the x-axis instruction luminance detection signal of curve map, y-axis instruction demist level.If the value of magnification of luminance detection signal high (if that is, illumination level is low), then demist level is low.
Level determiner 310 can arrange first threshold TH1 and Second Threshold TH2 to perform demist adaptively.Such as, first threshold TH1 can be the threshold value of the value of magnification of the illumination of when dimmed (that is, when illumination is less than or equal to 30lux), Second Threshold TH2 can be when illumination less than or equal to during 10lux night illumination the threshold value of value of magnification.
If value of magnification is lower than first threshold TH1 (that is, before dark), then level determiner 310 arranges maximum demist level.Mist eliminator 330 according to maximum demist level to greatest extent by demist algorithm application in input picture.
If value of magnification is higher than Second Threshold TH2 (that is, at night), then level determiner 310 arranges minimum demist level.Mist eliminator 330 according to minimum demist level not by demist algorithm application in input picture.
If value of magnification is between first threshold TH1 and Second Threshold TH2, then level determiner 310 can determine the demist level corresponding with value of magnification based on the curve map of Fig. 4.Along with value of magnification changes into Second Threshold TH2 when dimmed (that is) from first threshold TH1, demist level is reduced to minimum demist level by level determiner 310 gradually.Along with demist level reduces, mist eliminator 330 reduces demist degree gradually according to demist algorithm.
Mist eliminator 330 can comprise histogram generator 340, fog detector 350 and unit for scaling 360.
Histogram generator 340 produces the histogram of input picture.Histogram illustrates the intensity (that is, Luminance Distribution) of input picture, and histogram is x-axis represents intensity and y-axis represents the curve map of the occurrence rate (frequency) of the quantity of the pixel corresponding with intensity in indicative input image.In dark image, Luminance Distribution is to the histogrammic left side of input picture, and in bright image, Luminance Distribution tilts to the histogrammic right side of input picture.
Histogram generator 340 uses the histogram data of logarithmic scale.Because the brightness of the imageing sensor of the brightness for detecting light is made a response by logarithmic scale, therefore can the histogrammic level of meticulous division dark areas, and by using the histogram data of logarithmic scale according to the histogrammic level dividing bright area on a large scale, thus can effectively analyze mist image.Histogram generator 340 detects the brightness of each pixel of input picture and accumulates the pixel quantity of each brightness, thus produces histogram.
Fig. 5 illustrates the histogrammic example of the logarithmic scale relevant to the data of the input picture of 12 bits according to exemplary embodiment.Here, the dynamic range of representing gradation can be determined according to the bit number in data, and dynamic range can be classified as the histogram data of logarithmic scale.
Such as, the input picture of eight (8) bits can have the dynamic range for representing gradation from 0 to 255, and the input picture of 12 bits can have the dynamic range for representing gradation from 0 to 4096.In Figure 5, by use histogram index 0HIST [0] to histogram index 55HIST [55] by the input picture of 12 bits from 0 to 4096 dynamic range be categorized as 56 regions.Each histogram index represents the brightness value of particular range, and will be called as histogram regions now.
Fog detector 350 determines whether to occur mist by analyzing histogram.In histogram, when Luminance Distribution is totally tilted to the right, the minimum value of brightness and maximal value inclined right, and the difference hour between the minimum value of brightness and maximal value, can determine that the brightness of input picture is high because of mist.Therefore, fog detector 350 determines the generation of mist and the degree of mist by the minimum value of the histogram determination brightness from input picture and maximal value.
Fig. 6 is the histogram according to exemplary embodiment.
With reference to Fig. 6, histogrammic x-axis instruction is by the brightness that [55] represent from histogram index 0HIST [0] to histogram index 55HIST of Fig. 5, and y-axis indicates the quantity (occurrence rate) of the pixel corresponding with each histogram index.
Fog detector 350 can detect the central value " a " of the first histogram regions that histogram starts, the central value " max " of to be the central value " min " of the histogram regions of the first reference value and the cumulative probability from the first histogram regions the be histogram regions of the second reference value of the cumulative probability from the first histogram regions.
Cumulative probability can be that the central value " min " of the histogram regions of the first reference value is defined as the first minimum luminance value by fog detector 350, and is that the central value " max " of the histogram regions of the second reference value is defined as the first maximum brightness value by cumulative probability.Such as, as shown in following equation 1, the first reference value can be cumulative probability 5% (0.05), and as shown in following equation 2, the second reference value can be cumulative probability 95% (0.95).
Unit for scaling 360 receives the control signal S1 of instruction demist level, and by the first minimum luminance value of input picture and the first maximum brightness value being adjusted to the second minimum luminance value respectively and the second maximum brightness value carries out convergent-divergent to input picture.In other words, the input range between the first minimum luminance value and the first maximum brightness value zooms in the dynamic range (hereinafter, being called as " with reference to dynamic range ") of reference gray level by unit for scaling 360.Reference dynamic range is the maximum magnitude that can be showed by image processing equipment, and can be determined according to the bit number of view data.Such as, in the input picture of eight (8) bits, can be 0 to 255 with reference to dynamic range, in the image of 12 bits, can be 0 to 4096 with reference to dynamic range.
The minimum value of the brightness of input picture can be set to lower value by unit for scaling 360, and the maximal value of the brightness of input picture is set to high value to carry out convergent-divergent to input picture, thus improve contrast by carrying out equalization to the overall brightness of input picture.Therefore, the output image OUTPUT obtained by carrying out demist to input picture is output.
When receiving minimum demist horizontal signal, unit for scaling 360 is not to input picture application demist algorithm.When the input picture with low-light (level) is by demist, input picture may be dimmed and may be difficult to the object that identifies wherein.Therefore, according to exemplary embodiment, do not perform demist when having the input picture of low-light (level).
When receiving maximum demist horizontal signal, unit for scaling 360 carries out convergent-divergent by the minimum luminance value and maximum brightness value the first minimum luminance value of input picture and the first maximum brightness value being set to reference dynamic range to input picture.Such as, by the second minimum luminance value being set to 0 and the second maximum brightness value is set to 4096 carry out convergent-divergent to input picture.
Following equation 3 is the convergent-divergent algorithms for carrying out demist to input picture.Wherein, " output " represents the output image after convergent-divergent, and input represents input picture.
When receiving the demist horizontal signal of indicating predetermined demist level, unit for scaling 360 according to each convergent-divergent adjustment width in the reference dynamic range of input picture, by the first minimum luminance value of input picture and the first maximum brightness value being set to the second minimum luminance value respectively and the second maximum brightness value carries out convergent-divergent to input picture.Here, the second minimum luminance value can higher than the minimum luminance value with reference to dynamic range, and the second maximum brightness value can lower than the maximum brightness value with reference to dynamic range.
Along with demist level reduces, the adjustment width between the first minimum luminance value and the second minimum luminance value and the adjustment width between the first maximum brightness value and the second maximum brightness value reduce, and therefore, zoom degree reduces.In other words, according to exemplary embodiment, reduced adaptively along with demist level reduces demist degree, and when low-light (level) image, do not performed demist.
Following equation 4 and equation 5 are the equatioies for determining convergent-divergent adjustment width.Here, " level " represents demist level, and " output " represents the output image of equation 3, and " horizontal output " represents the output image being scaled to the adjustment width determined according to demist level.Along with demist level reduces, unit for scaling 360 reduces adjustment width gradually until close demist to reduce zoom degree gradually simultaneously.
Horizontal output t (x, y)=(input (x, y)+adjustment width) (5)
Fig. 3 is the block diagram of the structure of the image processing equipment 300b schematically shown according to another exemplary embodiment.Image processing equipment 300b can be identical with the image processing equipment shown in Fig. 1.
With reference to Fig. 3, level determiner 310, mist eliminator 330, edge detector 380 and gamma tucker (gamma applier) 390 can be comprised according to the image processing equipment 300b of embodiment.Hereinafter, by the difference between main Description Image treatment facility 300a and image processing equipment 300b.
Level determiner 310 can according to the demist level of the value of magnification determination input picture of the luminance detection signal inputted from illuminance transducer 200.
Mist eliminator 330 can comprise histogram generator 340, fog detector 350 and unit for scaling 360.Mist eliminator 330 based on the vaporific state of the histogram determination input picture of input picture, and can carry out demist to input picture based on demist level adaptively.
Edge detector 380 can detect the edge amount of input picture.Along with the brightness of input picture increases because of mist, edge amount reduces.By using this characteristic, the curve map of the relation between the brightness that edge detector 380 can increase from instruction by the degree (mist amount) of mist and edge amount or look-up table Edge detected amount, and the edge amount that detects can be detected when less than or equal to the 3rd threshold value.
Fig. 7 illustrates the curve map according to the relation between the brightness of exemplary embodiment and edge amount.The degree according to mist can be prestored and the curve map of the database of the predetermined luminance that increases and each edge amount or look-up table.
When whether Edge detected amount is less than or equal to the 3rd threshold value TH3, edge detector 380 exports control signal S2.
When receiving control signal S2 from edge detector 380, gamma tucker 390 is by being applied to the output image OUTPUT1 that exported by unit for scaling 360 to improve contrast by gamma curve.If mist amount is high, then (minimum/maximum) of the brightness of input picture is low, and thus contrast is low.Therefore, gamma tucker 390 can be determined gamma curve adaptively according to mist amount and the gamma curve determined is applied to output image OUTPUT1, thus exports the output image OUTPUT2 with the contrast of raising.Following equation 6 is for obtaining the contrast of the output image applying gamma curve.
Fig. 8 illustrates the example of the gamma curve according to exemplary embodiment.Can according to the degree adjustment gamma curve of mist.In fig. 8, x-axis represents the brightness value (luminance level) of the output image OUTPUT exported by unit for scaling 360, and y-axis represents the brightness value (luminance level) of the output image obtained by application gamma curve.
Fig. 9 is the process flow diagram of the defogging method schematically shown according to exemplary embodiment.
With reference to Fig. 9, when receiving input picture from imageing sensor, the histogram of input picture can be produced at operation S11 demister system.Demister system produces histogram by using the histogram data of logarithmic scale.
At operation S12, demister system detects the mist of input picture by analyzing histogram.When there is mist, the brightness of input picture totally increases, and the Luminance Distribution therefore in histogram is tilted to the right.Demister system detects the first corresponding with the minimum cumulative probability pre-set in histogram and cumulative maximum probability respectively minimum luminance value and the first maximum brightness value.Such as, minimum cumulative probability can be 5%, and cumulative maximum probability can be 95%.First minimum luminance value and first maximum brightness value of input picture are different according to the degree of mist, and (the first minimum luminance value/the first maximum brightness value) increases along with mist amount and reduce.Therefore, demister system detects the appearance of mist and the degree of mist by analyzing histogram.
At operation S13, demister system receives the information about ambient illuminance from illuminance transducer.Demister system periodically receives the value of magnification of luminance detection signal from illuminance transducer.Illuminance transducer detects, amplify also output environment brightness.Therefore, when surrounding environment is darker, value of magnification increases.In other words, the luminance detection signal exported by illuminance transducer and illumination level are inversely proportional to.Value of magnification reduces along with luminance level and increases, and value of magnification increases along with illumination level and reduces.
At operation S14, demister system is by carrying out convergent-divergent to export to input picture the image eliminating mist according to ambient illuminance.
If be less than first threshold from the value of magnification of the luminance detection signal of illuminance transducer reception, then demist is horizontally placed to maximum by demister system.Demister system carries out equalization by the present intensity scope of input picture all being zoomed to reference dynamic range according to maximum demist level to the brightness of input picture.In other words, demister system carries out convergent-divergent by the minimum luminance value and maximum brightness value the first minimum luminance value and the first maximum brightness value being re-set as reference dynamic range to input picture.Demister system can carry out equalization to the brightness of input picture, thus exports by the contrast increasing input picture the image had except fog effect.
If value of magnification is higher than Second Threshold, then demist is horizontally placed to minimum by demister system.Demister system exports input picture according to minimum demist level when not carrying out convergent-divergent.
If value of magnification is between first threshold and Second Threshold, then demister system arranges each demist level.Demister system calculates the adjustment width corresponding with demist level, carries out convergent-divergent, and export the input picture after convergent-divergent by with reference to the adjustment width in dynamic range to input picture.In other words, demister system carries out convergent-divergent by the maximum brightness value being set to by the second minimum luminance value be less than with reference to dynamic range higher than the minimum luminance value the second maximum brightness value being set to reference to dynamic range to input picture.
Along with value of magnification changes into Second Threshold from first threshold, demister system reduces demist level gradually, and correspondingly reduces adjustment width gradually, thus reduces the zoom degree of input picture gradually, that is, demist degree.
Figure 10 is the process flow diagram of the defogging method schematically shown according to another exemplary embodiment.
The defogging method of Figure 10 is different from the defogging method of Fig. 9 to be: certain operations is added to the defogging method of Figure 10.Present will mainly describe these difference.
When receiving input picture from imageing sensor, at operation S21, demister system can produce the histogram of input picture.Demister system detects the mist of input picture by analyzing histogram.At operation S23, demister system receives the information about ambient illuminance from illuminance transducer.At operation S24, demister system exports the image after demist by carrying out convergent-divergent according to ambient illuminance to input picture.
At operation S25, demister system can detect the edge amount of input picture.
At operation S26, if the edge amount of input picture is less than or equal to the 3rd threshold value, then gamma curve can be applied to the image after demist to improve contrast by demister system.
According to the defogging method of above embodiment by using the histogram of logarithmic scale and statistical method automatically and the level of the defrosting function of adjustment application adaptively.In addition, according to the defogging method of above embodiment by low-light (level) environment and without mist condition under a little automatically apply defrosting function or do not apply the deterioration that defrosting function prevents picture quality.
Defogging method according to above embodiment can be used in conjunction with CCTV camera (such as analog video camera and web camera).
As mentioned above, according to above embodiment, defogging method based on current vaporific state and illumination automatically and apply demist algorithm adaptively, thus reduces the deterioration of picture quality.
The present invention also can be implemented as the computer-readable code on computer readable recording medium storing program for performing.Described computer readable recording medium storing program for performing is that can store thereafter can by any data storage device of the data of computer system reads.The example of described computer readable recording medium storing program for performing comprises: ROM (read-only memory) (ROM), random access memory (RAM), CD-ROM, tape, floppy disk, optical data storage device etc.Described computer readable recording medium storing program for performing also can be distributed in the computer system of networking, makes described computer-readable code be stored in a distributed fashion and be performed.In addition, easily can be explained by the skilled programmer in field belonging to the present invention for realizing function program of the present invention, code and code segment.
According to exemplary embodiment, the hardware of the various quantity of the above-mentioned various function of at least one the be implemented as execution in the assembly represented by the block such as shown in Fig. 2 and Fig. 3, element or unit, software and/or firmware structure.Such as, at least one used direct circuit structure (such as storer, treatment element, logic element, look-up table etc.) in these assemblies, element or unit, wherein, described various direct circuit structure is by performing various function to the control of one or more microprocessor or other opertaing device.In addition, at least one in these assemblies, element or unit can carry out specific implementation by the module of one or more executable instruction comprised for performing specific logical function, program or partial code.In addition, at least one in these assemblies, element or unit also can comprise the processor (such as CPU (central processing unit) (CPU)), microprocessor etc. that perform various function.
Although described one or more exemplary embodiment with reference to the accompanying drawings, but those skilled in the art will appreciate that, when not departing from the spirit and scope of the present invention's design be defined by the claims, various change can be made in form and details.
Claims (20)
1. a demister system, comprising:
Illuminance transducer, is configured to detect ambient illuminance;
Level determiner, is configured to the demist level based on the ambient illuminance determination input picture detected;
Mist eliminator, is configured to the vaporific state of the histogram determination input picture based on input picture, and carries out demist to input picture adaptively according to the vaporific state determined and demist level.
2. demister system as claimed in claim 1, wherein, if the value of magnification of the luminance detection signal of illuminance transducer is less than first threshold, then level determiner exports maximum demist horizontal signal, if described value of magnification is higher than Second Threshold, then level determiner exports minimum demist horizontal signal, if described value of magnification is between first threshold and Second Threshold, then level determiner exports corresponding demist horizontal signal.
3. demister system as claimed in claim 2, wherein, along with described value of magnification changes between first threshold and Second Threshold, level determiner changes demist level.
4. demister system as claimed in claim 2, wherein, along with described value of magnification changes into Second Threshold from first threshold, level determiner reduces demist level.
5. demister system as claimed in claim 1, wherein, mist eliminator comprises:
Histogram generator, is configured to the histogram producing input picture;
Fog detector, is configured to detect the first minimum luminance value and the first maximum brightness value from histogram, the first minimum luminance value and the first maximum brightness value corresponding with preset cumulative probability;
Unit for scaling, the first minimum luminance value and the first maximum brightness value are re-set as the second minimum luminance value by demist level respectively that be configured to by determining according to the ambient illuminance based on detection and the second maximum brightness value carries out convergent-divergent to input picture.
6. demister system as claimed in claim 5, wherein, the second minimum luminance value is set to less than the first minimum luminance value, and the second maximum brightness value is set to larger than the first maximum brightness value.
7. demister system as claimed in claim 5, wherein, the brightness value that histogrammic preset cumulative probability is the first reference value by fog detector is defined as the first minimum luminance value, is that the brightness value of the second reference value is defined as the first maximum brightness value by preset cumulative probability.
8. demister system as claimed in claim 7, wherein, the first reference value is preset cumulative probability 5%, second reference value is preset cumulative probability 95%.
9. demister system as claimed in claim 5, wherein, along with demist level reduces, unit for scaling reduces the adjustment width between the first minimum luminance value and the second minimum luminance value and the adjustment width between the first maximum brightness value and the second maximum brightness value.
10. demister system as claimed in claim 1, also comprises:
Edge detector, is configured to the edge amount detecting input picture;
Gamma tucker, if the edge amount being configured to input picture is less than or equal to the 3rd threshold value, then by gamma curve being applied to based on the relation between predetermined luminance and edge amount the contrast being improved input picture by the input picture of demist.
11. 1 kinds of defogging methods, comprising:
Ambient illuminance is detected by illuminance transducer;
Based on the demist level of the ambient illuminance determination input picture detected;
Based on the vaporific state of the histogram determination input picture of input picture, and adaptively demist is carried out to input picture according to the vaporific state determined and demist level.
12. defogging methods as claimed in claim 11, wherein, determine that the step of demist level comprises:
If the value of magnification of the luminance detection signal of illuminance transducer is less than first threshold, then export maximum demist horizontal signal;
If described value of magnification is higher than Second Threshold, then export minimum demist horizontal signal;
If described value of magnification is between first threshold and Second Threshold, then export corresponding demist horizontal signal.
13. defogging methods as claimed in claim 12, wherein, along with described value of magnification changes between first threshold and Second Threshold, demist level is changed.
14. methods as claimed in claim 12, wherein, along with described value of magnification changes into Second Threshold from first threshold, demist level is lowered.
15. defogging methods as claimed in claim 11, wherein, determine that the step of vaporific state demist adaptively comprises:
Produce the histogram of input picture;
Detect the first minimum luminance value and the first maximum brightness value from histogram, wherein, the first minimum luminance value and the first maximum brightness value corresponding with preset cumulative probability;
First minimum luminance value and the first maximum brightness value are re-set as the second minimum luminance value to the demist level determined based on the ambient illuminance detected by basis respectively and the second maximum brightness value carries out convergent-divergent to input picture.
16. defogging methods as claimed in claim 15, wherein, the second minimum luminance value is set to less than the first minimum luminance value, and the second maximum brightness value is set to larger than the first maximum brightness value.
17. defogging methods as claimed in claim 15, wherein, the step detecting the first minimum luminance value and the first maximum brightness value comprises: the brightness value being the first reference value by histogrammic preset cumulative probability is defined as the first minimum luminance value, is that the brightness value of the second reference value is defined as the first maximum brightness value by preset cumulative probability.
18. defogging methods as claimed in claim 17, wherein, the first reference value is preset cumulative probability 5%, second reference value is preset cumulative probability 95%.
19. defogging methods as claimed in claim 15, wherein, the step of input picture being carried out to convergent-divergent comprises: along with demist level reduces, reduce the adjustment width between the first minimum luminance value and the second minimum luminance value and the adjustment width between the first maximum brightness value and the second maximum brightness value.
20. defogging methods as claimed in claim 11, also comprise:
Detect the edge amount of input picture;
If the edge amount of input picture is less than or equal to the 3rd threshold value, then by gamma curve being applied to based on the relation between predetermined luminance and edge amount the contrast being improved input picture by the input picture of demist.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020140036126A KR102207939B1 (en) | 2014-03-27 | 2014-03-27 | Defog system and method |
| KR10-2014-0036126 | 2014-03-27 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104952045A true CN104952045A (en) | 2015-09-30 |
| CN104952045B CN104952045B (en) | 2019-09-13 |
Family
ID=54166679
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410659623.XA Active CN104952045B (en) | 2014-03-27 | 2014-11-18 | Demister system and defogging method |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US9317910B2 (en) |
| KR (1) | KR102207939B1 (en) |
| CN (1) | CN104952045B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110852972A (en) * | 2019-11-11 | 2020-02-28 | 苏州科技大学 | Single image rain removing method based on convolutional neural network |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ES2727929T3 (en) * | 2014-06-12 | 2019-10-21 | Eizo Corp | Mist removal device and image generation method |
| KR102390918B1 (en) * | 2015-05-08 | 2022-04-26 | 한화테크윈 주식회사 | Defog system |
| CN105433671A (en) * | 2015-11-17 | 2016-03-30 | 青岛海尔智能技术研发有限公司 | Method for automatically removing mist on mirror surface and automatic demisting mirror |
| KR102584522B1 (en) | 2016-12-27 | 2023-10-05 | 한화비전 주식회사 | Image processing device and image enhancing method |
| KR102268970B1 (en) * | 2017-04-03 | 2021-06-24 | 한화테크윈 주식회사 | Method for defoging and Defog system |
| CN108447025B (en) * | 2018-01-31 | 2021-07-27 | 天津大学 | Polarization image defogging method based on single image acquisition |
| CN111161161B (en) * | 2019-12-04 | 2023-05-16 | 天津大学 | Feature fusion defogging method for maintaining color |
| CN111539891A (en) * | 2020-04-27 | 2020-08-14 | 高小翎 | Wave band self-adaptive demisting optimization processing method for single remote sensing image |
| CN113962872B (en) * | 2020-07-21 | 2023-08-18 | 四川大学 | Dual-channel joint optimization night image defogging method |
| CN112581411B (en) * | 2021-02-26 | 2021-06-15 | 深圳金三立视频科技股份有限公司 | Image defogging method and terminal |
| CN117392009B (en) * | 2023-12-06 | 2024-03-19 | 国网山东省电力公司淄博供电公司 | Automatic fog penetrating processing method, system, terminal and storage medium for image |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050046728A1 (en) * | 2000-10-31 | 2005-03-03 | Schinner Charles E. | Illuminated display and method of using same |
| CN101098489A (en) * | 2006-06-27 | 2008-01-02 | 三星电子株式会社 | Image processing apparatus and method of enhancing visibility of displayed image |
| CN101330576A (en) * | 2007-06-19 | 2008-12-24 | 奥林巴斯映像株式会社 | Image display apparatus, image pickup apparatus, image reproducing apparatus, and image displaying method |
| TW201120814A (en) * | 2009-12-04 | 2011-06-16 | Huper Lab Co Ltd | Method for determining if an input image is a foggy image, method for determining a foggy level of an input image and cleaning method for foggy images |
| CN103034979A (en) * | 2012-11-30 | 2013-04-10 | 声泰特（成都）科技有限公司 | Ultrasonic image definition improving method |
| CN103165099A (en) * | 2011-12-15 | 2013-06-19 | 罗伯特·博世有限公司 | Display device |
| CN103325355A (en) * | 2013-06-18 | 2013-09-25 | 华南理工大学 | Method for dynamically adjusting backlight brightness based on image content |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR0129242B1 (en) | 1994-07-01 | 1998-04-06 | 구자홍 | Optical pick us system |
| US8396324B2 (en) | 2008-08-18 | 2013-03-12 | Samsung Techwin Co., Ltd. | Image processing method and apparatus for correcting distortion caused by air particles as in fog |
| KR101518722B1 (en) | 2008-08-18 | 2015-05-15 | 삼성테크윈 주식회사 | Image enhancement processing method and apparatus for distortion correction by air particle like fog |
| JP5343726B2 (en) | 2009-06-19 | 2013-11-13 | カシオ計算機株式会社 | Image processing apparatus and image processing program |
| KR101610962B1 (en) | 2009-12-30 | 2016-04-08 | 주식회사 두원공조 | Defog system of vehicle and defogging method thereof |
| KR20130012749A (en) * | 2011-07-26 | 2013-02-05 | (주)영훈전자 | Video enhancer and video image processing method |
| KR101292421B1 (en) | 2011-08-05 | 2013-08-01 | 경희대학교 산학협력단 | Method for improving foggy image by unit image block |
| KR101341243B1 (en) * | 2012-04-04 | 2013-12-12 | (주) 넥스트칩 | Apparatus and method of restoring image damaged by weather condition |
| KR101279374B1 (en) * | 2012-11-27 | 2013-07-04 | 주식회사 카이넥스엠 | Fog reduction image enhancer and method for compensating for video of cctv camera |
-
2014
- 2014-03-27 KR KR1020140036126A patent/KR102207939B1/en active IP Right Grant
- 2014-09-08 US US14/479,746 patent/US9317910B2/en active Active
- 2014-11-18 CN CN201410659623.XA patent/CN104952045B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050046728A1 (en) * | 2000-10-31 | 2005-03-03 | Schinner Charles E. | Illuminated display and method of using same |
| CN101098489A (en) * | 2006-06-27 | 2008-01-02 | 三星电子株式会社 | Image processing apparatus and method of enhancing visibility of displayed image |
| CN101330576A (en) * | 2007-06-19 | 2008-12-24 | 奥林巴斯映像株式会社 | Image display apparatus, image pickup apparatus, image reproducing apparatus, and image displaying method |
| TW201120814A (en) * | 2009-12-04 | 2011-06-16 | Huper Lab Co Ltd | Method for determining if an input image is a foggy image, method for determining a foggy level of an input image and cleaning method for foggy images |
| CN103165099A (en) * | 2011-12-15 | 2013-06-19 | 罗伯特·博世有限公司 | Display device |
| CN103034979A (en) * | 2012-11-30 | 2013-04-10 | 声泰特（成都）科技有限公司 | Ultrasonic image definition improving method |
| CN103325355A (en) * | 2013-06-18 | 2013-09-25 | 华南理工大学 | Method for dynamically adjusting backlight brightness based on image content |
Non-Patent Citations (1)
| Title |
|---|
| 禹晶 等: "图像去雾技术研究进展", 《中国图象图形学报》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110852972A (en) * | 2019-11-11 | 2020-02-28 | 苏州科技大学 | Single image rain removing method based on convolutional neural network |
Also Published As
| Publication number | Publication date |
|---|---|
| US9317910B2 (en) | 2016-04-19 |
| KR102207939B1 (en) | 2021-01-26 |
| KR20150112287A (en) | 2015-10-07 |
| US20150279011A1 (en) | 2015-10-01 |
| CN104952045B (en) | 2019-09-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104952045A (en) | Defogging system and defogging method | |
| CN106127693B (en) | Defogging system and defogging method | |
| CN111028189B (en) | Image processing method, device, storage medium and electronic equipment | |
| CN109003249B (en) | Method, device and terminal for enhancing image details | |
| CN110766621B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| KR101204556B1 (en) | Method for removing image noise and night-vision system using the same | |
| CN104794705B (en) | Image defogging method and device based on image local content characteristic | |
| CN112950499B (en) | Image processing method, device, electronic equipment and storage medium | |
| US10609303B2 (en) | Method and apparatus for rapid improvement of smog/low-light-level image using mapping table | |
| US9508136B2 (en) | Image fusing method | |
| CN104603863A (en) | Image display device, control method for image display device, control program for image display device and recording medium recording control program | |
| CN115082350A (en) | Stroboscopic image processing method and device, electronic device and readable storage medium | |
| US11310440B2 (en) | Image processing apparatus, surveillance camera system, and image processing method | |
| CN107507601A (en) | A kind of method and system of the camera supervised interface display effect of adjust automatically | |
| KR101761947B1 (en) | Device and method for reducing blooming of camera image | |
| JP2020108058A (en) | Deposit detector and deposit detection method | |
| JP2003046807A (en) | Image display device and image display method | |
| KR20190072643A (en) | A face detecting apparatus, a control method therefor, and a program | |
| US20160292825A1 (en) | System and method to refine image data | |
| JP2008226176A (en) | Thermal target tracking device and method | |
| KR101592732B1 (en) | Apparatus for removing snow rain image in camera images and method for removing snow rain image using the same | |
| EP4209990A2 (en) | Blended gray image enhancement | |
| KR100512926B1 (en) | Apparatus for amend image using histogram | |
| CN112785509B (en) | Image contrast enhancement method, device, equipment and medium | |
| KR101634724B1 (en) | Apparatus for adaptive enhancing the brightness of night image using generation and selection of brightness conversion curve |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Gyeongnam Changwon City, South Korea Applicant after: HANWHA AEROSPACE Co.,Ltd. Address before: Gyeongnam Changwon City, South Korea Applicant before: HANWHA TECHWIN Co.,Ltd. |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20190226 Address after: Gyeonggi Do city of South Korea Applicant after: HANWHA TECHWIN Co.,Ltd. Address before: Gyeongnam Changwon City, South Korea Applicant before: HANWHA AEROSPACE Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220317 Address after: Gyeonggi Do city of South Korea Patentee after: HANWHA TECHWIN Co.,Ltd. Patentee after: New future semiconductor Co.,Ltd. Address before: Gyeonggi Do city of South Korea Patentee before: HANWHA TECHWIN Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Gyeonggi Do city of South Korea Patentee after: Hanhua Vision Co.,Ltd. Patentee after: New future semiconductor Co.,Ltd. Address before: Gyeonggi Do city of South Korea Patentee before: HANWHA TECHWIN Co.,Ltd. Patentee before: New future semiconductor Co.,Ltd. |