US20090086060A1 - Method and system for luminance noise filtering - Google Patents

Method and system for luminance noise filtering Download PDF

Info

Publication number
US20090086060A1
US20090086060A1 US12/315,147 US31514708A US2009086060A1 US 20090086060 A1 US20090086060 A1 US 20090086060A1 US 31514708 A US31514708 A US 31514708A US 2009086060 A1 US2009086060 A1 US 2009086060A1
Authority
US
United States
Prior art keywords
luminance
pixel data
region
pixel
pixel location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/315,147
Inventor
Hyung-Guen Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US12/315,147 priority Critical patent/US20090086060A1/en
Publication of US20090086060A1 publication Critical patent/US20090086060A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843Demosaicing, e.g. interpolating colour pixel values
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise

Definitions

  • the present invention relates generally to image pick-up devices, and more particularly, to luminance noise filtering for a pixel location using a region of pixel data directly from an image sensor such that line memory capacity is minimized.
  • FIG. 1 illustrates an image pick-up device 102 such as a camera system that includes an image sensor 104 .
  • the image sensor 104 generates pixel data for an image of an object 106 that is projected through an objective lens 108 onto the image sensor 104 .
  • the image sensor 104 may be a CIS (CMOS image sensor) commonly used in hand-held devices such as cell phones and PDA's (personal digital assistants).
  • a signal processor 110 manipulates the pixel data from the image sensor 104 for showing the image of the object 106 on a display 112 , or for further processing by an image recognition system 114 , or for sending the image via a transmission system 116 such that the image is shown on a remote display 118 .
  • the image sensor 104 generates pixel data 120 according to a Bayer filter array overlying the image sensor 104 .
  • the image sensor 104 With the Bayer filter array, the image sensor 104 generates an intensity signal of a respective color at each pixel location.
  • a square labeled with an “R” is for a pixel location on the image sensor 104 that generates an intensity signal of the red color component.
  • a square labeled with a “G” is for a pixel location on the image sensor 104 that generates an intensity signal of the green color component.
  • a square labeled with a “B” is for a pixel location on the image sensor 104 that generates an intensity signal of the blue color component.
  • An interpolation algorithm is then used by the signal processor 110 to determine the full set of intensity signals of the respective interpolated RGB color components for each of the pixel locations.
  • the interpolation algorithm uses the pixel data of the Bayer color filter array 120 for such a determination.
  • Temporal noise affects the quality of the image of the object as detected and generated by the image pick-up device 102 .
  • Temporal noise is the variation in the output from the image sensor 104 even under uniform illumination onto the image sensor 104 .
  • Such temporal noise may arise from shot noise and 1/f noise at the photo-diodes of the image sensor 104 , from thermal noise at the transistors and other circuit components used within the image sensor 104 , or from quantization error of an A/D (analog to digital) converter used within the image sensor 104 .
  • temporal noise increases with brightness of the image.
  • the detrimental effect of the temporal noise on the image is greater at lower illumination because the SNR (signal to noise ratio) decreases with lower illumination.
  • temporal noise sets a limit on the dynamic range of the image sensor 104 under dark conditions.
  • FIG. 4 illustrates a prior art process for reducing the effect of such temporal noise.
  • the pixel data 120 is generated with the Bayer color filter array at the image sensor 104 .
  • the signal processor 110 interpolates such pixel data 120 to generate the respective interpolated RGB color components 122 A, 122 B, and 122 C that are stored within a frame memory device 122 of the prior art.
  • a noise reducing block 132 uses such interpolated RGB color components for reducing the deleterious effects of the temporal noise.
  • FIG. 4 shows the noise reducing block 132 using the 3 ⁇ 3 arrays of the interpolated RGB color components 122 A, 122 B, and 122 C.
  • other prior art noise reducing processes may also use 5 ⁇ 5, 7 ⁇ 7, or other n ⁇ n arrays of the interpolated RGB color components.
  • the capacity of the frame memory device 122 is sufficient to store the n ⁇ n arrays of interpolated RGB color components used by the noise reducing block 132 .
  • a relatively large capacity of the frame memory device 122 is disadvantageous when the camera system 102 is incorporated as part of a hand-held device such as a cell phone or a PDA for example.
  • elimination of the frame memory device 122 is desired for a smaller device size, lower power dissipation, and lower cost especially when the camera system 102 is incorporated into a hand-held device.
  • luminance noise filtering is performed for a pixel location using a relatively small region of pixel data directly from the image sensor such that the frame memory may be eliminated.
  • a region of pixel data from the image sensor is used for determining a virtually filtered luminance for a pixel location within the region.
  • the virtually filtered luminance is determined by averaging the respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region.
  • the color components for the pixel location are determined from the region of pixel data.
  • a reference luminance is determined for the pixel location from the color components.
  • a final luminance of the pixel location is selected between the virtually filtered luminance and the reference luminance depending on an adaptive luminance that indicates the brightness of the image.
  • the present invention provides adaptive noise filtering by selecting the virtually filtered luminance as the final luminance for a darker image.
  • FIG. 1 shows components of an image pick-up device such as a camera system, according to the prior art
  • FIG. 2 illustrates interpolation of pixel data generated with a Bayer color filter array into color components, according to the prior art
  • FIG. 3 illustrates use of a region of pixel data generated with a Bayer color filter array for determining the color components of a pixel location within the region, according to the prior art
  • FIG. 4 illustrates a process for performing noise reduction after a n ⁇ n array of color components has been determined, according to the prior art
  • FIG. 5 illustrates a process for performing noise filtering using a region of pixel data for determining the luminance and the color components of a pixel location, according to an example embodiment of the present invention
  • FIG. 6 shows a block diagram of a system for performing noise filtering as illustrated in FIG. 5 such that frame memory is eliminated, according to an example embodiment of the present invention
  • FIG. 7 shows a flowchart during operation of the system of FIG. 6 , according to an example embodiment of the present invention
  • FIG. 8 illustrates use of a region of pixel data generated with the Bayer color filter array for determining color components of a pixel location within the region in a step of the flowchart of FIG. 7 , according to an example embodiment of the present invention
  • FIGS. 9A , 9 B, and 9 C illustrate use of the region of pixel data of FIG. 8 for determining a plurality of virtual luminance arrays, according to an example embodiment of the present invention
  • FIG. 10 shows a block diagram of a noise filter within the system of FIG. 6 , according to an example embodiment of the present invention
  • FIG. 11 shows an example graph used by a data processor within the system of FIG. 6 for determining a threshold value depending on an adaptive luminance, according to an example embodiment of the present invention.
  • FIG. 12 shows another example graph used by the data processor within the system of FIG. 6 for determining the threshold value depending on an auto exposure gain of the camera system, according to an example embodiment of the present invention.
  • FIGS. 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , and 12 refer to elements having similar structure and function.
  • a system 200 of a general aspect of the present invention performs noise filtering using a region of pixel data directly from the image sensor 104 .
  • the noise filtering is performed during determination of the luminance using such a region of pixel data for a single pixel location within the region.
  • FIG. 7 shows a flowchart of steps during operation of the system 200 of FIG. 6 .
  • a RGB matrix 202 includes a line memory device 204 for inputting and storing a region of pixel data 206 generated with a Bayer color filter array at the image sensor 104 (step 302 of FIG. 7 ).
  • the line memory device 204 may be implemented with any type of data storage devices.
  • the line memory device 204 may store pixel data for 4 ⁇ H pixel locations with H being the number of columns of pixels at the image sensor 104 (such as 648 columns for example) when the image sensor 104 outputs pixel data row by row.
  • the RGB matrix 202 also includes an interpolation processor 208 for determining interpolated color components R′, B′, and G′ of a pixel location 210 within the region 206 (step 304 of FIG. 7 ).
  • the interpolation processor 208 interpolates the region of pixel data 206 to generate the interpolated color components R′, B′, and G′.
  • Such interpolation algorithms for generating the interpolated color components R′, B′, and G′ are known to one of ordinary skill in the art.
  • the RGB matrix 202 determines a reference luminance, Y 1 H, from the interpolated color components R′, B′, and G′ as follows (step 304 of FIG. 7 ):
  • Such a reference luminance Y 1 H is calculated according to a conventional standard in the industry for calculating luminance as known to one of ordinary skill in the art.
  • the RGB matrix 202 includes a virtual luminance processor 212 for determining virtual luminance arrays Y 0 V, Y 1 V, and Y 2 V (step 304 of FIG. 7 ).
  • a first virtual luminance array Y 0 V [A B C], with A, B, and C each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as A, B, and C in the region of pixel data 206 .
  • a second virtual luminance array Y 1 V [D E F], with D, E, and F each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as D, E, and F in the region of pixel data 206 .
  • a third virtual luminance array Y 2 V [G H I], with G, H, and I each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as G, H, and I in the region of pixel data 206 .
  • the virtual luminance arrays Y 0 V, Y 1 V, and Y 2 V are determined for the pixel location 210 using the region of pixel data 206 that also determines the interpolated color components R′, G′, and B′ for the pixel location 210 .
  • the RGB matrix 202 sends the reference luminance Y 1 H and the virtual luminance arrays Y 0 V, Y 1 V, and Y 2 V to a noise filter 214 .
  • the RGB matrix 202 sends the interpolated color components R′, G′, and B′ to a chrominance signal processor 215 within a Y/C (luminance/chrominance) processor 216 .
  • the RGB matrix 202 sends the reference luminance Y 1 H and the interpolated color components R′, G′, and B′ to a data processor 218 .
  • FIG. 10 shows a block diagram for an example embodiment of the noise filter 214 that determines a virtually filtered luminance GOUT (step 306 of FIG. 7 ) from the virtual luminance arrays Y 0 V, Y 1 V, and Y 2 V.
  • the noise filter 214 includes multipliers 222 , 224 , and 226 and an adder 228 within a multiplying and summing block 230 .
  • the first multiplier 222 multiplies the first luminance array Y 0 V with a first weighted coefficient array GAD 0 [39 63 39] as follows:
  • the second multiplier 224 multiplies the second luminance array Y 1 V with a second weighted coefficient array GAD 1 [63 104 63] as follows:
  • the third multiplier 226 multiplies the third luminance array Y 2 V with a third weighted coefficient array GAD 2 [39 63 39] as follows:
  • the adder 228 sums together the resulting values from the multipliers 222 , 224 , and 226 .
  • a shifter 232 within a brightness control block 234 divides the result from the adder 228 with a sum of all the coefficients of GAD 0 , GAD 1 , and GAD 2 (i.e., 512 ).
  • a fourth multiplier 236 within the brightness control block 234 multiplies the result from the shifter 232 by a luminance compensation factor ⁇ , to generate the virtually filtered luminance GOUT.
  • the luminance compensation factor ⁇ and the weighted coefficient arrays GAD 0 , GAD 1 , and GAD 2 are determined using a Gaussian distribution equation for optimum image quality and are stored within a data register 220 in FIG. 6 .
  • the virtually filtered luminance GOUT is determined by averaging a respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region 206 .
  • the data processor 218 determines a threshold value THV (step 306 of FIG. 7 ).
  • the data processor 218 determines THV dependent on an adaptive luminance, AY, as illustrated by the graph 223 of FIG. 11 .
  • the adaptive luminance, AY indicates the overall brightness of a previous image, in one example embodiment of the present invention.
  • THV is determined according to another graph 225 dependent on the auto exposure gain used by the camera system 102 .
  • the auto exposure gain indicates a brightness of the image to be detected by the image sensor 102 within the camera system 102 , as known to one of ordinary skill in the art.
  • a higher auto exposure gain indicates a darker image for a higher THV according to the graph 225 of FIG. 12 .
  • the auto exposure gain indicates the adaptive luminance AY.
  • the reference luminance Y 1 H is used as indicating the adaptive luminance AY in FIG. 11 .
  • THV is determined depending on a brightness level for each pixel location.
  • the adaptive luminance AY is an average of the respective reference luminance Y 1 H for a predetermined region of pixel data.
  • the THV is determined to be higher for a darker image according to the graph 223 of FIG. 11 .
  • a comparing block 238 includes a subtractor 240 and an absolute value generator 242 that determine an absolute of the difference between the virtually filtered luminance GOUT and the reference luminance Y 1 H (i.e., delta) (step 308 of FIG. 7 ).
  • a comparator 244 within the comparing block 238 compares delta with THV (step 310 in FIG. 7 ).
  • a multiplexer 246 inputs the reference luminance Y 1 H and the virtually filtered luminance GOUT.
  • the comparator 244 controls the multiplexer 246 to select and output the virtually filtered luminance GOUT as a final luminance of the pixel location 210 when delta is less than or equal to THV (step 312 of FIG. 7 ).
  • the comparator 244 controls the multiplexer 246 to select and output the reference luminance Y 1 H as the final luminance of the pixel location 210 when delta is greater than THV (step 314 of FIG. 7 ).
  • steps 302 , 304 , 306 , 308 , 310 , 312 , 314 , and 316 are repeated for another pixel location with another region of pixel data from the image sensor 104 . Such steps are repeated for determining the respective luminance and interpolated color components for each pixel location with a respective region of pixel data of the image.
  • a larger array of pixel data is generated from the image sensor 104 for producing a smaller array of the processed image, as known to one of ordinary skill in the art.
  • Pixel data from locations toward the outer perimeter of the image sensor 104 are used for image signal processing of adjacent pixel locations toward the center of the processed image.
  • Such pixel locations toward the outer perimeter become cut off from the processed image because a sufficient region of pixel data surrounding such a pixel location is not available, as known to one of ordinary skill in the art.
  • Steps 304 , 306 , 308 , 310 , 312 , 314 , and 316 of FIG. 7 are repeated for each of the pixel locations for the processed image.
  • noise filtering is performed for a single pixel location using a region of pixel data 206 directly from the image sensor 104 while determining the final luminance Y 1 H/GOUT for the pixel location 210 .
  • the region of pixel data 206 is also used for determining the interpolated color components R′, G′, and B′ of the pixel location 210 . Because noise filtering is performed by using the region of pixel data 206 directly from the image sensor 104 , frame memory for storing interpolated pixel data may be eliminated with the present invention.
  • the capacity of the memory device included in the image pick-up device may be minimized since the luminance noise filter uses the image data directly from the image sensor for determining the final luminance Y 1 H/GOUT and the interpolated color components R′, G′, and B′ of the pixel location 210 .
  • Such smaller memory capacity is advantageous for smaller device size, lower power dissipation, and lower cost especially when the camera system is incorporated into a hand-held device.
  • the present invention provides adaptive noise filtering by varying the threshold value THV depending on the brightness of the image.
  • the reference luminance Y 1 H is selected as the final luminance instead of the virtually filtered luminance GOUT.
  • Noise filtering introduces distortion to the image, and the effect of temporal noise is less for a brighter image.
  • the reference luminance Y 1 H without distortion from virtual noise filtering is selected as the final luminance for a brighter image.
  • the deleterious effect of temporal noise is greater for a darker image.
  • the virtually filtered luminance GOUT with noise filtering is selected as the final luminance for a darker image.
  • a luminance signal processor 217 within the Y/C processor 216 processes the final luminance Y 1 H/GOUT for performing contour compensation to output a luminance signal Y for a Y/C (luminance/chrominance) formatter 219 .
  • a chrominance signal processor 217 within the Y/C processor 216 receives the interpolated color components R′, G′, and B′ and auto white balance data (AWBD) from the data processor 218 to generate further color components R′′-Y and B′′-Y for the Y/C formatter 219 .
  • the R′′ is an intensity of the interpolated color component R′ which is adjusted by the auto white balance data
  • the B′′ is an intensity of the interpolated color component B′ which is adjusted by the auto white balance data.
  • the Y/C formatter 219 generates luminance and chrominance data Y, Cb, Cr/R, and color data R′′′, G′′′, and B′′′ according to a standard as required by the display 112 , the image recognition system 116 , or the transmission system 116 .
  • Such components of the Y/C processor 216 and the Y/C formatter 219 are known to one of ordinary skill in the art.
  • the data processor 218 also determines and outputs to the image pick-up device auto exposure control data AED from Y 1 H, R′, G′, and B′, as known to one of ordinary skill in the art.
  • the present invention lies in the darkly outlined components of the RGB matrix 202 , the noise filter 214 , the data processor 218 , and the data register 220 in FIG. 6 , and the other components of FIG. 6 are known to one of ordinary skill in the art.
  • the present invention is described for the camera system 102 that may be part of a hand-held device.
  • the present invention may be used for any type of imaging device performing image signal processing.
  • the components illustrated and described herein for an example embodiment of the present invention may be implemented with any combination of hardware and/or software and in discrete and/or integrated circuits.
  • any number as illustrated and described herein is by way of example only.
  • any number of pixels as illustrated and described herein is by way of example only.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Processing Of Color Television Signals (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

In a method and system for luminance noise filtering, a region of pixel data directly from the image sensor is used for determining a virtually filtered luminance for a pixel location within the region. Luminance noise reduction is performed using the region of pixel data directly from the image sensor such that frame memory is eliminated. In addition, the present invention provides adaptive noise filtering by selecting the virtually filtered luminance as a final luminance for a darker image and by selecting a reference luminance without virtual noise filtering for a brighter image.

Description

    CROSS-REFERENCE TO RELATED APPLICATION(S)
  • The present application is a continuation application of an earlier filed copending patent application with Ser. No. 10/776,447 filed on Feb. 10, 2004, for which priority is claimed. This earlier filed copending patent application with Ser. No. 10/776,447 is in its entirety incorporated herewith by reference.
  • The present application also claims priority under 35 USC § 119 to Korean Patent Application No. 2003-0037268, filed on Jun. 10, 2003, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference. A certified copy of Korean Patent Application No. 2003-0037268 is contained in the parent copending patent application with Ser. No. 10/776,447.
  • TECHNICAL FIELD
  • The present invention relates generally to image pick-up devices, and more particularly, to luminance noise filtering for a pixel location using a region of pixel data directly from an image sensor such that line memory capacity is minimized.
  • BACKGROUND OF THE INVENTION
  • FIG. 1 illustrates an image pick-up device 102 such as a camera system that includes an image sensor 104. The image sensor 104 generates pixel data for an image of an object 106 that is projected through an objective lens 108 onto the image sensor 104. For example, the image sensor 104 may be a CIS (CMOS image sensor) commonly used in hand-held devices such as cell phones and PDA's (personal digital assistants).
  • A signal processor 110 manipulates the pixel data from the image sensor 104 for showing the image of the object 106 on a display 112, or for further processing by an image recognition system 114, or for sending the image via a transmission system 116 such that the image is shown on a remote display 118. Referring to FIGS. 1 and 2, the image sensor 104 generates pixel data 120 according to a Bayer filter array overlying the image sensor 104.
  • With the Bayer filter array, the image sensor 104 generates an intensity signal of a respective color at each pixel location. A square labeled with an “R” is for a pixel location on the image sensor 104 that generates an intensity signal of the red color component. Similarly, a square labeled with a “G” is for a pixel location on the image sensor 104 that generates an intensity signal of the green color component. Further, a square labeled with a “B” is for a pixel location on the image sensor 104 that generates an intensity signal of the blue color component.
  • An interpolation algorithm is then used by the signal processor 110 to determine the full set of intensity signals of the respective interpolated RGB color components for each of the pixel locations. The interpolation algorithm uses the pixel data of the Bayer color filter array 120 for such a determination.
  • Such an interpolation algorithm is known to one of ordinary skill in the art as disclosed in U.S. Pat. No. 5,382,976, U.S. Pat. No. 5,506,619, or U.S. Pat. No. 6,091,862. For determining the interpolated color components R′, G′, and B′ at a particular pixel location 124 with such an interpolation algorithm, a region of pixel data 126 surrounding that pixel location 124 is used as illustrated in FIG. 3.
  • Temporal noise affects the quality of the image of the object as detected and generated by the image pick-up device 102. Temporal noise is the variation in the output from the image sensor 104 even under uniform illumination onto the image sensor 104. Such temporal noise may arise from shot noise and 1/f noise at the photo-diodes of the image sensor 104, from thermal noise at the transistors and other circuit components used within the image sensor 104, or from quantization error of an A/D (analog to digital) converter used within the image sensor 104.
  • Such temporal noise increases with brightness of the image. However, the detrimental effect of the temporal noise on the image is greater at lower illumination because the SNR (signal to noise ratio) decreases with lower illumination. In fact, temporal noise sets a limit on the dynamic range of the image sensor 104 under dark conditions.
  • FIG. 4 illustrates a prior art process for reducing the effect of such temporal noise. The pixel data 120 is generated with the Bayer color filter array at the image sensor 104. The signal processor 110 interpolates such pixel data 120 to generate the respective interpolated RGB color components 122A, 122B, and 122C that are stored within a frame memory device 122 of the prior art.
  • In the prior art, after the interpolated RGB color components 122A, 122B, and 122C for an n×n array of pixel locations are generated and stored in the frame memory device 122, a noise reducing block 132 uses such interpolated RGB color components for reducing the deleterious effects of the temporal noise. FIG. 4 shows the noise reducing block 132 using the 3×3 arrays of the interpolated RGB color components 122A, 122B, and 122C. However, other prior art noise reducing processes may also use 5×5, 7×7, or other n×n arrays of the interpolated RGB color components.
  • In any case for the prior art noise reducing process, the capacity of the frame memory device 122 is sufficient to store the n×n arrays of interpolated RGB color components used by the noise reducing block 132. However, such a relatively large capacity of the frame memory device 122 is disadvantageous when the camera system 102 is incorporated as part of a hand-held device such as a cell phone or a PDA for example. Thus, elimination of the frame memory device 122 is desired for a smaller device size, lower power dissipation, and lower cost especially when the camera system 102 is incorporated into a hand-held device.
  • SUMMARY OF THE INVENTION
  • Accordingly, in a general aspect of the present invention, luminance noise filtering is performed for a pixel location using a relatively small region of pixel data directly from the image sensor such that the frame memory may be eliminated.
  • In a general embodiment of the present invention, in a method and system for luminance noise filtering, a region of pixel data from the image sensor is used for determining a virtually filtered luminance for a pixel location within the region. In an example embodiment, the virtually filtered luminance is determined by averaging the respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region.
  • In another embodiment of the present invention, the color components for the pixel location are determined from the region of pixel data.
  • In a further embodiment of the present invention, a reference luminance is determined for the pixel location from the color components. A final luminance of the pixel location is selected between the virtually filtered luminance and the reference luminance depending on an adaptive luminance that indicates the brightness of the image. The present invention provides adaptive noise filtering by selecting the virtually filtered luminance as the final luminance for a darker image.
  • In this manner, noise filtering is performed for a pixel location within a region of pixel data using virtual luminance that is determined using such a region of pixel data directly from the image sensor. Thus, frame memory for storing interpolated pixel data is eliminated with the present invention. The elimination of frame memory is especially advantageous for smaller device size, lower power dissipation, and lower cost of the camera system incorporated into a hand-held device.
  • These and other features and advantages of the present invention will be better understood by considering the following detailed description of the invention which is presented with the attached drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows components of an image pick-up device such as a camera system, according to the prior art;
  • FIG. 2 illustrates interpolation of pixel data generated with a Bayer color filter array into color components, according to the prior art;
  • FIG. 3 illustrates use of a region of pixel data generated with a Bayer color filter array for determining the color components of a pixel location within the region, according to the prior art;
  • FIG. 4 illustrates a process for performing noise reduction after a n×n array of color components has been determined, according to the prior art;
  • FIG. 5 illustrates a process for performing noise filtering using a region of pixel data for determining the luminance and the color components of a pixel location, according to an example embodiment of the present invention;
  • FIG. 6 shows a block diagram of a system for performing noise filtering as illustrated in FIG. 5 such that frame memory is eliminated, according to an example embodiment of the present invention;
  • FIG. 7 shows a flowchart during operation of the system of FIG. 6, according to an example embodiment of the present invention;
  • FIG. 8 illustrates use of a region of pixel data generated with the Bayer color filter array for determining color components of a pixel location within the region in a step of the flowchart of FIG. 7, according to an example embodiment of the present invention;
  • FIGS. 9A, 9B, and 9C illustrate use of the region of pixel data of FIG. 8 for determining a plurality of virtual luminance arrays, according to an example embodiment of the present invention;
  • FIG. 10 shows a block diagram of a noise filter within the system of FIG. 6, according to an example embodiment of the present invention;
  • FIG. 11 shows an example graph used by a data processor within the system of FIG. 6 for determining a threshold value depending on an adaptive luminance, according to an example embodiment of the present invention; and
  • FIG. 12 shows another example graph used by the data processor within the system of FIG. 6 for determining the threshold value depending on an auto exposure gain of the camera system, according to an example embodiment of the present invention.
  • The figures referred to herein are drawn for clarity of illustration and are not necessarily drawn to scale. Elements having the same reference number in FIGS. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, and 12 refer to elements having similar structure and function.
  • DETAILED DESCRIPTION
  • Referring to FIGS. 5 and 6, a system 200 of a general aspect of the present invention performs noise filtering using a region of pixel data directly from the image sensor 104. In addition, the noise filtering is performed during determination of the luminance using such a region of pixel data for a single pixel location within the region. FIG. 7 shows a flowchart of steps during operation of the system 200 of FIG. 6.
  • The system 200 is typically implemented within the signal processor 110 for manipulating pixel data from the image sensor 104. Referring to FIGS. 6, 7, and 8, a RGB matrix 202 includes a line memory device 204 for inputting and storing a region of pixel data 206 generated with a Bayer color filter array at the image sensor 104 (step 302 of FIG. 7).
  • The line memory device 204 may be implemented with any type of data storage devices. For example, the line memory device 204 may store pixel data for 4×H pixel locations with H being the number of columns of pixels at the image sensor 104 (such as 648 columns for example) when the image sensor 104 outputs pixel data row by row.
  • The RGB matrix 202 also includes an interpolation processor 208 for determining interpolated color components R′, B′, and G′ of a pixel location 210 within the region 206 (step 304 of FIG. 7). Referring to FIG. 8, the interpolation processor 208 interpolates the region of pixel data 206 to generate the interpolated color components R′, B′, and G′. Such interpolation algorithms for generating the interpolated color components R′, B′, and G′ are known to one of ordinary skill in the art.
  • In addition, the RGB matrix 202 determines a reference luminance, Y1H, from the interpolated color components R′, B′, and G′ as follows (step 304 of FIG. 7):

  • Y1H=(19*R′+38*G′+7*B′)/64
  • Such a reference luminance Y1H is calculated according to a conventional standard in the industry for calculating luminance as known to one of ordinary skill in the art.
  • Furthermore, the RGB matrix 202 includes a virtual luminance processor 212 for determining virtual luminance arrays Y0V, Y1V, and Y2V (step 304 of FIG. 7). Referring to FIG. 9A, a first virtual luminance array Y0V=[A B C], with A, B, and C each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as A, B, and C in the region of pixel data 206.
  • Similarly, referring to FIG. 9B, a second virtual luminance array Y1V=[D E F], with D, E, and F each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as D, E, and F in the region of pixel data 206. Also, referring to FIG. 9C, a third virtual luminance array Y2V=[G H I], with G, H, and I each being a respective average of the intensity values of a respective four pixels included in a box correspondingly labeled as G, H, and I in the region of pixel data 206. In this manner, the virtual luminance arrays Y0V, Y1V, and Y2V are determined for the pixel location 210 using the region of pixel data 206 that also determines the interpolated color components R′, G′, and B′ for the pixel location 210.
  • Referring back to FIG. 6, the RGB matrix 202 sends the reference luminance Y1H and the virtual luminance arrays Y0V, Y1V, and Y2V to a noise filter 214. In addition, the RGB matrix 202 sends the interpolated color components R′, G′, and B′ to a chrominance signal processor 215 within a Y/C (luminance/chrominance) processor 216. Furthermore, the RGB matrix 202 sends the reference luminance Y1H and the interpolated color components R′, G′, and B′ to a data processor 218.
  • FIG. 10 shows a block diagram for an example embodiment of the noise filter 214 that determines a virtually filtered luminance GOUT (step 306 of FIG. 7) from the virtual luminance arrays Y0V, Y1V, and Y2V. The noise filter 214 includes multipliers 222, 224, and 226 and an adder 228 within a multiplying and summing block 230.
  • The first multiplier 222 multiplies the first luminance array Y0V with a first weighted coefficient array GAD0 [39 63 39] as follows:

  • 39*A+63*B+39*C.
  • Similarly, the second multiplier 224 multiplies the second luminance array Y1V with a second weighted coefficient array GAD1 [63 104 63] as follows:

  • 63*D+104*E+63*F.
  • Also, the third multiplier 226 multiplies the third luminance array Y2V with a third weighted coefficient array GAD2 [39 63 39] as follows:

  • 39*G+63*H+39*I.
  • The adder 228 sums together the resulting values from the multipliers 222, 224, and 226. A shifter 232 within a brightness control block 234 divides the result from the adder 228 with a sum of all the coefficients of GAD0, GAD1, and GAD2 (i.e., 512). A fourth multiplier 236 within the brightness control block 234 multiplies the result from the shifter 232 by a luminance compensation factor α, to generate the virtually filtered luminance GOUT.
  • In one embodiment of the present invention, the luminance compensation factor α and the weighted coefficient arrays GAD0, GAD1, and GAD2 are determined using a Gaussian distribution equation for optimum image quality and are stored within a data register 220 in FIG. 6. In this manner, the virtually filtered luminance GOUT is determined by averaging a respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region 206.
  • In addition, referring to FIG. 6, the data processor 218 determines a threshold value THV (step 306 of FIG. 7). Referring to FIG. 11, the data processor 218 determines THV dependent on an adaptive luminance, AY, as illustrated by the graph 223 of FIG. 11. The adaptive luminance, AY, indicates the overall brightness of a previous image, in one example embodiment of the present invention.
  • For example, in FIG. 12, THV is determined according to another graph 225 dependent on the auto exposure gain used by the camera system 102. The auto exposure gain indicates a brightness of the image to be detected by the image sensor 102 within the camera system 102, as known to one of ordinary skill in the art. A higher auto exposure gain indicates a darker image for a higher THV according to the graph 225 of FIG. 12. In such an example, the auto exposure gain indicates the adaptive luminance AY.
  • In another embodiment of the present invention, the reference luminance Y1H is used as indicating the adaptive luminance AY in FIG. 11. In that case, THV is determined depending on a brightness level for each pixel location. Alternatively, the adaptive luminance AY is an average of the respective reference luminance Y1H for a predetermined region of pixel data. In any case, the THV is determined to be higher for a darker image according to the graph 223 of FIG. 11.
  • Referring back to FIG. 10, a comparing block 238 includes a subtractor 240 and an absolute value generator 242 that determine an absolute of the difference between the virtually filtered luminance GOUT and the reference luminance Y1H (i.e., delta) (step 308 of FIG. 7). A comparator 244 within the comparing block 238 compares delta with THV (step 310 in FIG. 7).
  • In FIG. 10, a multiplexer 246 inputs the reference luminance Y1H and the virtually filtered luminance GOUT. The comparator 244 controls the multiplexer 246 to select and output the virtually filtered luminance GOUT as a final luminance of the pixel location 210 when delta is less than or equal to THV (step 312 of FIG. 7). Alternatively, the comparator 244 controls the multiplexer 246 to select and output the reference luminance Y1H as the final luminance of the pixel location 210 when delta is greater than THV (step 314 of FIG. 7).
  • If the pixel location 210 is a last pixel location for an image (step 316 of FIG. 7), the flowchart of FIG. 7 ends. Otherwise, steps 302, 304, 306, 308, 310, 312, 314, and 316 are repeated for another pixel location with another region of pixel data from the image sensor 104. Such steps are repeated for determining the respective luminance and interpolated color components for each pixel location with a respective region of pixel data of the image.
  • Generally, a larger array of pixel data is generated from the image sensor 104 for producing a smaller array of the processed image, as known to one of ordinary skill in the art. Pixel data from locations toward the outer perimeter of the image sensor 104 are used for image signal processing of adjacent pixel locations toward the center of the processed image. However, such pixel locations toward the outer perimeter become cut off from the processed image because a sufficient region of pixel data surrounding such a pixel location is not available, as known to one of ordinary skill in the art. Steps 304, 306, 308, 310, 312, 314, and 316 of FIG. 7 are repeated for each of the pixel locations for the processed image.
  • In this manner, noise filtering is performed for a single pixel location using a region of pixel data 206 directly from the image sensor 104 while determining the final luminance Y1H/GOUT for the pixel location 210. The region of pixel data 206 is also used for determining the interpolated color components R′, G′, and B′ of the pixel location 210. Because noise filtering is performed by using the region of pixel data 206 directly from the image sensor 104, frame memory for storing interpolated pixel data may be eliminated with the present invention.
  • Thus, the capacity of the memory device included in the image pick-up device may be minimized since the luminance noise filter uses the image data directly from the image sensor for determining the final luminance Y1H/GOUT and the interpolated color components R′, G′, and B′ of the pixel location 210. Such smaller memory capacity is advantageous for smaller device size, lower power dissipation, and lower cost especially when the camera system is incorporated into a hand-held device.
  • In addition, the present invention provides adaptive noise filtering by varying the threshold value THV depending on the brightness of the image. For a brighter image, the reference luminance Y1H is selected as the final luminance instead of the virtually filtered luminance GOUT. Noise filtering introduces distortion to the image, and the effect of temporal noise is less for a brighter image. Thus, the reference luminance Y1H without distortion from virtual noise filtering is selected as the final luminance for a brighter image. On the other hand, the deleterious effect of temporal noise is greater for a darker image. Thus, the virtually filtered luminance GOUT with noise filtering is selected as the final luminance for a darker image.
  • Referring back to FIG. 6, a luminance signal processor 217 within the Y/C processor 216 processes the final luminance Y1H/GOUT for performing contour compensation to output a luminance signal Y for a Y/C (luminance/chrominance) formatter 219. A chrominance signal processor 217 within the Y/C processor 216 receives the interpolated color components R′, G′, and B′ and auto white balance data (AWBD) from the data processor 218 to generate further color components R″-Y and B″-Y for the Y/C formatter 219. The R″ is an intensity of the interpolated color component R′ which is adjusted by the auto white balance data, and the B″ is an intensity of the interpolated color component B′ which is adjusted by the auto white balance data.
  • The Y/C formatter 219 generates luminance and chrominance data Y, Cb, Cr/R, and color data R′″, G′″, and B′″ according to a standard as required by the display 112, the image recognition system 116, or the transmission system 116. Such components of the Y/C processor 216 and the Y/C formatter 219 are known to one of ordinary skill in the art. The data processor 218 also determines and outputs to the image pick-up device auto exposure control data AED from Y1H, R′, G′, and B′, as known to one of ordinary skill in the art. The present invention lies in the darkly outlined components of the RGB matrix 202, the noise filter 214, the data processor 218, and the data register 220 in FIG. 6, and the other components of FIG. 6 are known to one of ordinary skill in the art.
  • The foregoing is by way of example only and is not intended to be limiting. For example, the present invention is described for the camera system 102 that may be part of a hand-held device. However, the present invention may be used for any type of imaging device performing image signal processing. In addition, the components illustrated and described herein for an example embodiment of the present invention may be implemented with any combination of hardware and/or software and in discrete and/or integrated circuits. In addition, any number as illustrated and described herein is by way of example only. For example, any number of pixels as illustrated and described herein is by way of example only.
  • The present invention is limited only as defined in the following claims and equivalents thereof.

Claims (21)

1. A method for luminance noise filtering, comprising:
inputting a region of pixel data from an image sensor;
determining a virtually filtered luminance from a first processing of said region of pixel data and without using other pixel data for a pixel location within the region; and
determining a reference luminance for the pixel location from a second processing of said same region of pixel data and without using other pixel data,
wherein the reference luminance is determined after respective interpolated color components for the pixel location are determined such that the reference luminance is determined using said respective interpolated color components.
2. The method of claim 1, wherein the second processing includes the steps of:
determining said interpolated color components for the pixel location from said region of pixel data; and
determining the reference luminance for the pixel location from the interpolated color components.
3. The method of claim 1, further comprising:
selecting between the virtually filtered luminance and the reference luminance as a final luminance of the pixel location depending on an adaptive luminance.
4. The method of claim 3, further comprising:
determining a threshold value from the adaptive luminance;
selecting the virtually filtered luminance if an absolute of a difference between the virtually filtered luminance and the reference luminance is less than or equal to the threshold value; and
selecting the reference luminance if the absolute of the difference between the virtually filtered luminance and the reference luminance is greater than the threshold value.
5. The method of claim 4, wherein the adaptive luminance is determined from an average reference luminance for a predetermined region of pixel data.
6. The method of claim 3, wherein the adaptive luminance is indicated by an auto exposure gain for the image sensor.
7. The method of claim 3, wherein the adaptive luminance is indicated by the reference luminance.
8. The method of claim 1, wherein the virtually filtered luminance is determined by averaging a respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region.
9. The method of claim 1, wherein the image sensor is part of a hand-held image pick-up device having minimized line memory capacity.
10. A system for luminance noise filtering, comprising:
a memory device for storing a region of pixel data from an image sensor;
a noise filter for determining a virtually filtered luminance from a first processing of said region of pixel data and without using other pixel data for a pixel location within the region; and
a matrix for determining a reference luminance for the pixel location from a second processing of said same region of pixel data and without using other pixel data,
wherein the matrix determines the reference luminance after respective interpolated color components for the pixel location are determined such that the reference luminance is determined using said respective interpolated color components.
11. The system of claim 10, wherein the matrix determines said interpolated color components for the pixel location from said region of pixel data such that the reference luminance is determined from the interpolated color components.
12. The system of claim 10, wherein the noise filter selects between the virtually filtered luminance and the reference luminance as a final luminance of the pixel location depending on an adaptive luminance.
13. The system of claim 12, further comprising:
a data processor that determines a threshold value from the adaptive luminance;
wherein the noise filter selects the virtually filtered luminance if an absolute of a difference between the virtually filtered luminance and the reference luminance is less than or equal to the threshold value; and
wherein the noise filter selects the reference luminance if the absolute of the difference between the virtually filtered luminance and the reference luminance is greater than the threshold value.
14. The system of claim 13, wherein the adaptive luminance is determined from an average reference luminance for a predetermined region of pixel data.
15. The system of claim 12, wherein the adaptive luminance is indicated by an auto exposure gain for the image sensor.
16. The system of claim 12, wherein the adaptive luminance is indicated by the reference luminance.
17. The system of claim 10, wherein the virtual luminance is determined by averaging a respective pixel data multiplied with a respective weighting coefficient for each pixel location of the region.
18. The system of claim 10, wherein the image sensor is part of a hand-held image pick-up device having minimized line memory capacity.
19. A system for luminance noise filtering, comprising:
means for inputting a region of pixel data from an image sensor;
means for determining a virtually filtered luminance from said region of pixel data and without using other pixel data for a pixel location within the region; and
means for determining a reference luminance for the pixel location from a second processing of said same region of pixel data and without using other pixel data,
wherein the reference luminance is determined after respective interpolated color components for the pixel location are determined such that the reference luminance is determined using said respective interpolated color components.
20. The system of claim 19, further comprising:
means for determining said interpolated color components for the pixel location from the said region of pixel data; and
means for determining the reference luminance for the pixel location from the interpolated color components.
21. The system of claim 20, further comprising:
means for selecting between the virtually filtered luminance and the reference luminance as a final luminance of the pixel location depending on an adaptive luminance.
US12/315,147 2003-06-10 2008-11-28 Method and system for luminance noise filtering Abandoned US20090086060A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/315,147 US20090086060A1 (en) 2003-06-10 2008-11-28 Method and system for luminance noise filtering

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2003-0037268A KR100510532B1 (en) 2003-06-10 2003-06-10 Adaptive noise reduction filter for Bayer pattern color signal, digital image signal processor having it, and method thereof
KRP2003-0037268 2003-06-10
US10/776,447 US7538808B2 (en) 2003-06-10 2004-02-10 Method and system for luminance noise filtering
US12/315,147 US20090086060A1 (en) 2003-06-10 2008-11-28 Method and system for luminance noise filtering

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/776,447 Continuation US7538808B2 (en) 2003-06-10 2004-02-10 Method and system for luminance noise filtering

Publications (1)

Publication Number Publication Date
US20090086060A1 true US20090086060A1 (en) 2009-04-02

Family

ID=33509651

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/776,447 Active 2026-05-24 US7538808B2 (en) 2003-06-10 2004-02-10 Method and system for luminance noise filtering
US12/315,147 Abandoned US20090086060A1 (en) 2003-06-10 2008-11-28 Method and system for luminance noise filtering

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/776,447 Active 2026-05-24 US7538808B2 (en) 2003-06-10 2004-02-10 Method and system for luminance noise filtering

Country Status (3)

Country Link
US (2) US7538808B2 (en)
JP (1) JP4887546B2 (en)
KR (1) KR100510532B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070230774A1 (en) * 2006-03-31 2007-10-04 Sony Corporation Identifying optimal colors for calibration and color filter array design
US20070236580A1 (en) * 2006-03-31 2007-10-11 Sony Corporation Error analysis for image interpolation and demosaicing using lattice theory
US20110044544A1 (en) * 2006-04-24 2011-02-24 PixArt Imaging Incorporation, R.O.C. Method and system for recognizing objects in an image based on characteristics of the objects
US20110254924A1 (en) * 2009-11-27 2011-10-20 Thales Optronic system and method dedicated to identification for formulating three-dimensional images

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100510532B1 (en) * 2003-06-10 2005-08-26 삼성전자주식회사 Adaptive noise reduction filter for Bayer pattern color signal, digital image signal processor having it, and method thereof
KR100699834B1 (en) * 2005-02-07 2007-03-27 삼성전자주식회사 Method and apparatus for processing bayer-pattern color digital image signal
JP4712497B2 (en) * 2005-09-15 2011-06-29 ローム株式会社 Filter circuit, and image sensor, image sensor module, and image reading apparatus using the same
US20070153117A1 (en) * 2005-12-30 2007-07-05 Yen-Yu Lin Apparatus and method for adjusting display-related setting of an electronic device
JP4949766B2 (en) * 2006-08-09 2012-06-13 オンセミコンダクター・トレーディング・リミテッド Image signal processing device
US20080091966A1 (en) * 2006-10-13 2008-04-17 Alpha Imaging Technology, R.O.C. Structure and method for booting an image signal processor
US8711249B2 (en) * 2007-03-29 2014-04-29 Sony Corporation Method of and apparatus for image denoising
US8108211B2 (en) * 2007-03-29 2012-01-31 Sony Corporation Method of and apparatus for analyzing noise in a signal processing system
US20090040351A1 (en) * 2007-08-09 2009-02-12 Micron Technology, Inc. Method and apparatus for reducing noise in a pixel array
US10326969B2 (en) * 2013-08-12 2019-06-18 Magna Electronics Inc. Vehicle vision system with reduction of temporal noise in images
CN103871035B (en) * 2014-03-24 2017-04-12 华为技术有限公司 Image denoising method and device
CN104599292B (en) * 2015-02-03 2016-03-23 中国人民解放军国防科学技术大学 A kind of anti-noise moving object detection algorithm decomposed based on low-rank matrix
KR102194447B1 (en) 2019-04-25 2020-12-23 주식회사 포바이포 Method for removing digital image noise

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581298A (en) * 1988-11-09 1996-12-03 Canon Kabushiki Kaisha Color signal processing apparatus using plural luminance signals
US5668932A (en) * 1993-01-29 1997-09-16 Microsoft Corporation Digital video data compression technique
US5880782A (en) * 1994-12-30 1999-03-09 Sony Corporation System and method for controlling exposure of a video camera by utilizing luminance values selected from a plurality of luminance values
US6269181B1 (en) * 1997-11-03 2001-07-31 Intel Corporation Efficient algorithm for color recovery from 8-bit to 24-bit color pixels
US6937772B2 (en) * 2000-12-20 2005-08-30 Eastman Kodak Company Multiresolution based method for removing noise from digital images
US7139022B1 (en) * 2002-06-19 2006-11-21 Neomagic Corp. Edge enhancer for RGB-Beyer to YUV 4:2:0 converter with sharpened-Y feedback to U, V transformer
US7538808B2 (en) * 2003-06-10 2009-05-26 Samsung Electronics Co., Ltd. Method and system for luminance noise filtering

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2744260B2 (en) * 1988-11-22 1998-04-28 キヤノン株式会社 Color signal processing device
JPH0630308A (en) * 1992-07-13 1994-02-04 Matsushita Electric Ind Co Ltd Picture data processing unit
JPH0779372A (en) * 1993-06-30 1995-03-20 Sony Corp Electronic camera device
US5382976A (en) * 1993-06-30 1995-01-17 Eastman Kodak Company Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients
JPH08202871A (en) * 1995-01-20 1996-08-09 Advantest Corp Picture information processor
US5506619A (en) * 1995-03-17 1996-04-09 Eastman Kodak Company Adaptive color plan interpolation in single sensor color electronic camera
US6421083B1 (en) * 1996-03-29 2002-07-16 Sony Corporation Color imaging device and method
JP3503372B2 (en) * 1996-11-26 2004-03-02 ミノルタ株式会社 Pixel interpolation device and pixel interpolation method
JP2001045298A (en) * 1999-07-27 2001-02-16 Sharp Corp Method for processing picture, recording medium recording picture processing program and picture processor
JP4136255B2 (en) * 2000-02-29 2008-08-20 キヤノン株式会社 Image processing apparatus and method
JP4210021B2 (en) * 2000-06-21 2009-01-14 富士フイルム株式会社 Image signal processing apparatus and image signal processing method
JP4294887B2 (en) * 2001-05-24 2009-07-15 富士通株式会社 Image processing apparatus, image processing method, and image processing program
JP4358462B2 (en) * 2001-07-03 2009-11-04 富士フイルム株式会社 Noise removal circuit
KR100396898B1 (en) 2001-09-13 2003-09-02 삼성전자주식회사 A device and method for processing the output data from image sensor
US7133553B2 (en) * 2003-02-18 2006-11-07 Avago Technologies Sensor Ip Pte. Ltd. Correlation-based color mosaic interpolation adjustment using luminance gradients

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581298A (en) * 1988-11-09 1996-12-03 Canon Kabushiki Kaisha Color signal processing apparatus using plural luminance signals
US5668932A (en) * 1993-01-29 1997-09-16 Microsoft Corporation Digital video data compression technique
US5880782A (en) * 1994-12-30 1999-03-09 Sony Corporation System and method for controlling exposure of a video camera by utilizing luminance values selected from a plurality of luminance values
US6269181B1 (en) * 1997-11-03 2001-07-31 Intel Corporation Efficient algorithm for color recovery from 8-bit to 24-bit color pixels
US6937772B2 (en) * 2000-12-20 2005-08-30 Eastman Kodak Company Multiresolution based method for removing noise from digital images
US7139022B1 (en) * 2002-06-19 2006-11-21 Neomagic Corp. Edge enhancer for RGB-Beyer to YUV 4:2:0 converter with sharpened-Y feedback to U, V transformer
US7538808B2 (en) * 2003-06-10 2009-05-26 Samsung Electronics Co., Ltd. Method and system for luminance noise filtering

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070230774A1 (en) * 2006-03-31 2007-10-04 Sony Corporation Identifying optimal colors for calibration and color filter array design
US20070236580A1 (en) * 2006-03-31 2007-10-11 Sony Corporation Error analysis for image interpolation and demosaicing using lattice theory
US7558423B2 (en) * 2006-03-31 2009-07-07 Sony Corporation Error analysis for image interpolation and demosaicing using lattice theory
US20110044544A1 (en) * 2006-04-24 2011-02-24 PixArt Imaging Incorporation, R.O.C. Method and system for recognizing objects in an image based on characteristics of the objects
US20110254924A1 (en) * 2009-11-27 2011-10-20 Thales Optronic system and method dedicated to identification for formulating three-dimensional images
US8836762B2 (en) * 2009-11-27 2014-09-16 Thales Optronic system and method dedicated to identification for formulating three-dimensional images

Also Published As

Publication number Publication date
KR20040106076A (en) 2004-12-17
US20040252208A1 (en) 2004-12-16
US7538808B2 (en) 2009-05-26
JP2011040088A (en) 2011-02-24
JP4887546B2 (en) 2012-02-29
KR100510532B1 (en) 2005-08-26

Similar Documents

Publication Publication Date Title
US20090086060A1 (en) Method and system for luminance noise filtering
US8014626B2 (en) Image processing device, image processing method, and program
US7570390B2 (en) Image processing device and method
JP4687320B2 (en) Image processing apparatus and method, recording medium, and program
US7236190B2 (en) Digital image processing using white balance and gamma correction
US8942475B2 (en) Image signal processing device to emphasize contrast
JP5003196B2 (en) Image processing apparatus and method, and program
CN100366052C (en) Image processing device and method
US7710470B2 (en) Image processing apparatus that reduces noise, image processing method that reduces noise, electronic camera that reduces noise, and scanner that reduces noise
JP5223742B2 (en) Edge-enhanced image processing apparatus
US9865041B2 (en) Image processing apparatus, imaging apparatus, image processing method, and computer-processable non-transitory storage medium
US8411943B2 (en) Method and apparatus for image signal color correction with reduced noise
US7889942B2 (en) Dynamic range compensation-dependent noise reduction
US7710474B2 (en) Luminance signal processing device
JP2008258909A (en) Signal processing circuit
JP2000152033A (en) Image processor and image processing method
US8139856B2 (en) Image processing apparatus, imaging apparatus, and computer readable medium irregularizing pixel signals continuous in level near a saturation level
JPH11313336A (en) Signal processor and photographing signal processing method
JP2011100204A (en) Image processor, image processing method, image processing program, imaging apparatus, and electronic device
US7995856B2 (en) Dynamic range compensation-dependent noise reduction
JP3233114B2 (en) Image processing apparatus and image processing method
JP2000156871A (en) Image processor and image processing method
JP2003223636A (en) Image processor
US20100189350A1 (en) Image processing apparatus, image processing method, and program
JP4748702B2 (en) Luminance noise filtering method and luminance noise filtering system

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION