USRE44062E1 - Image sensor for detecting flicker noise and method thereof - Google Patents

Image sensor for detecting flicker noise and method thereof Download PDF

Info

Publication number
USRE44062E1
USRE44062E1 US12/874,820 US87482010A USRE44062E US RE44062 E1 USRE44062 E1 US RE44062E1 US 87482010 A US87482010 A US 87482010A US RE44062 E USRE44062 E US RE44062E
Authority
US
United States
Prior art keywords
pixel
value
frame
exposure time
pixel rows
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/874,820
Inventor
Chan-Ki Kim
Ki-Yong Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intellectual Ventures II LLC
Original Assignee
Intellectual Ventures II LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intellectual Ventures II LLC filed Critical Intellectual Ventures II LLC
Priority to US12/874,820 priority Critical patent/USRE44062E1/en
Assigned to INTELLECTUAL VENTURES II LLC reassignment INTELLECTUAL VENTURES II LLC MERGER (SEE DOCUMENT FOR DETAILS). Assignors: Crosstek Capital, LLC
Application granted granted Critical
Publication of USRE44062E1 publication Critical patent/USRE44062E1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/745—Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
    • E—FIXED CONSTRUCTIONS
    • E06—DOORS, WINDOWS, SHUTTERS, OR ROLLER BLINDS IN GENERAL; LADDERS
    • E06B—FIXED OR MOVABLE CLOSURES FOR OPENINGS IN BUILDINGS, VEHICLES, FENCES OR LIKE ENCLOSURES IN GENERAL, e.g. DOORS, WINDOWS, BLINDS, GATES
    • E06B1/00—Border constructions of openings in walls, floors, or ceilings; Frames to be rigidly mounted in such openings
    • E06B1/70—Sills; Thresholds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05Y—INDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF
    • E05Y2800/00—Details, accessories and auxiliary operations not otherwise provided for
    • E05Y2800/45—Manufacturing
    • E05Y2800/455—Extrusion
    • E—FIXED CONSTRUCTIONS
    • E06—DOORS, WINDOWS, SHUTTERS, OR ROLLER BLINDS IN GENERAL; LADDERS
    • E06B—FIXED OR MOVABLE CLOSURES FOR OPENINGS IN BUILDINGS, VEHICLES, FENCES OR LIKE ENCLOSURES IN GENERAL, e.g. DOORS, WINDOWS, BLINDS, GATES
    • E06B1/00—Border constructions of openings in walls, floors, or ceilings; Frames to be rigidly mounted in such openings
    • E06B1/04—Frames for doors, windows, or the like to be fixed in openings
    • E06B1/26—Frames of plastics

Definitions

  • the present invention relates to an image sensor and a method for detecting a flicker noise of the image sensor, which has improved functions so as to automatically eliminate the flicker noise.
  • an image sensor is a device of displaying images by using a feature that a semiconductor reacts to light. That is, the image sensor reads out electrical values by detecting lightness and wavelengths of different lights derived from different objects. The image sensor makes the electric values to levels able to be signal-processed.
  • the image sensor is a semiconductor device of changing an optical image to electrical values.
  • a charge-coupled device (CCD) is a device in which MOS capacitors are located very close to one another and charge, carriers are stored at the capacitors.
  • CCD charge-coupled device
  • CMOS Complementary Metal Oxide Semiconductor
  • CMOS Complementary Metal Oxide Semiconductor
  • CMOS Complementary Metal Oxide Semiconductor
  • CMOS Complementary Metal Oxide Semiconductor
  • the CMOS image sensor is used in personal portable systems such as a mobile phone since it consumes low power. Therefore, the image sensors are used in various areas of PC camera, medical instrument, toy and so on.
  • FIG. 1 is a block diagram showing a conventional image sensor.
  • the image sensor includes a controlling & external system interfacing block 10 , a pixel array 11 , an analog-line buffering block 12 , a column decoder 13 , an analog bus 14 , an analog signal processor (ASP) 15 and a digital signal processor (DSP) 16 .
  • a controlling & external system interfacing block 10 the image sensor includes a controlling & external system interfacing block 10 , a pixel array 11 , an analog-line buffering block 12 , a column decoder 13 , an analog bus 14 , an analog signal processor (ASP) 15 and a digital signal processor (DSP) 16 .
  • ASP analog signal processor
  • DSP digital signal processor
  • the ASP 15 contains a variable amplifier and an analog-to-digital converter (ADC) and the DSP 16 performs functions of error correction, color interpolation, gamma correction, color space conversion and so on.
  • ADC analog-to-digital converter
  • the pixel array 11 contains N ⁇ M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and is a core part of the image sensor for detecting information about images provided from the outside.
  • the controlling & external system interfacing block 10 controls a whole operation of the image sensor by using a finite state machine (FSM) and performs an interfacing operation for an external system. Since the block 10 includes an arrangement register (not shown), it is possible to program information related to various internal operations and the whole operation of the image sensor is controlled by the programmed information.
  • FSM finite state machine
  • the analog-line buffering block 12 detects voltages of pixels on a selected one row and stores the detected voltages therein. Among the analog data stored in the analog-line buffering block 12 , a data on a column chosen by the column decoder 13 is transferred to the variable amplifier in the ASP 15 through the analog bus 14 .
  • the variable amplifier e.g., a programmable gain amplifier (PGA) amplifies pixel voltages stored in the analog-line buffering block 12 when the pixel voltages are low.
  • the analog data amplified at the variable amplifier are color-corrected and then converted to digital values at the ADC.
  • the digital values are converted again according to video standards such as 4:2:2 or 4:4:4 at the DSP 16 after being processed by the above procedure.
  • the image sensor adopts a correlated double sampling (CDS) scheme to read a reset voltage signal and a data voltage signal from each pixel of the pixel array 11 and output a difference between the reset voltage signal and the data voltage signal.
  • CDS correlated double sampling
  • image sensor is still-camera, personal computer (PC) camera, medical, toy, and portable terminal and so on. If light sources are different, there occurs a flicker noise. Since, however, the greater part of application requires an image sensor usable without regard to a kind of light source, the image sensor needs a function of automatically eliminating the flicker noise.
  • the CMOS image sensor captures images by adjusting its exposure time to light. Therefore, if the exposure time is integer times of a frequency of a light source, there is no problem. However, if the exposure time is different from the frequency of the light source, in case of the CMOS image sensor capturing image data on a line-by-line basis, since the amount of light that each line receives is different, there occurs a flicker noise making a noise bar on a final image.
  • FIGS. 2A to 2E show graphs illustrating various cases in which flicker effects happen.
  • FIG. 2B shows the energy having a different frequency from the exposure time, i.e., a case that the exposure time is shorter than a frequency of the light source. In other words, it shows a case that the frequency of the energy is longer than the exposure time, i.e., the energy changes in a shorter time period.
  • FIG. 2C shows a case that the frequency of the energy is shorter than the exposure time, i.e., the energy changes in a longer time period.
  • a flicker noise when there occurs a flicker noise, a noise bar generated on the image flows upward or downward, or the noise bar is fixed in the image. At this time, the fixed flicker noise is difficult to be distinguished with a real image.
  • FIGS. 2D and 2E represent cases that there occur flicker noises fixed in the image.
  • sizes of flicker noises occurring in a first frame and a second frame are identical regardless of the relation between the exposure time and the frequency of the light source.
  • the fixed flicker noises are generated, if detecting the flicker noises by using a flicker noise of a different size for each frame as in an existing algorithm, it is impossible to detect the flicker noises.
  • an object of the present invention to provide an image sensor and a flicker noise detecting method capable of automatically eliminating flicker noises for every case that there occur the flicker noises.
  • an image sensor including a pixel array for capturing information about an image provided from the outside and having N pixel rows and M pixel columns for maximizing a feature of reacting to light, wherein M and N are integers, respectively, a flicker noise detective pixel unit containing X pixel rows, which has a form extended from the N pixel rows of the pixel array, and M pixel columns, wherein each pair of X pixel rows has an identical exposure time and X is an even number, and a flicker noise for controlling an exposure point for the flicker noise detective pixel unit and detecting the flicker noise by using outputs of the flicker noise detective pixel unit.
  • a method for detecting a flicker noise of an image sensor comprising the steps of: (a) securing information about images of a first pair of pixel rows by differing exposure points of the first pair of pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first pair of pixel rows; (b) capturing information about images of a second pair of pixel rows by differing exposure points of the second pair of pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the second pair of pixel rows; (c) calculating an average value of the image information for each pixel row of the first and the second pairs of pixel rows in every image information detecting process; (d) ciphering a maximum value and a minimum value among average values for said each pixel row obtained from the step (c); (e) determining a first subtract value by subtracting the minimum value from the maximum value of one pixel row having the first exposure time,
  • a method for detecting a flicker noise of an image sensor comprising the steps of: (a) securing information about an image of each of a first and a second pixel row by differing exposure points of the first and the second pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first and the second pixel rows; (b) capturing information about an image of each of a third and a fourth pixel row by differing exposure points of the third and the fourth pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the third and the fourth pixel rows; (c) calculating an average value of the image information for each of the first to the fourth pixel rows in every image information detecting process; (d) ciphering a maximum value and a minimum value among average values for said each of the first to the fourth pixel rows obtained from the step (c); (e) determining a first subtract value by subtracting the minimum
  • the present invention it is possible to automatically eliminate flicker in every case that a flicker noise occurs.
  • the present invention can control on/off of an exposure time for each line.
  • there are added dedicated lines for the flicker detection to an existing pixel array wherein the dedicated lines are independently operated with regard to functions of the pixel array and an exposure time of each dedicated line is artificially on/off to compensate a conventional noise detecting scheme. As a result, it is possible to detect flicker noises for most of cases.
  • FIG. 1 is a block diagram of a conventional image sensor
  • FIGS. 2A to 2E are graphs illustrating various cases in which flicker effects happen
  • FIG. 3 provides a block diagram of an image sensor in accordance with the present invention.
  • FIGS. 4A and 4B represent graphs describing two cases of detecting flicker as changing an exposure time when a frame length is integer times of a frequency of a light source.
  • FIG. 5 describes a flow chart of an algorithm for detecting flicker in accordance with an embodiment of the present invention.
  • the light source is a luminous body used in everyday life.
  • the sun and a fluorescent lamp are also light sources.
  • the sunlight since its frequency is very high and the exposure time is always more than thousands of times of a sunlight period, there does not occur the flicker effect under the sunlight.
  • the fluorescent lamp since its frequency is 50 Hz or 60 Hz, there occurs the flicker effect in an image sensor having the exposure time of dozens of ms.
  • CMOS image sensor Since a CMOS image sensor reads each line so as to capture image data from pixels, it uses various methods for eliminating flicker. Since an identical exposure time is applied to each line, if the exposure time is different from a frequency of a light source, the amount of energy made at each line by the light source becomes different from the exposure time. As a result, the different amount of energy is inputted and there occurs flicker.
  • a basic flicker phenomenon as well as a specific flicker phenomenon can be detected automatically.
  • the flicker phenomenon represent a phenomenon by which there is generated a noise bar on an image.
  • the noise bar on the image flows upward or downward, it can be definitely distinguished with a figure on the image.
  • a frame length becomes integer times of the frequency of the light source, the noise bar on the image does not flow upward or downward and looks like a check, making the flicker detection difficult.
  • this phenomenon is also detected.
  • FIG. 3 provides a block diagram of an image sensor in accordance with the present invention.
  • an inventive image sensor includes a pixel array 30 that contains N ⁇ M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and detects information about images provided from the outside, a flicker noise detective pixel block 31 that contains X pixel rows, which has a form extended from the N pixel rows of the pixel array 30 , and M pixel columns, X being an even number larger than N, and whose each pair of pixel rows has an identical exposure time, a flicker noise detecting block 32 for controlling an exposure point of the flicker noise detective pixel block 31 and detecting a flicker noise based on outputs of the flicker noise detective pixel block 31 , a controlling & external system interfacing block 33 , an analog-line buffering block 34 , a column decoder 36 , an analog bus 35 , an analog signal processor (ASP) 37 , and a digital signal processor (DSP) 38 .
  • N and M being integers, respectively, and detects information about images provided from the outside
  • the ASP 37 contains a variable amplifier and an analog-to-digital converter (ADC) and the DSP 38 performs functions of error correction, color interpolation, gamma correction, color space conversion and so on.
  • ADC analog-to-digital converter
  • the pixel array 30 contains N ⁇ M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and is a core part of the image sensor for detecting information about images provided from the outside.
  • the flicker noise detective pixel block 31 detects information for an image during one frame to allow each pair of rows to have different exposure points from each other and, in a next frame, detects information for the image after changing the exposure points of each pair of rows. That is, for a plurality of frames, it detects the image information as changing the exposure points of each pair of rows.
  • the controlling & external system interfacing block 33 controls a whole operation of the image sensor by using a finite state machine (FSM) and performs an interfacing operation for an external system. Since the block 33 includes an arrangement registers (not shown), it is possible to program information related to various internal operations and the whole operation of the image sensor is controlled by the programmed information.
  • FSM finite state machine
  • the analog-line buffering block 34 detects voltages of pixels on a selected row and stores the detected voltages therein. Among the analog data stored in the analog-line buffering block 34 , a data on a column chosen by the column decoder 36 is transferred to the variable amplifier in the ASP 37 through the analog bus 35 .
  • the variable amplifier e.g., a programmable gain amplifier (PGA) amplifies pixel voltages stored in the analog-line buffering block 34 when the pixel voltages are low.
  • the analog data amplified at the variable amplifier are color-corrected and then converted to digital values at the ADC.
  • the digital values are converted again according to video standards such as 4:2:2 or 4:4:4 at the DSP 38 after being processed by the above procedure.
  • the image sensor adopts a correlated double sampling (CDS) scheme to read a reset voltage signal and a data voltage signal from each pixel of the pixel array 30 and output a difference between the reset voltage signal and the data voltage signal.
  • CDS correlated double sampling
  • the inventive image sensor includes the flicker noise detective pixel block 31 for only detecting flicker, e.g., 4 pixel lines, in addition to the pixel array 30 on which an image is practically displayed.
  • the flicker noise detecting block 32 receives outputs from the flicker noise detective pixel block 31 and certifies whether or not the flicker is generated. Based on the results, different exposure times are provided to rows.
  • FIGS. 4A and 4B represent graphs describing two cases of detecting flicker as changing an exposure time when a frame length is integer times of a frequency of a light source.
  • FIG. 4A there is shown why it is impossible to detect the flicker when the frame length is integer times of the frequency of the light source.
  • the amount of energy of the first frame is different from that of the second frame since the light source has a different frequency from the exposure time.
  • the occurrence of flicker is detected by comparing the amount of energies of two frames.
  • the frequency of the light source becomes integer times of the frame length
  • data of lines at the same place of the first and the second frames are applied by different exposure times of the light source, it is difficult to detect the occurrence of flicker since the amount of energies inputted to the sensor during the sensor being exposed to the lines become identical.
  • FIG. 4B there is shown an example of adopting different exposure timing. If the exposure timing is differently set up for each line, it is possible to detect the flicker although the frame length becomes integer times of the frequency of the light source.
  • information about images of corresponding rows A 1 and A 2 is detected by differing their exposure points. For instance, if the exposure point of A 1 is a 1 ⁇ 4 point of a wavelength of the light source A, the exposure point of A 2 is decided as a 3 ⁇ 4 point of the wavelength of the light source A. Then, this process is repeated as changing the exposure point of each pixel.
  • information about images of corresponding rows B 1 and B 2 is detected by differing their exposure points. For example, if the exposure point of B 1 is a 1 ⁇ 4 point of a wavelength of the light source B, the exposure point of B 2 is determined as a 3 ⁇ 4 point of the wavelength of the light source A. This process is repeated as changing the exposure point of each pixel.
  • a minimum value and a maximum value are determined by comparing a plurality of average values of each pixel row.
  • a first subtract value is calculated by subtracting the minimum value from the maximum value of the pixel row A 1 having the exposure time ‘t 1 ’.
  • a second subtract value is ciphered by subtracting the minimum value from the maximum value of the pixel row A 2 having the exposure time ‘t 1 ’.
  • a smaller one of the first subtract value and the second subtract value is determined as a first minimum subtract value.
  • a third subtract value is calculated by subtracting the minimum value from the maximum value of the pixel row B 1 having the exposure time ‘t 2 ’.
  • a fourth subtract value is ciphered by subtracting the minimum value from the maximum value of the pixel row B 2 having the exposure time ‘t 2 ’.
  • a smaller one of the third subtract value and the fourth subtract value is decided as a second minimum subtract value.
  • an exposure time corresponding to the flicker noise is determined according to sizes of the first minimum subtract value and the second minimum subtract value.
  • an exposure time having a larger one of the first minimum subtract value and the second minimum subtract value corresponds to the flicker noise and a light source corresponding to an exposure time having a smaller one is a real light source.
  • the first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to the minute variation of an external environment. For each pixel row, information about an image is detected at a certain exposure time and an average value of each pixel row is calculated.
  • the above one time for each pixel row corresponds to one frame of the pixel array in the image sensor.
  • FIG. 5 describes a flow chart of an algorithm for detecting flicker in accordance with an embodiment of the present invention.
  • FIG. 5 there is shown a procedure of finding a real light source by using two pairs of pixel rows, i.e., 4 pixel rows, wherein the two pairs of pixel rows correspond to two light sources A and B, respectively.
  • a procedure of detecting a flicker noise is explained with reference to the drawing.
  • Each of the 4 pixel rows for detecting the flicker noise outputs one data for one frame reading out whole data of the pixel array. Therefore, there are outputted total 16 data from the 4 pixel rows by repeating the data reading process during 4 frames.
  • step ‘S 501 ’ a current frame is set to ‘0’ and a pixel data of a first frame is outputted.
  • step ‘S 502 ’ it is determined whether or not a current output data is of a fourth frame and, if the current frame is not the fourth frame, the next frame starts to be exposed. If the current frame is the fourth frame, this procedure goes back to step ‘S 501 ’ and the current frame is set to ‘0’ again.
  • image information of the corresponding pixel row is captured.
  • step ‘S 504 ’ there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S 503 ’.
  • step ‘S 506 ’ there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S 505 ’.
  • step ‘S 508 ’ there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S 507 ’.
  • image information of the corresponding pixel row is captured.
  • step ‘S 510 ’ there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S 509 ’.
  • step ‘S 511 ’ it is determined if the current frame is the fourth frame. If so, the procedure goes back to step ‘S 501 ’ and the current frame is set to ‘0’.
  • step ‘S 512 ’ a minimum value and a maximum value are ciphered by using the 4 average values obtained for each of the pixel rows A 1 , A 2 , B 1 and B 2 .
  • a first subtract value for the pixel row A 1 is calculated as ‘MaxA 1 ⁇ MinA 1 ’.
  • a second subtract value for the pixel row A 2 is ciphered as ‘MaxA 2 ⁇ MinA 2 ’.
  • the first minimum subtract value ‘FlkA’ is outputted as a smaller one of the first and the second subtract values.
  • a third subtract value for the pixel row B 1 is calculated as ‘MaxB 1 ⁇ MinB 1 ’.
  • step ‘S 514 ’ an exposure time corresponding to the flicker noise is determined by comparing the sizes of the first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’.
  • the flicker noise is a light source corresponding to an exposure time having a longer one of the first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’ and the real light source is a light source corresponding to an exposure time having a smaller one.
  • the first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’ should be larger than a signal conversion minimum value ‘Th’ for preventing an error operation due to the minute variation of an external environment.
  • one pair of lines is applied with an exposure time having a different frequency from the other pair of lines.
  • Pixel rows having an identical exposure time are exposed at different points from each other. In a next frame, they are exposed at different points from in the previous frame. In this case, the exposure time is not changed.
  • a maximum value and a minimum value are obtained by comparing first lines of the four frames. Likewise, respective maximum values and minimum values are secured from the second lines, the third lines and the fourth lines of the four frames. For the four lines, a smaller value between two lines applied by the light source A becomes ‘FlkA’ and a smaller value between two lines applied by the light source B becomes ‘FlkB’. A smaller value between ‘FlkA’ and ‘FlkB’ represents a current light source.
  • the exposure time is automatically changed applicable to the current light source, thereby eliminating the flicker phenomenon.
  • the flicker noise can be detected in case a frame length is integer times of a frequency of a light source by classifying pixel lines automatically eliminating the flicker noise occurring by the difference of the light source into pairs of pixel lines having different light sources and applying different exposure timing to each pair of pixel lines.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Civil Engineering (AREA)
  • Structural Engineering (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
  • Image Input (AREA)
  • Facsimile Heads (AREA)

Abstract

An image sensor has improved functions so as to automatically eliminate a flicker noise. For the purpose, the image sensor includes a pixel array for capturing information about an image provided from the outside and having N pixel rows and M pixel columns for maximizing a feature of reacting to light, wherein M and N are integers, respectively, a flicker noise detective pixel unit containing X pixel rows, which has a form extended from the N pixel rows of the pixel array, and M pixel columns, wherein each pair of X pixel rows has an identical exposure time and X is an even number, and a flicker noise for controlling an exposure point for the flicker noise detective pixel unit and detecting the flicker noise by using outputs of the flicker noise detective pixel unit.

Description

FIELD OF THE INVENTION
The present invention relates to an image sensor and a method for detecting a flicker noise of the image sensor, which has improved functions so as to automatically eliminate the flicker noise.
BACKGROUND OF THE INVENTION
In general, an image sensor is a device of displaying images by using a feature that a semiconductor reacts to light. That is, the image sensor reads out electrical values by detecting lightness and wavelengths of different lights derived from different objects. The image sensor makes the electric values to levels able to be signal-processed.
The image sensor is a semiconductor device of changing an optical image to electrical values. A charge-coupled device (CCD) is a device in which MOS capacitors are located very close to one another and charge, carriers are stored at the capacitors. On the other hand, a Complementary Metal Oxide Semiconductor (CMOS) image sensor uses CMOS technology which utilizes a control circuit and a signal processing circuit as peripheral circuits, employs MOS transistors as many as the number of pixels and adopts a switching scheme of detecting outputs sequentially by using the MOS transistors. The CMOS image sensor is used in personal portable systems such as a mobile phone since it consumes low power. Therefore, the image sensors are used in various areas of PC camera, medical instrument, toy and so on.
FIG. 1 is a block diagram showing a conventional image sensor.
Referring to FIG. 1, the image sensor includes a controlling & external system interfacing block 10, a pixel array 11, an analog-line buffering block 12, a column decoder 13, an analog bus 14, an analog signal processor (ASP) 15 and a digital signal processor (DSP) 16.
The ASP 15 contains a variable amplifier and an analog-to-digital converter (ADC) and the DSP 16 performs functions of error correction, color interpolation, gamma correction, color space conversion and so on.
Hereinafter, an operation of each component constructing the above image sensor will be explained in detail.
The pixel array 11 contains N×M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and is a core part of the image sensor for detecting information about images provided from the outside.
The controlling & external system interfacing block 10 controls a whole operation of the image sensor by using a finite state machine (FSM) and performs an interfacing operation for an external system. Since the block 10 includes an arrangement register (not shown), it is possible to program information related to various internal operations and the whole operation of the image sensor is controlled by the programmed information.
The analog-line buffering block 12 detects voltages of pixels on a selected one row and stores the detected voltages therein. Among the analog data stored in the analog-line buffering block 12, a data on a column chosen by the column decoder 13 is transferred to the variable amplifier in the ASP 15 through the analog bus 14.
The variable amplifier, e.g., a programmable gain amplifier (PGA), amplifies pixel voltages stored in the analog-line buffering block 12 when the pixel voltages are low. The analog data amplified at the variable amplifier are color-corrected and then converted to digital values at the ADC. The digital values are converted again according to video standards such as 4:2:2 or 4:4:4 at the DSP 16 after being processed by the above procedure.
Meanwhile, in the image sensor, a fixed pattern noise can occur by an offset voltage due to a minute difference in a manufacturing process. In order to compensate this fixed pattern noise, the image sensor adopts a correlated double sampling (CDS) scheme to read a reset voltage signal and a data voltage signal from each pixel of the pixel array 11 and output a difference between the reset voltage signal and the data voltage signal.
Application of the image sensor is still-camera, personal computer (PC) camera, medical, toy, and portable terminal and so on. If light sources are different, there occurs a flicker noise. Since, however, the greater part of application requires an image sensor usable without regard to a kind of light source, the image sensor needs a function of automatically eliminating the flicker noise.
The CMOS image sensor captures images by adjusting its exposure time to light. Therefore, if the exposure time is integer times of a frequency of a light source, there is no problem. However, if the exposure time is different from the frequency of the light source, in case of the CMOS image sensor capturing image data on a line-by-line basis, since the amount of light that each line receives is different, there occurs a flicker noise making a noise bar on a final image.
FIGS. 2A to 2E show graphs illustrating various cases in which flicker effects happen.
Referring to FIG. 2A, there is described the variation of light energy according to the change of time in case that the amount of inputted light, i.e., energy, has an identical frequency to that of the exposure time of the image sensor. In this case, since the amount of energy that each line receives is identical, a normal image is outputted.
FIG. 2B shows the energy having a different frequency from the exposure time, i.e., a case that the exposure time is shorter than a frequency of the light source. In other words, it shows a case that the frequency of the energy is longer than the exposure time, i.e., the energy changes in a shorter time period.
FIG. 2C shows a case that the frequency of the energy is shorter than the exposure time, i.e., the energy changes in a longer time period. In any case, there occurs flicker in the image. Specially, when there occurs a flicker noise, a noise bar generated on the image flows upward or downward, or the noise bar is fixed in the image. At this time, the fixed flicker noise is difficult to be distinguished with a real image.
FIGS. 2D and 2E represent cases that there occur flicker noises fixed in the image. In these cases, sizes of flicker noises occurring in a first frame and a second frame are identical regardless of the relation between the exposure time and the frequency of the light source. In case that the fixed flicker noises are generated, if detecting the flicker noises by using a flicker noise of a different size for each frame as in an existing algorithm, it is impossible to detect the flicker noises.
Therefore, as afore-mentioned, there needs to eliminate flicker for every case that the flicker occurs.
SUMMARY OF THE INVENTION
It is, therefore, an object of the present invention to provide an image sensor and a flicker noise detecting method capable of automatically eliminating flicker noises for every case that there occur the flicker noises.
In accordance with one aspect of the present invention, there is provided an image sensor including a pixel array for capturing information about an image provided from the outside and having N pixel rows and M pixel columns for maximizing a feature of reacting to light, wherein M and N are integers, respectively, a flicker noise detective pixel unit containing X pixel rows, which has a form extended from the N pixel rows of the pixel array, and M pixel columns, wherein each pair of X pixel rows has an identical exposure time and X is an even number, and a flicker noise for controlling an exposure point for the flicker noise detective pixel unit and detecting the flicker noise by using outputs of the flicker noise detective pixel unit.
In accordance with another aspect of the present invention, there is provided a method for detecting a flicker noise of an image sensor, comprising the steps of: (a) securing information about images of a first pair of pixel rows by differing exposure points of the first pair of pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first pair of pixel rows; (b) capturing information about images of a second pair of pixel rows by differing exposure points of the second pair of pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the second pair of pixel rows; (c) calculating an average value of the image information for each pixel row of the first and the second pairs of pixel rows in every image information detecting process; (d) ciphering a maximum value and a minimum value among average values for said each pixel row obtained from the step (c); (e) determining a first subtract value by subtracting the minimum value from the maximum value of one pixel row having the first exposure time, deciding a second subtract value by subtracting the minimum value from the maximum value of the other pixel row having the first exposure time, and outputting a smaller one of the first subtract value and the second subtract value as a first minimum subtract value; (f) determining a third subtract value by subtracting the minimum value from the maximum value of one pixel row having the second exposure time, deciding a fourth subtract value by subtracting the minimum value from the maximum value of the other pixel row having the second exposure time, and outputting a smaller one of the third subtract value and the fourth subtract value as a second minimum subtract value; and (g) deciding an exposure time corresponding to the flicker noise by comparing the first minimum subtract value and the second minimum subtract value.
In accordance with further another aspect of the present invention, there is provided a method for detecting a flicker noise of an image sensor, comprising the steps of: (a) securing information about an image of each of a first and a second pixel row by differing exposure points of the first and the second pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first and the second pixel rows; (b) capturing information about an image of each of a third and a fourth pixel row by differing exposure points of the third and the fourth pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the third and the fourth pixel rows; (c) calculating an average value of the image information for each of the first to the fourth pixel rows in every image information detecting process; (d) ciphering a maximum value and a minimum value among average values for said each of the first to the fourth pixel rows obtained from the step (c); (e) determining a first subtract value by subtracting the minimum value from the maximum value of the first pixel row, deciding a second subtract value by subtracting the minimum value from the maximum value of the second pixel row, and outputting a smaller one of the first subtract value and the second subtract value as a first minimum subtract value; (f) determining a third subtract value by subtracting the minimum value from the maximum value of the third pixel row, deciding a fourth subtract value by subtracting the minimum value from the maximum value of the fourth pixel row, and outputting a smaller one of the third subtract value and the fourth subtract value as a second minimum subtract value; and (g) deciding an exposure time corresponding to the flicker noise by comparing the first minimum subtract value and the second minimum subtract value.
In accordance with the present invention, it is possible to automatically eliminate flicker in every case that a flicker noise occurs. For this, the present invention can control on/off of an exposure time for each line. In accordance with the present invention, there are added dedicated lines for the flicker detection to an existing pixel array, wherein the dedicated lines are independently operated with regard to functions of the pixel array and an exposure time of each dedicated line is artificially on/off to compensate a conventional noise detecting scheme. As a result, it is possible to detect flicker noises for most of cases.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other objects and features of the present invention will become apparent from the following description of preferred embodiments given in conjunction with the accompanying drawings, in which:
FIG. 1 is a block diagram of a conventional image sensor;
FIGS. 2A to 2E are graphs illustrating various cases in which flicker effects happen;
FIG. 3 provides a block diagram of an image sensor in accordance with the present invention;
FIGS. 4A and 4B represent graphs describing two cases of detecting flicker as changing an exposure time when a frame length is integer times of a frequency of a light source; and
FIG. 5 describes a flow chart of an algorithm for detecting flicker in accordance with an embodiment of the present invention.
 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
In the following detailed description, the preferred embodiments of the present invention are set forth in order to provide a thorough understanding of the invention with reference to the drawings. However, it will be understood by those skilled in the art that the present invention may be practiced without these preferred embodiments.
A flicker effect happens when a frequency of a light source is different from an exposure time of an image sensor. The light source is a luminous body used in everyday life. The sun and a fluorescent lamp are also light sources. In case of using the sunlight as the light source, since its frequency is very high and the exposure time is always more than thousands of times of a sunlight period, there does not occur the flicker effect under the sunlight. On the other hand, in case of using the fluorescent lamp as the light source, since its frequency is 50 Hz or 60 Hz, there occurs the flicker effect in an image sensor having the exposure time of dozens of ms.
Since a CMOS image sensor reads each line so as to capture image data from pixels, it uses various methods for eliminating flicker. Since an identical exposure time is applied to each line, if the exposure time is different from a frequency of a light source, the amount of energy made at each line by the light source becomes different from the exposure time. As a result, the different amount of energy is inputted and there occurs flicker.
In accordance with the present invention, a basic flicker phenomenon as well as a specific flicker phenomenon can be detected automatically. The flicker phenomenon represent a phenomenon by which there is generated a noise bar on an image. In a general case, since the noise bar on the image flows upward or downward, it can be definitely distinguished with a figure on the image. However, if a frame length becomes integer times of the frequency of the light source, the noise bar on the image does not flow upward or downward and looks like a check, making the flicker detection difficult. In accordance with the present invention, this phenomenon is also detected.
FIG. 3 provides a block diagram of an image sensor in accordance with the present invention.
Referring to FIG. 3, an inventive image sensor includes a pixel array 30 that contains N×M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and detects information about images provided from the outside, a flicker noise detective pixel block 31 that contains X pixel rows, which has a form extended from the N pixel rows of the pixel array 30, and M pixel columns, X being an even number larger than N, and whose each pair of pixel rows has an identical exposure time, a flicker noise detecting block 32 for controlling an exposure point of the flicker noise detective pixel block 31 and detecting a flicker noise based on outputs of the flicker noise detective pixel block 31, a controlling & external system interfacing block 33, an analog-line buffering block 34, a column decoder 36, an analog bus 35, an analog signal processor (ASP) 37, and a digital signal processor (DSP) 38.
The ASP 37 contains a variable amplifier and an analog-to-digital converter (ADC) and the DSP 38 performs functions of error correction, color interpolation, gamma correction, color space conversion and so on.
Hereinafter, an operation of each component constructing the inventive image sensor will be explained in detail.
The pixel array 30 contains N×M pixels for maximizing a feature of reacting to light, N and M being integers, respectively, and is a core part of the image sensor for detecting information about images provided from the outside.
The flicker noise detective pixel block 31 detects information for an image during one frame to allow each pair of rows to have different exposure points from each other and, in a next frame, detects information for the image after changing the exposure points of each pair of rows. That is, for a plurality of frames, it detects the image information as changing the exposure points of each pair of rows.
The controlling & external system interfacing block 33 controls a whole operation of the image sensor by using a finite state machine (FSM) and performs an interfacing operation for an external system. Since the block 33 includes an arrangement registers (not shown), it is possible to program information related to various internal operations and the whole operation of the image sensor is controlled by the programmed information.
The analog-line buffering block 34 detects voltages of pixels on a selected row and stores the detected voltages therein. Among the analog data stored in the analog-line buffering block 34, a data on a column chosen by the column decoder 36 is transferred to the variable amplifier in the ASP 37 through the analog bus 35.
The variable amplifier, e.g., a programmable gain amplifier (PGA), amplifies pixel voltages stored in the analog-line buffering block 34 when the pixel voltages are low. The analog data amplified at the variable amplifier are color-corrected and then converted to digital values at the ADC. The digital values are converted again according to video standards such as 4:2:2 or 4:4:4 at the DSP 38 after being processed by the above procedure.
Meanwhile, in the image sensor, a fixed pattern noise can occur by an offset voltage due to a minute difference in a manufacturing process. In order to compensate this fixed pattern noise, the image sensor adopts a correlated double sampling (CDS) scheme to read a reset voltage signal and a data voltage signal from each pixel of the pixel array 30 and output a difference between the reset voltage signal and the data voltage signal.
As can be seen from the construction in FIG. 3, the inventive image sensor includes the flicker noise detective pixel block 31 for only detecting flicker, e.g., 4 pixel lines, in addition to the pixel array 30 on which an image is practically displayed.
The flicker noise detecting block 32 receives outputs from the flicker noise detective pixel block 31 and certifies whether or not the flicker is generated. Based on the results, different exposure times are provided to rows.
FIGS. 4A and 4B represent graphs describing two cases of detecting flicker as changing an exposure time when a frame length is integer times of a frequency of a light source.
Referring FIG. 4A, there is shown why it is impossible to detect the flicker when the frame length is integer times of the frequency of the light source. When comparing two frames in which flicker occurs, in case that the frame length is not integer times of the frequency of the light source, the amount of energy of the first frame is different from that of the second frame since the light source has a different frequency from the exposure time.
Therefore, the occurrence of flicker is detected by comparing the amount of energies of two frames. However, in case that the frequency of the light source becomes integer times of the frame length, although data of lines at the same place of the first and the second frames are applied by different exposure times of the light source, it is difficult to detect the occurrence of flicker since the amount of energies inputted to the sensor during the sensor being exposed to the lines become identical.
Therefore, in order to detect the flicker, it is required to adopt different exposure timing.
In FIG. 4B, there is shown an example of adopting different exposure timing. If the exposure timing is differently set up for each line, it is possible to detect the flicker although the frame length becomes integer times of the frequency of the light source.
Hereinafter, there is described an inventive flicker noise detecting algorithm. In accordance with the present invention, by adjusting the exposure timing; it is possible to detect the flicker noise in case that the frame length becomes integer times of the frequency of the light source.
It is assumed that there are a pair of pixel rows, A1 and A2, having an exposure time ‘t1’ corresponding to a light source A and a pair of pixel rows, B1 and B2, having an exposure time ‘t2’ corresponding to a light source B.
At first, information about images of corresponding rows A1 and A2 is detected by differing their exposure points. For instance, if the exposure point of A1 is a ¼ point of a wavelength of the light source A, the exposure point of A2 is decided as a ¾ point of the wavelength of the light source A. Then, this process is repeated as changing the exposure point of each pixel.
At this time, information about images of corresponding rows B1 and B2 is detected by differing their exposure points. For example, if the exposure point of B1 is a ¼ point of a wavelength of the light source B, the exposure point of B2 is determined as a ¾ point of the wavelength of the light source A. This process is repeated as changing the exposure point of each pixel.
Then, there is ciphered an average value of the information about the image of each pixel row for each time. After repeating plural times the average value ciphering process, a minimum value and a maximum value are determined by comparing a plurality of average values of each pixel row. A first subtract value is calculated by subtracting the minimum value from the maximum value of the pixel row A1 having the exposure time ‘t1’. Likewise, a second subtract value is ciphered by subtracting the minimum value from the maximum value of the pixel row A2 having the exposure time ‘t1’. A smaller one of the first subtract value and the second subtract value is determined as a first minimum subtract value.
A third subtract value is calculated by subtracting the minimum value from the maximum value of the pixel row B1 having the exposure time ‘t2’. Likewise, a fourth subtract value is ciphered by subtracting the minimum value from the maximum value of the pixel row B2 having the exposure time ‘t2’. A smaller one of the third subtract value and the fourth subtract value is decided as a second minimum subtract value.
After then, an exposure time corresponding to the flicker noise is determined according to sizes of the first minimum subtract value and the second minimum subtract value.
When deciding the exposure time corresponding to the flicker noise, an exposure time having a larger one of the first minimum subtract value and the second minimum subtract value corresponds to the flicker noise and a light source corresponding to an exposure time having a smaller one is a real light source.
The first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to the minute variation of an external environment. For each pixel row, information about an image is detected at a certain exposure time and an average value of each pixel row is calculated.
In the meantime, the above one time for each pixel row corresponds to one frame of the pixel array in the image sensor.
FIG. 5 describes a flow chart of an algorithm for detecting flicker in accordance with an embodiment of the present invention.
In FIG. 5, there is shown a procedure of finding a real light source by using two pairs of pixel rows, i.e., 4 pixel rows, wherein the two pairs of pixel rows correspond to two light sources A and B, respectively. Hereinafter, a procedure of detecting a flicker noise is explained with reference to the drawing.
At first, it is assumed that there are a pair of pixel rows using the light source A, i.e., having an exposure time corresponding to the light source A and a pair of pixel rows using the light source B, i.e., having an exposure time corresponding to the light source B, i.e., total 4 pixel rows extended from rows in a pixel array so as to detect the flicker noise.
Each of the 4 pixel rows for detecting the flicker noise outputs one data for one frame reading out whole data of the pixel array. Therefore, there are outputted total 16 data from the 4 pixel rows by repeating the data reading process during 4 frames.
In step ‘S501’, a current frame is set to ‘0’ and a pixel data of a first frame is outputted.
In step ‘S502’, it is determined whether or not a current output data is of a fourth frame and, if the current frame is not the fourth frame, the next frame starts to be exposed. If the current frame is the fourth frame, this procedure goes back to step ‘S501’ and the current frame is set to ‘0’ again.
If it is determined that the current frame is not the fourth frame in step ‘S502’, the next frame starts to be exposed. Therefore, in step ‘S503’, the pixel row A1 using the light source A is exposed at a ¼point of a wavelength of the light source A, i.e., ‘*Astart1<=*A/4’. The pixel row A2 using the light source A is exposed at a 4/4point of the wavelength of the light source A, i.e., ‘*Astart2<=*A’. The pixel row B1 using the light source B is exposed at a ¼point of a wavelength of the light source B, i.e., ‘*Bstart1<=*B/4’. The pixel row B2 using the light source B is exposed at a 4/4point of the wavelength of the light source B, i.e., ‘*Bstart2<=*B’. At each exposure point, image information of the corresponding pixel row is captured.
In step ‘S504’, there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S503’.
That is, an average value of the first frame for the pixel row A1 is calculated as ‘$AF11<=AFrameavg1’; that for the pixel row A2, as ‘$AF12<=AFrameavg2’; that for the pixel row B1, as ‘$BF11<=BFrameavg1’; and that for the pixel row B2, as ‘$BF12<=BFrameavg2’.
In step ‘S505’, the pixel row A1 using the light source A is exposed at a ¾point of the wavelength of the light source A, i.e., ‘*Astart1<=*A/3’. The pixel row A2 using the light source A is exposed at a 2/4 point of the wavelength of the light source A, i.e., ‘*Astart2<=*A/2’. The pixel row B1 using the light source B is exposed at a ¾point of the wavelength of the light source B, i.e., ‘*Bstart1<=*B/3’. The pixel row B2 using the light source B is exposed at a 2/4 point of the wavelength of the light source B, i.e., ‘*Bstart2<=*B/2’. At each exposure point, image information of the corresponding pixel row is secured.
In step ‘S506’, there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S505’.
Namely, an average value of the second frame for the pixel row A1 is calculated as ‘$AF21<=AFrameavg1’; that for the pixel row A2, as ‘$AF22<=AFrameavg2’; that for the pixel row B1, as ‘$BF21<=BFrameavg1’; and that for the pixel row B2, as ‘$BF22<=BFrameavg2’.
In step ‘S507’, the pixel row A1 using the light source A is exposed at a 2/4 point of the wavelength of the light source A, i.e., ‘*Astart1<=*A/2’. The pixel row A2 using the light source A is exposed at a ¾ point of the wavelength of the light source A, i.e., ‘*Astart2<=*A/3’. The pixel row B1 using the light source B is exposed at a 2/4 point of the wavelength of the light source B, i.e., ‘*Bstart1<=*B/2’. The pixel row B2 using the light source B is exposed at a ¾point of the wavelength of the light source B, i.e., ‘*Bstart2<=*B/3’. At each exposure point, image information of the corresponding pixel row is obtained.
In step ‘S508’, there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S507’.
That is to say, an average value of the third frame for the pixel row A1 is calculated as ‘$AF31<=AFrameavg1’; that for the pixel row A2, as ‘$AF32<=AFrameavg2’; that for the pixel row B1, as ‘$BF31<=BFrameavg1’; and that for the pixel row B2, as ‘$BF32<=BFrameavg2’.
In step ‘S509’, the pixel row A1 using the light source A is exposed at a 4/4 point of the wavelength of the light source A, i.e., ‘*Astart1<=*A’. The pixel row A2 using the light source A is exposed at a ¼ point of the wavelength of the light source A, i.e., ‘*Astart2<=*A/4’. The pixel row B1 using the light source B is exposed at a ¼ point of the wavelength of the light source B, i.e., ‘*Bstart1<=*B’. The pixel row B2 using the light source B is exposed at a 4/4point of the wavelength of the light source B. i.e., ‘*Bstart2<=*B/4’. At each exposure point, image information of the corresponding pixel row is captured.
In step ‘S510’, there is calculated an average value of the image information for each of the four pixel rows obtained during processing a frame corresponding to step ‘S509’.
That is, an average value of the second frame for the pixel row A1 is calculated as ‘$AF41<=AFrameavg1’; that for the pixel row A2, as ‘$AF42<=AFrameavg2’; that for the pixel row B1, as ‘$BF41<=BFrameavg1’; and that for the pixel row B2, as ‘$BF42<=BFrameavg2’.
In step ‘S511’, it is determined if the current frame is the fourth frame. If so, the procedure goes back to step ‘S501’ and the current frame is set to ‘0’.
In step ‘S512’, a minimum value and a maximum value are ciphered by using the 4 average values obtained for each of the pixel rows A1, A2, B1 and B2.
At this moment, the maximum value of the average values for the pixel row A1 is ‘MaxA1<=Max($AF11, $AF21, $AF31, $AF41)’ and its minimum value is ‘MinA1<=Min($AF11, $AF21, $AF31, $AF41)’.
The maximum value of the average values for the pixel row A2 is ‘MaxA2<=Max($AF12, $AF22, $AF32, $AF42)’ and its minimum value is ‘MinA2<=Min($AF12, $AF22, $AF32, $AF42)’.
The maximum value of the average values for the pixel row B1 is ‘MaxB1<=Max($BF11, $BF21, $BF31, $BF41)’ and its minimum value is ‘MinB1<=Min($BF11, $BF21, $BF31, $BF41)’.
The maximum value of the average values for the pixel row B2 is ‘MaxB2<=Max($BF12, $BF22, $BF32, $BF42)’ and its minimum value is ‘MinB2<=Min($BF12, $BF22, $BF32, $BF42)’.
In step ‘S513’, a first subtract value for the pixel row A1 is calculated as ‘MaxA1−MinA1’. A second subtract value for the pixel row A2 is ciphered as ‘MaxA2−MinA2’. Then, after comparing the first and the second subtract values like ‘FlkA<=Min(MaxA1−MinA1), (MaxA2−MinA2), the first minimum subtract value ‘FlkA’ is outputted as a smaller one of the first and the second subtract values.
Likewise, a third subtract value for the pixel row B1 is calculated as ‘MaxB1−MinB1’. A fourth subtract value for the pixel row B2 is ciphered as ‘MaxB2−MinB2’. Then, after comparing the third and the fourth subtract values like ‘FlkB<=Min(MaxB1−MinB1), (MaxB2−MinB2), the second minimum subtract value ‘FlkB’ is outputted as a smaller one of the third and the fourth subtract values.
In step ‘S514’, an exposure time corresponding to the flicker noise is determined by comparing the sizes of the first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’.
In this case, the flicker noise is a light source corresponding to an exposure time having a longer one of the first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’ and the real light source is a light source corresponding to an exposure time having a smaller one.
The first minimum subtract value ‘FlkA’ and the second minimum subtract value ‘FlkB’ should be larger than a signal conversion minimum value ‘Th’ for preventing an error operation due to the minute variation of an external environment.
In other words, in the operation of FIG. 5, among the four lines for detecting the flicker noise, one pair of lines is applied with an exposure time having a different frequency from the other pair of lines. Pixel rows having an identical exposure time are exposed at different points from each other. In a next frame, they are exposed at different points from in the previous frame. In this case, the exposure time is not changed.
In case of changing the exposure time and the exposure point, if the frequency of the light source and the exposure time are different, an output value of each line outputted from each frame is different from those of other lines and, thus, it is possible to detect the flicker exactly.
For more accurate flicker detection, two lines among the four lines have a different exposure time from the rest two lines. As a result, four resulting values are obtained from each of the four lines and total 16 resulting values are secured from the four lines.
At first, a maximum value and a minimum value are obtained by comparing first lines of the four frames. Likewise, respective maximum values and minimum values are secured from the second lines, the third lines and the fourth lines of the four frames. For the four lines, a smaller value between two lines applied by the light source A becomes ‘FlkA’ and a smaller value between two lines applied by the light source B becomes ‘FlkB’. A smaller value between ‘FlkA’ and ‘FlkB’ represents a current light source.
If the flicker is detected, the exposure time is automatically changed applicable to the current light source, thereby eliminating the flicker phenomenon.
As described above, in accordance with a preferred embodiment of the present invention, it is noticed that the flicker noise can be detected in case a frame length is integer times of a frequency of a light source by classifying pixel lines automatically eliminating the flicker noise occurring by the difference of the light source into pairs of pixel lines having different light sources and applying different exposure timing to each pair of pixel lines.
Therefore, in accordance with the present invention, it is possible to eliminate the flicker noise and improve the quality of image by automatically distinguishing a frequency of a light source without regard to a kind of flicker occurring in the image and applying an appropriate exposure time.
The present application contains subject matter related to Korean patent application No. 2004-29016, filed in the Korean Patent Office on Apr. 27, 2004, the entire contents of which being incorporated herein by reference.
While the present invention has been described with respect to the particular embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.

Claims (39)

1. A method for detecting a flicker noise of an image sensor, comprising the steps of:
(a) securing information about images of a first pair of pixel rows by differing exposure points of the first pair of pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first pair of pixel rows;
(b) capturing information about images of a second pair of pixel rows by differing exposure points of the second pair of pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the second pair of pixel rows;
(c) calculating an average value of the image information for each pixel row of the first and the second pairs of pixel rows in every image information detecting process;
(d) ciphering a maximum value and a minimum value among average values for said each pixel row obtained from the step (c);
(e) determining a first subtract value by subtracting the minimum value from the maximum value of one pixel row having the first exposure time, deciding a second subtract value by subtracting the minimum value from the maximum value of the other pixel row having the first exposure time, and outputting a smaller one of the first subtract value and the second subtract value as a first minimum subtract value;
(f) determining a third subtract value by subtracting the minimum value from the maximum value of one pixel row having the second exposure time, deciding a fourth subtract value by subtracting the minimum value from the maximum value of the other pixel row having the second exposure time, and outputting a smaller one of the third subtract value and the fourth subtract value as a second minimum subtract value; and
(g) deciding an exposure time corresponding to the flicker noise by comparing the first minimum subtract value and the second minimum subtract value.
2. The method as recited in claim 1, wherein, in the step (g), an exposure time having a larger one of the first minimum subtract value and the second minimum subtract value is determined as the flicker noise.
3. The method as recited in claim 1, wherein, in the step (g), a light source corresponding to an exposure time having a smaller one of the first minimum subtract value and the second minimum subtract value is decided as a real light source.
4. The method as recited in claim 2, wherein, in the step (g), a light source corresponding to an exposure time having a smaller one of the first minimum subtract value and the second minimum subtract value is decided as a real light source.
5. The method as recited in claim 3, wherein the first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to minute variation of an external environment.
6. The method as recited in claim 4, wherein the first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to minute variation of an external environment.
7. The method as recited in claim 1, wherein the image information for each pixel row is obtained at one exposure point to thereby cipher the average value.
8. The method as recited in claim 1, wherein one time of the image information detecting process corresponds to one frame.
9. A method for detecting a flicker noise of an image sensor, comprising the steps of:
(a) securing information about an image of each of a first and a second pixel row by differing exposure points of the first and the second pixel rows having a first exposure time and repeating the image information securing process as changing the exposure points of the first and the second pixel rows;
(b) capturing information about an image of each of a third and a fourth pixel row by differing exposure points of the third and the fourth pixel rows having a second exposure time and repeating the image information capturing process as changing the exposure points of the third and the fourth pixel rows;
(c) calculating an average value of the image information for each of the first to the fourth pixel rows in every image information detecting process;
(d) ciphering a maximum value and a minimum value among average values for said each of the first to the fourth pixel rows obtained from the step (c);
(e) determining a first subtract value by subtracting the minimum value from the maximum value of the first pixel row, deciding a second subtract value by subtracting the minimum value from the maximum value of the second pixel row, and outputting a smaller one of the first subtract value and the second subtract value as a first minimum subtract value;
(f) determining a third subtract value by subtracting the minimum value from the maximum value of the third pixel row, deciding a fourth subtract value by subtracting the minimum value from the maximum value of the fourth pixel row, and outputting a smaller one of the third subtract value and the fourth subtract value as a second minimum subtract value; and
(g) deciding an exposure time corresponding to the flicker noise by comparing the first minimum subtract value and the second minimum subtract value.
10. The method as recited in claim 9, wherein, in the step (g), an exposure time having a larger one of the first minimum subtract value and the second minimum subtract value is determined as the flicker noise.
11. The method as recited in claim 9, wherein, in the step (g), a light source corresponding to an exposure time having a smaller one of the first minimum subtract value and the second minimum subtract value is decided as a real light source.
12. The method as recited in claim 10, wherein, in the step (g), a light source corresponding to an exposure time having a smaller one of the first minimum subtract value and the second minimum subtract value is decided as a real light source.
13. The method as recited in claim 11, wherein the first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to minute variation of an external environment.
14. The method as recited in claim 12, wherein the first minimum subtract value and the second minimum subtract value are larger than a signal conversion minimum value for preventing an error operation due to minute variation of an external environment.
15. The method as recited in claim 9, wherein the image information for each of the first to the fourth pixel rows is obtained at one exposure point to thereby cipher the average value.
16. The method as recited in claim 9, wherein one time of the image information detecting process corresponds to one frame.
17. The method as recited in claim 16, wherein the step of detecting information about an image of each of two pixel rows by differing exposure points of the two pixel rows and repeating the image information detecting process is performed for 4 frames.
18. An image sensor comprising:
a pixel array for capturing information about an image provided from the outside and having N pixel rows and M pixel columns for maximizing a feature of reacting to light, wherein M and N are integers, respectively;
a flicker noise detective pixel unit containing X pixel rows, which has a form extended from the N pixel rows of the pixel array, and M pixel columns, wherein each pair of X pixel rows has an identical exposure time and X is an even number; and
a flicker noise detecting block for controlling an exposure point for the flicker noise detective pixel unit and detecting the flicker noise by using outputs of the flicker noise detective pixel unit,
wherein the flicker noise detective pixel unit secures the image information during one frame by making one pair of rows have different exposure points from each other, captures the image information during a next frame by differing the exposure points of the rows and performs its operation by varying the exposure points of the rows during a plurality of frames.
19. An image sensor comprising:
a flicker noise detective pixel block including a plurality of pixel rows;
a flicker noise detecting block configured to detect a flicker noise by providing exposure time starting points to the plurality of pixel rows during a first frame and by changing at least one of the exposure time starting points in the plurality of pixel rows during a second frame; and
wherein values of the exposure time starting points are determined with reference to start times of a corresponding one of the first frame or the second frame.
20. The image sensor of claim 19, wherein the plurality of pixel rows includes a first pair of pixel rows; and
wherein the flicker noise detecting block is further configured to provide exposure time starting points for a first exposure time to the first pair of pixel rows to detect a flicker of a first light source.
21. The image sensor of claim 20, wherein the flicker noise detecting block is further configured to provide different exposure time starting points to each row of the first pair of pixel rows during the first frame.
22. The image sensor of claim 20, wherein the plurality of pixel rows includes a second pair of pixel rows; and
wherein the flicker noise detecting block is further configured to provide exposure time starting points for a second exposure time to the second pair of pixel rows to detect a flicker of a second light source.
23. The image sensor of claim 22, wherein the flicker noise detecting block is further configured to provide different exposure time starting points to each row of the second pair of pixel rows during the first frame.
24. The image sensor of claim 22, wherein the first light source includes a frequency of 50 Hz and the second light source includes a frequency of 60 Hz.
25. The image sensor of claim 22, further comprising a pixel array configured to have an exposure time adjusted according to a detection of the flicker of the first light source or the flicker of the second light source.
26. A method for detecting flicker in an image sensor, the method comprising:
providing exposure time starting points to a plurality of pixel rows during a first frame;
changing at least one of the exposure time starting points in the plurality of pixel rows during a second frame; and
wherein values of the exposure time starting points are determined with reference to start times of a corresponding one of the first frame or the second frame.
27. The method of claim 26, further comprising providing exposure time starting points for a first exposure time to a first pair of pixel rows to detect a flicker of a first light source.
28. The method of claim 27, further comprising providing different exposure time starting points to each row of the first pair of pixel rows during the first frame.
29. The method of claim 27, further comprising providing exposure time starting points for a second exposure time to a second pair of pixel rows to detect a flicker of a second light source.
30. The method of claim 29, further comprising providing different exposure time starting points to each row of the second pair of pixel rows during the first frame.
31. The method of claim 29, wherein the first light source includes a frequency of 50 Hz and the second light source includes a frequency of 60 Hz.
32. The method of claim 29, further comprising:
detecting one of the flicker of the first light source or the flicker of the second light source; and
adjusting an exposure time of a pixel array according to said detecting one of the flicker of the first light source or the flicker of the second light source.
33. A method for detecting flicker in an image sensor, the method comprising:
changing at least one of a plurality of exposure time starting points in a corresponding plurality of pixel rows between a first frame and a second frame;
capturing image information from the plurality of pixel rows during the first frame and the second frame;
detecting a flicker of a light source according to the image information from the plurality of pixel rows during the first frame and the second frame; and
wherein values of the plurality of exposure time starting points are determined with reference to start times of a corresponding one of the first frame or the second frame.
34. The method of claim 33, further comprising:
changing at least one of the plurality of exposure time starting points for a first exposure time for a first pair of pixel rows between the first frame and the second frame;
capturing image information from each of the first pair of pixel rows during the first frame and the second frame; and
detecting a flicker of a first light source according to the image information from each of the first pair of pixel rows during the first frame and the second frame.
35. The method of claim 34, further comprising applying different exposure time starting points to the first pair of rows during the first frame.
36. The method of claim 34, further comprising:
changing at least one of the plurality of exposure time starting points of a second exposure time for a second pair of pixel rows between the first frame and the second frame;
capturing image information from the second pair of pixel rows during the first frame and the second frame; and
detecting a flicker of a second light source according to the image information from the second pair of pixel rows during the first frame and the second frame.
37. The method of claim 36, further comprising applying different exposure time starting points to the second pair of rows during the first frame.
38. The method of claim 36, further comprising adjusting an exposure time of a pixel array according to said detecting a flicker of a first light source and said detecting a flicker of a second light source.
39. An image sensor comprising:
a flicker noise detective pixel unit including a plurality of pixel rows; and
a flicker noise detection controller configured to provide:
a first exposure point for a first pixel row of the plurality of pixel rows during a first frame;
a second exposure point for a second pixel row of the plurality of pixel rows during the first frame;
a third exposure point for the first pixel row of the plurality of pixel rows during a second frame; and
a fourth exposure point for the second pixel row of the plurality of pixel rows during the second frame;
wherein the first exposure point is different from the third exposure point and the second exposure point is different from the fourth exposure point;
wherein values of the first exposure point and the second exposure point are determined with reference to a start time of the first frame; and
wherein values of the third exposure point and the fourth exposure point are determined with reference to a start time of the second frame.
US12/874,820 2004-04-27 2010-09-02 Image sensor for detecting flicker noise and method thereof Active 2026-10-09 USRE44062E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/874,820 USRE44062E1 (en) 2004-04-27 2010-09-02 Image sensor for detecting flicker noise and method thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR2004-0029016 2004-04-27
KR1020040029016A KR100574890B1 (en) 2004-04-27 2004-04-27 Image sensor and method for detection of flicker noise of the same
US10/879,556 US7420595B2 (en) 2004-04-27 2004-06-28 Image sensor for detecting flicker noise and method thereof
US12/874,820 USRE44062E1 (en) 2004-04-27 2010-09-02 Image sensor for detecting flicker noise and method thereof

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/879,556 Reissue US7420595B2 (en) 2004-04-27 2004-06-28 Image sensor for detecting flicker noise and method thereof

Publications (1)

Publication Number Publication Date
USRE44062E1 true USRE44062E1 (en) 2013-03-12

Family

ID=35136487

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/879,556 Active 2026-10-09 US7420595B2 (en) 2004-04-27 2004-06-28 Image sensor for detecting flicker noise and method thereof
US12/874,820 Active 2026-10-09 USRE44062E1 (en) 2004-04-27 2010-09-02 Image sensor for detecting flicker noise and method thereof

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/879,556 Active 2026-10-09 US7420595B2 (en) 2004-04-27 2004-06-28 Image sensor for detecting flicker noise and method thereof

Country Status (3)

Country Link
US (2) US7420595B2 (en)
JP (1) JP4632766B2 (en)
KR (1) KR100574890B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170054889A1 (en) * 2015-01-16 2017-02-23 JVC Kenwood Corporation Imaging processing apparatus and method of imaging processing
US11284023B2 (en) * 2017-12-25 2022-03-22 Canon Kabushiki Kaisha Imaging apparatus, imaging system, and drive method of imaging apparatus

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7408682B2 (en) * 2003-03-20 2008-08-05 Kabushiki Kaisha Toshiba Image reading apparatus
JP4329617B2 (en) * 2004-05-19 2009-09-09 ソニー株式会社 Imaging apparatus and imaging method
JP4377840B2 (en) * 2005-03-31 2009-12-02 イーストマン コダック カンパニー Digital camera
JP4539449B2 (en) * 2005-06-10 2010-09-08 ソニー株式会社 Image processing apparatus and imaging apparatus
JP2007174537A (en) * 2005-12-26 2007-07-05 Victor Co Of Japan Ltd Imaging apparatus
JP4353223B2 (en) * 2006-09-07 2009-10-28 ソニー株式会社 Image data processing apparatus, image data processing method, and imaging system
JP5188275B2 (en) * 2008-06-06 2013-04-24 キヤノン株式会社 Solid-state imaging device, driving method thereof, and imaging system
US20110255786A1 (en) * 2010-04-20 2011-10-20 Andrew Hunter Method and apparatus for determining flicker in the illumination of a subject
US8462229B2 (en) * 2010-09-30 2013-06-11 Hewlett-Packard Development Company, L.P. Detection of flicker within captured imaged frames
TWI423657B (en) 2011-01-25 2014-01-11 Pixart Imaging Inc Image system and interference removing method thereof
TWI459800B (en) 2011-10-18 2014-11-01 Pixart Imaging Inc Imaging system and deflicker method therefor
TWI469632B (en) * 2011-11-09 2015-01-11 Silicon Motion Inc Anti-flicker camera and image capture method thereof
US9276031B2 (en) 2013-03-04 2016-03-01 Apple Inc. Photodiode with different electric potential regions for image sensors
US9741754B2 (en) 2013-03-06 2017-08-22 Apple Inc. Charge transfer circuit with storage nodes in image sensors
US9473706B2 (en) * 2013-12-09 2016-10-18 Apple Inc. Image sensor flicker detection
KR102174192B1 (en) * 2014-01-14 2020-11-04 에스케이하이닉스 주식회사 Timing generator based on processor and method thereof, and CMOS image sensor using that
US10285626B1 (en) 2014-02-14 2019-05-14 Apple Inc. Activity identification using an optical heart rate monitor
US9686485B2 (en) 2014-05-30 2017-06-20 Apple Inc. Pixel binning in an image sensor
JP6700763B2 (en) * 2015-12-11 2020-05-27 キヤノン株式会社 Imaging device, control method thereof, and control program
US9912883B1 (en) 2016-05-10 2018-03-06 Apple Inc. Image sensor with calibrated column analog-to-digital converters
WO2018057975A1 (en) 2016-09-23 2018-03-29 Apple Inc. Stacked backside illuminated spad array
WO2018140522A2 (en) 2017-01-25 2018-08-02 Apple Inc. Spad detector having modulated sensitivity
US10656251B1 (en) 2017-01-25 2020-05-19 Apple Inc. Signal acquisition in a SPAD detector
US10962628B1 (en) 2017-01-26 2021-03-30 Apple Inc. Spatial temporal weighting in a SPAD detector
US10622538B2 (en) 2017-07-18 2020-04-14 Apple Inc. Techniques for providing a haptic output and sensing a haptic input using a piezoelectric body
US10440301B2 (en) 2017-09-08 2019-10-08 Apple Inc. Image capture device, pixel, and method providing improved phase detection auto-focus performance
US10848693B2 (en) 2018-07-18 2020-11-24 Apple Inc. Image flare detection using asymmetric pixels
US11019294B2 (en) 2018-07-18 2021-05-25 Apple Inc. Seamless readout mode transitions in image sensors
CN112532888B (en) * 2019-09-19 2022-10-04 杭州海康慧影科技有限公司 Method and device for inhibiting image striation phenomenon
KR20210112948A (en) * 2020-03-06 2021-09-15 삼성전자주식회사 Correlated double samling circuit and image sensor including thereof
US11563910B2 (en) 2020-08-04 2023-01-24 Apple Inc. Image capture devices having phase detection auto-focus pixels
CN112383718A (en) * 2020-11-16 2021-02-19 维沃移动通信（杭州）有限公司 Image exposure method and device and electronic equipment
US11546532B1 (en) 2021-03-16 2023-01-03 Apple Inc. Dynamic correlated double sampling for noise rejection in image sensors
US12069384B2 (en) 2021-09-23 2024-08-20 Apple Inc. Image capture devices having phase detection auto-focus pixels

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5515132A (en) * 1992-09-16 1996-05-07 Nikon Corporation Photometric control device for camera
US6271884B1 (en) * 1999-09-28 2001-08-07 Conexant Systems, Inc. Image flicker reduction with fluorescent lighting
US6295085B1 (en) 1997-12-08 2001-09-25 Intel Corporation Method and apparatus for eliminating flicker effects from discharge lamps during digital video capture
US20020044205A1 (en) 2000-09-08 2002-04-18 Hidetada Nagaoka Image pickup apparatus with reduced flicker and automatic level adjusting method of the same
US20020097328A1 (en) 2000-08-25 2002-07-25 Stmicroelectronics Ltd. Method of detecting flicker, and video camera using the method
US20020154225A1 (en) * 2001-04-23 2002-10-24 Hiroyuki Matsumoto Imaging system using solid-state CMOS imaging device
US20020158971A1 (en) * 2001-04-26 2002-10-31 Fujitsu Limited Method of reducing flicker noises of X-Y address type solid-state image pickup device
US20030090587A1 (en) * 2001-10-30 2003-05-15 Hofer Gregory V. Method and apparatus for auto-focus control in the presence of artificial illumination
US6630953B1 (en) 1998-07-24 2003-10-07 Matsushita Electric Industrial Co., Ltd. Flicker control imaging apparatus
US20040012692A1 (en) * 2002-03-25 2004-01-22 Shinichi Arazaki Flicker detection apparatus, a flicker correction apparatus, an image-pickup apparatus, a flicker detection program and a flicker correction program
US6710818B1 (en) 1999-10-08 2004-03-23 Matsushita Electric Industrial Co., Ltd. Illumination flicker detection apparatus, an illumination flicker compensation apparatus, and an ac line frequency detection apparatus, methods of detecting illumination flicker, compensating illumination flicker, and measuring ac line frequency
US20040080630A1 (en) 2002-10-10 2004-04-29 Hynix Semiconductor Inc. Pixel array, image sensor having the pixel array and method for removing flicker noise of the image sensor
US20040165084A1 (en) 2003-02-26 2004-08-26 Matsushita Electric Industrial Co., Ltd. Flicker detecting method and flicker detecting apparatus
US20050259162A1 (en) * 2004-05-20 2005-11-24 Jizhang Shan Methods and systems for detecting flash rate of surrounding lights for controlling camcorder frame rate
US7312823B1 (en) * 1995-04-24 2007-12-25 Sony Corporation Solid-state image pick-up apparatus and video camera loaded with the apparatus

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3685686B2 (en) * 2000-06-12 2005-08-24 三菱電機株式会社 Imaging area sensor and imaging apparatus
JP3522674B2 (en) * 2000-09-08 2004-04-26 三菱電機株式会社 Imaging device and automatic level adjustment method

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5515132A (en) * 1992-09-16 1996-05-07 Nikon Corporation Photometric control device for camera
US7312823B1 (en) * 1995-04-24 2007-12-25 Sony Corporation Solid-state image pick-up apparatus and video camera loaded with the apparatus
US6295085B1 (en) 1997-12-08 2001-09-25 Intel Corporation Method and apparatus for eliminating flicker effects from discharge lamps during digital video capture
US6630953B1 (en) 1998-07-24 2003-10-07 Matsushita Electric Industrial Co., Ltd. Flicker control imaging apparatus
US6271884B1 (en) * 1999-09-28 2001-08-07 Conexant Systems, Inc. Image flicker reduction with fluorescent lighting
US6710818B1 (en) 1999-10-08 2004-03-23 Matsushita Electric Industrial Co., Ltd. Illumination flicker detection apparatus, an illumination flicker compensation apparatus, and an ac line frequency detection apparatus, methods of detecting illumination flicker, compensating illumination flicker, and measuring ac line frequency
US20020097328A1 (en) 2000-08-25 2002-07-25 Stmicroelectronics Ltd. Method of detecting flicker, and video camera using the method
US20020044205A1 (en) 2000-09-08 2002-04-18 Hidetada Nagaoka Image pickup apparatus with reduced flicker and automatic level adjusting method of the same
US20020154225A1 (en) * 2001-04-23 2002-10-24 Hiroyuki Matsumoto Imaging system using solid-state CMOS imaging device
US20020158971A1 (en) * 2001-04-26 2002-10-31 Fujitsu Limited Method of reducing flicker noises of X-Y address type solid-state image pickup device
US20030090587A1 (en) * 2001-10-30 2003-05-15 Hofer Gregory V. Method and apparatus for auto-focus control in the presence of artificial illumination
US20040012692A1 (en) * 2002-03-25 2004-01-22 Shinichi Arazaki Flicker detection apparatus, a flicker correction apparatus, an image-pickup apparatus, a flicker detection program and a flicker correction program
US20040080630A1 (en) 2002-10-10 2004-04-29 Hynix Semiconductor Inc. Pixel array, image sensor having the pixel array and method for removing flicker noise of the image sensor
JP2004135347A (en) 2002-10-10 2004-04-30 Hynix Semiconductor Inc Pixel array of image sensor, image sensor using the same, and method for eliminating flicker noise of image sensor
US20040165084A1 (en) 2003-02-26 2004-08-26 Matsushita Electric Industrial Co., Ltd. Flicker detecting method and flicker detecting apparatus
US20050259162A1 (en) * 2004-05-20 2005-11-24 Jizhang Shan Methods and systems for detecting flash rate of surrounding lights for controlling camcorder frame rate

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Uncertified translation of Japanese Office Action dated Feb. 5, 2010.
Uncertified translation of Japanese Office Action dated May 28, 2010.

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170054889A1 (en) * 2015-01-16 2017-02-23 JVC Kenwood Corporation Imaging processing apparatus and method of imaging processing
US9883113B2 (en) * 2015-01-16 2018-01-30 JVC Kenwood Corporation Imaging processing apparatus and method of imaging processing by controlling an imaging period
US11284023B2 (en) * 2017-12-25 2022-03-22 Canon Kabushiki Kaisha Imaging apparatus, imaging system, and drive method of imaging apparatus

Also Published As

Publication number Publication date
JP2005318504A (en) 2005-11-10
KR100574890B1 (en) 2006-04-27
KR20050103733A (en) 2005-11-01
US20050238259A1 (en) 2005-10-27
JP4632766B2 (en) 2011-02-16
US7420595B2 (en) 2008-09-02

Similar Documents

Publication Publication Date Title
USRE44062E1 (en) Image sensor for detecting flicker noise and method thereof
US7280135B2 (en) Pixel array, image sensor having the pixel array and method for removing flicker noise of the image sensor
US8520094B2 (en) Flicker detecting circuit and method in image sensor
US7986363B2 (en) High dynamic range imager with a rolling shutter
JP4948090B2 (en) Imaging apparatus and drive control method
CN102713970B (en) Generating column offset corrections for image sensors
JP4327928B2 (en) Electronic camera device
US20090201402A1 (en) Image sensor and digital gain compensation method thereof
JP5624630B2 (en) How to generate column offset correction for an image sensor
US20030184666A1 (en) Image sensor having pixel array and method for automatically compensating black level of the same
US7777793B2 (en) Signal processor having A/D conversion unit and operation part
US7986354B2 (en) Method for correcting pixel defect of image pickup device
KR100975444B1 (en) Image sensor with compensating block for reset voltage
KR100355146B1 (en) Cmos image sensor
KR20090081273A (en) Apparatus for adaptive noise reduction and image sensor using the apparatus
US7667172B2 (en) Image sensor with expanding dynamic range
EP1248458B1 (en) System and method for correcting erroneous image signals from defective photosensitive pixels during analog-to-digital conversion
KR100890153B1 (en) Removal method of flicker noise and CMOS image sensor with same method
JP2004023231A (en) Imaging device and portable telephone system provided with the imaging device
CN118018853A (en) Ambient light sensing using image sensors
JP2000184289A (en) Defective pixel correction device for image pickup device and its method
KR100422579B1 (en) Image sensor and method for signal processing of image sensor
KR20070071003A (en) Image sensor and image contour detection method in image sensor
KR20120015583A (en) Method of operating an image sensor

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTELLECTUAL VENTURES II LLC, DELAWARE

Free format text: MERGER;ASSIGNOR:CROSSTEK CAPITAL, LLC;REEL/FRAME:026637/0632

Effective date: 20110718

FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12