USRE39712E1 - Digital imaging device optimized for color performance - Google Patents

Digital imaging device optimized for color performance Download PDF

Info

Publication number
USRE39712E1
USRE39712E1 US11/405,920 US40592006A USRE39712E US RE39712 E1 USRE39712 E1 US RE39712E1 US 40592006 A US40592006 A US 40592006A US RE39712 E USRE39712 E US RE39712E
Authority
US
United States
Prior art keywords
color
image
sensitivities
matrix
spectral
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US11/405,920
Inventor
Richard M. Vogel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intellectual Ventures Fund 83 LLC
Original Assignee
Eastman Kodak Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Co filed Critical Eastman Kodak Co
Priority to US11/405,920 priority Critical patent/USRE39712E1/en
Application granted granted Critical
Publication of USRE39712E1 publication Critical patent/USRE39712E1/en
Assigned to CITICORP NORTH AMERICA, INC., AS AGENT reassignment CITICORP NORTH AMERICA, INC., AS AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY, PAKON, INC.
Assigned to EASTMAN KODAK COMPANY, EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC., KODAK (NEAR EAST), INC., KODAK PORTUGUESA LIMITED, PAKON, INC., QUALEX INC., KODAK AVIATION LEASING LLC, FAR EAST DEVELOPMENT LTD., LASER-PACIFIC MEDIA CORPORATION, KODAK AMERICAS, LTD., KODAK PHILIPPINES, LTD., KODAK REALTY, INC., KODAK IMAGING NETWORK, INC., FPC INC., CREO MANUFACTURING AMERICA LLC, NPEC INC. reassignment EASTMAN KODAK COMPANY PATENT RELEASE Assignors: CITICORP NORTH AMERICA, INC., WILMINGTON TRUST, NATIONAL ASSOCIATION
Assigned to INTELLECTUAL VENTURES FUND 83 LLC reassignment INTELLECTUAL VENTURES FUND 83 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY
Anticipated expiration legal-status Critical
Assigned to MONUMENT PEAK VENTURES, LLC reassignment MONUMENT PEAK VENTURES, LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES FUND 83 LLC
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/447Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by preserving the colour pattern with or without loss of information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/85Camera processing pipelines; Components thereof for processing colour signals for matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/67Circuits for processing colour signals for matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2209/00Details of colour television systems
    • H04N2209/04Picture signal generators
    • H04N2209/041Picture signal generators using solid-state devices
    • H04N2209/042Picture signal generators using solid-state devices having a single pick-up sensor
    • H04N2209/045Picture signal generators using solid-state devices having a single pick-up sensor using mosaic colour filter
    • H04N2209/046Colour interpolation to calculate the missing colour values

Definitions

  • This invention pertains to the field of digital imaging and, more particularly, to the optimization of the color performance of digital imaging device, such as digital cameras and scanners.
  • Correction matrices are useful in a variety of color imaging applications to effect color conversion or correction. For instance, a conversion matrix is used to convert red, green, and blue video signals into Y (luminance) and I, Q (chrominance) signals. A color correction matrix is used to correct the spectral sensitivities of a video camera for the chromaticities of the phosphor set of the particular display in use. Another use is with film-to-video conversion, a process in which a color correction matrix operates on the film scanning signals to correct the film colorimetry for video display. While these systems were typically analog systems, matrix processing is particularly adapted to a digital environment.
  • a color cathode-ray tube (CRT) is used as an example of a typical display device where the defining spectral characteristics are easily derived by someone skilled in the art from a knowledge of the CRT's phosphor chromaticities and white-point setting, as well as a knowledge of the spectral response of the human eye.
  • the resulting spectral curves are referred to as the color-matching functions (CMFs) for the display.
  • CMFs color-matching functions
  • the camera exhibit spectral sensitivities only in the visible portion of the electro-magnetic spectrum (approximately 400 to 700 nm).
  • the overall spectral sensitivities of the camera correspond to a set of all-positive color-matching-functions (CMFs). If these requirements are met, the camera will be able to discern color information in the scene in much the same way that a human observer does. Failure to achieve this goal will result in color reproduction errors. (This failure mechanism is referred to as metamerism.)
  • a set of spectral curve is defined as a set of CMFs if, and only if, it can be exactly derived from the spectral response of the human eye via a linear 3 ⁇ 3 transformation.
  • CMFs Commission Internationale De L'Eclairage
  • the CIE Commission Internationale De L'Eclairage
  • CIE publication 15.2 (1986) Colorimetry—Second Edition in table 2.5 Another useful feature of CMFs is the fact that any two sets of CMFs are directly related to each other through a unique 3 ⁇ 3 linear transformation.
  • the optical path of an electronic camera may consist of various components—each with its own spectral characteristics. Among these components one would ordinarily find a lens, blur-filter, infra-red cut-off filter and a CCD imager.
  • the overall spectral sensitivity of the camera is determined by the combined spectral responses of the individual components.
  • FIG. 1 illustrates the spectral characteristics for a typical color CCD camera including the combined effects of all of the optical components. These curves have been normalized to unit response for comparison purposes as is the standard practice when working with color-matching functions.
  • FIG. 1 a second set (dotted lines) of curves representing the transformed spectral characteristics of the camera following the color-correction matrix operation. Note that the transformed spectral responses have negative lobes whereas the original camera spectral responses do not.
  • FIG. 2 compares the transformed spectral responses of the camera (dotted lines) with the CMF's for a CRT having CCIR Rec. 709 phosphors and a 6500 Kelvin white point. It can be seen that elements in a real camera have errors in spectral response that prevent replication of CMFs regardless of the transformation. Errors are normally spread among all colors in a way that minimizes color errors, but the result inevitably is not a perfect match, as seen particularly in the transformed camera red spectral response in FIG. 2 .
  • an improved method is used to select the color-correction matrix coefficients to account for changes i 9 n illuminant color temperature.
  • this method provides optimum compensation for variations in the scene illuminant by using all of the degrees-of-freedom available in the primary color separator matrix.
  • a color-correction matrix is shown in U.S. Pat. No. 5,001,663 as one component of a digital-signal processing chipset for a high performance digital color video camera.
  • the implementation illustrated requires that the matrix be mask-programmed into the chip during fabrication. This approach fixes the matrix coefficients during the production process such that color correction is specific to a defined type, or family, of cameras. This is ordinarily done by establishing the matrix coefficients to account for the optical component spectral characteristic or illuminant color temperature of a defined reference camera, and then embodying these coefficients in each manufactured camera.
  • U.S. Pat. No. 5,189,511 is a further example of the approach, describing improved resolution and reproduction of hard copies made from images captured by different types of electronic still cameras.
  • Subtractive-type color processing is used to attempt to stabilize the primaries associated with image dyes used to produce the hard copy images, preceded by additive-type processing which attempts to correct the camera sensitivities appropriately for the stabilized primaries.
  • the additive-type color processing may be in the camera itself to ensure that each output device achieves optimum color reproduction from signals corresponding to those provided by a defined reference camera. This arrangement allows signals from different types of cameras, i.e., corresponding to different defined reference cameras (e.g., high resolution professional cameras vs. low resolution consumer cameras), to provide input to different types of hardcopy devices and media.
  • a digital imaging device captures an image and generates a color signal from the image for application to an output device having specific color sensitivities, the imaging device further being one of many devices of the same type useful with the output device.
  • the digital imaging device for example, a digital camera, includes a color sensor for capturing the image and generating a color signal from the captured image, the color sensor having predetermined spectral sensitivities, and an optical section that is interposed in the image light directed to the color sensor, the optical section also having predetermined spectral characteristics.
  • the combination of the spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguish this particular imaging device from other imaging devices of the same type.
  • the matrix coefficients optimally correct the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the output device.
  • the present invention has the advantage that the color reproduction variation from one camera to the next is accordingly minimized. This reduces the occurrence of color nonuniformity between the same digital images captured by different digital cameras.
  • FIG. 1 is a comparison of the normalized original camera spectral characteristics and the transformed spectral characteristics following application of a color-correction matrix.
  • FIG. 2 is a comparison of the transformed camera spectral characteristics from FIG. 1 and the actual CMFs for a particular CRT.
  • FIG. 3 is a block diagram showing the preferred embodiment of the invention where the color matrix is located on the optical assembly of the camera, but he actual color-correction operation utilizing the matrix is performed external to the camera.
  • FIG. 4 is a block diagram showing a second version of the preferred embodiment of the invention wherein the color matrix is located on the optical assembly of the camera and the color-correction operation is performed internal to the camera.
  • FIG. 5 is a block diagram showing a third embodiment of the ivneiton wherein the color matrix is located within the camera but external to the optical assembly of the camera.
  • FIG. 6 is a block diagram showing a fourth embodiment of the invention wherein the lens is removable form the camera.
  • FIG. 7 is a block diagram outlining a general method for obtaining the color-correction matrix coefficients.
  • FIG. 8 is a block diagram of an electronic imaging system incorporating an imaging device in accordance with the invention.
  • a digital imaging device is a device which uses an electronic sensor to capture an image either directly from an object or indirectly from a medium, such as film; signal processing to represent the captured signal numerically; and some storage device to pressure the numerical image data.
  • a digital imaging device particularly a digital camera
  • a removable storage device such as an integrated circuit memory card
  • U.S. Pat. No. 5,016,107 describes an electronic still camera utilizing image compression and providing digital storage in a removable memory card having a static random access memory.
  • the integrated circuits in the removable memory card store image data and a directory locating the data.
  • the image data provided by the digital imaging device and stored in a memory card is ordinary used to produce some type of display or print, for example, a CRT display or a digital print made from images scanned from film or taken by an electronic camera.
  • the digital imaging device which may be an electronic camera 10 or a scanner 11 , is utilized in a system including a digital processor 12 .
  • the digital image information produced by the digital imaging device is downloaded to the peripheral digital processor 12 , as shown in FIG. 8 , for further processing into a digital image.
  • the downloading can be accomplished for either device in a number of ways, for instance by a cable connection 13 through an interface 14 , or by removable media, such as a memory card 15 , through a card reader 16 .
  • a suitable color CRT display 17 is connected to the digital processor 12 for displaying the images, and a printer 18 is connected to print out copies 18 a of the images.
  • a keyboard 19 is also connected for use in the processing of the images.
  • the digital processor 12 which can be part of a conventional programmed computer, utilizes conventional processing techniques to process the digital image information according to algorithms stored in the computer or provided by application software used with the computer.
  • the digital processor 12 may include a conventional color management system, which links the input device (camera 10 or scanner 11 ) and the output device (CRT 17 or printer 18 ) by utilizing device profiles appropriate for the type of input and output devices used (e.g., one input profile for the camera 10 and another input profile for the scanner 11 ).
  • the ultimate color performance of an electronic camera is directly influenced by the various optical components which comprise the image capture path. It is possible to maximize the color reproduction accuracy of a particular camera by computing a unique color correction matrix for hat camera which compensates for the unique optical characteristic of that camera. This approach also minimizes the variation in color reproduction from one camera to the next.
  • FIG. 3 a simplified block diagram illustrating the preferred embodiment of the invention is shown.
  • the electronic camera 10 has an optical sub-assembly 20 containing a lens 22 , an infrared cutoff filter 24 , a blur filter 26 and a CCD imager 28 with an integral color filter array (CFA) 30 .
  • CFA integral color filter array
  • the optical subassembly 20 has predetermined spectral sensitivities of the CCD imager 28 and the spectral characteristics of the lens 22 , the infrared cutoff filter 24 , and the blur filter 26 . Due to these spectral sensitivities and spectral characteristics, the combination thereof uniquely distinguish this imaging device from other imaging devices of the same type. In other words, although different cameras 10 contain nominally identical optical elements, including sensors, this overall spectral responses will differ from camera to camera.
  • the optical subassembly 20 which is used to capture an image of the scene 32 , is designated to be removable from the camera 10 for purposes of servicing and calibration.
  • the optical subassembly electrically connects to a preprocessing section 34 through an electrical connecting means 35 .
  • Image-wise signals S 1 -S N from the CCD imager 28 are converted to digital, linear RGB format within the camera by the pre-processing section 34 using techniques and components familiar to those skilled in the art. These digital RGB signals represent the red, green and blue primary components of the image, respectively.
  • Pre-processing section 34 may perform such well-known tasks as double-correlated sampling of the CCD signals, black-level control, white-balance, analog-to-digital conversion, conversion of the CCD signals to RGB and interpolation of the CFA data to produce RGB values at each pixel location.
  • Digital RGB values from the pre-processing section 34 are transformed to a set of color-corrected RGB values (R CC , G CC , B CC ) suitable for display on the color CRT display 17 by processing in a color matrix operation 40 .
  • the color-correction matrix 40 operation is performed external to the camera as is shown in FIG. 3 in, for example, the digital processor 12 shown in FIG. 8 . Therefore, the RGB signals and the matrix coefficients are provided to the external digital processor 12 via interface liens 37 a and b.
  • the color-correction matrix 40 operation is performed internal to the camera as illustrated in FIG. 4 . Where this step is performed is not important to the teaching of this invention. In either case the color-correction matrix 40 operation is performed on RGB signals which vary linearly with exposure.
  • Color-corrected RGB signals (R CC , G CC , B CC ) following the color-correction matrix 40 operation are converted to a format suitable for CRT display by a post-processing section 50 using techniques and components familiar to those skilled in the art.
  • Such post processing operations may include such tasks as interpolation, edge-enhancement and tone-scale remapping, for example.
  • the color-correction matrix coefficients for the color matrix operation 40 are stored in a digital memory 36 co-located on the optical sub-assembly 20 with all of the other optical components. These coefficients are uniquely determined for each camera in order to correct the spectral sensitivities of the particular CCD imager 28 in the camera 10 , and the spectral characteristics of the particular other elements in the optical subassembly 20 , for the color sensitivities of the type of output device being used.
  • optical sub-assemblies 20 can be fabricated, calibrated and stocked for later integration into the final product 10 without the need for calibrating the final product.
  • optical sub-assemblies 20 can be simply replaced without the need for calibrating the repaired product. Since each optical subassembly 20 is calibrated for the particular optical components on the subassembly, it may be appreciated that the matrix coefficients stored in the memory 36 are unique for each subassembly 20 , and therefore for each camera 10 .
  • RGB signals have been discussed by way of example as the tristimulus format of choice for representing the scene color information, this invention is not restricted to use with this format alone.
  • Other tristimulus formats such as the CIE XYZ format are equally applicable and may, in fact, present advantages in a particular implementation.
  • Sin the CIE XYZ format is a device independent space based on a set of CMFs defined by the CIE 1931 Standard Colorimetric Observer (2°), the matrix coefficients cold be used to generate an input profile unique to each camera which will correct the spectral sensitivities of the camera for the standardized CMFs of this device independent space.
  • the matrix coefficients cold be used to generate an input profile unique to each camera which will correct the spectral sensitivities of the camera for the standardized CMFs of this device independent space.
  • RGB input profiles are established which will correct the spectral sensitivities of an input device for a connection space.
  • output profiles are used to convert the signals from the connection space to a format that is expected by an output device. It should therefore be understood that this invention encompasses linear tristimulus formats in general while the discussion is limited to the familiar RG format for ease of understanding.
  • FIG. 5 illustrates a third embodiment of the invention wherein the color-correction matrix coefficients for the matrix operation 40 are stored in a digital memory 38 located somewhere within the camera 10 but not necessarily on the optical sub-assembly 20 .
  • the aforementioned advantages in the production and service environment are not realizable for the color reproduction accuracy and consistency goals of the invention are not compromised.
  • FIG. 6 illustrates a fourth embodiment of the invention wherein the lens 22 is not physically part of the optical sub-assembly and many, in fact, be removable as is the case of a camera with interchangeable lenses.
  • the camera of optical sub-assembly depending on where the color-coefficient matrix digital memory 38 is located, is calibrated using a lens with a spectral response representing the average of the spectral responses of all lenses that are anticipated to be used with the camera. This represents only a slight compromise since the lens does not contribute significantly to variations in color reproduction performance.
  • FIG. 7 illustrates a general method for obtaining these coefficients.
  • a color chart 72 containing colors representative of the expected range of real wold colors provides the basis for the coefficients calculation process.
  • An example of such a chart is the well known Macbeth Color Checker.
  • a necessary first step involves measurement of the spectral characteristics (S ⁇ ) of the illuminant 74 as well as measurements of the spectral characteristics (Ri ⁇ ) of each color patch of the color chart 72 .
  • CIE tristimulus values (XYZ) describing the location of a particular color patch in the 3-dimensional XYZ color pace, may then be computed form the measured optical spectral data as described in the aforementioned CIE publication 15.2 (1986) Colorimetry—Second Edition on pages 22-23. This set of XYZ values becomes the colorimetric aims for the camera.
  • the electronic camera 10 is used to capture an image of the color chart 72 under the specified illuminant 74 .
  • RGB camera signals representative of the captured color chart images are next subjected to a normalization process 78 to provide RGB signal switch vary linearly with scene luminance.
  • the normalization process 78 may include removal of the camera gramma/knee characteristics as well as black-level, white-balance and exposure errors.
  • Linear RGB signals are transformed to a set of color-corrected TGB signals by color-correction matrix transformation 79 . Initially this matrix is set equal to the identity matrix. The coefficients are subsequently adjusted in an iterative fashion by a regression process 80 until the average color error for all color patches of the color chart 72 is reduced to a predetermined level.
  • Color-corrected RGB signals from color-correction matrix transmission 79 are retransformed to a set of CIE XYZ signals by CRT phosphor matrix transformation 84 . These signals represent the colors which would appear on the face of a reference CRT when presented with the color-corrected RGB signals from color-correction matrix transformation 79 . It would be understood by someone skilled in the art that these color-corrected signals would first need to be modified to account for the nonlinear characteristics of the CRT phosphors.
  • the resulting XYZ signals from CRT phosphor transformation matrix 84 representing the reproduced colors for each color patch of the color chart 72 for a reference output device, in this case the reference CRT.
  • An error calculation process 82 determines the average error between the aim and reproduction signals for all of the color patches on the color chart 72 .
  • An individual color error is first computed for each color patch using the square-root of the sum of the squares of the differences of the aim and reproduction X, Y and Z signals. This represents the vector length between the location of the aim and reproduction colors in the 3-dimensional XYZ color space. The last part of the error calculation is to average the individual color errors. This average color error is used in the regression process 80 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Image Signal Generators (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

A digital imaging device captures an image and generates a color signal from the image for application to an output device having specific color sensitivities, the imaging device further being one of many devices of the same type useful with the output device. The digital imaging device, for example a digital camera, includes a color sensor for capturing the image and generating a color signal from the captured image, the color sensor having predetermined spectral sensitivities, and an optical section that is interposed in the image light directed to the color sensor, the optical section also having predetermined spectral characteristics. The combination of the spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguish this particular imaging device from other imaging devices of the same type. By providing a set of matrix coefficients uniquely determined for this imaging device, the matrix coefficients optimally correct the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the output device.

Description

This application is a reissue application for U.S. Pat. No. 5,668,596 issued on Sep. 16, 1997 on U.S. Ser. No. 08/608,649 filed Feb. 29, 1996
FIELD OF THE INVENTION
This invention pertains to the field of digital imaging and, more particularly, to the optimization of the color performance of digital imaging device, such as digital cameras and scanners.
BACKGROUND OF THE INVENTION
Correction matrices are useful in a variety of color imaging applications to effect color conversion or correction. For instance, a conversion matrix is used to convert red, green, and blue video signals into Y (luminance) and I, Q (chrominance) signals. A color correction matrix is used to correct the spectral sensitivities of a video camera for the chromaticities of the phosphor set of the particular display in use. Another use is with film-to-video conversion, a process in which a color correction matrix operates on the film scanning signals to correct the film colorimetry for video display. While these systems were typically analog systems, matrix processing is particularly adapted to a digital environment.
Continuing advances in semiconductor technology in areas such as digital memory, digital application-specific integrated circuits (BASICS) and charge-coupled device (CCD) images have made possible the introduction in recent years of digital electronic cameras. Evolution of this product segment will be driven by ever increasing consumer demands for better performance in such areas as resolution, photographic speed, and color reproduction. In the area of color reproduction it is desirable to select an optimum set of spectral characteristic for the CCD imager. The prior art (for example, as described in Color Science in Television and Display Systems by W. N. Sproson, published by Adam Hilger Ltd, 1983), teaches that one step toward the goal of good color reproduction is to choose a set of spectral characteristics for the camera which are as close as possible to the spectral characteristics of the intended display device. In the aforementioned Spronson text, a color cathode-ray tube (CRT) is used as an example of a typical display device where the defining spectral characteristics are easily derived by someone skilled in the art from a knowledge of the CRT's phosphor chromaticities and white-point setting, as well as a knowledge of the spectral response of the human eye. The resulting spectral curves are referred to as the color-matching functions (CMFs) for the display.
It is desirable to have the camera exhibit spectral sensitivities only in the visible portion of the electro-magnetic spectrum (approximately 400 to 700 nm). In addition, it is desirable that the overall spectral sensitivities of the camera correspond to a set of all-positive color-matching-functions (CMFs). If these requirements are met, the camera will be able to discern color information in the scene in much the same way that a human observer does. Failure to achieve this goal will result in color reproduction errors. (This failure mechanism is referred to as metamerism.)
A set of spectral curve is defined as a set of CMFs if, and only if, it can be exactly derived from the spectral response of the human eye via a linear 3×3 transformation. An infinite number of CMFs are possible according to this definition. The CIE (Commission Internationale De L'Eclairage) has published standardized spectral data sets describing the response of the human eye. This day may be found in CIE publication 15.2 (1986) Colorimetry—Second Edition in table 2.5. Another useful feature of CMFs is the fact that any two sets of CMFs are directly related to each other through a unique 3×3 linear transformation.
One practical limitation in the selection of a set of CMFs for the camera is the restriction that they be all positive, whereas the CMF's decreasing a color CRT typically have negative lobes. This is not a problem in practice since a linear 3×3 transformation may be employed, as discussed above, to correct the camera's output color signals for rendition on the CRT display. This linear 3×3 transformation is often referred to in the art as a color-correction matrix. Another practical restriction in the selection of a set of camera CMF's is the need to minimize the size of the off-diagonal coefficient in the color-correction matrix since these are directly responsible for degrading the noise performance of the imaging system.
The optical path of an electronic camera may consist of various components—each with its own spectral characteristics. Among these components one would ordinarily find a lens, blur-filter, infra-red cut-off filter and a CCD imager. The overall spectral sensitivity of the camera is determined by the combined spectral responses of the individual components. FIG. 1 illustrates the spectral characteristics for a typical color CCD camera including the combined effects of all of the optical components. These curves have been normalized to unit response for comparison purposes as is the standard practice when working with color-matching functions.
Included in FIG. 1 is a second set (dotted lines) of curves representing the transformed spectral characteristics of the camera following the color-correction matrix operation. Note that the transformed spectral responses have negative lobes whereas the original camera spectral responses do not. FIG. 2 compares the transformed spectral responses of the camera (dotted lines) with the CMF's for a CRT having CCIR Rec. 709 phosphors and a 6500 Kelvin white point. It can be seen that elements in a real camera have errors in spectral response that prevent replication of CMFs regardless of the transformation. Errors are normally spread among all colors in a way that minimizes color errors, but the result inevitably is not a perfect match, as seen particularly in the transformed camera red spectral response in FIG. 2.
The use of a color-correction matrix is shown in U.S. Pat. No. 5,253,047, in which a color temperature detecting circuit modifies the matrix coefficients for a primary color separator used to perform a color-correction operation for a color video camera. The primary color separator is used to compute the red, green and blue primary color signals for the luminance/chrominance signals generated by the camera detector circuitry. In U.S. patent application Ser. No. 08/569,645, “Method and Apparatus for Color-Correcting Multichannel Signals of a Digital Camera”, filed Dec. 8, 1995 to Spaulding et al. an improved method is used to select the color-correction matrix coefficients to account for changes i9n illuminant color temperature. In particular, this method provides optimum compensation for variations in the scene illuminant by using all of the degrees-of-freedom available in the primary color separator matrix.
A color-correction matrix is shown in U.S. Pat. No. 5,001,663 as one component of a digital-signal processing chipset for a high performance digital color video camera. The implementation illustrated requires that the matrix be mask-programmed into the chip during fabrication. This approach fixes the matrix coefficients during the production process such that color correction is specific to a defined type, or family, of cameras. This is ordinarily done by establishing the matrix coefficients to account for the optical component spectral characteristic or illuminant color temperature of a defined reference camera, and then embodying these coefficients in each manufactured camera.
U.S. Pat. No. 5,189,511 is a further example of the approach, describing improved resolution and reproduction of hard copies made from images captured by different types of electronic still cameras. Subtractive-type color processing is used to attempt to stabilize the primaries associated with image dyes used to produce the hard copy images, preceded by additive-type processing which attempts to correct the camera sensitivities appropriately for the stabilized primaries. The additive-type color processing may be in the camera itself to ensure that each output device achieves optimum color reproduction from signals corresponding to those provided by a defined reference camera. This arrangement allows signals from different types of cameras, i.e., corresponding to different defined reference cameras (e.g., high resolution professional cameras vs. low resolution consumer cameras), to provide input to different types of hardcopy devices and media.
As digital cameras and low cost scanner proliferate in the marketplace, there is increased need that images from comparable cameras or scanners produce comparable colors to the human observer. Unfortunately, small variations in optical component spectral characteristics, even within the same family of cameras, can produce noticeable color differences in the output image. Heretofore, the approaches taken do not account for variations in optical component spectral characteristics from individual imaging device to individual imaging device.
SUMMARY OF THE INVENTION
The aforementioned problems are solved with a technique for optimum color correction utilizing customized matrix coefficients for a particular imaging device. According to the invention, a digital imaging device captures an image and generates a color signal from the image for application to an output device having specific color sensitivities, the imaging device further being one of many devices of the same type useful with the output device. The digital imaging device, for example, a digital camera, includes a color sensor for capturing the image and generating a color signal from the captured image, the color sensor having predetermined spectral sensitivities, and an optical section that is interposed in the image light directed to the color sensor, the optical section also having predetermined spectral characteristics. Importantly, the combination of the spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguish this particular imaging device from other imaging devices of the same type. By providing a set of matrix coefficients uniquely determined for this imaging device, the matrix coefficients optimally correct the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the output device.
Besides providing an optimal level of color correction, the present invention has the advantage that the color reproduction variation from one camera to the next is accordingly minimized. This reduces the occurrence of color nonuniformity between the same digital images captured by different digital cameras.
These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a comparison of the normalized original camera spectral characteristics and the transformed spectral characteristics following application of a color-correction matrix.
FIG. 2 is a comparison of the transformed camera spectral characteristics from FIG. 1 and the actual CMFs for a particular CRT.
FIG. 3 is a block diagram showing the preferred embodiment of the invention where the color matrix is located on the optical assembly of the camera, but he actual color-correction operation utilizing the matrix is performed external to the camera.
FIG. 4 is a block diagram showing a second version of the preferred embodiment of the invention wherein the color matrix is located on the optical assembly of the camera and the color-correction operation is performed internal to the camera.
FIG. 5 is a block diagram showing a third embodiment of the ivneiton wherein the color matrix is located within the camera but external to the optical assembly of the camera.
FIG. 6 is a block diagram showing a fourth embodiment of the invention wherein the lens is removable form the camera.
FIG. 7 is a block diagram outlining a general method for obtaining the color-correction matrix coefficients.
FIG. 8 is a block diagram of an electronic imaging system incorporating an imaging device in accordance with the invention.
DETAILED DESCRIPTION OF THE INVENTION
Because electronic imaging devices employing electronic sensors are well known, the present description will be directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with the present invention. Elements not specifically shown or described herein may be selected from those known in the art. Certain aspects of the embodiments to be described may be provided in software. Given the system description as described in the following materials, all such software implementation is conventional and within the ordinary skill in such arts.
As understood in the prior art, a digital imaging device is a device which uses an electronic sensor to capture an image either directly from an object or indirectly from a medium, such as film; signal processing to represent the captured signal numerically; and some storage device to pressure the numerical image data. It is further known for a digital imaging device, particularly a digital camera, to use a removable storage device, such as an integrated circuit memory card, to store images. For instance, U.S. Pat. No. 5,016,107 describes an electronic still camera utilizing image compression and providing digital storage in a removable memory card having a static random access memory. In this camera, the integrated circuits in the removable memory card store image data and a directory locating the data. The image data provided by the digital imaging device and stored in a memory card is ordinary used to produce some type of display or print, for example, a CRT display or a digital print made from images scanned from film or taken by an electronic camera.
As shown in FIG. 8, the digital imaging device, which may be an electronic camera 10 or a scanner 11, is utilized in a system including a digital processor 12. The digital image information produced by the digital imaging device is downloaded to the peripheral digital processor 12, as shown in FIG. 8, for further processing into a digital image. The downloading can be accomplished for either device in a number of ways, for instance by a cable connection 13 through an interface 14, or by removable media, such as a memory card 15, through a card reader 16. A suitable color CRT display 17 is connected to the digital processor 12 for displaying the images, and a printer 18 is connected to print out copies 18a of the images. A keyboard 19 is also connected for use in the processing of the images. The digital processor 12, which can be part of a conventional programmed computer, utilizes conventional processing techniques to process the digital image information according to algorithms stored in the computer or provided by application software used with the computer. For example, the digital processor 12 may include a conventional color management system, which links the input device (camera 10 or scanner 11) and the output device (CRT 17 or printer 18) by utilizing device profiles appropriate for the type of input and output devices used (e.g., one input profile for the camera 10 and another input profile for the scanner 11).
The ultimate color performance of an electronic camera is directly influenced by the various optical components which comprise the image capture path. It is possible to maximize the color reproduction accuracy of a particular camera by computing a unique color correction matrix for hat camera which compensates for the unique optical characteristic of that camera. This approach also minimizes the variation in color reproduction from one camera to the next. With reference to FIG. 3, a simplified block diagram illustrating the preferred embodiment of the invention is shown. The electronic camera 10 has an optical sub-assembly 20 containing a lens 22, an infrared cutoff filter 24, a blur filter 26 and a CCD imager 28 with an integral color filter array (CFA) 30. The optical subassembly 20 has predetermined spectral sensitivities of the CCD imager 28 and the spectral characteristics of the lens 22, the infrared cutoff filter 24, and the blur filter 26. Due to these spectral sensitivities and spectral characteristics, the combination thereof uniquely distinguish this imaging device from other imaging devices of the same type. In other words, although different cameras 10 contain nominally identical optical elements, including sensors, this overall spectral responses will differ from camera to camera.
The optical subassembly 20, which is used to capture an image of the scene 32, is designated to be removable from the camera 10 for purposes of servicing and calibration. When installed in the camera, the optical subassembly electrically connects to a preprocessing section 34 through an electrical connecting means 35. Image-wise signals S1-SN from the CCD imager 28 are converted to digital, linear RGB format within the camera by the pre-processing section 34 using techniques and components familiar to those skilled in the art. These digital RGB signals represent the red, green and blue primary components of the image, respectively. Pre-processing section 34 may perform such well-known tasks as double-correlated sampling of the CCD signals, black-level control, white-balance, analog-to-digital conversion, conversion of the CCD signals to RGB and interpolation of the CFA data to produce RGB values at each pixel location.
Digital RGB values from the pre-processing section 34 are transformed to a set of color-corrected RGB values (RCC, GCC, BCC) suitable for display on the color CRT display 17 by processing in a color matrix operation 40. In this embodiment of the invention, the color-correction matrix 40 operation is performed external to the camera as is shown in FIG. 3 in, for example, the digital processor 12 shown in FIG. 8. Therefore, the RGB signals and the matrix coefficients are provided to the external digital processor 12 via interface liens 37a and b. In a second version of the preferred embodiment of this invention, the color-correction matrix 40 operation is performed internal to the camera as illustrated in FIG. 4. Where this step is performed is not important to the teaching of this invention. In either case the color-correction matrix 40 operation is performed on RGB signals which vary linearly with exposure.
Color-corrected RGB signals (RCC, GCC, BCC) following the color-correction matrix 40 operation are converted to a format suitable for CRT display by a post-processing section 50 using techniques and components familiar to those skilled in the art. Such post processing operations may include such tasks as interpolation, edge-enhancement and tone-scale remapping, for example.
In the preferred embodiment of this invention as shown in FIGS. 3 and 4, the color-correction matrix coefficients for the color matrix operation 40 are stored in a digital memory 36 co-located on the optical sub-assembly 20 with all of the other optical components. These coefficients are uniquely determined for each camera in order to correct the spectral sensitivities of the particular CCD imager 28 in the camera 10, and the spectral characteristics of the particular other elements in the optical subassembly 20, for the color sensitivities of the type of output device being used. (For this reason, while representing a specific imaging device, the coefficients are ordinarily calculated in relation to a reference output device, rather than a specific individual output device.) These coefficients are then applied to the color matrix operation 40 for color correction of the capture image. This approach has advantages in the production and service environments. In the production environment, optical sub-assemblies 20 can be fabricated, calibrated and stocked for later integration into the final product 10 without the need for calibrating the final product. In the service environment, since the optical subassembly is replaceably interconnected to the preprocessing section 34 through the electrical connecting means 35, optical sub-assemblies 20 can be simply replaced without the need for calibrating the repaired product. Since each optical subassembly 20 is calibrated for the particular optical components on the subassembly, it may be appreciated that the matrix coefficients stored in the memory 36 are unique for each subassembly 20, and therefore for each camera 10.
Note that, although RGB signals have been discussed by way of example as the tristimulus format of choice for representing the scene color information, this invention is not restricted to use with this format alone. Other tristimulus formats such as the CIE XYZ format are equally applicable and may, in fact, present advantages in a particular implementation. Sin the CIE XYZ format is a device independent space based on a set of CMFs defined by the CIE 1931 Standard Colorimetric Observer (2°), the matrix coefficients cold be used to generate an input profile unique to each camera which will correct the spectral sensitivities of the camera for the standardized CMFs of this device independent space. For example, in one application following the ICC Profile Format Specification (Version 3.2, Nov. 20, 1995, published by the International Color Consortium), RGB input profiles are established which will correct the spectral sensitivities of an input device for a connection space. Thereupon, output profiles are used to convert the signals from the connection space to a format that is expected by an output device. It should therefore be understood that this invention encompasses linear tristimulus formats in general while the discussion is limited to the familiar RG format for ease of understanding.
FIG. 5 illustrates a third embodiment of the invention wherein the color-correction matrix coefficients for the matrix operation 40 are stored in a digital memory 38 located somewhere within the camera 10 but not necessarily on the optical sub-assembly 20. In this embodiment, the aforementioned advantages in the production and service environment are not realizable for the color reproduction accuracy and consistency goals of the invention are not compromised.
FIG. 6 illustrates a fourth embodiment of the invention wherein the lens 22 is not physically part of the optical sub-assembly and many, in fact, be removable as is the case of a camera with interchangeable lenses. In this situation the camera of optical sub-assembly, depending on where the color-coefficient matrix digital memory 38 is located, is calibrated using a lens with a spectral response representing the average of the spectral responses of all lenses that are anticipated to be used with the camera. This represents only a slight compromise since the lens does not contribute significantly to variations in color reproduction performance.
The present invention has been described thus far with regard to a series of preferred embodiments outlining the location of the color-correction matrix coefficients within the camera as well as their application in the image processing path. FIG. 7 illustrates a general method for obtaining these coefficients. A color chart 72 containing colors representative of the expected range of real wold colors provides the basis for the coefficients calculation process. An example of such a chart is the well known Macbeth Color Checker.
A necessary first step involves measurement of the spectral characteristics (Sλ) of the illuminant 74 as well as measurements of the spectral characteristics (Riλ) of each color patch of the color chart 72. CIE tristimulus values (XYZ), describing the location of a particular color patch in the 3-dimensional XYZ color pace, may then be computed form the measured optical spectral data as described in the aforementioned CIE publication 15.2 (1986) Colorimetry—Second Edition on pages 22-23. This set of XYZ values becomes the colorimetric aims for the camera.
The electronic camera 10 is used to capture an image of the color chart 72 under the specified illuminant 74. RGB camera signals representative of the captured color chart images are next subjected to a normalization process 78 to provide RGB signal switch vary linearly with scene luminance. The normalization process 78 may include removal of the camera gramma/knee characteristics as well as black-level, white-balance and exposure errors.
Linear RGB signals are transformed to a set of color-corrected TGB signals by color-correction matrix transformation 79. Initially this matrix is set equal to the identity matrix. The coefficients are subsequently adjusted in an iterative fashion by a regression process 80 until the average color error for all color patches of the color chart 72 is reduced to a predetermined level.
Color-corrected RGB signals from color-correction matrix transmission 79 are retransformed to a set of CIE XYZ signals by CRT phosphor matrix transformation 84. These signals represent the colors which would appear on the face of a reference CRT when presented with the color-corrected RGB signals from color-correction matrix transformation 79. It would be understood by someone skilled in the art that these color-corrected signals would first need to be modified to account for the nonlinear characteristics of the CRT phosphors. The resulting XYZ signals from CRT phosphor transformation matrix 84 representing the reproduced colors for each color patch of the color chart 72 for a reference output device, in this case the reference CRT.
An error calculation process 82 determines the average error between the aim and reproduction signals for all of the color patches on the color chart 72. An individual color error is first computed for each color patch using the square-root of the sum of the squares of the differences of the aim and reproduction X, Y and Z signals. This represents the vector length between the location of the aim and reproduction colors in the 3-dimensional XYZ color space. The last part of the error calculation is to average the individual color errors. This average color error is used in the regression process 80.
The foregoing matrix coefficient coloration process has been described from the standpoint of obtaining a good colorimetric match between the original scene and its reproduction on a CRT. For some application this may not be the desired color reproduction goal. Modification to the method shown in FIG. 7 may be made to achieve a preferred color reproduction goal by taking into account such factors as chromatic adaptation and more perceptually uniform color spaces.
The invention has been described with reference to a preferred embodiment. However, it will be appreciated that variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of the invention.
PARTS LIST
  • 10 Electronic camera
  • 11 Electronic scanner
  • 12 Image processing external to camera (peripheral digital processor)
  • 13 Interface cable
  • 14 Digital interface
  • 15 Memory card, removable
  • 16 Card reader
  • 17 Color CRT display
  • 18 Printer, color
  • 18a Color print
  • 19 Keyboard
  • 20 Optical sub-assembly
  • 22 Lens
  • 24 Infra-red cutoff filter
  • 26 Blur filter
  • 28 CCD Imager
  • 30 Color filter array (CFA)
  • 32 Scene
  • 34 Camera video pre-processing section
  • 36 Color-correction matrix coefficient memory on optical subassembly
  • 38 Color-correction matrix coefficient memory in camera
  • 40 Color-correction matrix transformation
  • 50 Post-processing section
  • 72 Color chart
  • 74 Illuminant
  • 76 XYZ calculation process
  • 78 Normalization process
  • 79 Color-correction matrix transformation
  • 80 Regression process
  • 82 Color error calculation process

Claims (33)

1. A digital imaging device for capturing an image and generating a color signal from the image for application to an output device having specific color sensitivities, said imaging device further being one of many devices of the same type useful with the output device, said digital imaging device comprising:
a color sensor for capturing the image and generating the color signal from the captured image, said color sensor having predetermined spectral sensitivities;
an optical section having predetermined spectral characteristics, said optical section interposed in image light from the image directed to the color sensor thereby imparting the predetermined spectral characteristics to the image light, the combination of the spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguishing the imaging device from other imaging devices of the same type; and
a set of matrix coefficients uniquely determined for the imaging device in order to generate an optimized color signal, wherein said matrix coefficients are (a) automatically calculated by a matrix coefficient calculation from image data obtained by the color sensor from a color chart and (b) used for correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the output device.
2. An imaging device as claimed in claim 1 in which the optical section includes a lens for directing the image light from the image upon the color sensor, said lens having a predetermined lens spectral characteristic, and wherein the matrix coefficients correct the lens spectral characteristic for the color sensitivities of the output device.
3. An imaging device as claimed in claim 1 in which the optical section includes a blurry filter for spatially low pass filtering the image light directed upon the color sensor, said blur filter having a predetermined spectral characteristic, and wherein the matrix coefficients correct the spectral characteristic for the color sensitivities of the output device.
4. An imaging device as claimed in claim 1 in which the optical section includes an infrared cutoff filter for filtering the image light directed upon the color sensor, said infrared cutoff filter having a predetermined infrared spectral characteristic, and wherein the matrix coefficients correct the infrared spectral characteristic for the color sensitivities of the output device.
5. An imaging device as claimed in claim 1 wherein the color sensor includes a color filter array for color filtering the image light directed upon the color sensor, said color filter array having a predetermined color filter spectral characteristic, and wherein the matrix coefficients correct the color filter spectral characteristic for the color sensitivities of the display device.
6. An imaging device as claimed in claim 1 wherein the imaging device comprises a digital camera.
7. An imaging device as claimed in claim 1 wherein the imaging device comprises a digital scanner.
8. An imaging device as claimed in claim 1 wherein the output device comprises a display device.
9. An imaging device as claimed in claim 1 wherein the output device comprises a printing device.
10. An imaging device as claimed in claim 1 further comprising a color processing section for implementing a matrix coefficient on the color signal in order to generate the optimized color signal, said color processing section using the set of matrix coefficients that are uniquely determined for the imaging device in order to generate the optimized color signal.
11. An imaging device as claimed in claim 1 in which the optical section and the set of matrix, coefficients are included on a sub-assembly that is removable from the digital imaging device for purpose of servicing and repair of the imaging device.
12. An imaging device as claimed in claim 1 in which the output device is a reference device, and said matrix coefficients correct the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the reference color sensitivities of the output device.
13. An electronic imaging system including a component useful with an imaging device as claimed in claim 1, wherein the computer comprises a color processing section for implementing a matrix connection on thee color signal using the set of matrix coefficients in order to generate the optimized color signal, and the imaging device provides the color signal together with the matrix coefficients to the computer.
14. An imaging device as claimed in claim 1 in which the optical section includes a lens for directing the image light from the image upon the color sensor, said lens being removable from the imaging device and having a predetermined reference lens spectral characteristic, and wherein the matrix coefficients correct the reference lens spectral characteristic for the color sensitivities of the output device.
15. An imaging device as claimed in claim 1 in which the output device is represented by a connection space, and said matrix coefficients are part of a device profile for connecting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the connection space.
16. A digital camera for capturing an image and generating a color signal from the image for input to an intended display device having specific color sensitivities, said camera further being one of many cameras of the same type useful with the display device, said camera comprising:
a color sensor for capturing the image and generating the color signal from the captured image, said color sensor having predetermined spectral sensitivities defining the color response of the color sensor;
a lens for directing image light from the image upon the color sensor, said lens having a predetermined lens spectral characteristic;
an infrared cutoff filter having a predetermined infrared spectral characteristic for filtering the image light directed upon the color sensor;
the combination of said spectral sensitivities of the color sensor and the spectral characteristics of the lens and the infrared cutoff filter uniquely distinguishing the digital camera from other digital cameras of the same type; and
a matrix storage containing a set of matrix coefficients uniquely determined for the camera in order to generate an optimized color signal, wherein said matrix coefficients are (a) automatically calculated by a matrix coefficient calculation from image data obtained by the color sensor from a color chart and (b) used for correcting the spectral sensitivities of the color sensor and the spectral characteristics of the lens and the infrared cutoff filter for the color sensitivities of the intended display device.
17. A digital camera as claimed in claim 16 further comprising a blur filter having a predetermined low pass spatial characteristic for low pass filtering the image light directed upon the color sensor, and wherein the matrix coefficients further correct the spectral characteristic of the blur filter for the color sensitivities of the intended display device.
18. A digital camera as claimed in claim 16 wherein the color sensor includes a color filter array for color filtering the image light directed upon the color sensor, said color filter array having a predetermined color filter spectral characteristics, and wherein the matrix coefficients correct the spectral characteristic of the color filter array for the color sensitivities of the intended display device.
19. A digital camera as claimed in claim 16 further comprising a color processing section for implementing a matrix correction of the color signal in order to generate the optimized color signal, said color processing section using the set of matrix coefficients in the matrix storage that are uniquely determined for this digital camera in order to generate the optimized color signal.
20. An electronic imaging system including a computer useful with a digital camera as claimed in claim 16, wherein the computer comprises a color processing section for implementing a matrix correction on the color signal using the set of matrix coefficients in the matrix storage in order to generate the optimized color signal, and the digital camera provides the color signal together with the matrix coefficients to the computer.
21. A digital camera for capturing an image and generating an optimized color signal from the image for input to an intended display device having specific color sensitivities, said camera further being one of many cameras of the same type useful with the display device, said camera comprising:
a color sensor comprising a color filter array and a photosensor for capturing the image and generating a color signal from the captured image, said color sensor having predetermined spectral sensitivities defining the color response of a specific color sensor employed in the digital camera;
an optical section including at least a lens for directing image light from the image upon the color sensor and an infrared cutoff filter for filtering the image light directed upon the color sensor, said optical section having optical spectral characteristics comprised of a specific lens spectral characteristic which together define the optical response of a specific optical section employed in the digital camera;
the combination of said spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguishing the digital camera from other digital cameras of the same type;
a memory containing matrix coefficients uniquely determined by a matrix coefficient calculation for use by the camera in order to generate the optimized color signal, wherein said matrix coefficients are (a) automatically computed from image data obtained by the color sensor from a color chart and (b) used for correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the intended display device; and
a color processing section for implementing a matrix correction on the color signal using the matrix coefficients in the memory in order to generate the optimized color signal.
22. A digital camera as claimed in claim 21 wherein said optical section further includes a blur filter for spatially low pass filtering the image light directed upon the color sensor, said blur filter having a predetermined spectral characteristic, and wherein the matrix coefficients further correct the spectral characteristic of the blur filter for the color sensitivities of the intended display device.
23. A digital camera for capturing an image and generating a color signal from the image for input through an external processor to an intended display device having specific color sensitivities, said external processor including a color processing section for implementing a matrix correction on the color signal in order to generate an optimized color signal, said camera further being one of many cameras of the same type useful with the display device, said camera comprising:
a color sensor comprising a color filter array and a photosensor for capturing the image and generating the color signal from the captured image, said color sensor having predetermined spectral sensitivities defining the color response of the sensor;
an optical section including at least a lens for directing image light from the image upon the color sensor and an infrared cutoff filter for filtering the image light directed upon the color sensor, said optical section having optical spectral characteristics comprised of a specific lens spectral characteristic which together define the optical response of a specific optical section employed in the digital camera;
the combination of said spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguishing the digital camera from other digital cameras of the same type;
a memory containing matrix coefficients uniquely determined for the camera in order to generate the optimized color signal, wherein said matrix coefficients are (a) automatically calculated by a matrix coefficient calculation from image data obtained by the color sensor from a color chart and (b) used for correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the intended display device; and
means for providing the color signal and the matrix coefficients to the external processor.
24. A digital camera as claimed in claim 23 wherein said optical section further includes a blur filter for spatially low pass filtering the image light directed upon the color sensor, said blur filter having a predetermined spectral characteristic controlling the response of the optical section, and wherein the matrix coefficients further correct the spectral characteristics of the filter for the color sensitivities of the intended display device.
25. A digital camera for capturing an image and generating a color signal from the captured image, said camera comprising:
a main assembly for housing the camera; and
a removable subassembly including a color sensor having specific color sensitivities for capturing the image and generating the color signal, an optical section including at least a lens and an infrared filter having respective lens and cutoff spectral characteristics, and a memory device containing matrix coefficients for color correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the display device;
a signal processing section for processing the color signal generated by the color sensor;
electrical connecting means for replaceably interconnecting the signal processing section and the subassembly; and
a color processing section for implementing a matrix correction on the color signal using the matrix coefficients in the memory device in order to generate an optimized color signal.
26. A digital camera for capturing an image and outputting a color image signal to an external processor, said external processor including a color processing section for implementing a matrix correction on the color image signal in order to generate an optimized color signal from the captured image, said camera comprising:
a main assembly for housing the camera;
a removable subassembly including a color sensor having specific color sensitivities for capturing the image and generating a color signal, an optical section including at least a lens and an infrared filter having respective lens and cutoff spectral characteristics, and a memory device containing matrix coefficients for color correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the display device;
a signal processing section for processing the color signal generated by the color sensor;
electrical connecting means for replaceably interconnecting the signal processing section and the subassembly; and
means for providing the color image signal and the matrix coefficients to the external processor.
27. A digital camera for capturing an image and generating a color signal from the image for input through an external processor operative in a connection space having specific color sensitivities defined by a set of color matching functions, said external processor including a color processing section for implementing a matrix correction on the color signal in order to generate an optimized color signal, said camera further being one of many cameras of the same type, said camera comprising:
a color sensor comprising a color filter array and a photosensor for capturing the image and generating the color signal from the captured image, said color sensor having predetermined spectral sensitivities defining the color response of the sensor;
an optical section including at least a lens for directing image light from the image upon the color sensor and an infrared cutoff filter for filtering the image light directed upon the color sensor, aid optical section having optical spectral characteristics comprised of a specific lens spectral characteristics which together define the optical response of a specific optical section employed in the digital camera;
the combination of said spectral sensitivities of the color sensor and the spectral characteristics of the optical section uniquely distinguishing the digital camera from other digital cameras of the same type;
a memory containing matrix coefficients uniquely determined for the camera in order to generate the optimized color signal, wherein said matrix coefficients being are (a) automatically calculated by a matrix coefficient calculation from image data obtained by the color sensor from a color chart and (b) used as part of a device profile for correcting the spectral sensitivities of the color sensor and the spectral characteristics of the optical section for the color sensitivities of the connection space; and
means for providing the color signal and the matrix coefficients to the external processor.
28. A digital camera as claimed in claim 27 wherein said optical section further includes a blur filter for spatially low pass filtering the image light directed upon the color sensor, said blur filter having a predetermined spectral characteristic controlling the response of the optical section, and wherein the matrix coefficients further correct the spectral characteristic of the blur filter for the color sensitivities of the connection space.
29. An imaging device as claimed in claim 1 wherein the matrix coefficient calculation comprises processing blocks for (a) measuring spectral characteristics of colors of the color chart as illuminated by an illuminant and computing colorimetric values for each color/illuminant combination from the measured spectral characteristics, thereby obtaining a set of colorimetric aims for the imaging device, (b) capturing an image of the color chart by using the color sensor, thereby obtaining color image data representative of the image of the color chart, (c) processing the color image data in a color-correction matrix comprising a set of adjustable, color-correction coefficients and generating reproduction signals for the colors of the color chart, and (d) iteratively adjusting the adjustable, color-correction coefficients until the error between the reproduction signals and the colorimetric aims is reduced to a predetermined level.
30. A digital camera as claimed in claim 16 wherein the matrix coefficient calculation comprises processing blocks for (a) measuring spectral characteristics of colors of the color chart as illuminated by an illuminant and computing colorimetric values for each color/illuminant combination from the measured spectral characteristics, thereby obtaining a set of colorimetric aims for the imaging device, (b) capturing an image of the color chart by using the color sensor, thereby obtaining color image data representative of the image of the color chart, (c) processing the color image data in a color-correction matrix comprising a set of adjustable, color-correction coefficients and generating reproduction signals for the colors of the color chart, and (d) iteratively adjusting the adjustable, color-correction coefficients until the error between the reproduction signals and the colorimetric aims is reduced to a predetermined level.
31. A digital camera as claimed in claim 21 wherein the matrix coefficient calculation comprises processing blocks for (a) measuring spectral characteristics of colors of the color chart as illuminated by an illuminant and computing colorimetric values for each color/illuminant combination from the measured spectral characteristics, thereby obtaining a set of colorimetric aims for the imaging device, (b) capturing an image of the color chart by using the color sensor, thereby obtaining color image data representative of the image of the color chart, (c) processing the color image data in a color-correction matrix comprising a set of adjustable, color-correction coefficients and generating reproduction signals for the colors of the color chart, and (d) iteratively adjusting the adjustable, color-correction coefficients until the error between the reproduction signals and the colorimetric aims is reduced to a predetermined level.
32. A digital camera as claimed in claim 23 wherein the matrix coefficient calculation comprises processing blocks for (a) measuring spectral characteristics of colors of the color chart as illuminated by an illuminant and computing colorimetric values for each color/illuminant combination from the measured spectral characteristics, thereby obtaining a set of colorimetric aims for the imaging device, (b) capturing an image of the color chart by using the color sensor, thereby obtaining color image data representative of the image of the color chart, (c) processing the color image data in a color-correction matrix comprising a set of adjustable, color-correction coefficients and generating reproduction signals for the colors of the color chart, and (d) iteratively adjusting the adjustable, color-correction coefficients until the error between the reproduction signals and the colorimetric aims is reduced to a predetermined level.
33. A digital camera as claimed in claim 27 wherein the matrix coefficient calculation comprises processing blocks for (a) measuring spectral characteristics of colors of the color chart as illuminated by an illuminant and computing colorimetric values for each color-illuminant combination from the measured spectral characteristics, thereby obtaining a set of colorimetric aims for the imaging device, (b) capturing an image of the color chart by using the color sensor, thereby obtaining color image data representative of the image of the color chart, (c) processing the color image data in a color-correction matrix comprising a set of adjustable, color-correction coefficients and generating reproduction signals for the colors of the color chart, and (d) iteratively adjusting the adjustable, color-correction coefficients until the error between the reproduction signals and the colorimetric aims is reduced to a predetermined level.
US11/405,920 1996-02-29 2006-04-17 Digital imaging device optimized for color performance Expired - Lifetime USRE39712E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/405,920 USRE39712E1 (en) 1996-02-29 2006-04-17 Digital imaging device optimized for color performance

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/608,649 US5668596A (en) 1996-02-29 1996-02-29 Digital imaging device optimized for color performance
US11/405,920 USRE39712E1 (en) 1996-02-29 2006-04-17 Digital imaging device optimized for color performance

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US08/608,649 Reissue US5668596A (en) 1996-02-29 1996-02-29 Digital imaging device optimized for color performance

Publications (1)

Publication Number Publication Date
USRE39712E1 true USRE39712E1 (en) 2007-07-03

Family

ID=24437414

Family Applications (2)

Application Number Title Priority Date Filing Date
US08/608,649 Ceased US5668596A (en) 1996-02-29 1996-02-29 Digital imaging device optimized for color performance
US11/405,920 Expired - Lifetime USRE39712E1 (en) 1996-02-29 2006-04-17 Digital imaging device optimized for color performance

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US08/608,649 Ceased US5668596A (en) 1996-02-29 1996-02-29 Digital imaging device optimized for color performance

Country Status (1)

Country Link
US (2) US5668596A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030052980A1 (en) * 2001-08-07 2003-03-20 Brown Wade W. Calibration of digital color imagery
US20060197775A1 (en) * 2005-03-07 2006-09-07 Michael Neal Virtual monitor system having lab-quality color accuracy
US20060250668A1 (en) * 2004-01-13 2006-11-09 Olympus Corporation Color chart processing apparatus, color chart processing method, and color chart processing program
US20080062546A1 (en) * 2006-08-22 2008-03-13 Texas Instruments Incorporated Dynamic aperture for a light processing system
US20100079503A1 (en) * 2008-09-30 2010-04-01 Texas Instruments Incorporated Color Correction Based on Light Intensity in Imaging Systems
US20110032380A1 (en) * 2009-08-10 2011-02-10 Canon Kabushiki Kaisha Printing system and method
US9106936B2 (en) 2012-01-25 2015-08-11 Altera Corporation Raw format image data processing
US9172848B2 (en) * 2014-02-28 2015-10-27 Fuji Xerox Co., Ltd. Image reader for correcting an image
US11893770B2 (en) * 2020-09-29 2024-02-06 Beijing Zitiao Network Technology Co., Ltd. Method for converting a picture into a video, device, and storage medium

Families Citing this family (135)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2298100A (en) * 1995-02-07 1996-08-21 Peng Seng Toh High resolution video imaging system for simultaneous acquisition of two high aspect ratio object fields
JPH099270A (en) * 1995-06-23 1997-01-10 Sony Corp Video camera and video camera apparatus
US6160579A (en) * 1995-08-01 2000-12-12 Canon Kabushiki Kaisha Image processing apparatus and method
US6184925B1 (en) * 1996-04-11 2001-02-06 Asahi Kogaku Kogyo Kabushiki Kaisha Lens having color correction data
FR2749077B1 (en) * 1996-05-23 1999-08-06 Oreal COLOR MEASURING METHOD AND DEVICE
US5852502A (en) * 1996-05-31 1998-12-22 American Digital Imaging, Inc. Apparatus and method for digital camera and recorder having a high resolution color composite image output
JP3661817B2 (en) * 1996-09-03 2005-06-22 ソニー株式会社 Color correction apparatus, color correction control apparatus, and color correction system
US6278533B1 (en) 1996-11-29 2001-08-21 Fuji Photo Film Co., Ltd. Method of processing image signal
US6243133B1 (en) * 1997-03-07 2001-06-05 Eastman Kodak Company Method for automatic scene balance of digital images
AUPO799197A0 (en) * 1997-07-15 1997-08-07 Silverbrook Research Pty Ltd Image processing method and apparatus (ART01)
US5917556A (en) * 1997-03-19 1999-06-29 Eastman Kodak Company Split white balance processing of a color image
JPH10285610A (en) * 1997-04-01 1998-10-23 Sony Corp Color correction device and color correction controller
US7212229B2 (en) * 1997-04-04 2007-05-01 Eastman Kodak Company Digital camera providing image processing for an attachable printer
US7382379B1 (en) * 1997-06-27 2008-06-03 Eastman Kodak Company Arrangement for mapping colors between imaging systems and method thereof
JP3786242B2 (en) * 1997-07-14 2006-06-14 富士写真フイルム株式会社 Image processing method and apparatus, image reproduction method and apparatus, and image confirmation apparatus used in the method
US20030169344A1 (en) * 1997-07-15 2003-09-11 Kia Silverbrook Method of modifying a sensed image
JP3843170B2 (en) * 1997-08-25 2006-11-08 富士写真フイルム株式会社 Color correction function setting method
WO1999018719A1 (en) * 1997-10-07 1999-04-15 Sony Electronics Inc. Method of and apparatus for transmitting scaled and compressed raw ccd video data from a video camera
US6686961B1 (en) * 1997-11-07 2004-02-03 Minolta Co., Ltd. Image pickup apparatus
US6285398B1 (en) 1997-11-17 2001-09-04 Sony Corporation Charge-coupled device video camera with raw data format output and software implemented camera signal processing
EP1210816A4 (en) * 1998-02-27 2002-06-05 Liberty Imaging Inc High definition television camera and formatter
US6567119B1 (en) * 1998-03-26 2003-05-20 Eastman Kodak Company Digital imaging system and file format for storage and selective transmission of processed and unprocessed image data
US7453498B2 (en) * 1998-03-26 2008-11-18 Eastman Kodak Company Electronic image capture device and image file format providing raw and processed image data
WO1999055076A1 (en) * 1998-04-23 1999-10-28 Tv Photo Viewers, Inc. A device for viewing a photographic image through a television set
US6606120B1 (en) 1998-04-24 2003-08-12 Foveon, Inc. Multiple storage node full color active pixel sensors
US5965875A (en) * 1998-04-24 1999-10-12 Foveon, Inc. Color separation in an active pixel cell imaging array using a triple-well structure
US20030038885A1 (en) * 1998-05-21 2003-02-27 Nestor M. Rodriguez Wide gamut motion image capture process for post production applications
US7157302B2 (en) * 1998-06-04 2007-01-02 Micron Technology, Inc. Imaging device and method of manufacture
US6410899B1 (en) 1998-06-17 2002-06-25 Foveon, Inc. Active pixel sensor with bootstrap amplification and reduced leakage during readout
US6205244B1 (en) * 1998-06-23 2001-03-20 Intel Corporation Method for imager device color calibration utilizing light-emitting diodes or other spectral light sources
US6430313B1 (en) * 1998-09-10 2002-08-06 Intel Corporation Using a minimal number of parameters for correcting the response of color image sensors
WO2000016249A1 (en) * 1998-09-14 2000-03-23 University Of Utah Research Foundation Method of digital image enhancement and sharpening
US6879735B1 (en) 1998-09-14 2005-04-12 University Of Utah Reasearch Foundation Method of digital image enhancement and sharpening
KR100277829B1 (en) 1998-10-15 2001-01-15 정선종 Color correction device and method for minimizing the mystery of a color scanner
KR100278642B1 (en) * 1998-10-22 2001-01-15 윤종용 Color image processing apparatus and method
JP4311794B2 (en) * 1999-01-29 2009-08-12 オリンパス株式会社 Image processing apparatus and recording medium storing image processing program
US6762791B1 (en) 1999-02-16 2004-07-13 Robert W. Schuetzle Method for processing digital images
JP4327928B2 (en) * 1999-02-26 2009-09-09 メディア・テック・ユーエスエイ・インコーポレーテッド Electronic camera device
US6252220B1 (en) 1999-04-26 2001-06-26 Xerox Corporation Sensor cover glass with infrared filter
US6727521B2 (en) 2000-09-25 2004-04-27 Foveon, Inc. Vertical color filter detector group and array
US6731397B1 (en) 1999-05-21 2004-05-04 Foveon, Inc. Method for storing and retrieving digital image data from an imaging array
JP4274632B2 (en) * 1999-05-25 2009-06-10 オリンパス株式会社 Color reproduction system
US6738502B1 (en) * 1999-06-04 2004-05-18 Kairos Scientific, Inc. Multispectral taxonomic identification
US6697114B1 (en) 1999-08-13 2004-02-24 Foveon, Inc. Triple slope pixel sensor and arry
US6519361B1 (en) * 1999-11-19 2003-02-11 Xerox Corporation Optimization of color transformation matrix with all positive coefficients
US6809768B1 (en) 2000-02-14 2004-10-26 Foveon, Inc. Double slope pixel sensor and array
US7084905B1 (en) * 2000-02-23 2006-08-01 The Trustees Of Columbia University In The City Of New York Method and apparatus for obtaining high dynamic range images
US6721000B1 (en) 2000-02-23 2004-04-13 Neomagic Corp. Adaptive pixel-level color enhancement for a digital camera
US6882367B1 (en) 2000-02-29 2005-04-19 Foveon, Inc. High-sensitivity storage pixel sensor having auto-exposure detection
JP2001275003A (en) * 2000-03-24 2001-10-05 Fuji Photo Film Co Ltd Method and device for image correction and recording medium
US6692430B2 (en) 2000-04-10 2004-02-17 C2Cure Inc. Intra vascular imaging apparatus
US7081918B2 (en) * 2000-04-28 2006-07-25 Fuji Photo Film Co., Ltd. Image processing method, image processing apparatus and recording medium storing program therefor
US6449045B1 (en) * 2000-05-01 2002-09-10 Xerox Corporation System and method from reconstruction of spectral curves using measurements for a color sensor and statistical techniques
JP4064038B2 (en) * 2000-06-09 2008-03-19 富士フイルム株式会社 Image acquisition apparatus and image acquisition method using solid-state imaging device, and recording medium on which program for executing the method is recorded
JP3561680B2 (en) * 2000-07-14 2004-09-02 三洋電機株式会社 Digital camera
US6316284B1 (en) 2000-09-07 2001-11-13 Xerox Corporation Infrared correction in color scanners
US6768565B1 (en) 2000-09-07 2004-07-27 Xerox Corporation Infrared correction in color scanners
AU2001293062A1 (en) 2000-09-25 2002-04-08 Foveon, Inc. Active pixel sensor with noise cancellation
US6864915B1 (en) 2000-10-27 2005-03-08 Eastman Kodak Company Method and apparatus for production of an image captured by an electronic motion camera/sensor that emulates the attributes/exposure content produced by a motion camera film system
JP2004513580A (en) * 2000-11-01 2004-04-30 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Processing of color signal in color camera
US6950129B1 (en) * 2000-11-22 2005-09-27 Hewlett-Packard Development Company, L.P. One-time-use digital camera
US6909463B2 (en) * 2000-12-22 2005-06-21 Eastman Kodak Company Camera having verification display and white-compensator and imaging method
US6947079B2 (en) * 2000-12-22 2005-09-20 Eastman Kodak Company Camera having verification display with reverse white balanced viewer adaptation compensation and method
US6831999B2 (en) * 2001-02-08 2004-12-14 Canon Kabushiki Kaisha Color management architecture using phantom profiles to transfer data between transformation modules
JP2002330339A (en) * 2001-02-28 2002-11-15 Canon Inc Image pickup unit, image pickup optical unit and image pickup system
JP4486762B2 (en) * 2001-03-08 2010-06-23 富士フイルム株式会社 Image photographing method and apparatus
US6960757B2 (en) * 2001-06-18 2005-11-01 Foveon, Inc. Simplified wiring schemes for vertical color filter pixel sensors
US6930336B1 (en) 2001-06-18 2005-08-16 Foveon, Inc. Vertical-color-filter detector group with trench isolation
US6864557B2 (en) * 2001-06-18 2005-03-08 Foveon, Inc. Vertical color filter detector group and array
US7265781B2 (en) * 2001-08-22 2007-09-04 Fujifilm Corporation Method and apparatus for determining a color correction matrix by minimizing a color difference maximum or average value
JP2003198860A (en) * 2001-10-18 2003-07-11 Seiko Epson Corp Color conversion method, color conversion apparatus, color conversion matrix generation method, and color conversion matrix generation program
US6987533B2 (en) * 2001-10-26 2006-01-17 Ferrand David Ernest Corley Camera reference device and method of making camera reference device
US7053935B2 (en) * 2002-02-21 2006-05-30 Eastman Kodak Company Apparatus and method for accurate electronic color capture and reproduction
DE10208285A1 (en) * 2002-02-26 2003-09-18 Koenig & Bauer Ag Process for correcting the image data of a camera system
US6750442B2 (en) * 2002-03-06 2004-06-15 Xerox Corporation Use of spectral sensors for automatic media identification and improved scanner correction
JP2003284084A (en) * 2002-03-20 2003-10-03 Sony Corp Image processing apparatus and method, and manufacturing method of image processing apparatus
US6998660B2 (en) * 2002-03-20 2006-02-14 Foveon, Inc. Vertical color filter sensor group array that emulates a pattern of single-layer sensors with efficient use of each sensor group's sensors
US7012634B2 (en) * 2002-03-28 2006-03-14 Eastman Kodak Company System and method for calibrating an image capture device
US6759814B2 (en) 2002-03-28 2004-07-06 Eastman Kodak Company Illuminator and method of making same
AU2003224415A1 (en) 2002-05-16 2003-12-02 Cbyond Inc. Miniature camera head
US7164444B1 (en) 2002-05-17 2007-01-16 Foveon, Inc. Vertical color filter detector group with highlight detector
US7312829B2 (en) * 2002-07-15 2007-12-25 Ffei Limited Method of determining a device spectral response
US7289663B2 (en) * 2002-07-24 2007-10-30 Eastman Kodak Company Producing an extended color gamut luminance-chrominance digital image from a captured image
JP2004096508A (en) * 2002-08-30 2004-03-25 Konica Minolta Holdings Inc Image processing method, image processing apparatus, image recording apparatus, program, and recording medium
DE10242037A1 (en) * 2002-09-11 2004-03-25 Bts Media Solutions Gmbh Color video signal correction device using correction matrix with matrix coefficients adjusted dependent on color tones represented by video signals
US7502066B1 (en) * 2002-11-05 2009-03-10 Foveon, Inc. Methods for manufacturing and testing image sensing devices
US7453129B2 (en) * 2002-12-18 2008-11-18 Noble Peak Vision Corp. Image sensor comprising isolated germanium photodetectors integrated with a silicon substrate and silicon circuitry
US20040119860A1 (en) * 2002-12-23 2004-06-24 Eastman Kodak Company Method of colorimetrically calibrating an image capturing device
JP3861808B2 (en) * 2002-12-25 2006-12-27 ソニー株式会社 Imaging device
US7339216B1 (en) 2003-01-31 2008-03-04 Foveon, Inc. Vertical color filter sensor group array with full-resolution top layer and lower-resolution lower layer
US7262779B1 (en) * 2003-04-10 2007-08-28 Applied Vision Company, Llc Differential imaging colorimeter
US6927855B2 (en) * 2003-05-01 2005-08-09 Fujifilm Electronic Imaging Limited Method of determining an image recording device characterization
JP4022644B2 (en) * 2003-06-06 2007-12-19 株式会社ニコン Image file reading method and image file reading device
JP2005079834A (en) * 2003-08-29 2005-03-24 Pentax Corp Method for calculating color conversion matrix and image signal processing unit
US7844109B2 (en) * 2003-09-24 2010-11-30 Canon Kabushiki Kaisha Image processing method and apparatus
US7636468B2 (en) * 2003-11-10 2009-12-22 Microsoft Corporation System for customer and automatic color management using policy controls
US7383261B2 (en) * 2004-01-16 2008-06-03 Xerox Corporation Reference database and method for determining spectra using measurements from an LED color sensor, and method of generating a reference database
GB2430105B (en) * 2004-04-05 2009-09-23 Mitsubishi Electric Corp Imaging device
US20050280842A1 (en) * 2004-06-16 2005-12-22 Eastman Kodak Company Wide gamut film system for motion image capture
US20050280881A1 (en) * 2004-06-18 2005-12-22 Microsoft Corporation System and method for determination of a white point for calibration of an image capturing device
US7423677B2 (en) * 2004-07-27 2008-09-09 Avago Technologies Ecbu Ip Pte Ltd Color filter method and apparatus
US7477304B2 (en) * 2004-08-26 2009-01-13 Micron Technology, Inc. Two narrow band and one wide band color filter for increasing color image sensor sensitivity
JP4501634B2 (en) * 2004-10-29 2010-07-14 富士フイルム株式会社 Matrix coefficient determination method and image input apparatus
US7400022B2 (en) * 2004-12-17 2008-07-15 Unique Ic's Photoreceiver cell with color separation
US7471385B2 (en) * 2005-01-13 2008-12-30 Xerox Corporation Systems and methods for selecting a reference database for determining a spectrum of an object based on fluorescence of the object
US7274428B2 (en) 2005-03-24 2007-09-25 Eastman Kodak Company System and method for processing images to emulate film tonescale and color
JP4304623B2 (en) * 2005-06-01 2009-07-29 ソニー株式会社 Imaging apparatus and method of processing imaging result in imaging apparatus
US7800698B2 (en) * 2006-04-27 2010-09-21 Qualcomm Incorporated Weight adjustment in color correction
US7643175B2 (en) * 2006-12-14 2010-01-05 Eastman Kodak Company Color print enhancement system with conversion of PCS encoded picture into photographic process confined PCS and correction for finish
TWI377847B (en) * 2006-12-27 2012-11-21 Quanta Comp Inc Method and apparatus for image processing
US7602430B1 (en) 2007-04-18 2009-10-13 Foveon, Inc. High-gain multicolor pixel sensor with reset noise cancellation
US8077205B2 (en) * 2007-06-14 2011-12-13 Sony Corporation Adaptive prediction of calibration parameters for color imaging devices
US7847822B2 (en) * 2007-06-14 2010-12-07 Sony Corporation Sequential regression for calibration from residues
US7782367B2 (en) 2007-06-14 2010-08-24 Sony Corporation Direct calibration of color imaging devices
US8059183B2 (en) * 2007-11-16 2011-11-15 Canon Kabushiki Kaisha Image sensing apparatus and method for controlling the same
JP5090146B2 (en) * 2007-12-06 2012-12-05 オリンパス株式会社 Color conversion coefficient calculation device, color conversion coefficient calculation program, and color conversion coefficient calculation method
US7745773B1 (en) 2008-04-11 2010-06-29 Foveon, Inc. Multi-color CMOS pixel sensor with shared row wiring and dual output lines
US8300933B2 (en) * 2009-07-27 2012-10-30 Himax Imaging, Inc. System and method of generating color correction matrix for an image sensor
JP5874116B2 (en) * 2009-07-30 2016-03-02 国立研究開発法人産業技術総合研究所 Image photographing apparatus and image photographing method
US8358318B2 (en) * 2009-07-31 2013-01-22 Eastman Kodak Company Method for reproducing an image on an imaging device
DE102010003039A1 (en) 2010-03-18 2011-09-22 Basler Ag Saturation Setting
EP2383974B1 (en) 2010-04-30 2012-10-03 Basler AG Image processing tool, in particular in a colour camera, with universal colour operator
JP5766491B2 (en) * 2011-04-11 2015-08-19 株式会社Joled Luminescent panel, display device and electronic device
JP5899894B2 (en) * 2011-12-19 2016-04-06 富士通株式会社 Imaging apparatus, image processing apparatus, image processing program, and image processing method
US8929654B2 (en) 2011-12-28 2015-01-06 Dolby Laboratories Licensing Corporation Spectral image processing
US9257763B2 (en) 2013-07-02 2016-02-09 Gyrus Acmi, Inc. Hybrid interconnect
US9510739B2 (en) 2013-07-12 2016-12-06 Gyrus Acmi, Inc. Endoscope small imaging system
JP6069593B2 (en) * 2013-10-28 2017-02-01 ドルビー ラボラトリーズ ライセンシング コーポレイション Two-dimensional color conversion for wide color gamut workflow in digital cameras
KR102103730B1 (en) * 2013-11-19 2020-06-01 삼성디스플레이 주식회사 Display driving device and display device including the same
CN104897374B (en) * 2015-06-16 2016-04-13 常州千明智能照明科技有限公司 A kind of color calibration method of camera module
CN108282647B (en) * 2018-01-31 2019-11-05 上海小蚁科技有限公司 Color correcting method and device, computer readable storage medium, terminal
DE102018106875B4 (en) 2018-03-22 2020-01-23 Basler Ag Determine color correction parameters
DE102018106873B3 (en) 2018-03-22 2019-07-04 Basler Ag Determining color values corrected for inhomogeneous brightness recording
CN110459641A (en) * 2019-06-26 2019-11-15 杭州芯河光电科技有限公司 A kind of photodetection chip and a kind of photodetector
CN113965739B (en) * 2020-12-23 2023-07-25 深圳市火乐科技发展有限公司 Projection equipment control method and device, medium and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5001663A (en) * 1989-05-03 1991-03-19 Eastman Kodak Company Programmable digital circuit for performing a matrix multiplication
US5016107A (en) * 1989-05-09 1991-05-14 Eastman Kodak Company Electronic still camera utilizing image compression and digital storage
US5189511A (en) * 1990-03-19 1993-02-23 Eastman Kodak Company Method and apparatus for improving the color rendition of hardcopy images from electronic cameras
US5253047A (en) * 1990-09-14 1993-10-12 Sony Corporation Color CCD imager having a system for preventing reproducibility degradation of chromatic colors
US5652643A (en) 1992-03-17 1997-07-29 Sony Corporation Photographic and video image system
US5805213A (en) * 1995-12-08 1998-09-08 Eastman Kodak Company Method and apparatus for color-correcting multi-channel signals of a digital camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5001663A (en) * 1989-05-03 1991-03-19 Eastman Kodak Company Programmable digital circuit for performing a matrix multiplication
US5016107A (en) * 1989-05-09 1991-05-14 Eastman Kodak Company Electronic still camera utilizing image compression and digital storage
US5189511A (en) * 1990-03-19 1993-02-23 Eastman Kodak Company Method and apparatus for improving the color rendition of hardcopy images from electronic cameras
US5253047A (en) * 1990-09-14 1993-10-12 Sony Corporation Color CCD imager having a system for preventing reproducibility degradation of chromatic colors
US5652643A (en) 1992-03-17 1997-07-29 Sony Corporation Photographic and video image system
US5805213A (en) * 1995-12-08 1998-09-08 Eastman Kodak Company Method and apparatus for color-correcting multi-channel signals of a digital camera

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"Color Science in Television and Display Systems" by W.N. Sproson, 1983, pp. 27-39. *
"Getting Color in Sync" Bruce Fraser. MacUser, Apr. 1996. (available Feb. 1996). *
CIE publication 15.2 (1986) "Colorimetry-Second Edition", pp. 21-24,66-67. *
ICC Profile Format Specification (Version 3.2, Nov. 20, 1995) published By The International Color Consortium, pp. 24-26. *
Service Manual CCD-TR3/TR500 for the Sony Video Hi8 Handycam, copyright 1993 -pp. 39-42 (overall block diagram), 194-208 (Camera Section Adjustments, preparations before adjustment, 7-1 to 7-1-6), 224-225 (Camera System Adjustments-15. color reproduction adjustment and 16. auto white balance reference data input).
U.S. Appl. No. 08/569,645, Spaulding et al., filed Dec. 8, 1995. *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030052980A1 (en) * 2001-08-07 2003-03-20 Brown Wade W. Calibration of digital color imagery
US7362357B2 (en) * 2001-08-07 2008-04-22 Signature Research, Inc. Calibration of digital color imagery
US7756328B2 (en) * 2004-01-13 2010-07-13 Olympus Corporation Color chart processing apparatus, color chart processing method, and color chart processing program
US20060250668A1 (en) * 2004-01-13 2006-11-09 Olympus Corporation Color chart processing apparatus, color chart processing method, and color chart processing program
US7995838B2 (en) 2004-01-13 2011-08-09 Olympus Corporation Color chart processing apparatus, color chart processing method, and color chart processing program
US20060197775A1 (en) * 2005-03-07 2006-09-07 Michael Neal Virtual monitor system having lab-quality color accuracy
US20080062546A1 (en) * 2006-08-22 2008-03-13 Texas Instruments Incorporated Dynamic aperture for a light processing system
US7532259B2 (en) 2006-08-22 2009-05-12 Texas Instruments Incorporated Dynamic aperture for a light processing system
US20100079503A1 (en) * 2008-09-30 2010-04-01 Texas Instruments Incorporated Color Correction Based on Light Intensity in Imaging Systems
US20110032380A1 (en) * 2009-08-10 2011-02-10 Canon Kabushiki Kaisha Printing system and method
US9106936B2 (en) 2012-01-25 2015-08-11 Altera Corporation Raw format image data processing
US9172848B2 (en) * 2014-02-28 2015-10-27 Fuji Xerox Co., Ltd. Image reader for correcting an image
US11893770B2 (en) * 2020-09-29 2024-02-06 Beijing Zitiao Network Technology Co., Ltd. Method for converting a picture into a video, device, and storage medium

Also Published As

Publication number Publication date
US5668596A (en) 1997-09-16

Similar Documents

Publication Publication Date Title
USRE39712E1 (en) Digital imaging device optimized for color performance
US6243133B1 (en) Method for automatic scene balance of digital images
US6654493B1 (en) Charactering and calibrating an image capture device
US6366319B1 (en) Subtractive color processing system for digital imaging
US6995791B2 (en) Automatic white balance for digital imaging
US6791716B1 (en) Color image reproduction of scenes with preferential color mapping
EP0757473B1 (en) Image processing apparatus and method
US8620074B2 (en) Image sensor apparatus and method for scene illuminant estimation
US6504952B1 (en) Image processing method and apparatus
US7409082B2 (en) Method, apparatus, and recording medium for processing image data to obtain color-balance adjusted image data based on white-balance adjusted image data
EP1467555B1 (en) Producing a balanced digital color image having minimal color errors
JP2000102042A (en) Spectral sensitivity characteristic measurement method for image pickup device and image pickup data constitution method
JP2008510382A (en) Digital color fidelity
JP2005210495A (en) Image processing apparatus, method, and program
JP4677699B2 (en) Image processing method, image processing device, photographing device evaluation method, image information storage method, and image processing system
US5422739A (en) Color expressing method, color image reading apparatus and color image processing apparatus
US6122006A (en) Method for previewing a scene before actual capture by a motion-picture camera
US6507667B1 (en) Color digital imaging apparatus having a rule-based hue-shift processor
US20040119860A1 (en) Method of colorimetrically calibrating an image capturing device
US7146040B2 (en) Automatic white balance technique
US6822677B1 (en) Method and device for adjusting white balance based on primary color signals modulated with fourth color signal obtained by fourth sensor
JP2002109523A (en) Image pickup device, optical filter group, and image data converter
JP3863773B2 (en) Image photographing method and apparatus
US7369273B2 (en) Grayscale mistracking correction for color-positive transparency film elements
JP3976562B2 (en) Color correction matrix determination method and apparatus

Legal Events

Date Code Title Description
CC Certificate of correction
FPAY Fee payment

Year of fee payment: 12

AS Assignment

Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420

Effective date: 20120215

AS Assignment

Owner name: QUALEX INC., NORTH CAROLINA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AVIATION LEASING LLC, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: NPEC INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK REALTY, INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PHILIPPINES, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FPC INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK (NEAR EAST), INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: PAKON, INC., INDIANA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PORTUGUESA LIMITED, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.,

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AMERICAS, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

AS Assignment

Owner name: INTELLECTUAL VENTURES FUND 83 LLC, NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EASTMAN KODAK COMPANY;REEL/FRAME:030304/0525

Effective date: 20130201

AS Assignment

Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:064599/0304

Effective date: 20230728