EP0264281A2 - Color-matched printing - Google Patents
Color-matched printing Download PDFInfo
- Publication number
- EP0264281A2 EP0264281A2 EP87309118A EP87309118A EP0264281A2 EP 0264281 A2 EP0264281 A2 EP 0264281A2 EP 87309118 A EP87309118 A EP 87309118A EP 87309118 A EP87309118 A EP 87309118A EP 0264281 A2 EP0264281 A2 EP 0264281A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- color
- coordinates
- coloring agents
- quantities
- original color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 78
- 238000004364 calculation method Methods 0.000 claims abstract description 15
- 239000003086 colorant Substances 0.000 claims description 320
- 230000007935 neutral effect Effects 0.000 claims description 48
- 239000000654 additive Substances 0.000 claims description 16
- 230000000996 additive effect Effects 0.000 claims description 16
- 239000000047 product Substances 0.000 description 14
- 238000013459 approach Methods 0.000 description 8
- 239000013598 vector Substances 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 7
- 238000005259 measurement Methods 0.000 description 7
- 239000000203 mixture Substances 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 238000012937 correction Methods 0.000 description 5
- 239000000976 ink Substances 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 238000001228 spectrum Methods 0.000 description 4
- 238000010521 absorption reaction Methods 0.000 description 3
- 238000001739 density measurement Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000000985 reflectance spectrum Methods 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 230000000295 complement effect Effects 0.000 description 2
- 238000007796 conventional method Methods 0.000 description 2
- 239000013256 coordination polymer Substances 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 239000000975 dye Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009499 grossing Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 239000000049 pigment Substances 0.000 description 2
- 229920006395 saturated elastomer Polymers 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000004737 colorimetric analysis Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005316 response function Methods 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
- H04N1/60—Colour correction or control
- H04N1/6058—Reduction of colour to a range of reproducible colours, e.g. to ink- reproducible colour gamut
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S347/00—Incremental printing of symbolic information
- Y10S347/90—Data processing for electrostatic recording
Definitions
- the present invention relates to producing a color which matches an original color.
- the invention may be used in printing a color which accurately matches a color displayed on a cathode-ray tube (CRT) display.
- CTR cathode-ray tube
- the CRT color signals conventionally include three color coordinates for each distinct colored feature.
- Each feature could be a picture element, or pixel, or could be any other geometric shape, according to conventional image generating techniques applicable to CRT displays, to printing processes and to other color imaging techniques.
- the three coordinates may correspond, for example, to the primary colors produced by light-emitting elements within each pixel. However, these coordinates do not correspond to the toner colors used in printing, and therefore cannot be used directly to control the printing process.
- RGB coordinates corresponding to intensities of red, green and blue (RGB), the colors detected by cone cells on the retina of the human eye. These coordinates cause the light-emitting elements to generate a CRT color additively, with light of the primary red, green and blue colors mixing to produce other colors.
- the mixture of all three primaries yields white at maximal intensity and black at minimal intensity.
- each pair of the RGB primaries mixes to produce a color which can also serve as a primary, with red and green producing yellow, red and blue producing magenta, and blue and green producing cyan.
- the range of colors, or the color space, obtainable from the RGB coordinates may thus be graphically represented as a cube, with two diagonally-opposite corners corresponding to black and white, and the intermediate corners corresponding to the primary colors, as shown in Fig. 1 of the accompanying drawings.
- Fig. 1 also shows the corners corresponding to the cyan, magenta and yellow (CMY) primary colors nearer to the white corner than the RGB primaries are, because each of the CMY primaries is produced by adding the light from two of the RGB primaries, and therefore is more intense and closer to white than the RGB primaries. This illustrates the generation of a color additively.
- CMY cyan, magenta and yellow
- a color printer In contrast to a CRT display, a color printer generates an image subtractively, by applying toners to a white medium (or a transparent medium if back-lit), each toner absorbing some light frequencies and reflecting or transmitting others to produce its characteristic color.
- the toners commonly correspond to the CMY primary colors, with application of no toner producing white, and all toners at maximal intensity producing black. Alternatively, black may be produced with a separate toner.
- the toners may be mixed by superimposing them or by mixing them in a pattern such as a dot pattern. Superimposing a pair of the CMY primaries produces an RGB primary which can also be used in printing. In general, the mixing of subtractive primaries produces colors within a space similar to the RGB color space of Fig. 1, but a mixed color produced by combining quantities of the primaries will be nearer the black corner of the color space than the same quantity of any of the primaries alone because each added primary will subtract more of the light frequencies than the white medium would.
- CRT color signals into printer color signals One technique for converting CRT color signals into printer color signals is to convert each CRT color coordinate directly into coordinates for the pair of CMY primaries which mix to produce that coordinate. This does not accurately reproduce the CRT colors, however, because of spectral differences and because additive and subtractive images differ, as explained below.
- the differences between additive and subtractive primaries can be understood by comparing spectral shapes.
- the intensity spectrum of each additive primary preferably has a narrow peak at the appropriate wavelength and an intensity of zero for other wavelengths.
- the reflectance spectrum of each subtractive CMY primary spreads across a relatively-broad range of wavelengths, and typically includes some light from nearly all wavelengths, with maximal reflectance of the two RGB primaries which additively produce that CMY primary. Therefore, even if mixing of two CMY primaries produces a subtractive RGB primary, the reflectance spectrum of that RGB primary will be very different from the intensity spectrum of a corresponding additive RGB primary. The subtractive primary looks different from the corresponding additive primary.
- Figs. 2A-2C also illustrate why additive and subtractive images differ.
- the values shown for reflectance are each equal to (1 - absorption), so that many wavelengths are almost entirely absorbed, especially by the cyan and magenta toners. Therefore, mixing toners in a pattern will result in further absorption, producing a darker color than the primary toners which are mixed, as noted above.
- the additive CRT primaries when mixed, produce a color of greater intensity than the primaries themselves, and the CRT provides colors of higher intensity than can be obtained by ordinary printing, in which the maximum possible intensity is the white of the paper surface.
- the intensity differences between additive and subtractive colors are another reason the CRT color coordinates cannot be directly converted to CMY coordinates.
- a second technique for converting original color signals into printer color signals is described briefly in US-A- 4,446,470.
- This technique uses density measurements of the CMY primary toners to obtain a compensation matrix.
- the matrix provides a compensation constant to be multiplied with the coordinate to obtain an adjusted amount of each CMY primary toner to be printed.
- the density measurements are obtained from a solid print of the pure primary toner. Therefore, the measurements may not accurately reflect the manner in which the toners are applied by the printer. For example, the green produced by combining yellow and cyan may be bluish-green because the printer applies less yellow than expected in a pattern.
- the matrix does not take such variations into account.
- a color on a CRT display is matched by identifying its RGB components or coordinates, determining the corresponding CIE values, and defining the closest CMY mixture using a set of color lookup tables. Non-linear factors such as overlapping ink dots and absorption characteristics of the paper are then corrected. If changes are made in the toners or other printing parameters used in this technique, it would be necessary to develop a new set of color lookup tables.
- Another publication of interest is an article entitled "Four-color reproduction Theory for dot-formed imaging systems," by P G Engeldrum, as presented at The Second International Congress on advances in non-impact printing technologies, Nov., 1984 at Arlington, VA, USA.
- US-A- 4,522,491 relates to an indirect technique which can be used to reproduce a target color in printed form, but which requires the use of photographic media during an intermediate stage.
- This technique makes use of coordinates similar to the CIE coordinates to select a period of illumination of the photographic media through each of a number of filters.
- the exposure times are adjusted using a correction factor based on color density measurements. This technique is therefore very complicated.
- EP-A- 0,203,448, citable only under Art 54 (3) - EPC also addresses the problem of matching hard copy color to display color. It proposes the solution of defining a new MSW color space, which restricts the hard copy colors to some percentage of binary mixture of inks, some percentage of single ink, and some percentage of white. The color data in XYZ space are converted to MSW space, with unreachable colors being mapped into reachable colors. In contrast, the present invention proposes a more-general solution.
- the present invention provides a color matching technique which determines quantities of coloring agents which produce a color which matches an original color. The coloring agents are then applied in a pattern selected to approximate the determined quantities, and therefore to approximate the original color.
- This color matching technique may use tables, as in the selection of an application pattern, but does not require matrices or tables which depend on the color of each coloring agent and which would therefore need to be recalculated whenever a coloring agent changes.
- This aspect of the invention is based on the discovery that the quantities of coloring agents may be readily calculated from a definition of the original color, using a definition of each of the coloring agents to be applied rather than using matrices or tables which depend on the coloring agents.
- the invention may be used with any suitable coloring agents, including dyes, inks, toners, pigments and CRT color phosphors, although the invention has been developed for providing printed toner patterns which match CRT display colors. Furthermore, the original color to be matched need not be actually displayed or otherwise made visible.
- This aspect of the invention is based on the discovery of techniques for calculating the quantities of the coloring agents to be applied based on the linear mixing coordinates of the original color and of the coloring agents.
- the techniques of the invention can be used to obtain a close match for any original color, even outside the gamut of colors available with the coloring agents being used.
- the technique is flexible, permitting a number of variations which produce matching colors; each variation may be advantageous for a corresponding class of color-matching problems, in which it is desirable to preserve a color characteristic of an original image.
- This aspect of the invention is based on the discovery of a number of ways of calculating the quantities of coloring agents in the matching color to approximate an original color outside the color gamut.
- a method of generating a matching color thus includes determining quantities of coloring agents to be applied to generate a color matching the original color, then applying the coloring agents in a pattern which approximates those quantities.
- the quantities may be determined from quantities of original coloring agents which generate the original color, such as quantities of additive RGB coloring agents like CRT phosphors.
- the pattern applied which may for example be a pattern of dots, may be the one of a set of available patterns which most closely approximates the quantity of a coloring agent to be applied.
- a separate pattern may be selected for each coloring agent by comparing the quantity of that coloring agent with the area coverage percentages of available separate patterns for that coloring agent to find the closest area coverage percentage. The separate patterns for the coloring agents are then combined into a combined pattern which is applied to obtain the closest matching color.
- An apparatus for generating a color matching an original color includes means for determining the quantities of coloring agents to be applied to generate a color matching the original color, and also includes means for applying the matching coloring agents in a pattern which approximates those quantities.
- the quantities determining means includes means for obtaining quantities defining the original color, such as quantities of original coloring agents; coordinate determining means for determining from those quantities the linear mixing coordinates of the original color; and means for using the linear mixing coordinates of the original color and of at least three of the coloring agents to be applied to determine the coloring agent quantities.
- the apparatus may also include means storing an area coverage for each available pattern of each coloring agent.
- the applying means includes means for selecting a pattern which most closely approximates the determined quantity of a coloring agent, by retrieving the area coverages and comparing with the quantity of that coloring agent to find the most closely matching pattern.
- a method of determining quantities of the coloring agents to be used to generate a matching -color according to the invention includes determining linear mixing coordinates of the original color and then using those coordinates and the linear mixing coordinates of at least three of the coloring agents to be applied to determine the coloring agent quantities.
- the original color's linear mixing coordinates may be determined using the quantities of coloring agents which produce the original color.
- the original color's additive RGB coordinates for example, may be converted into coordinates in a linear mixing color space such as the CIE color space.
- Linear mixing coordinates of the coloring agents to be used may be determined in advance. If the coloring agents include three CMY coloring agents and three RGB coloring agents produced by combining the CMY coloring agents, for example, two of these six are then selected as primaries, and the relative quantities of those two primaries which will generate a pure hue matching the original color are calculated. This permits calculation of the quantities of the two primaries and the neutral coloring agents which will approximate the hue, saturation and reflectance of the original color. The hue, saturation and reflectance may be approximated in a manner which preserves the color characteristics of an original image which contains the original color.
- the two-dimensional linear mixing, coordinates of the coloring agents available as primaries will define a polygon, specifically a hexagon if six primaries are available.
- This hexagon can be divided into six mixing triangles by a center point inside the hexagon, each triangle having the center point as one vertex and the end points of one side of the hexagon as its other vertices.
- the center point may be at the coordinates of the neutral color with the same reflectance as the original color. These coordinates may be found based on the original color's coordinates and the coordinates of the white and black coloring agents, which are the end points of a mixing line which includes all the available neutral colors.
- the matching color lies within one of the mixing triangles, which can be selected based on the coordinates of the center point and of the original color.
- a line projecting from the center point through the original color intersects a side of the selected mixing triangle.
- the intersection point defines a pure hue, undiluted with neutral colorants.
- the two primary colors at the end points of the intersected side can be mixed to obtain the pure hue, which matches the hue of the original color.
- the relative quantities of the primary colors making up the pure hue can be calculated from the lengths of the parts into which the intersected side is divided. Then, the relative quantities of the pure hue and the neutral coloring agents can similarly be calculated in a manner which preserves color characteristics of the original image.
- the present invention is based in part on the recognition that color matching involves two separable problems.
- the first problem is to determine the quantities of coloring agents which will produce a color matching the original color.
- the second is to determine a pattern of coloring agents which will provide those quantities.
- the second problem arises after the quantities of coloring agents to be used in generating the matching color have been determined. It involves selecting from the available patterns of coloring agents the pattern which will most closely approximate those coloring agent quantities. Although this selection will not be affected by color changes in the coloring agents, it will be affected by changes in the equipment used to apply the coloring agents, whether a printer, plotter, CRT or other equipment, and also by changes in the surface characteristics of the medium to which the coloring agents are applied. It may also be affected by changes in the application characteristics of the coloring agents, such as changes in the viscosity of a toner or changes in the apparent size of a phosphor.
- coloring agent changes may be neglected, however, so that the selection of the pattern of coloring agents will be stable for a specific piece of equipment applying coloring agents to a specific medium. Therefore, flexibility is typically not as important in the solution of this second problem, even though selecting a coloring agent pattern appropriate to the equipment and the medium being used is very important.
- Fig. 3 illustrates the broad functions of color matching according to the invention.
- a definition of the original color is received, in box 10.
- this will be a set of numbers reflecting quantities of coloring agents which generate the original color.
- These quantities provide the information necessary to obtain a matching color, so that they should be expressed in a standard form such as the quantities of additive RGB phosphors in a pixel, the output of a calibrated colorimetric scanner, or another form which fully specifies the original color.
- the definition of the original color is then used in box 12 to determine the quantities of the coloring agents to be applied which will produce a matching color.
- the matching color may not be exactly the same as the original color, but it should closely approximate the original color and will ideally preserve color characteristics of an original image containing the original color, when viewed with matching colors in other parts of the image. Techniques for obtaining the optimal quantities of the coloring agents are discussed in more detail below.
- the coloring agent quantities are used in box 14 to select a pattern of the coloring agents which, of the available patterns, most closely approximates those quantities. Because a limited number of patterns will typically be available, the precise quantities usually cannot be obtained, but this step selects the pattern which comes closest to those quantities. Then, in box 16, the coloring agents are applied in the selected pattern to generate the matching color.
- Fig. 3 may be implemented in many ways. We turn now to a specific implementation which also makes use of a novel technique for the step in box 12.
- a central problem in implementing the technique of Fig. 3 is to determine accurately the coloring agent quantities which will generate a color matching the original color.
- the coloring agent quantities be determined without using a matrix or table which depends on the specific coloring agents, so that adjustments can be made for color changes in the coloring agents without recalculating all the values in the matrix or table.
- One aspect of the invention is based on the discovery of a computational technique which accurately determines coloring agent quantities directly from the definition of the original color.
- the computational technique makes use of linear mixing coordinates to convert the original color's numerical definition into coloring agent quantities.
- Figs. 4 and 5 illustrate linear mixing coordinates within the CIE color space, which is one example of a linear mixing color space. While some other color spaces, such as the RGB cubic color space of Fig. 1, are based on arbitrary mathematical models of color, the CIE color space is based on the actual response of the human eye-brain system to color.
- the CIE color space relies on a model, created in 1931, which defines color based in part on characteristics of the human perceptual system. For example, since colors are perceived differently In different parts of the human field of vision, the 1931 CIE model defined an observer as having the color response functions of an area within 2 degrees of arc of the center of vision.
- the colored object is illuminated by a standard light source.
- Fig. 4 shows a cross section of the CIE color space taken parallel to the x and y axes.
- the third axis, the Y axis is orthogonal to the x and y axes and measures reflectance only, not hue or saturation, so that the x and y coordinates shown on the axes of Fig. 4 are sufficient to define any hue within the CIE color space.
- the hues of the conventional RGB gamut and of a typical CMY gamut are outlined, and Fig. 4 shows that each of these gamuts is a subset of the hues within the CIE color space. Therefore, if the original color definition received in box 10 includes additive RGB quantities, those quantities correspond to a point in the CIE color space with x,y, and Y coordinates, the hue of which is completely specified by the x and y coordinates.
- Fig. 5 shows how color mixing may be performed in the CIE color space.
- the CIE color space is a linear mixing color space in which the mixing of two colors such as C 1 and C 2 produces a color along the line between C 1 and C 2 and spaced from them according to their relative quantities.
- the ratio between the distances P 1 and P 2 will be the same as the ratio between the quantities of the colors C 1 and C 2 .
- the RGB gamut based on the additive RGB phosphors of a CRT display, has three vertices, red, green and blue, and all the colors available with those phosphors fall within the triangle defined by those vertices.
- the CMY gamut based on three subtractive CMY primaries and three subtractive RGB primaries obtained by superimposing CMY primaries, has six vertices, and all the colors available with those primaries fall within the hexagon defined by those vertices.
- Fig. 4 also illustrates that the color obtained by superimposing two primaries is not necessarily the same as would be obtained by mixing those two primaries in a pattern such as a dot pattern.
- the RGB primaries obtained by superimposing CMY primaries having transparent properties are not on the lines between the CMY primaries, shown as dashed lines, but rather fall outside those lines, providing a greater gamut than the restricted triangular gamut within the dashed lines which would be available by mixing only the three CMY primaries in patterns. Also, if the CMY primaries were completely opaque rather than somewhat transparent, only the restricted triangular gamut would be available.
- mixing refers to the mixing of two or more coloring agents in adjacent areas of a pattern, with negligible superimposition. It will be understood that the dots or other areas of the pattern which contain distinct coloring agents must be small enough to be below the resolution limit of the human eye, so that the pattern is perceived as having a single color. The manner in which patterns are selected to approximate the coloring agent quantities is discussed in greater detail below.
- a 1 and A 2 are the areas occupied by each of the colors C 1 and C 2 , respectively, within a pattern in which they are mixed to obtain C d .
- P 1 and P 2 are proportional to the respective areas which C 1 and C 2 occupy.
- C 1 is an independent coloring agent
- C 2 is obtained by superimposition of C 1 and another independent coloring agent Cs, as occurs when one of the subtractive CMY primaries is mixed in a pattern with an adjacent subtractive RGB primary, then:
- Fig. 6 shows one technique according to the invention for determining coloring agent quantities making use of linear mixing as can be done in CIE color space.
- the technique begins with a preliminary step in box 20, the measuring and storing of the coordinates of the coloring agents which will be used to generate the matching image.
- the coordinates could be in any appropriate color space, they are preferably the coordinates of each coloring agent in a linear mixing color space such as the CIE coordinates. Rather than measuring these coordinates each time an image is generated, it typically suffices to measure and store the coordinates of a representative sample of each coloring agent in advance, provided the variation about the measured values is relatively small.
- the definition of the original color received in box 10 in Fig. 3 leads to the remaining steps in the technique of Fig. 6.
- the step in box 22 converts the original color's definition to coordinates in the same color space as those measured and stored in box 20. If the definition is expressed as quantities of additive RGB colors which generate the original color, for example, standard techniques are well know for converting such quantities to CIE coordinates. See, for example, Wyszecki, G. and Stiles, W.S., Color Science, Concepts and Methods, Quantitative Data and Formulae, Second Ed., John Wiley and Sons, New York, 1982 and Raster Graphics Handbook, Conrac Corp., Covina, California, 1980.
- the step in box 24 adjusts for out-of-bounds reflectance values, which occur when an original color is lower in reflectance than the black coloring agent or higher in reflectance than the white coloring agent.
- This adjustment could be done in any of several ways. For example, if the reflectance is lower than black, the quantity of the black coloring agent could be set to maximum, and if the reflectance is higher than white, the quantity of the white coloring agent could be set to maximum, so that original colors with out-of-bounds reflectances are matched with either black or white. This approach does not preserve any of the color variations between original colors with out-of-bounds reflectances, however.
- An approach which is preferable, because it preserves such variations is to compare the reflectance of the original color Y o with those of the white and black coloring agents; if it is less than the reflectance of black, it is made equal to the black reflectance Y b , but if it exceeds the reflectance of white, it is made equal to the white reflectance Y w .
- Another approach is to scale all the reflectances linearly into the reflectance range between the black and white coloring agents.
- the technique of Fig. 6 breaks down the problem of determining the coloring agent quantities into two parts, each involving linear mixing in a plane.
- a color referred to as the pure hue is found in a linear mixing plane like that shown in Figs. 4 and 5.
- saturation and reflectance are adjusted in a linear mixing plane which includes the pure hue and the neutral coloring agents, white and black.
- the technique of Fig. 6 makes use of the fact that any color within the available gamut can be obtained by mixing at most four coloring agents--two of the primary colors at adjacent vertices of the hexagon in Fig. 4 and the two neutral coloring agents.
- Fig. 7 shows the hexagonal CMY color gamut of Fig. 4 divided into six color mixing triangles.
- Each triangle has as its base one side of the hexagon, with one of its base vertices being at the x, y coordinates of one of the subtractive CMY primaries and the other at the x, y coordinates of one of the subtractive RGB primaries.
- the third vertex of each color mixing triangle is a center point, preferably at the x, y coordinates of a neutral color, a color obtainable by mixing only the neutral coloring agents, white and black, without any of the other coionng agents.
- the available neutral colors range in reflectance from the white of the paper to the pure black of the black coloring agent. As shown in Table 1, however, the x and y coordinates of these two extremes of reflectance may not be exactly the same. If they are treated as the ends of the reflectance axis of the three-dimensional gamut of available colors, the reflectance axis will be skewed somewhat in relation to the Y axis of the CIE color space.
- the colors along the neutral mixing line between the white and black coloring agents are the only available neutral colors which can be generated using only white and black.
- the step in box 26 in Fig. 6 determines the x, y coordinates of a center point on the neutral mixing line to be used in determining which pair of primary colors will be mixed to generate a matching color.
- the preferred center point is at the coordinates of the neutral color which has the same reflectance as the original color, because it yields an accurate choice of the two primary colors which, when mixed with the neutral coloring agents, white and black, will produce a color most closely matching the original color.
- This center point is also consistent with the preferred technique described below for adjusting saturation and reflectance to preserve color characteristics of an original image.
- the coordinates of this neutral color can be calculated by first calculating the relative position of the original color's reflectance along the mixing line between the neutral coloring agents, white and black.
- the relative position t n of this neutral color can be obtained from the reflectances of the original color and the neutral coloring agents as follows:
- Y o , Y b , and Yw are the reflectances or Y coordinates of the original color, the black coloring agent and the white coloring agent, respectively.
- Y o may have been adjusted in the step of box 24, as described above.
- x n and y n the x, y coordinates of the neutral color having the original color's reflectance, can be calculated as follows: where the subscripts follow the same convention as above.
- a number of other approaches could be used in selecting the center point, including using the x, y coordinates of the white coloring agent or of the black coloring agent. Indeed, both of these could be used, and if they result in selection of different pairs of primary colors or in substantially different proportions of matching coloring agents, an additional procedure may be used to determine which pair of primary colors or which proportions generate a matching color closer to the original color. For simplicity and accuracy, however, it is preferred to use the x, y coordinates of the neutral color having the original color's reflectance, as calculated above, as the center point coordinates.
- Fig. 7 shows that the colors within each of the color mixing triangles can be obtained by mixing the two primaries corresponding to the base vertices of that triangle with the neutral coloring agents, white and black.
- the center point coordinates from box 26 in Fig. 6 make it possible to select the pair of primary colors corresponding to the base vertices which can be mixed to obtain the matching color, in box 28.
- a line projecting from the center point through the original color will intersect the base of one of the color mixing triangles, with the original color falling within the angle between the two primary colors at the ends of that base.
- the appropriate pair of primary colors may be selected mathematically by going in a clockwise or counterclockwise direction around the hexagon and testing at each primary color whether the original color is at an angle ahead of or behind that primary color.
- the primary color at which the original color makes a transition by changing from being ahead to being behind is one primary color, and the previous primary color in the testing sequence is the other.
- the projecting line will intersect the line between these two primaries.
- Fig. 8 shows a routine which can be used to select the first and second primary colors in box 28, by going around the hexagon, mathematically testing each primary color in sequence to determine whether the original color changes from being ahead to being behind at that primary.
- a primary color is selected to be tested first. This selection may be based on the RGB coordinates of the original color, with the lowest of the RGB coordinates indicating the complement of the CMY coloring agent highest in quantity. Therefore, the starting primary is preferably a coloring agent which precedes the highest CMY coloring agent in the testing sequence, to expedite finding the transition of the original color.
- the highest of the CMY coloring agents is probably cyan, the complement of red, and the selected starting primary would be blue or magenta, which precede cyan as one proceeds in the clockwise direction around the hexagon.
- the cross product of the current primary being tested and the original color is calculated in box 52.
- This cross product is the vector cross product of two vectors, the first from the center point to the original color and the second from the center point to the primary being tested.
- the vector cross product yields a third vector, perpendicular to the plane of Fig. 7, whose magnitude will be positive when the first vector is to the left of the second vector and negative when the first vector is to the right of the second vector. See Foley, J. and Van Dam, A., Fundamentals of Interactive Computer Graphics, Addison-Wesley, Reading, Mass., 1984, pp. 453-455.
- the cross product magnitude CP may be calculated for each primary color as follows: where and
- X p r i mar y and yp r i mar y are the x, y coordinates of that primary color and the other coordinates have the same meanings as set forth above.
- the cross product magnitude CP is then compared with zero in box 54, and if it is less than zero, the routine proceeds to the next primary color in box 56 and returns to box 52. If the cross product is greater than or equal to zero, however, then the original color might be within the preceding angle.
- the previous primary's cross product is calculated in box 58 and is compared with zero in box 60. If it is not less than zero, the original color is not within the preceding angle, so the routine proceeds to the next primary color in box 56.
- the step in box 30 finds the pure hue, the pure hue being a color of the same hue as the original color which can be generated without any neutral coloring agents.
- the pure hue falls on the linear mixing line between two of the primary coloring agents, the two selected as described above.
- the pure hue can be adjusted in box 32 by the addition of neutral coloring agents.
- Its saturation which corresponds to the distance from the center point of the hexagon and is maximum at the mixing line between the primaries, can be decreased by adding the neutral coloring agents in appropriate quantities.
- Its reflectance corresponding to its position along an axis perpendicular to the plane of the hexagon can be increased by adding white or decreased by adding black.
- the generation of the matching color involves matching the hue, saturation and reflectance of the original color.
- the hue of the original color corresponds to the angular orientation of a line projecting from the center point through the two-dimensional coordinates of the original color. All the points on this line share the same hue, and one of these points is at the intersection of the projecting line and the linear mixing line between the two selected primary colors. Therefore, the pure hue is found by determining the relative quantities of the two selected primaries which generate it, based on the position of the intersection point along the linear mixing line.
- Fig. 9 illustrates geometrically how the relative quantities of the selected primaries in the pure hue are calculated.
- the relative quantities can be calculated from the lengths of the parts into which the intersection point divides the linear mixing line, but those lengths are not previously known. Therefore, a useful intermediate step is to calculate the x, y coordinates of the intersection point corresponding to the pure hue.
- Fig. 9 shows the line projecting from the center point through the original color and the intersection point of that line with the linear mixing line.
- the center point preferably has the coordinates of the neutral color having the same reflectance as the original color.
- the pure hue's coordinates xpand yp may therefore be obtained by simultaneously solving for xp and ypin the slope equations for the two intersecting lines:
- the step in box 30 also includes finding the relative quantities P 1 and P 2 of the first and second primary colors, respectively, which generate the pure hue. As noted above in relation to Figs. 4 and 5, these relative quantities have the same ratio as the lengths of the parts of the linear mixing line. Therefore, the relative quantities can be calculated as fractions of the total length of the linear mixing line as follows: and
- the calculations relating to the linear mixing plane shown in Figs. 4 and 5 are completed, so we turn now to calculations in another linear mixing plane which includes the pure hue and the two neutral coloring agents.
- the purpose of these calculations is to adjust the saturation and reflectance of the pure hue to obtain the matching color, as shown in box 32 in Fig. 6.
- the result will preferably be a color which closely matches the original color and which, in combination with other matching colors, preserves the color characteristics of the original image.
- the adjustment in step 32 may be tailored to the specific image whose colors are being matched.
- a major consideration in preserving the color characteristics of the original image is how to treat an original color which is outside the three-dimensional gamut of available colors.
- the relative quantities of the two primaries which generate the pure hue do not need to be adjusted, but the quantities of the neutral coloring agents which are mixed with them must be adjusted to provide a suitable approximation of an original color outside the gamut.
- Mixing in neutral coloring agents will change the saturation and reflectance of the pure hue, as discussed above, but it is usually possible to change these parameters while nonetheless preserving the color characteristics of the original image. For example, if the original image has colors which are distinguishable by saturation differences, the saturation differences can be preserved across a range of available saturation values. Similarly, if the original image has colors distinguishable by reflectance, reflectance differences can be preserved. In general, an appropriate compromise between preserving saturation characteristics and preserving reflectance characteristics can be found, and one of the advantages of the invention is that saturation and reflectance can be flexibly adjusted in whatever way is appropriate to the image being produced.
- Figs. 10 and 11 illustrate an implementation of the step in box 32 which preserves reflectance characteristics at the expense of saturation characteristics, an approach which is often useful and which may be especially desirable if the original image has many shades of colors outside the available reflectance image range.
- Fig. 10 illustrates geometrically the linear mixing plane which includes the pure hue, at coordinates xp, yp, Yp and the neutral coloring agents, white at x w , y w , Y w and black at Xb , y b , Y b .
- Fig. 10 also shows the triangle defined by these three colors and two lines of constant reflectance within that triangle, one at reflectance Yp and the other at the reflectance of the original color Y o .
- Fig. 10 illustrates geometrically the linear mixing plane which includes the pure hue, at coordinates xp, yp, Yp and the neutral coloring agents, white at x w , y w , Y w and black at Xb ,
- FIG. 10 shows the original color at x o , y o ,Y o inside the triangle.
- the step in box 24, discussed above, may ensure that Y b ⁇ Yo ⁇ Y w but the original color could also fall outside the triangle and to its right in Fig. 10.
- the technique of Figs. 10 and 11 adjusts the reflectance of the pure hue so that it falls on the line of constant reflectance Y o . If the original color falls outside the triangle, the matching color is the most saturated available color on that line, at xp n , yp n , Y o , but if the original color is in the triangle, the technique also adjusts the saturation of the matching color to that of the original color.
- Fig. 11 shows steps implementing this technique to perform the step in box 32 in Fig. 6.
- box 70 Y o and Yp are compared to determine whether the pure hue must be adjusted toward white or black to obtain reflectance Y o . If Y o ⁇ Yp, black is selected as the neutral coloring agent in box 72; otherwise, white is selected in box 74. Then, in box 76, the coordinates of the pure hue and the selected neutral coloring agent are used to obtain the x, y coordinates of a pure/neutral color which is the most saturated available color with reflectance y o . These coordinates xp n , Y p n can be obtained from: and where
- test in box 78 compares A o to Ap n , shown in Fig. 10, to determine the position of the original color in relation to the pure/neutral color. This can be done by first calculating A o and Ap n as follows: and in which x ⁇ , y n are the coordinates of the neutral color with the original color's reflectance, as discussed above in relation to center point selection and as shown in Fig. 10.
- the white coloring agent is the white of the paper on which the other coloring agents are printed, so that the white coloring agent will be present wherever none of the other coloring agents is printed. Therefore, the only coloring agent quantities to be calculated in box 34 in Fig. 6 are those of the black coloring agent and the two primary coloring agents which mix to provide the pure hue. As shown below, the quantity of black coloring agent can be directly calculated, while the quantities of the primaries must take into account the selection of the primary color pair in box 28, since one of the primaries will be a simple CMY primary while the other will be an RGB primary formed by superimposition.
- the quantity of black coloring agent a b can be directly calculated from the results of the previous calculations, as noted above. We know that the sum of all the coloring agent quantities must equal 1.0, and we also know that the reflectance of the matching color Y o must be equal to the sum of the products of each coloring agent quantity times the reflectance of that coloring agent in the linear mixing space. If we treat the pure hue as a single coloring agent, the only other coloring agents are white and black, yielding: and in which a b , a w and ap are the quantities of black, white and pure coloring agents, respectively. Hardy, A.C., Handbook of Colorimetry, The Technology Press, MIT, 1936 sets forth equivalent color mixing formulas.
- the two primary coloring agents which make up the pure hue are a subtractive CMY primary and an adjacent subtractive RGB primary
- the pure hue is actually generated from two of the subtractive CMY primaries.
- One CMY primary will be present throughout the pure hue areas, while the other CMY primary will be superimposed with the first only in the RGB primary areas.
- Some machines have complete undercover removal for the black coloring agent, so that black does not cover the other coloring agents.
- Other machines apply black over the CMY colors in the lower mixing triangle in Fig. 10, so that the quantities of the CMY primaries must be increased accordingly if Y o is less than Yp.
- the quantity of the first CMY primary ap r i mar y 1 is the quantity of the pure hue ap. This will be true for all values of Y o if the equipment provides complete undercover removal. But if undercover removal does not occur, then if Y o is less than Yp, the quantity of the first CMY primary ap r i mar yi is the pure/neutral ratio Rp /n , without multiplying times tp n as in box 84 in Fig. 11. In any case, the quantity of the second CMY primary ap r i mar y 3 is the product of the aprimaryi times the relative quantity of the RGB primary.
- the relative quantity of the RGB primary is either P 1 or P 2 , depending on whether it is the first or second primary, as discussed above in relation to box 30 in Fig. 6. Therefore, the quantities a primary 1 and ap r i mar y 3 can be assigned based on the first primary.
- the step in box 36 selects a pattern for application of the coloring agents which will most closely match the coloring agent quantities calculated in box 34, taking into account the operation of the equipment which applies the coloring agents.
- the patterns produced by a piece of equipment should be relatively stable over time, so that it will be worthwhile to have a table indicating the percentages of area coverage for each available pattern on that equipment. To the extent that the pattern depends on whether a specific area has a coloring agent applied to it or the white coloring agent in the paper is left exposed, it may be necessary in preparing such tables to treat the area coverage of white differently than the other coloring agents. If the equipment applies dots, for example, the dots may be larger than the spacing between dot centers, so that dots may overlap, resulting in non-linear area coverage with increasing dot density.
- the pattern whose area coverages most closely match the coloring agent quantities is selected by an appropriate comparison algorithm. From the above discussion, it is apparent that a b , ap r i mar yi and a primary 3 are sufficient to specify the coloring agent quantities. Therefore, these quantities can be compared with the area coverage percentages of the available patterns to find a pattern which provides approximately the appropriate coloring agent quantities. For completeness, however, it would be necessary to know the area coverage percentages of all available patterns, a daunting task in view of the tremendous number of permutations and combinations of quantities of coloring agents. Therefore, it is desirable to find a simpler approach to this comparison.
- one set of patterns can be selected to be used for the CMY primaries, with another used for black, so that the black patterns have minimal interaction with any of the CMY primaries, but so that the two CMY primaries have maximal interaction to obtain an RGB primary in the area where both are applied.
- a technique for obtaining the area coverage percentage for each such pattern is discussed in greater detail below in relation to creating area coverage tables.
- a set of patterns can be selected which will obtain a given level of accuracy in color matching. If the coloring agent quantities need only match the area coverage percentages to a given level of accuracy, then the patterns may be selected so that the differences between their area coverage percentages are just small enough to ensure that level of accuracy.
- the selected combined pattern of coloring agents is applied to generate the matching color, in box 38. It would also be appropriate, of course, to store a representation of the combined pattern in memory together with all the other patterns making up a complete image, and then generate the entire image at some later time.
- the method of color matching described above may be performed on many types of equipment. We turn now to an apparatus which matches color according to the invention and can be used in a printer, for example.
- Fig. 12 is a functional block diagram showing the components of a color matching apparatus 100 according to the invention. Apparatus 100 may also perform other control functions within a printer or other image- producing equipment, but the components shown generally relate to the function of generating a color which matches an original color.
- Fig. 12 shows apparatus 100 centered around central processing unit (CPU) 110 which receives data through an input 112 and provides data through an output 114 to a printing mechanism 116 or other color producing equipment.
- CPU 110 may be any appropriate processor, such as a microprocessor. During operation, CPU 110 executes instructions retrieved from program memory 120 and retrieves and stores data in data memory 140.
- Program memory 120 illustratively includes color-matching routine 122 during the execution of which CPU 110 operates according to the present invention.
- Color-matching routine 122 calls a number of subroutines which correspond to functions described above in relation to the method of the invention. These include quantities calculation subroutine 124, original color conversion subroutine 126, pattern selection subroutine 128 and pattern application subroutine 130.
- program memory 120 includes other programs which CPU 110 executes to perform functions other than color matching.
- CPU 110 may, for example, control all the functions of printing mechanism 116.
- Data memory 140 illustratively includes coloring agent coordinates 142, coordinate conversion table 144, area coverage table 146, and additional data memory 148 including registers and other data permitting CPU 110 to execute instructions from program memory 120.
- Coloring agent coordinates 142 as discussed above in relation to Table 1, are previously measured and stored.
- coordinate conversion table 144 is a standard table for converting coordinates used to generate a CRT color display to linear mixing coordinates.
- Area coverage table 146 which may be generated in the manner described below, should reflect the characteristics of printing mechanism 116 and the toners being used.
- CPU 110 receives the original color's coordinates through input 112 or retrieves previously calculated or received original color coordinates from additional data memory 148.
- CPU 110 retrieves the original color's linear mixing coordinates from coordinate conversion table 144.
- CPU 110 retrieves coloring agent coordinates 142 and uses them to calculate coloring agent quantities.
- pattern selection subroutine 1208 CPU 110 compares the calculated quantities with the stored area coverages of available patterns to find the pattern most closely approximating the calculated quantities.
- CPU 110 performs conventional techniques for distributing dots within a printed area in accordance with the selected pattern, such as dithering or half-toning. In general, CPU 110 will follow the steps discussed above in relation to the method of the invention.
- Area coverage table 146 provides one available technique for selecting the pattern of coloring agents which will most closely approximate the quantities of coloring agents in the matching color. Other techniques are available, including calculation of area coverage based on an appropriate algorithm, but area coverage table 146 is an extremely fast way of finding the most closely matching pattern. We turn now to a technique for creating the area coverage table 146.
- the coloring agent quantities are correctly determined, and if a pattern of coloring agents is applied which is substantially the same as those quantities, then the resulting color will match the original color. Therefore, the selection of the pattern which most closely approximates the coloring agent quantities is important in successful color matching. For the selection to be accurate, the comparison of the quantities with the patterns must be properly performed, and this also requires that the appropriate data about the patterns be available for comparison. The area coverage table is created to provide those data.
- This aspect of the present invention is based on the discovery that, rather than comparing the coloring agent quantities with a pattern's CIE coordinates, it is more appropriate to compare them with the areas covered by the coloring agents in that pattern. If the area coverages of the coloring agents in the pattern are the same or nearly the same as the coloring agent quantities, the pattern generates the matching color.
- the technique of creating an area coverage table begins with the printing of a number of available patterns of one of the coloring agents.
- the patterns which are printed should cover the range of desired area coverage from a blank pattern with zero area covered to a solid pattern with complete coverage.
- the CIE coordinates of each printed pattern are measured using a colorimeter.
- the measured reflectance values thus range from the reflectance Y m i n for the solid pattern to the reflectance Y max for the blank pattern, which will ordinarily be the reflectance of the paper. These values are then used to estimate the area coverage for each pattern.
- the area coverage Aj for the ith pattern with measured reflectance Yi can be estimated as follows:
- the estimated value of A I may be adequate for purposes of comparison with the coloring agent quantities, in which case an appropriate group of patterns providing the desired level of resolution can be selected for inclusion in the area coverage table.
- the estimated values of Ai are not adequate because of measurement errors, the estimated values can be mathematically corrected.
- Mathematical correction can reduce errors introduced by the measurement process, because the number of colored dots in a pattern should bear a predictable mathematical relation to the area coverage.
- Fig. 13 shows graphically the mathematical relationship between the number of dots and the area coverage percentage of a Bayer pattern, for example, and a similar relationship should be obtainable for any set of patterns.
- the mathematical correction process should involve curve fitting and smoothing of the area coverages calculated from the measured reflectance values so that they follow a curve more closely resembling the expected mathematical relationship for the patterns being used. In other words, some of the calculated area coverage values are corrected based on the values calculated for other patterns. Conventional techniques for curve fitting and smoothing are appropriate for this correction process.
- the table of patterns derived from printing each coloring agent separately in this manner is easy to create and also facilitates comparison with coloring agent quantities.
- the area coverages could first be estimated based on a mathematical model of the relationship between number of dots and area coverage percentage, after which measurements of actual area coverage could be made to correct the estimates, if necessary.
- the total number of possible patterns on a given printer may be extremely large, so that an important aspect of creating the area coverage table is to select a group of patterns which is small enough to be manageable, but large enough to provide a satisfactory approximation to any set of quantities of coloring agents.
- the color-matching technique of the invention has been compared with other color-matching techniques, including a conventional half-tone method and a Bayer 4x4 dither method.
- the Macbeth ColorChecker defined the original colors.
- the invention proved superior to the other techniques, producing colors nearly identical to the originals, while the other techniques did not.
- the Munsell color chart revealed, however, that the color matching technique of the invention accurately matches all colors except for low chroma or nearly achromatic colors, in which shifts in hue occur. These shifts result, however, not from a weakness in the technique but from the coarseness of the available patterns of coloring agents, which do not allow adjustment when the quantity of a color to be applied is less than the area coverage percentage of a single dot. Therefore, this can be solved by providing finer patterns in which each dot has a smaller area coverage percentage. For a new set of patterns, of course, it will be necessary to recalculate the area coverage percentage of each available pattern.
- the technique of the invention has been discussed in relation to converting CRT colors based on additive RGB phosphors into printed colors based on subtractive CMY toners, but is equally applicable to any other color- matching problem.
- RGB color coordinates HLS or LUV coordinates could be received and converted into coordinates in a linear mixing color space from which coloring agent quantities could then be determined.
- Colors printed on an electrostatic printer could be matched to thermally printed colors, and printed colors could be matched on a CRT display.
- the technique for the invention may be readily modified for the particular color-matching task at hand. For instance, in color-matching RGB coordinates developed to generate CRT colors, it is sometimes found that the reflectances of the original colors after conversion to CIE coordinates typically exceed the reflectance of the white coloring agent to be applied. This problem can be solved by scaling the reflectance values so that they all fit between the reflectances of the white and black coloring agents.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Image Communication Systems (AREA)
- Facsimile Image Signal Circuits (AREA)
- Dot-Matrix Printers And Others (AREA)
- Color, Gradation (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
Description
- The present invention relates to producing a color which matches an original color. For example, the invention may be used in printing a color which accurately matches a color displayed on a cathode-ray tube (CRT) display.
- In order to produce a printed color corresponding to a CRT color, for example, it is necessary to convert the signals which generate the CRT color into signals controlling the printing process. The CRT color signals conventionally include three color coordinates for each distinct colored feature. Each feature could be a picture element, or pixel, or could be any other geometric shape, according to conventional image generating techniques applicable to CRT displays, to printing processes and to other color imaging techniques. The three coordinates may correspond, for example, to the primary colors produced by light-emitting elements within each pixel. However, these coordinates do not correspond to the toner colors used in printing, and therefore cannot be used directly to control the printing process.
- One system of CRT color uses RGB coordinates corresponding to intensities of red, green and blue (RGB), the colors detected by cone cells on the retina of the human eye. These coordinates cause the light-emitting elements to generate a CRT color additively, with light of the primary red, green and blue colors mixing to produce other colors. The mixture of all three primaries yields white at maximal intensity and black at minimal intensity. In addition, each pair of the RGB primaries mixes to produce a color which can also serve as a primary, with red and green producing yellow, red and blue producing magenta, and blue and green producing cyan. The range of colors, or the color space, obtainable from the RGB coordinates may thus be graphically represented as a cube, with two diagonally-opposite corners corresponding to black and white, and the intermediate corners corresponding to the primary colors, as shown in Fig. 1 of the accompanying drawings. Fig. 1 also shows the corners corresponding to the cyan, magenta and yellow (CMY) primary colors nearer to the white corner than the RGB primaries are, because each of the CMY primaries is produced by adding the light from two of the RGB primaries, and therefore is more intense and closer to white than the RGB primaries. This illustrates the generation of a color additively.
- In contrast to a CRT display, a color printer generates an image subtractively, by applying toners to a white medium (or a transparent medium if back-lit), each toner absorbing some light frequencies and reflecting or transmitting others to produce its characteristic color. The toners commonly correspond to the CMY primary colors, with application of no toner producing white, and all toners at maximal intensity producing black. Alternatively, black may be produced with a separate toner. The toners may be mixed by superimposing them or by mixing them in a pattern such as a dot pattern. Superimposing a pair of the CMY primaries produces an RGB primary which can also be used in printing. In general, the mixing of subtractive primaries produces colors within a space similar to the RGB color space of Fig. 1, but a mixed color produced by combining quantities of the primaries will be nearer the black corner of the color space than the same quantity of any of the primaries alone because each added primary will subtract more of the light frequencies than the white medium would.
- One technique for converting CRT color signals into printer color signals is to convert each CRT color coordinate directly into coordinates for the pair of CMY primaries which mix to produce that coordinate. This does not accurately reproduce the CRT colors, however, because of spectral differences and because additive and subtractive images differ, as explained below.
- The differences between additive and subtractive primaries can be understood by comparing spectral shapes. The intensity spectrum of each additive primary preferably has a narrow peak at the appropriate wavelength and an intensity of zero for other wavelengths. In contrast, the reflectance spectrum of each subtractive CMY primary, as shown for typical toners in Figs. 2A-2C, spreads across a relatively-broad range of wavelengths, and typically includes some light from nearly all wavelengths, with maximal reflectance of the two RGB primaries which additively produce that CMY primary. Therefore, even if mixing of two CMY primaries produces a subtractive RGB primary, the reflectance spectrum of that RGB primary will be very different from the intensity spectrum of a corresponding additive RGB primary. The subtractive primary looks different from the corresponding additive primary.
- Figs. 2A-2C also illustrate why additive and subtractive images differ. The values shown for reflectance are each equal to (1 - absorption), so that many wavelengths are almost entirely absorbed, especially by the cyan and magenta toners. Therefore, mixing toners in a pattern will result in further absorption, producing a darker color than the primary toners which are mixed, as noted above. On the other hand, the additive CRT primaries, when mixed, produce a color of greater intensity than the primaries themselves, and the CRT provides colors of higher intensity than can be obtained by ordinary printing, in which the maximum possible intensity is the white of the paper surface. The intensity differences between additive and subtractive colors are another reason the CRT color coordinates cannot be directly converted to CMY coordinates.
- A second technique for converting original color signals into printer color signals is described briefly in US-A- 4,446,470. This technique uses density measurements of the CMY primary toners to obtain a compensation matrix. For each original coordinate, the matrix provides a compensation constant to be multiplied with the coordinate to obtain an adjusted amount of each CMY primary toner to be printed. The density measurements are obtained from a solid print of the pure primary toner. Therefore, the measurements may not accurately reflect the manner in which the toners are applied by the printer. For example, the green produced by combining yellow and cyan may be bluish-green because the printer applies less yellow than expected in a pattern. The matrix does not take such variations into account.
- A variation of this second technique, described in Starkweather, G.K., "A Color-Correction Scheme for Color Electronic Printers," Color Research and Application, Vol 11, Supplement (1986), pp. S67-S72, is to use a large number (e.g. 512) of compensation matrices, each matrix being tuned to a small portion of the color gamut. This is still not satisfactory for high saturation colors, however, and requires lengthy, complex computation to generate the matrices. Furthermore, if a color shift occurs because of a change in toner spectrum, toner sequence, dot overlap, flare or paper characteristics, all of the matrices must be recalculated. A third technique for converting CRT color signals into printer color signals in described in Kenney, J., "Careful Color Matching Makes Hardcopy Output Conform to CRT Display", Computer Technology Review, Fall 1985, pp. 167-175. This technique uses the CIE (Commission International de I'Eclairage) system which assigns coordinates to colors according to their appearance under a standard illumination as viewed by a standard observer. Three coordinates are assigned to each color, but these coordinates are not other colors making up that color; rather, the coordinates represent a summation of the color contributions of all wavelengths within the spectrum of a color sample. These values are mathematically useful in relating measurements of wavelength and intensity to perceived colors. A color on a CRT display is matched by identifying its RGB components or coordinates, determining the corresponding CIE values, and defining the closest CMY mixture using a set of color lookup tables. Non-linear factors such as overlapping ink dots and absorption characteristics of the paper are then corrected. If changes are made in the toners or other printing parameters used in this technique, it would be necessary to develop a new set of color lookup tables. Another publication of interest is an article entitled "Four-color reproduction Theory for dot-formed imaging systems," by P G Engeldrum, as presented at The Second International Congress on advances in non-impact printing technologies, Nov., 1984 at Arlington, VA, USA.
- US-A- 4,522,491 relates to an indirect technique which can be used to reproduce a target color in printed form, but which requires the use of photographic media during an intermediate stage. This technique makes use of coordinates similar to the CIE coordinates to select a period of illumination of the photographic media through each of a number of filters. In addition, the exposure times are adjusted using a correction factor based on color density measurements. This technique is therefore very complicated.
- EP-A- 0,203,448, citable only under Art 54 (3) - EPC, also addresses the problem of matching hard copy color to display color. It proposes the solution of defining a new MSW color space, which restricts the hard copy colors to some percentage of binary mixture of inks, some percentage of single ink, and some percentage of white. The color data in XYZ space are converted to MSW space, with unreachable colors being mapped into reachable colors. In contrast, the present invention proposes a more-general solution.
- It would be advantageous to have a simple, accurate technique for directly matching printed colors to those on a CRT display which would not require a new set of matrices or tables whenever toner color changes. It would further be advantageous to have a technique which would reliably obtain a printed color closely approximating a CRT display color even when the displayed color is outside the gamut of printable colors. The present invention provides a color matching technique which determines quantities of coloring agents which produce a color which matches an original color. The coloring agents are then applied in a pattern selected to approximate the determined quantities, and therefore to approximate the original color. This color matching technique may use tables, as in the selection of an application pattern, but does not require matrices or tables which depend on the color of each coloring agent and which would therefore need to be recalculated whenever a coloring agent changes. This aspect of the invention is based on the discovery that the quantities of coloring agents may be readily calculated from a definition of the original color, using a definition of each of the coloring agents to be applied rather than using matrices or tables which depend on the coloring agents. The invention may be used with any suitable coloring agents, including dyes, inks, toners, pigments and CRT color phosphors, although the invention has been developed for providing printed toner patterns which match CRT display colors. Furthermore, the original color to be matched need not be actually displayed or otherwise made visible. It may, for example, be only sufficiently defined to permit the determination of its coordinates in a linear mixing color space such as the CIE color space. This aspect of the invention is based on the discovery of techniques for calculating the quantities of the coloring agents to be applied based on the linear mixing coordinates of the original color and of the coloring agents.
- The techniques of the invention can be used to obtain a close match for any original color, even outside the gamut of colors available with the coloring agents being used. In matching a color outside the available gamut, the technique is flexible, permitting a number of variations which produce matching colors; each variation may be advantageous for a corresponding class of color-matching problems, in which it is desirable to preserve a color characteristic of an original image. This aspect of the invention is based on the discovery of a number of ways of calculating the quantities of coloring agents in the matching color to approximate an original color outside the color gamut.
- A method of generating a matching color according to the invention thus includes determining quantities of coloring agents to be applied to generate a color matching the original color, then applying the coloring agents in a pattern which approximates those quantities. The quantities may be determined from quantities of original coloring agents which generate the original color, such as quantities of additive RGB coloring agents like CRT phosphors. The pattern applied, which may for example be a pattern of dots, may be the one of a set of available patterns which most closely approximates the quantity of a coloring agent to be applied. A separate pattern may be selected for each coloring agent by comparing the quantity of that coloring agent with the area coverage percentages of available separate patterns for that coloring agent to find the closest area coverage percentage. The separate patterns for the coloring agents are then combined into a combined pattern which is applied to obtain the closest matching color.
- An apparatus for generating a color matching an original color according to the invention includes means for determining the quantities of coloring agents to be applied to generate a color matching the original color, and also includes means for applying the matching coloring agents in a pattern which approximates those quantities. The quantities determining means includes means for obtaining quantities defining the original color, such as quantities of original coloring agents; coordinate determining means for determining from those quantities the linear mixing coordinates of the original color; and means for using the linear mixing coordinates of the original color and of at least three of the coloring agents to be applied to determine the coloring agent quantities. The apparatus may also include means storing an area coverage for each available pattern of each coloring agent. The applying means includes means for selecting a pattern which most closely approximates the determined quantity of a coloring agent, by retrieving the area coverages and comparing with the quantity of that coloring agent to find the most closely matching pattern.
- A method of determining quantities of the coloring agents to be used to generate a matching -color according to the invention includes determining linear mixing coordinates of the original color and then using those coordinates and the linear mixing coordinates of at least three of the coloring agents to be applied to determine the coloring agent quantities. The original color's linear mixing coordinates may be determined using the quantities of coloring agents which produce the original color. The original color's additive RGB coordinates, for example, may be converted into coordinates in a linear mixing color space such as the CIE color space.
- Linear mixing coordinates of the coloring agents to be used may be determined in advance. If the coloring agents include three CMY coloring agents and three RGB coloring agents produced by combining the CMY coloring agents, for example, two of these six are then selected as primaries, and the relative quantities of those two primaries which will generate a pure hue matching the original color are calculated. This permits calculation of the quantities of the two primaries and the neutral coloring agents which will approximate the hue, saturation and reflectance of the original color. The hue, saturation and reflectance may be approximated in a manner which preserves the color characteristics of an original image which contains the original color. The two-dimensional linear mixing, coordinates of the coloring agents available as primaries will define a polygon, specifically a hexagon if six primaries are available. This hexagon can be divided into six mixing triangles by a center point inside the hexagon, each triangle having the center point as one vertex and the end points of one side of the hexagon as its other vertices. The center point may be at the coordinates of the neutral color with the same reflectance as the original color. These coordinates may be found based on the original color's coordinates and the coordinates of the white and black coloring agents, which are the end points of a mixing line which includes all the available neutral colors.
- The matching color lies within one of the mixing triangles, which can be selected based on the coordinates of the center point and of the original color. Mathematically, a line projecting from the center point through the original color intersects a side of the selected mixing triangle. The intersection point defines a pure hue, undiluted with neutral colorants. The two primary colors at the end points of the intersected side can be mixed to obtain the pure hue, which matches the hue of the original color. The relative quantities of the primary colors making up the pure hue can be calculated from the lengths of the parts into which the intersected side is divided. Then, the relative quantities of the pure hue and the neutral coloring agents can similarly be calculated in a manner which preserves color characteristics of the original image.
- The present invention will be described, by way of example, with reference to the accompanying drawings, in which:
- Fig. 1 is a graph showing the conventional RGB color space;
- Figs. 2A-2C are graphs of the reflectance spectra of typical CMY coloring agents, with Fig. 2A being that of cyan, Fig. 2B that of magenta and Fig. 2C that of yellow;
- Fig. 3 is a functional block diagram showing the broad functions of color matching according to the invention;
- Fig. 4 is a graph of a plane from the conventional CIE color space, showing RGB and CMY color gamuts;
- Fig. 5 is a graph showing how the plane of Fig. 4 serves as a linear mixing plane;
- Fig. 6 is a flowchart of the general steps of color matching according to the invention;
- Fig. 7 is a graph showing a portion of the CIE plane of Fig. 4, showing the CMY color gamut divided into color mixing triangles;
- Fig. 8 is a flowchart showing the steps of selecting one of the color mixing triangles of Fig. 7;
- Fig. 9 is a graph showing a portion of the CIE plane of Fig. 4, showing how the quantities of coloring agents are determined;
- Fig. 10 is graph showing a color mixing plane in which the reflectance and saturation of a pure hue may be adjusted according to the invention;
- Fig. 11 is a flowchart showing one technique for adjusting reflectance and saturation in the plane of Fig. 10;
- Fig. 12 is a block diagram showing the components of a color matching apparatus according to the invention, and
- Fig. 13 is a graph showing the mathematical relationship between number of dots and area coverage percentage for a Bayer pattern.
- The present invention is based in part on the recognition that color matching involves two separable problems. The first problem is to determine the quantities of coloring agents which will produce a color matching the original color. The second is to determine a pattern of coloring agents which will provide those quantities.
- The first of these problems becomes complicated if color changes occur in the coloring agents being used to produce the matching color. If one cyan toner, for example, is replaced with another which is closer to blue, then a different quantity of cyan toner is needed to produce the matching color. Similarly, color changes resulting from changes in temperature, humidity, paper or other causes may change the quantities of coloring agents which produce the matching color. Not all such color changes may justify a modification of the coloring agent quantities, of course, but it should be possible to take color changes into account in determining the quantities used to generate the matching color. Therefore, a satisfactory solution to this problem must accommodate color changes, whether the coloring agents are dyes, toners, inks, pigments, phosphors on a CRT, or others.
- The second problem arises after the quantities of coloring agents to be used in generating the matching color have been determined. It involves selecting from the available patterns of coloring agents the pattern which will most closely approximate those coloring agent quantities. Although this selection will not be affected by color changes in the coloring agents, it will be affected by changes in the equipment used to apply the coloring agents, whether a printer, plotter, CRT or other equipment, and also by changes in the surface characteristics of the medium to which the coloring agents are applied. It may also be affected by changes in the application characteristics of the coloring agents, such as changes in the viscosity of a toner or changes in the apparent size of a phosphor. Typically, these coloring agent changes may be neglected, however, so that the selection of the pattern of coloring agents will be stable for a specific piece of equipment applying coloring agents to a specific medium. Therefore, flexibility is typically not as important in the solution of this second problem, even though selecting a coloring agent pattern appropriate to the equipment and the medium being used is very important.
- Fig. 3 illustrates the broad functions of color matching according to the invention. A definition of the original color is received, in
box 10. Typically, this will be a set of numbers reflecting quantities of coloring agents which generate the original color. These quantities provide the information necessary to obtain a matching color, so that they should be expressed in a standard form such as the quantities of additive RGB phosphors in a pixel, the output of a calibrated colorimetric scanner, or another form which fully specifies the original color. - The definition of the original color is then used in
box 12 to determine the quantities of the coloring agents to be applied which will produce a matching color. The matching color may not be exactly the same as the original color, but it should closely approximate the original color and will ideally preserve color characteristics of an original image containing the original color, when viewed with matching colors in other parts of the image. Techniques for obtaining the optimal quantities of the coloring agents are discussed in more detail below. The coloring agent quantities are used inbox 14 to select a pattern of the coloring agents which, of the available patterns, most closely approximates those quantities. Because a limited number of patterns will typically be available, the precise quantities usually cannot be obtained, but this step selects the pattern which comes closest to those quantities. Then, inbox 16, the coloring agents are applied in the selected pattern to generate the matching color. - The technique of Fig. 3 may be implemented in many ways. We turn now to a specific implementation which also makes use of a novel technique for the step in
box 12. - A central problem in implementing the technique of Fig. 3 is to determine accurately the coloring agent quantities which will generate a color matching the original color. As noted above, it is desirable that the coloring agent quantities be determined without using a matrix or table which depends on the specific coloring agents, so that adjustments can be made for color changes in the coloring agents without recalculating all the values in the matrix or table. One aspect of the invention is based on the discovery of a computational technique which accurately determines coloring agent quantities directly from the definition of the original color. The computational technique makes use of linear mixing coordinates to convert the original color's numerical definition into coloring agent quantities.
- Figs. 4 and 5 illustrate linear mixing coordinates within the CIE color space, which is one example of a linear mixing color space. While some other color spaces, such as the RGB cubic color space of Fig. 1, are based on arbitrary mathematical models of color, the CIE color space is based on the actual response of the human eye-brain system to color. The CIE color space relies on a model, created in 1931, which defines color based in part on characteristics of the human perceptual system. For example, since colors are perceived differently In different parts of the human field of vision, the 1931 CIE model defined an observer as having the color response functions of an area within 2 degrees of arc of the center of vision. The colored object is illuminated by a standard light source. And the resulting perceived colors are mapped into a linear mixing color space, meaning that it obeys the rule that the mixing of two colors will result in another color along the line between those two colors, its position on this mixing line being linearly dependent on the relative quantities of the two colors being mixed.
- Fig. 4 shows a cross section of the CIE color space taken parallel to the x and y axes. The third axis, the Y axis, is orthogonal to the x and y axes and measures reflectance only, not hue or saturation, so that the x and y coordinates shown on the axes of Fig. 4 are sufficient to define any hue within the CIE color space. Within the cross section shown, the hues of the conventional RGB gamut and of a typical CMY gamut are outlined, and Fig. 4 shows that each of these gamuts is a subset of the hues within the CIE color space. Therefore, if the original color definition received in
box 10 includes additive RGB quantities, those quantities correspond to a point in the CIE color space with x,y, and Y coordinates, the hue of which is completely specified by the x and y coordinates. - Fig. 5 shows how color mixing may be performed in the CIE color space. Unlike the RGB color space of Fig. 1, the CIE color space is a linear mixing color space in which the mixing of two colors such as C1 and C2 produces a color along the line between C1 and C2 and spaced from them according to their relative quantities. In other words, the ratio between the distances P1 and P2 will be the same as the ratio between the quantities of the colors C1 and C2.
- Applying the relationship shown in Fig. 5 to the RGB and CMY gamuts shown in Fig. 4, it is apparent that mixing the colors at the vertices of one of the gamuts can generate only the colors within that gamut. The RGB gamut, based on the additive RGB phosphors of a CRT display, has three vertices, red, green and blue, and all the colors available with those phosphors fall within the triangle defined by those vertices. The CMY gamut, based on three subtractive CMY primaries and three subtractive RGB primaries obtained by superimposing CMY primaries, has six vertices, and all the colors available with those primaries fall within the hexagon defined by those vertices.
- Fig. 4 also illustrates that the color obtained by superimposing two primaries is not necessarily the same as would be obtained by mixing those two primaries in a pattern such as a dot pattern. The RGB primaries obtained by superimposing CMY primaries having transparent properties are not on the lines between the CMY primaries, shown as dashed lines, but rather fall outside those lines, providing a greater gamut than the restricted triangular gamut within the dashed lines which would be available by mixing only the three CMY primaries in patterns. Also, if the CMY primaries were completely opaque rather than somewhat transparent, only the restricted triangular gamut would be available.
- As used herein, "mixing" refers to the mixing of two or more coloring agents in adjacent areas of a pattern, with negligible superimposition. It will be understood that the dots or other areas of the pattern which contain distinct coloring agents must be small enough to be below the resolution limit of the human eye, so that the pattern is perceived as having a single color. The manner in which patterns are selected to approximate the coloring agent quantities is discussed in greater detail below.
- Considering Figs. 4 and 5 together, we can develop equations for obtaining a desired color Cd from quantities of two coloring agents C1 and C2 based on the lengths of the parts P1 and P2 of the linear mixing line between C1 and C2. If C1 and C2 are independent coloring agents which are not superimposed, then: Al/A2 = Pl/P2,
- where A1 and A2 are the areas occupied by each of the colors C1 and C2, respectively, within a pattern in which they are mixed to obtain Cd. In short, P1 and P2 are proportional to the respective areas which C1 and C2 occupy.
- lf C1 is an independent coloring agent, but C2 is obtained by superimposition of C1 and another independent coloring agent Cs, as occurs when one of the subtractive CMY primaries is mixed in a pattern with an adjacent subtractive RGB primary, then:
- AlIA3=(Pi + P2)/P2,
- in which A3 is the area occupied by C3. This is true because A1 includes an area A1' occupied solely by the color Ci and also includes the area A2 occupied by the color C2, while A3 includes only A2.
- Fig. 6 shows one technique according to the invention for determining coloring agent quantities making use of linear mixing as can be done in CIE color space. The technique begins with a preliminary step in
box 20, the measuring and storing of the coordinates of the coloring agents which will be used to generate the matching image. Although the coordinates could be in any appropriate color space, they are preferably the coordinates of each coloring agent in a linear mixing color space such as the CIE coordinates. Rather than measuring these coordinates each time an image is generated, it typically suffices to measure and store the coordinates of a representative sample of each coloring agent in advance, provided the variation about the measured values is relatively small. The actual measurement of the coordinates, however, is important because estimation of the coordinates, especially for the subtractive RGB primaries obtained by superimposition, is highly speculative and the coordinates depend on the composition and other characteristics of the coloring agents. Therefore, it is highly preferable to obtain accurate colorimetric measurements of each coloring agent which will be applied. For example, Table 1 shows actual measured CIE coordinates of a set of coloring agents used in one electrostatic printer. - The definition of the original color received in
box 10 in Fig. 3 leads to the remaining steps in the technique of Fig. 6. The step inbox 22 converts the original color's definition to coordinates in the same color space as those measured and stored inbox 20. If the definition is expressed as quantities of additive RGB colors which generate the original color, for example, standard techniques are well know for converting such quantities to CIE coordinates. See, for example, Wyszecki, G. and Stiles, W.S., Color Science, Concepts and Methods, Quantitative Data and Formulae, Second Ed., John Wiley and Sons, New York, 1982 and Raster Graphics Handbook, Conrac Corp., Covina, California, 1980. - To convert RGB coordinates to CIE coordinates, one approach would be to first obtain chromaticity coordinates using reference illuminant D65, a degree observer, CIE 1931, and Conrac typical graphic monitor phosphors:
- Assuming that the original color is chromatic, the coordinates in a linear mixing color space of both the original color and the coloring agents to be applied are known, but it is still necessary to convert the original color's coordinates into quantities of the coloring agents. More than two coloring agents will typically be needed because the original color will rarely fall precisely on one of the linear mixing lines between two of the coloring agents. The original color will sometimes fall outside of the three-dimensional gamut of colors which can be obtained by mixing the coloring agents, so that the conversion technique must obtain coloring agent quantities which generate an appropriate approximation of the original color. The next several steps in the technique of Fig. 6 solve these problems and determine coloring agent quantities based on the coordinates of the original color and the coordinates of the coloring agents to be applied.
- The step in
box 24 adjusts for out-of-bounds reflectance values, which occur when an original color is lower in reflectance than the black coloring agent or higher in reflectance than the white coloring agent. This adjustment could be done in any of several ways. For example, if the reflectance is lower than black, the quantity of the black coloring agent could be set to maximum, and if the reflectance is higher than white, the quantity of the white coloring agent could be set to maximum, so that original colors with out-of-bounds reflectances are matched with either black or white. This approach does not preserve any of the color variations between original colors with out-of-bounds reflectances, however. An approach which is preferable, because it preserves such variations is to compare the reflectance of the original color Yo with those of the white and black coloring agents; if it is less than the reflectance of black, it is made equal to the black reflectance Yb, but if it exceeds the reflectance of white, it is made equal to the white reflectance Yw. Another approach is to scale all the reflectances linearly into the reflectance range between the black and white coloring agents. - In boxes 26-34, the technique of Fig. 6 breaks down the problem of determining the coloring agent quantities into two parts, each involving linear mixing in a plane. First, a color referred to as the pure hue is found in a linear mixing plane like that shown in Figs. 4 and 5. Then, saturation and reflectance are adjusted in a linear mixing plane which includes the pure hue and the neutral coloring agents, white and black. In addition, the technique of Fig. 6 makes use of the fact that any color within the available gamut can be obtained by mixing at most four coloring agents--two of the primary colors at adjacent vertices of the hexagon in Fig. 4 and the two neutral coloring agents.
- Fig. 7 shows the hexagonal CMY color gamut of Fig. 4 divided into six color mixing triangles. Each triangle has as its base one side of the hexagon, with one of its base vertices being at the x, y coordinates of one of the subtractive CMY primaries and the other at the x, y coordinates of one of the subtractive RGB primaries. The third vertex of each color mixing triangle is a center point, preferably at the x, y coordinates of a neutral color, a color obtainable by mixing only the neutral coloring agents, white and black, without any of the other coionng agents.
- The available neutral colors range in reflectance from the white of the paper to the pure black of the black coloring agent. As shown in Table 1, however, the x and y coordinates of these two extremes of reflectance may not be exactly the same. If they are treated as the ends of the reflectance axis of the three-dimensional gamut of available colors, the reflectance axis will be skewed somewhat in relation to the Y axis of the CIE color space. The colors along the neutral mixing line between the white and black coloring agents are the only available neutral colors which can be generated using only white and black.
- The step in
box 26 in Fig. 6 determines the x, y coordinates of a center point on the neutral mixing line to be used in determining which pair of primary colors will be mixed to generate a matching color. The preferred center point is at the coordinates of the neutral color which has the same reflectance as the original color, because it yields an accurate choice of the two primary colors which, when mixed with the neutral coloring agents, white and black, will produce a color most closely matching the original color. This center point is also consistent with the preferred technique described below for adjusting saturation and reflectance to preserve color characteristics of an original image. - The coordinates of this neutral color can be calculated by first calculating the relative position of the original color's reflectance along the mixing line between the neutral coloring agents, white and black. The relative position tn of this neutral color can be obtained from the reflectances of the original color and the neutral coloring agents as follows:
- where Yo, Yb, and Yw are the reflectances or Y coordinates of the original color, the black coloring agent and the white coloring agent, respectively. Yo may have been adjusted in the step of
box 24, as described above. At this point, xn and yn, the x, y coordinates of the neutral color having the original color's reflectance, can be calculated as follows: - A number of other approaches could be used in selecting the center point, including using the x, y coordinates of the white coloring agent or of the black coloring agent. Indeed, both of these could be used, and if they result in selection of different pairs of primary colors or in substantially different proportions of matching coloring agents, an additional procedure may be used to determine which pair of primary colors or which proportions generate a matching color closer to the original color. For simplicity and accuracy, however, it is preferred to use the x, y coordinates of the neutral color having the original color's reflectance, as calculated above, as the center point coordinates.
- As noted above, Fig. 7 shows that the colors within each of the color mixing triangles can be obtained by mixing the two primaries corresponding to the base vertices of that triangle with the neutral coloring agents, white and black. The center point coordinates from
box 26 in Fig. 6 make it possible to select the pair of primary colors corresponding to the base vertices which can be mixed to obtain the matching color, inbox 28. Geometrically, a line projecting from the center point through the original color will intersect the base of one of the color mixing triangles, with the original color falling within the angle between the two primary colors at the ends of that base. Therefore, the appropriate pair of primary colors may be selected mathematically by going in a clockwise or counterclockwise direction around the hexagon and testing at each primary color whether the original color is at an angle ahead of or behind that primary color. The primary color at which the original color makes a transition by changing from being ahead to being behind is one primary color, and the previous primary color in the testing sequence is the other. The projecting line will intersect the line between these two primaries. - Fig. 8 shows a routine which can be used to select the first and second primary colors in
box 28, by going around the hexagon, mathematically testing each primary color in sequence to determine whether the original color changes from being ahead to being behind at that primary. Inbox 50, a primary color is selected to be tested first. This selection may be based on the RGB coordinates of the original color, with the lowest of the RGB coordinates indicating the complement of the CMY coloring agent highest in quantity. Therefore, the starting primary is preferably a coloring agent which precedes the highest CMY coloring agent in the testing sequence, to expedite finding the transition of the original color. For example, if the lowest of the RGB coordinates is red, then the highest of the CMY coloring agents is probably cyan, the complement of red, and the selected starting primary would be blue or magenta, which precede cyan as one proceeds in the clockwise direction around the hexagon. - The cross product of the current primary being tested and the original color is calculated in
box 52. This cross product is the vector cross product of two vectors, the first from the center point to the original color and the second from the center point to the primary being tested. The vector cross product yields a third vector, perpendicular to the plane of Fig. 7, whose magnitude will be positive when the first vector is to the left of the second vector and negative when the first vector is to the right of the second vector. See Foley, J. and Van Dam, A., Fundamentals of Interactive Computer Graphics, Addison-Wesley, Reading, Mass., 1984, pp. 453-455. The cross product magnitude CP may be calculated for each primary color as follows: - in which Xprimary and yprimary are the x, y coordinates of that primary color and the other coordinates have the same meanings as set forth above. The cross product magnitude CP is then compared with zero in
box 54, and if it is less than zero, the routine proceeds to the next primary color inbox 56 and returns tobox 52. If the cross product is greater than or equal to zero, however, then the original color might be within the preceding angle. The previous primary's cross product is calculated inbox 58 and is compared with zero inbox 60. If it is not less than zero, the original color is not within the preceding angle, so the routine proceeds to the next primary color inbox 56. If the previous primary's cross product is negative, however, then the original color is within the preceding angle and the primary being tested and the previous primary are selected inbox 62 as the pair of primary colors which will be mixed to generate the matching color. When a pair of primaries has been selected, the routine proceeds tobox 30 in Fig. 6. - The step in
box 30 finds the pure hue, the pure hue being a color of the same hue as the original color which can be generated without any neutral coloring agents. In other words the pure hue falls on the linear mixing line between two of the primary coloring agents, the two selected as described above. Once the pure hue is found, it can be adjusted inbox 32 by the addition of neutral coloring agents. Its saturation, which corresponds to the distance from the center point of the hexagon and is maximum at the mixing line between the primaries, can be decreased by adding the neutral coloring agents in appropriate quantities. Its reflectance, corresponding to its position along an axis perpendicular to the plane of the hexagon can be increased by adding white or decreased by adding black. Thus the generation of the matching color involves matching the hue, saturation and reflectance of the original color. - The hue of the original color corresponds to the angular orientation of a line projecting from the center point through the two-dimensional coordinates of the original color. All the points on this line share the same hue, and one of these points is at the intersection of the projecting line and the linear mixing line between the two selected primary colors. Therefore, the pure hue is found by determining the relative quantities of the two selected primaries which generate it, based on the position of the intersection point along the linear mixing line.
- Fig. 9 illustrates geometrically how the relative quantities of the selected primaries in the pure hue are calculated. The relative quantities can be calculated from the lengths of the parts into which the intersection point divides the linear mixing line, but those lengths are not previously known. Therefore, a useful intermediate step is to calculate the x, y coordinates of the intersection point corresponding to the pure hue.
- Fig. 9 shows the line projecting from the center point through the original color and the intersection point of that line with the linear mixing line. As discussed above, the center point preferably has the coordinates of the neutral color having the same reflectance as the original color. The pure hue's coordinates xpand yp may therefore be obtained by simultaneously solving for xp and ypin the slope equations for the two intersecting lines:
- (xp-xprimary 1)/(yp-yprimary1)= dx1/dyi and
- (xp-xn)/yp-yn) = dx2/dy2 where
- dx1=xprimary2-xprimary1,
- dyl =yprimary2'yprimary1.
- dx2=xo-xn, and
- dy2 = Yo-Yn.
-
- The step in
box 30 also includes finding the relative quantities P1 and P2 of the first and second primary colors, respectively, which generate the pure hue. As noted above in relation to Figs. 4 and 5, these relative quantities have the same ratio as the lengths of the parts of the linear mixing line. Therefore, the relative quantities can be calculated as fractions of the total length of the linear mixing line as follows: - These relative quantities can then be used to complete the calculation of the pure hue in
box 30 by obtaining its reflectance Yp: - Yp=P1Yprimary 1 + P2Ypr;mary2.
- At this point, the calculations relating to the linear mixing plane shown in Figs. 4 and 5 are completed, so we turn now to calculations in another linear mixing plane which includes the pure hue and the two neutral coloring agents. The purpose of these calculations is to adjust the saturation and reflectance of the pure hue to obtain the matching color, as shown in
box 32 in Fig. 6. Although these calculations could be performed in a number of ways, the result will preferably be a color which closely matches the original color and which, in combination with other matching colors, preserves the color characteristics of the original image. In other words, the adjustment instep 32 may be tailored to the specific image whose colors are being matched. A major consideration in preserving the color characteristics of the original image is how to treat an original color which is outside the three-dimensional gamut of available colors. In general, the relative quantities of the two primaries which generate the pure hue do not need to be adjusted, but the quantities of the neutral coloring agents which are mixed with them must be adjusted to provide a suitable approximation of an original color outside the gamut. Mixing in neutral coloring agents will change the saturation and reflectance of the pure hue, as discussed above, but it is usually possible to change these parameters while nonetheless preserving the color characteristics of the original image. For example, if the original image has colors which are distinguishable by saturation differences, the saturation differences can be preserved across a range of available saturation values. Similarly, if the original image has colors distinguishable by reflectance, reflectance differences can be preserved. In general, an appropriate compromise between preserving saturation characteristics and preserving reflectance characteristics can be found, and one of the advantages of the invention is that saturation and reflectance can be flexibly adjusted in whatever way is appropriate to the image being produced. - Figs. 10 and 11 illustrate an implementation of the step in
box 32 which preserves reflectance characteristics at the expense of saturation characteristics, an approach which is often useful and which may be especially desirable if the original image has many shades of colors outside the available reflectance image range. Fig. 10 illustrates geometrically the linear mixing plane which includes the pure hue, at coordinates xp, yp, Yp and the neutral coloring agents, white at xw, yw, Yw and black at Xb, yb, Yb. Fig. 10 also shows the triangle defined by these three colors and two lines of constant reflectance within that triangle, one at reflectance Yp and the other at the reflectance of the original color Yo. Fig. 10 shows the original color at xo, yo,Yo inside the triangle. The step inbox 24, discussed above, may ensure that Yb < Yo < Yw but the original color could also fall outside the triangle and to its right in Fig. 10. The technique of Figs. 10 and 11 adjusts the reflectance of the pure hue so that it falls on the line of constant reflectance Yo. If the original color falls outside the triangle, the matching color is the most saturated available color on that line, at xpn, ypn, Yo, but if the original color is in the triangle, the technique also adjusts the saturation of the matching color to that of the original color. - Fig. 11 shows steps implementing this technique to perform the step in
box 32 in Fig. 6. Inbox 70, Yo and Yp are compared to determine whether the pure hue must be adjusted toward white or black to obtain reflectance Yo. If Yo < Yp, black is selected as the neutral coloring agent inbox 72; otherwise, white is selected inbox 74. Then, inbox 76, the coordinates of the pure hue and the selected neutral coloring agent are used to obtain the x, y coordinates of a pure/neutral color which is the most saturated available color with reflectance yo. These coordinates xpn, Ypn can be obtained from: - At this point, adjustment of the reflectance is complete, but saturation may still be adjusted if the original color is not outside the triangle in Fig. 10. Therefore, the test in
box 78 compares Ao to Apn, shown in Fig. 10, to determine the position of the original color in relation to the pure/neutral color. This can be done by first calculating Ao and Apn as follows: - Then, if Ap/Apn X 1.0, the comparison in
box 78 yields a negative result, and the ratio Ap/Apn is selected inbox 80 as the pure/neutral ratio Rp/n, indicating the quantity of the pure/neutral color in the matching color and thereby adjusting saturation. But if Ao/Apn > 1.0, Rp/n is set to 1.0 inbox 82, because no adjustment of the saturation is possible. Sine Rp/nindicates the saturation adjustment of the pure hue, while tpn indicates the reflectance adjustment, the product of Rp/n and Tpn indicates the quantity of the pure hue after both adjustments. This product is used inbox 84 to find the coloring agent quantities, as discussed in more detail below in relation tobox 34 in Fig. 6. - Ordinarily in a printer, the white coloring agent is the white of the paper on which the other coloring agents are printed, so that the white coloring agent will be present wherever none of the other coloring agents is printed. Therefore, the only coloring agent quantities to be calculated in
box 34 in Fig. 6 are those of the black coloring agent and the two primary coloring agents which mix to provide the pure hue. As shown below, the quantity of black coloring agent can be directly calculated, while the quantities of the primaries must take into account the selection of the primary color pair inbox 28, since one of the primaries will be a simple CMY primary while the other will be an RGB primary formed by superimposition. - The quantity of black coloring agent ab can be directly calculated from the results of the previous calculations, as noted above. We know that the sum of all the coloring agent quantities must equal 1.0, and we also know that the reflectance of the matching color Yomust be equal to the sum of the products of each coloring agent quantity times the reflectance of that coloring agent in the linear mixing space. If we treat the pure hue as a single coloring agent, the only other coloring agents are white and black, yielding:
- But we know the values of Yo, Yw, Yp and Yb, and ap is equal to the product of the pure/neutral ratio Rp/n times tpn, so that we can directly calculate ab using this equation.
- Since the two primary coloring agents which make up the pure hue are a subtractive CMY primary and an adjacent subtractive RGB primary, the pure hue is actually generated from two of the subtractive CMY primaries. One CMY primary will be present throughout the pure hue areas, while the other CMY primary will be superimposed with the first only in the RGB primary areas. In addition, it may be necessary at this point to consider the particular characteristics of the equipment being used. Some machines have complete undercover removal for the black coloring agent, so that black does not cover the other coloring agents. Other machines, however, apply black over the CMY colors in the lower mixing triangle in Fig. 10, so that the quantities of the CMY primaries must be increased accordingly if Yo is less than Yp. In general, the quantity of the first CMY primary aprimary1 is the quantity of the pure hue ap. This will be true for all values of Yo if the equipment provides complete undercover removal. But if undercover removal does not occur, then if Yo is less than Yp, the quantity of the first CMY primary aprimaryi is the pure/neutral ratio Rp/n, without multiplying times tpn as in
box 84 in Fig. 11. In any case, the quantity of the second CMY primary aprimary3 is the product of the aprimaryi times the relative quantity of the RGB primary. - The relative quantity of the RGB primary is either P1 or P2, depending on whether it is the first or second primary, as discussed above in relation to
box 30 in Fig. 6. Therefore, the quantities aprimary 1 and aprimary3 can be assigned based on the first primary. If the first primary was cyan, for example, the quantity of cyan ac is aprimaryi while the quantity of yellow ay is P2aprimaryi and the quantity of magenta am is zero; but if the first primary was blue, ac still equals aprimaryl, but ay=0 and am=P1aprimary 1.If the first primary was green, ay=aprimary 1, ac=P1aprimary 1 and am=0; if the first primary was yellow, ay=aprimaryl, ac=0 and am=P2aprimary 1 ; if the first primary was red, am=aprimary 1, ay=Piaprimaryi and ac=0; and if the first primary was magenta, am=aprimaryi, ay=0 and ac=P2aprimary 1. This completes the determination of coloring agent quantities. - The step in
box 36 selects a pattern for application of the coloring agents which will most closely match the coloring agent quantities calculated inbox 34, taking into account the operation of the equipment which applies the coloring agents. As noted above, the patterns produced by a piece of equipment should be relatively stable over time, so that it will be worthwhile to have a table indicating the percentages of area coverage for each available pattern on that equipment. To the extent that the pattern depends on whether a specific area has a coloring agent applied to it or the white coloring agent in the paper is left exposed, it may be necessary in preparing such tables to treat the area coverage of white differently than the other coloring agents. If the equipment applies dots, for example, the dots may be larger than the spacing between dot centers, so that dots may overlap, resulting in non-linear area coverage with increasing dot density. Therefore, it is generally preferable to determine the area coverage for each dot pattern independently, as discussed below in relation to creating area coverage tables. It would also be possible to take into account the differences between the coloring agents other than white, but those differences are likely to be small enough to be negligible for most purposes. - In
box 36, the pattern whose area coverages most closely match the coloring agent quantities is selected by an appropriate comparison algorithm. From the above discussion, it is apparent that ab, aprimaryi and aprimary 3 are sufficient to specify the coloring agent quantities. Therefore, these quantities can be compared with the area coverage percentages of the available patterns to find a pattern which provides approximately the appropriate coloring agent quantities. For completeness, however, it would be necessary to know the area coverage percentages of all available patterns, a formidable task in view of the tremendous number of permutations and combinations of quantities of coloring agents. Therefore, it is desirable to find a simpler approach to this comparison. - In simplifying the comparison, it is helpful to recognize that the separate pattern for each coloring agent can ordinarily be treated independently of the other coloring agents with which it is mixed to obtain a combined pattern. Therefore, it is usually satisfactory to compare each of the three quantities ab, aprimaryi and aprimary3 with the area coverage percentages of the available patterns for the corresponding coloring agent to find the closest pattern for that coloring agent. The three separate patterns chosen in this way can then be combined in a single pattern to obtain the matching color. The effectiveness of this approach depends on choosing patterns for different coloring agents which result in the desired interaction effects. Although there will be some interaction between the separate patterns of different coloring agents, the effects of interaction can be reduced so that they are less than the actual variation within each pattern or increased to obtain superimposition of coloring agents. For example, one set of patterns can be selected to be used for the CMY primaries, with another used for black, so that the black patterns have minimal interaction with any of the CMY primaries, but so that the two CMY primaries have maximal interaction to obtain an RGB primary in the area where both are applied. A technique for obtaining the area coverage percentage for each such pattern is discussed in greater detail below in relation to creating area coverage tables.
- By analyzing the area coverage percentages of the patterns, a set of patterns can be selected which will obtain a given level of accuracy in color matching. If the coloring agent quantities need only match the area coverage percentages to a given level of accuracy, then the patterns may be selected so that the differences between their area coverage percentages are just small enough to ensure that level of accuracy.
- Finally, the selected combined pattern of coloring agents is applied to generate the matching color, in
box 38. It would also be appropriate, of course, to store a representation of the combined pattern in memory together with all the other patterns making up a complete image, and then generate the entire image at some later time. - The method of color matching described above may be performed on many types of equipment. We turn now to an apparatus which matches color according to the invention and can be used in a printer, for example.
- Fig. 12 is a functional block diagram showing the components of a
color matching apparatus 100 according to the invention.Apparatus 100 may also perform other control functions within a printer or other image- producing equipment, but the components shown generally relate to the function of generating a color which matches an original color. - Fig. 12
shows apparatus 100 centered around central processing unit (CPU) 110 which receives data through aninput 112 and provides data through anoutput 114 to aprinting mechanism 116 or other color producing equipment.CPU 110 may be any appropriate processor, such as a microprocessor. During operation,CPU 110 executes instructions retrieved fromprogram memory 120 and retrieves and stores data indata memory 140. -
Program memory 120 illustratively includes color-matching routine 122 during the execution of whichCPU 110 operates according to the present invention. Color-matching routine 122 calls a number of subroutines which correspond to functions described above in relation to the method of the invention. These includequantities calculation subroutine 124, originalcolor conversion subroutine 126,pattern selection subroutine 128 andpattern application subroutine 130. In addition, of course,program memory 120 includes other programs whichCPU 110 executes to perform functions other than color matching.CPU 110 may, for example, control all the functions ofprinting mechanism 116. -
Data memory 140 illustratively includes coloring agent coordinates 142, coordinate conversion table 144, area coverage table 146, andadditional data memory 148 including registers and otherdata permitting CPU 110 to execute instructions fromprogram memory 120. Coloring agent coordinates 142, as discussed above in relation to Table 1, are previously measured and stored. Similarly, coordinate conversion table 144 is a standard table for converting coordinates used to generate a CRT color display to linear mixing coordinates. Area coverage table 146, which may be generated in the manner described below, should reflect the characteristics ofprinting mechanism 116 and the toners being used. - During execution of color matching routine 122,
CPU 110 receives the original color's coordinates throughinput 112 or retrieves previously calculated or received original color coordinates fromadditional data memory 148. In executing originalcolor conversion subroutine 126,CPU 110 retrieves the original color's linear mixing coordinates from coordinate conversion table 144. In executingquantities calculation subroutine 124,CPU 110 retrieves coloring agent coordinates 142 and uses them to calculate coloring agent quantities. Duringpattern selection subroutine 128,CPU 110 compares the calculated quantities with the stored area coverages of available patterns to find the pattern most closely approximating the calculated quantities. And duringpattern application subroutine 130,CPU 110 performs conventional techniques for distributing dots within a printed area in accordance with the selected pattern, such as dithering or half-toning. In general,CPU 110 will follow the steps discussed above in relation to the method of the invention. - Area coverage table 146 provides one available technique for selecting the pattern of coloring agents which will most closely approximate the quantities of coloring agents in the matching color. Other techniques are available, including calculation of area coverage based on an appropriate algorithm, but area coverage table 146 is an extremely fast way of finding the most closely matching pattern. We turn now to a technique for creating the area coverage table 146.
- If the coloring agent quantities are correctly determined, and if a pattern of coloring agents is applied which is substantially the same as those quantities, then the resulting color will match the original color. Therefore, the selection of the pattern which most closely approximates the coloring agent quantities is important in successful color matching. For the selection to be accurate, the comparison of the quantities with the patterns must be properly performed, and this also requires that the appropriate data about the patterns be available for comparison. The area coverage table is created to provide those data.
- It is helpful to consider briefly the data about the patterns which are desirable in making a comparison with the coloring agent quantities. A colorimeter could be used to find CIE coordinates for a number of patterns of the coloring agents, but CIE coordinates cannot readily be compared with coloring agent quantities. Furthermore, a change in one of the coloring agents would invalidate the CIE coordinates for many of the patterns, leading to one of the problems which the present invention solves, namely the need to recreate an entire table or matrix each time a coloring agent's color changes.
- This aspect of the present invention is based on the discovery that, rather than comparing the coloring agent quantities with a pattern's CIE coordinates, it is more appropriate to compare them with the areas covered by the coloring agents in that pattern. If the area coverages of the coloring agents in the pattern are the same or nearly the same as the coloring agent quantities, the pattern generates the matching color.
- The technique of creating an area coverage table according to the invention begins with the printing of a number of available patterns of one of the coloring agents. The patterns which are printed should cover the range of desired area coverage from a blank pattern with zero area covered to a solid pattern with complete coverage. Then, the CIE coordinates of each printed pattern are measured using a colorimeter.
- The measured reflectance values thus range from the reflectance Ymin for the solid pattern to the reflectance Ymax for the blank pattern, which will ordinarily be the reflectance of the paper. These values are then used to estimate the area coverage for each pattern. The area coverage Aj for the ith pattern with measured reflectance Yi can be estimated as follows:
- Al = (Ymax - Yi)/(Ymax - Ymln).
- The estimated value of AI may be adequate for purposes of comparison with the coloring agent quantities, in which case an appropriate group of patterns providing the desired level of resolution can be selected for inclusion in the area coverage table.
- If the estimated values of Ai are not adequate because of measurement errors, the estimated values can be mathematically corrected. Mathematical correction can reduce errors introduced by the measurement process, because the number of colored dots in a pattern should bear a predictable mathematical relation to the area coverage. Fig. 13 shows graphically the mathematical relationship between the number of dots and the area coverage percentage of a Bayer pattern, for example, and a similar relationship should be obtainable for any set of patterns. The mathematical correction process should involve curve fitting and smoothing of the area coverages calculated from the measured reflectance values so that they follow a curve more closely resembling the expected mathematical relationship for the patterns being used. In other words, some of the calculated area coverage values are corrected based on the values calculated for other patterns. Conventional techniques for curve fitting and smoothing are appropriate for this correction process.
- The table of patterns derived from printing each coloring agent separately in this manner is easy to create and also facilitates comparison with coloring agent quantities. On the other hand, it may be necessary to use more complicated techniques in creating a table. For example, the area coverages could first be estimated based on a mathematical model of the relationship between number of dots and area coverage percentage, after which measurements of actual area coverage could be made to correct the estimates, if necessary. The total number of possible patterns on a given printer may be extremely large, so that an important aspect of creating the area coverage table is to select a group of patterns which is small enough to be manageable, but large enough to provide a satisfactory approximation to any set of quantities of coloring agents. For an electrostatic printer at eight dots per mm and 8 x 8 patterns, about 36-40 patterns should suffice, but at 16 dots per mm and 16 x 16 patterns, 60- 100 patterns will be needed. Similarly, 60- 100 patterns will be needed for a thermal printer at 12 dots per mm and 16 x 16 patterns. The technique described above can be used to select a group of patterns meeting the color resolution criteria of the printer or other color-producing equipment.
- The color-matching technique of the invention has been compared with other color-matching techniques, including a conventional half-tone method and a Bayer 4x4 dither method. The Macbeth ColorChecker defined the original colors. The invention proved superior to the other techniques, producing colors nearly identical to the originals, while the other techniques did not. The Munsell color chart revealed, however, that the color matching technique of the invention accurately matches all colors except for low chroma or nearly achromatic colors, in which shifts in hue occur. These shifts result, however, not from a weakness in the technique but from the coarseness of the available patterns of coloring agents, which do not allow adjustment when the quantity of a color to be applied is less than the area coverage percentage of a single dot. Therefore, this can be solved by providing finer patterns in which each dot has a smaller area coverage percentage. For a new set of patterns, of course, it will be necessary to recalculate the area coverage percentage of each available pattern.
- The technique of the invention has been discussed in relation to converting CRT colors based on additive RGB phosphors into printed colors based on subtractive CMY toners, but is equally applicable to any other color- matching problem. For example, instead of RGB color coordinates, HLS or LUV coordinates could be received and converted into coordinates in a linear mixing color space from which coloring agent quantities could then be determined. Colors printed on an electrostatic printer could be matched to thermally printed colors, and printed colors could be matched on a CRT display.
- The technique for the invention may be readily modified for the particular color-matching task at hand. For instance, in color-matching RGB coordinates developed to generate CRT colors, it is sometimes found that the reflectances of the original colors after conversion to CIE coordinates typically exceed the reflectance of the white coloring agent to be applied. This problem can be solved by scaling the reflectance values so that they all fit between the reflectances of the white and black coloring agents.
Claims (12)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US06/919,113 US4751535A (en) | 1986-10-15 | 1986-10-15 | Color-matched printing |
US919113 | 1986-10-15 |
Publications (3)
Publication Number | Publication Date |
---|---|
EP0264281A2 true EP0264281A2 (en) | 1988-04-20 |
EP0264281A3 EP0264281A3 (en) | 1989-10-11 |
EP0264281B1 EP0264281B1 (en) | 1994-07-27 |
Family
ID=25441530
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP87309118A Expired - Lifetime EP0264281B1 (en) | 1986-10-15 | 1987-10-15 | Color-matched printing |
Country Status (6)
Country | Link |
---|---|
US (1) | US4751535A (en) |
EP (1) | EP0264281B1 (en) |
JP (1) | JPS63105574A (en) |
CA (1) | CA1292581C (en) |
DE (1) | DE3750286T2 (en) |
ES (1) | ES2056827T3 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0454273A2 (en) * | 1990-04-26 | 1991-10-30 | Bayer Corporation | RGB color database and method for creating same |
EP0473432A2 (en) * | 1990-08-29 | 1992-03-04 | Xerox Corporation | Color printing |
EP0550212A1 (en) * | 1991-12-30 | 1993-07-07 | Xerox Corporation | Method for improved color reproduction |
EP0592147A2 (en) * | 1992-10-05 | 1994-04-13 | Canon Information Systems, Inc. | Color reproduction method and apparatus |
EP0606841A1 (en) * | 1993-01-12 | 1994-07-20 | E.I. Du Pont De Nemours And Company | Method for color image reproduction |
EP0684728A1 (en) * | 1994-05-26 | 1995-11-29 | Agfa-Gevaert N.V. | Colour matching by systems calibration, linear and non-linear gamut mapping |
US5481655A (en) * | 1992-09-18 | 1996-01-02 | Iris Graphics, Inc. | System for matching a picture on a monitor to a printed picture |
US5500921A (en) * | 1992-10-05 | 1996-03-19 | Canon Information Systems, Inc. | Method and apparatus for printing high fidelity color reproductions of colors displayed on a monitor |
EP1841238A3 (en) * | 2002-10-16 | 2008-04-16 | Eastman Kodak Company | Broad gamut color display apparatus using an electromechanical grating device |
Families Citing this family (84)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4905164A (en) * | 1986-12-19 | 1990-02-27 | General Electric Company | Method for modulating color for effecting color cell texture |
US4954889A (en) * | 1987-04-30 | 1990-09-04 | Nec Home Electronics Ltd. | Color masking circuit and color video printer using the same |
GB8722406D0 (en) * | 1987-09-23 | 1987-10-28 | Crosfield Electronics Ltd | Reproduction of coloured images |
US5065233A (en) * | 1988-08-24 | 1991-11-12 | Minolta Camera Kabushiki Kaisha | Color image forming apparatus |
US5157506A (en) * | 1990-08-29 | 1992-10-20 | Savitar, Inc. | Standardized color calibration of electronic imagery |
US5172224A (en) * | 1990-12-18 | 1992-12-15 | Eastman Kodak Company | Printer calibration method using electronically-decoupled color and tone scale adjustments |
JPH05183743A (en) * | 1992-01-06 | 1993-07-23 | Canon Inc | Color expressing method and color picture processor |
US5485284A (en) * | 1992-01-06 | 1996-01-16 | Canon Kabushiki Kaisha | Image processing system for performing color image data calibration |
JP3143508B2 (en) * | 1992-01-08 | 2001-03-07 | キヤノン株式会社 | Image processing method and apparatus |
US5909291A (en) * | 1992-03-19 | 1999-06-01 | Apple Computer, Inc. | Color matching apparatus and method |
US5377024A (en) * | 1992-05-04 | 1994-12-27 | Hewlett-Packard | Apparatus for forming color images using a hue-plus-gray color model |
US5473446A (en) * | 1992-05-04 | 1995-12-05 | Hewlett-Packard Company | Color digital halftoning using black and secondary color replacement and color vector dithering |
US5963201A (en) * | 1992-05-11 | 1999-10-05 | Apple Computer, Inc. | Color processing system |
DE69324899T2 (en) * | 1992-12-15 | 1999-10-21 | E.I. Du Pont De Nemours And Co., Wilmington | Color matching method and device |
US5754184A (en) * | 1993-01-06 | 1998-05-19 | Eastman Kodak Company | Digital color system and method which provides a visual match across different input and output viewing conditions |
US5508826A (en) * | 1993-04-27 | 1996-04-16 | Lloyd; William J. | Method and apparatus for calibrated digital printing using a four by four transformation matrix |
US5574666A (en) * | 1994-05-13 | 1996-11-12 | Canon Information Systems, Inc. | Color printing method and apparatus using gamut mapping in Munsell space |
US5450216A (en) * | 1994-08-12 | 1995-09-12 | International Business Machines Corporation | Color image gamut-mapping system with chroma enhancement at human-insensitive spatial frequencies |
US6072902A (en) * | 1995-05-03 | 2000-06-06 | Apple Computer, Inc. | Method and system for color matching between digital display devices |
US5754302A (en) * | 1996-05-24 | 1998-05-19 | Xerox Corporation | Color order in predicting pile height constraints in a xerographic color printing system |
US6539110B2 (en) | 1997-10-14 | 2003-03-25 | Apple Computer, Inc. | Method and system for color matching between digital display devices |
US6417863B1 (en) * | 1999-04-28 | 2002-07-09 | Intel Corporation | Color balancing a multicolor display |
JP2001045310A (en) * | 1999-07-28 | 2001-02-16 | Canon Inc | Image processor, image processing method and recording medium |
US6870523B1 (en) | 2000-06-07 | 2005-03-22 | Genoa Color Technologies | Device, system and method for electronic true color display |
US7283142B2 (en) * | 2000-07-28 | 2007-10-16 | Clairvoyante, Inc. | Color display having horizontal sub-pixel arrangements and layouts |
US8022969B2 (en) * | 2001-05-09 | 2011-09-20 | Samsung Electronics Co., Ltd. | Rotatable display with sub-pixel rendering |
US6950115B2 (en) * | 2001-05-09 | 2005-09-27 | Clairvoyante, Inc. | Color flat panel display sub-pixel arrangements and layouts |
US7274383B1 (en) | 2000-07-28 | 2007-09-25 | Clairvoyante, Inc | Arrangement of color pixels for full color imaging devices with simplified addressing |
WO2002011112A2 (en) | 2000-07-28 | 2002-02-07 | Clairvoyante Laboratories, Inc. | Arrangement of color pixels for full color imaging devices with simplified addressing |
AU2002216348A1 (en) * | 2000-12-18 | 2002-07-01 | Genoa Color Technologies Ltd. | Spectrally matched print proofer |
US7352488B2 (en) * | 2000-12-18 | 2008-04-01 | Genoa Color Technologies Ltd | Spectrally matched print proofer |
US7123277B2 (en) | 2001-05-09 | 2006-10-17 | Clairvoyante, Inc. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7184066B2 (en) | 2001-05-09 | 2007-02-27 | Clairvoyante, Inc | Methods and systems for sub-pixel rendering with adaptive filtering |
US7221381B2 (en) * | 2001-05-09 | 2007-05-22 | Clairvoyante, Inc | Methods and systems for sub-pixel rendering with gamma adjustment |
AU2002309213A1 (en) | 2001-06-07 | 2002-12-16 | Genoa Technologies Ltd. | System and method of data conversion for wide gamut displays |
US7714824B2 (en) * | 2001-06-11 | 2010-05-11 | Genoa Color Technologies Ltd. | Multi-primary display with spectrally adapted back-illumination |
WO2002101644A2 (en) * | 2001-06-11 | 2002-12-19 | Genoa Technologies Ltd. | Device, system and method for color display |
US8289266B2 (en) * | 2001-06-11 | 2012-10-16 | Genoa Color Technologies Ltd. | Method, device and system for multi-color sequential LCD panel |
IL159972A0 (en) * | 2001-07-23 | 2004-06-20 | Genoa Technologies Ltd | System and method for displaying an image |
JP2003136783A (en) * | 2001-10-31 | 2003-05-14 | Mitsumi Electric Co Ltd | Printer |
AU2002353139A1 (en) | 2001-12-14 | 2003-06-30 | Clairvoyante Laboratories, Inc. | Improvements to color flat panel display sub-pixel arrangements and layouts with reduced visibility of a blue luminance well |
US20030117423A1 (en) * | 2001-12-14 | 2003-06-26 | Brown Elliott Candice Hellen | Color flat panel display sub-pixel arrangements and layouts with reduced blue luminance well visibility |
US7417648B2 (en) * | 2002-01-07 | 2008-08-26 | Samsung Electronics Co. Ltd., | Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels |
US20040051724A1 (en) * | 2002-09-13 | 2004-03-18 | Elliott Candice Hellen Brown | Four color arrangements of emitters for subpixel rendering |
US7492379B2 (en) * | 2002-01-07 | 2009-02-17 | Samsung Electronics Co., Ltd. | Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with increased modulation transfer function response |
US7755652B2 (en) | 2002-01-07 | 2010-07-13 | Samsung Electronics Co., Ltd. | Color flat panel display sub-pixel rendering and driver configuration for sub-pixel arrangements with split sub-pixels |
AU2003208563A1 (en) * | 2002-01-07 | 2003-07-24 | Moshe Ben-Chorin | Electronic color display for soft proofing |
AU2003219505A1 (en) * | 2002-04-11 | 2003-10-27 | Moshe Ben-Chorin | Color display devices and methods with enhanced attributes |
AU2003281594A1 (en) * | 2002-07-24 | 2004-02-09 | Moshe Ben-Chorin | High brightness wide gamut display |
US6956581B2 (en) * | 2002-09-19 | 2005-10-18 | Lexmark International, Inc. | Gamut mapping algorithm for business graphics |
US20040080479A1 (en) * | 2002-10-22 | 2004-04-29 | Credelle Thomas Lioyd | Sub-pixel arrangements for striped displays and methods and systems for sub-pixel rendering same |
US6776473B2 (en) * | 2002-12-16 | 2004-08-17 | Lexmark International, Inc. | Method of mixing multi-level black and color inks in a printing system |
US7046256B2 (en) * | 2003-01-22 | 2006-05-16 | Clairvoyante, Inc | System and methods of subpixel rendering implemented on display panels |
US8228275B2 (en) | 2003-01-28 | 2012-07-24 | Genoa Color Technologies Ltd. | Optimal subpixel arrangement for displays with more than three primary colors |
US20040164101A1 (en) * | 2003-02-20 | 2004-08-26 | Valois Sas | Fluid dispenser |
US6917368B2 (en) * | 2003-03-04 | 2005-07-12 | Clairvoyante, Inc. | Sub-pixel rendering system and method for improved display viewing angles |
US7167186B2 (en) * | 2003-03-04 | 2007-01-23 | Clairvoyante, Inc | Systems and methods for motion adaptive filtering |
US20040196302A1 (en) | 2003-03-04 | 2004-10-07 | Im Moon Hwan | Systems and methods for temporal subpixel rendering of image data |
US7352374B2 (en) * | 2003-04-07 | 2008-04-01 | Clairvoyante, Inc | Image data set with embedded pre-subpixel rendered image |
US20040233308A1 (en) * | 2003-05-20 | 2004-11-25 | Elliott Candice Hellen Brown | Image capture device and camera |
US7230584B2 (en) * | 2003-05-20 | 2007-06-12 | Clairvoyante, Inc | Projector systems with reduced flicker |
US7268748B2 (en) * | 2003-05-20 | 2007-09-11 | Clairvoyante, Inc | Subpixel rendering for cathode ray tube devices |
EP1660937A2 (en) * | 2003-08-04 | 2006-05-31 | Genoa Color Technologies Ltd. | Multi-primary color display |
US7598961B2 (en) * | 2003-10-21 | 2009-10-06 | Samsung Electronics Co., Ltd. | method and apparatus for converting from a source color space to a target color space |
US7525526B2 (en) * | 2003-10-28 | 2009-04-28 | Samsung Electronics Co., Ltd. | System and method for performing image reconstruction and subpixel rendering to effect scaling for multi-mode display |
US7084923B2 (en) * | 2003-10-28 | 2006-08-01 | Clairvoyante, Inc | Display system having improved multiple modes for displaying image data from multiple input source formats |
US7495722B2 (en) * | 2003-12-15 | 2009-02-24 | Genoa Color Technologies Ltd. | Multi-color liquid crystal display |
US7145656B2 (en) * | 2003-12-15 | 2006-12-05 | E. I. Du Pont De Nemours And Company | Computer-implemented method for matching paint |
US7483095B2 (en) * | 2003-12-15 | 2009-01-27 | Genoa Color Technologies Ltd | Multi-primary liquid crystal display |
US7379207B2 (en) * | 2004-01-14 | 2008-05-27 | Xerox Corporation | Method and system for device-independent color gamut mapping |
US7619637B2 (en) * | 2004-04-09 | 2009-11-17 | Samsung Electronics Co., Ltd. | Systems and methods for improved gamut mapping from one image data set to another |
US7301543B2 (en) * | 2004-04-09 | 2007-11-27 | Clairvoyante, Inc. | Systems and methods for selecting a white point for image displays |
US7248268B2 (en) * | 2004-04-09 | 2007-07-24 | Clairvoyante, Inc | Subpixel rendering filters for high brightness subpixel layouts |
US20050250821A1 (en) * | 2004-04-16 | 2005-11-10 | Vincent Sewalt | Quaternary ammonium compounds in the treatment of water and as antimicrobial wash |
US7590299B2 (en) * | 2004-06-10 | 2009-09-15 | Samsung Electronics Co., Ltd. | Increasing gamma accuracy in quantized systems |
CN1882103B (en) * | 2005-04-04 | 2010-06-23 | 三星电子株式会社 | Systems and methods for implementing improved gamut mapping algorithms |
JP4976782B2 (en) * | 2005-09-07 | 2012-07-18 | キヤノン株式会社 | Signal processing method, image display device, and television device |
WO2007060672A2 (en) * | 2005-11-28 | 2007-05-31 | Genoa Color Technologies Ltd. | Sub-pixel rendering of a multiprimary image |
GB2435572A (en) * | 2006-02-24 | 2007-08-29 | Ava Cad Cam Group Ltd | Selecting a set of inks for colour process printing |
US7592996B2 (en) * | 2006-06-02 | 2009-09-22 | Samsung Electronics Co., Ltd. | Multiprimary color display with dynamic gamut mapping |
US7876341B2 (en) * | 2006-08-28 | 2011-01-25 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
US8018476B2 (en) | 2006-08-28 | 2011-09-13 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
US8405868B2 (en) * | 2006-09-27 | 2013-03-26 | Andrew Jackson | Method, apparatus and technique for enabling individuals to create and use color |
US8259127B2 (en) * | 2006-09-30 | 2012-09-04 | Samsung Electronics Co., Ltd. | Systems and methods for reducing desaturation of images rendered on high brightness displays |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4614967A (en) * | 1982-06-14 | 1986-09-30 | Canon Kabushiki Kaisha | Method and apparatus for reproducing a color image using additive and subtractive primary colors |
EP0203448A2 (en) * | 1985-05-28 | 1986-12-03 | Tektronix, Inc. | Matching hardcopy color to display color |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6018929B2 (en) * | 1977-10-13 | 1985-05-13 | スガ試験機株式会社 | color display device |
US4522491A (en) * | 1979-09-17 | 1985-06-11 | Ingalls Marjorie D | Method for reproducing one or more target colors on photographic paper or the like |
JPS57100580A (en) * | 1980-12-15 | 1982-06-22 | Fuji Photo Film Co Ltd | Ink jet printer |
JPS57197191A (en) * | 1981-05-30 | 1982-12-03 | Fuji Photo Film Co Ltd | Ink jet color print system |
US4536848A (en) * | 1982-04-15 | 1985-08-20 | Polaroid Corporation | Method and apparatus for colored computer graphic photography |
JPS59121074A (en) * | 1982-12-27 | 1984-07-12 | Ricoh Co Ltd | Color image formation |
JPH0767141B2 (en) * | 1983-11-18 | 1995-07-19 | キヤノン株式会社 | Color image processor |
JPS60105376A (en) * | 1983-11-14 | 1985-06-10 | Toshiba Corp | Color picture output device |
-
1986
- 1986-10-15 US US06/919,113 patent/US4751535A/en not_active Expired - Lifetime
-
1987
- 1987-09-02 CA CA000545965A patent/CA1292581C/en not_active Expired - Fee Related
- 1987-10-07 JP JP62253446A patent/JPS63105574A/en active Granted
- 1987-10-15 DE DE3750286T patent/DE3750286T2/en not_active Expired - Fee Related
- 1987-10-15 EP EP87309118A patent/EP0264281B1/en not_active Expired - Lifetime
- 1987-10-15 ES ES87309118T patent/ES2056827T3/en not_active Expired - Lifetime
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4614967A (en) * | 1982-06-14 | 1986-09-30 | Canon Kabushiki Kaisha | Method and apparatus for reproducing a color image using additive and subtractive primary colors |
EP0203448A2 (en) * | 1985-05-28 | 1986-12-03 | Tektronix, Inc. | Matching hardcopy color to display color |
Non-Patent Citations (2)
Title |
---|
ALLES UEBER FERNSEHEN, VIDEO, SATELLIT, DITTEL, vgs 1989, pages 113-117 * |
SECOND INTERNATIONAL CONGRESS ON ADVANCES IN NON-IMPACT PRINTING TECHNOLOGIES, November 1984, pages 61-65; P.G. ENGELDRUM: "Four color reproduction theory for dot formed imaging systems" * |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0454273A3 (en) * | 1990-04-26 | 1992-09-02 | Agfa Corporation | Rgb color database and method for creating same |
EP0454273A2 (en) * | 1990-04-26 | 1991-10-30 | Bayer Corporation | RGB color database and method for creating same |
EP0473432A2 (en) * | 1990-08-29 | 1992-03-04 | Xerox Corporation | Color printing |
EP0473432A3 (en) * | 1990-08-29 | 1992-08-26 | Xerox Corporation | Color printing |
US5237517A (en) * | 1990-08-29 | 1993-08-17 | Xerox Corporation | Color printing having a highlight color image mapped from a full color image |
EP0550212A1 (en) * | 1991-12-30 | 1993-07-07 | Xerox Corporation | Method for improved color reproduction |
US5481655A (en) * | 1992-09-18 | 1996-01-02 | Iris Graphics, Inc. | System for matching a picture on a monitor to a printed picture |
EP0592147A2 (en) * | 1992-10-05 | 1994-04-13 | Canon Information Systems, Inc. | Color reproduction method and apparatus |
US5438649A (en) * | 1992-10-05 | 1995-08-01 | Canon Information Systems, Inc. | Color printing method and apparatus which compensates for Abney effect |
EP0592147A3 (en) * | 1992-10-05 | 1994-06-15 | Canon Information Syst Inc | Color reproduction method and apparatus |
US5500921A (en) * | 1992-10-05 | 1996-03-19 | Canon Information Systems, Inc. | Method and apparatus for printing high fidelity color reproductions of colors displayed on a monitor |
EP0606841A1 (en) * | 1993-01-12 | 1994-07-20 | E.I. Du Pont De Nemours And Company | Method for color image reproduction |
EP0684728A1 (en) * | 1994-05-26 | 1995-11-29 | Agfa-Gevaert N.V. | Colour matching by systems calibration, linear and non-linear gamut mapping |
EP1841238A3 (en) * | 2002-10-16 | 2008-04-16 | Eastman Kodak Company | Broad gamut color display apparatus using an electromechanical grating device |
Also Published As
Publication number | Publication date |
---|---|
EP0264281B1 (en) | 1994-07-27 |
CA1292581C (en) | 1991-11-26 |
US4751535A (en) | 1988-06-14 |
JPS63105574A (en) | 1988-05-10 |
EP0264281A3 (en) | 1989-10-11 |
DE3750286D1 (en) | 1994-09-01 |
DE3750286T2 (en) | 1995-05-18 |
JPH0578227B2 (en) | 1993-10-28 |
ES2056827T3 (en) | 1994-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0264281B1 (en) | Color-matched printing | |
EP0550212B1 (en) | Method for improved color reproduction | |
US5596428A (en) | Color matching by systems calibration, linear and non-linear gamut mapping | |
US5398121A (en) | Method and device for generating a digital lookup table for printing inks in image reproduction equipment | |
US6181445B1 (en) | Device-independent and medium-independent color matching between an input device and an output device | |
US4884130A (en) | Method of describing a color in a triaxial planar vector color space | |
EP0574905B1 (en) | Method and apparatus for forming color images | |
EP1047263B1 (en) | Color image reproduction with accurate inside-gamut colors and enhanced outside-gamut colors | |
US5572632A (en) | Universal frame buffer for a rendering device | |
US4929978A (en) | Color correction method for color copier utilizing correction table derived from printed color samples | |
EP1022897B1 (en) | Image processing and color conversion | |
US5243414A (en) | Color processing system | |
US5748342A (en) | Image processing apparatus and method | |
US5999703A (en) | Computer program product for modifying the black channel of an output device profile without altering its colorimetric accuracy | |
US5561751A (en) | System and method for displaying a color image using vector error diffusion | |
US5481655A (en) | System for matching a picture on a monitor to a printed picture | |
US6204939B1 (en) | Color matching accuracy inside and outside the gamut | |
EP0423653B1 (en) | Method and apparatus for compensating for color in color images | |
US5857063A (en) | Multicolorant process control | |
EP0203448A2 (en) | Matching hardcopy color to display color | |
EP0562971A1 (en) | Method and apparatus for adaptive color characterization and calibration | |
US20050185200A1 (en) | Systems, methods, and computer program products for converting between color gamuts associated with different image processing devices | |
Katoh et al. | Three-dimensional gamut mapping using various color difference formulae and color spaces | |
JPH07323614A (en) | Method for forming printer table and generator therefor | |
US6160644A (en) | Scanner calibration technique to overcome tone inversion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE ES FR GB IT |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): DE ES FR GB IT |
|
17P | Request for examination filed |
Effective date: 19900411 |
|
17Q | First examination report despatched |
Effective date: 19920430 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE ES FR GB IT |
|
REF | Corresponds to: |
Ref document number: 3750286 Country of ref document: DE Date of ref document: 19940901 |
|
ET | Fr: translation filed | ||
ITF | It: translation for a ep patent filed | ||
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2056827 Country of ref document: ES Kind code of ref document: T3 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20021008 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20021009 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20021017 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20021031 Year of fee payment: 16 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20031015 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20031016 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040501 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20031015 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040630 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20031016 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20051015 |