JP2005332054A - Image processing method, image processor, image recording device and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve the brightness reproducibility of an object by calculating an index quantitatively representing a photographic scene from photographic image data, and deciding image processing conditions based on the calculated index. <P>SOLUTION: This image adjustment processing part 701 divides photographic image data into regions constituted of the combination of predetermined brightness and hue, and calculates an occupancy rate showing the rate of the occupancy of each of the divided regions to the overall photographic image data, and calculates an index to specify a photographic scene by multiplying the calculated occupancy rate of each region by a coefficient preliminarily set according to photographic conditions. Then, the photographic scene of the photographic image data is discriminated based on the calculated index, and a method for gradation adjustment for the photographic image data is decided according to the discriminated photographic scene. Then, gradation conversion processing is operated to the photographic image data by using the decided gradation adjusting method. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing method, an image processing apparatus, an image recording apparatus for forming an image on an output medium, and an image processing program.

  Conventionally, the brightness correction of a film scan image or a digital camera image has been performed by correcting the average brightness of the entire image to a value desired by the user. In normal shooting, the light source conditions such as forward light, backlight, and strobe light fluctuate in various ways, resulting in a large area with a large luminance deviation in the image. Additional correction using values calculated by regression analysis was necessary. However, the discriminant regression analysis method has a problem that it is difficult to discriminate a shooting scene because parameters calculated from a strobe scene and a backlight scene are very similar.

  Patent Document 1 discloses a method for calculating an additional correction value in place of the discriminant regression analysis method. In the method described in Patent Document 1, a luminance histogram indicating the cumulative number of pixels (frequency number) of luminance is deleted from the high luminance region and the sub luminance region, and further, the luminance average is used by using the frequency number limited. A value is calculated, and a difference between the average value and the reference luminance is obtained as a correction value.

  Patent Document 2 describes a method of determining a light source state at the time of photographing in order to compensate for the extraction accuracy of a face region. In the method described in Patent Document 2, first, a face candidate area is extracted, and a deviation of the average luminance of the extracted face candidate area with respect to the entire image is calculated. When the deviation amount is large, a shooting scene (backlight shooting or strobe proximity shooting) And the permissible width of the determination criterion as the face area is adjusted. Japanese Patent Laid-Open No. 6-67320 discloses a method of using a two-dimensional histogram of hue and saturation, Japanese Patent Laid-Open No. 8-122944, and Japanese Patent Laid-Open No. 8-184925. And pattern matching and pattern search methods described in Japanese Patent Laid-Open No. 9-138471.

Further, in Patent Document 2, as a background area removal method other than the face, the ratio of the straight line portion, the line object property, and the outer edge of the screen described in JP-A-8-122944 and JP-A-8-184925 are described. A method of determining using a contact rate, density contrast, density change pattern and periodicity is cited. A method using a one-dimensional histogram of density is described for discrimination of a photographic scene. This method is based on an empirical rule that the face area is dark and the background area is bright in the case of backlight, and the face area is bright and the background area is dark in the case of close-up flash photography.
JP 2002-247393 A JP 2000-148980 A

  However, although the technique described in Patent Document 1 reduces the influence of a region with a large luminance deviation in a backlight or strobe scene, the brightness of the face region is inappropriate in a shooting scene having a person as a main subject. There was a problem that there was. In addition, the technique described in Patent Document 2 can achieve the effect of compensating for the identification of the face area in the case of typical backlighting or close-up flash photography, but if it does not apply to the typical composition, There was a problem that the effect could not be obtained.

  An object of the present invention is to improve the lightness reproducibility of a subject by calculating an index that quantitatively represents a shooting scene (light source condition) of captured image data and determining an image processing condition based on the calculated index. It is to let you.

According to the first aspect of the present invention, the captured image data is divided into regions each having a predetermined combination of brightness and hue, and an occupancy ratio indicating the proportion of the entire captured image data is calculated for each of the divided regions. An occupancy ratio calculating step,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to the second aspect of the present invention, the captured image data is divided into regions each having a predetermined combination of brightness and hue, and an occupancy ratio indicating the proportion of the entire captured image data is calculated for each of the divided regions. An occupancy ratio calculating step,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

According to the third aspect of the present invention, the captured image data is divided into regions each having a predetermined combination of brightness and hue, and an occupancy ratio indicating the proportion of the entire captured image data is calculated for each of the divided regions. An occupancy calculation step to perform,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step; It is characterized by including.

According to the fourth aspect of the present invention, the captured image data is divided into a predetermined region composed of a combination of the distance from the outer edge of the screen of the captured image data and the brightness, and the captured image data is divided for each of the divided regions. An occupancy ratio calculating step for calculating an occupancy ratio indicating the ratio of the whole;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to the fifth aspect of the present invention, the captured image data is divided into a predetermined area composed of a combination of the distance from the outer edge of the screen of the captured image data and the brightness, and the captured image data is divided for each of the divided areas. An occupancy ratio calculating step for calculating an occupancy ratio indicating a ratio to the whole;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining step for determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

According to the sixth aspect of the present invention, the captured image data is divided into a predetermined area composed of a combination of the distance from the outer edge of the screen of the captured image data and the brightness, and the captured image data is divided for each of the divided areas. An occupancy ratio calculating step for calculating an occupancy ratio indicating a ratio to the whole;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step; It is characterized by including.

According to the seventh aspect of the present invention, the photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupation indicating a ratio of the divided regions to the whole photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating step of calculating a second occupancy ratio indicating a ratio;
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to the eighth aspect of the present invention, the captured image data is divided into regions each having a predetermined combination of brightness and hue, and a first occupation indicating a ratio of the divided regions to the entire captured image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating step of calculating a second occupancy ratio indicating a ratio;
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

The invention according to claim 9 divides the photographed image data into regions composed of a combination of predetermined lightness and hue, and a first occupation indicating a ratio of the divided regions to the whole photographed image data. The ratio is calculated, and the photographed image data is divided into a predetermined region composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the divided region occupies the entire photographed image data An occupancy ratio calculating step of calculating a second occupancy ratio indicating a ratio;
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step; It is characterized by including.

According to a tenth aspect of the present invention, in the image processing method according to any one of the fourth to sixth aspects, the cumulative number of pixels is calculated for each distance and brightness from the outer edge of the screen of the captured image data. Including the step of creating a two-dimensional histogram,
In the occupation rate calculation step, the occupation rate is calculated based on the created two-dimensional histogram.

According to an eleventh aspect of the present invention, in the image processing method according to any one of the seventh to ninth aspects, the cumulative number of pixels is calculated for each distance and brightness from the outer edge of the screen of the captured image data. Including the step of creating a two-dimensional histogram,
In the occupancy rate calculating step, the second occupancy rate is calculated based on the created two-dimensional histogram.

According to a twelfth aspect of the present invention, in the image processing method according to any one of the first to third aspects, a two-dimensional histogram is obtained by calculating a cumulative pixel number for each predetermined hue and brightness of the photographed image data. Including the process of creating
In the occupation rate calculation step, the occupation rate is calculated based on the created two-dimensional histogram.

A thirteenth aspect of the present invention is the image processing method according to any one of the seventh to ninth aspects, wherein a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data. Including the process of creating
In the occupation rate calculating step, the first occupation rate is calculated based on the created two-dimensional histogram.

  The invention according to claim 14 is the image processing method according to any one of claims 1 to 3, 7 to 9, and 11 to 13, wherein in the index calculation step, a skin color hue region having a predetermined high brightness is selected. The coefficient of a different sign is used for the hue area other than the high brightness skin color hue area.

  The invention according to claim 15 is the image processing method according to any one of claims 1 to 3, 7 to 9, and 11 to 14, wherein in the index calculation step, an intermediate brightness area of a flesh hue area, It is characterized in that coefficients having different signs are used in lightness regions other than the intermediate lightness region.

  According to a sixteenth aspect of the present invention, in the image processing method according to the fourteenth aspect, a lightness region of a hue region other than the high lightness skin color hue region is a predetermined high lightness region.

  According to a seventeenth aspect of the present invention, in the image processing method according to the fifteenth aspect, the lightness area other than the intermediate lightness area is a lightness area within a flesh-color hue area.

  According to an eighteenth aspect of the present invention, in the image processing method according to the fourteenth or sixteenth aspect, the high brightness skin color hue region includes a region in the range of 170 to 224 in terms of the brightness value of the HSV color system. It is characterized by that.

  According to a nineteenth aspect of the present invention, in the image processing method according to the fifteenth or seventeenth aspect, the intermediate lightness region includes a region in the range of 85 to 169 as a lightness value of the HSV color system. It is said.

  The invention according to claim 20 is the image processing method according to any one of claims 14, 16, and 18, wherein a hue region other than the high brightness skin color hue region includes a blue hue region and a green hue region. It is characterized by including at least one of these.

  According to a twenty-first aspect of the present invention, in the image processing method according to any one of the fifteenth, seventeenth, and nineteenth aspects, a lightness area other than the intermediate lightness area is a shadow area.

  The invention according to claim 22 is the image processing method according to claim 20, wherein a hue value of the blue hue region is in a range of 161 to 250 as a hue value of the HSV color system, and the green hue region The hue value is a hue value of the HSV color system and is in the range of 40 to 160.

  According to a twenty-third aspect of the present invention, in the image processing method according to the twenty-first aspect, the brightness value of the shadow area is in the range of 26 to 84 as the brightness value of the HSV color system.

  According to a twenty-fourth aspect of the present invention, in the image processing method according to any one of the fourteenth to twenty-third aspects, the hue value of the flesh-colored hue region is a hue value of HSV color system 0 to 39 and 330 to It is characterized by being in the range of 359.

  According to a twenty-fifth aspect of the present invention, in the image processing method according to any one of the fourteenth to twenty-fourth aspects, the skin color hue region is divided into two regions by a predetermined conditional expression based on brightness and saturation. It is characterized by that.

The invention described in claim 26 divides the photographed image data into regions composed of a combination of predetermined brightness and hue, and calculates an occupancy ratio indicating a proportion of the entire photographed image data for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

The invention described in claim 27 divides the photographed image data into regions composed of a combination of predetermined brightness and hue, and calculates an occupancy ratio indicating the ratio of the entire photographed image data for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

The invention described in claim 28 divides the photographed image data into regions composed of a combination of predetermined brightness and hue, and calculates an occupancy ratio indicating the proportion of the entire photographed image data for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means; It is characterized by having.

The invention described in claim 29 divides the photographed image data into predetermined regions comprising a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data for each of the divided regions. An occupancy ratio calculating means for calculating an occupancy ratio indicating a ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to a thirty-third aspect of the present invention, the photographed image data is divided into a predetermined area composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data is divided for each of the divided areas. An occupancy ratio calculating means for calculating an occupancy ratio indicating a ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

The invention described in claim 31 divides the photographed image data into predetermined regions composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data for each of the divided regions. An occupancy ratio calculating means for calculating an occupancy ratio indicating a ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means; It is characterized by having.

According to a thirty-second aspect of the present invention, the photographed image data is divided into regions each having a predetermined combination of brightness and hue, and the first occupation indicating the ratio of the divided regions to the whole photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to a thirty-third aspect of the present invention, the photographed image data is divided into regions each having a predetermined combination of brightness and hue, and the first occupation indicating the ratio of the divided regions to the whole photographed image data is divided. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the photographed image data based on the determined gradation adjustment amount.

The invention described in claim 34 divides the photographed image data into regions composed of combinations of predetermined brightness and hue, and a first occupancy indicating a ratio of the divided regions to the entire photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means; It is characterized by having.

According to a thirty-fifth aspect of the present invention, in the image processing apparatus according to any one of the twenty-ninth to thirty-first aspects, by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the captured image data. A creation means for creating a two-dimensional histogram;
The occupancy rate calculation means calculates the occupancy rate based on the created two-dimensional histogram.

According to a thirty-sixth aspect of the present invention, in the image processing apparatus according to any one of the thirty-second to thirty-fourth aspects, by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data. A creation means for creating a two-dimensional histogram;
The occupancy rate calculation means calculates the second occupancy rate based on the created two-dimensional histogram.

A thirty-seventh aspect of the present invention is the image processing apparatus according to any one of the twenty-sixth to twenty-eighth aspects, wherein a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and brightness of the photographed image data. With creation means to create
The occupancy rate calculation means calculates the occupancy rate based on the created two-dimensional histogram.

According to a thirty-eighth aspect of the present invention, in the image processing apparatus according to any one of the thirty-second to thirty-fourth aspects, a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and lightness of the photographed image data. With creation means to create
The occupancy rate calculation means calculates the first occupancy rate based on the created two-dimensional histogram.

  The invention described in claim 39 is the image processing apparatus according to any one of claims 26-28, 32-34, 36-38, wherein the index calculating means includes a skin color hue region having a predetermined high brightness. In addition, a coefficient having a different sign is used for a hue area other than the high brightness skin color hue area.

  In the image processing apparatus according to any one of claims 26 to 28, 32 to 34, and 36 to 39, the index calculation unit includes: an intermediate brightness area of a flesh color hue area; A feature is that a coefficient having a different sign is used in the lightness region other than the intermediate lightness region.

  The invention according to claim 41 is the image processing apparatus according to claim 39, characterized in that the brightness area of the hue area other than the high brightness skin color hue area is a predetermined high brightness area.

  The invention according to claim 42 is the image processing apparatus according to claim 40, characterized in that the lightness area other than the intermediate lightness area is a lightness area in the flesh-color hue area.

  The invention according to claim 43 is the image processing apparatus according to claim 39 or 41, wherein the skin color hue region of high brightness includes a region in the range of 170 to 224 in terms of brightness value of the HSV color system. It is characterized by that.

  According to a 44th aspect of the present invention, in the image processing apparatus according to the 40th or 42th aspect, the intermediate lightness region includes a region in the range of 85 to 169 as a lightness value of the HSV color system. It is said.

  The invention according to claim 45 is the image processing apparatus according to any one of claims 39, 41, and 43, wherein the hue area other than the high brightness skin color hue area includes a blue hue area and a green hue area. It is characterized by including at least one of these.

  According to a forty-sixth aspect of the present invention, in the image processing apparatus according to any one of the forty, forty-second and forty-fourth aspects, the brightness area other than the intermediate brightness area is a shadow area.

  According to a 47th aspect of the present invention, in the image processing apparatus according to the 45th aspect, a hue value of the blue hue region is in a range of 161 to 250 as a hue value of an HSV color system, and the green hue region The hue value is a hue value of the HSV color system and is in the range of 40 to 160.

  According to a 48th aspect of the present invention, in the image processing apparatus according to the 46th aspect, the lightness value of the shadow area is in the range of 26 to 84 as the lightness value of the HSV color system.

  According to a 49th aspect of the present invention, in the image processing device according to any one of the 39th to 48th aspects, the hue value of the flesh color hue region is a hue value of HSV color system in a range of 0 to 39 and 330 to It is characterized by being in the range of 359.

  According to a fifty-fifth aspect of the present invention, in the image processing device according to any one of the thirty-ninth to the forty-ninth aspects, the skin color hue region is divided into two regions according to a predetermined conditional expression based on brightness and saturation. It is characterized by that.

The invention according to claim 51 divides the photographed image data into regions composed of a combination of predetermined brightness and hue, and calculates an occupancy ratio indicating a proportion of the entire photographed image data for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention according to claim 52 divides the photographed image data into regions composed of combinations of predetermined brightness and hue, and calculates an occupancy ratio indicating the proportion of the entire photographed image data for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

According to the invention of claim 53, the photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and an occupation ratio indicating a ratio of the whole photographed image data is calculated for each of the divided regions. Occupancy ratio calculating means to
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention described in claim 54 divides the photographed image data into predetermined regions composed of combinations of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data for each of the divided regions. An occupancy ratio calculating means for calculating an occupancy ratio indicating a ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

In the invention according to claim 55, the photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data is divided for each of the divided areas. An occupancy ratio calculating means for calculating an occupancy ratio indicating the ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention described in claim 56 divides the photographed image data into predetermined regions composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and the photographed image data for each of the divided regions. An occupancy ratio calculating means for calculating an occupancy ratio indicating a ratio of the whole;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention described in claim 57 divides the photographed image data into regions composed of a combination of predetermined brightness and hue, and a first occupation indicating the ratio of the divided regions to the entire photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention described in claim 58 divides the photographed image data into regions composed of a combination of predetermined lightness and hue, and the first occupation indicating the ratio of the divided regions to the entire photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

The invention described in claim 59 divides the photographed image data into regions composed of a combination of a predetermined brightness and hue, and a first occupation indicating the ratio of the divided regions to the entire photographed image data. The ratio is calculated, and the photographed image data is divided into predetermined regions each composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and each of the divided regions occupies the entire photographed image data. An occupancy ratio calculating means for calculating a second occupancy ratio indicating a ratio;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
And means for forming the image data subjected to the gradation conversion processing on an output medium.

According to a sixty-sixth aspect of the present invention, in the image recording device according to any one of the twenty-fourth to fifty-sixth aspects, by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data. A creation means for creating a two-dimensional histogram;
The occupancy rate calculation means calculates the occupancy rate based on the created two-dimensional histogram.

The invention according to claim 61 is the image recording apparatus according to any one of claims 57 to 59, wherein the number of accumulated pixels is calculated for each distance and brightness from the outer edge of the screen of the photographed image data. A creation means for creating a two-dimensional histogram;
The occupancy rate calculation means calculates the second occupancy rate based on the created two-dimensional histogram.

The invention according to claim 62 is the image recording apparatus according to any one of claims 51 to 53, wherein a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and lightness of the photographed image data. With creation means to create
The occupancy rate calculation means calculates the occupancy rate based on the created two-dimensional histogram.

According to a 63rd aspect of the present invention, in the image recording apparatus according to any one of the 57th to 59th aspects, a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data. With creation means to create
The occupancy rate calculation means calculates the first occupancy rate based on the created two-dimensional histogram.

  The invention described in Item 64 is the image recording device described in any one of Items 51-53, 57-59, 61-63, wherein the index calculating means includes a skin color hue region having a predetermined high brightness. In addition, a coefficient having a different sign is used for a hue area other than the high brightness skin color hue area.

  The invention according to claim 65 is the image recording apparatus according to any one of claims 51 to 53, 57 to 59, 61 to 64, wherein the index calculating means includes an intermediate brightness area of a flesh color hue area, A feature is that a coefficient having a different sign is used in the lightness region other than the intermediate lightness region.

  According to a 66th aspect of the present invention, in the image recording apparatus according to the 64th aspect, the brightness area of the hue area other than the high brightness skin color hue area is a predetermined high brightness area.

  According to a 67th aspect of the present invention, in the image recording apparatus according to the 65th aspect, the lightness area other than the intermediate lightness area is a lightness area within a flesh-color hue area.

  According to a 68th aspect of the present invention, in the image recording apparatus according to the 64th or 66th aspect, the high lightness skin color hue region includes a region having a lightness value of 170 to 224 in the HSV color system. It is characterized by that.

  According to a 69th aspect of the present invention, in the image recording apparatus according to the 65th or 67th aspect, the intermediate brightness area includes an area in the range of 85 to 169 in terms of brightness values of the HSV color system. It is said.

  The invention according to claim 70 is the image recording apparatus according to any one of claims 64, 66, and 68, wherein the hue area other than the high brightness skin color hue area includes a blue hue area and a green hue area. It is characterized by including at least one of these.

  The invention according to claim 71 is the image recording apparatus according to any one of claims 65, 67 and 69, wherein the brightness area other than the intermediate brightness area is a shadow area.

  According to a 72nd aspect of the present invention, in the image recording apparatus according to the 70th aspect, a hue value of the blue hue region is in a range of 161 to 250 as a hue value of an HSV color system, and the green hue region The hue value is a hue value of the HSV color system and is in the range of 40 to 160.

  The invention described in Item 73 is the image recording apparatus described in Item 71, wherein the brightness value of the shadow area is in the range of 26 to 84 as the brightness value of the HSV color system.

  According to a 74th aspect of the present invention, in the image recording apparatus according to any one of the 64-th to 73rd aspects, the hue value of the flesh-colored hue region is a hue value of HSV color system of 0 to 39 and 330 to It is characterized by being in the range of 359.

  According to a 75th aspect of the present invention, in the image recording device according to any one of the 64-th to 74th aspects, the skin color hue region is divided into two regions according to a predetermined conditional expression based on brightness and saturation. It is characterized by that.

According to an embodiment of the present invention, the photographed image data is divided into regions each having a combination of predetermined brightness and hue, and the photographed image data is divided into the divided regions for each computer. An occupancy ratio calculation function for calculating an occupancy ratio indicating the ratio of the total,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to a 77th aspect of the present invention, in a computer for executing image processing, the photographed image data is divided into regions composed of combinations of predetermined brightness and hue, and the photographed image data is divided into the divided regions. An occupancy ratio calculation function for calculating an occupancy ratio indicating the ratio of the total,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount.

The invention according to claim 78 is a computer for executing image processing, wherein the photographed image data is divided into regions each having a predetermined combination of brightness and hue, and the photographed image data is divided into the divided regions. An occupancy rate calculation function that calculates an occupancy rate indicating the proportion of the total,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function; Is an image processing program for realizing the above.

According to an 79th aspect of the present invention, a captured image data is divided into a predetermined area composed of a combination of the distance from the outer edge of the screen of the captured image data and the brightness, and the computer for executing image processing is divided. An occupancy ratio calculation function for calculating an occupancy ratio indicating a ratio of the entire captured image data for each of the areas obtained;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to an 80th aspect of the present invention, a computer for executing image processing divides photographed image data into predetermined regions composed of combinations of distance and brightness from the outer edge of the screen of the photographed image data. An occupancy ratio calculation function for calculating an occupancy ratio indicating a ratio of the entire captured image data for each of the areas obtained;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount.

The invention according to claim 81 divides the photographed image data into a predetermined area composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness to a computer for executing image processing. An occupancy ratio calculation function for calculating an occupancy ratio indicating a ratio of the entire captured image data for each of the areas obtained;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function; Is an image processing program for realizing the above.

The invention according to claim 82 is a computer for executing image processing, wherein the photographed image data is divided into regions composed of combinations of predetermined brightness and hue, and the photographed image data is divided into the divided regions. While calculating the 1st occupation rate which shows the ratio for the whole, image | photographed image data is divided | segmented into the predetermined area | region which consists of the combination from the distance from the outer edge of the screen of the said image | photographed image data, and the said brightness | luminance An occupancy ratio calculating function for calculating a second occupancy ratio indicating the ratio of the entire captured image data,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method.

According to an 83rd aspect of the present invention, in a computer for executing image processing, the photographed image data is divided into regions composed of combinations of predetermined brightness and hue, and the photographed image data is divided for each of the divided regions. While calculating the 1st occupation rate which shows the ratio for the whole, image | photographed image data is divided | segmented into the predetermined area | region which consists of the combination from the distance from the outer edge of the screen of the said image | photographed image data, and the said brightness | luminance An occupancy ratio calculating function for calculating a second occupancy ratio indicating the ratio of the entire captured image data,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
An image processing program for realizing a gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount.

According to an 84th aspect of the present invention, in a computer for executing image processing, the photographed image data is divided into regions composed of combinations of predetermined brightness and hue, and the photographed image data is divided for each of the divided regions. While calculating the 1st occupation rate which shows the ratio for the whole, image | photographed image data is divided | segmented into the predetermined area | region which consists of the combination from the distance from the outer edge of the screen of the said image | photographed image data, and the said brightness | luminance An occupancy ratio calculating function for calculating a second occupancy ratio indicating the ratio of the entire captured image data,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function; Is an image processing program for realizing the above.

The invention described in Item 85 is the image processing program described in any one of Items 79-81, by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data. Realize creation function to create 2D histogram,
When the occupancy rate calculation function is realized, the occupancy rate is calculated based on the created two-dimensional histogram.

The invention described in Item 86 is the image processing program described in any one of Items 82-84, by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data. Realize creation function to create 2D histogram,
When realizing the occupancy rate calculation function, the second occupancy rate is calculated based on the created two-dimensional histogram.

According to an 87th aspect of the present invention, in the image processing program according to any one of the 76th to 78th aspects, a two-dimensional histogram is calculated by calculating the cumulative number of pixels for each predetermined hue and brightness of the photographed image data. Realize the creation function to create,
When the occupancy rate calculation function is realized, the occupancy rate is calculated based on the created two-dimensional histogram.

According to an 88th aspect of the present invention, in the image processing program according to any one of the 82nd to 84th aspects, a two-dimensional histogram is calculated by calculating a cumulative number of pixels for each predetermined hue and brightness of the photographed image data. Realize the creation function to create,
When realizing the occupancy rate calculating function, the first occupancy rate is calculated based on the created two-dimensional histogram.

  According to an 89th aspect of the present invention, in the image processing program according to any one of the 76th to 78th, 82th to 84th, and 86th to 88th, when the index calculation function is realized, a predetermined high brightness is obtained. It is characterized in that coefficients having different signs are used in the flesh-color hue area and the hue area other than the high-brightness flesh-color hue area.

  In the image processing program according to any one of claims 76 to 78, 82 to 84, and 86 to 89, the invention according to a 90th aspect is the middle of the flesh color hue region when the index calculation function is realized. A feature is that coefficients of different signs are used in the brightness area and brightness areas other than the intermediate brightness area.

  The invention according to claim 91 is the image processing program according to claim 89, characterized in that the brightness area of the hue area other than the high brightness skin color hue area is a predetermined high brightness area.

  The invention according to claim 92 is the image processing program according to claim 90, wherein the brightness area other than the intermediate brightness area is a brightness area in the flesh-color hue area.

  The invention according to claim 93 is the image processing program according to claim 89 or 91, wherein the skin color hue region of high brightness includes a region in the range of 170 to 224 in terms of brightness values of the HSV color system. It is characterized by that.

  According to a 94th aspect of the present invention, in the image processing program according to the 90th or 92th aspect, the intermediate lightness area includes an area in the range of 85 to 169 as a lightness value of the HSV color system. It is said.

  The invention according to claim 95 is the image processing program according to any one of claims 89, 91, 93, wherein the hue area other than the high-brightness skin color hue area includes a blue hue area and a green hue area. It is characterized by including at least one of these.

  According to a 96th aspect of the present invention, in the image processing program according to any one of the 90th, 92th, and 94th aspects, a lightness area other than the intermediate lightness area is a shadow area.

  The invention according to claim 97 is the image processing program according to claim 95, wherein a hue value of the blue hue region is in a range of 161 to 250 as a hue value of the HSV color system, and the green hue region The hue value is a hue value of the HSV color system and is in the range of 40 to 160.

  According to a 98th aspect of the present invention, in the image processing program according to the 96th aspect, the lightness value of the shadow area is in the range of 26 to 84 as the lightness value of the HSV color system.

  According to a 99th aspect of the present invention, in the image processing program according to any one of the 89th to 98th aspects, the hue value of the flesh color hue region is a hue value of HSV color system 0-39 and 330- It is characterized by being in the range of 359.

  According to a 100th aspect of the present invention, in the image processing program according to any one of the 89th to 99th aspects, the skin color hue region is divided into two regions by a predetermined conditional expression based on brightness and saturation. It is characterized by that.

  According to the present invention, an index that quantitatively indicates a shooting scene of captured image data is calculated, a shooting scene is determined based on the calculated index, and gradation adjustment for the captured image data is performed according to the determination result. By determining the method, it is possible to appropriately correct the brightness of the subject.

  In addition, it is possible to appropriately correct the brightness of the subject by calculating an index quantitatively indicating the shooting scene of the captured image data and determining the gradation adjustment amount of the captured image data based on the calculated index. It becomes.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
First, the configuration in the present embodiment will be described.

  FIG. 1 is a perspective view showing an external configuration of an image recording apparatus 1 according to an embodiment of the present invention. As shown in FIG. 1, the image recording apparatus 1 is provided with a magazine loading unit 3 for loading a photosensitive material on one side of a housing 2. Inside the housing 2 are provided an exposure processing unit 4 for exposing the photosensitive material, and a print creating unit 5 for developing and drying the exposed photosensitive material to create a print. On the other side surface of the housing 2, a tray 6 for discharging the print created by the print creation unit 5 is provided.

  In addition, a CRT (Cathode Ray Tube) 8 serving as a display device, a film scanner unit 9 serving as a device for reading a transparent document, a reflective document input device 10, and an operation unit 11 are provided on the upper portion of the housing 2. The CRT 8 constitutes display means for displaying an image of image information to be printed on the screen. Further, the housing 2 includes an image reading unit 14 that can read image information recorded on various digital recording media, and an image writing unit 15 that can write (output) image signals to various digital recording media. Yes. In addition, a control unit 7 that centrally controls these units is provided inside the housing 2.

  The image reading unit 14 includes a PC card adapter 14a and a floppy (registered trademark) disk adapter 14b, and a PC card 13a and a floppy (registered trademark) disk 13b can be inserted therein. The PC card 13a has, for example, a memory in which a plurality of frame image data captured by a digital camera is recorded. For example, a plurality of frame image data captured by a digital camera is recorded on the floppy (registered trademark) disk 13b. Examples of the recording medium on which frame image data is recorded other than the PC card 13a and the floppy (registered trademark) disk 13b include a multimedia card (registered trademark), a memory stick (registered trademark), MD data, and a CD-ROM. .

  The image writing unit 15 is provided with a floppy (registered trademark) disk adapter 15a, an MO adapter 15b, and an optical disk adapter 15c, into which an FD 16a, an MO 16b, and an optical disk 16c can be respectively inserted. Examples of the optical disc 16c include a CD-R and a DVD-R.

  In FIG. 1, the operation unit 11, the CRT 8, the film scanner unit 9, the reflection original input device 10, and the image reading unit 14 are integrally provided in the housing 2. One or more may be provided separately.

  Further, in the image recording apparatus 1 shown in FIG. 1, there is exemplified an apparatus that creates a print by exposing to a photosensitive material and developing it, but the print creation system is not limited to this, for example, an inkjet system, an electronic system, etc. A method such as a photographic method, a thermal method, or a sublimation method may be used.

<Main part configuration of image recording apparatus 1>
FIG. 2 shows a main part configuration of the image recording apparatus 1. As shown in FIG. 2, the image recording apparatus 1 includes a control unit 7, an exposure processing unit 4, a print generation unit 5, a film scanner unit 9, a reflection original input device 10, an image reading unit 14, a communication means (input) 32, The image writing unit 15, data storage unit 71, template storage unit 72, operation unit 11, CRT 8, and communication unit (output) 33 are configured.

The control unit 7 is constituted by a microcomputer, and various control programs stored in a storage unit (not shown) such as a ROM (Read Only Memory) and a CPU (Central Processing).
Unit) (not shown) controls the operation of each unit constituting the image recording apparatus 1 in cooperation with the unit.

  The control unit 7 includes an image processing unit 70 according to the image processing apparatus of the present invention, and is read from the film scanner unit 9 or the reflective original input device 10 based on an input signal (command information) from the operation unit 11. Image processing is performed on the image signal, the image signal read from the image reading unit 14, and the image signal input from the external device via the communication unit 32 to form exposure image information, and the exposure processing unit 4 Output. Further, the image processing unit 70 performs a conversion process corresponding to the output form on the image signal subjected to the image processing, and outputs the image signal. Output destinations of the image processing unit 70 include the CRT 8, the image writing unit 15, the communication means (output) 33, and the like.

  The exposure processing unit 4 exposes an image to the photosensitive material and outputs the photosensitive material to the print creating unit 5. The print creating unit 5 develops and exposes the exposed photosensitive material to create prints P1, P2, and P3. The print P1 is a service size, high-definition size, panoramic size print, the print P2 is an A4 size print, and the print P3 is a business card size print.

  The film scanner unit 9 reads a frame image recorded on a transparent original such as a developed negative film N or a reversal film imaged by an analog camera, and acquires a digital image signal of the frame image. The reflective original input device 10 reads an image on a print P (photo print, document, various printed materials) by a flat bed scanner, and acquires a digital image signal.

  The image reading unit 14 reads frame image information recorded on the PC card 13 a or the floppy (registered trademark) disk 13 b and transfers the frame image information to the control unit 7. The image reading unit 14 includes, as the image transfer means 30, a PC card adapter 14a, a floppy (registered trademark) disk adapter 14b, and the like. The image reading unit 14 reads frame image information recorded on the PC card 13a inserted into the PC card adapter 14a or the floppy (registered trademark) disk 13b inserted into the floppy (registered trademark) disk adapter 14b. Transfer to the control unit 7. For example, a PC card reader or a PC card slot is used as the PC card adapter 14a.

  The communication means (input) 32 receives an image signal representing a captured image and a print command signal from another computer in the facility where the image recording apparatus 1 is installed, or a distant computer via the Internet or the like.

  The image writing unit 15 includes, as the image conveying unit 31, a floppy (registered trademark) disk adapter 15a, an MO adapter 15b, and an optical disk adapter 15c. In accordance with a write signal input from the control unit 7, the image writing unit 15 includes a floppy (registered trademark) disk 16a inserted into the floppy (registered trademark) disk adapter 15a, an MO 16b inserted into the MO adapter 15b, The image signal generated by the image processing method according to the present invention is written to the optical disk 16c inserted into the optical disk adapter 15c.

  The data storage unit 71 stores and sequentially stores image information and order information corresponding to the image information (information on how many prints are to be created from images of which frames, print size information, and the like).

  The template storage means 72 stores at least one template data for setting a synthesis area and a background image, an illustration image, and the like, which are sample image data corresponding to the sample identification information D1, D2, and D3. A predetermined template is selected from a plurality of templates that are set by the operation of the operator and stored in advance in the template storage means 72, and the frame image information is synthesized by the selected template and designated sample identification information D1, D2, D3 The sample image data selected on the basis of the image data and the image data and / or character data based on the order are combined to create a print based on the specified sample. The synthesis using this template is performed by a well-known chroma key method.

  Note that sample identification information D1, D2, and D3 for specifying a print sample is configured to be input from the operation unit 211. These sample identification information is recorded on a print sample or an order sheet. Therefore, it can be read by reading means such as OCR. Or it can also input by an operator's keyboard operation.

  In this way, sample image data is recorded corresponding to the sample identification information D1 for designating the print sample, the sample identification information D1 for designating the print sample is input, and based on the input sample identification information D1. Select the sample image data, synthesize the selected sample image data with the image data and / or text data based on the order, and create a print based on the specified sample. Can actually place a print order and meet the diverse requirements of a wide range of users.

  Also, the first sample identification information D2 designating the first sample and the image data of the first sample are stored, and the second sample identification information D3 designating the second sample and the second sample The image data is stored, the sample image data selected based on the designated first and second sample identification information D2 and D3, and the image data and / or character data based on the order are synthesized, and according to the designation In order to create a print based on a sample, it is possible to synthesize a wider variety of images, and it is possible to create a print that meets a wider variety of user requirements.

  The operation unit 11 includes information input means 12. The information input unit 12 is configured by a touch panel, for example, and outputs a pressing signal of the information input unit 12 to the control unit 7 as an input signal. Note that the operation unit 11 may be configured to include a keyboard, a mouse, and the like. The CRT 8 displays image information and the like according to a display control signal input from the control unit 7.

  The communication means (output) 33 sends an image signal representing a photographed image after image processing of the present invention and order information attached thereto to other computers in the facility where the image recording apparatus 1 is installed, the Internet Etc. to a distant computer via

  As shown in FIG. 2, the image recording apparatus 1 displays an image input unit that captures image information obtained by dividing and metering images of various digital media and an image original, an image processing unit, and a processed image. Print output, image output means for writing to an image recording medium, and means for transmitting image data and accompanying order information to another computer in the facility or a distant computer via the Internet via a communication line, Prepare.

<Internal Configuration of Image Processing Unit 70>
FIG. 3 shows an internal configuration of the image processing unit 70. As shown in FIG. 3, the image processing unit 70 includes an image adjustment processing unit 701, a film scan data processing unit 702, a reflection original scan data processing unit 703, an image data format decoding processing unit 704, a template processing unit 705, and CRT specific processing. 706, printer specific processing unit A707, printer specific processing unit B708, and image data format creation processing unit 709.

  The film scan data processing unit 702 performs a calibration operation specific to the film scanner unit 9, negative / positive reversal (in the case of a negative document), dust scratch removal, contrast adjustment, granular noise removal, and sharpness for the image data input from the film scanner unit 9. Processing such as conversion enhancement is performed, and processed image data is output to the image adjustment processing unit 701. In addition, the film size, the negative / positive type, information relating to the main subject optically or magnetically recorded on the film, information relating to the photographing conditions (for example, information content described in APS), and the like are also output to the image adjustment processing unit 701. .

  The reflection original scan data processing unit 703 performs a calibration operation unique to the reflection original input device 10, negative / positive reversal (in the case of a negative original), dust flaw removal, contrast adjustment, and noise removal on the image data input from the reflection original input device 10. Then, processing such as sharpening enhancement is performed, and processed image data is output to the image adjustment processing unit 701.

  The image data format decoding processing unit 704 restores the compression code, if necessary, according to the data format of the image data input from the image transfer means 30 and / or the communication means (input) 32, and the color data. Are converted into a data format suitable for computation in the image processing unit 70 and output to the image adjustment processing unit 701. Further, when the size of the output image is specified from any of the operation unit 11, the communication unit (input) 32, and the image transfer unit 30, the image data format decoding processing unit 704 detects the specified information, The image is output to the image adjustment processing unit 701. Information about the size of the output image designated by the image transfer means 30 is embedded in the header information and tag information of the image data acquired by the image transfer means 30.

  The image adjustment processing unit 701 receives from the film scanner unit 9, the reflection original input device 10, the image transfer unit 30, the communication unit (input) 32, and the template processing unit 705 based on the command from the operation unit 11 or the control unit 7. Image processing (described later with reference to FIGS. 5, 6, 12 and 15) is performed on the image data to generate digital image data for image formation optimized for viewing on the output medium, and CRT The data is output to the specific processing unit 706, the printer specific processing unit A 707, the printer specific processing unit B 708, the image data format creation processing unit 709, and the data storage unit 71.

  In the optimization process, for example, when it is assumed that the image is displayed on a CRT display monitor compliant with the sRGB standard, the optimal color reproduction is performed within the sRGB standard color gamut. If output to silver salt photographic paper is assumed, processing is performed so that optimum color reproduction is obtained within the color gamut of silver salt photographic paper. In addition to the compression of the color gamut, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, and processing for handling output characteristics (LUT) of the output device are also included. Furthermore, it goes without saying that tone compression processing such as noise suppression, sharpening, gray balance adjustment, saturation adjustment, or dodging processing is performed.

  As shown in FIG. 3, the image adjustment processing unit 701 includes a scene determination unit 710 and a gradation conversion unit 711. FIG. 4A shows an internal configuration of the scene determination unit 710. As shown in FIG. 4A, the scene determination unit 710 includes a ratio calculation unit 712, an index calculation unit 713, and an image processing condition calculation unit 714. As shown in FIG. 4B, the ratio calculation unit 712 includes a color system conversion unit 715, a histogram creation unit 716, and an occupation rate calculation unit 717.

  The color system conversion unit 715 converts RGB (Red, Green, Blue) values of the captured image data into the HSV color system. The HSV color system is a representation of image data in terms of three elements: Hue, Saturation, and Lightness (Value or Brightness), and is based on the color system proposed by Munsell. It has been devised.

  In this embodiment, “brightness” means “brightness” generally used unless otherwise noted. In the following description, V (0 to 255) of the HSV color system is used as “brightness”, but a unit system representing the brightness of any other color system may be used. At that time, it goes without saying that numerical values such as various coefficients described in the present embodiment are recalculated. The captured image data in the present embodiment is assumed to be image data having a person as a main subject.

  The histogram creation unit 716 creates a two-dimensional histogram by dividing the photographed image data into regions composed of a predetermined combination of hue and brightness, and calculating the cumulative number of pixels for each of the divided regions. In addition, the histogram creation unit 716 divides the captured image data into predetermined regions composed of combinations of the distance from the outer edge of the screen of the captured image data and the brightness, and calculates the cumulative number of pixels for each of the divided regions. To create a two-dimensional histogram. Note that the captured image data is divided into regions including combinations of the distance from the outer edge of the screen of the captured image data, brightness, and hue, and a cumulative pixel count is calculated for each of the divided regions, thereby creating a three-dimensional histogram. You may do it. In the following, it is assumed that a method of creating a two-dimensional histogram is adopted.

  The occupancy ratio calculation unit 717 is a first occupancy indicating the ratio of the cumulative number of pixels calculated by the histogram creation unit 716 to the total number of pixels (the entire captured image data) for each region divided by the combination of brightness and hue. The rate (see Table 1) is calculated. In addition, the occupation ratio calculation unit 717 calculates the total number of pixels (shooted image data) of the cumulative number of pixels calculated by the histogram creation unit 716 for each region divided by the combination of the distance from the outer edge of the screen of the shot image data and the brightness. A second occupancy ratio (see Table 4) indicating a ratio of the total) is calculated.

  The index calculation unit 713 multiplies the first occupancy calculated for each area by the occupancy calculation unit 717 by a first coefficient (see Table 2) set in advance according to the shooting conditions. As a result, the index 1 for specifying the shooting scene is calculated. Here, the shooting scene indicates a light source condition when shooting a subject, such as forward light, backlight, and strobe light. The index 1 indicates the characteristics at the time of strobe shooting, such as the indoor shooting degree, the close-up shooting degree, and the face color high brightness. In order to separate only an image that should be determined as “strobe” from other shooting scenes (light source conditions). belongs to.

  When calculating the index 1, the index calculation unit 713 uses coefficients of different signs for a predetermined high brightness skin color hue area and a hue area other than the high brightness skin color hue area. Here, the predetermined high lightness skin color hue region includes regions 170 to 224 in the lightness value of the HSV color system. Further, the hue area other than the predetermined high brightness skin color hue area includes at least one high brightness area of the blue hue area (hue values 161 to 250) and the green hue area (hue values 40 to 160).

  In addition, the index calculation unit 713 multiplies the first occupancy calculated for each area by the occupancy calculation unit 717 by a second coefficient (see Table 3) set in advance according to the shooting conditions. By calculating the sum, an index 2 for specifying the shooting scene is calculated. The index 2 is a composite indication of characteristics at the time of backlight shooting such as outdoor shooting degree, sky blue high brightness, facial color low brightness, and the like. Only an image that should be determined as “backlight” is taken from other shooting scenes (light source conditions). It is for separation.

  When calculating the index 2, the index calculation unit 713 uses coefficients of different signs in the intermediate brightness area of the flesh color hue area (hue values 0 to 39, 330 to 359) and the brightness areas other than the intermediate brightness area. . The intermediate lightness area of the flesh color hue area includes lightness values of 85 to 169. The brightness area other than the intermediate brightness area includes, for example, a shadow area (brightness values 26 to 84).

  Further, the index calculation unit 713 multiplies the second occupancy calculated for each area by the occupancy calculation unit 717 by a third coefficient (see Table 5) set in advance according to the shooting conditions. By calculating the sum, an index 3 for specifying the shooting scene is calculated. The index 3 indicates the difference in contrast between the center and the outside of the screen of the captured image data between the backlight and the strobe, and quantitatively indicates only the image that should be distinguished from the backlight or the strobe. When calculating the index 3, the index calculation unit 713 uses different values of coefficients according to the distance from the outer edge of the screen of the captured image data.

  In addition, the index calculation unit 713 calculates the index 4 by multiplying the index 1 and the index 3 by a coefficient set in advance according to the shooting condition, and combining them. Further, the index calculation unit 713 calculates the index 5 by multiplying the index 1, the index 2, and the index 3 by a coefficient set in advance according to the shooting condition, respectively. A specific method for calculating the indices 1 to 5 in the index calculating unit 713 will be described in detail in the operation description of the present embodiment described later.

  FIG. 4C shows the internal configuration of the image processing condition calculation unit 714. As shown in FIG. 4C, the image processing condition calculation unit 714 includes a scene determination unit 718, a gradation adjustment method determination unit 719, a gradation adjustment parameter calculation unit 720, and a gradation adjustment amount calculation unit 721. .

  The scene determination unit 718 determines the shooting scene (light source condition) of the captured image data based on the values of the index 4 and the index 5 calculated by the index calculation unit 713.

  A gradation adjustment method determination unit 719 determines a method of gradation adjustment for the captured image data according to the captured scene determined by the scene determination unit 718. For example, when the photographic scene is front light, as shown in FIG. 18A, a method (gradation adjustment method A) for correcting the translation (offset) of the pixel value of the inputted photographic image data is applied. The When the photographic scene is backlit, as shown in FIG. 18B, a method (gradation adjustment method B) for applying gamma correction to the pixel value of the input photographic image data is applied. When the shooting scene is a strobe, as shown in FIG. 18C, a method (gradation adjustment method C) for applying gamma correction and translation (offset) correction to the pixel value of the input shot image data is applied. .

  The tone adjustment parameter calculation unit 720 calculates parameters (key correction values and the like) necessary for tone adjustment based on the values of the index 4 and the index 5 calculated by the index calculation unit 713.

  The tone adjustment amount calculation unit 721 calculates (determines) the tone adjustment amount for the captured image data based on the tone adjustment parameter calculated by the tone adjustment parameter calculation unit 720. Specifically, the tone adjustment amount calculation unit 721 selects a tone adjustment parameter from a plurality of tone conversion curves set in advance corresponding to the tone adjustment method determined by the tone adjustment method determination unit 719. A gradation conversion curve corresponding to the gradation adjustment parameter calculated by the calculation unit 720 is selected. Note that the tone conversion curve (tone adjustment amount) may be calculated based on the tone adjustment parameter calculated in the tone adjustment parameter 720.

  A specific method for calculating the indices 1 to 5 in the index calculating unit 713, a method for determining a shooting scene (light source condition) in the scene determining unit 718, and a method for calculating a gradation adjustment parameter in the gradation adjustment parameter calculating unit 720 will be described later. This will be described in detail in the description of the operation of the present embodiment.

  In FIG. 3, the gradation conversion unit 711 performs gradation conversion of the captured image data according to the gradation conversion curve determined by the gradation adjustment amount calculation unit 721.

  The template processing unit 705 reads out predetermined image data (template) from the template storage unit 72 based on a command from the image adjustment processing unit 701, and performs template processing for combining the image data to be processed with the template. The image data after the template processing is output to the image adjustment processing unit 701.

  The CRT specific processing unit 706 performs a process such as changing the number of pixels and color matching on the image data input from the image adjustment processing unit 701 as necessary, and combines the information with information that needs to be displayed, such as control information. Image data is output to the CRT 8.

  The printer-specific processing unit A707 performs printer-specific calibration processing, color matching, pixel number change processing, and the like as necessary, and outputs processed image data to the exposure processing unit 4.

  When an external printer 51 such as a large-format ink jet printer can be connected to the image recording apparatus 1 of the present invention, a printer specific processing unit B708 is provided for each printer apparatus to be connected. The printer-specific processing unit B708 performs printer-specific calibration processing, color matching, pixel number change, and the like, and outputs processed image data to the external printer 51.

  The image data format creation processing unit 709 converts the image data input from the image adjustment processing unit 701 into various general-purpose image formats typified by JPEG, TIFF, Exif, and the like as necessary. The completed image data is output to the image transport unit 31 and the communication means (output) 33.

  Note that the film scan data processing unit 702, the reflection original scan data processing unit 703, the image data format decoding processing unit 704, the image adjustment processing unit 701, the CRT specific processing unit 706, the printer specific processing unit A707, and the printer specific shown in FIG. The divisions of the processing unit B708 and the image data format creation processing unit 709 are provided to assist understanding of the functions of the image processing unit 70, and are not necessarily realized as physically independent devices. Alternatively, it may be realized as a type of software processing performed by a single CPU.

Next, the operation in this embodiment will be described.
First, the scene determination process executed in the image adjustment processing unit 701 will be described with reference to the flowchart of FIG.

  First, in the ratio calculation unit 712, the captured image data is divided into predetermined image areas, and an occupation ratio calculation process for calculating an occupation ratio indicating the ratio of each divided area to the entire captured image data is performed (step S1). Details of the occupation ratio calculation process will be described later with reference to FIGS.

  Next, an index (indicator 1 to 5) for specifying the shooting scene (quantitatively representing the light source condition) based on the occupation ratio calculated by the ratio calculation unit 712 and a coefficient set in advance according to the shooting condition. Calculated (step S2). The index calculation process in step S2 will be described in detail later.

  Next, a photographic scene is determined based on the index calculated in step S2, image processing conditions (gradation conversion processing conditions) for the photographic image data are determined according to the determination result (step S3), and the scene determination process is performed. finish. The image processing condition determination process in step S3 will be described in detail later with reference to FIG.

  Next, the occupation rate calculation process executed in the rate calculation unit 712 will be described in detail with reference to the flowchart of FIG.

  First, the RGB values of the photographed image data are converted into the HSV color system (step S10). FIG. 7 shows an example of a conversion program (HSV conversion program) that obtains a hue value, a saturation value, and a lightness value by converting from RGB to the HSV color system in a program code (c language). In the HSV conversion program shown in FIG. 7, the values of digital image data as input image data are defined as InR, InG, and InB, the calculated hue value is defined as OutH, the scale is defined as 0 to 360, and the saturation The value is OutS, the brightness value is OutV, and the unit is defined as 0 to 255.

  Next, the photographed image data is divided into regions composed of combinations of predetermined brightness and hue, and a two-dimensional histogram is created by calculating the cumulative number of pixels for each divided region (step S11). Hereinafter, the area division of the captured image data will be described in detail.

The lightness value (V) is 0-25 (v1), 26-50 (v2), 51-84 (v3), 85-169 (v4), 170-199 (v5), 200-224 (v6) , 225 to 255 (v7). Hue (H) is a skin hue hue area (H1 and H2) with a hue value of 0 to 39, 330 to 359, a green hue area (H3) with a hue value of 40 to 160, and a blue hue area with a hue value of 161 to 250 It is divided into four areas (H4) and a red hue area (H5). Note that the red hue region (H5) is not used in the following calculation because it is known that the contribution to the discrimination of the shooting scene is small. The flesh color hue area is further divided into a flesh color area (H1) and another area (H2). Hereinafter, among the flesh color hue regions (H = 0 to 39, 330 to 359), a hue color '(H) that satisfies the following equation (1) is defined as a flesh color region (H1), and a region that does not satisfy the equation (1) is ( H2).
10 <Saturation (S) <175,
Hue '(H) = Hue (H) + 60 (when 0 ≤ Hue (H) <300),
Hue '(H) = Hue (H)-300 (when 300 ≤ Hue (H) <360),
Luminance Y = InR × 0.30 + InG × 0.59 + InB × 0.11
As
Hue '(H) / Luminance (Y) <3.0 × (Saturation (S) / 255) +0.7 (1)
Therefore, the number of divided areas of the captured image data is 4 × 7 = 28. In addition, it is also possible to use the brightness (V) in the formula (1).

When the two-dimensional histogram is created, a first occupancy ratio indicating the ratio of the cumulative number of pixels calculated for each divided region to the total number of pixels (the entire captured image) is calculated (step S12), and the main occupancy ratio calculation is performed. The process ends. Assuming that the first occupancy ratio calculated in the divided area composed of the combination of the lightness area vi and the hue area Hj is Rij, the first occupancy ratio in each divided area is expressed as shown in Table 1.

Next, a method for calculating the index 1 and the index 2 will be described.
Table 2 shows the first coefficient necessary for calculating the index 1 that quantitatively indicates the accuracy of strobe shooting obtained by discriminant analysis, that is, the lightness state of the face area at the time of strobe shooting. Show. The coefficient of each divided area shown in Table 2 is a weighting coefficient that is multiplied by the first occupation ratio Rij of each divided area shown in Table 1.

  FIG. 8 shows a lightness (v) -hue (H) plane. According to Table 2, a positive (+) coefficient is used for the first occupancy calculated from the region (r1) distributed in the skin color hue region of high brightness in FIG. 8, and the other hue is blue. A negative (−) coefficient is used for the first occupancy calculated from the hue region (r2). FIG. 10 shows a curve (coefficient curve) in which the first coefficient in the skin color area (H1) and the first coefficient in the other areas (green hue area (H3)) continuously change over the entire brightness. It is shown. According to Table 2 and FIG. 10, in the region of high brightness (V = 170 to 224), the sign of the first coefficient in the skin color region (H1) is positive (+), and other regions (for example, the green hue region) The sign of the first coefficient in (H3)) is negative (-), and it can be seen that the signs of the two are different.

従って、H1〜H4領域の和は、下記の式(2-1)〜式(2-4)のように表される。
H1領域の和＝R11×(-44.0)＋R21×(-16.0)＋（中略）...＋R71×(-11.3) (2-1)
H2領域の和＝R12×0.0＋R22×8.6＋（中略）... ＋R72×(-11.1) (2-2)
H3領域の和＝R13×0.0＋R23×(-6.3)＋（中略）...＋R73×(-10.0) (2-3)
H4領域の和＝R14×0.0＋R24×(-1.8)＋（中略）...＋R74×(-14.6) (2-4) When the first coefficient in the lightness region vi and the hue region Hj is Cij, the sum of the Hk regions for calculating the index 1 is defined as in Expression (2).

Accordingly, the sum of the H1 to H4 regions is expressed by the following formulas (2-1) to (2-4).
H1 area sum = R11 x (-44.0) + R21 x (-16.0) + (omitted) ... + R71 x (-11.3) (2-1)
Sum of H2 area = R12 x 0.0 + R22 x 8.6 + (omitted) ... + R72 x (-11.1) (2-2)
H3 area sum = R13 x 0.0 + R23 x (-6.3) + (omitted) ... + R73 x (-10.0) (2-3)
Sum of H4 area = R14 x 0.0 + R24 x (-1.8) + (omitted) ... + R74 x (-14.6) (2-4)

The index 1 is defined as in Expression (3) using the sum of the H1 to H4 regions shown in Expressions (2-1) to (2-4).
Index 1 = sum of H1 area + sum of H2 area + sum of H3 area + sum of H4 area + 4.424 (3)

Table 3 shows the second coefficient necessary for calculating the accuracy obtained as a result of discriminant analysis for backlighting, that is, the index 2 that quantitatively indicates the brightness state of the face region during backlighting for each divided region. Show. The coefficient of each divided area shown in Table 3 is a weighting coefficient that is multiplied by the first occupation ratio Rij of each divided area shown in Table 1.

  FIG. 9 shows a lightness (v) -hue (H) plane. According to Table 3, a negative (-) coefficient is used for the occupancy calculated from the region (r4) distributed in the intermediate lightness of the flesh color hue region in FIG. 9, and the low lightness (shadow) region ( A positive (+) coefficient is used for the occupation ratio calculated from r3). FIG. 11 shows the second coefficient in the skin color region (H1) as a curve (coefficient curve) that continuously changes over the entire brightness. According to Table 3 and FIG. 11, the sign of the second coefficient of the intermediate lightness region of the flesh color hue region having the lightness value of 85 to 169 (v4) is negative (−), and the lightness value is 26 to 84 (v2, It can be seen that the sign of the second coefficient in the low brightness (shadow) region of v3) is positive (+), and the sign of the coefficient in both regions is different.

従って、H1〜H4領域の和は、下記の式(4-1)〜式(4-4)のように表される。
H1領域の和＝R11×(-27.0)＋R21×4.5＋（中略）...＋R71×(-24.0) (4-1)
H2領域の和＝R12×0.0＋R22×4.7＋（中略）... ＋R72×(-8.5) (4-2)
H3領域の和＝R13×0.0＋R23×0.0＋（中略）...＋R73×0.0 (4-3)
H4領域の和＝R14×0.0＋R24×(-5.1)＋（中略）...＋R74×7.2 (4-4) When the second coefficient in the lightness area vi and the hue area Hj is Dij, the sum of the Hk areas for calculating the index 2 is defined as in Expression (4).

Accordingly, the sum of the H1 to H4 regions is expressed by the following formulas (4-1) to (4-4).
H1 area sum = R11 x (-27.0) + R21 x 4.5 + (omitted) ... + R71 x (-24.0) (4-1)
Sum of H2 area = R12 x 0.0 + R22 x 4.7 + (omitted) ... + R72 x (-8.5) (4-2)
Sum of H3 area = R13 x 0.0 + R23 x 0.0 + (omitted) ... + R73 x 0.0 (4-3)
H4 area sum = R14 x 0.0 + R24 x (-5.1) + (omitted) ... + R74 x 7.2 (4-4)

The index 2 is defined as in Expression (5) using the sum of the H1 to H4 regions shown in Expressions (4-1) to (4-4).
Index 2 = sum of H1 area + sum of H2 area + sum of H3 area + sum of H4 area + 1.554 (5)
Since the index 1 and the index 2 are calculated based on the brightness of the captured image data and the distribution amount of the hue, the index 1 and the index 2 are effective for determining a captured scene when the captured image data is a color image.

  Next, with reference to the flowchart of FIG. 12, the occupation rate calculation process executed in the rate calculation unit 712 to calculate the index 3 will be described in detail.

  First, the RGB values of the photographed image data are converted into the HSV color system (step S20). Next, the photographed image data is divided into regions each composed of a combination of the distance from the outer edge of the photographed image screen and the brightness, and a two-dimensional histogram is created by calculating the cumulative number of pixels for each divided region (step S21). Hereinafter, the area division of the captured image data will be described in detail.

  FIGS. 13A to 13D show four regions n1 to n4 divided according to the distance from the outer edge of the screen of the captured image data. A region n1 shown in FIG. 13A is an outer frame, a region n2 shown in FIG. 13B is a region inside the outer frame, and a region n3 shown in FIG. A region n4 shown in FIG. 13D is an inner region and is a central region of the captured image screen. Further, the lightness is divided into seven regions v1 to v7 as described above. Therefore, when the captured image data is divided into regions composed of combinations of the distance from the outer edge of the captured image screen and the brightness, the number of divided regions is 4 × 7 = 28.

When the two-dimensional histogram is created, a second occupancy ratio indicating the ratio of the cumulative number of pixels calculated for each divided region to the total number of pixels (the entire captured image) is calculated (step S22), and the main occupancy ratio calculation is performed. Processing ends. If the second occupancy calculated in the divided area composed of the combination of the brightness area vi and the screen area nj is Qij, the second occupancy in each divided area is expressed as shown in Table 4.

図１４は、画面領域ｎ１〜ｎ４における第３の係数を、明度全体に渡って連続的に変化する曲線（係数曲線）として示したものである。 Next, a method for calculating the index 3 will be described.
Table 5 shows the third coefficient necessary for calculating the index 3 for each divided region. The coefficient of each divided area shown in Table 5 is a weighting coefficient by which the second occupation ratio Qij of each divided area shown in Table 4 is multiplied, and is obtained by discriminant analysis.

FIG. 14 shows the third coefficient in the screen areas n1 to n4 as a curve (coefficient curve) that continuously changes over the entire brightness.

従って、n1〜n4領域の和は、下記の式(6-1)〜式(6-4)のように表される。
n1領域の和＝Q11×40.1＋Q21×37.0＋（中略）...＋Q71×22.0 (6-1)
n2領域の和＝Q12×(-14.8)＋Q22×(-10.5)＋（中略）...＋Q72×0.0 (6-2)
n3領域の和＝Q13×24.6＋Q23×12.1＋（中略）...＋Q73×10.1 (6-3)
n4領域の和＝Q14×1.5＋Q24×(-32.9)＋（中略）...＋Q74×(-52.2) (6-4) When the third coefficient in the brightness area vi and the screen area nj is Eij, the sum of the nk area (screen area nk) for calculating the index 3 is defined as in Expression (6).

Accordingly, the sum of the n1 to n4 regions is expressed as the following formulas (6-1) to (6-4).
n1 area sum = Q11 x 40.1 + Q21 x 37.0 + (omitted) ... + Q71 x 22.0 (6-1)
Sum of n2 area = Q12 x (-14.8) + Q22 x (-10.5) + (omitted) ... + Q72 x 0.0 (6-2)
n3 area sum = Q13 x 24.6 + Q23 x 12.1 + (omitted) ... + Q73 x 10.1 (6-3)
n4 area sum = Q14 x 1.5 + Q24 x (-32.9) + (omitted) ... + Q74 x (-52.2) (6-4)

The index 3 is defined as equation (7) using the sum of the N1 to H4 regions shown in equations (6-1) to (6-4).
Index 3 = sum of n1 regions + sum of n2 regions + sum of n3 regions + sum of n4 regions−12.6201 (7)
The index 3 is calculated based on a compositional feature (distance from the outer edge of the screen of the captured image data) based on the brightness distribution position of the captured image data. It is also effective.

The index 4 is defined as in Expression (8) using the indices 1 and 3, and the index 5 is defined as in Expression (9) using the indices 1 to 3.
Index 4 = 0.565 x Index 1 + 0.565 x Index 3 + 0.457 (8)
Indicator 5 = (-0.121) x Indicator 1 + 0.91 x Indicator 2 + 0.113 x Indicator 3-0.072 (9)
Here, the weighting coefficient by which each index is multiplied in Expression (8) and Expression (9) is set in advance according to the shooting conditions.

  Next, the image processing condition determination process (step S3 in FIG. 5) executed in the image processing condition calculation unit 714 will be described with reference to the flowchart in FIG. 15 and FIG.

  First, based on the values of the index 4 and the index 5 calculated by the index calculation unit 713, the shooting scene (light source condition) of the captured image data is determined (step S30). Hereinafter, a method for determining a shooting scene (light source condition) will be described.

このように指標４、５の値により撮影シーン（光源条件）を定量的に判別することができる。 In FIG. 17, 60 images were taken under each light source condition of forward light, backlight, and strobe, and indices 4 and 5 were calculated for a total of 180 digital image data, and the values of indices 4 and 5 under each light source condition were calculated. It is a plot. According to FIG. 17, when the value of the index 4 is larger than 0.5, there are many strobe scenes, and when the value of the index 4 is 0.5 or less and the value of the index 5 is larger than −0.5, the backlight scene is I understand that there are many. Table 6 shows the determination contents of the shooting scene (light source condition) based on the values of the indexes 4 and 5.

As described above, the shooting scene (light source condition) can be quantitatively determined based on the values of the indices 4 and 5.

  When the shooting scene is determined, a gradation adjustment method for the shot image data is determined in accordance with the determined shooting scene (step S31). As shown in FIG. 16, the gradation adjustment method A (FIG. 18A) is selected when the shooting scene is the follow light, and the gradation adjustment method B (FIG. 18B) is selected when the shooting scene is the backlight. If the selected strobe is selected, the gradation adjustment method C (FIG. 18C) is selected.

  When the gradation adjustment method is determined, parameters necessary for gradation adjustment are calculated based on the index calculated by the index calculation unit 713 (step S32). Hereinafter, the calculation method of the gradation adjustment parameter calculated in step S32 will be described. In the following description, it is assumed that the 8-bit captured image data is converted in advance to 16 bits, and the unit of the value of the captured image data is 16 bits.

As parameters necessary for gradation adjustment (gradation adjustment parameters), the following parameters P1 to P9 are calculated.
P1: Average brightness of the entire shooting screen
P2: Block division average brightness
P3: Average brightness of skin tone area (H1)
P4: Brightness correction value 1 = P1-P2
P5: Reproduction target correction value = Brightness reproduction target value (30360)-P4
P6: Offset value 1 = P5-P1
P7: Key correction value
P8: Brightness correction value 2
P9: Offset value 2 = P5-P8-P1

Here, a method for calculating the parameter P2 will be described with reference to FIGS.
First, a CDF (cumulative density function) is created in order to normalize captured image data. Next, the maximum value and the minimum value are determined from the obtained CDF. The maximum value and the minimum value are obtained for each RGB. Here, the maximum value and the minimum value obtained for each RGB are Rmax, Rmin, Gmax, Gmin, Bmax, and Bmin, respectively.

Next, normalized image data for any pixel (Rx, Gx, Bx) of the captured image data is calculated. If the normalized data of Rx in the R plane is R _point , the normalized data of Gx in the G plane is G _point , and the normalized data of Bx in the B plane is B _point , the normalized data R _point , G _point , B _point are , Respectively, are expressed as in Expression (10) to Expression (12).
R _point = {(Rx−Rmin) / (Rmax−Rmin)} × 65535 (10)
G _point = {(Gx−Gmin) / (Gmax−Gmin)} × 65535 (11)
B _point = {(Bx−Bmin) / (Bmax−Bmin)} × 65535 (12)
Next, the luminance N _point of the pixel (Rx, Gx, Bx) is calculated by Expression (13).
N _point = (B _point + G _point + R _point ) / 3 (13)

  FIG. 19A shows a frequency distribution (histogram) of luminance of RGB pixels before normalization. In FIG. 19A, the horizontal axis represents luminance, and the vertical axis represents pixel frequency. This histogram is created for each RGB. When the luminance histogram is created, normalization is performed for each plane with respect to the photographed image data by Expressions (10) to (12). FIG. 19B shows a histogram of luminance calculated by the equation (13). Since the captured image data is normalized by 65535, each pixel takes an arbitrary value between the maximum value 65535 and the minimum value 0.

  When the luminance histogram shown in FIG. 19B is divided into blocks divided by a predetermined range, a frequency distribution as shown in FIG. 19C is obtained. In FIG. 19C, the horizontal axis is the block number (luminance), and the vertical axis is the frequency.

  Next, a process of deleting highlight and shadow areas is performed from the luminance histogram shown in FIG. This is because the average brightness is very high in white walls and snow scenes, and the average brightness is very low in dark scenes, so highlights and shadow areas adversely affect average brightness control. . Therefore, by limiting the highlight area and the shadow area of the luminance histogram shown in FIG. 19C, the influence of both areas is reduced. When the high luminance region (highlight region) and the low luminance region (shadow region) are deleted from the luminance histogram shown in FIG. 20A (or FIG. 19C), the result is as shown in FIG.

  Next, as shown in FIG. 20C, an area having a frequency greater than a predetermined threshold is deleted from the luminance histogram. This is because if there is a part having an extremely high frequency, the data in this part strongly affects the average luminance of the entire captured image, and thus erroneous correction is likely to occur. Therefore, as shown in FIG. 20C, the number of pixels equal to or greater than the threshold is limited in the luminance histogram. FIG. 20D is a luminance histogram after the pixel number limiting process is performed.

  Each block number of the luminance histogram (FIG. 20 (d)) obtained by deleting the high luminance region and the low luminance region from the normalized luminance histogram and further limiting the number of accumulated pixels, and the respective frequencies The parameter P2 is obtained by calculating the average luminance based on the above.

The parameter P1 is an average value of the luminance of the entire captured image data, and the parameter P3 is an average value of the luminance of the skin color area (H1) in the captured image data. The key correction value of parameter P7 and the luminance correction value 2 of parameter P8 are defined as shown in equations (14) and (15), respectively.
P7 (key correction value) = (P3-((index 5/6) x 10000) + 30000) /24.78) (14)
P8 (Luminance correction value 2) = (Index 4/6) x 17500 (15)

  When the tone adjustment parameter is calculated, the tone adjustment amount for the photographed image data is determined based on the calculated tone adjustment parameter (step S33), and the image processing condition determination processing ends. In step S33, specifically, the step corresponding to the gradation adjustment parameter calculated in step S32 is selected from a plurality of gradation conversion curves set in advance corresponding to the gradation adjustment method determined in step S31. A key conversion curve is selected (determined). Note that the gradation conversion curve (gradation adjustment amount) may be calculated based on the gradation adjustment parameter calculated in step S32. When the gradation conversion curve is determined, the photographed image data is gradation converted according to the determined gradation conversion curve.

Hereinafter, a method for determining a gradation conversion curve for each shooting scene (light source condition) will be described.
<For direct light>
When the shooting scene is front light, offset correction (parallel shift of 8-bit value) for matching the parameter P1 with P5 is performed by the following equation (16).
RGB value of output image = RGB value of input image + P6 (16)
Therefore, when the photographic scene is a continuous light, a gradation conversion curve corresponding to Expression (16) is selected from the plurality of gradation conversion curves shown in FIG. Alternatively, the gradation conversion curve may be calculated (determined) based on Expression (16).

<In the case of backlight>
When the shooting scene is backlit, a gradation conversion curve corresponding to the parameter P7 (key correction value) shown in Expression (14) is selected from the plurality of gradation conversion curves shown in FIG. A specific example of the gradation conversion curve of FIG. 18B is shown in FIG. The correspondence between the value of parameter P7 and the selected gradation conversion curve is shown below.
If -0.5 <P7 <+0.5 → L3
+0.5 ≤ P7 <+1.5 → L4
When +1.5 ≤ P7 <+2.5 → L5
-1.5 <P7 ≤ -0.5 → L2
-2.5 <P7 ≤ -1.5 → L1
When the shooting scene is backlit, it is preferable to perform a dodging process together with the gradation conversion process. In this case, it is desirable to adjust the degree of dodging process according to the index 5 indicating the backlight intensity.

<In the case of strobe>
When the shooting scene is a strobe, offset correction (parallel shift of 8-bit value) is performed by Expression (17).
RGB value of output image = RGB value of input image + P9 (17)
Therefore, when the shooting scene is a strobe, a gradation conversion curve corresponding to Expression (17) is selected from a plurality of gradation conversion curves shown in FIG. Alternatively, the gradation conversion curve may be calculated (determined) based on Expression (17). When the value of the parameter P9 in Expression (17) exceeds a predetermined value α, a curve corresponding to the key correction value 2 = P9−α is selected from the curves L1 to L5 shown in FIG. select.

  In the present embodiment, when the gradation conversion process is actually performed on the captured image data, the above-described image processing conditions are changed from 16 bits to 8 bits.

  Note that if the gradation adjustment method differs greatly between the following light, backlight, and strobe, there is a concern about the effect on image quality when shooting scenes are misidentified. It is desirable to set an intermediate area that moves slowly.

  As described above, according to the image recording apparatus 1 of the present embodiment, the index that quantitatively indicates the shooting scene of the shot image data is calculated, the shooting scene is determined based on the calculated index, and the determination result is obtained. Accordingly, by determining the gradation adjustment method for the captured image data and determining the gradation adjustment amount (gradation conversion curve) of the captured image data, the brightness of the subject can be appropriately corrected.

  In particular, in addition to the index 1 that quantitatively indicates the accuracy for flash photography and the index 2 that quantitatively indicates the accuracy for backlight photography, the image is taken using the index 3 derived from the compositional elements of the captured image data. By discriminating the scene, it is possible to improve the accuracy of discrimination of the shooting scene.

  Note that the description in the present embodiment can be changed as appropriate without departing from the spirit of the present invention.

  For example, a face image may be detected from the photographed image data, a photographing scene may be determined based on the detected face image, and image processing conditions may be determined. In addition, Exif (Exchangeable Image File Format) information may be used to determine the shooting scene. By using Exif information, it is possible to further improve the accuracy of shooting scene determination.

  In the above-described embodiment, the shooting scene is determined based on the indices 4 and 5. However, an index may be further added to determine the shooting scene in the three-dimensional space. For example, in a stroboscopic scene, gradation adjustment is performed to darken the entire image according to the index 4, so that if the under-photographed scene is mistakenly determined to be a stroboscopic scene, there is a concern that the image may be further darkened. In order to avoid this, it is preferable to set the average luminance P3 of the skin color area as an index 6 and determine whether the scene is a strobe scene or an under shooting scene.

1 is a perspective view showing an external configuration of an image recording apparatus according to an embodiment of the present invention. 1 is a block diagram showing an internal configuration of an image recording apparatus according to an embodiment. The block diagram which shows the principal part structure of the image processing part of FIG. The figure which shows the internal structure (a) of a scene discrimination | determination part, the internal structure (b) of a ratio calculation part, and the internal structure (c) of an image processing condition calculation part. FIG. The flowchart which shows the scene discrimination | determination process performed in an image adjustment process part. The flowchart which shows the occupation rate calculation process which calculates the 1st occupation rate for every area | region of brightness and hue. The figure which shows an example of the program which converts from RGB to HSV color system. The figure which shows the brightness | luminance (V) -hue (H) plane, and the area | region r1 and the area | region r2 on a VH plane. The figure which shows the brightness | luminance (V) -hue (H) plane, and the area | region r3 and the area | region r4 on a VH plane. The figure which shows the curve showing the 1st coefficient by which the 1st occupation rate for calculating the parameter | index 1 is multiplied. The figure which shows the curve showing the 2nd coefficient by which the 1st occupation rate for calculating the parameter | index 2 is multiplied. The flowchart which shows the occupation rate calculation process which calculates a 2nd occupation rate based on the composition of picked-up image data. The figure which shows the area | regions n1-n4 determined according to the distance from the outer edge of the screen of picked-up image data. The figure which shows the curve showing the 3rd coefficient for multiplying the 2nd occupation rate for calculating the parameter | index 3 according to area | region (n1-n4). 6 is a flowchart showing details of the image processing condition determination process shown in FIG. 5. The figure which shows the relationship between the parameter | index for identifying (discriminating) a photography scene, parameters AC, and gradation adjustment methods AC. The plot figure of the parameter | index 4 and the parameter | index 5 calculated according to the imaging | photography scene (forward light, strobe, backlight). The figure which shows the gradation conversion curve corresponding to each gradation adjustment method. The figure which shows the frequency distribution (histogram) (a) of brightness | luminance, the normalized histogram (b), and the block-divided histogram (c). The figure ((a) and (b)) explaining deletion of the low-intensity area | region and the high-intensity area | region from the brightness | luminance histogram, and the figure ((c) and (d)) explaining the restriction | limiting of the frequency of a brightness | luminance. The figure which shows the gradation conversion curve showing the image processing conditions (gradation conversion conditions) in case a imaging | photography scene is backlight.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image recording apparatus 2 Case 3 Magazine loading part 4 Exposure processing part 5 Print preparation part 7 Control part 8 CRT
DESCRIPTION OF SYMBOLS 9 Film scanner part 10 Reflective original input device 11 Operation part 12 Information input means 14 Image reading part 15 Image writing part 30 Image transfer means 31 Image conveying part 32 Communication means (input)
33 Communication means (output)
51 External Printer 70 Image Processing Unit 72 Template Storage Unit 701 Image Adjustment Processing Unit 702 Film Scan Data Processing Unit 703 Reflected Original Scan Data Processing Unit 704 Image Data Format Decoding Processing Unit 705 Template Processing Unit 706 CRT Specific Processing Unit 707 Print Specific Processing Unit A
708 Print unique processing section B
709 Image data format creation processing unit 710 Scene determination unit 711 Gradation conversion unit 712 Ratio calculation unit 713 Index calculation unit 714 Image processing condition calculation unit 715 Color system conversion unit 716 Histogram creation unit 717 Occupancy calculation unit 718 Scene determination unit 719 Gradation adjustment method determination unit 720 Gradation adjustment parameter calculation unit 721 Gradation adjustment amount calculation unit

Claims (100)

Occupancy rate calculating step of dividing the captured image data into regions each having a combination of predetermined brightness and hue, and calculating an occupancy rate indicating the proportion of the entire captured image data for each of the divided regions;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing method comprising: Occupancy rate calculating step of dividing the captured image data into regions each having a combination of predetermined brightness and hue, and calculating an occupancy rate indicating the proportion of the entire captured image data for each of the divided regions;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing method comprising: Occupancy rate calculating step of dividing the captured image data into regions each having a combination of predetermined brightness and hue, and calculating an occupancy rate indicating the proportion of the entire captured image data for each of the divided regions;
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step;
An image processing method comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing method comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining step for determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing method comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step of calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step;
An image processing method comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion step of performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing method comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing method comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. An occupancy calculation step to calculate,
An index calculation step for calculating an index for identifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discriminating step for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining step for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination step of determining a gradation adjustment amount based on the calculated index;
A gradation conversion step of performing gradation conversion processing of the gradation adjustment amount determined in the adjustment amount determination step on the captured image data using the gradation adjustment method determined in the adjustment method determination step;
An image processing method comprising: Creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the captured image data,
The image processing method according to any one of claims 4 to 6, wherein, in the occupancy ratio calculating step, the occupancy ratio is calculated based on the created two-dimensional histogram. Creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the captured image data,
10. The image processing method according to claim 7, wherein, in the occupancy rate calculating step, the second occupancy rate is calculated based on the created two-dimensional histogram. Creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the photographed image data,
The image processing method according to claim 1, wherein in the occupancy rate calculating step, the occupancy rate is calculated based on the created two-dimensional histogram. Creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the photographed image data,
The image processing method according to any one of claims 7 to 9, wherein, in the occupancy ratio calculating step, the first occupancy ratio is calculated based on the created two-dimensional histogram.   In the index calculation step, coefficients having different signs are used in a predetermined high brightness skin color hue area and a hue area other than the high brightness skin color hue area. The image processing method according to any one of 9, 11 to 13.   In the index calculation step, coefficients having different signs are used in an intermediate brightness area of the flesh hue area and a brightness area other than the intermediate brightness area. An image processing method according to any one of the above.   The image processing method according to claim 14, wherein a brightness area of a hue area other than the high-brightness skin color hue area is a predetermined high brightness area.   The image processing method according to claim 15, wherein the brightness area other than the intermediate brightness area is a brightness area within a flesh-color hue area.   17. The image processing method according to claim 14, wherein the high-brightness skin color hue region includes a region in a range of 170 to 224 in terms of a brightness value of the HSV color system.   The image processing method according to claim 15 or 17, wherein the intermediate lightness region includes a region having a lightness value of HSV color system in a range of 85 to 169.   The image processing method according to any one of claims 14, 16, and 18, wherein the hue area other than the high brightness skin color hue area includes at least one of a blue hue area and a green hue area. .   The image processing method according to claim 15, wherein the brightness area other than the intermediate brightness area is a shadow area.   The hue value of the blue hue region is in the range of 161 to 250 as the hue value of the HSV color system, and the hue value of the green hue region is in the range of from 40 to 160 as the hue value of the HSV color system. The image processing method according to claim 20, wherein the image processing method is provided.   The image processing method according to claim 21, wherein the brightness value of the shadow region is in the range of 26 to 84 as the brightness value of the HSV color system.   The image processing method according to any one of claims 14 to 23, wherein a hue value of the skin color hue region is in a range of 0 to 39 and 330 to 359 as a hue value of the HSV color system. .   The image processing method according to any one of claims 14 to 24, wherein the skin color hue region is divided into two regions by a predetermined conditional expression based on brightness and saturation. Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
An image processing apparatus comprising: Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing apparatus comprising: Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
An image processing apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
An image processing apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
An image processing apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
An image processing apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
An image processing apparatus comprising: Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data;
32. The image processing apparatus according to claim 29, wherein the occupancy rate calculating unit calculates the occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data;
The image processing apparatus according to any one of claims 32 to 34, wherein the occupancy rate calculating unit calculates the second occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data;
The image processing apparatus according to any one of claims 26 to 28, wherein the occupancy rate calculation unit calculates the occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data;
The image processing apparatus according to any one of claims 32 to 34, wherein the occupancy ratio calculating unit calculates the first occupancy ratio based on the created two-dimensional histogram.   35. The index calculation means uses coefficients having different signs for a predetermined high brightness skin color hue region and a hue region other than the high brightness skin color hue region. 36. The image processing device according to any one of 36 to 38.   The index calculation means uses coefficients of different signs for the intermediate brightness area of the flesh-color hue area and the brightness areas other than the intermediate brightness area, according to claim 26 to 28, 32 to 34, 36 to 39. The image processing apparatus according to any one of the above.   40. The image processing apparatus according to claim 39, wherein a brightness area of a hue area other than the high brightness skin color hue area is a predetermined high brightness area.   41. The image processing apparatus according to claim 40, wherein the brightness area other than the intermediate brightness area is a brightness area in a flesh-color hue area.   42. The image processing apparatus according to claim 39 or 41, wherein the high lightness skin color hue region includes a region having a lightness value of HSV color system in a range of 170 to 224.   43. The image processing apparatus according to claim 40, wherein the intermediate lightness region includes a region having a lightness value of HSV color system in a range of 85 to 169.   44. The image processing apparatus according to claim 39, wherein the hue area other than the high brightness skin color hue area includes at least one of a blue hue area and a green hue area. .   45. The image processing apparatus according to claim 40, wherein the brightness area other than the intermediate brightness area is a shadow area.   The hue value of the blue hue region is in the range of 161 to 250 as the hue value of the HSV color system, and the hue value of the green hue region is in the range of from 40 to 160 as the hue value of the HSV color system. The image processing apparatus according to claim 45, wherein the image processing apparatus is provided.   47. The image processing apparatus according to claim 46, wherein a lightness value of the shadow area is within a range of 26 to 84 as a lightness value of the HSV color system.   The image processing apparatus according to any one of claims 39 to 48, wherein a hue value of the skin color hue region is in a range of 0 to 39 and 330 to 359 as a hue value of the HSV color system. .   The image processing apparatus according to any one of claims 39 to 49, wherein the skin color hue region is divided into two regions according to a predetermined conditional expression based on brightness and saturation. Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: Occupancy rate calculating means for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, an occupancy rate calculating means for calculating an occupancy rate indicating the proportion of the entire captured image data;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupation ratio indicating a ratio of the whole photographed image data for each of the divided areas. Occupancy ratio calculating means for calculating;
An index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated occupation ratio of each area by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Gradation conversion means for performing gradation conversion processing on the captured image data using the determined gradation adjustment method;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupancy ratio indicating the proportion of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data is determined for each of the divided areas. Occupancy ratio calculating means for calculating;
Index calculating means for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
Discrimination means for discriminating a photographing scene of the photographed image data based on the calculated index;
An adjustment method determining means for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
Adjustment amount determining means for determining a gradation adjustment amount based on the calculated index;
Gradation conversion means for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination means on the captured image data using the gradation adjustment method determined by the adjustment method determination means;
Means for forming image data subjected to the gradation conversion processing on an output medium;
An image recording apparatus comprising: Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data;
57. The image recording apparatus according to claim 54, wherein the occupancy rate calculating unit calculates the occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the photographed image data;
The image recording apparatus according to any one of claims 57 to 59, wherein the occupancy rate calculating unit calculates the second occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data;
54. The image recording apparatus according to claim 51, wherein the occupancy rate calculating unit calculates the occupancy rate based on the created two-dimensional histogram. Creating means for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data;
The image recording apparatus according to any one of claims 57 to 59, wherein the occupancy ratio calculating unit calculates the first occupancy ratio based on the created two-dimensional histogram.   The index calculation means uses coefficients with different signs for a predetermined high lightness skin color hue region and a hue region other than the high lightness skin color hue region. The image recording device according to any one of 61 to 63.   The index calculation means uses coefficients of different signs for the intermediate brightness area of the flesh-color hue area and the brightness areas other than the intermediate brightness area, according to claims 51 to 53, 57 to 59, and 61 to 64. The image recording apparatus according to any one of the above.   65. The image recording apparatus according to claim 64, wherein a brightness area of a hue area other than the high brightness skin color hue area is a predetermined high brightness area.   66. The image recording apparatus according to claim 65, wherein the brightness area other than the intermediate brightness area is a brightness area within a flesh-color hue area.   67. The image recording apparatus according to claim 64 or 66, wherein the high-brightness skin color hue region includes a region having a brightness value in the HSV color system of 170 to 224.   68. The image recording apparatus according to claim 65, wherein the intermediate brightness area includes an area in the range of 85 to 169 in terms of brightness values of the HSV color system.   The image recording apparatus according to any one of claims 64, 66, and 68, wherein the hue area other than the high brightness skin color hue area includes at least one of a blue hue area and a green hue area. .   The image recording apparatus according to any one of claims 65, 67, and 69, wherein a brightness area other than the intermediate brightness area is a shadow area.   The hue value of the blue hue region is in the range of 161 to 250 as the hue value of the HSV color system, and the hue value of the green hue region is in the range of from 40 to 160 as the hue value of the HSV color system. The image recording apparatus according to claim 70, wherein the image recording apparatus is provided.   72. The image recording apparatus according to claim 71, wherein a lightness value of the shadow area is a lightness value of the HSV color system in a range of 26 to 84.   The image recording apparatus according to any one of claims 64 to 73, wherein a hue value of the flesh color hue region is in a range of 0 to 39 and 330 to 359 as a hue value of the HSV color system. .   The image recording apparatus according to any one of claims 64 to 74, wherein the skin color hue region is divided into two regions according to a predetermined conditional expression based on brightness and saturation. In the computer for executing image processing,
Occupancy rate calculation function for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, calculating an occupation rate indicating the proportion of the entire captured image data;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing program for realizing In the computer for executing image processing,
Occupancy rate calculation function for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, calculating an occupation rate indicating the proportion of the entire captured image data;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing program for realizing In the computer for executing image processing,
Occupancy rate calculation function for dividing the captured image data into regions composed of combinations of predetermined brightness and hue, and for each of the divided regions, calculating an occupation rate indicating the proportion of the entire captured image data;
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupancy ratio indicating the ratio of the entire photographed image data for each of the divided areas. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupancy ratio indicating the ratio of the entire photographed image data for each of the divided areas. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into predetermined areas composed of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and an occupancy ratio indicating the ratio of the entire photographed image data for each of the divided areas. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated occupancy of each area by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupation ratio indicating a ratio of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas consisting of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data for each of the divided areas is obtained. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
A gradation conversion function for performing gradation conversion processing on the photographed image data using the determined gradation adjustment method;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupation ratio indicating a ratio of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas consisting of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data for each of the divided areas is obtained. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing on the captured image data based on the determined gradation adjustment amount;
An image processing program for realizing In the computer for executing image processing,
The photographed image data is divided into regions composed of a combination of predetermined brightness and hue, and a first occupation ratio indicating a ratio of the whole photographed image data is calculated for each of the divided regions, and the photographed image data Is divided into predetermined areas consisting of a combination of the distance from the outer edge of the screen of the photographed image data and the brightness, and a second occupancy ratio indicating the proportion of the whole photographed image data for each of the divided areas is obtained. Occupancy rate calculation function to calculate,
An index calculation function for calculating an index for specifying a shooting scene by multiplying the calculated first occupancy and second occupancy by a coefficient set in advance according to shooting conditions;
A discrimination function for discriminating a shooting scene of the shot image data based on the calculated index;
An adjustment method determining function for determining a method of gradation adjustment for the captured image data according to the determined shooting scene;
An adjustment amount determination function for determining a gradation adjustment amount based on the calculated index;
A gradation conversion function for performing gradation conversion processing of the gradation adjustment amount determined by the adjustment amount determination function on the captured image data using the gradation adjustment method determined by the adjustment method determination function;
An image processing program for realizing Realizing a creation function to create a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the captured image data,
The image processing program according to any one of claims 79 to 81, wherein the occupancy rate is calculated based on the created two-dimensional histogram when realizing the occupancy rate calculation function. Realizing a creation function to create a two-dimensional histogram by calculating the cumulative number of pixels for each distance and brightness from the outer edge of the screen of the captured image data,
The image processing according to any one of claims 82 to 84, wherein the second occupation ratio is calculated based on the created two-dimensional histogram when the occupation ratio calculation function is realized. program. Realizing a creation function for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data,
The image processing program according to any one of claims 76 to 78, wherein when the occupancy rate calculation function is realized, the occupancy rate is calculated based on the created two-dimensional histogram. Realizing a creation function for creating a two-dimensional histogram by calculating the cumulative number of pixels for each predetermined hue and brightness of the captured image data,
The image processing according to any one of claims 82 to 84, wherein the first occupation ratio is calculated based on the created two-dimensional histogram when the occupation ratio calculation function is realized. program.   76. A coefficient having a different sign is used for a predetermined high brightness skin color hue area and a hue area other than the high brightness skin color hue area when realizing the index calculation function. 82-84, 86-88.   76. When implementing the index calculation function, coefficients having different signs are used for an intermediate brightness area of a flesh hue area and a brightness area other than the intermediate brightness area, 76 to 78, 82 to 84, The image processing program according to any one of 86 to 89.   90. The image processing program according to claim 89, wherein a brightness area of a hue area other than the high brightness skin color hue area is a predetermined high brightness area.   The image processing program according to claim 90, wherein the brightness area other than the intermediate brightness area is a brightness area in a flesh-color hue area.   92. The image processing program according to claim 89, wherein the high lightness skin color hue region includes a region having a lightness value in the HSV color system of 170 to 224.   The image processing program according to claim 90 or 92, wherein the intermediate brightness area includes an area in the range of 85 to 169 in terms of brightness values of the HSV color system.   The image processing program according to any one of claims 89, 91, and 93, wherein the hue area other than the high brightness skin color hue area includes at least one of a blue hue area and a green hue area. .   The image processing program according to any one of claims 90, 92, and 94, wherein a brightness area other than the intermediate brightness area is a shadow area.   The hue value of the blue hue region is in the range of 161 to 250 as the hue value of the HSV color system, and the hue value of the green hue region is in the range of from 40 to 160 as the hue value of the HSV color system. The image processing program according to claim 95, wherein the image processing program is provided.   The image processing program according to claim 96, wherein the lightness value of the shadow area is a lightness value of the HSV color system in a range of 26 to 84.   99. The image processing program according to claim 89, wherein a hue value of the skin color hue region is in a range of 0 to 39 and 330 to 359 as a hue value of the HSV color system. .   The image processing program according to any one of claims 89 to 99, wherein the skin color hue region is divided into two regions according to a predetermined conditional expression based on lightness and saturation.

Images