KR20120020024A - Method and apparatus for iris recognition and iridodiagnosi using wireless mobile communications device - Google Patents

Abstract

PURPOSE: An image processing device for recognizing/diagnosing an iris in a wireless mobile communication terminal and a method thereof are provided to photograph iris and face images with clear colors. CONSTITUTION: Each LED(Light Emitting Diode) lighting device(200) transmits a visible ray and an infrared ray by selecting a filter(100). A camera device(600) captures an image of an interest area. A control device(700) controls the camera device and the LED lighting device according to an output value of sensor devices(300~500). An LCD(Liquid Crystal Display) device(800) visually displays a visually processed image. A data processing device(900) corrects the processed image.

Description

Image processing apparatus and method for iris recognition and iris diagnosis in wireless mobile communication terminal {METHOD AND APPARATUS FOR IRIS RECOGNITION AND IRIDODIAGNOSI USING WIRELESS MOBILE COMMUNICATIONS DEVICE}

According to the present invention, an image in the visible range and an image in the near infrared range are separately acquired using a manual left and right sliding band pass filter switching device on a wireless mobile communication terminal, and the image is processed to be suitable for iris diagnosis and iris recognition. The present invention relates to a processing apparatus and method, and more particularly, to an illuminance sensor for detecting a luminance value and a color temperature value of an environment from a face and an iris region, an acceleration and gyro sensor for detecting an impact such as acceleration and gravity, and rotation information. The image component of the camera and the eye equipped with a geomagnetic sensor and the like is divided into sub-unit areas, and the signal is sampled for each sub-unit area through the image area division step of grouping these sub-unit areas and redefining them into several middle unit areas. , Separate into sharpness components and compensate for each After compensating for the signal distortion according to the miniaturization trend of the module, when using the autofocus camera device, it is possible to capture a clear image with auto focusing on a target area of interest (face, eyes) in a preset subject composition (rectangular border). It is about how to.

Recently, in the case of a camera phone of a wireless mobile communication terminal such as a mobile phone, the camera embedded in the mobile communication terminal has become smaller and higher resolution in response to a user's demand for capturing higher resolution photos. Mobile communication terminals with mega pixel cameras comparable to those of the market are being released.

However, the mobile communication terminal of the wireless mobile terminal having a high

The device for the mobile communication function, which is the main function, is very limited compared to the dedicated digital still camera. In particular, the image sensor that receives light and captures an image is a main function of acquiring an image by outputting a large amount and a small amount of light received at a difference in charge amount. There is a problem that it is impossible to accurately capture a clear picture suitable for iris diagnosis or iris recognition because it cannot be detected accurately.

More particularly, the present invention relates to a lens system in which a central portion of an image is prevented from appearing red as the lens system is miniaturized, and a portable mobile device having the same.

In general, an imaging device such as a CCD or a CMOS used in a camera or the like responds to light in a near infrared or infrared region of about 700 nm or more. However, the light in the near infrared or infrared region weakens the color reproduction ability of the image pickup device by causing crosstalk to the image pickup device, and deteriorates the signal to noise ratio (S / Nration) characteristic of the image pickup device. Therefore, the lens system provided in the existing camera is equipped with an infrared cut filter for blocking light in the near infrared or infrared region to prevent this.

However, when the infrared cut filter is disposed between the object side and the lens system, the outer diameter of the filter is increased and the cost is increased. As described later, the telecentric angle becomes larger as the incident angle of the light incident on the infrared cut filter increases. As a result, there was a problem that a red noise occurs in the center of the image or a blue noise occurs in the periphery of the image. In addition, when the infrared cut-off filter is disposed between the lens system and the image pickup device, the back focal length (BFL) increases, thereby increasing the size of the image pickup device and increasing the unit cost of the image pickup device. There was a problem that could not meet the current trend.

In addition, the image sensor generates a fixed pattern noise due to an offset voltage due to a slight difference in the manufacturing process. To compensate for this noise, the image sensor reads a reset voltage signal from each pixel of the pixel array, reads a data voltage signal, and then outputs the difference. use.

The digitized data is compressed / extended, or gamma-corrected, according to the area by subdividing the area of the signal in consideration of the gamma characteristics of the display device in the gamma correction unit. The gamma-corrected signal is processed into an environment that is easy to see when a person views an image through a digital signal processing unit consisting of an automatic focusing time control device, an automatic white balance circuit and a color gamut converter.

Such image sensors, especially CMOS image sensors, have a great advantage of low power consumption, and thus are very useful for personal portable systems such as mobile phones. However, as the camera module equipped with the image sensor dedicated to the mobile phone becomes smaller and requires a lens with a larger F number, each pixel of the RGB color filter array pixel of the image sensor is different from the angle of refraction of the lens with respect to light. This difference in position is caused by the difference in brightness or color depending on the wavelength of the light and the shading of the microlenses.Inevitably, the signal loss occurs depending on the position of the RGB color filter. Distortion occurs. Data loss is more concentrated in the edge part than in the center part of the captured image, so the image of the edge part is darker than the center part and the color is not properly represented.

It is very difficult to apply such a calibration pattern or a fixed camera motion when a general user wants to obtain an orthoimage at any place by using a digital camera of a wireless mobile communication device such as a mobile phone or a smart phone. In addition, when using a varifocal lens or a zoom lens, the focal length and the image center are changed by the lens operation, and there is a need to perform calibration each time.

Generally, camera parameters are obtained through one calibration step and can be regarded as maintaining a fixed value, but since the camera rotation angle information should be considered to change with each shooting, any pattern including a calibration pattern is used. Even there is a problem that should be able to obtain the rotation angle information.

The present invention has been proposed to solve the above-mentioned conventional problems,

A method of providing an infrared cut filter for capturing clear images for iris diagnosis and a near infrared transmission filter for capturing clear images for iris recognition,

A method of providing a lens system that prevents the central part of a color image from appearing red with the miniaturization of the lens system, and prevents the image from being sharpened by a near-infrared transmission filter.

A method of providing a device capable of taking pictures that are clearer and more suitable for human visibility,

Provides a signal compensation method that can compensate for signal distortion due to the miniaturization trend of the camera module,

Provides a way to capture clear images with auto focusing on the area of interest (face, eyes)

To provide a corrected image using angular velocity and rotation angle.

The technical problem to be solved.

The present invention has been made to solve the problems of the prior art,

An infrared cut filter for capturing a clear image for iris diagnosis and a near infrared transmission filter for capturing a clear image for iris recognition provide a simple manual left and right sliding filter opening and closing device.

The present invention provides a lens system in which a central portion of an image is prevented from appearing red as the lens system is miniaturized, and a wireless mobile communication terminal having the same.

The present invention provides a camera having an illuminance sensor capable of capturing a picture that is more sharp and suitable for human visibility by providing an illuminance sensor capable of detecting an accurate luminance value of a surrounding environment for capturing an image.

The present invention provides an apparatus and method for controlling the brightness and white balance of the digital image signal by controlling the LED lighting apparatus according to the luminance value detected by the illuminance sensor.

The image segmentation step of dividing the captured image into sub-unit areas, grouping these sub-unit areas and re-defining them into several mid-level areas, samples the signal for each sub-unit area, and separates them into brightness, color, and sharpness components and compensates for each. The present invention provides a signal compensation method capable of compensating for signal distortion caused by a miniaturization trend of a camera module.

The present invention provides a method for capturing a sharp image with auto focusing on a desired region of interest (face or eye) in a desired moving subject composition (rectangular border) when using an autofocus camera device.

After correcting the lens distortion from the pattern on the general plane photographed by the digital camera of the wireless communication device having an arbitrary rotation angle posture, the corrected image is generated using the camera rotation angle information about the plane automatically calculated. By using the method and the angular velocity and rotation angle from the geomagnetic and acceleration sensors.

To solve the above technical problem.

With the camera and simple filter operation, iris and face images with vivid color can be captured, making it easy to diagnose irises on the wireless mobile terminal, and also convenient on the wireless mobile terminal by capturing accurate gray scale iris images. It is possible to use a wireless communication service safely.

By allowing the iris to be provided in any one of the spaces between the lens groups of the lens system having a plurality of lens groups, it is possible to prevent distortion between the image of the center of the iris image and the image of the periphery of the iris image. Can be. Degradation of the iris image can be prevented without additional manufacturing cost increase.

The camera used in the wireless mobile communication terminal is equipped with a separate illuminance sensor, so that the brightness and color temperature of the imaging environment can be detected with accurate physical values so that the image can be captured more clearly and the iris image with white balance adjusted to match human visibility It works.

By using the brightness value of the imaging environment detected by the illuminance sensor, the brightness of the backlight of the LCD which displays the captured image can be automatically adjusted to suit the surrounding environment, and the amount of flash light that provides glare in the dark environment can be adjusted. There is a side effect that can be automatically adjusted to suit.

The image segmentation step of dividing the captured image of the eye into sub-unit areas and grouping these sub-unit areas and re-defining them into several middle unit areas is performed by sampling the signal for each sub-unit area and separating them into brightness, color, and sharpness components. Since it is a method of compensating for the signal, signal distortion due to the miniaturization trend of the camera module is compensated.

If the area of interest (both eyes, or both eyes) of the subject falls within the preset subject composition (rectangular border), the measured distance movement information matched to this sub-screen is retrieved from the storage unit and provided to the distance measuring unit. It indicates the measurement distance corresponding to and receives the measurement distance value from the measurement distance unit in response. By moving the lens forward and backward to find the best focus, the distance of the subject is analyzed only with the image itself, so that the user can easily and conveniently take a picture without paying much attention to the shooting distance and focus.

As described above, the present invention is to compensate for the degradation of the image quality caused by lens distortion in the imaging equipment employing the lens system, such as a digital camera, and to generate an orthoimage for the resulting image at this time as Distortion correction can be performed automatically using only the image without depending on the lens system information or external device, so that it can be applied not only to still images provided by general digital cameras but also to videos captured by the same camera.

1 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
2 is a block diagram of the filter opening and closing device of the left and right sliding method according to an embodiment of the present invention.
3 is a schematic configuration diagram of an LED lighting apparatus according to an embodiment of the present invention.
4 is a detailed configuration diagram showing an example of the illuminance sensor.
Figure 5 is a detailed configuration diagram showing an example of the acceleration and gyro sensor.
6 is a schematic conceptual diagram of a lens system according to an embodiment of the present invention.
7 is a conceptual diagram schematically showing an optical path for explaining the principles of the present invention.
8 is a conceptual diagram of the controller.
9 is a configuration diagram showing an example of the control unit in more detail.
10 is a block diagram of a signal compensation method according to an embodiment of the present invention.
11 is an example of a screen in which divisionally defined images captured for signal compensation according to the present invention are divided into regions.
12 is a block diagram of a data compensation step according to an embodiment of the present invention.
FIG. 13 is a diagram illustrating a step-by-step procedure of performing auto focusing based on measurement distance information to a subject corresponding to a sub screen area according to an exemplary embodiment.
14 is a flowchart illustrating a method of changing an auto focusing position with respect to a fixed subject according to an exemplary embodiment.
FIG. 15 illustrates a process of determining which region is to be distortion-corrected according to a scale in a current camera image (perspective image).

An image processing apparatus of a wireless mobile communication terminal of the present invention for achieving the above object,

Acquire the first image according to the luminance distribution of the visible light range with respect to the region of interest (face, eyes) from the infrared cut-off bandpass filter and the region of interest (face, eyes) from the near infrared transmission bandpass filter 100 according to the necessary purpose. An image acquisition unit for separately acquiring a second image according to grayscale of

A display unit 800 for simultaneously displaying the first image and the second image on one screen at the same time or separately displaying the resultant image processed according to a necessary purpose;

And a data processor 900 for correcting an image suitable for iris diagnosis and recognition by using the image and the output information obtained by processing from the image acquisition unit.

The image acquisition unit preferably includes a sensor unit 300, 400, 500, an LED lighting unit 200, a camera unit 600, a band pass filter unit 100, and a control unit 700.

The sensor unit of the image acquisition unit,

The illuminance sensor 300 for detecting the luminance value and the color temperature value of the surrounding environment from the region of interest, the acceleration and gyro sensor 400 for detecting impacts such as acceleration and gravity, the geomagnetic sensor 500 for detecting rotation information, and the like. Include.

The LED lighting unit 200 of the image acquisition unit,

And a visible light LED 220 for projecting a specific region visible light and an infrared LED 210 for projecting light in a near infrared region.

The camera unit of the image acquisition unit,

The lens 610 and an image sensor 650 for capturing an image of the ROI are included.

The lens of the camera unit

Meanwhile, in the case of a portable mobile device such as a mobile phone, miniaturization and compactness are important issues. It is preferable that a lens system that can be provided in such a mobile mobile device is a small lens system. It is desirable to have lens groups.

The band pass filter unit 100 of the image acquisition unit,

And a near-infrared transmission filter 110 and an infrared cut-off filter 120, which are arranged in front and rear of the lens in a manual sliding mode.

Closing the infrared cut-off bandpass filter 120 of the bandpass filter unit 100 and capturing an image of the ROI to obtain the visible range image, and closing the near infrared transmission bandpass filter 110 And capturing an image of light projected on the ROI to obtain the near infrared range image.

The control unit of the image acquisition unit,

It is preferable to include a method and a module for controlling the lens 610, the image sensor 650 and the LED lighting device 200 according to the output value of the sensor.

The lens is configured to capture an image of light of a specific region visible light LED illuminator 220 projected onto the ROI while the infrared cut-off bandpass filter 120 is closed in front of the lens to obtain a visible light range image of the ROI. 611, a near-infrared LED illuminator that controls the brightness of the image sensor 650 and the LED illuminator 200, and is projected to the region of interest with the near-infrared transmission bandpass filter 110 closed in front of the lens ( It is preferable to control the brightness of the lens, the image sensor and the LED lighting device to capture the light image of the 210 to obtain a near infrared range image of the region of interest.

The display unit of the image processing apparatus

Preferably, the display unit further includes an LCD 800 for visually displaying the image processed image acquired by the image acquisition unit. In this embodiment, the display unit is configured to display the luminance value of the surrounding environment detected by the illuminance sensor 300. Accordingly, it is preferable that the backlight brightness of the LCD unit can be adjusted.

The data processor 900 corrects a distorted image due to hand shake, rotation, and a change in luminance value of the surrounding environment using an image obtained by the image acquisition unit and output information, to be suitable for iris diagnosis and recognition. desirable.

Hereinafter, with reference to the accompanying drawings will be described in detail the advantages, features and preferred embodiments of the present invention.

1 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.

As shown in FIG. 1, the image processing apparatus of the present invention selects the light of the visible region and the infrared region of the light from the region of interest (face, eyes) of the subject by a sliding switching method. Filter 100 for blocking, each LED lighting device 200 for projecting visible and infrared light according to whether the filter is selected, the illumination sensor 300 for detecting the luminance value and color temperature value of the surrounding environment from the region of interest ), A sensor device such as an acceleration and gyro sensor 400 for detecting an impact such as acceleration and gravity, a geomagnetic sensor 500 for detecting rotation information, a lens 610 for capturing an image of the ROI, and an image sensor 650. A camera device 600 including the camera device, a control device 700 for controlling the camera device and the LED lighting device according to an output value of the sensor device, and a video processed by the image acquisition unit. And a data processing apparatus 900 for correcting an image processed by the image acquisition unit.

Here, the band pass filter includes a filter that transmits light in the near infrared region and blocks light in the visible region and a filter which transmits the visible region and blocks the light in the infrared region. The filter may be used coated on the glass or film surface. As shown in FIG. 1, the filter is properly disposed, and the filter is covered by a sliding left and right opening and closing method according to a necessary purpose.

2 is a block diagram of the filter opening and closing device of the left and right sliding method according to an embodiment of the present invention.

In the state of FIG. 2A, when the opening and closing switch 150 protruding toward the outer center of the camera seating part is pushed to the right side, the cover slides to the right as shown in FIG.

At this time, when the user selects the recognition mode on the program, the visible light LED 220 is turned off and only the near infrared LED 210 is alternately turned on. In addition, when the switch 150 is pushed to the left side in the state of FIG. 2B, the cover is slid to the left so that the camera seat is completely covered with the infrared cut filter 120, and the user selects the program in the normal color image shooting or iris diagnosis mode. When visible light LED turns on, infrared LED turns off.

In addition, the opening and closing switch may be configured integrally or detachably with the wireless communication terminal.

3 is a schematic configuration diagram of an LED lighting apparatus according to an embodiment of the present invention.

The LED lighting device is a visible light LED projecting visible light in a specific region and an infrared LED projecting light in a near infrared region according to whether the filter is selected. As shown in FIG. 3, the visible light LED 220 is positioned in the upper direction of the lens. , Infrared LED 210 is located in the lower direction of the lens, it may be configured in the center or right and left.

In addition, the power of the LED lighting device is not supplied from the power of the wireless communication terminal,

Independently attached battery can be powered and can be configured separately.

In this case, the wavelength band of the infrared LED 210 uses an LED lamp that emits a wavelength of 700 ~ 900nm, preferably alternating an LED lamp that emits a single wavelength of 760nm and an LED lamp that emits a single wavelength of 870nm. And the peaks in the emission bands (760 and 870 nm) to prevent the blue and green eyes of Westerners and the brown eyes of Asians from being photographed on one side and dark on the other side. In addition, the wavelength band of the visible light LED uses a high-brightness LED 220 emitting a wavelength of 400 ~ 700nm.

The sensor device may include an illuminance sensor that detects luminance and color temperature values of the surrounding environment from the region of interest, an acceleration and gyro sensor that detects shock such as acceleration and gravity, and a geomagnetic sensor that detects rotation information.

The illuminance sensor 300 detects the luminance and color temperature of the surrounding environment with an accurate physical quantity. In conventional mobile communication cameras, image sensors (CCD, CMOS) are used to adjust the brightness and white balance using only the optical signals detected due to their size constraints. It could not detect and could not capture images that were clear and matched to human visibility. In contrast, in the present invention, since the correct brightness value Lux and the color temperature (Calvin) can be detected through the separate illuminance sensor 15, the detected brightness value Lux and the color temperature (Calvin) are used. It is possible to capture images that are sharper and match human visibility.

4 is a detailed configuration diagram showing an example of the illuminance sensor. As shown in FIG. 4, the illuminance sensor includes a visible light detector 310 for detecting visible light in an imaging environment, and an infrared detector for detecting infrared light in an imaging environment. 320, and a converter 330 that converts and outputs the brightness and the color temperature of the imaging environment into an accurate physical quantity by analyzing the visible and infrared rays of the detected imaging environment. The physical quantity indicating the brightness output from the converter may be a Lux value, and the physical quantity indicating the color temperature is Calvin degree.

The acceleration sensor detects and calculates a shake during exposure in which the subject region of interest image is introduced into the imaging surface, and compares the calculated shake with a preset correction limit to calculate an excessive angle that deviates from the correction limit.

In another embodiment, the gyro sensor 400 calculates the angular velocity to quantitatively compare the shake with a preset correction limit to capture excessive shake. In this way, when detecting the shaking of the image using the sensor already built in the smart phone, the processing speed is faster, it becomes accurate.

5 is a detailed configuration diagram showing an example of the acceleration and gyro sensor;

The last FilterAngle (440) in the figure simply reexpresses the radians in degrees. After all, the variable FilterAngle is the final result of the filter. In addition, the compensation signal (410) is the angle obtained using the value output from the acceleration sensor. That is, not the output of the acceleration sensor, but the angle obtained there.

And the part of the gyro signal (420) is not the gyro signal as it is, but the result of the angular velocity (rad / sec) reflecting the scale factor in the gyro signal. That is, the compensation signal is the angle output from the acceleration sensor, the gyro signal is the angular velocity output from the gyro.

In video equipment adopting a lens system such as a digital camera, software image compensation caused by lens distortion is compensated for by software, and ortho images should be generated for the resulting images. This is the focal length and camera rotation angle information obtained through camera calibration. In addition, information about the image center is required, but as already mentioned, it will be regarded as the center of the image buffer. The focal length can be regarded as unchanged after the camera calibration is finished, but the rotation angle information always changes according to the user's camera adjustment state, and the geomagnetic sensor used as an embodiment of the present invention for obtaining the rotation angle information. 500 includes an X- and Y-axis fluxgates orthogonal to each other, and a geomagnetic detection module for detecting an electrical signal corresponding to the geomagnetism from each of the fluxgates and the X- and Y-axis fluxgates, respectively. A signal processor for converting and outputting an electrical signal into predetermined X and Y axis output values, and normalizing the X and Y axis output values to a predetermined range, respectively, and then rotating angles from the normalized output values. It is preferable to include a geomagnetic calculation unit for calculating.

Meanwhile, the geomagnetic calculation unit performs a normalization process of mapping the actual output value output from the signal processor to a predetermined range. To this end, the manufacturer of the geomagnetic sensor measures the output values of the X- and Y-axis fluxgates by rotating the geomagnetic sensor at least once in a horizontal state in advance. When the measurement is completed, the maximum and minimum values of the measured output values are selected and recorded in the memory.

The geomagnetic calculation unit performs normalization by substituting the maximum and minimum values recorded in the memory and the X and Y axis output values detected from the signal detection unit into the following equation.

Equation 1

In Equation 1, X and Y are output values of the X and Y axis fluxgates, Xn and Yn are normalization values of X and Y, respectively, Xmax and Xmin are the maximum and minimum values of X, and Ymax and Ymin are respectively. Represent the maximum and minimum value of Y, respectively. The geomagnetic calculation unit calculates Xbias, Xscale, Ybias, and Yscale by substituting Xmax, Xmin, Ymax, and Ymin previously measured and recorded in the memory into Equation 1, and then calculates Xn and Yn using the same again.

According to the X- and Y-axis output values normalized by the geomagnetic calculation unit, the X-axis output is represented by the cos function graph, and the Y-axis output value is represented by the sin function graph.

The geomagnetic calculation unit calculates the rotation angle by using the X-axis and Y-axis output values. That is, the rotation angle ψ is expressed as tan-1 (Y-axis output value / X-axis output value). According to Fig. 7, a tan function graph expressed as Y-axis output value / X-axis output value is also shown.

On the other hand, the tan-1 function has a range of 0 ° to 90 ° in the first quadrant, -90 ° to + 90 ° in the second and third quadrants, and -90 ° to 0 ° in the fourth quadrant. Will have As a result, in order to fully express the range of 0 ° to 360 °, the geomagnetic calculation unit calculates the rotation angle according to the following equation.

Equation 2

Quadrant 1: Rotation Angle = tan-1 (Y / X)

2nd and 3rd quadrants: angle of rotation = 180 ° + tan-1 (Y / X)

4 quadrants: rotation angle = 360 ° + tan-1 (Y / X)

In Equation 2, X and Y represent an X-axis output value and a Y-axis output value, respectively.

The rotation angle calculated by the geomagnetic calculation unit is input to the controller. The controller extracts the information corresponding to the rotation angle from the main memory as described above.

On the other hand, according to another embodiment of the present invention, the geomagnetic sensor measures the degree of rotation using a variety of sensors, such as a magnetic resistance sensor (Magnetic Resistance sensor), magnetic impedance sensor (Magnetic Impedance sensor), Hall sensor (hall sensor), etc. can do.

In order to achieve the above object, the lens 610 may include at least three or more lens groups, and at least one lens group of the lens groups may include an aspherical plastic lens. .

6 is a conceptual diagram schematically illustrating a lens system according to an exemplary embodiment of the present invention.

The first lens group 611 having positive refractive power, the second lens group 612 having positive refractive power, and the third lens group 613 having negative refractive power from the direction in which external light enters the lens system. can do.

Small cameras, especially cameras mounted on portable mobile devices such as small mobile phones, are focused on miniaturization. In this case, as the camera is miniaturized, the lens system included in the camera may also be miniaturized. As the lens system is miniaturized, the incident angle of light incident on the lens system may be increased.

7 is a conceptual diagram schematically showing an optical path for explaining the principles of the present invention.

At this time, as shown in Figure 7, the light incident on the lens system from any subject (object) is incident in the form of a light cone (light cone) similar to the cone, in this case the central axis of the light cone The incident angle θ of the light on the image is called the telecentric angle 615. The incidence angle of the light on the central axis of the light cone, i.e. the telecentric angle, is important, because it is the light on the central axis 617 of the light cone that is incident on the lens system and determines the image, other than the central axis of the light cone. This is because light only plays a role in determining the brightness of the image.

As will be described later, the wavelength of the light blocked by the infrared cut filter varies according to the size of the telecentric angle of the light incident on the infrared cut filter. That is, the larger the telecentric angle of the light incident on the infrared cut filter, the shorter the transmitted region. This means that the light incident perpendicularly to the infrared cut-off filter is blocked only in the infrared region and transmitted in the visible region.

As the telecentric angle of the light incident on the infrared cut filter increases, it means that a region near red is blocked in addition to the infrared region.

Therefore, the incident light having a large telecentric angle, that is, the image of the subject not located on the central axis of the lens system appears to have a smaller red area than the image of the subject located on the central axis. It is blue compared to the image. As a result, the image of the center located on the central axis is relatively red, and the image of the peripheral part not located on the central axis is relatively blue, resulting in a problem that the image is not clear.

That is, as described above, as the telecentric angle 615 of the light incident on the infrared cut filter 120 increases, the above-described problem occurs. Thus, the telesen of light incident on the infrared cut filter If the trick angle is small, the above problems can be prevented. The infrared blocking filter may be provided between the lens system and the imaging device by reducing the telecentric angle of the light incident on the infrared blocking filter, but in this case, the back focal length is increased to increase the size of the imaging device. In addition, there is a problem that by increasing the unit cost of the imaging device, it cannot meet the current trend of miniaturization and compactness.

Therefore, as shown in FIG. 1, the infrared cut filter 120 is disposed on the front surface of the first lens group 611, whereby the light path is changed while the light from the subject passes through the first lens group. As a result, the telecentric angle of the light at the time of entering the infrared cut filter is reduced, thereby preventing the problem of having the infrared cut filter provided between the lens system and the imaging device. The sharpness of the image can be prevented. At this time, the light path is changed while light from the subject passes through the first lens group, and the first lens group has a positive refractive power in order to reduce the telecentric angle when the light enters the infrared cut filter. I like it.

The lens unit may include a lens and a shutter, and may further include an aperture. The lens may include a zoom lens, a focus lens, and the like, which are typically provided in a dedicated digital still camera. The shutter may include both an electronic or mechanical shutter. The camera according to the present invention may further include an aperture for adjusting the amount of light incident through the lens, such as a dedicated digital still camera. The lens unit may include a lens driving circuit for driving the zoom lens and a focus lens, a shutter driving circuit for driving the shutter, and an aperture driving circuit for driving the aperture.

Since the camera according to the exemplary embodiment of the present invention is mainly used in a mobile communication terminal, it is preferable that the lens unit is simply implemented to improve the portability of the user. That is, the zoom lens, the zoom lens driving circuit, the aperture driving circuit, and the like may be deleted to remove the zoom function from the camera so that the aperture has a fixed aperture opening and closing amount. When the aperture with a fixed aperture opening and closing amount is used, the amount of incident light may be adjusted by adjusting the shutter speed. However, if necessary, the lens unit may be implemented by including all or selectively the zoom lens, the focus lens, the iris, and the driving circuit thereof, as in the conventional lens unit included in the digital still video camera.

The image sensor 650 detects an image (optical signal) of the subject passing through the lens unit and converts the converted image into an electrical signal (imaging image signal) containing the captured image. It consists of a Charge Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS) sensor that forms an image sensor that is sensitive to the visible region (about 400 to 700 nm) and the near infrared region (about 700 to 1000 nm). The sensor generates and outputs a digital signal by photoelectric conversion of the optical image input from the lens.

The control unit 700 includes: an image signal processor (ISP: 710) for removing noise of the electrical signal converted by the image sensor 650 and controlling gain to convert the signal into a digital image signal; And controlling the LED lighting apparatus 200 according to the luminance value and the color temperature value detected by the illuminance sensor 300 to adjust the brightness and white balance of the digital image signal, and to adjust the brightness and white balance. It may include a digital signal processor (DSP: 750) for converting into a standardized image signal according to a predetermined standard, compressing to store the standardized image signal, and restoring the compressed standardized image signal to display the compressed standardized image signal.

8 is a conceptual diagram of the control unit 700.

9 is a configuration diagram showing an example of the control unit in more detail.

Preferably, the display unit 800 further includes an LCD unit for visually displaying an image processed by the control unit, and in this embodiment, the display unit is configured according to the luminance value of the surrounding environment detected by the illuminance sensor. Backlight brightness can be adjusted.

The data processor 900,

It is preferable to correct the distorted image due to camera shake, rotation, change in luminance value of the surrounding environment, etc. by using the image and output information obtained from the image acquisition unit to an image suitable for iris diagnosis and recognition.

According to the first embodiment of the present invention, in the compensation method of the present invention, an image area dividing step (S101) of dividing a captured image into sub-unit areas and re-defining these sub-unit areas to re-define them into a middle region consisting of a center area and an edge area (S101). And a data sampling step (S102) of sampling a signal for each sub-unit area, a step (S103) of dividing the sampled signal into brightness values, color values, and sharpness values, and a brightness compensation step (S107) for compensating the brightness values. ) And a color compensation step (S104) comprising a color compensation step (S108) for compensating the color value, a sharpness compensation step (S105) for compensating the sharpness value of the compensation data which has been subjected to the data compensation step, and the sharpness compensation step. It is characterized in that the mux step (S106) for transmitting to the liquid crystal device of the mobile phone by mux the brightness value and the color value compensated through.

According to a second embodiment of the present invention, in the compensation method of the present invention, in the first embodiment, the brightness compensation step (S107) calculates the brightness average value by averaging the signal in the center area (S121). ), A difference value calculating step (S122) for calculating a difference value between the brightness value Y (n) and the brightness average value Ya of the edge region, and the brightness gain determination of decreasing the brightness gain Gy (n) as the difference value increases. Step S123 and a compensation value calculation step S124 for calculating the brightness compensation value Yc (n) by multiplying the difference value by the brightness gain Gy (n).

According to a third embodiment of the present invention, in the compensation method of the present invention, in the first embodiment, the brightness compensating step comprises: a mean value calculation step (S121) of calculating a brightness average value Ya by averaging a signal in a center region; A difference value calculating step of calculating a difference value between the brightness value Y (n) and the brightness average value Ya of the edge region; a gain determining step of increasing the brightness gain Gy (n) as the difference value increases, and the brightness component Y and a compensation value calculating step of calculating the brightness compensation value Yc (n) by multiplying (n) by the brightness gain Gy (n).

According to a fourth embodiment of the present invention, in the compensation method of the present invention, in the first to second embodiments, the color compensation step is predetermined to the color values U (n) and V (n) of the edge region. It is characterized by calculating the color compensation value by multiplying the color gain Guv (n) of.

According to a fifth embodiment of the present invention, in the compensation method of the present invention, in the fourth embodiment, the sharpness compensation step includes: the sharpness value of the edge region closest to the edge region among the subunit regions of the center region; It is characterized by replacing with.

According to a sixth embodiment of the present invention, in the compensation method of the present invention, in the fifth embodiment, the image area dividing step divides the captured image into a total of sixteen subunit areas and binds four central subunit areas to one. It is characterized in that the center region and the three sub-unit regions of each edge are redefined as a break-up region having four edge regions.

10 is a block diagram of a signal compensation method according to an embodiment of the present invention;

11 is an example of a screen in which divisionally defined images captured for signal compensation according to the present invention are divided into regions.

The signal compensation method of the present invention comprises an image region division step, a data sampling step, a data separation step, a data compensation step, a sharpness compensation step, and a data muxing step.

The image region dividing step divides the captured image region R into sub-unit regions SR1, SR2, SR3, ..., Sn, grouping the sub-unit regions, and re-defines the sub-region region MR composed of the center region CR and the edge region ER. It is a deciding step. The division of the image area as described above is to compensate for the data value of the edge area based on the data of the center area with less distortion because the distortion phenomenon occurs intensively in the edge area ER of the captured image. As shown in Fig. 11, the image area R is made up of 16 sub-unit areas SR1, SR2,... , SR16, four sub-unit areas SR6, SR7, SR10, SR11 are grouped into a center area CR, SR1, SR2, SR5 as edge area ER1, SR3, SR4, SR8 as edge area ER2, SR9, SR13, The divisional regulation is made into an interruption area consisting of an edge area including SR14 as the edge area ER3 and SR12, SR15 and SR16 as the edge area ER4.

The data sampling step is a step of sampling a signal for each subunit region according to a predetermined rule.

The data separation step is to separate brightness values Y (n), color values U (n), V (n), and sharpness values S (n) from a signal measured from the sampling step.

The data compensation step includes a brightness compensation step and a color compensation step, and the brightness compensation step includes an average value calculation step, a difference value calculation step, a gain determination step and a compensation value calculation step.

12 is a block diagram of a data compensation step according to an embodiment of the present invention.

Referring to the brightness compensation step (S121), the brightness average value calculation step is to calculate the brightness average value Ya of the brightness value Y (n) of the central region. For example, in the case of dividing into 16 sub-unit areas, the brightness values Y (6), Y (7), Y (10), and Y (11) of the subunit areas SR6, SR7, SR10, and SR11 are obtained. These brightness average values Ya = (Y (6) + Y (7) + Y (10) + Y (11)) / 4 are obtained.

The difference value calculating step (S122) is a step of obtaining a difference value between the brightness average value Ya of the center region and the brightness value Y (n) of each subunit region of the edge region. The difference value is calculated in order to determine the gain for compensating the brightness component.

The gain determination step S123 may be implemented in various ways, but basically, if the brightness value Y (n) of the edge area is less than the brightness average value Ya of the center area, it is inevitable to compensate for the brightness value Y (n) of the edge area. The gain is determined to be close to the brightness average value Ya within the range of minimizing the noise problem, which is obtained by decreasing the brightness gain Gy (n) as the difference is larger. Can be determined. The method of reducing the brightness gain Gy (n) as the difference becomes larger is as follows.

Ya-Y (n) ≥ 10 High Ya-Y (n) <20, Gy (n) = 2.2 (When the difference is more than 10 and less than 20, brightness gain: 2.2)

Ya-Y (n) ≥20 High Ya-Y (n) <30, Gy (n) = 1.5 (If the difference is more than 20 and less than 30, brightness gain: 1.5)

Ya-Y (n) ≥ 30 High Ya-Y (n) <40, Gy (n) = 1.1 (When difference value is more than 30 and less than 40, brightness gain: 1.1)

Ya-Y (n) ≥ 40 High Ya-Y (n) <50, Gy (n) = 0.9 (When the difference is more than 40 and less than 50, brightness gain is 0.9)

Compensation brightness value calculating step (S124) is a step of compensating the brightness value Y (n) of the edge region with the gain determined by the above process,

The difference value is multiplied by the brightness gain Gy (n) to determine the compensation brightness value Yc (n) (Yc (n) = (Ya-Y (n)) × Gy (n)).

According to another embodiment of the present invention, the brightness gain Gy (n) may be determined by increasing the difference as the difference value increases. In this case, the compensation brightness value is not the difference value but the corresponding brightness of the edge region. The value Y (n) is compensated by directly multiplying the brightness gain Gy (n) (Yc (n) = Y (n) × Gy (n)).

The color compensation step calculates the compensation color values Uc (n) and Vc (n) by multiplying the color values U (n) and V (n) of the edge area by a predetermined color gain Guv (n). The gain compensates for the crosstalk of the signal caused by the process.

In the sharpness correction step, the compensation brightness values Yc (n) and the compensation color values Uc (n) and Vc (n) that have been subjected to the data compensation step are increased with the noise as well. Will be done. Sharpness correction can be implemented in a variety of known ways, but preferably replaces the sharpness value S (n) of the subunit area of the edge area with the sharpness value of the subunit area of the center area closest to the edge area. In the case of dividing the image area into 16, for example, the sharpness values S (1), S (2) and S (5) of the subunit areas SR1, SR2, SR5 of the edge area ER1 are divided into the subunit areas SR6 of the center area CR. The sharpness values S (3), S (4) and S (8) of the subunit areas SR3, SR4 and SR8 of the edge area ER2 are replaced with the sharpness values S (6) and the sharpness values of the subunit area SR7 of the center area CR. The sharpness values S (9), S (13) and S (14) of the subunit areas SR9, SR13, SR14 of the edge area ER3 are replaced by the S (7) value, and the sharpness values S (of the subunit area SR10 of the center area CR 10) and replace the sharpness values S (12), S (15) and S (16) of the subunit areas SR12, SR15 and SR16 of the edge area ER4 with the sharpness values S (11) of the subunit area SR11 of the center area CR. Replace with a value.

The MUX step MUX the compensation brightness value and the compensation color value compensated through the sharpness compensation step and transmit the MUX to the liquid crystal device of the mobile phone.

Auto focusing method according to the present invention

The distance of the subject is determined by computer analysis using only the image itself. The camera uses the same information as the composition (rectangular border) of the subject to be positioned inside by aiming the area of interest (both eyes, or both eyes) of the subject displayed on the screen. That is, the camera causes an image formed through the lens to be formed on the image pickup device, and the pieces of pixels of the image pickup device are viewed to see differences in intensity among adjacent pixels. If the background is out of focus, the pixels will have very similar intensities, and if the background is in focus, the difference in intensity between adjacent pixels will be large. After all, autofocus is to find the point (lens position) with the largest difference in intensity between adjacent pixels.

On-screen coordinate area information (sub-screen area) of the sub-screen divided by N sub-screens of a wireless communication device (mobile phone, smart phone, PDA, etc.) equipped with an autofocus camera device, and this sub-screen The first step of displaying the subject on the touch screen by performing auto focus initially set according to the shooting mode setting by the photographer while storing the ranging information corresponding to the area, the rectangle so that both eyes and face can be aimed and positioned. A second step (S131) of setting and displaying a window of a second step; a third step (S132) of calculating an on-screen coordinate of the rectangular part when both eyes and a face are positioned in a rectangular window; A fourth step (S133) of identifying the sub screen area, and auto focus according to the measurement distance information corresponding to the sub screen area. Comprising a fifth step of performing provides a method for changing the auto focusing position on the screen in a predetermined focus distance.

FIG. 13 is a diagram illustrating a step-by-step procedure of performing auto focusing based on measurement distance information to a subject corresponding to a sub screen area according to an exemplary embodiment.

The measurement distance information is a center pixel coordinate of the sub screen, and according to the fifth step, autofocusing is performed by measuring an intensity difference between adjacent pixels as shown in FIG. 12 based on the center pixel of the sub screen. It is preferable.

The autofocus measures the difference in intensity between neighboring pixels based on a pixel corresponding to the center coordinate of the sub-screen (hereinafter, referred to as a 'center cell') and performs the focusing.

14 is a flowchart illustrating a method of changing an autofocusing position with respect to a moving subject according to a first embodiment of the present invention.

When the autofocus camera device is set to the camera mode (ie, the shooting mode) by the photographer (S142), the control unit displays an image of the subject formed by the lens unit on the touch screen (S143) and controls the measurement distance unit. Perform autofocusing accordingly.

Then, the photographer looks at the image of the subject through the touch screen and moves the camera around to set the composition of the subject to be photographed.

The coordinate calculation unit calculates the coordinates of the portion where the response signal is generated on the touch screen (S144) and provides the coordinates to the controller, and the controller compares the coordinates provided by the coordinate calculation unit with the sub-screen area stored in the storage unit (S145). The preset square subscreen is determined.

When the photographer enters the preset subject composition, the control unit searches the storage unit for the measured distance movement information stored in the sub-screen, which is matched with the sub-screen, and indicates the measurement distance corresponding to the sub-screen. The measured distance value is provided from the distance unit (S146).

When the controller detects the measured distance value corresponding to the corresponding sub-screen, the controller provides a center pixel coordinate to the auto focus unit for auto focusing according to the measured distance value to instruct the execution of autofocus. Accordingly, the autofocus unit detects pixels on the screen corresponding to the received center pixel coordinates and checks the difference in signal strength between the center pixel and its surrounding pixels. (S147) Then, the autofocus unit controls the operation of the lens driver. In response, the lens driving unit performs autofocus by moving the lenses forming the lens unit to find a point having the greatest intensity difference between pixels.

The light incident on the lens unit by the auto focusing forms an image according to the measurement distance value of the corresponding sub-screen. In this case, the sub-region preset by the photographer appears most clearly. As a result, the photographer can check and capture an image in which the subject has the clearest region of interest through the touch screen.

As described above, the software corrects the image caused by lens distortion.

The method includes the following steps.

Let X be any point on the plane lying in three-dimensional space. In the absence of camera rotation, X is represented by the perspective transform on the image as follows:

수학식 3

Equation 3

Here, P is a perspective transformation matrix, and considering the camera rotation R, it is changed to the following equation (21).

수학식 4

Equation 4

And from equations 3 and 4

수학식 5

Equation 5

At this time, the rotation matrix R is assumed to be rotated by the camera coordinate system and is expressed as follows.

Equation 6

The angle value of Equation 6 is equal to the amount of camera rotation obtained through camera calibration, but the direction of rotation is opposite. In other words, it is assumed that the reference coordinate system is located on the plane. Since the actual operation process is an image pixel coordinate system, it is impossible to generate an orthoimage using Equation 5 only. This is because x in Equation 5 is multiplied by PRP-1, so the third element of x 'is not' 1 '. That is, the expression expressed in the homogeneous coordinate system through Equation 5 should be expressed in the image coordinate system again. This can be solved by the affine transform, denoted by "A".

In order to express the image pixel coordinate system in the homegeneous coordinate system S152, a scale between two coordinate systems needs to be determined. The transform matrix is primarily formed by using a homegeneous coordinate value corresponding to the image size. You can get it.

수학식 7

Equation 7

In summary,

수학식 8

Equation 8

To obtain an ortho-image (S153), the gray (or color) value of the pixel coordinate value of the corresponding perspective image (lens distorted camera image) is read from the pixel coordinate value of the ortho image. Since inverse spatial mapping is advantageous, Equation 9 below is used as a spatial mapping function.

수학식 9

Equation 9

In fact, in the process of obtaining the orthoimage, the scale of the final image is determined according to which point four points are used in the procedure of obtaining “A” represented by Equation (9). That is, the scale can be determined by appropriately adjusting the points a2, b2, c2, and d2 corresponding to the four corners of the orthogonal image shown on the right side of FIG. It is decided whether to correct the distortion.

FIG. 15 illustrates a process of determining which region is to be distortion-corrected according to a scale in a current camera image (perspective image).

For example, in the case of selecting a1, b1, c1, and d1 in FIG. 15, distortion of the entire contents of the perspective image S151 may be corrected but there is no corresponding region in the inverse spatial warping process. Will cause this

As described above, the present invention is to compensate for the degradation of the image quality caused by lens distortion in the imaging equipment employing the lens system, such as a digital camera, and to generate an orthoimage for the resulting image Distortion correction can be performed automatically using only the image without depending on the lens system information or external device, so that it is applicable not only to still images provided by general digital cameras but also to videos captured by the same camera. In addition, in the case of applying a zoom lens or a varifocal lens, the lens distortion parameter for each lens position can be obtained through calibration, and the obtained lens distortion variable is stored in a nonvolatile memory or a look-up table. In this way, the distortion parameter at any lens position can be solved by interpolation of known values.

In the detailed description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the following claims and their equivalents.

P: perspective transformation matrix
R: camera rotation matrix
A: convert affine

Claims (16)

Acquire the first image according to the luminance distribution of the visible light range with respect to the region of interest (face, eyes) from the infrared cut-off bandpass filter and the region of interest (face, eyes) from the near infrared transmission bandpass filter 100 according to the necessary purpose. An image acquisition unit for separately acquiring a second image according to grayscale of

A data processor 900 for correcting an image suitable for iris diagnosis and recognition by using the image and output information processed and acquired from the image acquisition unit;

The illuminance sensor 300 for detecting the luminance value and the color temperature value of the surrounding environment from the region of interest, the acceleration and gyro sensor 400 for detecting impacts such as acceleration and gravity, the geomagnetic sensor 500 for detecting rotation information, and the like. Sensor unit to include.

And an illumination device unit 200 including a visible light LED 220 for projecting a specific region visible light and an infrared LED 210 for projecting light in a near infrared region.

A camera unit including a lens and a low light image sensor having three lens groups;

A band pass filter unit including a near-infrared transmission filter 110 and an infrared cut-off filter 120 respectively arranged in a manual left and right sliding opening and closing manner in front of the lens;

A control unit including a lens 610, an image sensor 650, and a method and a module for controlling the LED lighting device 200 according to an output value of a sensor;

Preferably, the LCD may further include an LCD 800 that visually displays the processed image acquired by the image acquisition unit, and may adjust the backlight brightness of the LCD unit according to the luminance value of the surrounding environment detected by the illumination sensor 300. And, the display unit 800 to display the first image and the second image on the same screen at the same time, or to display the result processed separately, respectively,

If the area of interest (both eyes, or both eyes) of the subject falls within the preset subject composition (rectangular border), the measured distance movement information matched to this sub-screen is retrieved from the storage unit and provided to the distance measuring unit. Autofocusing (S148) method to move the lens forward and backward to find the best focus by receiving the measured distance value corresponding to

Data processing unit 900 including a method for correcting a distorted image due to camera shake, rotation, change of luminance value of surrounding environment, etc. by using image and output information acquired from image acquisition unit to image suitable for iris diagnosis and recognition )Wow,

Iris diagnosis and iris recognition image processing system comprising a
The method of claim 1,
The band pass filter is composed of a filter which transmits light in the near infrared region and blocks light in the visible region, and a filter which transmits the visible region and blocks the light in the infrared region. The iris diagnosis and iris recognition wireless mobile communication terminal image processing system, characterized in that the filter can be used coated on the glass or film surface
The method of claim 1,
When the band pass filter part pushes the opening / closing switch 150 protruding to the outside center of the camera seating part to the right side, the cover slides to the right side so that the camera seating part is completely covered with the near infrared transmission filter 110, and the opening and closing switch 150 is turned to the left side. The sliding cover is slid to the left so that the camera seat is completely covered with the infrared cut filter 120, the iris diagnosis and the iris recognition wireless mobile terminal image processing, characterized in that it can be configured integrally or separately with the wireless communication terminal. system
The method of claim 1,
The illumination unit is located in the upper direction of the lens of the visible light LED projecting the visible light in a specific region according to the filter selection, the infrared LED projecting the light of the near infrared region is located in the lower direction of the lens. The iris diagnosis and iris recognition wireless, characterized in that the power supply of the LED lighting device is not supplied from the power of the wireless communication terminal, the battery can be independently attached to the power supply and can be configured separately. Mobile communication terminal image processing system The method of claim 1,
The illuminance sensor of the sensor unit includes a visible light detector 310 for detecting visible light in an imaging environment, an infrared detector 320 for detecting infrared light in an imaging environment, and an integrated analysis of visible light and infrared light in the detected imaging environment. Iris diagnosis and iris recognition wireless mobile terminal image processing system, characterized in that it can be configured to include a converter 330 for converting the output of the brightness and color temperature of the environment to the correct physical quantity The method of claim 1,
The acceleration sensor of the sensor unit detects and calculates a shake during exposure in which an image of the subject region of interest enters the imaging plane, compares the calculated shake with a preset correction limit, and calculates an excessive angle outside the correction limit.
An iris diagnosis and iris recognition wireless mobile communication terminal image processing system, characterized in that the gyro sensor 400 calculates the angular velocity and quantitatively compares the shake with a preset correction limit to capture excessive shake. The method of claim 1,
The geomagnetic sensor of the sensor unit includes an X-axis and a Y-axis fluxgate which are orthogonal to each other, and a geomagnetic detection module for detecting an electrical signal corresponding to the geomagnetism from each of the fluxgates, and the X- and Y-axis fluxgates respectively detected. A signal processor for converting and outputting an electrical signal into predetermined X and Y axis output values, and normalizing the X and Y axis output values to a predetermined range, respectively, and then rotating angles from the normalized output values. Iris diagnosis and iris recognition wireless mobile communication terminal image processing system comprising a geomagnetic calculation unit for calculating The method of claim 1,
The lens of the camera unit is a first lens group 611 having positive refractive power, a second lens group 612 having positive refractive power, and a third lens group 613 having negative refractive power from a direction in which external light is incident. An iris diagnosis and iris recognition wireless mobile terminal image processing system, comprising: a zoom lens, a focus lens, and an aperture The method of claim 1,
By providing an infrared cut filter 120 on the front surface of the first lens group 611, the light path is changed while the light from the subject passes through the first lens group, and as a result it is incident on the infrared cut filter. Iris diagnosis and iris recognition wireless mobile communication terminal image processing system, characterized in that the telecentric angle of the light at the time can be made small, thereby preventing the sharpness of the image. The method of claim 1,
The image sensor 650 of the camera unit has a visible light range even in low light.
(Images about 400 to 700 nm) and near-infrared (about 700 to 1000 nm)
Iris diagnosis and iris recognition wireless mobile communication terminal image processing system, characterized in that composed of a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor The method of claim 1,
The control unit 700 removes noise of the electrical signal converted by the image sensor 650, and adjusts the gain to convert the image signal processor (ISP: 710) and the detected by the illumination sensor 300 The LED lighting apparatus 200 is controlled according to a luminance value to adjust the brightness and white balance of the digital image signal, and convert the digital image signal having the brightness and white balance adjusted to a standardized image signal according to a predetermined standard. Iris diagnosis and iris recognition wireless mobile terminal image, characterized in that it may include a digital signal processor (DSP: 750) for compressing to store the standardized image signal, and restores to display the compressed standardized image signal Processing system The method of claim 1,
The signal processing method of the data processing unit includes an image region division step, a data sampling step, a data separation step, a data compensation step, a sharpness compensation step, and a data muxing step. system The method of claim 12,
The image region dividing step divides the captured image region R into sub-unit regions SR1, SR2, SR3, ..., Sn and re-defines the sub-unit regions into a midpoint region MR consisting of the center region CR and the edge region ER. Step. The division of the image area as described above is to compensate for the data value of the edge area based on the data of the center area with less distortion because the distortion phenomenon occurs intensively in the edge area ER of the captured image. As shown in Fig. 11, the image area R is made up of 16 sub-unit areas SR1, SR2,... , SR16, four sub-unit areas SR6, SR7, SR10, SR11 are grouped into a center area CR, SR1, SR2, SR5 as edge area ER1, SR3, SR4, SR8 as edge area ER2, SR9, SR13, An image processing system for iris diagnosis and iris recognition, characterized in that SR14 is divided into an interruption area consisting of an edge area having an edge area ER3 and SR12, SR15, SR16 being an edge area ER4. The method of claim 12,
The data compensation step includes a brightness compensation step and a color compensation step, and the brightness compensation step includes an average value calculation step, a difference value calculation step, a gain determination step and a compensation value calculation step. Mobile communication terminal image processing system The method of claim 1,
The auto focusing method divides the touch screen of a wireless communication device (mobile phone, smart phone, PDA, etc.) with an auto focus camera device into N sub-screens and coordinate area information on the screen for the sub-screens (sub-screen area). And a first step of displaying the subject on the touch screen by performing auto focus initially set according to the shooting mode setting by the photographer, while storing the ranging information corresponding to the sub-screen area. Step 2 (S131) of setting and displaying a rectangular window so as to be displayed, step 3 (S132) of calculating coordinates on the screen of the rectangular part when both eyes and faces are aimed and positioned in the rectangular window, and calculating the on-screen A fourth step (S133) of identifying the sub screen area including coordinates; and the measurement distance information corresponding to the sub screen area. The iris diagnosis and iris recognition wireless mobile communication terminal image processing system, comprising: providing an auto focusing position changing method for a screen within a predetermined shooting distance including a fifth step of performing auto focus;
The method of claim 1,
In order to obtain an ortho-image (S153) correcting an image caused by lens distortion, the gray in the pixel coordinate value of the perspective image (lens distorted camera image) corresponding to the pixel coordinate value of the orthoimage is obtained. Inverse spatial mapping, which reads (or color) values, and scales by appropriately adjusting the points corresponding to the four corners of the orthoimage to determine which area in the current camera image (perspective image: S151). Iris diagnosis and iris recognition wireless mobile terminal image processing system, characterized in that it provides a method for determining whether to correct the distortion

Images