CN101729884B - Image acquiring device and image preprocessing method - Google Patents

Image acquiring device and image preprocessing method Download PDF

Info

Publication number
CN101729884B
CN101729884B CN 200810201288 CN200810201288A CN101729884B CN 101729884 B CN101729884 B CN 101729884B CN 200810201288 CN200810201288 CN 200810201288 CN 200810201288 A CN200810201288 A CN 200810201288A CN 101729884 B CN101729884 B CN 101729884B
Authority
CN
China
Prior art keywords
data
image
mentioned
colourity
chroma
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200810201288
Other languages
Chinese (zh)
Other versions
CN101729884A (en
Inventor
陈永纬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huiguo (Shanghai) Software Technology Co Ltd
Silicon Motion Inc
Original Assignee
Huiguo (Shanghai) Software Technology Co Ltd
Silicon Motion Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huiguo (Shanghai) Software Technology Co Ltd, Silicon Motion Inc filed Critical Huiguo (Shanghai) Software Technology Co Ltd
Priority to CN 200810201288 priority Critical patent/CN101729884B/en
Publication of CN101729884A publication Critical patent/CN101729884A/en
Application granted granted Critical
Publication of CN101729884B publication Critical patent/CN101729884B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Color Television Systems (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

The invention discloses an image acquiring device and an applied image preprocessing method. The image preprocessing method comprises the following steps: receiving image data which comprises luminance data and chrominance data; merging the chrominance data in adjacent rows to generate chrominance merging data; temporarily storing the luminance data and the chrominance merging data by using a buffer group; obtaining the chrominance merging data from the buffer group and making adjacent rows share the corresponding chrominance merging data to obtain the processed chrominance data. The processed chrominance data and the luminance data outputted by the buffer group are used for displaying an image on a screen.

Description

Image capture unit and image preprocessing method
Technical field
The invention relates to image capture unit and image preprocessing method and device, particularly about a kind of pre-process method and device of YUV image.
Background technology
In digital image processing field, common a kind of coding method is the YUV coding.The image data of YUV coding techniques gained comprises: brightness data Y (Luminance, Luma) and chroma data U and V (Chrominance, Chroma).U is blue partially degrees of data (another common C that is denoted as b).V is red partially degrees of data (another common C that is denoted as r).YUV coding is followed following formula, the data of red to include, green and primary colors (RGB):
Y＝0.299*R+0.587*G+0.114*B；
U=0.436* (B-Y)/(1-0.114); And
V＝0.615*(R-Y)/(1-0.299)。
Because human eye is not so good as brightness (Y) to the susceptibility of colourity (U and V), so can adopt low sampling frequency for colourity (U and V).Common a kind of method is the sampling of 4:2:2 colourity.
Fig. 1 is with the image data explanation 4:2:2 colourity sampling of a picture 100.Being different from brightness data must be to each pixel sampling, and the sampling of 4:2:2 colourity reduces by half the sampling frequency of chroma data (U and V), makes per two pixels share one group of chroma data (U and V).Consult Fig. 1, the pixel 102 of the 0th row (row) the 0th row (column) only has brightness data Y 00With blue partially degrees of data U 00Sampling, and do not have the sampling of red partially degrees of data (V); 104 of the pixels of the 0th row the 1st row only have brightness data Y 01With red partially degrees of data V 01Sampling, and do not have the sampling of blue partially degrees of data (U). Pixel 102 and 104 is shared chroma data U 00With V 01
Above-mentioned image data (YUV) can be converted to data streaming (streaming) through an image compaction algorithms.The image compaction algorithms need be a plurality of sprites (sub-image) with a picture segmentation usually, and each sprite is carried out computing.Conventional art as buffer (line buffer), is collected the image data of sprite usually with buffer, uses during for the image compaction algorithms.
In addition, above-mentioned image data (YUV) also must be temporary in the output of buffer (linebuffer) side earlier before being played in screen.
The quantity that how to reduce buffer (line buffer) is the important problem in present technique field.
Summary of the invention
The present invention discloses a kind of image capture unit and applied image preprocessing method.
Image capture unit of the present invention comprises a sensing cell, an image data generation unit, one first image pretreatment unit, a buffer group, one second image pretreatment unit and an image compression unit.Above-mentioned sensing cell and image data generation unit are responsible for sensing image and are produced image data, and wherein, image data comprises brightness data and chroma data.Brightness data is temporary to buffer group.Chroma data then is temporary in buffer group after the first image pretreatment unit is converted to the colourity merging data; Wherein, the performed action of the first image pretreatment unit is: merge the chroma data of adjacent lines, so as to reducing the data volume of chroma data.The second image pretreatment unit is positioned at after the buffer group, in order to obtain above-mentioned colourity merging data and to make adjacent row share pairing colourity merging data, handles the back chroma data with output.Chroma data and brightness data are used to show that an image is in a screen after the processing that above-mentioned second image pretreatment unit and buffer group are provided.
The present invention more can be used for the pre-process of image processing computings such as image compaction algorithms.Except being played on the screen, any image processing computing that needs to collect sprite as the image compaction algorithms, also can be used this image preprocessing method.The method comprises: receive image data, comprising brightness data and chroma data; The chroma data that merges adjacent lines is to produce the colourity merging data; With temporary above-mentioned brightness data of a buffer group and above-mentioned colourity merging data; And obtain above-mentioned colourity merging data from above-mentioned buffer group, and make adjacent row share pairing colourity merging data, to obtain handling the back chroma data.The brightness data that chroma data and above-mentioned buffer group are kept in after the above-mentioned processing plays for image or follow-up image processing computing is used.
Description of drawings
For above-mentioned purpose of the present invention, feature and advantage can be become apparent, below in conjunction with accompanying drawing the specific embodiment of the present invention is elaborated, wherein:
Fig. 1 is with the image data explanation 4:2:2 colourity sampling of a picture 100; And
Fig. 2 is a kind of execution mode of image capture unit of the present invention.
The primary clustering symbol description:
100～one pictures;
The pixel of 102～corresponding picture 100 the 0th row the 0th row;
The pixel of 104～corresponding picture 100 the 0th row the 1st row;
200～image capture unit;
202～sensing component; 204～image data generation component;
206～the first image pretreatment units;
208～buffer group;
210～the second image pretreatment units;
212～image compression unit; 214～Storage Media;
216～brightness data; 218～chroma data;
220～colourity merging data; 222～chroma data after handling;
The image of 224～compression; 226～screen;
Y 00-Y 73～brightness data;
U 00-U 72～blue partially degrees of data; And
V 01-V 73～red partially degrees of data.
Embodiment
Fig. 2 is a kind of execution mode of image capture unit of the present invention.Image capture unit 200 can be network camera (web-cam), digital camera ... Deng digital photographic device, comprising sensing cell 202, image data generation unit 204, the first image pretreatment unit 206, buffer group 208 and the second image pretreatment unit 210.
Sensing cell 202 can be photosensitive device, as CCD or cmos sensor, is used for sensing image.202 sensing image analog signals of sensing cell are amplified and are converted to the image data (comprising data 216 and 218) of numeral by image data generation unit 204.Image data can be the YUV coding, comprising brightness data 216 (Y) and chroma data 218 (U and V).As shown in the figure, brightness data 216 (Y) is temporary in buffer group 208; Then more after the first image pretreatment unit 206 converts colourity merging data 220 to, the side is temporary to buffer group 208 for chroma data 218.The 206 performed actions of the first image pretreatment unit are: the chroma data that merges adjacent lines.Thereby the data volume of colourity merging data 220 is far below the data quantity of chroma data 218.
Buffer group 208 can export its content when storing spill-over, and begins new storage action.The second image pretreatment unit 210 is between buffer group 208 and image compression unit 212, in order to receive colourity merging data 220 and to make adjacent row share the colourity merging data, to obtain handling back chroma data 222.The brightness data 216 that buffer group 208 is provided is used for dialling with processing back chroma data 222 puts image in screen 226.
In addition, the brightness data that provided of buffer group 208 216 with handle back chroma data 222 and also can be used to do the image compression.As shown in Figure 2, image compression unit 212 couples above-mentioned second image pretreatment unit 210 and buffer group 208, and chroma data 222 and brightness data 216 carry out an image compaction algorithms after the processing that said modules (210 and 208) is provided.Image 224 after the compression can be stored in a Storage Media 214.
In some embodiments, image data (216 and 218) can be the sampling of 4:2:2 colourity; Chroma data 218 comprises that blue partially degrees of data (is generally denoted as U or C b) and red partially degrees of data (being generally denoted as V or Cr).Consult Y, U and the V sampling of the picture 100 that Fig. 1 indicates, the first image pretreatment unit 206 can borrow column operations (expression formula 1) down to merge the chroma data of adjacent lines:
M Y, 2x=(U 2y, 2x+ U 2y+1,2x)/2; And
N Y, 2x+1=(V 2y, 2x+1+ V 2y+1,2x+1)/2; (expression formula 1)
Wherein, y and x are variable; M Y, 2xWith N Y, 2x+1The colourity merging data 220 of composition diagram 2; U 2y, 2xIt is the blue partially degrees of data of a picture 2y capable (row), 2x row (column) pixel; U 2y+1,2xThe blue partially degrees of data of, 2x row pixel capable for this picture 2y+1; V 2y, 2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y; And V 2y+1,2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y+1.
With two adjacent behavior examples of the 0th and 1 row, be positioned at the chroma data U of the 0th row 00With the chroma data U that is positioned at the 1st row 10Merge into colourity merging data M 00, M wherein 00=(U 00+ U 10)/2; Be positioned at the chroma data V of the 0th row 01With the chroma data V that is positioned at the 1st row 11Merge into colourity merging data N 01, N wherein 01=(V 01+ V 11)/2; Be positioned at the chroma data U of the 0th row 02With the chroma data U that is positioned at the 1st row 12Merge into colourity merging data M 02, M wherein 02=(U 02+ U 12)/2; Be positioned at the chroma data V of the 0th row 03With the chroma data V that is positioned at the 1st row 13Merge into colourity merging data N 03, N wherein 03=(V 03+ V 13)/2, by that analogy.
The capacity of buffer group 208 can be according to the data volume design of a sprite of image processing computing.Suppose that a sprite comprises the 8x16 pixel, sprites then capable with 0-7, the 0-15 row are example, and buffer group 208 stored data comprise:
Y 00、Y 01、Y 02、Y 03、…、Y 0，15
Y 10、Y 11、Y 12、Y 13、…、Y 1，15
Y 70、Y 71、Y 72、Y 3、…、Y 7，15
M 00、N 01、M 02、N 03、…、N 0，15
M 10、N 11、M 12、N 13、…、N 1，15
M 20、N 21、M 22、N 23、…、N 2，15
M 30、N 31、M 32、N 33、…、N 3，15
Referring to the conventional art that does not adopt first and second image pretreatment unit 206 and 210, the data of the required storage of conventional buffer group comprise:
Y 00、Y 01、Y 02、Y 03、…、Y 0，15
Y 10、Y 11、Y 12、Y 13、…、Y 1，15
Y 70、Y 71、Y 72、Y 3、…、Y 7，15
U 00、V 01、U 02、V 03、…、V 0，15
U 10、V 11、U 12、V 13、…、V 1，15
U 70、V 71、U 72、V 3、…、V 7，15
Buffer of the present invention group 208 can reduce by 25% capacity, significantly saves the area and the cost of circuit.
In some embodiments, the second image pretreatment unit 210 can borrow expression formula 2 to make adjacent row share the colourity merging data:
U ' 2y, 2x=U ' 2y+1,2x=M Y, 2xAnd
V ' 2y, 2x+1=V ' 2y+1,2x+1=N Y, 2x+1(expression formula 1)
Wherein, U ' 2y, 2x, U ' 2y+1,2x, V ' 2y, 2x+1With V ' 2y+1,2x+1 Chroma data 222 after the processing of composition diagram 2.
With two adjacent behavior examples of the 0th and 1 row, colourity merging data M 00Duplicate the 0th row pixel, as handling back chroma data U ' to the 0th and 1 row 00With U ' 10Use, wherein U ' 00=U ' 10=M 00Colourity merging data N 01Duplicate the 1st row pixel, as handling back chroma data V ' to the 0th and 1 row 01With V ' 11Use, wherein V ' 01=V ' 11=N 01Colourity merging data M 02Duplicate the 2nd row pixel, as handling back chroma data U ' to the 0th and 1 row 02With U ' 12Use, wherein U ' 02=U ' 12=M 02Colourity merging data N 03Duplicate the 3rd row pixel, as handling back chroma data V ' to the 0th and 1 row 03With V ' 13Use, wherein V ' 03=V ' 13=N 03
By expression formula 2, the image data of each pixel (about brightness data and chroma data) can be by complete collection, so as to playing or the image compaction algorithms.
The method that the present invention reduces the chroma data data volume more can be used in the pre-process of other image processing computing, the general designation image preprocessing method.Except the mentioned image compaction algorithms of Fig. 2 embodiment, any image processing computing that needs to collect earlier the data data of sprite all can be used this image preprocessing method.The method comprises: receive image data, comprising brightness data (as Y) and chroma data (as U and V), this image data can be the sampling of 4:2:2 colourity; Carry out above-mentioned expression formula 1, the chroma data that merges adjacent lines is to produce colourity merging data (M of expression formula 1 and N); With temporary above-mentioned brightness data Y of a buffer group and above-mentioned colourity merging data (M and N); And obtain above-mentioned colourity merging data (M and N), and carry out above-mentioned expression formula 2 and make adjacent row share colourity merging data (M and N) must handle back chroma data (U ' of expression formula 2 and V ') from above-mentioned buffer group.Chroma data after the above-mentioned processing (U ' and V ') will be for image broadcast or image processing computing use with the brightness data (Y) that above-mentioned buffer group keep in.The chroma data that sees through the first image pretreatment unit, 206 merging adjacent lines can be saved the hardware space of buffer group to produce the colourity merging data, and then reduces the cost of image acquisition system.

Claims (6)

1. image capture unit, comprising:
One sensing cell receives light source to produce an image simulation signal;
One image data generation unit receives above-mentioned image simulation signal and produces image data, and above-mentioned image data comprises brightness data and chroma data;
One first image pretreatment unit, the chroma data that merges adjacent lines is to produce the colourity merging data;
One buffer group is in order to temporary above-mentioned brightness data and above-mentioned colourity merging data; And
One second image pretreatment unit couples above-mentioned buffer group obtaining above-mentioned colourity merging data, and makes adjacent row share pairing colourity merging data must handle the back chroma data;
Wherein, chroma data is used to show that an image is in a screen after the brightness data that provided of this buffer group, the processing that provided with this second image pretreatment unit;
Wherein the following column operations of this first image pretreatment unit merges the chroma data of adjacent lines:
M Y, 2x=(U 2y, 2x+ U 2y+1,2x)/2; And
N y，2x+1＝(V 2y，2x+1+V 2y+1，2x+1)/2；
Wherein, y and x are variable;
M Y, 2xWith N Y, 2x+1Form above-mentioned colourity merging data;
U 2y, 2xBe that a picture 2y is capable, the blue partially degrees of data of 2x row pixel;
U 2y+1,2xThe blue partially degrees of data of, 2x row pixel capable for this picture 2y+1;
V 2y, 2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y; And
V 2y+1,2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y+1;
Wherein the following column operations of this second image pretreatment unit makes adjacent row share pairing colourity merging data:
U ' 2y, 2x=U ' 2y+1,2x=M Y, 2xAnd
V’ 2y，2x+1＝V’ 2y+1，2x+1＝N y，2x+1；
Wherein, U ' 2y, 2x, U ' 2y+1,2x, V ' 2y, 2x+1With V ' 2y+1,2x+1Form chroma data after the above-mentioned processing.
2. image capture unit as claimed in claim 1, it is characterized in that, more comprise an image compression unit, couple above-mentioned buffer group to obtain above-mentioned brightness data, couple this second image pretreatment unit obtaining chroma data after the above-mentioned processing, and to above-mentioned brightness data, with handle the back chroma data and carry out an image compaction algorithms.
3. image capture unit as claimed in claim 1 is characterized in that, above-mentioned image data is the sampling of 4:2:2 colourity, and above-mentioned chroma data comprises blue partially degrees of data and red partially degrees of data.
4. image preprocessing method, comprising:
Receive image data, comprising brightness data and chroma data;
The chroma data that merges adjacent lines is to produce the colourity merging data; And
Make adjacent row share pairing colourity merging data must handle the back chroma data;
Wherein, chroma data and above-mentioned brightness data are used to show that an image is in a screen after the above-mentioned processing;
Wherein following column operations merges the chroma data of adjacent lines:
M Y, 2x=(U 2y, 2x+ U 2y+1,2x)/2; And
N y，2x+1＝(V 2y，2x+1+V 2y+1，2x+1)/2；
Wherein, y and x are variable;
M Y, 2xWith N Y, 2x+1Form above-mentioned colourity merging data;
U 2y, 2xBe that a picture 2y is capable, the blue partially degrees of data of 2x row pixel;
U 2y+1,2xThe blue partially degrees of data of, 2x row pixel capable for this picture 2y+1;
V 2y, 2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y; And
V 2y+1,2x+1The red partially degrees of data of, 2x+1 row pixel capable for this picture 2y+1;
Wherein following column operations makes adjacent row share pairing colourity merging data:
U ' 2y, 2x=U ' 2y+1,2x=M Y, 2xAnd
V’ 2y，2x+1＝V’ 2y+1，2x+1＝N y，2x+1；
Wherein, U ' 2y, 2x, U ' 2y+1,2x, V ' 2y, 2x+1With V ' 2y+1,2x+1Form chroma data after the above-mentioned processing.
5. image preprocessing method as claimed in claim 4 is characterized in that, above-mentioned image data is the sampling of 4:2:2 colourity, and above-mentioned chroma data comprises blue partially degrees of data and red partially degrees of data.
6. image preprocessing method as claimed in claim 4 is characterized in that, more comprises above-mentioned brightness data, carries out an image compaction algorithms with processing back chroma data, to be stored in a Storage Media.
CN 200810201288 2008-10-16 2008-10-16 Image acquiring device and image preprocessing method Active CN101729884B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200810201288 CN101729884B (en) 2008-10-16 2008-10-16 Image acquiring device and image preprocessing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200810201288 CN101729884B (en) 2008-10-16 2008-10-16 Image acquiring device and image preprocessing method

Publications (2)

Publication Number Publication Date
CN101729884A CN101729884A (en) 2010-06-09
CN101729884B true CN101729884B (en) 2011-08-17

Family

ID=42449957

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200810201288 Active CN101729884B (en) 2008-10-16 2008-10-16 Image acquiring device and image preprocessing method

Country Status (1)

Country Link
CN (1) CN101729884B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI451751B (en) * 2010-10-29 2014-09-01 Silicon Motion Inc 3d-image capturing device and controller chip thereof
CN109389627A (en) * 2017-08-08 2019-02-26 宝成工业股份有限公司 Contactless glue amount judgment means
CN107948652B (en) * 2017-11-21 2021-04-13 海信视像科技股份有限公司 Method and equipment for image conversion

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1810045A (en) * 2003-06-20 2006-07-26 皇家飞利浦电子股份有限公司 Luminance and color separation
US7259796B2 (en) * 2004-05-07 2007-08-21 Micronas Usa, Inc. System and method for rapidly scaling and filtering video data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1810045A (en) * 2003-06-20 2006-07-26 皇家飞利浦电子股份有限公司 Luminance and color separation
US7259796B2 (en) * 2004-05-07 2007-08-21 Micronas Usa, Inc. System and method for rapidly scaling and filtering video data

Also Published As

Publication number Publication date
CN101729884A (en) 2010-06-09

Similar Documents

Publication Publication Date Title
US11694372B2 (en) Non-linear color correction
WO2012169140A1 (en) Image processing device, image processing method and digital camera
JP2002084547A (en) Image data size converting processor, digital camera, and image data size converting processing record medium
WO2015149583A1 (en) Terminal and terminal shooting method
CN102224736A (en) Image pick-up device
CN106027886B (en) A kind of panoramic video realizes the method and system of synchronization frame
CN101729884B (en) Image acquiring device and image preprocessing method
TWI387325B (en) Image capturing device and image pre-processing method thereof
US20230269489A1 (en) Method and apparatus for multi-image multi-exposure processing
WO2022160995A1 (en) Image sensor, camera, electronic device, and control method
KR100532021B1 (en) Method and system for single-chip integration of 3D Y/C comb filter and interlace-to-progressive converter
CN1110188C (en) Vertical line multiplication method for high-resolution camera and circuit therefor
TW201018209A (en) Method and electronic device for adjusting compression ratio of JPEG image
WO2020137662A1 (en) Image capturing device, image data processing method of image capturing device, and program
CN111242087A (en) Object recognition method and device
CN100418347C (en) Method for removing cob-webbing of digital image
CN105323568A (en) Color reconstruction method of color filter array in digital camera
US8363138B2 (en) Digital photographing apparatus
CN113747046B (en) Image processing method, device, storage medium and electronic equipment
CN103458250A (en) Image processing device and image processing method
CN102164230A (en) High-definition network shooting camera
CN101742279A (en) Compression ratio adjustment method and electronic device of JPEG (Joint Photographic Experts Group) image
CN104754314B (en) Image processing apparatus
JP2003224857A (en) Image pickup unit and image pickup method adopting interlace transfer system
TW583870B (en) Auto white balance calibration method of the image capturing device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant