CN1668106A - Method and apparatus for removing blocking effect of image frame using loop filter - Google Patents

Method and apparatus for removing blocking effect of image frame using loop filter Download PDF

Info

Publication number
CN1668106A
CN1668106A CN 200410028297 CN200410028297A CN1668106A CN 1668106 A CN1668106 A CN 1668106A CN 200410028297 CN200410028297 CN 200410028297 CN 200410028297 A CN200410028297 A CN 200410028297A CN 1668106 A CN1668106 A CN 1668106A
Authority
CN
China
Prior art keywords
pixel
pixel data
threshold
borders
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200410028297
Other languages
Chinese (zh)
Inventor
金昌成
施宣辉
郭宗杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ali Corp
Original Assignee
Ali Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ali Corp filed Critical Ali Corp
Priority to CN 200410028297 priority Critical patent/CN1668106A/en
Publication of CN1668106A publication Critical patent/CN1668106A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

This invention provides a block effect image process method for removing image pictures with loop filter and related devices used to process the block effect between two blocks in a picture by loop filter. This invention compares two edge pixels of the two edge sides of said two blocks based on at least a sensing threshold to decide if it's necessary to regulate the pixel data of said two edge pixels to reduce the difference corresponding to the data.

Description

Remove the method and apparatus of the block effect of image frame with loop filter
Technical field
The invention provides a kind of method and apparatus that is used for handling the block effect of image frame, especially refer to a kind ofly handle the method and apparatus of the block effect of image frame with the threshold of feelings (perceptual threshold) loop filter of mode.
Background technology
Current at present several image encoding standards are that unit encodes to an image frame with the block, and the data of each block usually need processing via quantization operations to promote the data compression rate of cataloged procedure, therefore this image frame has non-continuous event usually in decoded block border, so-called block effect (blocking artifact).For this non-continuous event that results from image encoding and produce can be eased up improving the quality of image frame, the up-to-date video signal coding standard of advancing---H.264 adopt loop filter to handle the block effect of image frame.Related data sees also the H.264 file of video signal coding standard.
Above-mentioned loop filter is the filter that is arranged in encoding loop or the decoding loop, and it has than the better treatment effeciency of back level filter that is arranged at outside encoding loop or the decoding loop, and needn't extra buffer need be set as back level filter.Fig. 1 is the schematic diagram with combination of the image processing system 110,130 of loop filter and a transmission/storage medium 120.Image processing system 110 is an encoding loop 110, is used for the view data that input terminal 111 is imported is encoded.And transmit/storage medium 120 is used for transmitting or memory encoding loop 110 is produced encoded video signal.Image processing system 130 is a decoding loop 130, the encoded video signal of transmission/storage medium 120 inputs certainly that is used for decoding, and the view data behind lead-out terminal 133 output decoders.Wherein transmission/storage medium 120 can be transmission channels such as world-wide web, also can be storage devices such as CD or DVD.Encoding loop 110 have a coding unit 112, a reconstruction unit 114, with a loop filter 116.Decoding loop 130 has a decoding unit 132 and a loop filter 136.Image processing according to mpeg standard is required, predictive frame (P Frame, Predictive Frame) with parts of images information must compare by the intra coded frame (I Frame, Intra Frame) that encoding loop 110 or 130 pairs of decoding loops have complete image information, with coding or the decoding of finishing described predictive frame.Loop filter 116,136 then can be in encoding loop 110 or filter task that decoding loop 130 is encoded or finish described loop filter in the lump during decode operation is endowed, so its treatment effeciency surpasses the treatment effeciency of described back level filter.
Compare with back level filtering, though H.264 the video signal coding standard has the innate advantage of loop filter, the complexity of computing becomes the H.264 bottleneck of video signal coding standard.Meet H.264 with one that the decoder of video signal coding standard is an example, promptly accounted for the workload of whole decoding loop about 33% with the loop filter that removes block effect.
Summary of the invention
Therefore main purpose of the present invention is to provide a kind of loop filter in threshold of feelings mode to handle the method and apparatus of the block effect of image frame, to address the above problem.
The invention provides a kind of image processing method, be used for handling the block effect between two blocks in the image frame (blocking artifact).This image processing method has: storage is to pixel data that should two blocks; And according to a first threshold relatively two border pixels of the boundaries on either side of this two block (boundary edge pixel) determine whether adjusting the pixel data of this two borders pixel, if the pairing difference of pixel data of this two borders pixel meets this first threshold, the pixel data of adjusting this two borders pixel is to reduce the pairing difference of pixel data of this two borders pixel.
The present invention also provides a kind of loop filter of image processing system accordingly when said method is provided, be used for handling the block effect between two blocks in the image frame.This loop filter has: a memory cell is used for storing to pixel data that should two blocks; One comparing unit, be electrically connected to this memory cell, be used for according to a first threshold relatively two border pixels of the boundaries on either side of this two block (boundary edge pixel) determine whether adjusting the pixel data of this two borders pixel, if the pairing difference of pixel data of this two borders pixel meets this first threshold, this comparing unit decision is adjusted the pixel data of this two borders pixel to reduce the pairing difference of pixel data of this two borders pixel; And an arithmetic element (arithmetic unit), be electrically connected to this comparing unit and this memory cell, be used for adjusting the pixel data of this two borders pixel.
One of benefit of the present invention is, the present invention handles the block effect of image frame with loop filter, compares with back level filtering, and loop filter has preferable treatment efficiency.
Another benefit of the present invention is, the present invention determines whether to adjust the pixel data of this two borders pixel in the mode of the threshold of feelings, and therefore the block effect that is difficult for identification for human eye can determine to disregard fast, to promote the treatment efficiency of this image frame.
Description of drawings
Fig. 1 is the schematic diagram of the combination of a conventional image processing system and a transmission/storage medium.
Fig. 2 is the schematic flow sheet of image processing method of the present invention.
Fig. 3 be Fig. 2 method interior (intra) coding filtering schematic flow sheet.
Fig. 4 is the schematic flow sheet of (inter) coding filtering between the method for Fig. 2.
Fig. 5 is the schematic diagram of the handled relevant block of method of Fig. 2.
Fig. 6 is the schematic diagram of the pixel sequence of Fig. 2.
Fig. 7 is the schematic diagram of the handled pixel data of method of Fig. 2.
Fig. 8 is the boundary intensity table of comparisons of the method for Fig. 4.
Fig. 9 is the schematic diagram of sensation loop filter of the present invention.
Figure 10 is the schematic diagram of image encoding system of the sensation loop filter of an application drawing 9.
Figure 11 is the schematic diagram of picture decoding system of the sensation loop filter of an application drawing 9.
The reference numeral explanation
110,130,700,800 image processing systems
111,113,131,133 input/output terminals
112 coding units
114 reconstruction units
116,136,600 loop filters
120 transmission/storage mediums
132 decoding units
300 macro zone blocks
301-308,401 borders
The 315-348 block
610 memory cell
620 comparing units
630 arithmetic elements
M, the n vertical vector
????p i,q iPixel data
Embodiment
Please also refer to Fig. 2, Fig. 3 and Fig. 4, Fig. 2, Fig. 3, be all the schematic flow sheet of image processing method of the present invention with Fig. 4, wherein Fig. 3 and Fig. 4 distinguish the step 201a of displayed map 2, the detailed process of 201b.At first in step 200 decision frame type (frame type), step 200 is known in the art to method of the present invention.When a present pending frame is an intra coded frame (Intra frame), execution in step 201a, otherwise this present pending frame is a coded frame (Inter frame), with regard to execution in step 201b.The kind of above-mentioned intra coded frame has: interior encode fragment (Intraslice) and synchronously interior encode fragment (SI slice, Synchronized Intra slice).And the kind of coded frame has between above-mentioned: predictive coding fragment (Pslice, Predicted slice), bi-directional predictive coding fragment (Bslice, Bidirectional predicted slice), with predictive coding fragment (SP slice, Synchronized Predicted slice) synchronously.Because the content of step 201b is similar to the part details of step 201a, below step 201a, description of step 201b again will be described earlier.
Please also refer to Fig. 3, Fig. 4, Fig. 5 and Fig. 6.Fig. 5 is Fig. 3 and the schematic diagram of the handled relevant block of method of Fig. 4, and Fig. 6 is the schematic diagram of the pixel sequence of Fig. 3.In present embodiment, the handled image frame of the method for Fig. 3 and Fig. 4 is the unit of composition with macro zone block shown in Figure 5 (macroblock) 300, each macro zone block 300 have 16 blocks (block) 315,316 ..., 348, wherein each block has the pixel data (luminance pixel data) of 4 * 4 brightness or the pixel data (chromatic pixel data) of 2 * 2 colors.The longitudinal axis of Fig. 6 is represented the size of described pixel data, and the transverse axis of Fig. 6 is then represented a vertical vector n, and wherein vertical vector n is perpendicular to the border 401 of two adjacent region piece P, Q (not being shown in relevant indicators) in this image frame.
Fig. 3, Fig. 4, with pixel data p shown in Figure 6 i, q i(i=0,1 ...) correspond respectively to this two adjacent regions piece P, Q, wherein pixel data p 0, q 0Represent the data that are arranged in the boundary pixel (boundary edgepixel) on the border 401 of the most close this two block P, Q on the vertical vector n among this two block P, the Q respectively, and pixel data p 1, q 1Then representative is arranged in the data that vertical vector n goes up the border interior pixels (interior edge pixel) on secondly close border 401 respectively, and the rest may be inferred.For example with the block 326,336 of Fig. 5 as this two adjacent regions piece P, Q, the shown vertical vector m of Fig. 5 is one of vertical vector perpendicular to border 303, border 401 then shown in Figure 6 is border shown in Figure 5 303, and vertical vector n shown in Figure 6 is vertical vector m shown in Figure 5.This moment Fig. 6 pixel data p 0, p 1... representative in the block 326 of Fig. 5 near 303 places, border in regular turn toward the data that are arranged in the pixel on the vertical vector m away from border 303 directions, and the pixel data q of Fig. 6 0, q 1... the representative in the block 336 of Fig. 5 near 303 places, border in regular turn toward the data that are arranged in the pixel on the vertical vector m away from border 303 directions.Along with the selection of different vertical vector m, each block 315,316 of each macro zone block 300 of this image frame ..., 348 border 301,302 ..., the block effect (blocking artifact) on 308 can be handled to remove one by one by Fig. 3 and image processing method shown in Figure 4.
As shown in Figure 3, the invention provides a kind of image processing method, be used for handling the block effect between two block P, the Q in the image frame.Wherein this image processing method is the loop filter method of a video signal coding process or vision signal decode procedure.The order of following steps and non-limiting scope of the present invention, the specification specified of the step 201a of this image processing method is as follows.
Step 202: storage is to pixel data p that should two block P, Q i, q i(i=0,1,2);
Step 204: according to a significant difference threshold value (Noticeable Difference Threshold) the Δ I pixel data p of two border pixels of 401 both sides, border of this two block P, Q relatively 0, q 0Determine whether adjusting the pixel data p of this two borders pixel 0, q 0, if the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0Less than significant difference threshold value Δ I, then enter and stop ahead of time (EarlyTermination) state 290 and handle follow-up pixel data to save time, otherwise enter step 206, wherein significant difference threshold value Δ I also can be described as critical significant difference (JND, Just NoticeableDifference) Δ I;
Step 206: can distinguish the relatively pixel data p of two border pixels of 401 both sides, border of this two block P, Q of discontinuous threshold value (Recognizable DiscontinuityThreshold) T (Δ Q, Δ I) according to one 0, q 0Determine whether adjusting the pixel data p of this two borders pixel 0, q 0, if the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0Less than distinguishing discontinuous threshold value T (Δ Q, Δ I), then enter step 208, otherwise enter ahead of time state of termination 290 and handle follow-up pixel data to save time, wherein can distinguish discontinuous threshold value T (Δ Q, Δ I) also can be described as and to distinguish discontinuous restriction (Recognizable Discontinuity Limit) T (Δ Q, Δ I);
Step 208: adjust threshold value (Adjustment Threshold) Δ according to one 0/ 2 pixel data p of the pixel in this two borders pixel relatively 0Or q 0Pixel data p with a border interior pixels that is close to 1Or q 1Determine whether adjusting the pixel data p of this two borders pixel 0, q 0, if the pixel data difference p of block P 1-p 0Less than adjusting the threshold value Δ 0/ 2 or the pixel data difference q of block Q 1-q 0Less than adjusting the threshold value Δ 0/ 2, then enter step 210, handle follow-up pixel data to save time otherwise enter ahead of time state of termination 290;
Step 210: the pixel data p that adjusts this two borders pixel 0, q 0To reduce the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0, difference p wherein 0-q 0Be luminance difference (luminancedifference) or heterochromia (chromatic difference).It is as follows that this step is adjusted the result:
p 0’=p 0+kΔ 0
q 0’=q 0-kΔ 0
And in adjusting back execution in step 212p, 212q respectively;
Step 212p: according to the significant difference threshold value Δ I pixel data p of the adjusted boundary pixel in this two borders pixel relatively 0' with a next-door neighbour the pixel data p of border interior pixels 1Determine whether adjusting the pixel data p of this border interior pixels 1, if difference p 1-p 0' less than significant difference threshold value Δ I, enter then ahead of time that state of termination 291p handles follow-up pixel data to save time, otherwise enter step 214p;
Step 214p: the expection adjusted value p of pixel data that calculates this next-door neighbour's border interior pixels 1'=p 1+ 0.5k Δ 0, and the pixel data p of this border interior pixels relatively 1With its expection adjusted value p 1' how the person is than the pixel data p near this adjusted boundary pixel 0' with one next-door neighbour this border interior pixels pixel data p 2Mean value p m, to determine whether to adjust the pixel data p of this border interior pixels 1, if difference p 1'-p mLess than p 1-p m, then enter step 216p, otherwise pixel data p 1To not be updated.As shown in Figure 7, mean value p mBe pixel data p 0' and pixel data p 2Mid point;
Step 216p: with the pixel data p of this border interior pixels 1Be adjusted into its expection adjusted value p 1'=p 1+ 0.5k Δ 0
Step 212q: according to the significant difference threshold value Δ I pixel data q of the adjusted boundary pixel in this two borders pixel relatively 0' with a next-door neighbour the pixel data q of border interior pixels 1Determine whether adjusting the pixel data q of this border interior pixels 1, if difference q 1-q 0' less than significant difference threshold value Δ I, enter then ahead of time that state of termination 291q handles follow-up pixel data to save time, otherwise enter step 214q;
Step 214q: the expection adjusted value q of pixel data that calculates this next-door neighbour's border interior pixels 1'=q 1-0.5k Δ 0, and the pixel data q of this border interior pixels relatively 1With its expection adjusted value q 1' how the person is than the pixel data q near this adjusted boundary pixel 0' with one next-door neighbour this border interior pixels pixel data q 2Mean value q m, to determine whether to adjust the pixel data q of this border interior pixels 1, if difference q 1'-q mLess than q 1-q m, then enter step 216q, otherwise pixel data q 1To not be updated; And
Step 216q: with the pixel data q of this border interior pixels 1Be adjusted into its expection adjusted value q 1'=q 1-0.5k Δ 0
Above-mentioned significant difference threshold value Δ I according to Weber's law (Weber ' s Law) define.The Weber's law statement: delta threshold (increment threshold) is a definite value to the ratio of background intensity.In present embodiment, the mean flow rate of this two block P, Q can be defined as I respectively p, I qAccording to Weber's law, be I in background luminance pThe time, the distinguishable hardly critical significant difference Δ I of human eye pBrightness I to environment pThe ratio perseverance be definite value k.Similarly, be I in background luminance qThe time, the distinguishable hardly critical remarkable difference DELTA I of human eye qBrightness I with environment qThe ratio perseverance be definite value k.Shown in the parameter-definition of Fig. 3, the employed significant difference threshold value of method of the present invention Δ I is the critical remarkable difference DELTA I of this two block P, Q p, Δ I qMean value (Δ I p+ Δ I q)/2.That is to say significant difference threshold value Δ I=(Δ I p+ Δ I q)/2=(kI p+ kI q)/2.As previously described, method of the present invention not only is applicable to the pixel data p of brightness i, q i, also be applicable to the pixel data p of color i, q iTherefore as the handled pixel data p of method of the present invention i, q iPixel data p for color i, q iThe time, just the pixel data mean value with this two block P, Q is defined as I respectively p, I q, calculate significant difference threshold value Δ I=(Δ I according to aforementioned definitions again p+ Δ I q)/2=(kI p+ kI q)/2.
As described in step 216p, the pixel data p of this border interior pixels 1Adjustment amount 0.5k Δ 0Pixel data p for the described boundary pixel of step 210 0Adjustment amount k Δ 0Half.And for example step 216q is described, the pixel data q of this border interior pixels 1Adjustment amount-0.5k Δ 0Pixel data q for the described boundary pixel of step 210 0Adjustment amount-k Δ 0Half.Especially it is noted that, though the parameter-definition of Fig. 3 shows: can distinguish discontinuous threshold value T (Δ Q, Δ I) is defined as the difference DELTA Q of quantization parameter (Quantization Parameter) of this two block P, Q and the linear combination (α Δ Q+ β Δ I) of significant difference threshold value Δ I, and in present embodiment, can adopt simple parameters α=β=1 to implement, this and non-limiting scope of the present invention.In another embodiment of the present invention, can distinguish discontinuous threshold value T (Δ Q, Δ I) also can by the many formulas of more high order of Δ Q and Δ I or the function of other kind of Δ Q and Δ I be constituted, wherein when the difference DELTA Q of the quantization parameter of this two block P, Q or critical remarkable difference DELTA I increase, can distinguish discontinuous threshold value T (Δ Q, Δ I) also increases accordingly, and when the difference DELTA Q of the quantization parameter of this two block P, Q or critical remarkable difference DELTA I reduce, can distinguish that discontinuous threshold value T (Δ Q, Δ I) also reduces accordingly.Therefore method of the present invention also includes: when the difference DELTA Q of the quantization parameter of this two block P, Q or critical remarkable difference DELTA I increased, increase can be distinguished discontinuous threshold value T (Δ Q, Δ I); And when the difference DELTA Q of the quantization parameter of this two block P, Q or critical remarkable difference DELTA I reduced, minimizing can be distinguished discontinuous threshold value T (Δ Q, Δ I).
Please also refer to Fig. 2, Fig. 4 and Fig. 8, Fig. 8 is boundary intensity (BS, the BoundaryStrength) table of comparisons of the method for Fig. 4, and wherein this boundary intensity table of comparisons is known by industry, and its definition defines as JVT (H.264) standard.As shown in Figure 2, when this present pending frame is a coded frame, execution in step 201b.Yet at the beginning of execution in step 201b, at first check according to the boundary intensity table of comparisons shown in Figure 8 whether the boundary intensity BS of the frame that this is at present pending is zero, if boundary intensity BS is zero, according to details execution in step 201b shown in Figure 4, otherwise this pending frame will not be updated.As shown in Figure 4, the specification specified of the step 201b of this image processing method is as follows.
Step 202: storage is to pixel data p that should two block P, Q i, q i(i=0,1,2);
Step 206 ': according to the threshold value T pixel data p of two border pixels of 401 both sides, border of this two block P, Q relatively 0, q 0Determine whether adjusting the pixel data p of this two borders pixel 0, q 0, if the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0Less than threshold value T, then enter step 208 ', handle follow-up pixel data to save time otherwise enter ahead of time state of termination 290.The definition of the threshold value T of this step parameter-definition as shown in Figure 4 wherein;
Step 208 ': adjust the threshold value Δ according to one 0/ 2 pixel data p of the pixel in this two borders pixel relatively 0Or q 0Pixel data p with a border interior pixels that is close to 1Or q 1Determine whether adjusting the pixel data p of this two borders pixel 0, q 0, if the pixel data difference p of block P 1-p 0Less than adjusting the threshold value Δ 0/ 2 or the pixel data difference q of block Q 1-q 0Less than adjusting the threshold value Δ 0/ 2, then enter step 210 ', handle follow-up pixel data to save time otherwise enter ahead of time state of termination 290.Parameter Δ wherein 0Definition as shown in Figure 4, so adjustment threshold value Δ of this step 0/ 2 definition is change accordingly also;
Step 210 ': the pixel data p that adjusts this two borders pixel 0, q 0To reduce the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0, difference p wherein 0-q 0Be luminance difference XOR heterochromia.It is as follows that this step is adjusted the result:
p 0’=p 0+kΔ 0
q 0’=q 0-kΔ 0
Parameter Δ wherein 0Definition as shown in Figure 4, so the adjustment result of this step also accordingly the change.
In present embodiment, when the mean value of the quantization parameter of this two block P, Q less than ten six the time, then disregard the block effect on the border 401 of this two block P, Q, handle the block effect on other border of this image frame to save timeliness.
Please consult Fig. 9, Figure 10 and Figure 11 simultaneously, Fig. 9 is the schematic diagram of sensation loop filter 600 of the present invention, and Figure 10 and Figure 11 are respectively the schematic diagram of image processing system of the sensation loop filter 600 of an application drawing 9.The present invention also provides a kind of loop filter 600 of image processing system accordingly when said method is provided, be used for handling the block effect between two block P, the Q in the image frame.Wherein this image processing system is a video coder 700 or a video signal decoder 800.The explanation of method as described above, because can the present invention have used with human eye and differentiate relevant significant difference threshold value Δ I and can distinguish discontinuous threshold value T (Δ Q, Δ I), thus loop filter 600 also can be described as sensation loop filter (PLF, Perceptual Loop Filter) 600.Loop filter 600 includes: a memory cell 610 is used for storing to pixel data p that should two block P, Q i, q iAnd a comparing unit 620, be electrically connected to memory cell 610, be used for according to the significant difference threshold value Δ I pixel data p of two border pixels of 401 both sides, border of this two block P, Q relatively 0, q 0, determine whether adjusting the pixel data p of this two borders pixel 0, q 0If the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0Less than significant difference threshold value Δ I, then comparing unit 620 is as described in the step 204, decision enters ahead of time state of termination 290 and handles follow-up pixel data to save time, otherwise as described in step 206, comparing unit 620 can be distinguished the relatively pixel data p of two border pixels of 401 both sides, border of this two block P, Q of discontinuous threshold value T (Δ Q, Δ I) according to one 0, q 0Determine whether adjusting the pixel data p of this two borders pixel 0, q 0If the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0Less than distinguishing discontinuous threshold value T (Δ Q, Δ I), then comparing unit 620 decision as step 208 again row further relatively, otherwise comparing unit 620 decisions enter and do sth. in advance state of termination 290 and handle follow-up pixel data to save time.As previously described, pixel data p 0, q 0Can be the pixel data p of brightness 0, q 0, also can be the pixel data p of color 0, q 0So above-mentioned difference p 0-q 0It can be luminance difference XOR heterochromia.
Loop filter 600 also includes: an arithmetic element (arithmetic unit) 630, be electrically connected to comparing unit 620 and memory cell 610, and be used for adjusting the pixel data p of this two borders pixel i, q iAs described in step 208, comparing unit 620 is also adjusted the threshold value Δ according to one 0/ 2 pixel data p of the pixel in this two borders pixel relatively 0Or q 0Pixel data p with a border interior pixels that is close to 1Or q 1Determine whether adjusting the pixel data p of this two borders pixel 0, q 0If the pixel data difference p of block P 1-p 0Less than adjusting the threshold value Δ 0/ 2 or the pixel data difference q of block Q 1-q 0Less than adjusting the threshold value Δ 0/ 2, then comparing unit 620 decision is adjusted the pixel data p of these two borders pixels as described in the step 210 with arithmetic element 630 0, q 0To reduce the pixel data p of this two borders pixel 0, q 0Pairing difference p 0-q 0But comparing unit 620 is execution in step 212zp, 214p in addition, with decision whether as described in the step 216p, with the pixel data p of this border interior pixels 1Be adjusted into its expection adjusted value p with arithmetic element 630 1'=p 1+ 0.5k Δ 0As previously described, the pixel data p of this border interior pixels 1Adjustment amount 0.5k Δ 0Pixel data p for the described boundary pixel of step 210 0Adjustment amount k Δ 0Half.Similarly, but comparing unit 620 also execution in step 212q, 214q, with decision whether as described in the step 216q, with the pixel data q of this border interior pixels 1Be adjusted into its expection adjusted value q with arithmetic element 630 1'=q 1-0.5k Δ 0Also as previously described, the pixel data q of this border interior pixels 1Adjustment amount-0.5k Δ 0Pixel data q for the described boundary pixel of step 210 0Adjustment amount-k Δ 0Half.
In present embodiment, when the difference DELTA Q of the quantization parameter of this two block P, Q or significant difference threshold value Δ I increased, comparing unit 620 increases can distinguish discontinuous threshold value T (Δ Q, Δ I); When the difference DELTA Q of the quantization parameter of this two block P, Q or significant difference threshold value Δ I reduced, comparing unit 620 reduces can distinguish discontinuous threshold value T (Δ Q, Δ I).
The explanation of method as described above, the difference of each element in the present embodiment when carrying out 206 ', 208 ', 210 ' only is threshold value T and parameter Δ 0Select for use, no longer repeat to give unnecessary details.
In the quantization operations process that general pattern is handled, the selected quantization parameter of each block is big more, and picture quality is poor more; Described quantization parameter is more little, and picture quality is good more.The preferable pairing quantization parameter scope of picture quality is about below 22.Method and apparatus of the present invention is under quantization parameter is about situation below 22, and the picture quality after the processing all can match in excellence or beauty and meet picture quality after H.264 the loop filter of video signal coding standard is handled.
One of benefit of the present invention is, the present invention handles the block effect of image frame with loop filter, compares with back level filtering, and loop filter has preferable treatment efficiency.
Another benefit of the present invention is, the present invention determines whether to adjust the pixel data of this two borders pixel in the mode of the threshold of feelings, and therefore the block effect that is difficult for identification for human eye can determine to disregard fast, to promote the treatment efficiency of this image frame.
Another benefit of the present invention is, the computing of method of the present invention and relevant apparatus is simple and easy, and the image frame of being formed with the block that level, vertical two directions are arranged, one side of each block border and with this block border vertical direction on have only the pixel data of two pixels to be adjusted at most, so its treatment efficiency is better than the treatment efficiency of conventional H .264 standard.
The above only is preferred embodiment of the present invention, and all equivalences of carrying out according to claim of the present invention change and revise, and all should belong to covering scope of the present invention.

Claims (20)

1. an image processing method is used for handling the block effect between two blocks in the image frame, and this image processing method includes:
Storage is to pixel data that should two blocks; And
According to a first threshold relatively two border pixels of the boundaries on either side of this two block determine whether adjusting the pixel data of this two borders pixel, if the pairing difference of pixel data of this two borders pixel meets this first threshold, the pixel data of adjusting this two borders pixel is to reduce the pairing difference of pixel data of this two borders pixel.
2. the method for claim 1, wherein this difference is a luminance difference XOR heterochromia.
3. the method for claim 1, it also includes: the pixel data that determines whether adjusting this two borders pixel according to one second threshold ratio than a pixel in this two borders pixel and a next-door neighbour's border interior pixels.
4. method as claimed in claim 3, it also includes: the pixel data that determines whether adjusting this border interior pixels according to one the 3rd threshold ratio than an adjusted boundary pixel in this two borders pixel and a next-door neighbour's border interior pixels.
5. method as claimed in claim 4, wherein the 3rd threshold value equals this first threshold.
6. method as claimed in claim 4, wherein the pixel data adjustment amount of this border interior pixels is half of pixel data adjustment amount of this boundary pixel.
7. the method for claim 1, it also includes:
When the difference of the quantization parameter of this two block increases, increase this first threshold; And
When the difference of the quantization parameter of this two block reduces, reduce this first threshold.
8. the method for claim 1, it also includes:
When one increases according to the defined critical significant difference of Weber's law, increase this first threshold; And
When this critical significant difference reduces, reduce this first threshold.
9. the method for claim 1, wherein this first threshold is one according to the defined critical significant difference of Weber's law.
10. the method for claim 1, wherein this image processing method is the loop filter method of a video signal coding process or vision signal decode procedure.
11. the loop filter of an image processing system is used for handling the block effect between two blocks in the image frame, this loop filter includes:
One memory cell is used for storing to pixel data that should two blocks;
One comparing unit, be electrically connected to this memory cell, be used for according to a first threshold relatively two border pixels of the boundaries on either side of this two block determine whether adjusting the pixel data of this two borders pixel, if the pairing difference of pixel data of this two borders pixel meets this first threshold, this comparing unit decision is adjusted the pixel data of this two borders pixel to reduce the pairing difference of pixel data of this two borders pixel; And
One arithmetic element is electrically connected to this comparing unit and this memory cell, is used for adjusting the pixel data of this two borders pixel.
12. loop filter as claimed in claim 11, wherein this difference is a luminance difference XOR heterochromia.
13. loop filter as claimed in claim 11, wherein this comparing unit also determines whether adjusting the pixel data of this two borders pixel than a pixel in this two borders pixel and a next-door neighbour's border interior pixels according to one second threshold ratio.
14. loop filter as claimed in claim 13, wherein this comparing unit also determines whether adjusting the pixel data of this border interior pixels than an adjusted boundary pixel in this two borders pixel and a next-door neighbour's border interior pixels according to one the 3rd threshold ratio.
15. method as claimed in claim 14, wherein the 3rd threshold value equals this first threshold.
16. loop filter as claimed in claim 14, wherein the pixel data adjustment amount of this border interior pixels is half of pixel data adjustment amount of this boundary pixel.
17. loop filter as claimed in claim 11, wherein when the difference of the quantization parameter of this two block increased, this comparing unit increased this first threshold; When the difference of the quantization parameter of this two block reduced, this comparing unit reduced this first threshold.
18. loop filter as claimed in claim 11, wherein when one increased according to the defined critical remarkable difference of Weber's law, this comparing unit increased this first threshold; When this critical significant difference reduced, this comparing unit reduced this first threshold.
19. loop filter as claimed in claim 11, wherein this first threshold is one according to the defined critical significant difference of Weber's law.
20. loop filter as claimed in claim 11, wherein this image processing system is a video coder or a video signal decoder.
CN 200410028297 2004-03-09 2004-03-09 Method and apparatus for removing blocking effect of image frame using loop filter Pending CN1668106A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200410028297 CN1668106A (en) 2004-03-09 2004-03-09 Method and apparatus for removing blocking effect of image frame using loop filter

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200410028297 CN1668106A (en) 2004-03-09 2004-03-09 Method and apparatus for removing blocking effect of image frame using loop filter

Publications (1)

Publication Number Publication Date
CN1668106A true CN1668106A (en) 2005-09-14

Family

ID=35038949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200410028297 Pending CN1668106A (en) 2004-03-09 2004-03-09 Method and apparatus for removing blocking effect of image frame using loop filter

Country Status (1)

Country Link
CN (1) CN1668106A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007033551A1 (en) * 2005-09-19 2007-03-29 Huawei Technologies Co., Ltd. A loop filtering method for use in image encoding process
US8131105B2 (en) 2006-11-28 2012-03-06 Realtek Semiconductor Corp. Image processing method and device for performing block effect reduction
CN101527842B (en) * 2008-03-07 2012-12-12 瑞昱半导体股份有限公司 Image processing method and image processing device for filtering blocking artifact
CN103530895A (en) * 2012-07-06 2014-01-22 北京大学 Method and device for detecting mosaic

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007033551A1 (en) * 2005-09-19 2007-03-29 Huawei Technologies Co., Ltd. A loop filtering method for use in image encoding process
CN100438629C (en) * 2005-09-19 2008-11-26 华为技术有限公司 Loop filtering method in image coding processing
US8131105B2 (en) 2006-11-28 2012-03-06 Realtek Semiconductor Corp. Image processing method and device for performing block effect reduction
CN101527842B (en) * 2008-03-07 2012-12-12 瑞昱半导体股份有限公司 Image processing method and image processing device for filtering blocking artifact
CN103530895A (en) * 2012-07-06 2014-01-22 北京大学 Method and device for detecting mosaic
CN103530895B (en) * 2012-07-06 2016-07-13 北京大学 A kind of method and apparatus detecting mosaic

Similar Documents

Publication Publication Date Title
US10225550B2 (en) Controlling a video content system by computing a frame quality score
CN1164123C (en) Quantization process for video encoding
US7289562B2 (en) Adaptive filter to improve H-264 video quality
US11172231B2 (en) Method, apparatus and system for encoding or decoding video data of precincts by using wavelet transform
CN101207812B (en) Method for filtering video loop
CN100581255C (en) Pixel loop filtering method and filter
CN1416650A (en) method for filtering digital images, and filetring device
CN1287598C (en) Filtering method and apparatus for removing blocking artifacts and/or ringing noise
CN101267560A (en) Block-removal filtering method and device
US20140192866A1 (en) Data Remapping for Predictive Video Coding
CN1652610A (en) Deblocking filtering method and apparatus of video frequency or image
CN1285214C (en) Loop filtering method and loop filter
Fernández et al. Complexity reduction in the HEVC/H265 standard based on smooth region classification
CN101321276B (en) Method and apparatus for removing block effect
CN107105240B (en) HEVC-SCC complexity control method and system
CN1668106A (en) Method and apparatus for removing blocking effect of image frame using loop filter
CN113079375B (en) Method and device for determining video coding and decoding priority order based on correlation comparison
CN1723712A (en) Joint resolution or sharpness enhancement and artifact reduction for coded digital video
US20050196066A1 (en) Method and apparatus for removing blocking artifacts of video picture via loop filtering using perceptual thresholds
CN116320446A (en) Video encoding method and device, electronic equipment and computer medium
WO2018177395A1 (en) Method and apparatus for filtering video frames
CN1449196A (en) Method of processing digital images for low-bit rate applications
CN1937780A (en) Block effect removing method for video compression
KR100916996B1 (en) Image processing apparatus and method, lcd overdrive system using the same
US7844124B2 (en) Method of estimating a quantization parameter

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication