CN110166798B - Down-conversion method and device based on 4K HDR editing - Google Patents
Down-conversion method and device based on 4K HDR editing Download PDFInfo
- Publication number
- CN110166798B CN110166798B CN201910469194.2A CN201910469194A CN110166798B CN 110166798 B CN110166798 B CN 110166798B CN 201910469194 A CN201910469194 A CN 201910469194A CN 110166798 B CN110166798 B CN 110166798B
- Authority
- CN
- China
- Prior art keywords
- pixel point
- target pixel
- target
- point
- order
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000006243 chemical reaction Methods 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000013507 mapping Methods 0.000 claims abstract description 7
- 239000011159 matrix material Substances 0.000 claims abstract description 7
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a down-conversion method and a down-conversion device based on 4K HDR editing, which are used for decoding a video to be processed to obtain a video source format, and respectively executing down-conversion operation on Y, U, V components of each frame, wherein the down-conversion operation comprises the following steps: s1: mapping the target pixel position to a source frame to obtain a virtual pixel point; s2: selecting a pixel point matrix around the virtual pixel point as a reference point of a target pixel; s3: and performing horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation on the reference point to obtain the value of the target pixel point. The high quality and the image fluency when the 4K data is down-converted to the high-definition data are ensured, and good user experience is provided.
Description
Technical Field
The invention relates to the field of video editing, in particular to a down-conversion method and device based on 4K HDR editing.
Background
At present, a large number of unmanned aerial vehicles, mobile phones and camera images support 4K shooting, 4K is used for editing in application of television stations, and files are packaged and output and then converted to high definition for broadcasting. The existing editing mode can not ensure the quality and the image fluency of 4K data down-conversion to high-definition data.
Disclosure of Invention
In order to solve the above problem, the present invention provides a down-conversion method based on 4K HDR editing, which decodes a video to be processed to obtain a video source format, and performs down-conversion operations on Y, U, V components of each frame respectively, where the down-conversion operations include the following steps:
s1: mapping the target pixel position to a source frame to obtain a virtual pixel point;
s2: selecting a pixel point matrix around the virtual pixel point as a reference point of a target pixel;
s3: and performing horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation on the reference point to obtain the value of the target pixel point.
Repeating the steps S1-S3 to obtain all target pixel points; and encoding the processed Y, U, V components to obtain the target video.
Further, the step S1 includes the following sub-steps:
s11: the scaling is determined as follows:
W_ratio＝srcWidth/dstWidth；
H_ratio＝srcHeight/dstHeight；
wherein W _ ratio is the width scaling, H _ ratio is the length scaling, srcWidth is the source frame width, srcHeight is the source frame height, dstWidth is the target frame width, and srcHeight is the target frame height;
s12: the position of the target pixel in the source frame is calculated as follows:
srcX＝dstX×H_ratio；
srcY＝dstY×W_ratio；
in the formula, dstX and dstY are target pixel positions, and srCx and srCY are virtual positions of the target pixels in the source frame.
Further, in step S2, when the radius of the lanczos interpolation is 2, 4 × 4 points around the virtual pixel point are selected as reference points for calculating the target pixel value.
Further, in step S3, 4 points are obtained by performing four horizontal first-order lanczos interpolation, and then the value of the target pixel point is obtained by performing one vertical first-order lanczos interpolation.
Further, the weight of 4 points participating in the first-order lanczos operation each time is determined by the following expression, and the interpolation result is a weighted average value of 4 pixel points:
in the formula, x represents the distance from the pixel point to the point to be interpolated of the original frame, and a represents the radius of the lanczos interpolation.
A down-conversion apparatus includes a decoding unit, a down-converter, and an encoding unit; the decoding unit is used for decoding a video to be processed and extracting Y, U, V components, the down converter is used for mapping the position of a target pixel to a source frame to obtain a virtual pixel point, a pixel point matrix is selected around the virtual pixel point to serve as a reference point of the target pixel, and then horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation are carried out on the reference point to obtain the value of the target pixel point; and the coding unit codes the processed Y, U, V components to obtain the target video.
The invention has the beneficial effects that: by the method and the device, high quality and image fluency when the 4K data is down-converted to the high-definition data are ensured, and good user experience is provided.
Drawings
FIG. 1 is a flow chart of a method of downconversion;
fig. 2 is a schematic diagram of an embodiment.
Detailed Description
In order to make the technical solutions of the present invention better understood by those skilled in the art, the present invention will be further described in detail with reference to the accompanying drawings and specific embodiments.
A method of down-conversion based on 4K HDR editing decodes the video to be processed to obtain a video source format, i.e. yuv file, and performs down-conversion operations on Y, U, V components of each frame, respectively, as shown in fig. 1:
s1: mapping the target pixel position to a source frame to obtain a virtual pixel point;
s2: selecting a pixel point matrix around the virtual pixel point as a reference point of a target pixel;
s3: and performing horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation on the reference point to obtain the value of the target pixel point.
Repeating the steps S1-S3 to obtain all target pixel points; and encoding the processed Y, U, V components to obtain the target video.
One embodiment of the invention converts 4K video to high definition video by down-sampling the original frame, down-converting the video frame using lanczos interpolation,
the step S1 includes the following sub-steps:
s11: the scaling is determined as follows:
W_ratio＝srcWidth/dstWidth；
H_ratio＝srcHeight/dstHeight；
wherein W _ ratio is the width scaling, H _ ratio is the length scaling, srcWidth is the source frame width, srcHeight is the source frame height, dstWidth is the target frame width, and srcHeight is the target frame height;
s12: the position of the target pixel in the source frame is calculated as follows:
srcX＝dstX×H_ratio；
srcY＝dstY×W_ratio；
in the formula, dstX and dstY are target pixel positions, and srCx and srCY are virtual positions of the target pixels in the source frame. Both srcX and srcX are typically floating point numbers, and a pixel O (srcX, srcY) is virtually present in a source frame.
Further, in step S2, when the radius of the lanczos interpolation is 2, 4 × 4 points around the virtual pixel point are selected as reference points for calculating the target pixel value. Such as the point shown in fig. 2 at the intersection of the lines.
Further, in step S3, 4 points are obtained by performing four horizontal first-order lanczos interpolation, and then the value of the target pixel point is obtained by performing one vertical first-order lanczos interpolation.
In fig. 2, to calculate the value of the target pixel, four times of first-order lanczos interpolation is performed in the horizontal direction to obtain A, B, C, D four points, and then another lanczos interpolation in the vertical direction is performed, so that the value of the pixel point O, that is, the value of the target pixel point, can be obtained by using A, B, C, D points.
Further, the weight of 4 points participating in the first-order lanczos operation each time is determined by the following expression, and the interpolation result is a weighted average value of 4 pixel points:
in the formula, x represents the distance from the pixel point to the point to be interpolated of the original frame, and a represents the radius of the lanczos interpolation. It is preferable that the value of a is 2 in the down-conversion.
And finally, writing the processed Y, U, V component into a yuv file, and then coding to obtain the video subjected to down-conversion finally.
A down-conversion apparatus includes a decoding unit, a down-converter, and an encoding unit; the decoding unit is used for decoding a video to be processed and extracting Y, U, V components, the down converter is used for mapping the position of a target pixel to a source frame to obtain a virtual pixel point, a pixel point matrix is selected around the virtual pixel point to serve as a reference point of the target pixel, and then horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation are carried out on the reference point to obtain the value of the target pixel point; and the coding unit codes the processed Y, U, V components to obtain the target video.
It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the order of acts described, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and elements referred to are not necessarily required in this application.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a ROM, a RAM, etc.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (7)
1. A down-conversion method based on 4K HDR editing decodes a video to be processed to obtain a video source format, and is characterized in that: separately performing a down-conversion operation on Y, U, V components of each frame, the down-conversion operation comprising the steps of:
s1: mapping the position of the target pixel to a source frame, and calculating in a zooming mode to obtain a virtual pixel point;
s2: selecting a pixel point matrix around the virtual pixel point as a reference point of a target pixel;
s3: and performing horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation on the reference point to obtain the value of the target pixel point.
2. The method of down-conversion based on 4K HDR editing as claimed in claim 1, wherein: repeating the steps S1-S3 to obtain all target pixel points; and encoding the processed Y, U, V components to obtain the target video.
3. The method of down-conversion based on 4K HDR editing as claimed in claim 1, wherein: the step S1 includes the following sub-steps:
s11: the scaling is determined as follows:
W_ratio＝srcWidth/dstWidth；
H_ratio＝srcHeight/dstHeight；
wherein W _ ratio is the width scaling, H _ ratio is the length scaling, srcWidth is the source frame width, srcHeight is the source frame height, dstWidth is the target frame width, and srcHeight is the target frame height;
s12: the position of the target pixel in the source frame is calculated as follows:
srcX＝dstX×H_ratio；
srcY＝dstY×W_ratio；
in the formula, dstX and dstY are target pixel positions, and srCx and srCY are virtual positions of the target pixels in the source frame.
4. The method of down-conversion based on 4K HDR editing as claimed in claim 1, wherein: in step S2, when the radius of the lanczos interpolation is 2, 4 × 4 points around the virtual pixel point are selected as reference points for calculating the target pixel value.
5. The method of claim 4, wherein the method comprises: in step S3, 4 points are obtained by performing four horizontal first-order lanczos interpolation, and then the value of the target pixel point is obtained by performing one vertical first-order lanczos interpolation.
6. The method of down-conversion based on 4K HDR editing as claimed in claim 5, wherein: the weight of 4 points participating in the first-order lanczos operation each time is determined by the following expression, and the interpolation result is the weighted average value of 4 pixel points:
in the formula, x represents the distance from the pixel point to the point to be interpolated of the original frame, and a represents the radius of the lanczos interpolation.
7. A down-conversion apparatus based on 4K HDR editing, characterized by performing the steps of the method of any one of claims 1 to 6, comprising a decoding unit, a down-converter and an encoding unit; the decoding unit is used for decoding a video to be processed and extracting Y, U, V components, the down converter is used for mapping the position of a target pixel to a source frame to obtain a virtual pixel point, a pixel point matrix is selected around the virtual pixel point to serve as a reference point of the target pixel, and then horizontal first-order lanczos interpolation and vertical first-order lanczos interpolation are carried out on the reference point to obtain the value of the target pixel point; and the coding unit codes the processed Y, U, V components to obtain the target video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910469194.2A CN110166798B (en) | 2019-05-31 | 2019-05-31 | Down-conversion method and device based on 4K HDR editing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910469194.2A CN110166798B (en) | 2019-05-31 | 2019-05-31 | Down-conversion method and device based on 4K HDR editing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110166798A CN110166798A (en) | 2019-08-23 |
| CN110166798B true CN110166798B (en) | 2021-08-10 |
Family
ID=67630465
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910469194.2A Active CN110166798B (en) | 2019-05-31 | 2019-05-31 | Down-conversion method and device based on 4K HDR editing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110166798B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7232160B2 (en) * | 2019-09-19 | 2023-03-02 | Ｔｖｓ Ｒｅｇｚａ株式会社 | IMAGE QUALITY CIRCUIT, VIDEO PROCESSING DEVICE, AND SIGNAL FEATURE DETECTION METHOD |
| CN111901551A (en) * | 2020-06-19 | 2020-11-06 | 成都东方盛行电子有限责任公司 | Ultrahigh-definition small-resolution rendering editing method, system, terminal device and storage medium |
| CN111885335B (en) * | 2020-06-19 | 2022-03-29 | 成都东方盛行电子有限责任公司 | Ultrahigh-definition down-conversion rendering method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1688166A (en) * | 2005-04-28 | 2005-10-26 | 天津大学 | HDTV-SDTV converting coder |
| CN1750636A (en) * | 2005-09-29 | 2006-03-22 | 西安交通大学 | Method for input high resolution TV and computer signals by digital high resolution TV chip |
| CN102016971A (en) * | 2008-06-27 | 2011-04-13 | 夏普株式会社 | Control device for liquid crystal display device, control method for liquid crystal display device, program, and recording medium therefor |
| CN102438135A (en) * | 2011-01-14 | 2012-05-02 | 展讯通信（上海）有限公司 | Method and device for down-sampling and decoding high-resolution video on small-size display equipment |
| CN103714512A (en) * | 2013-12-25 | 2014-04-09 | 中国船舶重工集团公司第七0九研究所 | Real-time color image scaling method based on Lanczos core |
| WO2015124754A1 (en) * | 2014-02-21 | 2015-08-27 | Koninklijke Philips N.V. | High definition and high dynamic range capable video decoder |
| CN108681992A (en) * | 2018-04-23 | 2018-10-19 | 南京理工大学 | The image interpolation algorithm of laser facula is measured for detector array method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011216948A (en) * | 2010-03-31 | 2011-10-27 | Sony Corp | Camera system, video processing apparatus, and camera apparatus |
| US8508621B2 (en) * | 2010-09-30 | 2013-08-13 | Apple Inc. | Image sensor data formats and memory addressing techniques for image signal processing |
-
2019
- 2019-05-31 CN CN201910469194.2A patent/CN110166798B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1688166A (en) * | 2005-04-28 | 2005-10-26 | 天津大学 | HDTV-SDTV converting coder |
| CN1750636A (en) * | 2005-09-29 | 2006-03-22 | 西安交通大学 | Method for input high resolution TV and computer signals by digital high resolution TV chip |
| CN102016971A (en) * | 2008-06-27 | 2011-04-13 | 夏普株式会社 | Control device for liquid crystal display device, control method for liquid crystal display device, program, and recording medium therefor |
| CN102438135A (en) * | 2011-01-14 | 2012-05-02 | 展讯通信（上海）有限公司 | Method and device for down-sampling and decoding high-resolution video on small-size display equipment |
| CN103714512A (en) * | 2013-12-25 | 2014-04-09 | 中国船舶重工集团公司第七0九研究所 | Real-time color image scaling method based on Lanczos core |
| WO2015124754A1 (en) * | 2014-02-21 | 2015-08-27 | Koninklijke Philips N.V. | High definition and high dynamic range capable video decoder |
| CN108681992A (en) * | 2018-04-23 | 2018-10-19 | 南京理工大学 | The image interpolation algorithm of laser facula is measured for detector array method |
Non-Patent Citations (3)
| Title |
|---|
| 4K超高清节目制播中HDR与SDR的兼容与转换;成六祥 邢卫东;《广播与电视技术》;20190415;全文 * |
| 下变换设备在播出系统中的使用和分析;陈登耀;《西部广播电视》;20161225;全文 * |
| 关于下变换的思考;蒋光华;《现代电视技术》;20170215;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110166798A (en) | 2019-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200349680A1 (en) | Image processing method and device, storage medium and electronic device | |
| US9501818B2 (en) | Local multiscale tone-mapping operator | |
| JP5182957B2 (en) | Variable scaling of image data for aspect ratio conversion | |
| US9652829B2 (en) | Video super-resolution by fast video segmentation for boundary accuracy control | |
| CN110166798B (en) | Down-conversion method and device based on 4K HDR editing | |
| US9001274B2 (en) | Image processing method | |
| US10306210B2 (en) | Image processing apparatus and image capturing apparatus | |
| US9471958B2 (en) | Image processing method and apparatus | |
| JP6039657B2 (en) | Method and device for retargeting 3D content | |
| CN109862208A (en) | Method for processing video frequency, device and computer storage medium | |
| CN111986601B (en) | Screen display method, device, terminal equipment and storage medium | |
| CN105230033A (en) | Adaptive frequency intensity-controlled is utilized to convert the details created in image | |
| JP2002185776A (en) | Petite size image processing engine | |
| US20220138906A1 (en) | Image Processing Method, Apparatus, and Device | |
| JP2014522596A5 (en) | ||
| US20230196721A1 (en) | Low-light video processing method, device and storage medium | |
| CN110572713B (en) | Transcoding method and processing terminal for adaptive video bandwidth ratio | |
| US10026013B2 (en) | Clustering method with a two-stage local binary pattern and an iterative image testing system thereof | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| KR102411911B1 (en) | Apparatus and method for frame rate conversion | |
| CN110121032B (en) | Method, device and equipment for displaying animation special effect and storage medium | |
| JP2016095667A (en) | Image processing device and electronics apparatus | |
| WO2024130715A1 (en) | Video processing method, video processing apparatus and readable storage medium | |
| KR101028449B1 (en) | Method and apparatus for resizing image | |
| JP2017223765A (en) | Display control device and display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |