CN1466384A - Image layered coding and exchanging method in video signal system - Google Patents
Image layered coding and exchanging method in video signal system Download PDFInfo
- Publication number
- CN1466384A CN1466384A CNA021246408A CN02124640A CN1466384A CN 1466384 A CN1466384 A CN 1466384A CN A021246408 A CNA021246408 A CN A021246408A CN 02124640 A CN02124640 A CN 02124640A CN 1466384 A CN1466384 A CN 1466384A
- Authority
- CN
- China
- Prior art keywords
- terminal
- hierarchical coding
- coding
- video
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
This invention relates to a method for picture hierarchical code and exchange in video communication system applying the hierarchical code technology of H263+in the terminal and MCU separately, MCU only acts as exchange and switch over without multipicture, but decodes, split-joins then to apply the hierarchical code technology either gets picture quality related to the band width of different bandwidth terminals having meetings at the same time or increases the ability of anti-error code to ensure having the meeting normally to increase the entire performance of the system.
Description
Technical field
The invention belongs to the video signal field, is a kind of video image image transmitted hierarchical coding and switching method of being applied to specifically.
Background technology
In the video signal field, multipoint control unit) and terminal two parts especially at present based on general main MCU (the Multipoint Control Unit: that comprises of the TV conference system of standard H.320 and H.323, pass through transmission network, Integrated Service Digital Network(ISDN)) and LAN (Local Area Network: local area network (LAN)) etc., MCU and each terminal are coupled together as ISDN (Integrated Services Digital Network:.And generally all allow polytype network and terminal to attend a meeting in the TV conference system, and the bandwidth of diverse network is not quite similar, in order normally to have a meeting, general all is to adopt bandwidth minimum among the participant to carry out coding transmission, two shortcomings are arranged concerning the participant who has higher bandwidth like this: the one, desirable picture quality can not be provided, the 2nd, do not make full use of existing bandwidth resources.
At above-mentioned shortcoming, following solution is proposed, that is: in the prior art
If do not having under the situation of many pictures, H.261/H.263 terminal image is adopting standard through after the encoding compression, send them to all terminals of attending a meeting by MCU, if do not need rate adapted, then with its direct forwarding, carry out rate adapted if desired and handle, then need image code stream is decoded, send to each terminal again after encoding by required bandwidth.
If adopting under the situation of many pictures, MCU carries out required ratio respectively after with the picture decoding of a plurality of terminals and dwindles conversion process, through splicing, carries out sending to each terminal after the encoding compression then again.
In addition, the patent No. is that US5838664, denomination of invention have also been described the TV conference system that (transmission rate matching and spatial mixing) technology is mixed in a kind of employing rate adapted (transcoding), code check coupling and space for the United States Patent (USP) of " adopting the TV conference system of rate adapted ", in this system, MCU has a VPU who carries out the processing of this respect, and (Video Processing Unit: video processing unit), each terminal all adopts the picture quality of unified bandwidth to have a meeting.
There are many shortcomings in such scheme, as handling, increased amount of calculation and time delay, reduced picture quality there not being MCU under the situation of many pictures also to carry out the rate adapted that image separates, encodes.
H.263, the vedio layering coding technology is also obtaining using widely in the standard on the other hand, this technology is in the one and same coding code stream, difference according to the decoding needs, signal to noise ratio), different resolution, different frame per second as different SNR (Signal Noise Ratio:, and obtain the video image of different quality.Three kinds of video coding and layering technical points, promptly adopt SNR hierarchical coding technology, Temporal (time) layering encoding and decoding technique, Spatial (space) hierarchical coding technology, Fig. 3,4,5 is depicted as the schematic diagram that adopts above-mentioned three kinds of hierarchical coding technology, and this class hierarchical coding technology is layered as the terminal image: basic layer and enhancement layer.The hierarchical coding technology can be arranged the code stream flow according to the transmission network present situation on the one hand, on the other hand when more serious error code appears in enhancement layer, enhancement layer can be given up and not and only show basic layer, and then improve the anti-error code capacity of system.
Summary of the invention
At said circumstances, the present invention proposes a kind of hierarchical coding technical scheme in terminal and MCU, adopting H.263+ respectively, make guaranteeing under the situation that meeting can normally be carried out that each terminal can obtain the picture quality that is complementary with the respective transmissions network bandwidth.
For achieving the above object, the invention provides image layered coding and switching method in a kind of video-signal system, this method is made up of the following step:
A, terminal image encoding code stream is carried out hierarchical coding, and be sent to MCU by transmission network;
B, whether be that the situation of many pictures judges that MCU is sent to terminal with hierarchical coding stream then to video-signal system;
C, each terminal are with the hierarchical coding code stream decoding.
Wherein, step b more particularly is meant,
If there is not the situation of many pictures, the hierarchical coding code stream that MCU directly will be complementary with the transmission network bandwidth number that each terminal is had is sent to each terminal by transmission network,
If the situation of many pictures, MCU carries out required transformation of scale after with the hierarchical coding code stream decoding of a plurality of terminals respectively to be handled, through splicing, to splice the back image and carry out hierarchical coding, the hierarchical coding code stream that will be complementary with the transmission network bandwidth number that each terminal is had sends to each terminal respectively again.
In general, above-mentionedly image is carried out hierarchical coding be meant and adopt a kind of in SNR hierarchical coding technology, Spatial (space) hierarchical coding technology or Temporal (time) the hierarchical coding technology that what just terminal obtained will be respectively: image, the image of different resolution or the image of different frame per second of the different SNR of identical frame per second.
Step a more specifically also comprises following steps:
A1, determine the number of plies of hierarchical coding according to the bandwidth species number of transmission network;
A2, the layering of carrying out basic layer and enhancement layer according to the described number of plies are handled;
A3, terminal image code stream is carried out hierarchical coding, and the hierarchical coding code stream that will be complementary with the transmission network bandwidth number that terminal is had by transmission network is sent to MCU.
Specifically described hierarchical coding also comprises following steps among the step b:
B1, determine the number of plies of hierarchical coding according to the bandwidth species number of transmission network;
B2, the layering of carrying out basic layer and enhancement layer according to the described number of plies are handled.
Among above-mentioned steps a, the b, when described transmission network bandwidth number of a great variety, generally be to have the how many kinds of bandwidth just to carry out the hierarchical coding of the corresponding number of plies.Encoding calculation amount will be increased,, the method for no more than 3 enhancement layers can be chosen for the more situation of bandwidth number owing to increase the coding number of plies.The hierarchical coding code stream is sent to relevant terminal or MCU, and wherein the bandwidth number of hierarchical coding code stream is no more than and approaches most the transmission network bandwidth number that terminal has.
Adopt technical solutions according to the invention, though increased the complexity that encoding and decoding are handled, but can be by using the layering encoding and decoding technique and adopting rate adapted strategy flexibly, make and to obtain when the different bandwidth terminal is had a meeting jointly and the corresponding picture quality of its bandwidth, in addition, can also improve anti-error code capacity, the assurance meeting can normally be carried out, thereby has improved the entire system performance.
Description of drawings
Fig. 1 is a method flow diagram of the present invention.
Fig. 2 has the schematic diagram that the terminal of different bandwidth links to each other with MCU in the embodiment of the invention.
Fig. 3 is the method schematic diagram that adopts SNR hierarchical coding technology in the embodiment of the invention 1.
Fig. 4 is the method schematic diagram that adopts Temporal hierarchical coding technology in the embodiment of the invention 2.
Fig. 5 is the method schematic diagram that adopts Spatial hierarchical coding technology in the embodiment of the invention 3.
The figure number explanation:
Frame in the frame of I, basic layer; The predictive frame of P, basic layer;
Frame in the frame of EI, enhancement layer; The predictive frame of EP, enhancement layer;
B, bi-directional predicted frames; CIF, CLV Common Intermediate Format;
QCIF, 1/4 CLV Common Intermediate Format.
Specific implementation
Describe the present invention in detail below in conjunction with the specific embodiment situation shown in Fig. 2,3,4,5.
As shown in Figure 2, wherein terminal 1, terminal 2 and bandwidth are that the transmission network of 768kbps links to each other, and terminal 3, terminal 4 and bandwidth are that the transmission network of 384kbps links to each other, and multipoint control unit MCU then links to each other with above-mentioned two kinds of transmission networks respectively.
Embodiment 1
Fig. 3 is for adopting the schematic diagram of SNR hierarchy encoding method, basic tomographic image coding is the same with the non-layered situation, and the error image of original image and decoded picture is encoded in enhancement layer, pass to decoding end, thereby obtain having the decoded picture of higher SNR value than non-layered situation, for example, basic tomographic image SNR is 40 decibels, enhancement layer image SNR is 45 decibels, like this, by adopting SNR layering encoding and decoding technique at MCU and terminal respectively, can satisfy different terminals and obtain identical frame per second, the requirement of the picture quality of different SNR, as shown in Figure 1, concrete steps are as follows:
One, the picture coding code stream with terminal 1 carries out hierarchical coding, and is sent to MCU by transmission network.
Specifically, at first determine 2 layers of the numbers of plies of hierarchical coding according to 2 kinds of bandwidth of transmission network.
Secondly, carry out the layering of basic layer and enhancement layer according to the described number of plies and handle, as shown in Figure 3, determine that the basic layer encoded bandwidth of terminal 1 is 384kbps, I and P represent interior frame of the frame of basic layer and predictive frame respectively; The enhancement layer coding bandwidth also is 384kbps, and EI and EP represent interior frame of the frame of enhancement layer and predictive frame respectively.
At last, terminal image code stream being carried out hierarchical coding, and by transmission network, will " basic layer+enhancement layer " total bandwidth of encoding be that the hierarchical coding code stream of 768kbps is sent to MCU.
Two, whether be that the situation of many pictures is judged to video-signal system,
For the situation that does not have many pictures, MCU only exchanges the hierarchical coding code stream, transfers, and sends each terminal respectively to.In Fig. 2, the bandwidth that MCU will transmit terminal 1 is that the hierarchical coding code stream of 768kbps is sent to terminal 2, terminal 3, terminal 4 respectively, then terminal 2 can obtain the picture quality that bandwidth is 768kbps " a basic layer+enhancement layer ", and terminal 3, terminal 4 then obtain the picture quality that its respective bandwidth is the basic layer of 384kbps.
For the situation that many pictures are arranged, MCU carries out required ratio respectively after with the hierarchical coding code stream decoding of a plurality of terminals and dwindles conversion process, through splicing, more spliced image is carried out the compression of SNR hierarchical coding then, respectively that each terminal is required at last corresponding code stream sends to each terminal.As shown in Figure 2, MCU will splice the SNR hierarchical coding that the back image carries out as shown in Figure 3 " the basic layer+384kbps enhancement layer of 384kbps ", then " basic layer bit stream+enhancement layer bitstream " sent to terminal 1 and terminal 2, and only " basic layer bit stream " sent to terminal 3 and terminal 4.
Three, each terminal is with the hierarchical coding code stream decoding.
Embodiment 2
Fig. 4 is for adopting the schematic diagram of Temporal (time) hierarchy encoding method, the Temporal hierarchical coding uses bi-directional predicted frames (B frame) image, this image is an independent entity in code stream, it is that (Frames Per Second: it is the image of 30fps that image frames per second), enhancement layer then can be selected frame per second to 15fps that basic layer can be selected frame per second.By adopting Temporal layering encoding and decoding technique in MCU and terminal respectively, can satisfy the image that different terminals obtains different frame per second, other concrete steps are with embodiment 1, the hierarchy encoding method difference that its difference is only being used.
Embodiment 3
Fig. 5 is for adopting the schematic diagram of Spatial (space) hierarchy encoding method, its coded system and SNR hierarchy encoding method are basic identical, unique different be that the image resolution ratio of its enhancement layer and basic layer is different, for example, what basic layer obtained is QCIF (Quarter Common IntermediateFormat:1/4 CLV Common Intermediate Format) image, is CIF (CommonIntermediate Format: image CLV Common Intermediate Format) and enhancement layer obtains.By adopting Spatial layering encoding and decoding technique in MCU and terminal respectively, can satisfy the image that different terminals obtains different resolution, other concrete steps are with embodiment 1, the hierarchy encoding method difference that its difference is only being used.
The foregoing description just is described at the situation of two kinds of bandwidth, and for other situation, processing method is similar, and generally being has the how many kinds of bandwidth just to carry out the hierarchical coding of the corresponding number of plies.Encoding calculation amount will be increased owing to increase the coding number of plies,, the method for no more than 3 enhancement layers can be chosen for the more situation of bandwidth number.
In addition, in order to improve computational efficiency, enhancement layer can directly utilize the motion estimation result in the basic layer and need not carry out estimation and calculate, even enhancement layer only considers wholely not consider the half-pix estimation as the number estimation, but these measures can be very not big for the influence of picture quality.
Claims (11)
1, image layered coding and the switching method in a kind of video-signal system is characterized in that, this method is made up of the following step:
A, terminal image encoding code stream is carried out hierarchical coding, and be sent to MCU by transmission network;
B, whether be that the situation of many pictures judges that MCU is sent to terminal with hierarchical coding stream then to video-signal system;
C, each terminal are with the hierarchical coding code stream decoding.
2, image layered coding and the switching method in a kind of video-signal system as claimed in claim 1 is characterized in that described step b comprises particularly:
If there is not the situation of many pictures, the hierarchical coding code stream that MCU directly will be complementary with the transmission network bandwidth number that each terminal is had is sent to each terminal by transmission network;
If the situation of many pictures is arranged, MCU carries out required transformation of scale after with the hierarchical coding code stream decoding of a plurality of terminals respectively to be handled, through splicing, to splice the back image and carry out hierarchical coding, the hierarchical coding code stream that will be complementary with the transmission network bandwidth number that each terminal is had is sent to each terminal respectively again.
3,, it is characterized in that described hierarchical coding is meant to adopt a kind of in signal to noise ratio hierarchical coding technology, space layered coding technology or the time hierarchical coding technology as image layered coding and switching method in claim 1, the 2 described a kind of video-signal systems.
4, image layered coding and the switching method in a kind of video-signal system as claimed in claim 1 is characterized in that described step a specifically comprises following steps:
A1, determine the number of plies of hierarchical coding according to the bandwidth species number of transmission network;
A2, the layering of carrying out basic layer and enhancement layer according to the described number of plies are handled;
A3, terminal image code stream is carried out hierarchical coding, and the hierarchical coding code stream that will be complementary with the transmission network bandwidth number that terminal is had by transmission network is sent to MCU.
5, image layered coding and the switching method in a kind of video-signal system as claimed in claim 4 is characterized in that the bandwidth species number among the described step a1 equals the number of plies of hierarchical coding.
6, image layered coding and the switching method in a kind of video-signal system as claimed in claim 4 is characterized in that no more than 3 layers of the number of plies of enhancement layer among the described step a1.
7, image layered coding and the switching method in a kind of video-signal system as claimed in claim 4, it is characterized in that being complementary described in the described step a3 is meant: the bandwidth number of hierarchical coding code stream is no more than and approaches most the transmission network bandwidth number that terminal has.
8, image layered coding and the switching method in a kind of video-signal system as claimed in claim 2 is characterized in that described hierarchical coding comprises following steps:
B1, determine the number of plies of hierarchical coding according to the bandwidth species number of transmission network;
B2, the layering of carrying out basic layer and enhancement layer according to the described number of plies are handled.
9, image layered coding and the switching method in a kind of video-signal system as claimed in claim 8 is characterized in that the bandwidth species number among the described step b1 equals the number of plies of hierarchical coding.
10, image layered coding and the switching method in a kind of video-signal system as claimed in claim 8 is characterized in that no more than 3 layers of the number of plies of enhancement layer among the described step b1.
11, image layered coding and the switching method in a kind of video-signal system as claimed in claim 2, it is characterized in that described be complementary be meant: the bandwidth number of hierarchical coding code stream is no more than and approaches most the transmission network bandwidth number that terminal has.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 02124640 CN1199460C (en) | 2002-06-19 | 2002-06-19 | Image layered coding and exchanging method in video signal system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 02124640 CN1199460C (en) | 2002-06-19 | 2002-06-19 | Image layered coding and exchanging method in video signal system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1466384A true CN1466384A (en) | 2004-01-07 |
| CN1199460C CN1199460C (en) | 2005-04-27 |
Family
ID=34142739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 02124640 Expired - Fee Related CN1199460C (en) | 2002-06-19 | 2002-06-19 | Image layered coding and exchanging method in video signal system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1199460C (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7634533B2 (en) | 2004-04-30 | 2009-12-15 | Microsoft Corporation | Systems and methods for real-time audio-visual communication and data collaboration in a network conference environment |
| CN101258754B (en) * | 2005-04-08 | 2010-08-11 | 新加坡科技研究局 | Method for encoding at least one digital picture and the encoder |
| CN101860714A (en) * | 2010-04-29 | 2010-10-13 | 中兴通讯股份有限公司 | Video processing method and system thereof and MCU video processing units |
| US7903886B2 (en) | 2005-09-08 | 2011-03-08 | Seiko Epson Corporation | Partial precision compression scheme for transmitting data to a display over a limited-bandwidth transmission path |
| CN102033729A (en) * | 2010-10-27 | 2011-04-27 | 广东威创视讯科技股份有限公司 | Method for mosaicing heterogeneous images and system thereof |
| CN101594512B (en) * | 2009-06-30 | 2012-01-18 | 中兴通讯股份有限公司 | Terminal, multi-point control unit, system and method for realizing high definition multiple images |
| CN101155309B (en) * | 2006-09-28 | 2012-12-26 | Lg电子株式会社 | Method for data transmission |
| US8477841B2 (en) | 2008-12-24 | 2013-07-02 | Acer Incorporated | Video processing method, encoding device, decoding device, and data structure for facilitating layout of a restored image frame |
| CN108093197A (en) * | 2016-11-21 | 2018-05-29 | 阿里巴巴集团控股有限公司 | For the method, system and machine readable media of Information Sharing |
| CN108134918A (en) * | 2018-01-30 | 2018-06-08 | 苏州科达科技股份有限公司 | Method for processing video frequency, device and multipoint video processing unit, conference facility |
| CN110139129A (en) * | 2019-03-27 | 2019-08-16 | 西安万像电子科技有限公司 | Image transfer method and device |
-
2002
- 2002-06-19 CN CN 02124640 patent/CN1199460C/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7634533B2 (en) | 2004-04-30 | 2009-12-15 | Microsoft Corporation | Systems and methods for real-time audio-visual communication and data collaboration in a network conference environment |
| CN1694528B (en) * | 2004-04-30 | 2013-01-02 | 微软公司 | Systems and methods for novel real-time audio-visual communication and data collaboration |
| CN101258754B (en) * | 2005-04-08 | 2010-08-11 | 新加坡科技研究局 | Method for encoding at least one digital picture and the encoder |
| US7903886B2 (en) | 2005-09-08 | 2011-03-08 | Seiko Epson Corporation | Partial precision compression scheme for transmitting data to a display over a limited-bandwidth transmission path |
| CN101155309B (en) * | 2006-09-28 | 2012-12-26 | Lg电子株式会社 | Method for data transmission |
| US8787446B2 (en) | 2006-09-28 | 2014-07-22 | Lg Electronics Inc. | Method of transmitting data |
| US8477841B2 (en) | 2008-12-24 | 2013-07-02 | Acer Incorporated | Video processing method, encoding device, decoding device, and data structure for facilitating layout of a restored image frame |
| CN101594512B (en) * | 2009-06-30 | 2012-01-18 | 中兴通讯股份有限公司 | Terminal, multi-point control unit, system and method for realizing high definition multiple images |
| WO2011134224A1 (en) * | 2010-04-29 | 2011-11-03 | 中兴通讯股份有限公司 | Video processing method and system thereof, multipoint control unit (mcu) video processing unit |
| CN101860714B (en) * | 2010-04-29 | 2013-07-03 | 中兴通讯股份有限公司 | Video processing method and system thereof and MCU video processing units |
| CN101860714A (en) * | 2010-04-29 | 2010-10-13 | 中兴通讯股份有限公司 | Video processing method and system thereof and MCU video processing units |
| CN102033729A (en) * | 2010-10-27 | 2011-04-27 | 广东威创视讯科技股份有限公司 | Method for mosaicing heterogeneous images and system thereof |
| CN108093197A (en) * | 2016-11-21 | 2018-05-29 | 阿里巴巴集团控股有限公司 | For the method, system and machine readable media of Information Sharing |
| CN108134918A (en) * | 2018-01-30 | 2018-06-08 | 苏州科达科技股份有限公司 | Method for processing video frequency, device and multipoint video processing unit, conference facility |
| CN110139129A (en) * | 2019-03-27 | 2019-08-16 | 西安万像电子科技有限公司 | Image transfer method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1199460C (en) | 2005-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2372743C2 (en) | Scalable video coding with two-level coding and one-level decoding | |
| CN101594512B (en) | Terminal, multi-point control unit, system and method for realizing high definition multiple images | |
| CN101427573B (en) | System and method for thinning of scalable video coding bit-streams | |
| EP1683356B1 (en) | Distributed real-time media composer | |
| RU2475998C2 (en) | Multi-level structure of coded bitstream | |
| US20090315975A1 (en) | Systems, methods, and media for providing cascaded multi-point video conferencing units | |
| CN100420299C (en) | A screen broadcasting method | |
| CN1885785A (en) | MCU cascade system and establishing and communication method for the same | |
| AU2007223300A1 (en) | System and method for providing error resilience, random access and rate control in scalable video communications | |
| CN1199460C (en) | Image layered coding and exchanging method in video signal system | |
| CN1578456A (en) | Digital video signal processing apparatus of mobile communication system and method thereof | |
| EP1695558A2 (en) | Spatial and snr scalable video coding | |
| CA2644753A1 (en) | System and method for providing error resilience, random access and rate control in scalable video communications | |
| US20030118097A1 (en) | System for realization of complexity scalability in a layered video coding framework | |
| CN1859573A (en) | Predicting coding method and its system in frame | |
| CN103546754B (en) | From H.264/AVC to code-transferring method and the system of SVC gradable spatial | |
| CN1668110A (en) | Method and apparatus for improving the average image refresh rate in a compressed video bitstream | |
| WO2001062001A1 (en) | A method and an apparatus for video mixing of bit streams | |
| CN100454821C (en) | Method for resource sharing among MCUs in videoconference system | |
| CN1832569A (en) | Conference television system and conference television implementing method | |
| CN1605200A (en) | Terminal used in video transmission system | |
| JP2005535219A (en) | Method and apparatus for performing multiple description motion compensation using hybrid prediction code | |
| CN1941903A (en) | Code-transferring system and method for realizing multiple code flow output simultaneouslly | |
| CN101056405A (en) | A fast switching method for telescopic video stream | |
| CN1244234C (en) | Multi-path picture mixing method based on DTC space |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20050427 Termination date: 20170619 |