CN101489090B - Method, apparatus and system for multipath media stream transmission and reception - Google Patents
Method, apparatus and system for multipath media stream transmission and reception Download PDFInfo
- Publication number
- CN101489090B CN101489090B CN200910008299.4A CN200910008299A CN101489090B CN 101489090 B CN101489090 B CN 101489090B CN 200910008299 A CN200910008299 A CN 200910008299A CN 101489090 B CN101489090 B CN 101489090B
- Authority
- CN
- China
- Prior art keywords
- media data
- data flow
- grouping
- path
- groups
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000005540 biological transmission Effects 0.000 title claims abstract description 43
- 238000004891 communication Methods 0.000 claims abstract description 46
- 238000003384 imaging method Methods 0.000 claims description 9
- 238000000926 separation method Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 13
- 241001269238 Data Species 0.000 description 3
- 239000002131 composite material Substances 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method for transmitting and receiving a multiplex media data stream, a device and a system, and relates to a network technique capable of solving the problem of unable freely combination and output of the multiplex media stream. The transmission method of the multiplex media data stream in a multimedia communication comprises: grouping the untransmitted multiplex media data stream; performing a grouping description to the grouped multiplex media data stream; transmitting the grouped multiplex media data stream and the corresponding grouping description. A receiving treatment method of the multiplex media data stream in the multimedia communication comprises: receiving the multiplex media data stream with the grouping description and the grouping description corresponding to the media data stream; and grouping and outputting the media data stream according to the received multiplex media data stream. The examples of the invention can suit for the multiplex media stream transmission and output in the multimedia communication.
Description
Technical field
The present invention relates to network technology, relate in particular to method, the Apparatus and system of multipath media stream transmission and reception in a kind of multimedia communication.
Background technology
In order further to strengthen the clinical sense of meeting, in video conferencing, usually need to transmit a plurality of (or the many groups) participant's in a meeting-place video, audio frequency and data simultaneously.Based on ITU-T standard definition H.239 the transmission of multipath media stream in the video conferencing, terminal and terminal and terminal and MCU (MultipointControl Unit, multipoint control unit) between, can transmit multipath media stream, this standard has only defined how to transmit a road auxiliary video stream at present, H.239 only define the role of Liao Mei road Media Stream simultaneously, this role can be live image or lantern slide content, but can not show the relation between multipath media stream, therefore after receiving terminal gets the multi-path media data, need to be undertaken being exported again after operational processes by receiving terminal.
Be illustrated in figure 1 the method schematic diagram of many a kind of roads media flow transmission in the video conferencing of prior art.Meeting-place A and meeting-place B place respectively two cover video conference terminals, and every locking terminal is for 1 (or 1 group) participant.Wherein, each locking terminal comprises respectively the equipment such as camera, microphone, display device and loud speaker.In addition, pass through the switch interconnection network between two meeting-place A, B.The terminal 1 of meeting-place A connects with the terminal 3 of meeting-place B, the terminal 2 of meeting-place A connects with the terminal 4 of meeting-place B, the terminal 1 of meeting-place A will present acoustic image and the data of terminal 3 collections of meeting-place B like this, and the terminal 2 of meeting-place A will present acoustic image and the data of terminal 4 collections of meeting-place B.Conversely, the terminal 3 of meeting-place B will present acoustic image and the data of terminal 1 collection of meeting-place A, and the terminal 4 of meeting-place B will present acoustic image and the data of terminal 2 collections of meeting-place A.By such technical scheme, realized the transmission of two meeting-place two-way video-voice frequency flows.
Also have in prior art and another kind ofly produce the method for corresponding audio position for the video layout, comprise: by MCU produce synthetic a plurality of end points images many picture videos and with the corresponding sound position information of many picture layout, and according to the loud speaker situation of receiving terminal, a plurality of audio streams, many picture videos and sound position information are sent to receiving terminal, receiving terminal is used a plurality of audio streams to be reappeared according to positional information, and in the position of the end points sound that makes the participant hear and many pictures, the position (layout) of end points approaches.For the participant, with the audio broadcasting of speaker in the display screen proximal end, compare, in the audio broadcasting of the speaker of screen far-end, may be attenuated, or by time delay.This scheme can strengthen the clinical sense of meeting.But in this scheme, sound position is determined by MCU, by terminal, carried out, lack flexibility, terminal can not be done autonomous the adjustment to the position of sound.Prior art can't realize multipath media stream independent assortment output in multimedia communication, and does not consider transmission and the processing of data service.
Summary of the invention
Embodiments of the invention provide the methods, devices and systems of multipath media stream transmission and output in a kind of multimedia communication, can solve the problem that multipath media stream in multimedia communication can not independent assortment output.
Embodiments of the invention adopt following technical scheme:
The transmission method of multi-path media data flow in a kind of multimedia communication comprises:
The multi-path media data flow that will transmit is divided into groups; Multi-path media data flow after described grouping is divided into groups to describe; Transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
Embodiments of the invention also provide the receiving handling method of multi-path media data flow in a kind of multimedia communication, comprising: receive the multi-path media data flow of describing with grouping; The described media data flow of grouping output is described according to the grouping of the multi-path media data flow of described reception.
Embodiments of the invention also provide the transmitting device of multi-path media data flow in a kind of multimedia communication, comprising: grouped element, divided into groups for the multi-path media data flow to transmitting; The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping; Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
Embodiments of the invention also provide the receiving and processing device of multi-path media data flow in a kind of multimedia communication, comprising: receiving element reaches the grouping description corresponding with described media data flow for receiving the multi-path media data flow of describing with grouping; Output unit, describe for the grouping of the multi-path media data flow according to described reception, the described media data flow of grouping output.
Embodiments of the invention also provide a kind of conference terminal, comprising:
Dispensing device, for obtaining the multi-path media data flow that will transmit and being divided into groups, divide into groups to describe to the multi-path media data flow after described grouping, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow; And/or
Receiving and processing device, describe for receiving the multi-path media data flow described with grouping and the grouping corresponding with described media data flow, and describe according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
Embodiments of the invention also provide the system of multi-path media data stream transmitting in a kind of multimedia communication, comprising:
Data acquisition facility, comprise that video capture device, audio frequency obtain equipment or data acquisition facility, for obtaining the multi-path media data flow;
Transmitting device, for the multi-path media data flow that described data acquisition facility is obtained, divided into groups, multi-path media data flow after described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow;
Receiving and processing device, describe for receiving the multi-path media data flow described with grouping and the grouping corresponding with described media data flow, and describe according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping;
Data output device, exported by picture output device, audio output apparatus or data output apparatus for the media data flow by after described grouping.
The method of multipath media stream transmission and reception, Apparatus and system in the multimedia communication that the embodiment of the present invention provides, the multi-path media data can be divided into groups, and each grouping is divided into groups to describe, and after dividing into groups, multimedia data stream and grouping are described and are sent; And carry after multimedia data stream that grouping describes and the grouping corresponding with described multimedia data stream describe receiving, according to these groupings, describe, the described media data flow of grouping output, thereby realized the independent assortment output of multipath media stream.
The accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, below will the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
The method schematic diagram that Fig. 1 is multipath media stream transmission in the prior art video conferencing;
The method flow diagram that Fig. 2 is multi-path media data stream transmitting in embodiment of the present invention multimedia communication;
The method flow diagram that Fig. 3 is multi-path media data flow output in embodiment of the present invention multimedia communication;
The method schematic diagram that Fig. 4 is multi-path media data stream transmitting and output in the embodiment of the present invention one multimedia communication;
The method flow diagram that Fig. 5 is the embodiment of the present invention one;
Fig. 6 is the schematic diagram that the embodiment of the present invention one multipath media stream is divided into groups at input;
Fig. 7 is the schematic diagram that the embodiment of the present invention one multipath media stream is divided into groups at output;
The method schematic diagram that Fig. 8 is multi-path media data stream transmitting and output in the embodiment of the present invention two multimedia communications;
The method flow diagram that Fig. 9 is multi-path media data stream transmitting and output in the embodiment of the present invention three multimedia communications;
The device schematic diagram that Figure 10 is multi-path media data stream transmitting in embodiment of the present invention multimedia communication;
The device schematic diagram that Figure 11 is multi-path media data flow reception & disposal in embodiment of the present invention multimedia communication;
The system schematic that Figure 12 is multi-path media data stream transmitting in embodiment of the present invention multimedia communication.
Embodiment
Methods, devices and systems below in conjunction with accompanying drawing to multipath media stream transmission and reception in embodiment of the present invention multimedia communication are described in detail.
Should be clear and definite, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making under the creative work prerequisite the every other embodiment obtained, belong to the scope of protection of the invention.
As shown in Figure 2, the method for multipath media stream transmission in the embodiments of the invention multimedia communication comprises:
S201, the multi-path media data flow that will transmit is divided into groups.
Wherein, divide into groups to adopt following any mode to the multi-path media data flow:
According to the position relationship between the interface of media data flow, divided into groups, the media data flow that is about to the close physical interface in Same Physical interface or position is divided into one group; Or divided into groups by the locus of audio frequency and/or video, obtain the locus of image by video camera, microphone obtains the locus of sound, using the locus of image and/or the consistent or close video of sound position and/or audio frequency as one group; Or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, described multi-path video stream is divided into groups.
S202, the multi-path media data flow after described grouping is divided into groups to describe.
Particularly, can by media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly, thereby realize the description of divide into groups of the multi-path media data flow after grouping.
S203, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
The method of the multipath media stream transmission that the embodiment of the present invention provides is by being divided into groups the multi-path media data flow, and add the grouping description to the media data flow after grouping, can specify the group feature for the media data flow of transmission, receiving terminal can be described and carry out corresponding output processing according to this grouping, thereby has realized the independent assortment transmission of multipath media stream at different terminals.
As shown in Figure 3, the method for multipath media stream reception & disposal in the embodiments of the invention multimedia communication comprises:
S301, reception are described with the multi-path media data flow of grouping description and the grouping corresponding with described media data flow.
Particularly, grouping describe can be carried at media data flow or with the corresponding bearer path of media data flow in; Or be carried in the control protocol relevant to media data flow; Or be carried in the control message increased in media data flow.
S302, the grouping described media data flow of output and the grouping description corresponding with described media data flow are described according to the grouping of the multi-path media data flow of described reception.
In the embodiments of the invention multimedia communication, the method for multipath media stream reception & disposal is described by receiving with the multi-path media data flow of grouping description and the grouping corresponding with described media data flow, describe the described media data of grouping output according to described grouping again, thereby realized that multipath media stream can be in the independent assortment output of different terminals.
Below by the transmission of multipath media stream in multimedia communication under different scenes and the practical application of output, the specific embodiment of the present invention is described.
Embodiment mono-
As shown in Figure 4, be the schematic diagram of the present embodiment multipath media stream transmission with the output scene.The present embodiment be take meeting-place A and is sent multipath media stream, meeting-place B to receive multipath media stream be example.Should be noted that, in actual applications, meeting-place A and meeting-place B generally comprise transmitting and receiving device simultaneously, also comprise transmitting and receiving device on terminal simultaneously.The present invention for convenience of description, embodiments of the invention are simplified.
In the present embodiment, meeting-place A comprises participant P1 and P2, terminal 1, P1 and P2 have respectively with it corresponding microphone 1, make a video recording 1 and data processing equipment 1 (such as a computer), meeting-place B comprises terminal 2, and a plurality of participant P3 lay respectively at display 1 and the loud speaker 1 of position 1, with display 3 and the loud speaker 3 of position 3, be positioned at the display 2 of position 2.Terminal 1 is connected by network with terminal 2.As shown in Figure 5, basic processing procedure is as follows:
S501, terminal 1 collect 6 road media datas and are divided into groups.These 6 groups of media datas comprise: data service media 1, data service media 2, video media 1, video media 2, audio frequency media 1, audio frequency media 2.
Can be divided into groups according to the position relationship between the interface of media data flow, the media data flow that is about to the close physical interface in Same Physical interface or position is divided into one group.As shown in Figure 6, this 6 road Media Stream is divided into to two groups of L1 and L2, wherein the media data of L1 group is corresponding with participant P1, comprising: data service media 1, video media 1, audio frequency media 1; The Media Stream of L2 group is corresponding with participant P2, comprising: data service media 2, video media 2, audio frequency media 2.
Above-mentioned is that terminal 1 is determined the method for grouping according to interface relationship, the data that the video input of corresponding participant P1, audio frequency input, data service input interface are received are as the L1 group, and the data that the video input of corresponding participant P2, audio frequency input, data service input interface are received are as the L2 group.Video interface can be CVBS (Composite Video Broadcast Signal or Composite Video Blanking and Sync, the composite video broadcast singal) interface, S-Video (Separate Video, separating video) interface, VGA (VideoGraphics Array, video graphics array) interface, DVI (Digital Visual Interface, digital video) interface etc.Audio interface can be various forms MIC (Medium Interface Connector, media interface connector), Line IN (input signal) analog or digital interface.The data service interface can be network interface, USB, can be also VGA interface (data content has been converted to video output on PC), and data business content comprises file or lantern slide broadcasting.These interfaces physically also may merge, for example video interface and audio interface can be merged into HDMI (High Definition Multimedia Interface, high-resolution multimedia) interface or IEEE1394 interface, even video, audio frequency, data service can all connect by USB interface, and video, audio frequency, data service can also be transmitted by logical channel in this case.
The present invention is not limited thereto, and each grouping also may exist many group videos, audio frequency, data traffic flow, and the L1 that for example divides into groups also can have the two-way audio input, the two-path video input.
The method of determining the grouping relation can also be, divided into groups in locus by audio frequency and/or video, obtain the locus of image by video camera, microphone obtains the locus of sound, using the locus of image and/or the consistent or close video of sound position and/or audio frequency as one group.
The method of determining the grouping relation can also be, utilizes array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, described multi-path video stream is divided into groups.Again corresponding video media and audio frequency media are categorized into to one group afterwards, for example video media and audio frequency media can be divided into groups according to position relationship.The Media Stream divided into groups can form by other means, and not necessarily directly from interface, obtain.
S502, terminal 1 are carried out compressed encoding by the media data flow after grouping.
S503, the multi-path media data flow after described grouping is divided into groups to describe.
The multi-path media data flow is divided into groups to describe following three kinds of modes is arranged:
Mode one media data flow or with the corresponding bearer path of media data flow in carry grouping and describe.
For example, can carry grouping in the extended head of RTP or media data flow describes.Particularly, can in the extended head of RTP or the extended field in media data flow or specific fields, fill the group feature.
For example, at the extended head (RTP Header Extension) of RTP, fill the grouping description field, there is the rtp streaming that same packets is described, be same group.Perhaps, can also in corresponding bearer path, identification packet describe, for example, in the data (payload) of RTP, carry out field extension, increase grouping and describe.
Extended head that in addition can also self-defined RTP, and carry grouping and describe in self-defining extended head.
Also can, by being identified, realize carrying of grouping description in RTP in SIP/SDP communication.
Mode two is carried the grouping descriptor in the control protocol relevant to Media Stream.Particularly, can in the extended field in control protocol, fill the group feature.
The H.323 standard of take is example, each Media Stream can distribute corresponding session id (sessionID), so just can be by being the next associated relevant session of each session id designated packet description, such as in opening logical channel (OpenLogicalChannel) message, expand a grouping description field, for filling grouping, describe, as following definition:
OpenLogicalChannel ::＝SEQUENCE
{
forwardLogicalChannelNumber LogicalChannelNumber，
forwardLogicalChannelParametersSEQUENCE
{
portNumber INTEGER(0..65535)OPTIONAL，
dataType DataType，
multiplexParameters CHOICE
{
h222LogicalChannelParameters H222LogicalChannelParameters，
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParameters H2250LogicalChannelParameters，
none NULL --for use with Separate Stack when
--multiplexParameters are not required
--or appropriate
}，
...，
forwardLogicalChannelDependency LogicalChannelNumber OPTIONAL，
--also used to refer to the primary logical channel when using video redundancy
coding
replacementFor LogicalChannelNumber OPTIONAL，
groupID INTEGER(0..65535)OPTIONAL
}，
--Used to specify the reverse channel for bi-directional open request
reverseLogicalChannelParameters SEQUENCE
{
dataType DataType，
multiplex Parameters CHOICE
{
--H.222parameters are never present in reverse direction
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParameters H2250LogicalChannelParameters
}OPTIONAL，--Not present for H.222
...，
reverseLogicalChannelDependency LogicalChannelNumber OPTIONAL，
--also used to refer to the primary logical channel when using video redundancy
coding
replacementFor LogicalChannelNumber OPTIONAL
}OPTIONAL，--Not present for uni-directional channel request
...，
separateStack NetworkAccessParameters OPTIONAL，
--for Open responder to establish the stack
encryptionSync EncryptionSync OPTIONAL --used only by Master
}
Wherein groupID is the grouping description field of expansion, for filling grouping, describes.
Mode three increases the control message of the grouping description of carrying corresponding media data in media data flow.Particularly, in each described control message, define the group feature, the message body of described control message, comprised at least one Media Stream that belongs to same grouping.
For example, increase a control message, this message is same grouping for notifying which media data of opposite end.Suppose grouping L1 video, audio frequency, the session logical channel number (LCN) of data service data be respectively 1,2,3, transmit a message GroupIndication, comprise logical channel number (LCN) 1,2 in this message, 3, receiving terminal is same group according to the media data of this message decision logic channel number 1,2,3 like this.
While adopting the SIP/SDP agreement to carry out multimedia communication, also can realize by the mode that adopts a plurality of sessions (session) carrying of grouping description.For example:
v＝0
o＝mhandley 28908445262890842807IN IP4126.16.64.4
s＝P1
m＝audio 49170RTP/AVP 0
m＝video 51372RTP/AVP 31
m＝application 32416udp wb
v＝0
o＝mhandley 28908445262890842807IN IP4126.16.64.4
s＝P2
m＝audio 49171RTP/AVP 0
m＝video 51373RTP/AVP 31
m＝application 32417udp wb
Wherein, session P1 (S=P1) is corresponding to grouping L1, and session P2 (S=P1), corresponding to grouping L2, comprises respectively audio frequency, video and application data stream.
Can certainly grouping be described by increasing an attribute, for example:
v＝0
m＝audio 49170RTP/AVP 0
m＝video 51372RTP/AVP 31
m＝application 32416udp wb
m＝audio 49171RTP/AVP 0
m＝video 51373RTP/AVP 31
m＝application 32417udp wb
g＝491705137232416
g＝491715137332417
By this explanation of g=491705137232416, by port 49170,51372,32416 corresponding media datas are divided into one group, and by g=491715137332417, by 49171,51373, the corresponding media data of 32417 port is divided into other one group.
In addition, also can describe by direct extended medium, increase a minute group profile and realize grouping, for example:
v＝0
m＝audio 49170RTP/AVP 0group1
m＝video 51372RTP/AVP 31group1
m＝application 32416udp wb group1
m＝audio 49171RTP/AVP 0group2
m＝video 51373RTP/AVP 31group2
m＝application 32417udpwb group2
Like this, the group1 in media description, group2 is for illustrating that the group number that this Media Stream is corresponding, the Media Stream of identical group number are same group.Group1 and group2 can be numeral or character mark.
S504, terminal 1 send to terminal 2 by the multi-path media data.
S505, terminal 2 receive the media data of describing with grouping, the decompression of being decoded.
S506, according to grouping, the output medium data are described.
As shown in Fig. 4, Fig. 7, be specially: according to the grouping relation, determine that will divide into groups video data 1 corresponding to L1 and voice data 1 output to display 1 and the loud speaker 1 of position 1, by the video data 2 of grouping L2 and display 3 and the loud speaker 3 that voice data 2 outputs to position 3, by grouping L1 and the data service media 1 of L2 and the display 2 that data service media 2 output to position 2 as required.
Embodiments of the invention can also realize that the data service data output interface switches output to the data service of a plurality of transmitting terminals of getting, can switch as required.For example, the data service output interface is switched to the data service output of L1 when the participant P1 of transmitting terminal explanation lantern slide, is switched to the data service output of L2 when P2 explanation lantern slide.The video here, audio frequency, data service output interface can be also various forms and the combinations the same with above-mentioned input interface.
Embodiments of the invention can also be realized describing video data, voice data or the data service data of output interface output being switched according to the grouping of the media data flow of described reception.For example, terminal 2 can also further be described according to grouping, automatically control when participant P1 explanation lantern slide, the output content that video output 1 and video are exported to 2 interfaces all switches to the video of grouping L1, audio frequency output 1 and audio frequency output 2 are all switched to the audio frequency of output grouping L1, can, so that the participant of meeting-place B can see the image of P1 on display separately simultaneously, hear the sound of P1 on loud speaker separately like this.Further, the transmission of the video and audio collection that receiving terminal can notify transmitting terminal to suspend generation L2 group simultaneously or the video and audio of time-out L2 group, to reduce taking bandwidth.
The network that connects terminal 1 and terminal 2 can be circuit-domain network (as E1/SDH/ISDN), can be also packet network (as IP network), and H.320/H.323/H.324/SIP communication protocol can adopt and wait.
In above-described embodiment, video media 1, audio frequency media 1 and data service media 1 are divided into to 1 group, and this is a kind of common applicable cases, but actual grouping can be very flexible, for example, using video media 2 as 1 group, using audio frequency media 2 with video media 1 as 1 group.
By above-mentioned steps, the embodiment of the present invention has realized by grouping, the multi-path media data being transmitted and being exported, thereby receiving terminal can carry out independent assortment output by multipath media stream, has also solved transmission and the control of the data service corresponding with video and audio.Therefore the embodiment of the present invention has also realized using single terminal in a meeting-place, has also solved the problem that prior art is used the high cost that a plurality of terminals bring.
Embodiment bis-
On the basis of embodiment mono-, the method for the present embodiment multi-path media data stream transmitting and output can also be passed through intermediate equipment (for example: conference control equipment is specifically as follows multipoint control unit MCU) and process.
MCU, after receiving the media data flow that carries the grouping description and grouping is described accordingly, obtains the grouping description of each road media data, and can need to redefine the grouping relation of each road media data flow according to output.In the present embodiment, thereby can change the grouping relation between media data flow by the grouping relation of multipoint control unit MCU forwarding media data flow, or regenerate the grouping relation of multi-path media data flow.
As shown in Figure 8, video media stream and audio medium stream that terminal 1 sends, and the data service Media Stream that terminal 3 sends sends to terminal 2 after the MCU place is combined as a new group L.Concrete compound mode is not limited to above-described embodiment.
Be understood that in video conference, conference control equipment mainly completes the main medium current control, therefore, adopt this mode can be comparatively neatly according to the request of some conference terminals, corresponding Media Stream (audio medium stream, video media stream and data medium stream) is combined, can diversifiedly meet user's demand.
The embodiment of the present invention has realized multipath media stream being transmitted and exporting by grouping, thereby receiving terminal can carry out independent assortment output by multipath media stream, has also solved transmission and the control of the data service Media Stream corresponding with video and audio.
Implement three
On the basis that the present embodiment is transmission multi-path media data flow in implementing, the method for terminal 2 output multi-channel Media Streams, specifically comprise the steps:
S901, arrange a plurality of loud speakers in the B of meeting-place;
S902, terminal 2 are obtained the spatial positional information of each display in the B of meeting-place;
S903, display 1 output by video data in the grouping L1 received 1 by position 1, the video data 2 in grouping L2 is by display 3 outputs of position 3.
S904, the voice data 1 of the grouping L1 that receives is exported by least one loud speaker in the B of meeting-place, made the display 1 of Gan Yu position, its locus 1 identical or close.
S905, the voice data 2 of the grouping L2 that receives is exported by least one loud speaker in the B of meeting-place, made the display 3 of Gan Yu position, its locus 3 identical or close.
Above-mentioned steps S904 and S905 are not limited to said sequence, and step S905 can be before step S904.
The present embodiment can realize in many meeting-place that the sound that the participant hears is identical or close with corresponding video location, thereby has realized better the sense of reality of video conferencing.
Embodiments of the invention also provide a kind of device of multipath media stream transmission, can solve the problem that multipath media stream can only transmit between specific terminal.
As shown in figure 10, the device of multi-path media data stream transmitting in the embodiments of the invention multimedia communication comprises:
Grouped element 101, divided into groups for the multi-path media data flow to transmitting;
Further, at grouped element described in a preferred embodiment of the present invention 101, can to media data flow, be divided into groups by following any mode: according to the position relationship between the interface of media data flow, divided into groups, the media data flow that is about to the close physical interface in Same Physical interface or position is divided into one group; Or divided into groups by the locus of audio frequency and/or video, obtain the locus of image by video camera, microphone obtains the locus of sound, using the locus of image and/or the consistent or close video of sound position and/or audio frequency as one group; Or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, described multi-path video stream is divided into groups.
Media data flow after described grouping description unit 102 can adopt following any mode to grouping divide into groups to describe: media data flow or with the corresponding bearer path of media data flow in carry the grouping description; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly.
Described in the present embodiment, media data flow is specifically as follows following one or more: audio stream, video flowing, data flow.
The device of multi-path media data stream transmitting in the embodiments of the invention multimedia communication, by grouped element, the multi-path media data are divided into groups, the grouping description unit divides into groups to describe to multimedia data stream, thereby realized that multipath media stream is transmitted by a terminal, and make receiving terminal to export each media data according to grouping description respective packets, realized the independent assortment transmission of multi-path media data at different terminals.
The present invention also provides the device of multi-path media data flow reception & disposal in a kind of multimedia communication, can solve multipath media stream can not independent assortment the problem of output.
As shown in figure 11, the device of multi-path media data flow reception & disposal in the embodiments of the invention multimedia communication, comprise receiving element 111 and output unit 112.
Receiving element 111, reach the grouping description corresponding with described media data flow for receiving the multi-path media data flow of describing with grouping.Wherein, grouping describe can be carried at media data flow or with the corresponding bearer path of media data flow in; Or be carried in the control protocol relevant to media data flow; Or be carried in the control message increased in media data flow.
Further, described device can also comprise: switch unit, the media data flow of describing described output unit output for the grouping of the media data flow according to described receiving element reception is switched.Described device can also comprise the time-out unit, for when all output ports all are switched to the media data flow of designated groups, suspends collection or the transmission of the media data flow of other group except designated groups.
In the embodiments of the invention multimedia communication, the device of multi-path media data flow reception & disposal is when receiving the multi-path media data flow described with grouping and the grouping corresponding with described media data flow and describe, can describe according to grouping, the described media data flow of grouping output, thus realized that multipath media stream can freely export at different terminals.In addition, switch unit can also be switched the transmission of the media data of specific cluster, suspends collection or transmission that unit can suspend the media data of some group, has slowed down network pressure.
The device of multipath media stream transmission in the multimedia communication that embodiments of the invention provide, and the device of reception & disposal, can, with reference to said method embodiment mono-, two, three, realize the independent assortment output of multipath media stream in multimedia communication.
Embodiments of the invention also provide a kind of conference terminal, comprise dispensing device and receiving and processing device.
Described dispensing device, for obtaining the multi-path media data flow that will transmit and being divided into groups, multi-path media data flow after described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow; And/or
Described receiving and processing device, describe for receiving the multi-path media data flow described with grouping and the grouping corresponding with described media data flow, and describe according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
For a conference terminal, preferably there is dispensing device and receiving and processing device simultaneously.
On the basis of such scheme, described dispensing device further comprises:
Grouped element, for the multi-path media data flow that will transmit is divided into groups, comprise according to the position relationship between the interface of media data flow and being divided into groups, or divided into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, described multi-path video stream is divided into groups;
The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly;
Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
The embodiments of the invention conference terminal, can realize the grouping of the multimedia data stream to sending and carrying of grouping description, thereby the multi-path media data flow can be divided into groups to send, and after the grouping of the multimedia data stream that receives the grouping transmission and correspondence is described, can describe each media data flow is exported according to this grouping, thereby realize multi-path media data independent assortment is exported.
Embodiments of the invention also provide the system of multipath media stream transmission in a kind of multimedia communication, can solve multipath media stream can not independent assortment the problem of output.
The present embodiment can be combined and describe with the embodiment of Fig. 4.As shown in figure 12, the system of multipath media stream transmission in the embodiments of the invention multimedia communication comprises: data acquisition facility 121, transmitting device 122, receiving and processing device 123 and data output device 124.Wherein,
Described data acquisition facility 121, comprise that video capture device, audio frequency obtain equipment or data acquisition facility, for obtaining the multi-path media data flow.
Described transmitting device 122, for the multi-path media data flow that described data acquisition facility is obtained, divided into groups, multi-path media data flow after described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow.
Described receiving and processing device 123, describe for receiving the multi-path media data flow described with grouping and the grouping corresponding with described media data flow, and describe according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
Described data output device 124, exported by picture output device, audio output apparatus or data output apparatus for the media data flow by after described grouping.
On the basis of such scheme, described transmitting device further can comprise:
Grouped element, for the multi-path media data flow that will transmit is divided into groups, comprise according to the position relationship between the interface of media data flow and being divided into groups, or divided into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, described multi-path video stream is divided into groups;
The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly;
Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
In a preferred embodiment of the present invention, described system can also comprise:
Conference control equipment, for by forwarding media data stream packet relation, changing the grouping relation, or divided into groups to the multi-path media data flow in different meeting-place.Described conference control equipment can be MCU.
The system of multipath media stream transmission in the multimedia communication that the embodiment of the present invention provides, by transmitting device, the multi-path media data are divided into groups, multi-path media data flow after described grouping is divided into groups to describe, and the grouping that sends the described media data of describing with grouping and correspondence is described, and after output device receives multi-path media data and grouping and describe, describe the described media data of grouping output according to described grouping, thereby can realize the independent assortment output of multipath media stream; In described system, preferred MCU can also be changed or be forwarded by forwarding media data stream packet relation and then change grouping relation the grouping relation of media data, thereby can realize the independent assortment output of multipath media stream.
The system of multipath media stream transmission in the multimedia communication that embodiments of the invention provide, can, with reference to said method embodiment mono-, two, three, realize multipath media stream transmission in multimedia communication, reception and output processing.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, to come the hardware that instruction is relevant to complete by computer program, described program can be stored in a computer read/write memory medium, this program, when carrying out, can comprise the flow process as the embodiment of above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory, ROM) or random store-memory body (Random Access Memory, RAM) etc.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily or replacement, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by the described protection range with claim.
Claims (19)
1. the method for multi-path media data stream transmitting in a multimedia communication, is characterized in that, comprising:
The multi-path media data flow that will transmit is divided into groups;
Multi-path media data flow after described grouping is divided into groups to describe, and described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature; Wherein, the multi-path media data flow after described grouping is divided into groups to describe, comprising: carry grouping and describe in the control protocol relevant to media data flow;
Transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
2. the method for claim 1, is characterized in that, described the multi-path media data flow that will transmit divided into groups to be specially:
According to the position relationship between the interface of media data flow, divided into groups, the media data flow that is about to the close physical interface in Same Physical interface or position is divided into one group; Or
Divided into groups in locus by audio frequency and/or video, obtain the locus of image by video camera, microphone obtains the locus of sound, using the locus of image and/or the consistent or close video of sound position and/or audio frequency as one group; Or
Utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or
After getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, multi-path video stream is divided into groups.
3. method as claimed in claim 1 or 2, is characterized in that, described the multi-path media data flow that will transmit divided into groups, and comprising:
Change the grouping relation by conference control equipment by the grouping relation that forwards the multi-path media data flow; Or
By conference control equipment, the multi-path media data flow in different meeting-place is divided into groups.
4. method as claimed in claim 1 or 2, is characterized in that, described media data flow is specially following one or more: audio stream, video flowing, data flow.
5. the method for multi-path media data flow reception & disposal in a multimedia communication, is characterized in that, comprising:
The multi-path media data flow that reception is described with grouping and the grouping corresponding with described media data flow are described, described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature, wherein, described grouping is described and is carried in the control protocol relevant to media data flow;
According to the grouping of the multi-path media data flow of described reception, describe, the described media data flow of grouping output, output on the output interface or output equipment corresponding with its grouping described multi-path media data flow Zhong Mei road media data flow.
6. method as claimed in claim 5, is characterized in that, according to the grouping of the multi-path media data flow of described reception, describes, and the described media data flow of grouping output comprises:
Describe the video data of described reception is outputed to corresponding video output interface according to the grouping of the media data flow of described reception; And/or
The voice data of described reception is outputed to corresponding audio frequency data interface; And/or
The data service data of described reception are outputed to corresponding data service data output interface.
7. method as claimed in claim 6, is characterized in that, the data service data of described reception outputed to corresponding data service data output interface and comprise:
Described data service data output interface switches output to the data service data of a plurality of transmitting terminals of receiving.
8. method as claimed in claim 5, is characterized in that, according to the grouping of the multi-path media data flow of described reception, describes, and the described media data flow of grouping output comprises:
According to the grouping of the multi-path media data flow of described reception, describe, video data is outputed on corresponding display device, obtain the spatial positional information of described display device, at least one the equipment output of raising one's voice for voice data that will be relevant to described video data, make the audio space position of output identical with the locus of described display device or close.
9. method as claimed in claim 5, is characterized in that, also comprises:
Describe video data, voice data or the data service data of output interface output are switched according to the grouping of the media data flow of described reception.
10. the device of multi-path media data stream transmitting in a multimedia communication, is characterized in that, comprising:
Grouped element, divided into groups for the multi-path media data flow to transmitting;
The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping, and described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature; Wherein, the multi-path media data flow of described grouping description unit after to described grouping divides into groups to describe, and comprising: carry grouping and describe in the control protocol relevant to media data flow;
Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
11. device according to claim 10, is characterized in that, described grouped element is divided into groups to the multi-path media data flow that will transmit by following any one:
According to the position relationship between the interface of media data flow, divided into groups, the media data flow that is about to the close physical interface in Same Physical interface or position is divided into one group; Or
Divided into groups in locus by audio frequency and/or video, obtain the locus of image by video camera, microphone obtains the locus of sound, using the locus of image and/or the consistent or close video of sound position and/or audio frequency as one group; Or
Utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or
After getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, multi-path video stream is divided into groups.
12. according to claim 10 to the described device of any one in 11, it is characterized in that,
Described media data flow is specially following one or more: audio stream, video flowing, data flow.
13. in a multimedia communication, the device of multi-path media data flow reception & disposal, is characterized in that, comprising:
Receiving element, for receiving with the multi-path media data flow of grouping description and the grouping corresponding with described media data flow, describe, described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature, and described grouping is described and is carried in the control protocol relevant to media data flow;
Output unit, describe for the grouping of the multi-path media data flow according to described reception, and the described media data flow of grouping output, output on the output interface or output equipment corresponding with its grouping described multi-path media data flow Zhong Mei road media data flow.
14. device according to claim 13, is characterized in that, also comprises:
Switch unit, the media data flow of describing described output unit output for the grouping of the media data flow according to described receiving element reception is switched.
15. a conference terminal, is characterized in that, comprising:
Dispensing device, for obtaining the multi-path media data flow that will transmit and being divided into groups, divide into groups to describe to the multi-path media data flow after described grouping, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow; Wherein, the multi-path media data flow after described grouping is divided into groups to describe, comprising: carry grouping and describe in the control protocol relevant to media data flow;
And/or
Receiving and processing device, for receiving with the multi-path media data flow of grouping description and the grouping corresponding with described media data flow, describe, described grouping is described and is carried in the control protocol relevant to media data flow, and describe according to the grouping of the multi-path media data flow of described reception, the described media data flow of grouping output, output on the output interface or output equipment corresponding with its grouping described multi-path media data flow Zhong Mei road media data flow;
Wherein, described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature.
16. conference terminal according to claim 15, is characterized in that, described dispensing device comprises:
Grouped element, for the multi-path media data flow that will transmit is divided into groups, comprise according to the position relationship between the interface of media data flow and being divided into groups, or divided into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, multi-path video stream is divided into groups;
The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly;
Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
17. in a multimedia communication, the system of multi-path media data stream transmitting, is characterized in that, comprising:
Data acquisition facility, comprise that video capture device, audio frequency obtain equipment or data acquisition facility, for obtaining the multi-path media data flow;
Transmitting device, for the multi-path media data flow that described data acquisition facility is obtained, divided into groups, multi-path media data flow after described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after described grouping reaches the grouping description corresponding with described media data flow; Wherein, the multi-path media data flow after described grouping is divided into groups to describe, comprising: carry grouping and describe in the control protocol relevant to media data flow;
Receiving and processing device, for receiving with the multi-path media data flow of grouping description and the grouping corresponding with described media data flow, describe, and describe according to the grouping of the multi-path media data flow of described reception, the described media data flow of grouping output, output on the output interface or output equipment corresponding with its grouping described multi-path media data flow Zhong Mei road media data flow;
Data output device, exported by picture output device, audio output apparatus or data output apparatus for the media data flow by after described grouping;
Wherein, described grouping is described as described multi-path media data flow Zhong Mei road media data flow and specifies the group feature.
18. system according to claim 17, is characterized in that, described transmitting device comprises:
Grouped element, for the multi-path media data flow that will transmit is divided into groups, comprise according to the position relationship between the interface of media data flow and being divided into groups, or divided into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described reproduction of multiple audio streams is divided into groups; Or, after getting panoramic picture by the wide-angle imaging machine, after described panoramic picture being cut into to the image of multichannel separation, multi-path video stream is divided into groups;
The grouping description unit, divide into groups to describe to the multi-path media data flow after described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or carry grouping and describe in the control protocol relevant to media data flow; Or increase in media data flow and carry and the media data control message of describing that divides into groups accordingly;
Data transmission unit, transmit multi-path media data flow after described grouping and the grouping description corresponding with described media data flow.
19. according to the described system of claim 17 or 18, it is characterized in that, also comprise:
Conference control equipment, for by forwarding media data stream packet relation, changing the grouping relation, or divided into groups to the multi-path media data flow in different meeting-place.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
| PCT/CN2010/070180 WO2010094213A1 (en) | 2009-02-20 | 2010-01-14 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101489090A CN101489090A (en) | 2009-07-22 |
| CN101489090B true CN101489090B (en) | 2014-01-08 |
Family
ID=40891737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910008299.4A Active CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101489090B (en) |
| WO (1) | WO2010094213A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101489090B (en) * | 2009-02-20 | 2014-01-08 | 华为终端有限公司 | Method, apparatus and system for multipath media stream transmission and reception |
| CN106162038A (en) * | 2015-03-25 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of audio frequency sending method and device |
| CN108667891B (en) * | 2018-03-05 | 2020-11-06 | 集思谱（北京）科技有限公司 | Independent unit combined multimedia information spreading method and system |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| CN113542688B (en) * | 2021-07-14 | 2023-03-28 | 杭州海康威视数字技术股份有限公司 | Audio and video monitoring method, device, equipment, storage medium and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multi medium information treatment system |
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007072739A (en) * | 2005-09-07 | 2007-03-22 | Hitachi Communication Technologies Ltd | Multipoint conference system, multipoint conference apparatus, and client terminal |
| CN101489090B (en) * | 2009-02-20 | 2014-01-08 | 华为终端有限公司 | Method, apparatus and system for multipath media stream transmission and reception |
-
2009
- 2009-02-20 CN CN200910008299.4A patent/CN101489090B/en active Active
-
2010
- 2010-01-14 WO PCT/CN2010/070180 patent/WO2010094213A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multi medium information treatment system |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Non-Patent Citations (1)
| Title |
|---|
| JP特开2007-72739A 2007.03.22 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101489090A (en) | 2009-07-22 |
| WO2010094213A1 (en) | 2010-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102055949B (en) | Recording method, device and system of multimedia conference and rewinding method and device | |
| CN101370114B (en) | Video and audio processing method, multi-point control unit and video conference system | |
| EP2214410B1 (en) | Method and system for conducting continuous presence conferences | |
| US8633962B2 (en) | Video decoder which processes multiple video streams | |
| EP2469853B1 (en) | Method and device for processing video image data, system and terminal for video conference | |
| JP3676979B2 (en) | High-speed video transmission via telephone line | |
| US8139100B2 (en) | Virtual multiway scaler compensation | |
| US9344475B2 (en) | Media transmission method and system based on telepresence | |
| CN110392047A (en) | Data transmission method, device and equipment | |
| CN103220543B (en) | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect | |
| CN101489090B (en) | Method, apparatus and system for multipath media stream transmission and reception | |
| CN102655584A (en) | Media data transmitting and playing method and system in tele-presence technology | |
| US9113037B2 (en) | Video conference virtual endpoints | |
| US20100328422A1 (en) | Method and System for Composing Video Images from a Plurality of Endpoints | |
| CN102547213A (en) | Video imaging preview method for video conference system | |
| CN105340215A (en) | Dynamic allocation of encoders | |
| Tang et al. | Audio and video mixing method to enhance WebRTC | |
| US20110088069A1 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN102572367B (en) | Multiple auxiliary stream control method, device and network system | |
| KR20160149150A (en) | MMT apparatus and method for processing stereoscopic video data | |
| CN207573452U (en) | A kind of integrated terminal equipment made for internet audiovisual with activity live streaming | |
| KR101673184B1 (en) | An ip switching/routing apparatus by separated processing of sdi format image signals and the method thereof | |
| WO2016204502A1 (en) | Mmt apparatus and mmt method for processing stereoscopic video data | |
| CN116866287A (en) | Audio and video signal exchange processing method, interface board and exchange equipment | |
| KR20220087322A (en) | Multiview streaming screen control method and data synchronization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Su Honghong Inventor after: Wang Zhaoxiang Inventor before: Su Honghong |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: SU HONGHONG TO: SU HONGHONG WANG ZHAOXIANG |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee after: Huawei terminal (Shenzhen) Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: HUAWEI DEVICE Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181218 Address after: 523808 Southern Factory Building (Phase I) Project B2 Production Plant-5, New Town Avenue, Songshan Lake High-tech Industrial Development Zone, Dongguan City, Guangdong Province Patentee after: HUAWEI DEVICE Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: Huawei terminal (Shenzhen) Co.,Ltd. |