JPH05103324A - Multi-point video conference controlling device - Google Patents

Abstract

PURPOSE:To obtain clear pictures so as to realize a multi-point video conference with presence by displaying the video of a speaking point from the video of another point in an enlarged state while the videos of all points attending the conference are dividedly displayed. CONSTITUTION:A voice detecting section 7 measures voice levels and specifies speaking points upon receiving terminal voice input signals 6a-6e from each video conference terminal equipment. A control information processing section 8 outputs synthesized control information 9 based on the measured results of the section 7 and video signal processing sections 4a-4e perform a contracting and synthesizing processes on displayed pictures based on the information 9. In addition, a control information processing section 8 outputs the information 9 based on a terminal video designating signal as the terminal video designating signals regarding picture displays from each video conference terminal equipment instead of the input signals 6a-6e and the processing sections 4a-4e perform contracting and synthesizing processes on displayed pictures.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference system for performing a video conference between a plurality of points at three or more locations, while displaying images of a plurality of terminals on a screen of a video conference terminal device. The present invention relates to a multipoint video conference control device capable of changing the size and position of part of the screen.

[0002]

2. Description of the Related Art A multi-point video conference system of this type has a configuration as shown in FIG. In the figure,
T is a video conference terminal device installed at a location where conference participants gather, having means for collecting video and audio at that location, and means for displaying video at another location and reproducing audio. Upon receiving the video and audio from the conference terminal device T,
It is a multipoint video conference control device that synthesizes them and distributes them to the video conference terminal device T. Each video conference terminal device,
The video signal at that point taken by the image pickup device and the audio signal collected by the microphone are sent to the multipoint video conference control device 1. In some cases, document data may be sent out. As shown in FIG. 13, the multipoint video conference control device 1 is connected to a plurality of video conference terminal devices, receives signals such as video and audio from each of the video conference terminal devices, performs synthesis / mixing processing, It is to be distributed to the conference terminal devices. The multipoint video conference control device combines the images of a plurality of points with the image signals of other points so that the images can be viewed at the same time, and outputs them as one image to each terminal. Similarly, it receives a voice signal at that point, mixes it with voice signals at other points so that the voices at a plurality of points can be heard at the same time, and sends it to each terminal. The video conference terminal device displays the combined image of each point on the display device. It also plays the mixed audio. The conference participants can view the images of each point at the same time and can hear the speech of each point at the same time because the images of each point are divided and displayed on the screen of the display device.

As a conventional example, the video conference control device 1 shown in FIG. 13 has a device as disclosed in Japanese Patent Laid-Open No. 61-32683. FIG. 10 shows the above-mentioned Japanese Patent Laid-Open No. 61-32.
FIG. 6 is a diagram showing the concept of what is disclosed in Japanese Patent No. 683,
It is a figure which shows the structure of the multipoint video conference control apparatus in the case of performing a video conference between five points. 1 is a multipoint video conference control device, 2a, 2b, 2c, 2d, 2e are terminal image input signals from each video conference terminal device, 3a, 3b, 3
c, 3d, and 3e are video memories for storing the terminal video input signals 2a to 2e, and 4a, 4b, 4c, 4d, and 4e are video signal processing units that read out data from the video memories 3a to 3e and perform reduction / combination. Reference numerals 5a, 5b, 5c, 5d, and 5e denote video output signals to the video conference terminal devices output from the video signal processing units 4a to 4e, and 20a, 20b, 20c, and 2.
Video input signals 0d and 20e are output from the video memories 3a to 3e to the video signal processing unit. The alphabet corresponds to each terminal at each point. FIG. 11 shows FIG.
It is a figure which shows the structure of the video signal processing part 4e which is a structure part of the multipoint video conference control apparatus shown in FIG. 20a, 2
0b, 20c, 20d are video input signals, 21a, 21
Reference numerals b, 21c, and 21d denote reduction circuits that perform reduction processing on the video input signals 20a to 20d, and 22 denotes a synthesis circuit that synthesizes the reduced video signals.

Next, the operation will be described. In this multipoint video conference control device 1, the video image memories 3a, 3b, 3 provided respectively corresponding to the terminal video input signals 2a, 2b, 2c, 2d, 2e from the video conference terminal device.
It is once recorded in c, 3d, and 3e. After that, the video signals are read out all at once by using the same clock and matching the phases.

These video signals are input to the video signal processing units 4a, 4b, 4c, 4d, and 4e except signals corresponding to their own video conference terminal devices (for example, read from the video memory 3a). The input signal is input to the video signal processing units 4b, 4c, 4d, 4e. The same applies to other signals.)

In the video signal processing section 4e, the video memory 3
Video input signals 20a, 20 from a, 3b, 3c, 3d
b, 20c, 20d are reduction circuits 21a, 21b, 21
In c and 21d, the vertical and horizontal dimensions are reduced to 1/2. The reduction rate is fixed. Then, the synthesis circuit 22
In (1), they are combined into one screen and output as a video output signal 5e. Other video signal processing units 4a, 4b, 4c,
The operation in 4d is also the same. Video output signals 5a, 5
b, 5c, 5d and 5e are output to each video conference terminal device.

Upon receiving the video output signal, the video conference terminal device performs split display in the format shown in FIG. 12, for example. 12
Indicates a screen format displayed on the video conference terminal device e, and each alphabet is a terminal video input signal 2a to 2e from the other video conference terminal device a to d (hereinafter abbreviated as ground a to d). Indicates that the screen is. As described above, the multipoint video conference control device enables the video conference terminal device to simultaneously display the images of each ground.

[0008]

Since the conventional multipoint video conference control device is constructed as described above and the reduction ratio of the reduction circuit for reducing the image is fixed, the presence or absence of the utterance at each point is determined. The screen of each ground is always the same size, position, and shape regardless of the situation, etc., and it is not possible to display the video of the speaking point in a large size while simultaneously displaying the video of multiple terminals, and to grasp the atmosphere of the entire conference. However, there was a problem that a clear image of the speaker could not be seen.

The present invention has been made in order to solve the above-mentioned problems, and the size and display position of an image such as the ground being spoken or the ground designated by the chair are displayed while simultaneously displaying the ground image. An object of the present invention is to obtain a multipoint video conference control device that can be changed and displayed.

[0010]

A multipoint video conference control device according to the inventions of claims 1, 2 and 3 (hereinafter referred to as the first invention) receives signals from three or more video conference terminal devices. Measuring means for measuring one or more physical quantities of the signal, a display mode of the video signal based on the measured physical quantity, and a video conference terminal device for displaying the video in the display mode, and the determination thereof Based on the result, a control signal creating unit that creates a control signal for controlling the display mode of the video signal in the determined video conference terminal device, and a video signal that changes the display mode by the control signal created by the control signal creating unit It is provided with a processing means.

Further, in the multipoint video conference control device according to the invention of claim 2, the display mode is the change rate of the video signal and the combination mode, and the video signal processing means is created by the control signal creating means. The image changing means for changing the image by the control signal and the image synthesizing means for synthesizing the plurality of image signals by the control signal created by the control signal creating means.

Further, in the multipoint video conference control apparatus according to the invention of claim 3, the display mode is a display position of the video signal and a combination mode, and the video signal processing means is created by the control signal creating means. The image synthesizing means synthesizes a plurality of image signals at the determined display position by the control signal.

The multipoint video conference control device according to the inventions of claims 4, 5 and 6 (hereinafter referred to as the second invention) is 3
Receiving a designation signal designating a video conference terminal device that performs display in the display mode and the display mode of the video signal from one or more video conference terminal devices or other devices,
A control signal generating means for generating a control signal for controlling the display mode of the video signal based on the designated signal, and a video signal processing means for changing the display mode by the control signal generated by the control signal generating means. is there.

According to a fifth aspect of the present invention, in the multipoint video conference control device, the display mode is the change rate of the video signal and the combination mode, and the video signal processing means is created by the control signal creating means. The image changing means for changing the image by the control signal and the image synthesizing means for synthesizing the plurality of image signals by the control signal created by the control signal creating means.

In the multipoint video conference control apparatus according to the invention of claim 6, the display mode is a display position of the video signal and a combination mode, and the video signal processing means is created by the control signal creating means. The image synthesizing means synthesizes a plurality of image signals at a designated display position by the control signal.

[0016]

According to the first aspect of the present invention, by measuring the physical quantity of the signal from each ground, the image reduction / enlargement ratio of the image signal or the display position of the image, or the display mode according to the combination thereof and the television to be controlled. The conference terminal device is determined, the control signal is generated by the control signal generating means based on the result, and the display mode of a plurality of video signals for the ground is set by the output, and the screens of these videos are combined and displayed. Further, in the second invention, instead of measuring the physical quantity of the signal from each ground and determining the display mode of the video, a control signal is generated by a designating signal designating the display mode of the video in the video conference terminal device. The control signal is generated by the means, the display mode of a plurality of video signals of the ground is set by the output thereof, and the screens of these videos are combined.

[0017]

EXAMPLE 1 An example according to the first invention will be described below with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a multipoint video conference control device according to the present invention when a video conference is held between five points.
In this embodiment, the level of an audio signal is used as a physical quantity of a signal, an audio level measuring unit is used as a measuring unit, a control information processing unit and a split display control unit are used as a control signal creating unit, and a scaling circuit or a variable circuit is used as a video signal processing unit. An image signal processing unit having a reduction / enlargement circuit and a synthesis circuit uses the reduction / enlargement ratio as the change rate of the image.

1 is a multipoint video conference control device, 2a, 2
b, 2c, 2d and 2e are terminal video input signals from the respective video conference terminal devices, 3a, 3b, 3c, 3d and 3e are video memories for storing the terminal video input signals 2a to 2e, 4a and 4a.
b, 4c, 4d, and 4e are data from the video memories 3a to 3e.
Video signal processing units 5a, 5 for reading out and processing the data
b, 5c, 5d, and 5e are video output signals to the video conference terminal devices output from the video signal processing units 4a to 4e, 6
a, 6b, 6c, 6d, 6e are terminal audio input signals from the respective video conference terminal devices, and 7 is terminal audio input signals 6a-6.
A voice level measuring unit that measures the level of e, 8 is a control information processing unit that receives the measurement result of the voice level measuring unit 7 and creates control information, and 9 is combined control information of the output of the control information processing unit 8. is there.

FIG. 2 is a diagram showing the configuration of the video signal processing unit 4e which is a component of the multipoint video conference control apparatus 1 shown in FIG. Reference numerals 20a, 20b, 20c and 20d denote video input signals from the video memories 3a to 3d, and 21a and 21.
b, 21c and 21d are reduction / enlargement circuits that perform reduction / enlargement processing on the video input signals 20a to 20d, 22 is a combination circuit that combines the output signals of the reduction / enlargement circuits 21a to 21d and the variable reduction / enlargement circuit 25, and 24 is an image. Input signal 20a
20d is a switching circuit for selecting one of them, 25 is a variable reduction / enlargement circuit that reduces the output of the switching circuit 24 in stages, and 26 is a combination circuit 22, a switching circuit 24, and a variable reduction / enlargement circuit 25. Split display control unit for controlling
Reference numeral 7 is a switching control signal, 28 is a reduction / enlargement ratio control signal, and 29 is a synthesis control signal.

Next, the operation will be described. In the multipoint video conference control device of FIG. 1, terminal video input signals 2a, 2b, 2c, sent from the video conference terminal devices of each ground.
2d and 2e are received and temporarily recorded in the corresponding video memories 3a, 3b, 3c, 3d and 3e. After recording, the phases of the output video signals are made to coincide with each other by simultaneously reading out with the same clock (this clock is not shown), and the video signal processing units 4a, 4b, 4
Send to c, 4d, 4e.

At this time, the video signals are input to the video signal processing units 4a, 4b, 4c, 4d and 4e except for the signals corresponding to their own video conference terminal devices (for example, read from the video memory 3a). The generated signal is input to the video signal processing units 4b, 4c, 4d, 4e (the same applies to the others).

On the other hand, the audio level measuring unit 7 measures the audio level of the terminal audio input signals 6a, 6b, 6c, 6d, 6e sent from the video conference terminal devices at each ground. For example, the sound level is ranked from 0 to 10 in ascending order. In the control information processing unit 8, based on the audio level measured by the audio level measuring unit 7, the reduction / enlargement ratio for each ground, the display position and the reduction / enlargement ratio, and the video conference terminal device to be displayed at the display position are determined,
Based on these decisions, the video signal processing units 4a, 4b, 4
Synthesis control information 9 for controlling c, 4d, and 4e is created.
For example, the voice level measuring unit 7 may use the terminal voice input signal 6a-
6e is measured, and if all the voice levels are 3 or less, the control information processing unit 8 determines that no speech is made in all terminals, and the reduction / enlargement ratios and display positions of the screens of all terminals are fixed. (For example, reduction / enlargement ratio 1/2,
The image display positions of the grounds a, b, c, and d are determined as upper left, upper right, lower left, and lower right, respectively. Then, in order to display the screens of all terminals in that mode, the video signal processing unit 4
Synthesis control information 9 for controlling a, 4b, 4c, 4d, and 4e
To create. On the other hand, if the voice level at a certain ground exceeds 3, it is determined that the ground is speaking, and the reduction / enlargement ratio and the display position of the terminal are changed according to the level. For example, if the ground a is level 5, the synthesis control information 9 with the reduction / enlargement ratio of 3/4 and the display position at the upper left is created.

When the number of the grounds for which the variable reduction / enlargement and the display position are to be changed is limited to one, only the ground having the maximum audio level is made variable, and the display mode of the other grounds is the same as that when no speech is made. It is fixed. If a plurality of grounds whose variable reduction / enlargement and display positions are to be changed are allowed, they are made variable according to the audio level. Either one may be selected as needed.

Next, the operation of the video signal processing section will be described. The video signal processing units 4a, 4b, 4c, 4d, and 4e perform the same operation, so the video signal processing unit 4e will be taken as an example. The video signal processing unit 4e of FIG. 2 shows an embodiment in the case where there is only one ground whose variable reduction / enlargement and display position should be changed. The split display control unit 26 receives the synthesis control information 9e from the control information processing unit 8 and divides it into a switching control signal 27, a reduction / enlargement control signal 28, and a synthesis control signal 29 according to the contents, and the switching circuit 24 and the variable reduction. It is distributed to the expansion circuit 25 and the synthesis circuit 22. For example, it is assumed that the content of the composition control information 9e is that the ground a is talking, the reduction / enlargement rate of the image is 75%, and the display position is at the upper left. In this case, the split display control unit 26
Outputs a switching control signal 27 so that the switching circuit 24 selects the video input signal 20a from the video memory 3a.
The switching circuit 24 selects the video input signal 20a and sends it to the variable reduction / enlargement circuit 25. The reduction / enlargement control signal 28 is a control signal for controlling the input video signal to be reduced to a reduction ratio of 75%, and the variable reduction / enlargement circuit 25 reduces the image to 3/4 and sends it to the synthesizing circuit 22. ..

The composite control signal 29 displays the image of the ground a at the upper left and the images of the other grounds b, c and d at fixed positions.
That is, it is a control signal for controlling display in the upper right, lower left, and lower right, and based on this signal, the synthesizing circuit 22 causes the reducing / enlarging circuits 21a, 21b, 21c, and 21d in FIG.
The video input signals 20a, 20b, 20c, and 20d from the video memories 3a, 3b, 3c, and 3d of FIG. Select and display at each fixed position. Reduction / enlargement circuits 21a, 21b, 21c, 2
The reduction ratio of 1d is fixed. The synthesizing circuit 22 has a memory therein and displays a video image at a predetermined position by writing a video signal at a predetermined position. After writing the images of the ground b, c, and d, the variable reduction / enlargement circuit 25 makes the images 3/4.
The video signal of the ground a reduced to is received and written in the upper left of the memory. The video signal combined into one screen by the combining circuit 22 is output as a video output signal 5e.

The specific operation of the reduction / enlargement circuits 21a to 21d will be described with reference to FIG. FIG. 3A shows an example of the arrangement of pixels of the video signals 20a to 20e. Reference numeral 30 denotes an array of pixels, and the number of pixels is 100 × 100. x indicates a horizontal position, y indicates a vertical position, and (x1, y1) indicates one pixel at the left corner. One pixel corresponds to one point on the screen. Figure 3
(B) shows an example of arrangement of pixels output from the reduction / enlargement circuits 21a to 21d. Since the reduction / enlargement ratio is 1/2, the number of pixels is 5.
It is 0x50. z indicates a horizontal position, w indicates a vertical position, and (z1, w1) indicates the upper left pixel.
In the reduction / enlargement circuits 21a to 21d, four pixels of the video signal
The reduction / enlargement operation is performed by associating one with the pixel of the reduction / enlargement circuit. For example, pixel (x1, y
1), (x3, y1) ... (x99, y1) data (z1, w1), (z2, w1) ... (z50, w
1), (x1, y3), (x3, y3) ... (x9
The data of (9, y3) is (z1, w2), (z2, w2)
Enter in (z50, w2). Same operation as y5
Repeat for y99, w3 to w50. In addition, you may use what took the average here. That is, pixel (x
1, y1), (x2, y1), (x1, y2), (x
The average value of (2, y2) may be substituted for (z1, w1). Also, the maximum value of them may be taken.

Next, the specific operation of the reduction / enlargement circuits 21a to 21d will be described with reference to FIG. FIG. 3C shows the pixel arrangement of the output of the variable reduction / enlargement circuit 25 when the reduction / enlargement ratio is 3/4, and the number of pixels is 75 × 75. The meanings of z and w are the same as in the case of FIG.

In the variable reduction / enlargement circuit 25, the pixel 30 of the video signal is changed to the pixel 3 of the variable reduction / enlargement circuit according to the reduction / enlargement ratio.
A variable reduction / enlargement operation is performed by associating with 2. In the case of 32, since the reduction / enlargement ratio is 3/4, (x
1, y1), (x2, y1), (x3, y1), (x
5, y1) ... (x99, y1) data is converted to (z1,
w1), (z2, w1), (z3, w1), (z4, w
1) Put in (z75, w1). Similarly, Y2, Y
The data of rows 3 and Y5 are made to correspond to rows W2, W3, and W4. An average or maximum value may be used as in the case of the reduction / enlargement circuit. Alternatively, a moving average of pixels may be used.

Similarly, when the reduction ratio is 2/3, the number of pixels is 6
Since it is 6 × 66, (x1, y1), (x2, y
1), (x4, y1), (x5, y1) ... (x9
The data of (8, y1) are (z1, w1), (z2, w
1), (z3, w1), (z4, w1) ... (z6
6, w1). As described above, the variable reduction / enlargement circuit 25 can select the reduction / enlargement rate stepwise.

Receiving the outputs of the reduction / enlargement circuit and the variable reduction / enlargement circuit, the synthesizing circuit 22 performs a synthesizing process. Less than,
The operation will be described with reference to FIG. In the figure, each alphabet indicates that it is a screen based on a video signal from the ground. The synthesizing circuit 22 first receives the image output from the reducing / enlarging circuits 21a, 21b, 21c, 21d, and according to the synthesizing control signal 29, the reducing / enlarging circuit 21.
Select the output of b, 21c, 21d, and internal 100 × 1
00 is written in the memory corresponding to the pixel. That is, FIG.
As shown in (a), 50 × 50 pixels of the reduction circuit 21b are written in the upper right of the memory, pixels of the reduction circuit 21c are similarly written in the lower left, and pixels of the reduction circuit 21d are written in the lower right. Images of the grounds b, c, and d are written, except for the portion of the left upper reduction circuit 21a.

Next, the image output from the variable reduction / enlargement circuit 25 is received, and 75 × 75 pixels are written in the upper left of the memory. At this time, since the data is overwritten in the overlapping portion of the images of the grounds b, c, d and the image of the ground a which have already been written, the overlapping portion is the data of the video of the ground a.
Then, an image as shown in FIG. 4B is finally obtained. Thus, in the video output signal 5e, the ground a
The image of is larger and clearer than other ground.

In the above description, the reduction / enlargement rate is 1
It was less than, but may be equal to or greater than 1. For example, when the memory of the synthesizing circuit 22 has 200 × 200 pixels, in order to obtain the same screen as in the above example, the reduction / enlargement circuits 21a, 21b, 21c, and 21d have a reduction / enlargement ratio of 1 and the variable reduction / enlargement circuit 25. In, the reduction / enlargement ratio may be set to 3/2.

When the reduction / enlargement ratio is 3/2,
The number of pixels of the video signals 20a to 20e in (a) is 100 × 1.
Therefore, the number of pixels in FIG. 3B is 150 × 150.
Is. At this time, in the variable reduction / enlargement circuit 25, the pixels of the video signal correspond to the pixels of the variable reduction / enlargement circuit 25, for example, as follows. Pixel (x1, y1) becomes (z1, w
1), (z2, w1), (z1, w2), (z2, w
Corresponding to (2), (x2, y1) becomes (z3, w1),
Corresponding to (z3, w2) ... (x100, y1)
Correspond to (z150, w1) and (z150, w2). Further, the pixel (x1, y2) is replaced by (z1, w3), (z
2, x3, and (x2, y2) is converted to (z3, w
Corresponding to (3), ... (x100, y2) is converted to (z15
0, w3). The same operation is repeated thereafter. In addition, you may use what took the average here. Also, the maximum value of them may be taken.

Here, the reduction / enlargement ratio means the ratio of the number of pixels before and after the reduction, and is not related to the physical size of the display screen. Therefore, the operation does not change even if the physical size of the display screen of the video conference terminal device varies.

The screen format in the case of the above operation explanation is shown in FIG.
It shows in (a). FIG. 5 shows screen formats from other points received by the video conference terminal device e, and shows that each alphabet is a screen based on a video signal from the ground. Since the reduction ratio can be changed in stages, it is possible to display one ground image on the entire screen even with a split screen.

The case where the ground a is speaking has been described above, but the same applies when the grounds b, c, and d are speaking.
5B shows a composite screen in which the ground b is speaking, FIG. 5C shows a composite screen in which the ground c is speaking, and FIG. 5D shows a composite screen in which the ground d is speaking. However, since the video input signal 20e of the terminal of itself is not input to the video signal processing unit 4e when the ground e, that is, the user himself is speaking,
The synthesis circuit 22 does not synthesize the output of the variable reduction / enlargement circuit 25 by the synthesis control signal 29 output from the divided display control unit 26. Therefore, all ground images are displayed in the same size. Further, the operations in the video processing units 4a, 4b, 4c and 4d are also the same.

In the present embodiment, the size of the screen is changed based on the audio signal, so that if there is a utterance, the image of the utterance point is automatically enlarged and a clear image of the utterance point is obtained. In addition, it is possible to know from the screen whether or not a statement has been made.

In the above example, the image of each TV terminal is written in the four corners, but the writing position can be arbitrarily set in the synthesizing circuit 22 simultaneously with the reduction / enlargement ratio or independently. Figure 6 shows the screen format when the position is changed.
It shows in (a). FIG. 6A shows a case where the ground a is speaking. FIG. 6B is a composite screen in which the ground b is speaking, FIG.
6C shows a composite screen in which the ground c is speaking, and FIG. 6D shows a composite screen in which the ground d is speaking.

Second Embodiment In the first embodiment, the video signal processing units 4a to 4e are composed of the reduction / enlargement circuit and the variable reduction / enlargement circuit. However, they may be formed of only the variable reduction / enlargement circuit. FIG. 7 shows a configuration example.
In the figure, the variable reduction / enlargement circuits 25a to 25e are shown in the first embodiment
Performs exactly the same function as in. Since the synthesizing circuit 22 has four input signals and the same number as the number of grounds, the selecting function in the case of the first embodiment is unnecessary. The split display control unit 26 receives the synthesis control information 9 from the control information processing unit 8 and controls the variable reduction / enlargement circuits 25a to 25d and the synthesis circuit 22.

For example, suppose that the content of the control information 9 is that the ground a is talking and the reduction / enlargement rate of the image is 75%. In this case, the split display control unit 26 controls the variable reduction / enlargement circuit 25a to reduce the image to 3/4 and the variable reduction / enlargement circuits 25b, 25c, and 25d to reduce the image to 1/2. The synthesis circuit 22 is a variable reduction / enlargement circuit 25.
After the images b, 25c, and 25d are written in the internal memory, the image of the variable reduction / enlargement circuit 25a is written to synthesize them. The video signal combined into one screen by the combining circuit 22 is output as a video output signal 5e. In this embodiment, unlike the case of the first embodiment,
It is possible to simultaneously reduce and enlarge a plurality of images of the ground according to the audio level and change the display position.

Third Embodiment Although the voice level is used as the physical quantity of the signal in the first embodiment, the physical quantity of the signal other than the voice signal may be used. For example, it is possible to control the screen by the movement of the person on the screen. When compressing a video signal, the amount of data for a motionless image is small, and the amount of data for a moving image is large. Therefore, the terminal voice input signals 6a to 6e
If a terminal video signal is used instead of the above, the amount of data is measured, and if it is treated in the same manner as the audio level in the first embodiment, control by the movement of the person on the screen is possible. The video conference terminal device may detect a motion when compressing an image and receive the signal. It is possible to enlarge the image of a point that is actively moving. It is also possible to control the screen according to the brightness of the screen. If the brightness of the screen of the terminal is obtained from the terminal video signal and treated in the same manner as the audio level of the first embodiment, control by the brightness of the screen is possible. Further, the brightness of the screen and the like created by the video conference terminal device of each ground may be transmitted to the multipoint video conference control device according to the invention. At that time, it may be transmitted through a dedicated signal line or may be transmitted together with data of a video signal or an audio signal. Further, it is conceivable that the screen is controlled not by the level but by the frequency distribution of the audio signal. If the terminal voice input signals 6a to 6e are converted into a frequency distribution by high-speed Fourier transform, their shapes, peaks, etc. are measured and treated in the same manner as the voice level of the first embodiment, the frequency of the voice signal is It is possible to control by distribution.

Embodiment 4 Next, an embodiment of the second invention will be described with reference to the drawings. FIG. 8 is a diagram showing a configuration of a multipoint videoconference control device according to the second invention when a videoconference is held between five points. The first invention has a measuring means for measuring a physical quantity, and determines the display mode of the image based on the measurement result,
In the second invention, instead, each television terminal device receives a designation signal for designating a reduction / enlargement ratio to be displayed on its own terminal device, a display position, and a ground to be displayed in the display mode, and is synthesized by the designation signal. The control information 9 is created.
In FIG. 8, 11a to 11e are terminal image designation signals for the ground a to e.

The terminal image designating signals 11a to 11e are used to display the image of what ground is displayed on the screen of the terminal device of one's own terminal in what manner (for example, how much reduction / enlargement ratio, at which display position).
It is to specify whether to display. Terminal image designation signal 11
Based on a, the control information processing section 8 functions as a decoder, decodes the contents of the terminal video designating signal 11a, and synthesizes control information 9a to 9a to display the screen of its own terminal device based on the designated contents. 9e is created, and the display screen is instructed to the video signal processing unit 4a. Similarly, based on the terminal image designation signals 11b to 11e, the image signal processing units 4b to 4e.
Instruct the display screen to. Video signal processing units 4a to 4e
The operation of is the same as that of the first invention. In the second invention, since the control signal is created based on the designated signal, the measuring means in the first invention is unnecessary. Therefore, the second invention has a simpler configuration than the first invention and does not require setting or adjustment when determining the display mode or the like from the physical quantity. Therefore, a maintenance-free multipoint video conference control device can be made small and simple.

Fifth Embodiment In the above embodiment, the screen mode of the terminal device of its own is controlled by designation from the video conference terminal device.
The display mode of the screens of all terminal devices on the ground may be controlled by designation from one specific terminal device. For example, a specific terminal can be used as a chairperson, and the screen control of all video conference terminals can be performed by designating that terminal. FIG. 9 shows a configuration example. In the figure, 13 is a terminal selection signal, 1
Reference numeral 4 is a control signal switching unit. Depending on which video conference terminal device is the chairman's terminal, the terminal selection signal 13 causes the control signal switching unit 14 to control the terminal video designation signals 11a to 11e.
Select one from. Terminal image designation signals 11a to 11e
Different from the case of the fourth embodiment, specifies which ground image is displayed on what screens of all ground terminal devices in what manner. Therefore, the video of the designated terminal device on the ground is displayed on the display screens of all the terminal devices on the ground except the display screen of the designated terminal device on the ground. It is conceivable that the terminal selection signal 13 is created by, for example, a multipoint video conference terminal device or a terminal that is the center of a video conference. In this embodiment, the same screen can be displayed on all terminals by the will of a specific person such as the chairperson. Therefore, the attention of all the participants can be focused on the speaker, for example, and the chairperson can easily proceed with the proceedings.

In the fourth and fifth embodiments, the terminal video designation signal is received from the video conference terminal device, but the designation signal may be received from a completely different control device other than the video conference terminal device, for example. In the above embodiment, the number of conference participants is 5
Although the case has been described, the video signal processing can be performed by the same means even when the number of points is other than 5 if the number is 3 or more, and the video conference control device according to the present invention can be realized. ..

[0046]

As described above, according to the first invention, a signal is received from the video conference terminal device, and a video signal display mode of the video conference terminal device is displayed based on one or more physical quantities of the signal. Since the video conference terminal to be displayed in that display mode has been determined, it is possible to enlarge / move the image at some points (for example, the speaking point), and the conference participants can see the images at other conference participation points, You can clearly see the video of some of the conference points. Further, according to the second invention, since the video conference display device and the video conference terminal device for displaying the video signal are designated, the image at the designated point can be enlarged / moved, and the conference participants can It is possible to clearly see the image of the designated conference participation point while seeing the image of the other conference participation point.

[Brief description of drawings]

FIG. 1 is a block diagram of a multipoint video conference control apparatus according to an embodiment of the first aspect of the present invention.

FIG. 2 is a configuration diagram of a video signal processing unit according to an embodiment of the present invention.

FIG. 3 is a pixel layout diagram of a video signal according to an embodiment of the present invention.

FIG. 4 is an explanatory diagram of screen composition according to an embodiment of the present invention.

FIG. 5 is an example of a composite screen in one embodiment of the present invention.

FIG. 6 is an example of a composite screen in an embodiment of the present invention.

FIG. 7 is a block diagram of a video signal processing unit according to another embodiment of the present invention.

FIG. 8 is a configuration diagram of a multipoint video conference control device according to an embodiment of claim 2 of the present invention.

FIG. 9 is a configuration diagram of a multipoint video conference control device according to another embodiment of the second aspect of the present invention.

FIG. 10 is a block diagram of a conventional multipoint video conference control device.

FIG. 11 is a configuration diagram of a conventional video signal processing unit.

FIG. 12 is an example of a conventional composite screen.

FIG. 13 is a diagram showing a connection between a multipoint video conference control device and five video conference terminal devices.

[Explanation of symbols]

1 Multipoint video conference control device 2a, 2b, 2c, 2d, 2e Terminal video input signal 3a, 3b, 3c, 3d, 3e Video memory 4a, 4b, 4c, 4d, 4e Video signal processing unit 5a, 5b, 5c, 5d, 5e Video output signal 6a, 6b, 6c, 6d, 6e Terminal audio input signal 7 Audio level measuring unit 8 Control information processing unit 9 Synthesis control information 11a, 11b, 11c, 11d, 11e Terminal video designation signal 13 Terminal selection signal 14 control signal switching unit 20a, 20b, 20c, 20d, 20e video input signal 21a, 21b, 21c, 21d reduction / enlargement circuit 22 synthesis circuit 24 switching circuit 25 variable reduction / enlargement circuit 26 division display control unit 27 switching control signal 28a, 28b , 28c, 28d Reduction / enlargement ratio control signal 29 Composite control signal 30 Pixel arrangement of video signals 20a to 20d DESCRIPTION OF SYMBOLS 1 Pixel arrangement of reduction / enlargement circuits 21a to d 32 Pixel arrangement of variable reduction / enlargement circuit 25 33 Explanatory diagram showing screen synthesis 34 Explanatory diagram showing screen synthesis 40 Synthetic screen in which ground a is speaking 41 41 Ground b in speech Screen 42 Composite screen in which ground c is speaking 43 Composite screen in which ground d is speaking 50 Composite screen in which ground a is speaking 51 Composite screen in which ground b is speaking 52 Composite screen 53 in which ground c is speaking 53 Ground d is Composite screen during speech 60 Composite screen by conventional multipoint video conference control device T Video conference terminal device

Claims (6)

[Claims] 1. A video signal and an audio signal are received from three or more video conference terminal devices, the video signals and audio signals are synthesized, and the synthesized signal is used for the video conference terminal devices. A multipoint video conference control device for transmitting to a plurality of video conference terminal devices, measuring means for measuring one or more physical quantities of the signals, and a video signal based on the measured physical quantities. Of the display mode and the video conference terminal device for displaying the video in the display mode, and based on the determination result, a control signal generation for generating a control signal for controlling the display mode of the video signal in the video conference terminal device. And a video signal processing means for changing the display mode by the control signal created by the control signal creating means. Multipoint video conference control device. 2. A video signal and an audio signal are received from three or more video conference terminal devices, the video signals and audio signals are synthesized, and the synthesized signal is used. A multi-point video conference control device for transmitting to a plurality of video conference terminal devices, measuring means for measuring one or more physical quantities of the signals, and the video based on the measured physical quantities. The video conferencing rate of the video of the signal, the aspect of the combination and the video conferencing terminal device that displays the video according to the rate of change of the video and the aspect of the compositing are determined, and based on the determination result, An image is generated by a control signal creating unit that creates a control signal that controls the rate of change of the image and the aspect of composition, and the control signal created by the control signal creating unit. A multipoint video conference control device comprising: a video changing means for changing the video changing means; and a video synthesizing means for synthesizing a plurality of video signals by the control signal created by the control signal creating means. 3. Video signals and audio signals are received from three or more video conference terminal devices, the video signals and audio signals are combined, and the combined signals are combined. A multi-point video conference control device for transmitting to a plurality of video conference terminal devices, measuring means for measuring one or more physical quantities of the signals, and the video based on the measured physical quantities. A display position of the signal, a combination mode and a display position of the video conference terminal device for displaying the video in the display position and the combination mode are determined, and based on the determination result, the display position of the video signal in the video conference terminal device and A control signal generating means for generating a control signal for controlling the combination mode and a plurality of video signals are determined by the control signal generated by the control signal generating means. A multipoint video conference control device comprising video synthesizing means for synthesizing at a predetermined display position. 4. A video signal and an audio signal are received from three or more video conference terminal devices, the video signals and audio signals are combined, and the combined signal is added to the video conference terminal devices. A multipoint video conference control device for sending to a plurality of video conference terminal devices or another device, a display mode of the video signal and a designation signal for designating a video conference terminal device to be displayed in the display mode. And a control signal creating means for creating a control signal for controlling the display mode of the video signal in the video conference terminal device based on the designated signal, and the display mode is changed by the control signal created by the control signal creating means. A multipoint video conference control device comprising video signal processing means. 5. A video signal and an audio signal are received from three or more video conference terminal devices, the video signals and audio signals are combined, and the combined signal is added to the video conference terminal devices. A multipoint video conference control device for transmitting to a plurality of video conference terminal devices or other devices, the rate of change of the image of the video signal, the aspect of synthesis, and the rate of change of the image and the aspect of synthesis. A control signal for receiving a designation signal for designating a video conference terminal device for displaying, and based on the designation signal, creating a control signal for controlling the rate of change and the aspect of synthesis of the video of the video signal in the video conference terminal device. Created by the creating means, the image changing means for changing the image by the control signal created by the control signal creating means, and the creating means by the control signal creating means A multipoint video conference control device comprising video synthesizing means for synthesizing a plurality of video signals by a control signal. 6. A video signal and an audio signal are received from three or more video conference terminal devices, the video signals and audio signals are combined, and the combined signal is output. A multi-point video conference control device for transmitting to a multi-point video conference, wherein a video conference is displayed from the plurality of video conference terminal devices or other devices in the display position of the video signal, a combination mode, and the display position and the combination mode. Receives a designation signal that designates the terminal device,
Based on the designated signal, a control signal creating means for creating a control signal for controlling the display position and the synthesizing mode of the video signal in the video conference terminal device, and a plurality of videos by the control signal created by the control signal creating means. A multipoint video conference control device comprising video synthesizing means for synthesizing a signal at a designated display position.