JPH11341441A - Video generator, video reproduction device, video generating method and video reproducing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the video generator and the reproducing device that recognize effectively validity of displayed information in the case that a viewer reproduces a recorded image by himself and to provide the video generating method and the reproduction method. SOLUTION: The video reproduction device discriminates whether or not additional information 43 is to be outputted based on a valid period denoted by period information of control information 45 and a time (date and time) at reproduction when the device reproduces a video image from a recording medium 9 on which a video/audio signal consisting of main display information 41 such as video and audio information, additional information 43 added to the main display information and outputted, and control information 45 including period information denoting a period to output the additional information and not to output it, and the video reproduction device outputs the additional information 43 with the main display information when the video reproduction device discriminates that the additional information 43 is to be outputted.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video generating technique and a video reproducing technique for adding predetermined display or audio additional information to a video when reproducing the recorded video.

[0002]

2. Description of the Related Art Conventionally, during a program such as a television broadcast, information such as notification of a gift application is sometimes displayed.
Some of such notification information has a period during which the information is valid, and after the validity period has elapsed, the information has no meaning at all. In particular, when a program is rebroadcast and viewed, the period in which the notification information becomes valid may have already passed, and even though the information is invalid, the viewer may be able to use the information. It can be misleading to be confusing. Therefore, on the broadcast station side, in such a case, for example, a telop such as "This is a rebroadcast and this recruitment is not currently being conducted." Prevents viewer confusion.

[0003]

A similar problem may occur when a viewer reproduces and watches a program recorded on an image recording device (VTR). In this case, the time when the program was broadcast was completely different from the time when the viewer played it,
Viewers can use the previously invalidated information announced in the program,
The user may mistakenly recognize that it is effective without realizing it, and may cause confusion as in the case described above.

[0004] In the future, it is expected that other channel broadcasts and home servers in which broadcasts are stored at home will become popular.
With the spread of these, it becomes increasingly difficult for viewers to determine whether the program they are watching is currently being broadcast or recorded in the past. It is believed that the likelihood of misunderstanding and confusion will increase.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to prevent the viewer from being confused by the displayed information when playing back a recorded image. It is an object of the present invention to provide a video generating apparatus and a reproducing apparatus, a video generating method and a reproducing method.

[0006]

A video generating apparatus according to the present invention generates video and audio information from main display information including video and audio information and additional information added to and output from the main display information. An image generation device. The video generation device includes a period setting unit that sets period information indicating a period during which the additional information should be output or a period during which the additional information should not be output, and control information including the period information set by the period setting unit.
Information generating means for adding to the video and audio information.

[0007] A video reproducing apparatus according to the present invention comprises: a video, an audio, additional information added to the video and output, and period information indicating a period during which the additional information should be output or a period during which the additional information should not be output. This is a video reproducing apparatus that reproduces the recorded video and audio from a recording medium on which control information including the control information is recorded. The video reproducing apparatus includes: a clock unit that outputs time information at the time of reproduction; a period indicated by the period information of the control information when reproducing the video and audio recorded from the recording medium; By comparing the time information with the time information, it is determined whether or not the additional information should be output. When it is determined that the additional information should be output, the additional information control that outputs the additional information is performed. Means. The additional information may include text, image, or audio information indicating a message that conveys the validity of video and audio reproduction.

[0008] The above-mentioned video reproducing apparatus may further include a reference table in which a predetermined code is associated with a predetermined message. At this time, the additional information includes at least one of the predetermined codes, and the additional information control unit refers to the reference table and outputs a message corresponding to the predetermined code included in the additional information.

A video generation method according to the present invention is a video generation method for generating video and audio information from main display information including video and audio information and additional information added to the main display information and output. In the video generation method, period information indicating a period during which the additional information should be output or a period during which the additional information should not be output is set, and the set period information is added to the video and audio information as control information.

The video reproducing method according to the present invention is characterized in that a video, an audio, additional information added to the video and output, and period information indicating a period during which the additional information should be output or a period during which the additional information should not be output. This is a video reproducing method for reproducing the recorded video and audio from a recording medium on which the control information and the control information are recorded. The video playback method obtains time information at the time of playback, and when playing back video and audio recorded from the recording medium, a time period indicated by the period information of the control information, and the time information at the time of playback obtained. By comparing with
It is determined whether or not the additional information should be output. When it is determined that the additional information should be output, the additional information is output.

[0011]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a video generating apparatus and a video reproducing apparatus according to the present invention. The video generation device according to the present embodiment includes main display information that is mainly displayed information such as video and audio, additional information such as a display message and an audio message that is additionally output to the main display information, Video and audio information is generated in association with control information including period information, which is information indicating a period for controlling output of information. The video reproducing apparatus according to the present embodiment is configured to store the main display information such as the video and audio information generated by the video generating apparatus, the additional information and the control information, When reproducing the display information, it also outputs additional information. At this time, the video playback device determines whether to output the additional information based on the period information included in the control information and the time information (date and time) at the time of playback. Here, the additional information is
It includes information such as characters, images, and audio that represent a message that conveys the validity of video and audio playback. The details will be described below.

<Configuration and Operation of Video Generating Apparatus> FIG. 1 is a schematic block diagram of a video generating apparatus according to the present embodiment. The video generation device includes an additional information setting unit 3 for setting additional information;
Control information setting unit 5 for setting control information for additional information
And a video / audio information generating unit 7 for adding additional information and control information of the additional information to main display information such as video and audio. The additional information setting unit 3 sets additional information such as a display message or a voice message that is output in addition to the main display information. The control information setting unit 5 sets control information including information on a period for controlling the output of the additional information and information indicating whether to output the additional information during the period or not. The details of the additional information and the control information of the additional information will be described later. The video / audio information generating unit 7 associates the main display information, the additional information set by the additional information setting unit 3 with the control information of the additional information set by the control information setting unit 5, and associates the video / audio information. Generate. As described above, the video generation device sets the control information for controlling whether or not to output the additional information with respect to the additional information. The video / audio information from the video generation device is reproduced by the video reproduction device after being recorded on a predetermined recording medium or after being carried and received by a broadcast wave, for example.

<Structure of Video Reproducing Apparatus> FIG. 2 is a schematic block diagram of a video reproducing apparatus according to the present embodiment. The video playback device reads out video / audio information recorded on a predetermined recording medium 9 such as a video tape and outputs the transported audio stream as a transport stream packet (hereinafter, referred to as a “TS packet”). Audio ES (audio elementary stream) from the TS packet from the unit 11;
A TS decoding unit 13 for generating a video ES (video elementary stream) and data, and a TS decoding unit 1
3, a video decoder 17 for decoding the audio ES from the TS decoder 13 to generate an audio signal, a video decoder 17 for decoding the video ES from the TS decoder 13 to generate a video signal, and data from the TS decoder 13. And an additional information output control unit 19 for analyzing the contents of the additional information and controlling the output of the additional information contained in the data.
9, an additional data generating unit 21 for generating additional data such as a display message and an audio message, and a video signal from the video decoding unit 17 and a video signal of the display message from the additional data generating unit 21 And an audio mixing unit 24 for mixing the audio signal from the audio decoding unit 15 and the audio signal of the audio message from the additional data generation unit 21. The video playback device further includes a clock 25 for giving date and time information, and a look-up table (LUT) 31 that is referred to when generating additional information.

<Operation of Video Reproducing Apparatus> FIG. 3 is a diagram illustrating an outline of the operation of the video reproducing apparatus according to the present embodiment. FIG.
In the recording medium 9, a video (video / audio information) that has been generated by the video generation device, broadcasted, and received at a certain time is recorded (recorded). Specifically, the recording medium 9 stores main display information 41 such as video and audio, additional information 43 that is information that is additionally output to the main display information 41, and output of the additional information 43. Is digitally encoded and recorded. At this time, the video recorded on the recording medium 9 is not limited to a broadcast video, but may be a video directly recorded by a video generation device. The additional information 43 includes characters and images (display messages) representing a message that conveys the validity of the main display information (video and audio) 41 when it is reproduced.
Or information such as voice (voice message) is included. In the video playback device of the present embodiment, when the main display information 41 such as the video and audio recorded on the recording medium 9 is reproduced, whether or not to output the additional information 43 is determined by the date and time of the reproduction,
This is performed based on the period information included in the control information 45 of the additional information. When it is determined that the additional information 43 should be output, the additional information 43 is output together with the main display information 41. In the present embodiment, the main display information 41 and the additional information 43 are received and recorded synchronously, but the additional information 43 may be received and recorded asynchronously with the main display information 41.

FIG. 4 is a diagram showing a data stream processed by the recording / reproducing unit 11 and the TS decoding unit 13. Hereinafter, the operation of the video reproducing apparatus will be described with reference to FIG. The recording / reproducing unit 11 reads the video / audio information from the recording medium 9 and outputs it as a TS packet. At this time, the recording / reproducing unit 11 sets the information regarding the video in the main display information 41 as the video TS packet 50, the information regarding the audio in the main display information 41 as the audio TS packet 52, the additional information 43 and the control information thereof. 45 is transmitted as a data TS packet 54. These TS packets are identified by a packet ID (PID). In the present embodiment, the packet ID (PID) is “k” for video,
“L” indicates voice, and “m” indicates data. The video TS packet 50 includes a header section 50h including information for control.
And a payload section 50p including video data.
Similarly, audio and data TS packets 52 and 54 also include a header portion and a payload portion.

The TS decoding unit 13 receives the TS packet from the recording / reproducing unit 11, identifies the type of the packet based on the packet ID, and generates a video or audio TS packet 5.
A video PES 60 or an audio PES 62 is created from 0 and 52 in units of 1 GOP (Group Of Pictures). In the present embodiment, the association between the main display information 41 and the additional information 43 is performed on a GOP basis, but may be performed using a time stamp for display or the like. Here, “PES” is a packetized elementary stream. Thereafter, the header part 60h is removed from the video PES 60, and the video ES 61 is taken out. Similarly, audio PES6
3 to extract the audio ES 63. The video ES 61 is sent to the video decoding unit 17, and the audio ES 63 is sent to the audio decoding unit 1.
5 is output. The header portion of the data TS packet 54 is removed, and the payload portion 54p is output to the additional information output control unit 19.

FIG. 5 shows the structure of the payload portion 54p of the data TS packet 54. As shown in the figure, the payload section 54p of the data TS packet 54 includes the additional information 43 and the control information 45 of the additional information. The control information 45 includes control start date and time information 45a indicating the start date and time of the period for controlling the output of the additional information 43, and control end date and time information 4 indicating the end date and time of the period for controlling the output of the additional information 43.
5b and an output enable / disable flag 45c indicating whether or not to output the additional information during the period of controlling the output of the additional information.
And are included. When the output permission flag 45c is “true”, the control start date / time information 45a and the control end date / time information 45b
This indicates that the additional information 43 is output only during the control period determined from the following. If the output permission flag 45c is “false”, it indicates that the additional information 43 is not output during the period of controlling the output, and that the additional information 43 is output during other periods.

The audio decoding unit 15 includes the TS decoding unit 1
3 is decoded into an audio signal.
The video decoding unit 17 decodes the video ES 61 received from the TS decoding unit 13 into a video signal.

Upon receiving the data from the TS decoding unit 13, the additional information output control unit 19 analyzes the control information 45 therein and determines whether or not to output the additional information 43.
FIG. 6 is a flowchart showing the processing of the additional information output control unit 19 at this time.

As shown in FIG. 6, the additional information output control unit 1
9 reads the control start date / time information 45a, the control end date / time information 45b, and the output availability flag 45c from the control information 45 included in the data from the TS decoding unit 13 (S
1). Thereafter, the date and time at that time (at the time of reproduction) is read from the clock 25 (S2). It is determined whether the date and time at the time of reproduction is later than the control start date and time indicated by the control start date and time information 45a (S
3). When the date and time at the time of reproduction is later than the start of control (YES at step S3), the date and time at the time of reproduction is the control end date and time information 4
It is determined whether it is before the control end date and time indicated by 5b (S
4). If the date and time at the time of reproduction is earlier than the control end date and time (YES in step S4), the output determination flag is set to "true" (S5). On the other hand, when the date and time at the time of reproduction is before the control start date and time (NO in step S3) or after the control end date and time (NO in step S4), the output determination flag is set to "false" (S9). . Here, when the output determination flag is "true", it means that the display message should be displayed, and when it is "false", it means that the message should not be displayed. After setting the output determination flag (steps S5 and S9), whether the output flag is "true"
That is, it is determined whether the additional information should be output during that period (S6). When the output possibility flag 45c is "true", the process proceeds to step S7. Output enable / disable flag 4
When 5c is "false", that is, when the additional information should not be output during that period, the value of the output determination flag is inverted (S10), and the process proceeds to step S7. In step S7, it is determined whether or not the output determination flag is "true". If the output determination flag is "true", the additional information 43 included in the data is output to the additional data creating unit 21 (S8), and the process ends. If the output determination flag is “false”, step S8
Skip and exit. That is, when the output determination flag is “false”, the additional information
Is not output.

As described above, the video reproducing apparatus of the present embodiment
At the time of reproducing the recorded video, it is determined whether or not to output (display or audio output) the additional information for the video by comparing the validity period defined by the control information with the date and time of the reproduction.

The additional data generator 21 creates and outputs additional data from the additional information sent from the additional information output controller 19. At this time, the additional information sent from the additional information output control unit 19 is the image data (display message).
, This data is converted into a video signal and output to the overlay unit 23. If the information sent from the additional information output control unit 19 is voice data (voice message), this data is converted into a voice signal. And outputs it to the audio mixing unit 24.

When the additional information is a display message, the additional information includes image data or character data of the message to be displayed. Additional data generator 2
When the additional information includes image data indicating a message to be displayed in the additional information, the image data is converted into a video signal. If character data is included in the additional information,
The additional information includes a predetermined code (JIS code or the like) indicating a character string, or an identification number (message ID) for specifying a message to be displayed. When the additional information includes an identification number (message ID), the additional data generation unit 21 creates a message corresponding to the message ID with reference to the lookup table 31 and converts the message into a video signal. . At this time, the look-up table 31 stores a fixed message corresponding to the message ID. FIG.
, The additional information may be a combination of a predetermined parameter and a message. In this case, the additional data generation unit 21 reads the data corresponding to the parameter with reference to the lookup table 31, and completes the display message. In FIG. 6, “% NA” in the message
The parameters such as “ME%” and “% DATE%” are replaced with the corresponding data with reference to the lookup table 31, and the display message 73 is created. At this time, “DATE”, “T” in the lookup table 31
The value of the data of "IME" is sequentially updated by the clock 25. By using the look-up table 31 in this manner, the amount of additional information and the time and effort when creating additional information can be reduced.

FIGS. 8B and 8C show the results of FIG.
7 shows a display example of additional information at the time of reproduction by the video reproduction device of the present embodiment when the additional information and control information indicated by are received. The additional information and control information shown in FIG.
0:00, April 1, 998 to 23, April 29, 1998
The additional information (“Note! This recruitment has been completed”) 68 is not displayed during the period until 19:00, and this additional information is displayed in other periods. FIG. 8B shows a display screen when the reproduction time is 12:30 on April 3, 1998. In this case, the additional information output control unit 19 does not display the additional information (display message). And only the main display information 66 is displayed. On the other hand, FIG. 8C shows that the time of reproduction is May 1, 1998.
The display screen at 12:30 on the day is shown. The additional information output control unit 19 determines that additional information is to be displayed, and the additional information 68 is displayed together with the main display information 66. By displaying the additional information 68 as shown in FIG. 8, the viewer can play back the main display information 68
Its effectiveness can be easily recognized.

Thereafter, when receiving the video signal from the additional data generation unit 21, the overlay unit 23 combines the video signal with the video signal from the code unit 17 and outputs the video signal.

On the other hand, when the additional information is a voice message, that is, the additional information includes MPEG audio, WAV
When audio data such as an E file is included, the additional data generation unit 21 decodes the audio data sent from the additional information output control unit 19 into an audio signal, and outputs the audio signal to the audio mixing unit 24. At this time, as in the case described above, the additional information may include a predetermined parameter for referring to the lookup table 31. For example, FIG.
As shown in the example shown in FIG. 7, the additional information 75 includes audio data 75b, 75f such as MPEG audio and WAVE files.
And data 75d for converting to an audio signal with reference to the lookup table 31 may be mixed. In this case, the additional data generation unit 21 outputs the audio flags 75a, 75
The voice data 75b and 75f are recognized by e, and the character data 75d is recognized as data to be converted into a voice signal by referring to the lookup table 31 by the LUT flag 75c. In this case, look-up table 3
1 stores data for speech synthesis. In the example shown in FIG. 9, synthetic voice data of voices that utter the numbers “1”, “2”, etc. are stored. That is, the content indicated by the character data 75d is the look-up table 3
After being converted to an audio signal with reference to 1, audio data ("number") 75b and audio data ("is")
75f, and a voice message (“number is 123
4) 77 is generated, converted into an audio signal, and output to the audio mixing unit 24.

Thereafter, when the audio mixing unit 24 receives the audio signal from the additional data generation unit 21, the audio mixing unit 24 mixes this audio signal with the audio signal from the audio decoding unit 15 and outputs it. At this time, the audio mixing unit 24
Alternatively, the audio input may be switched from the audio decoding unit 15 to the additional data generation unit 21 and only the audio signal from the additional data generation unit 21 may be output. The audio mixing unit 24 outputs only the audio signal from the audio decoding unit 15 when receiving no audio signal from the additional data generation unit 21.

As described above, the video reproducing apparatus according to the present embodiment includes main display information such as video and audio, additional information indicating the validity of the main display information at the time of reproduction, and control information of the additional information. When reproducing the main display information from the recording medium in which the video / audio information is recorded, the control includes whether or not to output the additional information, including the time (date and time) at the time of the reproduction and the output control period of the additional information. Determined based on information. Thus, the viewer can easily recognize whether the main display information displayed on the screen is valid or invalid based on the additional information, and the viewer is not confused.

In the above embodiment, when reproducing the recorded video or the like, whether or not the additional information can be output is determined based on the date and time at the time of reproduction. In addition, the date and time at the time of recording are recorded. In advance, it may be determined whether output is possible based on the date and time at the time of recording. Further, the additional information is not limited to information indicating the validity of the main display information at the time of reproduction, and may be other information that assists the main display information.

[0030]

According to the video generating apparatus and the video generating method of the present invention, additional information and control information of the additional information are added to the main display information. By referring to the control information of the additional information, the output period of the additional information can be controlled, and the desired additional information can be output at a desired time so as to prevent confusion of the viewer.

According to the video reproducing apparatus and the video reproducing method of the present invention, when reproducing the recorded main display information (video, audio, etc.), additional information indicating the validity of the main display information at the time of reproduction is output. Whether or not to do so is determined by judging from the date and time of the reproduction and the control information including the output control period of the additional information. Thus, the viewer can easily recognize whether the information displayed on the screen is valid or invalid, and does not get confused. Also, the additional information may include text, images, or audio information, and can convey the validity of the display information to the viewer in various ways. Also, a predetermined code,
By using the reference table in which a predetermined message is associated, it is possible to reduce the information amount of the additional information and the trouble in creating the additional information.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of a video generation device according to the present invention.

FIG. 2 is a schematic block diagram of a video playback device according to the present invention.

FIG. 3 is a view for explaining the concept of the operation of the video reproducing apparatus according to the present invention.

FIG. 4 is a view for explaining how video, audio, and data are extracted from a transport stream (TS).

FIG. 5 is a diagram showing a configuration of data obtained from a data packet.

FIG. 6 is a flowchart illustrating an operation of an additional information output control unit.

FIG. 7 is an exemplary view for explaining processing of an additional data creating unit when creating additional information with reference to a lookup table;

FIG. 8A shows an example of additional information and control information, and FIG.
An example when the display of the additional information is stopped, and (c) an example when the additional information is displayed together with the main display information.

FIG. 9 is a view for explaining processing of an additional data creation unit when audio information is included in the additional information.

[Explanation of symbols]

 3 additional information setting section 5 control information setting section 7 video / audio information generating section 9 recording medium 11 recording / reproducing section 13 TS decoding section 15 audio decoding section 17 video decoding section 19 additional information control section 21 display data generating section 23 overlay section 24 audio Mixing unit 25 Clock 41 Main display information 43 Additional information 45 Control information of additional information.

Continuing on the front page (72) Inventor Kenjiro Tsuda 1006 Kazuma Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd. Inventor Yoshimori Nakase 1006 Kazuma, Kazuma, Kazuma, Osaka, Japan Matsushita Electric Industrial Co., Ltd. Matsushita Electric Industrial Co., Ltd. (72) Inventor Tetsuya Imamura 1006 Oji Kadoma, Osaka Prefecture

Claims (6)

[Claims] 1. main display information including video and audio information;
In a video generation apparatus for generating video and audio information from additional information added to and output from the main display information, a period setting means for setting period information indicating a period during which the additional information should be output or a period during which the additional information should not be output And an information generating unit for adding control information including the period information set by the period setting unit to the video and audio information. 2. main display information including video and audio information;
From the recording medium on which the additional information output in addition to the main display information and control information including period information indicating a period during which the additional information is to be output or a period during which the additional information is not to be output are recorded, In a video playback device that plays back video and audio, a clock unit that outputs time information at the time of playback, and when playing back video and audio recorded from the recording medium, a period indicated by the period information of the control information; By comparing with the time information at the time of reproduction by the clock means,
Determining whether or not the additional information should be output, and additional information control means for outputting the additional information when determining that the additional information should be output. Playback device. 3. The video reproducing apparatus according to claim 2, wherein the additional information includes characters, images, or audio information. 4. The video playback device according to claim 2, further comprising: a reference table in which a predetermined code and a predetermined message are associated with each other; wherein the additional information includes at least one of the predetermined code; The video reproducing apparatus, wherein the additional information control means outputs a message corresponding to a predetermined code included in the additional information with reference to the reference table. 5. The main display information including video and audio information includes:
In a video generation method for generating video / audio information from additional information added to and output from the main display information, setting period information indicating a period during which the additional information is to be output or a period during which the additional information is not to be output; A video generation method, characterized in that the generated period information is added to the video / audio information as control information. 6. main display information including video and audio information, additional information added to the main display information and output,
A video reproducing method for reproducing the recorded video and audio from a recording medium on which control information including period information indicating a period during which the additional information is to be output or a period during which the additional information is not to be output is provided. Acquiring information, and reproducing the video and audio recorded from the recording medium, by comparing the period indicated by the period information of the control information with the acquired time information at the time of reproduction, the additional information is obtained. A video reproducing method, comprising: judging whether or not to output, and, when judging to output the additional information, outputting the additional information.