JP2001298675A - Device and method for processing information and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To permit a user to easily know information concerning video data. SOLUTION: A system controller 151 obtains program information corresponding to a program. An OSD circuit 128 synthesizes program information corresponding to the program with video data of the program. An input change-over switch 118 selects one of video data of the program where program information is synthesized and video data of the program where program information is not synthesized. An MPEG video encoder 119 encodes video data of the program which is selected by the input switch 118.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an information processing apparatus and method, and a recording medium, and more particularly to an information processing apparatus and method for combining characters or images corresponding to a program with a video of the program, and a recording medium.

[0002]

2. Description of the Related Art In recent years, in the United States and European countries, MPEG
(Moving Picture Image Coding Experts Group) and other high-efficiency coding technologies are applied to encode and distribute video and audio signals via communication satellites and the like, and demodulate them on the receiving side. is there.

In these systems, a dedicated receiving / demodulating device is required on the receiving side. In this reception / demodulation device, a portion for selecting a transport stream of a desired channel from a transport stream in which data of a plurality of channels is multiplexed, and a portion in which a desired program is encoded from the transport stream of a desired channel. A portion that separates video data (hereinafter, referred to as coded video data) and coded audio data (hereinafter, referred to as coded voice data), based on the separated coded video data and coded voice data. And a part for decoding into band data or an analog signal.

In this system, a receiving / demodulating device is required to receive a transport stream of a desired channel and to separate coded video data and coded audio data of a desired program. PSI (P
rogram Spesific Information: Program specification information)
And EPG (Electronic Program Guide)
Alternatively, SI (Service Information) is added.

FIG. 1 is a diagram showing a configuration of a conventional recording / reproducing apparatus for recording or reproducing an MPEG transport stream.

The antenna 1 receives a radio wave transmitted from a broadcasting satellite or a communication satellite (not shown), down-converts the received radio wave to generate an RF signal, and converts the RF signal into an IR signal.
D (Integrated Receiver and Decoder) (also referred to as set-top box) 2.

The IRD 2 includes a tuner 11, a demultiplexer 12, an MPEG AV (Audio Video) decoder 13, a reference clock reproducing circuit 14, and a digital interface 15. The RF signal supplied from the antenna 1 is input to the tuner 11.

The tuner 11 has a receiving unit and a QPSK (Quadratu
rePhase Shift Keying), which is composed of a demodulator and an error correction circuit, and converts a transport stream of a desired channel designated by a user from a front panel (not shown) from a multiplexed transport stream of a plurality of channels. Select and perform QPSK demodulation, and further detect and correct errors. The tuner 11 outputs the MPEG transport stream to the demultiplexer 12 and the digital interface 15.

The data of each program has a predetermined length (18
8 bytes) and has a header at the beginning. The header is provided with a PID (Packet Identification) for identifying data.

[0010] The demultiplexer 12 is configured to transmit a predetermined one of packets (transport packets) constituting the MPEG transport stream supplied from the tuner 11.
Extract and separate the ones corresponding to the channels, MPEGAV
Output to the decoder 13 and the reference clock recovery circuit 14.

At the time of this separation, the demultiplexer 12 looks at the PID (packet ID) assigned to the packet. Then, if the PID indicates the encoded video data and the encoded audio data of the desired program, the demultiplexer 12 sends the PID to the MPEGAV decoder 13, respectively.

A reference clock recovery circuit 14 generates a reference clock based on the data stored in the transport packet supplied from the demultiplexer 12, and
It is supplied to the AV decoder 13.

[0013] The MPEGAV decoder 13 uses the reference clock supplied from the reference clock recovery circuit 14 to output the MPMP included in the packet supplied from the demultiplexer 12.
The coded video data and the coded audio data are decoded by the EG method, and the resulting analog video and audio signals are output to the monitor 3.

The demultiplexer 12 extracts a transport packet corresponding to a predetermined channel from transport packets constituting the MPEG transport stream supplied from the tuner 11, and supplies the transport packet to the digital interface 15. Or the demultiplexer 12
Extracts, from the transport packets constituting the MPEG transport stream supplied from the tuner 11, those corresponding to a plurality of channels and supplies them to the digital interface 15.

The digital interface 15 is an IEEE
(Institute of Electrical and Electronics Engineer
s) An interface for performing communication conforming to the 1394 standard. Digital interface 15 is IEEE
It is connected to an HDD (Hard Disk Drive) 4 via a serial bus (IEEE1394 serial bus) conforming to the 1394 standard.

The HDD 4 adds a time stamp as timing information corresponding to the time at which the transport packet was input to the HDD 4 to the transport packet input via the IEEE1394 serial bus, and added the time stamp. Record the packet on the internal hard disk. The HDD 4 temporarily stores the transport packet to which the time stamp is added in a buffer memory (not shown), converts the transport packet into a temporally continuous packet, and records the packet on the hard disk.

When reproducing the packet recorded on the HDD 4, the HDD 4 sequentially reads out the packet recorded on the hard disk, and transmits the packet based on the time stamp added to the packet (transmission timing). Time interval), and adjust it via a serial bus (IEEE1394 serial bus) compliant with the IEEE1394 standard.
Each packet is output to IRD2. The packet whose timing has been adjusted is supplied from the HDD 4 to the IRD 2 in accordance with the timing supplied from the IRD 2 to the HDD 4, so that the IRD 2 does not overflow or underflow the buffer for temporarily storing the packet. , The image signal can be reproduced and output to the monitor 3.

As described above, the transport stream of the digital broadcast can be received, decoded, and displayed on the monitor device.

Next, the additional information of the transport stream will be described. As described above, PSI (program usage information) and EPG are included in the multiplexed bit stream.
(Electronic program guide) or SI (service information) is added. Here, PSI defined by MPEG and DVB (Digital Video Broadcast)
ing) The SI specified in the system will be described.

The PAT (Programme Association Table)
It is defined by MPEG, and the PID (packet ID) is 0. The main contents are the PID of the NIT and the PMT of the PMT described later.
This is a description of the ID.

A PMT (Programme Map Table) is defined by MPEG, and a PID is determined by the above-described PAT. The main contents are a description of a correspondence between a program number and a PID, and a description of a PID of an ECM (scramble data attached to a program).

CAT (Conditional Access Table) is MPE
It is defined by G, and PID is 1. The main content is a description of EMM (scramble information for customers).

PID of NIT (Network Information Table)
Is 0010. The main contents of the NIT are a description of a network name (satellite name, terrestrial transmission station, etc.) and a description of a modulation method and a frequency for each transport stream (physical channel).

The following table is specified in DVB.

PID of BAT (Bouquet Association Table)
Is 0011. The main contents of BAT are the description of the name of Bouquet (program supplier) and the destination country, and the contents of services related to transport streams (physical channels) and CASS (Conditional Access Service S).
ystem) method.

PID of SDT (Service Description Table)
Is 0011. The main content of the SDT is a description of a transport stream (physical channel) such as a service ID included in the transport stream and a name of a bouquet thereof. Here, the service ID is NHK satellite first, NHK
This refers to a broadcast channel such as a satellite second. That is,
This is the same as the program number specified in MPEG.

The PID of the EIT (Event Information Table) is 0012. The main content of EIT is Event I
This is a description of D and its start time, broadcast time, program contents, and the like. Then, a transport stream ID and a service ID are described for each event ID. Here, the event is, for example, a program such as “News at 7:00 (broadcast on December 1)”.

The ID of TDT (Time and Data Table) is 001
0. The main content of TDT is the description of information in Coordinated Universal Time. Using the TDT, the time of a clock (not shown) in the device can be adjusted.

The PID of the RST (Running Status Table) is 00
Thirteen. The main content of the RST is a description of the event execution status. That is, a description such as before the start, execution, or end of a certain event is made.

Next, how the IRD 2 processes the PSI and SI described above will be described.

First, the IRD 2 sets constants and the like in accordance with the system of each network. Since this information is described in the NIT, a modulation scheme, a frequency, a bit rate, an error correction scheme, and the like can be obtained for each transport stream. After the setting, these information are stored in the EEPROM (not shown) of the IRD2.

Next, an event search is performed using the EIT. Each broadcast event has a unique event ID,
The name and contents of the broadcast program are described in the EIT together with the start time, and the transport stream ID and the service ID are described for each event. Therefore, the transport stream ID is determined from the EIT, the digital signal processing device is set using the transport stream constant obtained in the NIT, and the transport stream of the desired channel is selected.

Next, the output of the demultiplexer 12 is
The processing of the IRD 2 when transmitting to the decoder 13 will be described.

First, the IRD 2 writes the output of the tuner 11 into the buffer memory inside the demultiplexer 12.
In the buffer memory, since a storage area is defined for each data, writing is performed in each area.

Next, the IRD 2 searches for a PAT from the additional information written in the additional information area of the buffer memory. In this process, a packet whose PID is 0 may be searched for. The PAT describes the PID of the PMT for each program.

Then, next, a packet whose PID has a predetermined value is searched for. As a result, a PMT corresponding to a desired program number can be detected. The PMT describes MPEG encoded video data, MPEG encoded audio data, and ECM PID of a desired program number.

Therefore, when watching a broadcast of a desired program number, the IRD 2 reads a packet having a PID corresponding to the desired program number from the buffer memory and sends it to the MPEGAV decoder 13 through the demultiplexer 12. At this time, only the data excluding the header is sent.

[0038] The IRD 2 decodes scramble using ECM information described in a packet having a PID in which another predetermined value is set.

The IRD 2 in FIG. 1 further includes encoded video data, encoded audio data,
The additional information can be output to an external recording / reproducing device, for example, the HDD 4 via the digital interface 15. The multiplexed video data, the coded audio data, and the additional information output from the external recording / reproducing device are received via the digital interface 15 and the demultiplexer 12
Can be sent to Next, these processes will be described.

First, a process for transmitting the output of the demultiplexer 12 from the digital interface 15 to the outside will be described. Since most of this processing is the same as the above-described normal processing, only different points will be described.

The IRD 2 sends the encoded video data and the encoded audio data to the digital interface 15 with the packet header attached. That is, the demultiplexer 12
Is read from the buffer memory together with the header, and sent to the digital interface 15 through the demultiplexer 12.

The PSI and SI are also sent to the digital interface 15 with the header attached. However, the PAT leaves only the PID specifying the PMT of the selected program number, and removes the others.

Thus, the digital interface 1
The data sent to 5 is sent out from here. The digital interface 15 is based on IEEE1394. In this case, the data is stored and output in an IEEE1394 isochronous packet. The isochronous packet output from the digital interface 15 is sent to an external HDD 4 or the like. Then, data is extracted from the isochronous packet, an error correction code in a recording system is added, and the data is subjected to channel coding processing and then recorded.

The packet for the isochronous communication includes a packet header, a header CRC, a data field, and a data CRC.

Further, the packet header includes Data_length indicating the data length, Tag indicating the type of format of the data transmitted in the packet, Channel indicating the channel number (any of 0 to 63) of the packet, and processing code. And a synchronization code Sy defined by each application.

The header CRC (Header_CRC) is an error detection code of the packet header and includes a data CRC (Data_CRC).
Is an error detection code for a data field. The data field is composed of a CIP header and real-time data. Among them, the real-time data is the original data to be transmitted.

The CIP header has a transmission node number SID, a packetization unit DBS, and the number of data divisions F in packetization.
N, the number of quadlets added to adjust the data length to a predetermined fixed length at the time of division (one quadlet is 4 bytes), QPC, flag SPH in the header of the source packet,
It consists of a counter DBC for detecting packet loss, a signal format FMT, and a format-dependent field FDF.

The command and response packets of the asynchronous communication are composed of a packet header and a data block. The packet header identifies the destination
destination_ID is placed, followed by tl (Transaction Label) indicating the label of the process, and rt indicating retry playback
(Retry Code) and tcode (Tran
saction Code) and pri (Priority). Next, source_ID indicating the transfer destination is recorded, and next to this, destination_offset indicating the lower 48 bits of the address of the transfer destination is arranged.

Next, data_l representing the data length is used.
extended_tc for ength and other processing codes
ode is arranged, and finally, header_CRC which is an error detection code in the header is arranged.

Data blocks are CTS, CT / RC, HA, OP
C, OPR, and data_CRC, which is an error detection code in data. When a command is transferred, 0 is placed in CTS, and a code indicating the type of request is placed as CT / RC. In the HA, an ID of a destination in the device is arranged. Commands to be transferred are arranged in OPC, and parameters are arranged in OPR.

When transmitting a response, the CT
0 is placed in S, and a code indicating the type of reply is placed in CT / RC. In the HA, the ID of the sender in the device is placed, and the OP
In C, the code of the processed command is placed. In addition, parameters are arranged in the OPR.

As described above, the digital interface 15 performs isochronous communication and asynchronous communication, transmits data using isochronous communication, and performs command and response communication using asynchronous communication.

In the isochronous communication, one of the AV devices connected by a bus is set as a route, and this route transmits a cycle start packet at the first timing of one cycle of 125 μs. Each AV device that performs isochronous communication is assigned a specific time zone in each cycle,
At the timing of the assignment, data is transmitted with a predetermined channel number. As described above, in isochronous communication, communication is performed at fixed time intervals.

Next, a process for sending an external input from the digital interface 15 to the demultiplexer 12 will be described. From the isochronous packet input to the digital interface 15 from the outside, the original coded video data, coded audio data, and additional information are extracted here and written into the buffer memory inside the demultiplexer 12.

The processing of the encoded video data and the encoded audio data written in the buffer memory is the same as the processing of these data in the transport stream input from the tuner 11 described above. On the other hand, the PSI and SI written in the buffer memory are processed as follows.

The PAT and PMT are used as they are. As described above, when outputting data from IRD2 to external HDD4,
Since only the PID designating the PMT of the program number selected from the PAT is left and the others are removed, the external HDD 4
In the PAT in the data input from, only the PID designating the PMT of the program number being input is described. Therefore, the PMT is searched for by looking at the PAT, and the coded video data and coded audio data of the program being input can be read out by looking at the PMT. The read encoded video data and encoded audio data pass through the demultiplexer 12 and
The data is sent to the EGAV decoder 13 and thereafter processed similarly to these data from the tuner 11.

Regarding the EIT, the actual and present (pr.) Of the program described in the PAT
esent), and ignore others. Here, “actual” means that it is a transport stream of the selected channel, and “present” means that the selected program is currently being broadcast.

As for the RST, only those relating to the program described in the PAT are decoded, and the others are ignored. As for SDT, only the actual one of the program described in PAT is decoded, and the others are ignored.

The NIT is necessary for setting in the tuner 11, but is not required in the demultiplexer 12, and is ignored. BAT is also ignored.

Regarding the TDT, when a reproduction signal from an external recording / reproduction device is input, the TDT in the reproduction signal from the recording / reproduction device indicates the time at the time of recording and indicates the current time. Therefore, ignore this TDT.

[0061]

SUMMARY OF THE INVENTION However, IRD2
And the HDD 4 have a function of displaying common program information or a function of displaying an operating state corresponding to each other (for example, transmitting data indicating that the HDD 4 is performing slow reproduction, and receiving the data by the IRD 2 to the monitor 3). Display, etc.)
The user who is watching the video on the monitor 3 receives the information on the video supplied from the HDD 4 (program name, recording date, performer, etc.), or the operation state of the HDD 4 (for example,
Slow playback, double speed playback, etc.).

The present invention has been made in view of such circumstances, and has as its object to enable a user to easily know information on video data.

[0063]

According to a first aspect of the present invention, there is provided an information processing apparatus, comprising: an acquisition unit for acquiring second video data corresponding to first video data; a second video data; A synthesizing unit for synthesizing the video data, and one of the first video data in which the second video data is synthesized by the synthesizing unit and the first video data in which the second video data is not synthesized. It is characterized by including a selecting means and an encoding means for encoding the first video data selected by the selecting means.

[0064] The information processing apparatus may further include recording means for recording the first video data encoded by the encoding means.

[0065] The information processing apparatus may further include transmitting means for transmitting the first video data encoded by the encoding means to another apparatus.

According to a fourth aspect of the present invention, in the information processing method, an obtaining step of obtaining second video data corresponding to the first video data, and synthesizing the second video data and the first video data. In the combining step and the processing in the combining step, the second
The first video data synthesized with the first video data and the second video data
A selecting step of selecting any one of the first video data in which the first video data is not synthesized, and an encoding step of encoding the first video data selected in the processing of the selecting step. And

According to a fifth aspect of the present invention, there is provided a program for recording a recording medium, comprising: an acquiring step of acquiring second video data corresponding to first video data; And a selecting step of selecting one of the first video data in which the second video data is synthesized in the processing of the synthesizing step and the first video data in which the second video data is not synthesized. And an encoding step of encoding the first video data selected in the processing of the selection step.

According to a sixth aspect of the present invention, there is provided an information processing apparatus comprising: a first acquisition unit for acquiring encoded first video data; and a first video data acquired by the first acquisition unit. Decoding means, second acquisition means for acquiring second video data corresponding to the first video data, second video data acquired by the second acquisition means, and decoded first video data. Synthesizing means for synthesizing the video data, encoding means for encoding the first video data in which the second video data has been synthesized by the synthesizing means, first video data encoded by the encoding means, And selecting and outputting means for selectively outputting any one of the encoded first video data obtained by the first obtaining means and not synthesized with the second video data. I do.

[0069] The information processing apparatus further includes holding means for holding the encoded first video data, and the first obtaining means obtains the first video data held by the holding means. You can make it.

[0070] The information processing apparatus further includes a receiving means for receiving the encoded first video data, and the first obtaining means obtains the first video data received by the receiving means. be able to.

The information processing apparatus may further include recording means for recording the first video data selected and output by the selection output means.

[0072] The information processing apparatus may further include transmitting means for transmitting the first video data selected and output by the selection output means to another apparatus.

[0073] In the information processing method according to the eleventh aspect, a first acquisition step of acquiring encoded first video data and a first acquisition step acquired in the processing of the first acquisition step.
A decoding step of decoding the second video data corresponding to the first video data, a second obtaining step of obtaining the second video data corresponding to the first video data, and a second video data obtained by the processing of the second obtaining step. A combining step of combining the decoded first video data, a coding step of coding the first video data combined with the second video data in the processing of the combining step, and a processing of the coding step One of the first video data encoded in the first and the encoded first video data obtained by the processing of the first obtaining step and not synthesized with the second video data. And a selecting output step of selecting and outputting.

According to a twelfth aspect of the present invention, there is provided a program for a recording medium, comprising:
A decoding step of decoding the first video data obtained in the processing of the first obtaining step;
Acquiring the second video data corresponding to the first video data, combining the second video data acquired in the processing of the second acquisition step, and the decoded first video data. Synthesizing step, an encoding step of encoding the first video data obtained by synthesizing the second video data in the processing of the synthesizing step, first video data encoded in the processing of the encoding step, and Selecting and outputting any one of the encoded first video data not synthesized with the second video data obtained in the processing of the first obtaining step. And

The information processing apparatus according to claim 1, and claim 4
In the information processing method described in the above, and the recording medium described in the claim 5, the second video data corresponding to the first video data is obtained, and the second video data and the first video data are The first image is synthesized and the second video data is synthesized.
, And one of the first video data in which the second video data is not synthesized is selected, and the selected first video data is encoded.

An information processing apparatus according to claim 6, claim 1
In the information processing method according to claim 1 and the recording medium according to claim 12, encoded first video data is acquired, and the acquired first video data is decoded.
The second video data corresponding to the first video data is acquired, the acquired second video data is combined with the decoded first video data, and the second video data is combined with the second video data. One of the first video data in which the first video data is encoded and the encoded first video data and the obtained first video data in which the second video data is not synthesized are encoded. Selected output.

[0077]

FIG. 2 is a diagram showing an embodiment of a video recording / reproducing system according to the present invention. AVHDD31
Based on an RF (Radio Frequency) signal corresponding to a terrestrial wave supplied from an antenna (not shown), encoded video data (hereinafter, referred to as encoded video data) or encoded audio data (hereinafter, referred to as encoded video data). (Referred to as coded audio data), and the generated coded video data and coded audio data are multiplexed and recorded, or via an AV bus such as a bus compliant with a standard such as IEEE 1394 or the like, It records encoded video data and encoded audio data supplied from a DVCR (Digital Video Cassette Recorder) 34 or the like.

The AVHDD 31 encodes an input analog video signal (hereinafter, referred to as an analog video signal) to generate coded video data, and also receives an input analog audio signal (hereinafter, referred to as an analog audio signal). To generate encoded audio data, and multiplex and record the generated encoded video data and encoded audio data.

The AVHDD 31 decodes the coded video data supplied from the IRD 32 or DVCR 34, and outputs an analog video signal and an analog audio signal.

The AVHDD 31 converts the recorded encoded video data and encoded audio data into IRD data via the AV bus.
32 or DVCR 34.

The AVHDD 31 is an IRD 32 or a DVC via an AV bus, or image data consisting of characters or video corresponding to program information such as PSI, EPG, or SI.
Image data consisting of characters or video corresponding to the command supplied from R34 is generated.

The AVHDD 31 records, for example, image data generated as program information and component digital data (hereinafter referred to as video data) obtained by decoding recorded encoded video data. The image corresponding to the coded video data is used as the background, and the image corresponding to the program information is displayed on the front side (the user can see all the images corresponding to the program information).

The AVHDD 31 similarly stores image data consisting of characters or images corresponding to program information and the like, video data corresponding to terrestrial waves, or IRD 32 or DVCR 3.
4 is combined with the video data obtained by decoding the encoded video data supplied from 4.

The AVHDD 31 encodes video data obtained by synthesizing an image composed of characters or video corresponding to program information and the like, multiplexes the coded video data with the coded audio data, and multiplexes the multiplexed data. Record or AV
The multiplexed data is transferred to the IRD32 or DVC via the bus.
Supply to R34.

The IRD 32 receives an electric wave transmitted from a broadcasting satellite or a communication satellite (not shown) and demodulates an RF signal supplied from another antenna (not shown) to generate an analog video signal and an analog audio signal. Or, supplied from the AVHDD 31 or DVCR 34 via the AV bus,
The encoded video data is decoded to generate an analog video signal, and the encoded audio data is decoded to generate an analog audio signal, which is supplied to the monitor 33.

The IRD 32 demodulates an RF signal supplied from another antenna (not shown), and transmits the coded video data and coded audio data obtained by the demodulation via the AV bus.
It is supplied to the AVHDD 31 or DVCR.

The monitor 33 displays an image on the basis of the analog video signal supplied from the IRD 32,
The audio is output based on the analog audio signal supplied from the X. 32.

The DVCR 34 is connected to the AVHDD 31 via the AV bus.
Alternatively, the encoded video data or the encoded audio data supplied from the IRD 32 is recorded on the attached digital video cassette, and the encoded video data or the encoded audio data is read from the attached digital video cassette. Or it outputs to IRD32.

FIG. 3 is a diagram showing an example of the configuration of the AVHDD 31.

The terrestrial tuner 111 of the AVHDD 31 receives a terrestrial wave from a broadcasting station (not shown), demodulates an analog video signal and an analog audio signal, respectively, and switches the demodulated analog video signal and analog audio signal to an input switch. 11
Output to 2.

The input switch 112 includes a terrestrial tuner 1
11, NTSC (National Televis
Not only are analog video signals and analog audio signals of the ion system committee) input, but also composite video signals and analog audio signals, which are external analog video signals, are input. Based on a command from the system controller 151, the input switch 112 selects one of an analog video signal and an analog audio signal from the terrestrial tuner 111 and a composite video signal and an analog audio signal that are analog video signals from the outside. Select one of them and convert the selected analog video signal to YC
(Brightness signal and chrominance signal) Output to the separator 113 and output the selected analog audio signal to the audio A / D (Analog / Digital) converter 120.

The YC separator 113 separates the analog video signal input from the input switch 112 into a luminance signal and a chrominance signal, and outputs each to the input switch 114. The input switch 114 receives an external S video signal in addition to the analog video signal (luminance signal and color signal) input from the YC separator 113. The input switch 114 selects one of the analog video signal from the YC separator 113 and the S video signal based on a command from the system controller 151, and converts the selected signal into a video A / D converter. Output to 115.

The video A / D converter 115 performs A / D conversion processing, chroma encoding processing, and the like on the input analog video signal (separated into a luminance signal and a chrominance signal), and converts the analog video signal into video data. And the pre-video signal processing unit 1
17 is output. The video A / D converter 115 also generates a clock generated based on a horizontal synchronization signal of the input analog video signal, a horizontal synchronization signal of the input analog video signal, a vertical synchronization signal, and a synchronization signal such as a field determination signal. The control signal is supplied to the synchronization control circuit 116. The synchronization control circuit 116 generates various clock signals and synchronization signals based on the clock supplied from the video A / D converter 115 and the synchronization control signals, and outputs them to necessary parts as appropriate.

The pre-video signal processing unit 117 performs a pre-filter process or the like on the input video data, and
18 and the post video signal processing unit 127.

The input switch 118 controls the video data supplied from the pre-video signal processing unit 117 and the OSD (On Screen
en Display) circuit 128 to select one of the video data supplied from the
ving Picture Experts Group) Video Encoder 119
To supply.

[0096] The MPEG video encoder 119 adds the block DCT (Dis-
Performs MPEG video encoding processing such as crete Cosine Transform (discrete cosine transform) encoding processing to generate an ES (Elementary Stream) (hereinafter referred to as video ES) composed of encoded video data, and generates the generated video ES. Output to the demultiplexing circuit 123.

In this example, the MPEG system is used as the video data encoding system. However, another video compression system may be used or uncompressed.

The audio A / D converter 120 is connected to the input switch 11
2 is converted into so-called linear PCM (Pulse Code Modulation) audio data (hereinafter referred to as
(Hereinafter simply referred to as audio data), and the input switch 121
And to the switch 130.

The input switch 121 is used for the audio A / D converter 12
Audio data supplied from 0, and MPEGAV decoder 1
26, and selects one of the audio data supplied from the MPEG audio encoder 1
22.

The MPEG audio encoder 122 outputs the audio
After converting the audio data input from the A / D converter 120 into encoded audio data of the MPEG system, the encoded audio data
An ES (audio ES) is generated, and the generated audio ES is output to the demultiplexing circuit 123.

The compression method of audio data may be other than MPEG, or may be uncompressed.

The demultiplexing circuit 123 converts the encoded video data and the encoded audio data into an HDD (Hard Disk Drive) 12
5, the video ES input from the MPEG video encoder 119 and the MPEG audio encoder 122 based on the control signal supplied from the synchronization control circuit 116.
Multiplexes the audio ES input from the
Stream) is generated and output to the buffer control unit 124.

The multiplexing / demultiplexing circuit 123 includes an HDD 125
When reading the encoded video data and the encoded audio data recorded in the TS, a PES (Packetized Elementary Stream) is extracted from the TS supplied from the buffer control unit 124, and the extracted PES is output to an MPEGAV (Audio / Visual) decoder. 126 or the buffer controller 124
Is supplied to the digital interface 132.

When recording the coded video data and the coded audio data in the HDD 125, the buffer control unit 124 converts the TS input from the demultiplexing circuit 123 into the HDD 125.
The buffer is controlled so that it can be supplied intermittently. That is, for example, when the HDD 125 is performing a seek operation, the buffer control unit 124 cannot temporarily write the TS to the HDD 125, and thus temporarily stores the TS in the buffer. At a rate higher than the rate input from the separation circuit 123, the HDD
A buffer control such as writing the data into the buffer 125 is executed.
When reading the encoded video data and the encoded audio data recorded in the HDD 125, the buffer control unit 124 can output the data intermittently input from the HDD 125 to the demultiplexing circuit 123 as continuous data. Control the buffer as follows.

The HDD 125 is connected to the system controller 15
1 and supplied from the buffer control unit 124
Is recorded at a predetermined address. The HDD 125 uses IDE (Integrated Drive Electronics) as a protocol.
It uses SCSI (Small Computer Sys
tem Interface) may be used.

Further, in this example, the HDD 125 is used as a recording medium for recording video data. However, for example, an optical disk, a magneto-optical disk, a solid-state memory, or the like may be used.

[0107] The MPEG decoder 126
The PES supplied from 3 is separated into video ES and audio ES,
A video MPEG decoding process is performed on the separated video ES to generate video data. The MPEG decoder 126 performs audio MPEG decoding processing on the separated audio ES to generate audio data. The MPEG decoder 126 outputs the generated video data to the post video signal processing unit 127 and outputs the audio data to the switch 130 and the input switch 121, respectively.

The post video signal processing section 127 switches between the video data input from the MPEG AV decoder 126 and the video data input from the pre video signal processing section 117 based on a command from the system controller 151. After that, a motion detection process is executed, a video signal interpolation process is performed based on the result, and the result is output to the OSD circuit 128.

The OSD circuit 128 generates image data consisting of characters or video corresponding to program information such as PSI, EPG, or SI, and generates the generated image data into the video input from the post video signal processing unit 127. For the data,
The combined video data is synthesized so that the whole is superimposed, or the video data is synthesized so that characters corresponding to program information etc. are partially displayed. Output to the video D / A converter 129 and the input switch 118.

The OSD circuit 128 is connected to the interface 15
6, image data supplied from the system controller 151 (for example, image data corresponding to a user's operation on the input unit 155) may be combined with video data.

The OSD circuit 128 may convert the image data to be combined with the video data into image frame conversion, enlargement processing, reduction processing, or multi-screen display. You may make it synthesize | combine.

FIG. 4 is a diagram showing an example of an image composed of characters or video corresponding to program information and the like. Program information,
For example, it is composed of a program name, a statement explaining the contents of the program, a program length, and the like.

The video D / A converter 129 converts the video data input from the OSD circuit 128 into a YC signal, and converts the video data into a D / A (Digit
al / Analog) After performing the conversion process, an analog video signal is generated and output, and an S video signal is generated and output.

The switching unit 130 includes an MPEG AV decoder 126,
Alternatively, one of the audio data supplied from the audio A / D converter 120 is selected based on a command from the system controller 151, and the selected audio data is selected as the audio data.
Output to the D / A converter 131. The audio D / A converter 131
The input audio data is converted into an analog audio signal and output.

The digital interface 132 is connected to an IRD via an AV bus such as an IEEE1394 serial bus.
The format conversion of the TS supplied from the DVCR 32 or the DVCR 34 and output to the demultiplexing circuit 123, and the conversion of the data such as the TS input from the demultiplexing circuit 123 into a format compatible with the AV bus, and the IRD 32 or the DVCR
34. In this example, the IRD 32 or the DVCR 34 was connected to the AVHDD 31 as an external device.
A television receiver or another AV (Audio / Visual) device may be connected to the AVHDD 31.

The digital interface 132 supplies a command received from the IRD 32 or DVCR 34 via the AV bus to the system controller 151 via the host bus 152.

The system controller 151 sends an MPEG video encoder 119 via the interface 156.
And a control signal for controlling the encoding rate to the MPEG audio encoder 122 or the image data corresponding to the operation of the input unit 155 to the OSD circuit 12.
8 to control the overall operation of the AVHDD 31.

The system controller 151 sends a ROM (Read Only Memory) 1 via the host bus 152.
The basic program stored in the RAM 53 is stored in the RAM (Ran
dom-Access Memory) 154 and executes it. The operating system (Operating System) recorded on the HDD 125
m) and execute various processes. Further, the system controller 151 appropriately stores programs recorded on the magnetic disk 201, the optical disk 202, the magneto-optical disk 203, or the semiconductor memory 204 mounted on the drive 157 in the RAM 154.
Read and execute.

System controller 151, ROM 15
3, RAM 154, input unit 155, interface 15
6 and the drive 157 are interconnected via a host bus 152.

Next, the process of adding an image corresponding to the program information to the video included in the TS supplied from the IRD 32 and recording it by the AVHDD 31 will be described with reference to the flowchart of FIG. In step S11, the OSD circuit 128
Acquires program information from the system controller 151.

In step S12, the digital interface 132 of the AVHDD 31 receives the transport packet constituting the TS supplied from the IRD 32,
The received transport packet is demultiplexed by the demultiplexing circuit 123.
To supply. The demultiplexing circuit 123 extracts the PES from the transport packet and supplies the extracted PES to the MPEGAV decoder 126. In step S13, the MPEGAV decoder 12
6 decodes the encoded video data included in the PES into video data. The MPEGAV decoder 126 supplies video data to the OSD circuit 128 via the post video signal processing section 127.

In step S14, the OSD circuit 128
Synthesizes the image of the program information with the video data, and outputs the synthesized video to the MPEG video encoder 119 via the input switch 118. The OSD circuit 128 may change the shape of a character (so-called font) included in the image of the program information according to the setting of the user.

In step S15, the MPEG video encoder 119 encodes the video data obtained by synthesizing the image of the program information supplied from the OSD circuit 128 via the input switch 118 to generate encoded video data. . At step S16, the HDD 125
The encoded video data (multiplexed with the encoded audio data to form a TS) supplied from the MPEG video encoder 119 is recorded via the buffer control unit 23 and the buffer control unit 124.

In step S17, the system controller 151 determines whether or not a preset time has elapsed based on data stored in advance, for example, in response to a user operation, and determines whether the preset time has elapsed. If it is determined that the time has not elapsed, the procedure returns to step S12, and the process of recording a video combined with an image is repeated.

If it is determined in step S17 that the preset time has elapsed, the process proceeds to step S18, where the HDD 125
The transport packet supplied from the IRD 32 is recorded via the demultiplexing circuit 123 and the buffer control unit 124.

At step S19, the system controller 151 operates the input unit 151 corresponding to the operation of the user.
It is determined whether or not to end the recording based on a signal from the CPU or the like. If it is determined that the recording should be continued, the process proceeds to step S18.
And the process of recording the transport packet is repeated.

If it is determined in step S19 that the recording is to be ended, the process ends.

As described above, the AVHDD 31 can combine the video included in the transport packet supplied from the IRD 32 with the image of the program information and record it as a transport packet.

Note that the AVHDD 31 may read the packet recorded by itself in the processing of step S12, and record it as a packet different from the read packet in the processing of steps S16 and S18. Further, the AVHDD 31 may generate encoded video data corresponding to the analog video signal in the process of step S12.

Note that the AVHDD 31 may record the packet and transmit the packet to the IRD 32 or DVCR 34 via the AV bus in the processing of steps S16 and S18.

Next, a description will be given, with reference to the flowchart of FIG. Step S
At 31, the system controller 151 sets the scheduled recording, for example, a recording channel, a recording start time, a recording end time, etc., based on a signal from the input unit 155 corresponding to the user's operation. Step S3
In 2, the OSD circuit 128 obtains, from the system controller 151, program information corresponding to the setting of the scheduled recording.

In step S33, the OSD circuit 128
Generates video data corresponding to the program information, and outputs the video data to the MPEG video encoder 119 via the input switch 118. In step S34, the MPEG video encoder 119 encodes the video data supplied from the OSD circuit 128 to generate encoded video data. In step S35, the HDD 125 records the encoded video data supplied from the MPEG video encoder 119 via the demultiplexing circuit 123 and the buffer control unit 124.

In step S36, the system controller 151 determines whether or not the preset time has elapsed based on the data stored in advance, and if it is determined that the preset time has not elapsed. The procedure returns to step S33, and repeats the process of recording the video corresponding to the program information.

If it is determined in step S36 that the preset time has elapsed, the process proceeds to step S37, in which the system controller 151 sets the timer recording based on the time data supplied from a real-time clock (not shown). Next, it is determined whether or not the scheduled recording is to be performed. If it is determined that the scheduled recording is not to be performed, the process returns to step S37, and the determination process is repeated until the scheduled recording is performed.

If it is determined in step S37 that the scheduled recording is to be executed, the process proceeds to step S38, where the AVHDD
Reference numeral 31 executes scheduled recording based on the settings in the process of step S31.

In step S39, the AVHDD 31
The coded video data corresponding to the program information recorded in the process of step S35 is read, and the coded video data that has been reserved and recorded is connected to the coded video data corresponding to the read program information, and is recorded on the HDD 125. Then, the process ends.

As described above, the AVHDD 31 can record an image composed of characters or images corresponding to the scheduled recording before the scheduled recording, and can join the encoded video data with the scheduled recording. The user can know the setting of the scheduled recording and the like only by looking at the scheduled recorded video.

It should be noted that the recording of an image composed of characters or video corresponding to the scheduled recording may be performed simultaneously with the execution of the scheduled recording.

Next, the process of adding an image corresponding to the program information to the recorded video and transmitting it by the AVHDD 31 will be described with reference to the flowchart of FIG. In step S51, the OSD circuit 128 acquires program information from the system controller 151.

In step S52, the HDD 125
Read the recorded transport packet,
The signal is supplied to the demultiplexing circuit 123 via the buffer control unit 124. The demultiplexing circuit 123 extracts the PES from the transport packet and supplies the extracted PES to the MPEGAV decoder 126. In step S53, the MPEGAV decoder 126
Decodes the encoded video data included in the PES into video data. The MPEGAV decoder 126 outputs the decoded video data to the OSD circuit 12 via the post video signal processing unit 127.
8

In step S54, the OSD circuit 128
Combines the image of the program information acquired in the processing of step S51 with the video data, and outputs the MP
Output to the EG video encoder 119.

In step S55, the MPEG video encoder 119 generates encoded video data by encoding the video data synthesized from the program information image supplied from the OSD circuit 128, and multiplexes the generated encoded video data. It is supplied to the separation circuit 123. The demultiplexing circuit 123 generates a transport packet based on the encoded video data, and outputs the generated transport packet to the digital interface 132.

At step S56, the digital interface 132 transmits the transport packet supplied from the demultiplexing circuit 123 to, for example, the DVCR 34 via the AV bus.

In step S57, the system controller 151 determines whether or not a preset time has elapsed based on the data stored in advance, and if it is determined that the preset time has not elapsed. The procedure returns to step S52, and repeats the process of transmitting the transport packet including the video obtained by combining the images.

If it is determined in step S57 that the preset time has elapsed, the flow advances to step S58, in which the HDD 125 reads the recorded transport packet and sends it through the buffer control unit 124 and the demultiplexing circuit 123. And the digital interface 13
Feed to 2. In step S59, the digital interface 132 transmits the supplied transport packet to, for example, the DVCR 34 via the AV bus.

At step S60, the system controller 151 operates the input unit 151 corresponding to the operation of the user.
It is determined whether or not transmission is to be terminated based on a signal or the like, and if it is determined that transmission is to be continued, step S58
And repeats the process of transmitting the transport packet.

If it is determined in step S60 that the transmission is to be ended, the processing ends.

As described above, the AVHDD 31 can combine the image included in the recorded transport packet with the image of the program information and transmit it as a transport packet via the AV bus. The DVCR 34 can record the received transport packet.

Steps S51 to S57
In the processing of (1), it is determined whether or not to execute based on the setting corresponding to the operation of the user, and if it is determined not to execute, the processing of steps S51 to S57 may be skipped.

Next, the process of executing a command by the AVHDD 31 will be described with reference to the flowchart of FIG. In step S101, the digital interface 13
2 receives a command (stored in a packet) supplied from, for example, the IRD 32 via the AV bus,
This is supplied to the system controller 151. Step S1
In 02, the system controller 151 executes the command supplied from the digital interface 132. This command is, for example, a so-called pause,
This is for instructing slow reproduction, step reproduction, fast forward, or fast rewind.

In step S103, the OSD circuit 12
8 synthesizes image data (pre-stored) corresponding to the command supplied from the system controller 151 with video data, and converts the synthesized video data via the input switch 118 into MPEG video data. Output to the encoder 119.

In step S 104, the MPEG video encoder 119 encodes the video data obtained by synthesizing the image corresponding to the command supplied from the OSD circuit 128 to generate coded video data, and supplies the coded video data to the demultiplexing circuit 123. . The demultiplexing circuit 123 generates a transport packet based on the encoded video data, and converts the generated transport packet into a digital interface 132
Output to In step S105, the digital interface 132 transmits the transport packet supplied from the demultiplexing circuit 123 to the IRD 32 that has transmitted the command via the AV bus.

In step S106, the system controller 151 determines whether or not to end the image synthesis based on the command or the like supplied from the digital interface 132. If it is determined that the image synthesis is not to be ended, The procedure returns to step S103, and repeats the process of transmitting the transport packet including the image corresponding to the command.

If it is determined in step S106 that the synthesis of the images is to be ended, the process ends.

As described above, the AVHDD 31 can generate a video transport packet obtained by synthesizing an image corresponding to a command to be executed, and transmit the transport packet via the AV bus. The device that sent the command (for example, IRD32)
Receives a transport packet including an image obtained by synthesizing an image corresponding to the transmitted command, and displays an image obtained by synthesizing an image corresponding to the transmitted command. The user can check the executed command by watching the video, and can easily select the command.

It should be noted that the system controller 151
Based on the HD encoded image data recorded in D125, predetermined image data is generated and supplied to the OSD circuit 128. The OSD circuit 128 receives the image data from the post video signal processing unit 127. May be combined with the video data.

The AVHDD 31 is not limited to the system defined in IEEE1394, but includes SCSI, Fiber Channel, Bluetooth,
Packets may be transmitted by a method such as SB (Universal Serial Bus).

Note that the buffer control circuit 124
25, it is described that the packet is recorded on the HDD 125.
The present invention is not limited to this, and the packet may be recorded on a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like.

The AVHDD 31 has been described as receiving and outputting an NTSC signal. However, the AVHDD 31 is not limited to the NTSC signal and may be a PAL (Phase Alternation by Line).
Or an HD (High Definition) signal.

The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software can execute various functions by installing a computer built into dedicated hardware or installing various programs. It is installed from a recording medium into a possible general-purpose personal computer or the like.

As shown in FIG. 3, the recording medium is a magnetic disk 201 (including a floppy disk) on which the program is recorded, which is distributed separately from the computer to provide the program to the user, and an optical disk 20.
2 (CD-ROM (Compact Disc-Read Only Memory), DVD
(Including Digital Versatile Disc)), magneto-optical disc 2
RO (including an MD (Mini-Disc)) or a packaged medium including a semiconductor memory 204 and the like, which is provided to the user in a state in which it is installed in a computer in advance, and in which a program is recorded.
It is composed of M153, HDD125 and the like.

In this specification, the step of describing a program stored in a recording medium may be performed in a chronological order according to the described order. This also includes processing executed in parallel or individually.

In the present specification, the system is
It represents the entire device composed of a plurality of devices.

[0164]

According to the information processing apparatus according to the first aspect, the information processing method according to the fourth aspect, and the recording medium according to the fifth aspect, the second video corresponding to the first video data. Data is obtained, the second video data is combined with the first video data, and the first video data is combined with the first video data.
One of the video data and the first video data in which the second video data is not synthesized is selected, and the selected first video data is encoded.
The user can easily know information on the first video data.

An information processing apparatus according to claim 6, claim 1
According to the information processing method of the first aspect and the recording medium of the twelfth aspect, the encoded first video data is obtained, the obtained first video data is decoded, and the first video data is decoded. Second video data corresponding to the video data is obtained, the obtained second video data is combined with the decoded first video data, and the first video obtained by combining the second video data is obtained. Data is encoded, and either one of the encoded first video data and the obtained encoded first video data, to which the second video data is not synthesized, is selectively output. With this configuration, the user can easily know the information on the first video data.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a conventional recording / reproducing apparatus.

FIG. 2 is a diagram showing an embodiment of a video recording / reproducing system according to the present invention.

FIG. 3 is a diagram illustrating an example of the configuration of an AVHDD 31.

FIG. 4 is a diagram showing an example of an image composed of characters or video corresponding to program information and the like.

FIG. 5 is a flowchart illustrating a recording process.

FIG. 6 is a flowchart illustrating a process of reserved recording.

FIG. 7 is a flowchart illustrating a transmission process.

FIG. 8 is a flowchart illustrating a command execution process.

[Explanation of symbols]

31 AVHDD, 118 input switch, 119 MPEG
Video encoder, 121 input switch, 122 MP
EG audio encoder, 123 demultiplexer,
124 buffer control unit, 125 HDD, 126 M
PEGAV decoder, 128 OSD circuit, 130 switch, 132 digital interface, 151
System controller, 153 ROM, 154 RA
M, 201 magnetic disk, 202 optical disk,
203 magneto-optical disk, 204 semiconductor memory

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/03 H04N 7/08 Z 7/035 7/08 7/081 (72) Inventor Tomoyuki Sato Tokyo 6-7-35 Kita-Shinagawa, Shinagawa-ku Sony Corporation (72) Inventor Shigeharu Sato 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation (72) Inventor Masashi Ota Shinagawa-ku, Tokyo 6-7-35 Kita-Shinagawa Sony Corporation (72) Inventor Masayuki Aiba 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation F-term (reference) 5C025 BA21 BA28 CA02 CA09 CA19 CB09 DA01 DA04 5C053 FA20 FA22 FA24 GA11 GB11 GB22 GB37 JA05 JA16 JA21 LA07 5C063 AB07 AC01 AC05 CA11 CA12 CA20 CA23 DA03 DA13 DB10 EB27 EB33 EB37 EB49

Claims (12)

[Claims] An acquisition unit configured to acquire second video data corresponding to the first video data; a synthesis unit configured to synthesize the second video data with the first video data; Selecting means for selecting either one of the first video data in which the second video data is synthesized and the first video data in which the second video data is not synthesized, and An encoding unit that encodes the selected first video data. 2. The information processing apparatus according to claim 1, further comprising a recording unit that records the first video data encoded by the encoding unit. 3. The information processing apparatus according to claim 1, further comprising a transmission unit that transmits the first video data encoded by the encoding unit to another device. 4. An obtaining step of obtaining second video data corresponding to the first video data; a synthesizing step of synthesizing the second video data and the first video data; and a synthesizing step. Selecting one of the first video data in which the second video data is synthesized in the processing of the first video data and the first video data in which the second video data is not synthesized, An encoding step of encoding the first video data selected in the processing of the step. 5. An obtaining step of obtaining second video data corresponding to the first video data; a synthesizing step of synthesizing the second video data and the first video data; and a synthesizing step. Selecting one of the first video data in which the second video data is synthesized in the processing of the first video data and the first video data in which the second video data is not synthesized, An encoding step of encoding the first video data selected in the processing of the step, wherein the program is readable by a computer. 6. A first obtaining unit that obtains encoded first video data; a decoding unit that decodes the first video data obtained by the first obtaining unit; A second obtaining unit that obtains second video data corresponding to the first video data, the second video data obtained by the second obtaining unit, and the decoded first video data. Combining means for combining the first video data combined with the second video data by the combining means; and the first video encoded by the coding means. Data and one of the encoded first video data obtained by the first obtaining means and not combined with the second video data, and a selection output means for selectively outputting one of the encoded first video data. Features include That the information processing apparatus. 7. The image processing apparatus according to claim 1, further comprising a storage unit that stores the encoded first video data, wherein the first acquisition unit stores the first video data stored in the storage unit. The information processing apparatus according to claim 6, wherein the information is acquired. 8. The image processing apparatus further includes receiving means for receiving the encoded first video data, wherein the first obtaining means obtains the first video data received by the receiving means. The information processing apparatus according to claim 6, wherein 9. The information processing apparatus according to claim 6, further comprising recording means for recording the first video data selected and output by the selection output means. 10. The information processing apparatus according to claim 6, further comprising a transmission unit that transmits the first video data selected and output by the selection output unit to another device. 11. A first obtaining step of obtaining encoded first video data, a decoding step of decoding the first video data obtained in the processing of the first obtaining step, A second acquisition step of acquiring second video data corresponding to the first video data; the second video data acquired in the processing of the second acquisition step; A combining step of combining the first video data combined with the second video data in the processing of the combining step; and a coding step of coding the first video data in the processing of the combining step. Any of the encoded first video data and the encoded first video data obtained by the processing of the first obtaining step, wherein the second video data is not synthesized. The information processing method characterized by including a selection output step for selectively outputting one. 12. A first obtaining step of obtaining encoded first video data, a decoding step of decoding the first video data obtained in the processing of the first obtaining step, A second acquisition step of acquiring second video data corresponding to the first video data; the second video data acquired in the processing of the second acquisition step; A combining step of combining the first video data combined with the second video data in the processing of the combining step; and a coding step of coding the first video data in the processing of the combining step. Any of the encoded first video data and the encoded first video data obtained by the processing of the first obtaining step, wherein the second video data is not synthesized. Recording medium having computer-readable program characterized by comprising a selection output step for selectively outputting one is recorded.