JP4333522B2 - Information processing apparatus, information processing method, recording medium, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing method, a recording medium, and a program, and more particularly, an information processing apparatus and information suitable for use when editing video data compressed using bidirectional inter-frame prediction. The present invention relates to a processing method, a recording medium, and a program.

  In an image compression method represented by MPEG (Moving Picture Coding Experts Group / Moving Picture Experts Group) or the like, high compression efficiency is realized by compressing and encoding a video signal using inter-frame prediction. However, when considering video editing, compressed images using inter-frame prediction are related to the compression signal based on prediction between frames, so video materials can be joined together with the compressed video signal. I can not do such a thing. For this reason, in a system in which editing of a video material is considered in advance, encoding is generally performed using only compression within a frame without using inter-frame prediction.

  However, for example, when a video signal having a high definition and a large amount of information such as an HD (High Definition) signal is handled, if encoding is performed only by intra-frame compression, only a low compression efficiency can be obtained. In order to transmit or store data, an expensive system having a high transfer rate, a large storage capacity, or a high processing speed is required. That is, in order to handle a high-definition video signal with a large amount of information in an inexpensive system, it is necessary to increase the compression efficiency using inter-frame prediction.

  In MPEG, a compression coding method using bidirectional inter-frame prediction, which is composed of an I picture (I-Picture), a P picture (P-Picture), and a B picture (B-Picture), is Long GOP. This is called (Group of Picture) compression.

  An I picture is an intra-frame (Intra) encoded image, which is a picture that is encoded independently of other screens. An image can be decoded using only this information. A P picture is an inter-frame (inter) forward predictive encoded image, and is a forward predictive encoded picture represented by a difference from a temporally previous (forward) frame. A B picture is a bi-directional predictive encoded image, and is based on motion-compensated interframe prediction using temporally forward (forward direction), backward (reverse direction), or front and back (bidirectional) pictures. A picture to be encoded.

  Since the data amount of P pictures and B pictures is smaller than that of I pictures, if the GOP is lengthened (that is, the number of pictures constituting the Long GOP is increased), the video compression rate can be increased. Therefore, it is suitable for use in digital broadcasting and DVD (Digital Versatile Disk) video. However, if the GOP is too long, editing control with frame accuracy becomes difficult, and operational problems occur particularly in editing for business use.

  Processing for editing two video data compressed by the Long GOP method by connecting them at a predetermined editing point will be described with reference to FIG.

  First, in each of the editing target compressed video data 1 and the editing target compressed video data 2, partial decoding in the vicinity of the editing point is performed, and a partial uncompressed video signal 1 and video signal 2 are obtained. Then, the uncompressed video signal 1 and the video signal 2 are connected at the editing point, and if necessary, an effect (Effect) is applied near the editing point and re-encoding is performed. Then, the re-encoded compressed video data is combined with the compressed video data that has not been decoded and re-encoded (other than the vicinity of the editing point where partial decoding has been performed).

  The method described with reference to FIG. 1 decodes all compressed video data of editing material, then connects the video signals at the editing points, re-encodes all the video signals again, and edits the compressed video data that has been edited. Compared with the obtaining method, there are advantages that image quality deterioration due to re-encoding can be locally suppressed and editing processing time can be greatly shortened.

  However, if editing and re-encoding are performed by the method described with reference to FIG. 1, there arises a problem that an image cannot be referred to at the joint between the re-encoded portion and the non-re-encoded portion.

  In order to solve this problem, when compression is performed using the prediction encoding between frames (Long GOP) method, as a method of realizing editing relatively easily, restrictions are applied to inter-frame prediction, and only within the GOP. There is known a method of restricting inter-frame prediction so as to adopt a closed GOP structure that refers to an image and does not refer to an image across GOPs.

  A case where a restriction is applied to inter-frame prediction will be described with reference to FIG. In FIG. 2, in order to show the relationship between inter-frame prediction and editing, the compressed material video 1 data and the compressed material video 2 data to be edited, the partially re-encoded compressed video near the edited point And the compressed video data of the portion not to be re-encoded, the picture order in the display order is shown. The arrows in the figure indicate the reference direction of the image (hereinafter the same). In FIG. 2, 15 pictures of the display order BBIBBPBBPBBPBBP are set to 1 GOP, and the image is referred to only within the GOP. This method prohibits prediction across GOPs, thereby eliminating the relationship of compressed data by prediction between GOPs and enabling reconnection of compressed data (determination of a range for re-encoding) in units of GOPs.

  That is, the data of the compressed material video 1 and the data of the compressed material video 2 to be edited are determined for each 1 GOP including the editing point, and the re-encoding range determined for each 1 GOP is edited. The data of the compressed material video 1 and the data of the compressed material video 2 are decoded, and the uncompressed material video 1 signal and the material video 2 signal are generated. Then, the uncompressed material video 1 signal and the material video 2 signal are connected at the cut editing point, and the connected material video 1 and material video 2 are partially re-encoded to generate compressed video data. The compressed video data that has been compressed and encoded is generated by being connected to the compressed video data that is generated and not re-encoded.

As shown in FIG. 3, the actually encoded data is arranged in a coding order, and the compressed video data is combined in the coding order. The compressed video data generated by partial re-encoding of the connected material video 1 and material video 2 and the compressed video data of the portion not re-encoded are the coding order in the data of the compressed material video 1 of the portion not re-encoded. In the B ₁₃ picture that is the 14th picture in the display order and the compressed video data generated by re-encoding, I is the first picture in the coding order and the 3rd picture in the display order. _Two pictures are connected. Then, in the compressed video data generated by re-encoding, the coding is performed in the B ₁₂ picture which is the last picture in the coding order and the 13th picture in the display order and the data of the compressed material video 2 which is not re-encoded. The I ₂ picture, which is the first picture in the order and the third picture in the display order, is connected. That is, the compressed video data generated by partially re-encoding the connected material video 1 and material video 2 and the compressed video data of the portion not re-encoded are connected at the GOP switching portion and compressed. Video data is generated.

  On the other hand, a GOP structure that is not a Closed GOP structure, that is, a Long GOP structure that refers to an image across GOPs is hereinafter referred to as an Open GOP.

  Also, when editing two bit streams of Open GOP, specifically, when inserting bit stream Y into bit stream X, B picture before I picture (I The B picture that appears before the picture is displayed is deleted, and the temporal reference (Temporal Reference) of the remaining images constituting the GOP is changed, thereby forming the last GOP of the bitstream X. The B picture before I picture predicted using the image is not displayed, and the deterioration of the image quality at the joint portion when the bit streams of the MPEG encoded images are connected by the Open GOP can be prevented. There is a technique (for example, Patent Document 1).

Japanese Patent Laid-Open No. 10-66085

  However, as described with reference to FIGS. 2 and 3, in the editing method using the Closed GOP structure that prohibits prediction across GOPs, the prediction direction is limited at the start and end of the GOP. Compared with Open GOP, which is a commonly used compression method, the compression efficiency of video signals is reduced.

  Further, in the technique described in Patent Document 1, since the B picture near the joint is not displayed, there is a problem that the corresponding image is lost.

  The present invention has been made in view of such a situation, and editing of a compressed video signal using bidirectional inter-frame prediction compressed by the Long GOP method, which can obtain a high compression efficiency, is limited by the VBV Buffer. It can be realized by protecting

The first information processing apparatus according to the present invention includes a decoding unit that decodes video data in a predetermined range near an editing point of the first compressed video data and the second compressed video data, and the first compressed video data The first uncompressed video signal generated by decoding by the decoding means and the second uncompressed video signal generated by decoding the second compressed video data by the decoding means are connected at the editing point. a connecting means for generating a third non-compressed video signal, encodes the third non-compressed video signal that is generated is connected by connecting means, and encoding means for generating a third compressed image data, the Gets information about Q-matrix of a predetermined picture of the second compressed video data, by encoding means, and control means for controlling the encoding using the Q matrix, except near an edit point Connecting the first compressed video data in a predetermined range and the second compressed video data in a predetermined range other than the vicinity of the editing point and the third compressed video data encoded and generated by the encoding means; wherein the Ru and a edited video data generating means for generating compressed encoded edited image data.

  The control means can acquire information relating to the Q matrix of the first picture connected to the third compressed video data by the edited video data generation means out of the second compressed video data. When one picture meets a predetermined condition, the control means controls the encoding means so that the second picture encoded by the encoding means is encoded using the Q matrix of the first picture. The edited video data generation means can connect the first picture subsequent to the second picture.

  The predetermined condition may include that a sequence header is not inserted before the first picture.

  The predetermined condition may include that the first picture is not set to load a Q matrix during encoding.

  The control means inserts a sequence header into a picture that is encoded by the encoding means and is connected to the first compressed video data in a predetermined range other than the vicinity of the editing point by the edited video data generating means. Thus, the encoding means can be controlled.

  In the control means, the picture type of the portion that is temporally behind in the image display order from any intra-frame encoded image or inter-frame forward prediction encoded image of the third compressed video data. The encoding process by the encoding means can be further controlled so as not to change from the corresponding picture types of the first compressed video data and the second compressed video data.

  The control means can acquire information relating to the Q matrix of the first picture connected to the third compressed video data by the edited video data generation means out of the second compressed video data. It is possible to determine whether or not the Q matrix of one picture is equal to the Q matrix of the second picture connected subsequent to the first picture by the editing data generating means. When it is determined that the Q matrices of the second picture and the second picture are not equal, the second picture can be set so that the Q matrix is loaded at the time of encoding.

  The control unit may acquire information related to the Q matrix of the second picture corresponding to the first picture that is the last picture of the third compressed video data out of the second compressed video data. The encoding means can be controlled so that the first picture is encoded with the same Q matrix as the second picture.

  An update means for updating the syntax of the second compressed video data in a predetermined range other than the vicinity of the edit point can be further provided, and the control means further controls the processing of the syntax update control means. In the second compressed video data, the first is an intra-frame encoded image or an inter-frame forward prediction encoded image connected to the third compressed video data by the edited video data generating means. Information and the Q matrix of the second picture that is the next inter-frame forward predictive encoded image, the Q matrix of the first picture and the second picture is different, If the second picture is not set to load the Q matrix during encoding, the syntax update control means is controlled. It can be made to be added to QuantMatrixExtention the syntax of the second picture.

  The first information processing method of the present invention includes a decoding step for decoding video data in a predetermined range near an editing point of the first compressed video data and the second compressed video data, and the first compressed video data Edits the first uncompressed video signal generated by decoding in the decoding step and the second uncompressed video signal generated by decoding the second compressed video data in the decoding step Connecting at a point, generating a third uncompressed video signal, obtaining information about a Q matrix of a predetermined picture of the second compressed video data, and using the obtained information, processing of the connecting step Encoding the third uncompressed video signal connected and generated to generate third compressed video data, and a predetermined range other than the vicinity of the editing point. The first compressed video data and the second compressed video data in a predetermined range other than the vicinity of the editing point are connected to the third compressed video data encoded and generated by the process of the encoding step, and compressed. An edited video data generation step for generating encoded edited video data.

  A program recorded on the first recording medium of the present invention includes a decoding step for decoding a predetermined range of video data in the vicinity of the editing point of the first compressed video data and the second compressed video data; A first uncompressed video signal generated by decoding one compressed video data by the process of the decoding step, and a second uncompressed video generated by decoding the second compressed video data by the process of the decoding step. The signal is connected at the editing point, and a connection step for generating a third uncompressed video signal, and information about the Q matrix of a predetermined picture of the second compressed video data are acquired, and the acquired information is used. An encoding step for encoding a third uncompressed video signal connected and generated by the processing of the connection step to generate third compressed video data; First compressed video data in a predetermined range other than the vicinity of the point, second compressed video data in a predetermined range other than the vicinity of the editing point, and third compressed video data generated by encoding in the encoding step And the edited video data generating step for generating the compressed and encoded edited video data.

  The first program of the present invention includes a decoding step for decoding a predetermined range of video data in the vicinity of an editing point of the first compressed video data and the second compressed video data, and the first compressed video data is decoded The first uncompressed video signal generated by decoding by the processing of the step and the second uncompressed video signal generated by decoding the second compressed video data by the processing of the decoding step are edited at the editing point. Connecting and generating a third uncompressed video signal, obtaining information relating to a Q matrix of a predetermined picture of the second compressed video data, and using the obtained information to connect by processing of the connecting step An encoding step for encoding the generated third uncompressed video signal to generate third compressed video data, and a predetermined range other than the vicinity of the editing point The first compressed video data and the second compressed video data in a predetermined range other than the vicinity of the editing point are connected to the third compressed video data encoded and generated by the process of the encoding step, and the compressed code The computer is caused to execute a process including an edited video data generation step of generating the edited video data.

  In the first information processing apparatus, the information processing method, and the program of the present invention, video data in a predetermined range near the editing point of the first compressed video data and the second compressed video data is decoded, and the first The first uncompressed video signal generated by decoding the first compressed video data and the second uncompressed video signal generated by decoding the second compressed video data are connected at the editing point. , A third uncompressed video signal is generated, information about the Q matrix of a predetermined picture of the second compressed video data is acquired, and the third uncompressed video signal is encoded using the acquired information. Third compressed video data is generated, the first compressed video data in a predetermined range other than the vicinity of the editing point, the second compressed video data in a predetermined range other than the vicinity of the editing point, and the third compressed video De And data and is connected, compressed encoded edited image data is generated.

  According to the second information processing apparatus of the present invention, the first uncompressed video signal generated by decoding the first compressed video data in a predetermined range near the editing point and the second compressed video data are the editing point. The second non-compressed video signal generated by decoding within a predetermined range in the vicinity is encoded with the third non-compressed video signal generated by being connected at the editing point to obtain the third compressed video data. Encoding means to be generated and a Q matrix of a first picture which is a picture in a range other than a predetermined range in the vicinity of the editing point in the second compressed video data and is a picture connected to the third compressed video data If the first picture meets a predetermined condition, the second picture to be encoded by the encoding means is encoded using the Q matrix of the first picture. And a controlling means for controlling the encoding processing by the encoding means.

  According to the second information processing method of the present invention, the first uncompressed video signal generated by decoding the first compressed video data in a predetermined range near the editing point and the second compressed video data are edited. The second non-compressed video signal generated by decoding within a predetermined range in the vicinity is encoded with the third non-compressed video signal generated by being connected at the editing point to obtain the third compressed video data. An encoding step to be generated, and a Q matrix of a first picture that is a picture in a range other than a predetermined range in the vicinity of the editing point in the second compressed video data and is a picture connected to the third compressed video data If the first picture meets the predetermined condition, the second picture encoded by the encoding step is encoded using the Q matrix of the first picture. So that the, characterized in that it comprises a control step of controlling the encoding processing by the processing in the encoding step.

  In the second information processing apparatus and information processing method of the present invention, the first uncompressed video signal generated by decoding the first compressed video data in a predetermined range near the editing point, and the second compression The third uncompressed video signal generated by connecting the video data to the second uncompressed video signal generated by decoding the video data within a predetermined range near the editing point is encoded, and the third uncompressed video signal is encoded. The compressed video data of the first picture, which is a picture in a range other than the predetermined range in the vicinity of the editing point in the second compressed video data, and is a picture connected to the third compressed video data. When information about the Q matrix is acquired and the first picture meets a predetermined condition, the second picture encoded by the process of the encoding step is processed using the Q matrix of the first picture. As encoded, the encoding processing by the processing in the encoding step is controlled.

  According to the present invention, editing processing can be performed. In particular, since re-encoding is performed using a Q matrix of compressed video data that is an editing material, image quality by re-encoding is improved. Deterioration can be suppressed.

  Further, according to another aspect of the present invention, editing processing can be performed, and in particular, re-encoding is controlled using a Q matrix of compressed video data that is an editing material. Degradation of image quality due to re-encoding can be suppressed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 4 is a block diagram showing a hardware configuration of the editing apparatus 1 to which the present invention is applied.

  A CPU (Central Processing Unit) 11 is connected to the north bridge 12 and controls processing such as reading of data stored in an HDD (Hard disk Drive) 16 or editing processing executed by the CPU 20. Generate and output commands for The north bridge 12 is connected to a PCI bus (Peripheral Component Interconnect / Interface) 14. For example, under the control of the CPU 11, the north bridge 12 receives supply of data stored in the HDD 16 via the south bridge 15 and receives the PCI bus. 14, and supplied to the memory 18 via the PCI bridge 17. The north bridge 12 is also connected to the memory 13, and exchanges data necessary for the processing of the CPU 11.

  The memory 13 stores data necessary for processing executed by the CPU 11. The south bridge 15 controls writing and reading of data in the HDD 16. The HDD 16 stores the compression-encoded editing material.

  The PCI bridge 17 controls the writing and reading of data in the memory 18, controls the supply of compression-encoded data to the decoders 22 to 24 or the stream splicer 25, and controls the PCI bus 14 and the control bus 19. Control the exchange of data. Under the control of the PCI bridge 17, the memory 18 stores compression encoded data that is an editing material read by the HDD 16 and edited compression encoded data supplied from the stream splicer 25.

  The CPU 20 is connected to the PCI bridge 17, decoders 22 to 24, stream splicer 25, effect / switch in accordance with commands supplied from the CPU 11 via the north bridge 12, PCI bus 14, PCI bridge 17, and control bus 19. 26, the encoder 27, and the processing executed by the syntax update unit 28 are controlled. The memory 21 stores data necessary for the processing of the CPU 20.

  Based on the control of the CPU 20, the decoders 22 to 24 decode the supplied compressed encoded data and output an uncompressed video signal. The stream splicer 25 combines the supplied compressed video data with a predetermined frame based on the control of the CPU 20. The decoders 72 to 74 may be provided as independent devices that are not included in the editing device 1. For example, when the decoder 74 is provided as an independent device, the decoder 74 can receive, decode, and output the compressed edited video data generated by editing by the processing described later. The

  The effect / switch 26 switches the uncompressed video signal output supplied from the decoder 22 or the decoder 23 based on the control of the CPU 20, that is, combines the supplied uncompressed video signal with a predetermined frame. If necessary, an effect is applied to a predetermined range and supplied to the encoder 27. The encoder 27 encodes the supplied uncompressed video signal based on the control of the CPU 20, and outputs the compressed and encoded video data to the stream splicer 25.

  The syntax update unit 28 updates the syntax of the compression-coded video data supplied to the stream splicer 25 based on the control of the CPU 20.

  Next, the operation of the editing device 1 in the first embodiment will be described.

  The HDD 16 stores data of the compressed material video 1 and the compressed material video 2 compressed by the Long GOP Open GOP method shown in FIG. In FIG. 5, the compressed material image 1 and the compressed material image 2 are described in the order of pictures to be displayed (display order).

  The CPU 11 controls the south bridge 15 and, based on a user operation input supplied from an operation input unit (not shown), compresses and encodes the compressed material video 1 data and the compressed material video 2 data from the HDD 16. The data is read out and supplied to the memory 18 via the north bridge 12, the PCI bus 14, and the PCI bridge 17, and stored, and information indicating the editing point and a command indicating the start of editing are supplied to the north bridge 12, PCI. The data is supplied to the CPU 20 via the bus 14, the PCI bridge 17, and the control bus 19.

  Based on the information indicating the edit point supplied from the CPU 11, the CPU 20 determines a range to be re-encoded among the compressed material video 1 data and the compressed material video 2 data that have been compression-encoded. Then, the CPU 20 controls the PCI bridge 17 to select a picture in a range to be re-encoded and a picture that needs to be referred to from the compression-encoded compressed material video 1 data stored in the memory 18. Corresponding compressed material video 1 data is supplied to the decoder 22, and among the compressed material video 2 data, the picture of the range to be re-encoded and the compressed material video 2 data corresponding to the picture that needs to be referred to The data is supplied to the decoder 23.

  That is, at this time, when the B picture 36 and the B picture 37 are included in the re-encoding range in the compressed material video 1, in order to decode the B picture 36 and the B picture 37, the I picture 31 and , P picture 32 to P picture 35 are also decoded. Similarly, when the B picture 38 and the B picture 39 are included in the re-encoding range in the compressed material video 2, the I picture 40 is also decoded in order to decode the B picture 38 and the B picture 39. Is done.

  At this time, the CPU 20 controls the PCI bridge 17 so that the pictures in the range in which the re-encoding is not performed among the data of the compressed material video 1 and the compressed material video 2 stored in the memory 18 are performed. Is supplied to the stream splicer 25.

  The CPU 20 controls the decoder 22 and the decoder 23 to decode the supplied compressed and encoded data.

  The decoder 22 and the decoder 23 decode the supplied data based on the control of the CPU 20, and supply the material video 1 and material video 2 signals obtained by decoding to the effect / switch 26. The effect / switch 26 connects the signals of the uncompressed decoded material video 1 and the decoded material video 2 at a predetermined cut editing point (splice point) based on the control of the CPU 20, and as necessary. , Applying an effect, generating an uncompressed edited video signal for re-encoding, and a re-encoding reference image necessary for re-encoding (in FIG. 5, P picture 41 necessary for encoding B picture 42 and B picture 43) Are supplied to the encoder 27.

  Further, the decoder 22 and the decoder 23 can extract information necessary for the encoding process by the subsequent encoder 27 and supply it to the CPU 20 via the control bus 19. The CPU 20 supplies information necessary for the encoding process by the subsequent encoder 27 supplied from the decoder 22 or the decoder 23 to the encoder 27 via the control bus 19.

  Based on the control of the CPU 20, the encoder 27 encodes the uncompressed edited video signal for re-encoding supplied from the effect / switch 26.

  At that time, as shown in FIG. 5, the encoder 27 must use the previous P picture 41 as a reference picture in order to encode the B picture 42 and the B picture 43 for which bi-directional predictive coding is performed. Don't be. Further, by determining the picture type so that the last picture of re-encoding becomes a P picture in the display order, the pictures after the last picture of re-encoding need not be used as a reference picture for encoding. Can be.

  In other words, by performing re-encoding with a picture type such that the end point of re-encoding is a GOP break (that is, other than a B picture), even if the compressed material video data for editing is OpenGOP, It is not necessary to use a picture after the last picture of re-encoding as a reference picture for encoding.

  The video data re-encoded by the encoder 27 is supplied to the stream splicer 25. The syntax update unit 28 updates the syntax of the compression-coded material video data supplied to the stream splicer 25 as needed based on the control of the CPU 20. The case where the syntax is updated by the syntax update unit 28 will be described later. Based on the control of the CPU 20, the stream splicer 25 compresses the compressed material image 1 and the compressed material image 1 in the range in which the re-encoding of the data of the compressed material image 1 and the compressed material image 2 supplied from the PCI bridge 17 is not performed. The material video 2 and the encoded video data supplied from the encoder 27 are connected to generate compressed edited video data.

  Specifically, the stream splicer 25 controls the P picture 46 of the compressed material video 1 supplied from the PCI bridge 17 and the B picture 42 of the encoded video data supplied from the encoder 27 based on the control of the CPU 20. And the P picture 45 of the encoded video data supplied from the encoder 27 and the I picture 47 of the compressed material video 2 supplied from the PCI bridge 17 are displayed on the display order. The streams are connected so that they are connected in a continuous manner.

  Then, the stream splicer 25 supplies the created compressed edited video data to the PCI bridge 17 under the control of the CPU 20, stores it in the memory 18, and supplies it to the decoder 24 for decoding to check the editing result. The baseband signal generated by being output and displayed on a monitor or the like or decoded is output to another device.

  When an instruction to save the compressed edited video data generated by editing is issued from an operation input unit (not shown), the CPU 11 controls the PCI bridge 17 to read the compressed edited video data stored in the memory 18. Then, the data is supplied to the south bridge 15 via the PCI bus 14 and the north bridge 12, and the south bridge 15 is controlled to supply the supplied compressed edited video data to the HDD 16 for storage.

  Actual encoding is performed in a coding order, and the compressed video encoded by the encoder 27 is also output in the coding order. Corresponding to the case described with reference to FIG. 5, FIG. 6 shows a sequence of pictures in a compressed signal in a coding order.

  In each data of the compressed material video 1 to be edited and the compressed material video 2 to be edited, the re-encoding range including the editing point is determined, and the compressed material video 1 and the compressed material video 2 in the re-encoded range are decoded. Thus, an uncompressed material video 1 signal and a material video 2 signal are generated. Then, at the cut edit point, the signal of the uncompressed material video 1 and the material video 2 are connected, and the connected material video 1 and material video 2 are the last picture as a P picture (or I picture). ), The compressed video data is generated, and the compressed video data is compressed by being connected to the portion of the compressed video data that is not re-encoded.

The compressed video data generated by partial re-encoding of the connected material video 1 and material video 2 and the compressed video data of the portion not re-encoded are the coding order in the data of the compressed material video 1 of the portion not re-encoded. In the B ₁₃ picture that is the 14th picture in the display order and the compressed video data generated by re-encoding, the first picture in the coding order and the 3rd picture in the display order. A certain I ₂ picture is connected. Then, in the compressed video data generated by re-encoding, the P ₁₅ picture (P picture 45), which is the last picture in the coding order and the 16th picture in the display order, and the compressed material video of the portion that is not re-encoded. 2, the I ₀ picture (I picture 47), which is the first picture in the coding order and the third picture in the data display order, is connected. That is, the compressed video data generated by partially re-encoding the connected material video 1 and material video 2 and the compressed video data of the portion not re-encoded are connected and compressed regardless of the GOP switching portion. Edited video data is generated.

Thus, in the display order, the P ₁₅ picture (P picture 45), which is the last picture of re-encoding, becomes the last picture of re-encoding in the coding order. In this way, by determining the picture type, it is possible to avoid using pictures after the last picture of re-encoding as a reference picture for encoding.

  At this time, it is necessary to perform re-encoding in consideration of a VBV (Video Buffering Verifier) buffer. A VBV buffer for editing is described with reference to FIG.

  When encoding is performed, control is performed so that the subsequent decoder can perform normal decoding by assigning the generated code amount to each picture so that the VBV buffer does not overflow or underflow. It must be done. In particular, when partial re-encoding is performed for editing, the VBV buffer overflows or underflows even with respect to a portion that is not partially re-encoded (particularly near the connection point between the portion that is re-encoded and the portion that is not re-encoded). It is necessary to re-encode so that it does not flow.

  It is the non-re-encoded portion of the compressed video data that is combined after the re-encoded compressed video signal that is affected by the state of the buffer of the re-encoded compressed video data. A sufficient condition for the compressed video data of the non-re-encoded portion not to overflow or underflow is that the first I picture or P of the compressed edited video data of the non-re-encoded portion combined after the re-encoded compressed video signal. In FIG. 7, the Occupancy of the P picture indicated by D in FIG. 7 following the I picture indicated by A in FIG. 7 is the next to the I picture indicated by B in FIG. 7 of the compressed material video 2 data. It is equal to the Occupancy of an I picture or a P picture, that is, a P picture indicated by C in FIG. Therefore, when re-encoding is performed, it is necessary to control the occupancy of the buffer at the end of re-encoding (portion indicated by A in FIG. 7) so that the value satisfies the above condition.

  By doing so, it is possible to prevent the VBV buffer from being broken as much as possible.

  However, depending on the generated code amount of the I picture indicated by A and the next I or P picture, it is indicated by D as described with reference to FIG. 7 only by controlling the occupancy of the I picture indicated by A. The Occupancy of the P picture cannot be made equal to the Occupancy of the P picture indicated by C in FIG. 7 of the compressed material video 2 data, and the VBV buffer may break down.

  A case where the VBV buffer fails will be described with reference to FIG.

In general, the generated code amount of an I picture and the generated code amount of a P picture are larger than the generated code amount of a B picture. For example, the generated code amount B of the I ₂ picture that is the leading I picture of the data of the compressed material video 2 that is not re-encoded and combined after the compressed video data generated by re-encoding, and the next P picture consider the case a generated code amount C of a P ₅ picture is large.

At this time, in the compressed edited video generated by editing, the occupancy of the part indicated by D in the P picture following the first I picture of the part not encoded subsequent to the part encoded part is compressed before editing. Even if an attempt is made to control the Occupancy of the I picture indicated by A so as to be equal to the Occupancy of the portion indicated by C of the material video 2 data, the code generation amount of consecutive P pictures is large. As a result, the buffer underflows. In this example, since the Occupancy of the I picture indicated by A in the edited I ₀ picture is almost the maximum value of the buffer, no matter how the generated code amount is controlled in the re-encoding portion, The underflow of the buffer cannot be avoided in the part indicated by D. That is, the method described with reference to FIGS. 5 and 6 cannot guarantee 100% of the decoding process in the decoder.

  Therefore, the CPU 20 controls the processing executed by the decoder 22 and the decoder 23, the stream splicer 25, the effect / switch 26, and the encoder 27 so that re-encoding is performed under the condition that the VBV buffer does not fail. Can be.

  Next, a description will be given of a second embodiment in which video signals compressed by the Long GOP Open GOP method can be edited while keeping the condition that the VBV buffer does not fail.

  The operation of the editing device 1 in the second embodiment will be described.

  The CPU 11 controls the south bridge 15 and, based on a user operation input supplied from an operation input unit (not shown), compresses and encodes the compressed material video 1 data and the compressed material video 2 data from the HDD 16. The data is read out and supplied to the memory 18 via the north bridge 12, the PCI bus 14, and the PCI bridge 17, and stored, and information indicating the editing point and a command indicating the start of editing are supplied to the north bridge 12, PCI. The data is supplied to the CPU 20 via the bus 14, the PCI bridge 17, and the control bus 19.

  Based on the information indicating the edit point supplied from the CPU 11, the CPU 20 determines a range to be re-encoded among the compressed material video 1 data and the compressed material video 2 data that have been compression-encoded.

  Specifically, in the compressed material video 1, the CPU 20 combines the start point of the re-encoding interval before the partially re-encoded compressed video, and displays the last picture in the display order of the compressed video of the non-re-encoded portion. The picture type is determined to be an I picture or a P picture.

  That is, for example, as shown in FIG. 9, the CPU 20 starts the re-encoding section so that the picture type of the last picture is P picture 46 in the display order of the portion of the compressed material video 1 that is not re-encoded. Are determined to be the B picture 36 next to the P picture 35 in the compressed material video 1. In other words, the CPU 20 can facilitate the encoding process by setting the compressed video of the portion that is not re-encoded as the GOP end position.

  Further, the CPU 20 combines the end point of the re-encoding section in the compressed material video 2 after the partially re-encoded compressed video, and the first picture has the picture type of the compressed video display order of the non-re-encoded portion. Decide to be an I picture.

  That is, for example, as shown in FIG. 9, the CPU 20 ends the re-encoding interval so that the picture type of the first picture becomes I picture 47 in the display order of the compressed material video 2 of the portion that is not re-encoded. Are determined as the B picture 39 before the I picture 40 in the compressed material video 2.

  Then, the CPU 20 controls the PCI bridge 17, and among the data of the compression-compressed compressed material video 1 stored in the memory 18, a picture in a range to be re-encoded, a B picture 36 and a B picture 37. The decoder 22 is supplied with the data of the I picture 31, P picture 32, P picture 33, P picture 34, and P picture 35, which are pictures that need to be referred to in order to decode the video. Of the data, the decoder 23 is supplied with data of an I picture 40 that is a picture to be re-encoded and a picture that needs to be referred to in order to decode the B picture 38 and the B picture 39.

  At this time, the CPU 20 controls the PCI bridge 17 so that the pictures in the range in which the re-encoding is not performed among the data of the compressed material video 1 and the compressed material video 2 stored in the memory 18 are performed. Is supplied to the stream splicer 25.

  The CPU 20 controls the decoder 22 and the decoder 23 to decode the supplied compressed and encoded data.

  The decoder 22 and the decoder 23 decode the supplied data based on the control of the CPU 20, and supply the material video 1 and material video 2 signals obtained by decoding to the effect / switch 26. The effect / switch 26 connects the signals of the uncompressed decoded material video 1 and the decoded material video 2 at a predetermined cut editing point (splice point) based on the control of the CPU 20, and as necessary. , Applying an effect, generating an uncompressed edited video signal for re-encoding, and a re-encoding reference image necessary for re-encoding (in FIG. 9, P picture 41 required for encoding B picture 42 and B picture 43) , And image data corresponding to the I picture 74 necessary for encoding the B picture 72 and the B picture 73), and the image data.

  The CPU 20 acquires information on the number n of consecutive B pictures positioned last in the display order in the portion of the compressed material video 2 where re-encoding is performed. As described above, the picture type of the first picture in the display order of the compressed material video 2 of the portion that is not re-encoded is determined to be an I picture, so the number n of B pictures, that is, not re-encoded. The number of B pictures between the first I picture in the display order of the partial compressed material video 2 and the I picture or P picture existing immediately before the I picture after editing. In the case of FIG. 9, the number n of B pictures is two, a B picture 38 and a B picture 39.

  Further, the CPU 20 displays the I picture or P picture immediately before the first I picture in the display order of the portion of the compressed material video 2 that is not re-encoded, in other words, the I picture or P picture that exists at the end of the re-encoding range. Get information about the picture type of a picture. In the case of FIG. 9, the P picture 61 is the I picture or P picture that exists immediately before the first I picture in the display order of the compressed material video 2 of the portion that is not re-encoded.

  Then, in the processing executed by the encoder 27, the CPU 20 has the same number of B picture types near the end point of re-encoding as the compressed material video 2 before editing, and the picture type of the picture immediately before the B picture is I picture or The encoder 27 is controlled so as to be a P picture. Further, it is preferable that the CPU 20 controls the picture type of the picture immediately before the B picture to be the same as that of the compressed material video 2 before editing.

  That is, in the case of FIG. 9, the CPU 20 prepares the B picture 38 and B picture 39 of the compressed material video 2 before editing, the B picture 72 and the B picture 73 in re-encoding, and the B picture 72 in re-encoding. Also, the P picture 71 is set immediately before the B picture 73.

  Based on the control of the CPU 20, the encoder 27 encodes the uncompressed edited video signal for re-encoding supplied from the effect / switch 26.

  The video data re-encoded by the encoder 27 is supplied to the stream splicer 25. The syntax update unit 28 updates the syntax of the compression-coded material video data supplied to the stream splicer 25 as needed based on the control of the CPU 20. The case where the syntax is updated by the syntax update unit 28 will be described later. Based on the control of the CPU 20, the stream splicer 25 compresses the compressed material video 1 and the compressed material video in a range where re-encoding of the data of the compressed material video 1 and the compressed material video 2 supplied from the PCI bridge 17 is not performed. 2 and the encoded video data supplied from the encoder 27 are connected to generate compressed edited video data.

  Specifically, the stream splicer 25 controls the P picture 46 of the compressed material video 1 supplied from the PCI bridge 17 and the B picture 42 of the encoded video data supplied from the encoder 27 based on the control of the CPU 20. Are connected in a display order, and the B picture 73 of the encoded video data supplied from the encoder 27 and the I picture 47 of the compressed material video 2 supplied from the PCI bridge 17 are displayed in the display order. The streams are connected so that they are connected in a continuous manner.

  Actual encoding is performed in the coding order, and the compressed video encoded by the encoder 27 is also output in the coding order. Corresponding to the case described with reference to FIG. 9, FIG. 10 shows the arrangement of pictures in a compressed signal in coding order.

  That is, the stream splicer 25, based on the control of the CPU 20, performs a B picture 81 following the P picture 71 in the coding order in the encoded video data at the connection point between the re-encoded part and the non-re-encoded part. And the I picture 47 of the compressed material video 2 (I picture not re-encoded) are connected so as to be continuous in coding order, and the I picture 47 of the compressed material video 2 and the B picture 72 of the encoded video data Are connected so as to be continuous in coding order, and in the encoded video data, a B picture 73 following the B picture 72 in the coding order and a P picture 82 of the compressed material video 2 are connected so as to be continuous in the coding order. Connect the streams as Match.

  In other words, the stream splicer 25, in the coding order, does not re-encode an I picture before n re-encoded B pictures following the last I picture or P picture of the re-encoded interval. Connect the streams so that

  Then, the stream splicer 25 supplies the created compressed edited video data to the PCI bridge 17 under the control of the CPU 20, stores it in the memory 18, and supplies it to the decoder 24 for decoding to check the editing result. The baseband signal generated by being output and displayed on a monitor or the like or decoded is output to another device. When the decoder 24 is configured as an independent device, the device corresponding to the decoder 24 is generated as described with reference to FIGS. 9 and 10, in other words, at the end of the re-encoded interval. In response to the supply of compressed video data after editing, in which an I picture that is not re-encoded is inserted before n re-encoded B pictures following the I picture or P picture of The generated baseband signal can be output.

  Next, a VBV buffer in the case of performing editing processing using re-encoding described with reference to FIGS. 9 and 10 will be described with reference to FIG.

  When the editing process using re-encoding described with reference to FIGS. 9 and 10 is performed, an I picture that is not re-encoded is inserted before the last n B pictures of re-encoding in the coding order. The Therefore, as shown in FIG. 11, in the part excluding the last n B pictures from the re-encoding range (the part indicated by E in FIG. 11), the Occupancy of the I picture that is not re-encoded matches that before editing. As described above, information on the generated code amount of the I picture that is re-encoded and is not re-encoded thereafter (the portion indicated by F in FIG. 11) is information on the generated code amount of the corresponding I picture of the compressed material video 2 (The portion indicated by B in FIG. 11) is obtained from the VBV buffer Occupancy.

  After that, in order to prevent the VBV buffer of the compressed video of the portion not re-encoded from overflowing or underflowing, the Occupancy of the I picture or P picture positioned next to the first I picture of the compressed video of the portion not re-encoded is edited. In the last n B pictures (the part indicated by G in FIG. 11) of the re-encoding part, the generated code amount is controlled and encoding is performed so as to match before and after. That is, in FIG. 11, since the generated code amount indicated by C before editing and the generated code amount indicated by H after editing are the same, the Occupancy indicated by I before editing is indicated by J after editing. N B pictures are re-encoded so that the Occupancy matches. Thereby, in FIG. 11, the buffer underflow does not occur in the portions indicated by K and L.

  In this method, since the picture types in the combined portion of the compressed video of the portion where re-encoding is performed and the portion where re-encoding is not performed are stored before and after editing, as shown in FIG. 11, re-encoding is performed. Even if the generated code amount F of the first I picture connected to the portion where re-encoding is not performed and the generated code amount H of the next I picture or P picture are large, If the constraint of the VBV buffer is satisfied with the data of the compressed material video 2, it is possible to perform encoding so that the compressed video after editing is also satisfied.

  As described above, with reference to FIGS. 4 to 11, the first embodiment and the second embodiment of the process executed by the editing apparatus 1 capable of editing the video data compressed using the bidirectional inter-frame prediction. The form has been described. The MPEG syntax handled by the editing apparatus 1 has the following rules in the Q matrix (Q-Matrix: Quantiser Matrix).

  The first rule is that when the load flag is set to 1 in the Sequence Header or Quant Matrix Extension, the Q matrix is loaded and then used until the Q matrix is loaded. It is. The second rule is that a default Q matrix is used in a picture having a Sequence Header. The third rule is that a B header cannot contain a Sequence Header.

  Then, basically, the Q matrix used in the previous picture is also used in the next picture. Therefore, in editing, the compressed video data of the portion that has not been re-encoded and the portion that has been re-encoded are combined, so that inconsistency may occur in the Q matrix to be used, which may cause problems.

  In the Long GOP compression, an I picture is inserted at a certain interval, and a range from an I picture to a picture immediately before the next I picture is 1 GOP. Generally, in order to enable random access, a Sequence Header is inserted before the I picture.

  As described with reference to FIG. 2, when editing is performed by combining compressed video data in units of GOPs in the editing processing of compressed video data having a closed GOP structure, the sequence for each GOP in the compressed video data serving as the editing material. If the header is inserted, even if the compressed video data having a different Q matrix is edited, the compressed video data of the re-encoded portion and the non-re-encoded portion are combined immediately before the Sequence Header. Therefore, in the edited data, no inconsistency occurs in the Q matrix to be used, and no malfunction occurs.

  In contrast, as in the first embodiment or the second embodiment described above, compressed video data having an Open GOP structure that is not a Closed GOP structure is connected regardless of the GOP unit. When editing, the compressed video data of the re-encoded part and the non-re-encoded part are not necessarily combined immediately before the Sequence Header. Therefore, when compressed video data having different Q matrices are edited, inconsistency occurs in the Q matrix before and after editing. Even in the Closed GOP structure, if the Sequence Header is not inserted before the I picture, inconsistency occurs in the Q matrix before and after editing as in the Open GOP structure.

  Hereinafter, a process executed to edit LongGOP OpenGOP compression-encoded data without causing inconsistency in the Q matrix before and after editing will be described with reference to FIGS.

  First, with reference to FIG. 12, an example of occurrence of a problem during editing in the case of the above-described first embodiment will be described.

  Note that the arrangement order of each compressed video in FIG. 12 is described in a coding order, and this data arrangement order is the same as that described with reference to FIG. In FIG. 12, pictures with the same alphabet described as the Q matrix use the same Q matrix. When the Q matrix is A, the default Q matrix is used. To do. The description of “1” in the figure indicates a picture having a Q matrix load flag (Load_Flag) of 1. In a picture having a Q matrix load flag of 1, the Q matrix is loaded. It is assumed that it is set to Further, in the picture of the portion shown in FIG. 12, there is no picture in which the Sequence Header is inserted.

  In the first embodiment, in each of the data of the compressed material video 1 and the compressed material video 2, in the coding order, the beginning of the re-encoded portion is an I picture, and the end point of the re-encoded portion is a GOP break, A predetermined range in the vicinity of the edit point is determined as a re-encode range so as to be other than the B picture, and these data are decoded and re-encoded after being connected at the edit point. The compressed video data generated by re-encoding is connected to the data of the compressed material video 1 and the compressed material video 2 which are not decoded.

  That is, as shown in FIG. 12, the pictures before the B picture 101 of the data of the compressed material video 1 serving as the editing material are supplied to the stream splicer 25 as data used without being re-encoded. In addition, a portion in a predetermined range from the I picture 102 to the B picture 103 in the compressed material video 1 data to be edited material is a re-encoded portion of the data (for example, an I picture 31, The P picture 32 to the P picture 35) are supplied to the decoder 22. Similarly, the pictures from the appropriate picture before the B picture 104 to the B picture 105 of the data of the compressed material video 2 as the editing material, and the B picture 38 and the B picture 39 are re-encoded data, A picture (for example, I picture 40) necessary for reference is supplied to the decoder 23 together with the picture. Also, the I picture 40 of the data of the compressed material video 2 as the editing material and the pictures after the P picture 106 are supplied to the stream splicer 25 as data used without being re-encoded.

  Here, in the data of the compressed material video 1 which is the editing material, in the pictures up to the picture immediately before the B picture 101 in which the Q matrix load flag is set to 1, the Q matrix indicated by the default “A” is displayed. The range from the B picture 101 that is used and the Q matrix load flag is set to 1 to the picture immediately before the B picture 121 that is set to the Q matrix load flag is indicated by “B”. From the B picture 121 on which the Q matrix load flag is set to 1 and the Q matrix load flag is set to 1, and then to the picture in which the Q matrix load flag is set to 1 or the sequence header is inserted In the range, the default Q matrix indicated by “A” is used. .

  Further, in the data of the compressed material video 2 that is the editing material, in the pictures up to the B picture 104 that is the picture immediately before the B picture 122 in which 1 is set in the Q matrix load flag, Q indicated by “B” is displayed. In the range from the B picture 122 in which the matrix is used and the Q matrix load flag is set to 1 to the B picture 38 that is the picture immediately before the B picture 39 in which the Q matrix load flag is set to 1. Is a picture immediately before a B picture that uses a Q matrix indicated by “C” and has a Q matrix load flag set to 1 and then a B picture 123 that has a Q matrix load flag set to 1. In the range up to B picture 107, the Q matrix indicated by “B” In the range from the B picture 123 in which the Q matrix load flag is set to 1 to the next picture in which the Q matrix load flag is set to 1 or the sequence header is inserted. Q matrix indicated by “D” is used.

  The compressed material video 1 and the compressed material video 2, which are editing materials for which the use of the Q matrix is set as described above, are decoded within the above-described range, connected at the editing point, and then encoded and generated. In the Q matrix of each picture of the compressed video data, the Q matrix from the first I picture 108 to the B picture 109 immediately before the B picture 110 in which the Q matrix load flag is set to 1 is the default “A The Q matrix in the picture from the B picture 110 in which the Q matrix load flag is set to 1 to the P picture 45, which is the last picture, is the Q matrix indicated by “D”. .

  However, the Q matrix may change in the compressed edited video after the un-encoded part and the re-encoded part are connected. For example, the Q matrix from the I picture 108 to the B picture 109 immediately before the B picture 110 whose Q matrix load flag is set to 1 is edited even though it was “A” before editing. After that, the Q matrix indicated by “B”, which is the same as the B picture 113 immediately before the I picture 108, becomes inconsistent. In the non-re-encoded part connected to the re-encoded part, the Q matrix up to the B picture 115 immediately before the B picture 116 in which 1 is set in the Q matrix load flag is not edited. Is “C” or “B”, but after editing, it becomes the same Q matrix indicated by “D” as the P picture 45, and inconsistency occurs.

  As described above, in the portion connected for editing, inconsistency occurs unless the connection point is immediately before the Sequence Header or immediately before the picture whose Q matrix load flag is 1, so at the time of the next decoding process, There is a risk that normal decoded video cannot be obtained because the decoding is performed using a Q matrix different from that used for encoding.

  Therefore, in order to prevent the occurrence of inconsistency in the Q matrix and to obtain a normal decoded video during the next decoding process, the picture after the connection point of the portion connected for editing It is necessary to prevent the Q matrix from changing before and after editing.

  Next, referring to FIG. 13, in the first embodiment, it is executed in order to prevent occurrence of Q matrix mismatch and obtain a normal decoded video during the next decoding process. The processing will be described.

  As shown in FIG. 13, in the first embodiment, the re-encoding range is determined so that the re-encoding start point is at the head of the GOP. Therefore, the CPU 20 controls the encoder 27 to insert a Sequence Header into the I picture 108 that is the first picture in the re-encoding range, or to set the Q matrix load flag to 1 so as to load the Q matrix. To do. Based on the control of the CPU 20, the encoder 27 inserts a Sequence Header into the I picture 108 which is the first picture in the re-encoding range, or sets the Q matrix load flag to 1. Accordingly, inconsistency of the Q matrix does not occur before and after editing regardless of the setting of the Q matrix of the B picture 113 that is the picture immediately before the I picture 108 in the compressed edited image data.

  Further, as shown in FIG. 13, in the first embodiment, the picture type at the end point of re-encoding is set to other than B picture (here, P picture 45), and re-encoding is performed. The head of the non-re-encoded part connected to the end point is the I picture 47 in the coding order. Here, when a Sequence Header is inserted before the I picture 47, inconsistency of the Q matrix does not occur. As described above, a Sequence Header is usually inserted before the I picture for random access. Even when the Sequence Header is not inserted before the I picture 47, the Q matrix is loaded even when the Q matrix load flag is set to 1 so that the Q matrix is loaded in the I picture 47. Inconsistency does not occur. Therefore, the CPU 20 determines whether or not a Sequence Header is inserted before the I picture 47, and whether or not 1 is set in the Q matrix load flag so that the Q matrix is loaded in the I picture 47. Determine whether.

  That is, the CPU 20 loads the Q matrix so that the sequence header is inserted in the I picture 40 of the compressed material video 2 corresponding to the I picture 47 and whether the Q matrix is loaded in the I picture 47. It is determined whether or not 1 is set in the flag. The CPU 20 acquires information indicating whether or not the Sequence Header is inserted in the I picture 40 of the compressed material video 2 and whether or not 1 is set in the Q matrix load flag from the decoder 23. Or may be obtained from the CPU 11.

  For example, when the decoder 23 decodes the data of the compressed material video 2, information indicating whether or not a Sequence Header is inserted in the I picture 40 and whether or not 1 is set in the Q matrix load flag. May be extracted and supplied to the CPU 20, or whether or not the Sequence Header is inserted in the I picture 40 and whether or not the Q matrix load flag is set to 1. May be detected and notified to the CPU 20. Alternatively, when the CPU 11 controls the south bridge 15 to read the data of the compressed material video 2 from the HDD 16 and supplies the data to the north bridge 12, the data of the compressed material video 2 of the north bridge 12 is used in the I picture 40. Information indicating whether or not a Sequence Header is inserted and whether or not 1 is set in the Q matrix load flag may be extracted and supplied to the CPU 20, or an I picture The CPU 20 may be notified by detecting whether or not a Sequence Header is inserted at 40 and whether or not 1 is set in the Q matrix load flag.

  When it is determined that the Sequence Header is not inserted before the I picture 47 and that the Q matrix load flag is not set to 1, the CPU 20 determines the Q matrix in the I picture 40 of the compressed material video 2. Information is acquired, the encoder 27 is controlled, and the P picture 45 immediately before the I picture 47 is encoded using this Q matrix. When the Sequence Header is not inserted before the I picture 47 and the Q matrix load flag is not set to 1, the encoder 27 controls the I picture 40 of the compressed material video 2 based on the control of the CPU 20. The P matrix 45 immediately before the I picture 47 is encoded using the Q matrix in, and the Q matrix load flag is set to 1. Note that the CPU 20 may be able to acquire information on the Q matrix in the I picture 40 of the compressed material video 2 from the decoder 23 or may be acquired from the CPU 11.

  For example, when the decoder 23 decodes the data of the compressed material video 2, the information of the Q matrix in the I picture 40 may be extracted and supplied to the CPU 20, or the CPU 11 may be connected to the south bridge 15. When the data of the compressed material video 2 is read from the HDD 16 and supplied to the north bridge 12, the information of the Q matrix in the I picture 40 is extracted from the data of the compressed material video 2 of the north bridge 12, You may enable it to supply to CPU20.

  Also, in the I picture or P picture next to the I picture 47, that is, in the P picture 114 in FIG. 13, the inconsistency of the Q matrix occurs between the I picture 40 and the P picture 106 of the compressed material video 2 before editing. This is a case where the Q matrices are different and 1 is not set to the Q matrix load flag in the P picture 106. Therefore, the CPU 20 determines whether or not the Q matrix is different between the I picture 40 and the P picture 106 of the compressed material video 2 before editing, and the Q matrix is loaded so that the P matrix 106 is loaded with the Q matrix. It is determined whether or not 1 is set in the flag.

  Note that the CPU 20 can acquire information about the Q matrix of the I picture 40 and the P picture 106 of the compressed material video 2 before editing and information indicating the value of the Q matrix load flag of the P picture 106 from the CPU 11. You may be able to do it.

  For example, when the CPU 11 controls the south bridge 15 to read the data of the compressed material video 2 from the HDD 16 and supplies it to the north bridge 12, the compression before the editing is performed from the data of the compressed material video 2 of the north bridge 12. Information about the Q matrix of the I picture 40 and the P picture 106 of the material video 2 and information indicating the value of the Q matrix load flag of the P picture 106 may be extracted and supplied to the CPU 20.

  When the Q matrix of the I picture 40 is different from that of the P picture 106 and the Q matrix load flag is not set to 1 in the P picture 106, the CPU 20 controls the syntax update unit 28 to change the P picture 114 to Quant A Matrix Extension is added, and the Q matrix load flag is set to 1 so that the Q matrix can be loaded in the next decoding. The syntax update unit 28 adds a Quant Matrix Extension to the P picture 114 based on the control of the CPU 20 and sets 1 to the Q matrix load flag.

  Next, referring to the flowchart of FIG. 14, the compressed video data having the OpenGOP structure is edited so that the VBV buffer is not broken as much as possible, and the Q matrix is not inconsistent before and after editing. The editing process 1 in the first embodiment will be described.

  In step S1, the CPU 11 receives an operation input from a user instructing to start editing from an operation input unit (not shown), controls the south bridge 15, and based on the user operation input supplied from the operation input unit (not shown). Then, the compressed material video 1 data and the compressed material video 2 data that have been compression-encoded are read from the HDD 16 and supplied to the memory 18 via the north bridge 12, the PCI bus 14, and the PCI bridge 17. Information indicating the editing point and a command indicating the start of editing are supplied to the CPU 20 via the north bridge 12, the PCI bus 14, the PCI bridge 17, and the control bus 19.

  At this time, the CPU 11 determines whether or not a Sequence Header is inserted in the I picture 40 in the information necessary for re-encoding and connection processing 1 described later, that is, in the data of the compressed material video 2, as necessary. Information indicating whether or not the Q matrix load flag is set to 1, information on the Q matrix in the picture 40 of the compressed material video 2 before I editing, or the I picture 40 of the compressed material video 2 before editing The information of the Q matrix with the P picture 106 and the information indicating the value of the Q matrix load flag of the P picture 106 are read from the HDD 16 and the compressed material video 1 data and the compressed material video 2 are compressed and encoded. Extracted or detected from the data of the north bridge 12, PCI bus 14, PCI bridge 17, and , Via the control bus 19, it may be supplied or notifies the CPU 20.

  In step S2, the memory 18 acquires two pieces of editing material data that have been compression-encoded.

  In step S3, the CPU 20 determines that the re-encoding start point is the head of the GOP and the re-encoding end point picture type is B based on the information indicating the editing point and the command indicating the editing start supplied from the CPU 11. The decoding range of the compression-encoded editing material data is determined so as to be other than the picture (here, P picture 45).

  In step S4, the CPU 20 controls the PCI bridge 17 and is necessary for decoding and re-encoding data in the determined decoding range from the two compression-encoded editing material data stored in the memory 18. Data is extracted and supplied to the decoder 22 and the decoder 23, respectively. At this time, the CPU 20 also controls the PCI bridge 17 to supply the stream splicer 25 with the compression-encoded editing material data of a portion that is not re-encoded. Under the control of the CPU 20, the PCI bridge 17 converts data necessary for decoding and re-encoding data in the determined decoding range from the two compression-encoded editing material data stored in the memory 18. The extracted material data is extracted and supplied to the decoder 22 and the decoder 23, respectively, and the portion of the compression-encoded editing material data not re-encoded is supplied to the stream splicer 25.

  In step S5, the CPU 20 controls the decoder 22 and the decoder 23 to decode data in the determined decoding range. Under the control of the CPU 20, the decoder 22 and the decoder 23 decode the supplied compression-encoded editing material data and supply it to the effect / switch 26.

  At this time, the decoder 23 inserts a sequence header in the I picture 40 as necessary when decoding information necessary for re-encoding and connection processing 1 described later, that is, data of the compressed material video 2. Information indicating whether the Q matrix load flag is set to 1 and information on the Q matrix in the I picture 40 of the compressed material video 2 before editing are extracted or detected, and the control bus You may make it supply or notify to CPU20 via 19. FIG.

  In step S6, the CPU 20 controls the effect / switch 26 to connect the decoded data at the editing point and apply the effect as necessary. Based on the control of the CPU 20, the effect / switch 26 connects the supplied uncompressed decoded video material at an editing point, applies an effect as necessary, and supplies it to the encoder 27.

  In step S7, a re-encoding and connection process 1 described later with reference to FIG. 15 is executed, and the process ends.

  By such processing, the vicinity of the edit point of the compressed video data of the Open GOP structure of Long GOP is partially decoded, and after the decoded uncompressed video signal is connected at a predetermined edit point, re-encoding is performed, By connecting to the compressed video data of the part that has not been decoded and re-encoded, editing of the compressed video data of the Long GOP Open GOP structure can be realized.

  Next, the re-encoding and connection process 1 executed in step S7 in FIG. 14 will be described with reference to the flowchart in FIG.

  In step S21, under the control of the CPU 20, the encoder 27 performs encoding by inserting a sequence header into a picture that is a starting point of re-encoding in a coding order and inserting a sequence header.

  In step S22, the encoder 27 determines whether or not the next picture to be encoded is a picture serving as a connection point with a portion not to be re-encoded, that is, in the case of FIG. Judge whether or not. If it is determined in step S22 that the picture to be encoded next is not a picture that becomes a connection point with a portion that is not re-encoded, the process proceeds to step S25 described later.

  In step S22, when it is determined that the picture to be encoded next is a picture that becomes a connection point with a portion not to be re-encoded, in step S23, the encoder 27 causes the CPU 20 to perform encoding next. The picture that is about to be notified is a picture that becomes a connection point with a portion that is not re-encoded. The CPU 20 indicates whether or not a Sequence Header is inserted in the I picture 40 of the compressed material video 2 supplied from the CPU 11 or the decoder 23, and whether or not 1 is set in the Q matrix load flag. Based on the information, a sequence header is inserted in the first picture of the part not to be re-encoded that is combined with the last picture of re-encoding, that is, I picture 47, or a Q matrix is set to be loaded It is judged whether it is done. In step S23, it is determined that the sequence header is inserted in the first picture of the non-re-encoded part combined with the last picture of re-encoding or the Q matrix is set to be loaded. In this case, the process proceeds to step S25 described later.

  In step S23, it is determined that the sequence header is not inserted in the first picture of the part that is not re-encoded and is combined with the last picture of re-encoding, and the Q matrix is not set to be loaded. In step S24, the CPU 20 obtains the corresponding picture of the compressed material video 2 before editing, that is, the Q matrix of the I picture 40 of the compressed material video 2 from the decoder 23 or the CPU 11, and uses the same Q matrix. The encoder 27 is controlled so that the P picture 45 is encoded. Based on the control of the CPU 20, the encoder 27 encodes the P picture 45, which is a connection point with a portion not to be re-encoded, by using the Q matrix of the I picture 40 of the compressed material video 2 and also loads the Q matrix. Set 1 to the flag.

  If it is determined in step S22 that the picture to be encoded next is not a picture that becomes a connection point with a portion not to be re-encoded, or is combined with the last picture to be re-encoded in step S23. If it is determined that the sequence header is inserted in the first picture of the part that is not re-encoded or the Q matrix is set to be loaded, the encoder 27 controls the CPU 20 in step S25. Based on this, the picture is encoded using the Q matrix determined by the normal algorithm.

  After the process of step S24 or step S25 is completed, in step S26, the encoder 27 determines whether or not re-encoding has been completed. If it is determined in step S26 that re-encoding has not ended, the process returns to step S22, and the subsequent processes are repeated.

  If it is determined in step S26 that the re-encoding has been completed, in step S27, the CPU 20 determines, based on the information supplied from the decoder 23 or the CPU 11, the first non-re-encoded part following the part to be re-encoded. And the second I picture or P picture, that is, whether or not the Q matrix before editing of the I picture 47 and the P picture 114 is the same. If it is determined in step S27 that the first and second I-pictures or P-pictures of the non-re-encoded part following the part to be re-encoded are identical in Q matrix before editing, the process will be described later. Proceed to step S30.

  If it is determined in step S27 that the first and second I-picture or P-picture Q-matrix of the non-re-encoded part following the re-encoded part is not the same, the CPU 20 in step S28 Is based on the information supplied from the decoder 23 or the CPU 11, the second I picture or P picture of the part that is not re-encoded following the part to be re-encoded, that is, the P picture 114 is loaded with the Q matrix. It is determined whether it is set as follows. If it is determined in step S28 that the second I picture or P picture of the non-re-encoded part following the re-encoded part is set to be loaded with the Q matrix, the process will be described later. Proceed to step S30.

  If it is determined in step S28 that the second I picture or P picture of the part that is not re-encoded following the part to be re-encoded is not set to be loaded with the Q matrix, in step S29, the CPU 20 Controls the syntax update unit 28 to update the syntax of the second I picture or P picture of the part that is not re-encoded following the part to be re-encoded, that is, the syntax of the P picture 114, add the QuantMatrixExtention, The Q matrix is set to be loaded at the time of decoding. Under the control of the CPU 20, the syntax update unit 28 updates the syntax of the second I picture or P picture that is not re-encoded following the re-encoded part, that is, the P picture 114, and adds QuantMatrixExtention. Then, the Q matrix is set to be loaded at the next decoding.

  If it is determined in step S27 that the first and second I-picture or P-picture Q-matrix of the non-re-encoded portion following the re-encoded portion is the same, the re-encoding portion is re-encoded in step S28. If it is determined that the second I picture or P picture of the part that is not re-encoded following the part to be encoded is set to be loaded with the Q matrix, or after the end of the process of step S29, In step S30, the CPU 20 controls the stream splicer 25 to connect the part that has not been re-encoded and the part that has not been re-encoded. Based on the control of the CPU 20, the stream splicer 25 includes a part that has not been re-encoded and a part that has not been re-encoded, that is, the B picture 113 and the I picture 108, and the P picture 45 and the I picture 47. The connected compressed edited video data is supplied to the PCI bridge 17 and the decoder 24, the process returns to step S7 in FIG. 14, and the process ends.

  By such processing, no inconsistency occurs in the Q matrix before and after editing, and image deterioration due to editing can be prevented.

  Next, an example of a problem during editing in the case of the above-described second embodiment will be described with reference to FIG.

  Note that the arrangement order of the compressed video in FIG. 16 is described in a coding order, and this data arrangement order is the same as that described with reference to FIG. Also, in FIG. 16, pictures with the same alphabet described as the Q matrix use the same Q matrix. When the Q matrix is A, the default Q matrix is used. To do. It is assumed that the Q matrix is set to be loaded in the picture having the Q matrix load flag set to 1. In FIG. 16, a circle in which a sequence header is inserted is described.

  In the second embodiment, in the compressed material video 1, the start point of the re-encoding section is the last display order of the compressed video of the portion not re-encoded, which is combined before the partially re-encoded compressed video. The picture type of the picture is determined to be an I picture or a P picture. For example, as shown in FIG. 16, the display order of the section to be re-encoded so that the picture type of the last picture becomes P picture (P picture 46) in the display order of the compressed material video 1 of the portion that is not re-encoded. Is determined to be the B picture 36 next to the P picture 35 in the compressed material video 1. In other words, the portion of the compressed video that is not re-encoded is the GOP end position, which facilitates the encoding process.

  In the compressed material video 2, the end point of the re-encoding interval is the display order of the compressed video of the non-re-encoded portion combined after the partially re-encoded compressed video, and the picture type of the first picture is I picture. To be determined. Also, as shown in FIG. 16, in re-encoding, the number of B picture types near the end point of the re-encoding section is the same as that of the compressed material video 2 before editing, and the picture immediately before the B picture The picture type is set to I picture or P picture.

  That is, as shown in FIG. 16, pictures before the B picture 151 of the data of the compressed material video 1 serving as the editing material are supplied to the stream splicer 25 as data used without being re-encoded. In addition, a portion within a predetermined range from the I picture 161 to the B picture 162 of the compressed material video 1 data to be edited material is a re-encoded portion of the data (for example, an I picture 31, The P picture 32 to the P picture 35) are supplied to the decoder 22. Similarly, a picture in a predetermined range including an editing point before the B picture 39 of the data of the compressed material video 2 serving as an editing material is a picture necessary for reference (for example, I It is supplied to the decoder 23 together with the picture 40). Also, the pictures after the I picture 40 and the P picture 152 of the compressed material video 2 data as the editing material are supplied to the stream splicer 25 as data used without being re-encoded.

  Here, in the data of the compressed material video 1 that is the editing material, in the pictures up to the B picture 151 in which 1 is set in the Q matrix load flag, the default Q matrix indicated by “A” is used. In the range from the B picture 151 in which the matrix load flag is set to 1 to the picture immediately before the B picture 163 in which the Q matrix load flag is set to 1, the Q matrix indicated by “B” is used. After the B picture 163 with the Q matrix load flag set to 1, after the B picture 163 is set to the Q matrix load flag, or within the range up to the picture in which the Sequence Header is inserted, the default is set. A Q matrix indicated by “A” is used.

  In addition, in the data of the compressed material video 2 that is the editing material, 1 is set in the Q matrix load flag, and 1 is set in the Q matrix load flag from the I picture 164 in which the Sequence Header is inserted. In the pictures up to the picture immediately before the B picture 165, the Q matrix indicated by “B” is used. From the B picture 165 in which the Q matrix load flag is set to 1, the Q matrix load flag is set to 1 next. In the range up to the B picture 153 that is the picture immediately before the set B picture 166, the Q matrix indicated by “C” is used, and after the B picture 166 having the Q matrix load flag set to 1, Next, Q matrix load flag is set to 1 or Sequ In the range up to the picture in which the ence header is inserted, the Q matrix indicated by “D” is used.

  The compressed material video 1 and the compressed material video 2, which are editing materials for which the use of the Q matrix is set as described above, are decoded within the above-described range, connected at the editing point, and then encoded and generated. In the compressed video data, the Q matrix from the first I picture 154 to the picture immediately before the B picture 167 whose Q matrix load flag is set to 1 is the Q matrix indicated by the default “A”. The Q matrix from the B picture 167 in which 1 is set to the matrix load flag to the B picture 73 is a Q matrix indicated by “D”.

  However, since the Sequence Header is not inserted in the I picture 154 in the compressed edited video after being connected to the part that is not re-encoded, the B picture in which the Q matrix load flag is set to 1 from the I picture 154 Although the Q matrix up to the picture immediately before 167 is “A” before editing, the Q matrix indicated by “B” is the same as the B picture 151 immediately before I picture 154 after editing. As a result, inconsistency occurs. Further, in the case shown in FIG. 16, the non-recoded I picture 47 connected to the re-encoded portion has no Sequence Header inserted and the Q matrix load flag is not 1. Despite the fact that the Q matrix of the I picture 40 before editing corresponding to the picture 47 is “C”, the Q matrix indicated by “D” is the same as that of the immediately preceding B picture 81, and inconsistency occurs. It has occurred. In the case of FIG. 16, the Q matrix of the next B picture 72 matches with “D” before and after editing, and no inconsistency occurs. However, whether the Sequence Header is inserted in the I picture 47 or Q When the matrix load flag is 1, the edited Q matrix becomes the same as the I picture 47, and inconsistency may occur. Then, the picture from the P picture 82 connected to the B picture 73 which is the last picture to be encoded to the picture in which the Sequence Header is inserted next or the Q matrix load flag is 1, that is, in FIG. In some cases, the Q matrix of the P picture 82 and the B picture 155 is “C” before editing, but the same “D” as the B picture 73 immediately before the P picture 82 after editing. The Q matrix shown in FIG.

  In this way, if the Q matrix is different before and after the connection point of the portion connected for editing, inconsistency occurs unless the connection point is immediately before the Sequence Header or immediately before the picture whose Q matrix load flag is 1. At the time of the next decoding process, since decoding is performed using a Q matrix different from that at the time of encoding, there is a possibility that a normal decoded video cannot be obtained.

  Therefore, in order to prevent the occurrence of inconsistency in the Q matrix and to obtain a normal decoded video during the next decoding process, the picture after the connection point of the portion connected for editing It is necessary to prevent the Q matrix from changing before and after editing.

  Next, referring to FIG. 17, in the second embodiment, it is executed to prevent occurrence of Q matrix mismatch and to obtain a normal decoded video at the next decoding processing. The processing will be described.

  As shown in FIG. 17, in the second embodiment, the re-encoding range is determined so that the re-encoding start point is at the head of the GOP. Therefore, the CPU 20 controls the encoder 27 to insert a Sequence Header into the I picture 154 that is the first picture in the re-encoding range, or to set the Q matrix load flag to 1 so as to load the Q matrix. To do. Based on the control of the CPU 20, the encoder 27 inserts a Sequence Header into the I picture 154 that is the first picture in the re-encoding range, or sets the Q matrix load flag to 1. As a result, inconsistency of the Q matrix does not occur before and after editing regardless of the setting of the Q matrix of the B picture 151 that is the picture immediately before the I picture 154 in the compressed edited image data.

  Also, as shown in FIG. 17, in the second embodiment, the end point of the re-encoded section in the compressed material video 2 is the portion of the portion that is not re-encoded that is combined after the re-encoded compressed video. In the display order of the compressed video, the picture type of the first picture is determined to be I picture. In re-encoding, the number of B picture types near the end point of the re-encoding section is the same as that of the compressed material video 2 before editing. The picture type of the picture immediately before the B picture is the I picture or P picture. The connection between the re-encoded portion and the portion corresponding to the compressed material video 2 that is not re-encoded is a coding order, and is immediately before the continuous B picture near the end point of the re-encoding section, that is, immediately before the B pictures 72 and 73. The leading I picture 47 of the portion corresponding to the compressed material video 2 that is not re-encoded is inserted, and the B picture 72 and the B picture 73 are followed by the P picture 82 corresponding to the P picture 152 of the compressed material video 2. It is made like that.

  Here, when a Sequence Header is inserted before the I picture 47, inconsistency of the Q matrix of the I picture 47 does not occur. As described above, a Sequence Header is usually inserted before the I picture for random access. Even when the Sequence Header is not inserted before the I picture 47, the Q matrix is loaded even when the Q matrix load flag is set to 1 so that the Q matrix is loaded in the I picture 47. Inconsistency does not occur. Therefore, the CPU 20 determines whether or not a Sequence Header is inserted before the I picture 47, and whether or not 1 is set in the Q matrix load flag so that the Q matrix is loaded in the I picture 47. Determine whether.

  That is, the CPU 20 loads the Q matrix so that the sequence header is inserted in the I picture 40 of the compressed material video 2 corresponding to the I picture 47 and whether the Q matrix is loaded in the I picture 47. It is determined whether or not 1 is set in the flag. The CPU 20 acquires information indicating whether or not the Sequence Header is inserted in the I picture 40 of the compressed material video 2 and whether or not 1 is set in the Q matrix load flag from the decoder 23. Or may be acquired from the CPU 11.

  For example, when the decoder 23 decodes the data of the compressed material video 2, it detects whether or not a Sequence Header is inserted in the I picture 40 and whether or not 1 is set in the Q matrix load flag. Alternatively, the information indicating these may be extracted and supplied to the CPU 20, or the CPU 11 controls the south bridge 15 to read the data of the compressed material video 2 from the HDD 16, and the north bridge 12, whether or not a Sequence Header is inserted in the I picture 40 from the compressed material video 2 of the north bridge 12 and whether or not the Q matrix load flag is set to 1 is detected. Information indicating these may be extracted and supplied to the CPU 20.

  When it is determined that the Sequence Header is not inserted before the I picture 47 and that the Q matrix load flag is not set to 1, the CPU 20 determines the Q matrix in the I picture 40 of the compressed material video 2. The information is acquired, and the encoder 27 is controlled to encode the B picture 81 immediately before the I picture 47 using this Q matrix and set the Q matrix load flag to 1. When the Sequence Header is not inserted before the I picture 47 and the Q matrix load flag is not set to 1, the encoder 27 controls the I picture 40 of the compressed material video 2 based on the control of the CPU 20. The B picture 81 is encoded using the Q matrix in, and 1 is set in the Q matrix load flag. Note that the CPU 20 may be able to acquire information on the Q matrix in the I picture 40 of the compressed material video 2 from the decoder 23 or may be acquired from the CPU 11.

  For example, when the decoder 23 decodes the data of the compressed material video 2, the information of the Q matrix in the I picture 40 may be extracted and supplied to the CPU 20, or the CPU 11 may be connected to the south bridge 15. When the data of the compressed material video 2 is read from the HDD 16 and supplied to the north bridge 12, the Q matrix information in the I picture 40 is extracted from the compressed material video 2 of the north bridge 12, and the CPU 20 It may be possible to supply.

  Also, in the coding order, the B picture 72 connected next to the I picture 47 is encoded with the same Q matrix as the I picture 47, or the Q matrix is loaded. If the Q matrix load flag is set to 1, no Q matrix mismatch occurs. Therefore, the CPU 20 acquires information on the Q matrix in the I picture 40 of the compressed material video 2, and the B picture 72 connected next to the I picture 47 is the same as the Q matrix in the I picture 40 corresponding to the I picture 47. Whether the Q matrix is encoded, and whether the Q matrix load flag is set to 1 or not. Note that the CPU 20 may be able to acquire the information of the Q matrix in the I picture 40 of the compressed material video 2 from the decoder 23 in the same manner as described above, or may be acquired from the CPU 11. You may be able to.

  Then, the CPU 20 does not encode the B picture 72 connected next to the I picture 47 with the same Q matrix as the Q matrix in the I picture 40 corresponding to the I picture 47, and sets the Q matrix load flag. If 1 is not set, the encoder 27 is controlled to set 1 to the Q matrix load flag of the B picture 72. The encoder 27 sets 1 to the Q matrix load flag of the B picture 72 based on the control of the CPU 20.

  In order to prevent inconsistency of the Q matrix in the picture following the last picture to be re-encoded in the coding order, that is, the P picture 82 connected next to the B picture 73, the B picture 73 is edited. The encoding may be performed with the same Q matrix as the B picture 39 of the previous compressed material video 2. In this way, in the P picture 82 of the compressed material video 2 (the picture corresponding to the P picture 152 following the B picture 39 of the compressed material video 2 before editing), 1 is set in the Q matrix load flag. Regardless, it is possible to prevent inconsistency of the Q matrix in the P picture 82 connected next to the B picture 73.

  That is, the CPU 20 acquires information on the Q matrix in the B picture 39 of the compressed material video 2 before editing, controls the encoder 27, encodes the B picture 73 using this Q matrix, and loads the Q matrix. Set the flag to 1. Based on the control of the CPU 20, the encoder 27 encodes the B picture 73 using the Q matrix in the B picture 39 of the compressed material video 2 and sets 1 to the Q matrix load flag. Note that the CPU 20 can acquire information on the Q matrix in the B picture 39 of the compressed material video 2 from the CPU 11.

  For example, when the CPU 11 controls the south bridge 15 to read the data of the compressed material video 2 from the HDD 16 and supplies the data to the north bridge 12, the data of the compressed material video 2 of the north bridge 12 is converted into the B picture 39. Information of the Q matrix can be extracted and supplied to the CPU 20.

  That is, the CPU 20 supplies the information of the Q matrix in the B picture 39 supplied from the CPU 112 to the encoder 27. The encoder 27 encodes the B picture 73 using this Q matrix under the control of the CPU 20.

  Next, referring to the flowchart in FIG. 18, the compressed video data having the OpenGOP structure is edited so as not to break the VBV buffer, and the Q matrix is not inconsistent before and after editing. The editing process 2 in the second embodiment will be described.

  In step S41, the CPU 11 receives an operation input from a user instructing to start editing from an operation input unit (not shown), controls the south bridge 15, and based on the user operation input supplied from the operation input unit (not shown). Then, the compressed material video 1 data and the compressed material video 2 data that have been compression-encoded are read from the HDD 16 and supplied to the memory 18 via the north bridge 12, the PCI bus 14, and the PCI bridge 17. Information indicating the editing point and a command indicating the start of editing are supplied to the CPU 20 via the north bridge 12, the PCI bus 14, the PCI bridge 17, and the control bus 19.

  At this time, the CPU 11 determines whether or not a Sequence Header is inserted in the I picture 40 in the information necessary for re-encoding and connection processing 1 described later, that is, in the data of the compressed material video 2, as necessary. Information indicating whether or not 1 is set in the Q matrix load flag, information on the Q matrix of the I picture 40 of the compressed material video 2 before editing, or information on the Q matrix of the B picture 39 from the HDD 16 Extracted or detected from the compressed and encoded compressed material video 1 data and compressed material video 2 data that have been read, via the north bridge 12, the PCI bus 14, the PCI bridge 17, and the control bus 19, You may make it supply to CPU20.

  In step S42, the memory 18 acquires two pieces of editing material data that have been compression-encoded.

  In step S43, the CPU 20 determines that the picture type of the last picture in the display order of the compressed material video 1 of the portion not to be re-encoded is P based on the information indicating the editing point and the command indicating the editing start supplied from the CPU 11. The decoding range of the compression-encoded editing material data is determined so that the picture type of the first picture becomes I picture in the display order of the compressed material video 2 of the portion that is a picture and is not re-encoded.

  In step S44, the CPU 20 is required to control the PCI bridge 17 to decode and re-encode data in the determined decoding range from the two compression-encoded editing material data stored in the memory 18. Data is extracted and supplied to the decoder 22 and the decoder 23, respectively. At this time, the CPU 20 also controls the PCI bridge 17 to supply the stream splicer 25 with the compression-encoded editing material data of a portion that is not re-encoded. Under the control of the CPU 20, the PCI bridge 17 converts data necessary for decoding and re-encoding data in the determined decoding range from the two compression-encoded editing material data stored in the memory 18. The extracted material data is extracted and supplied to the decoder 22 and the decoder 23, respectively, and the portion of the compression-encoded editing material data not re-encoded is supplied to the stream splicer 25.

  In step S45, the CPU 20 controls the decoder 22 and the decoder 23 to decode the data in the determined decoding range. Under the control of the CPU 20, the decoder 22 and the decoder 23 decode the supplied compression-encoded editing material data and supply it to the effect / switch 26.

  At this time, the decoder 23 inserts a sequence header in the I picture 40 as necessary when decoding information necessary for re-encoding and connection processing 1 described later, that is, data of the compressed material video 2. Information indicating whether the Q matrix load flag is set to 1 or whether the Q matrix information of the I picture 40 of the compressed material video 2 before editing is extracted or detected, and the control bus It may be supplied to the CPU 20 via 19.

  In step S46, the CPU 20 controls the effect / switch 26 to connect the decoded data at the editing point and apply the effect as necessary. Based on the control of the CPU 20, the effect / switch 26 connects the supplied uncompressed decoded video material at an editing point, applies an effect as necessary, and supplies it to the encoder 27.

  In step S47, the re-encoding and connection process 2 described later with reference to FIGS. 19 and 20 is executed, and the process ends.

  By such processing, the vicinity of the edit point of the compressed video data of the Open GOP structure of Long GOP is partially decoded, and after the decoded uncompressed video signal is connected at a predetermined edit point, re-encoding is performed, By connecting to the compressed video data of the part that has not been decoded and re-encoded, editing of the compressed video data of the Long GOP Open GOP structure can be realized.

  Next, the re-encoding and connection process 2 executed in step S47 in FIG. 18 will be described with reference to FIGS.

  In step S61, under the control of the CPU 20, the encoder 27 performs encoding by setting the picture that is the starting point of re-encoding in the coding order as an I picture and inserting a sequence header.

  In step S62, the encoder 27 determines whether or not the next picture to be encoded is a picture that becomes the first connection point with the part that is not re-encoded, that is, in the case of FIG. Judge whether there is. If it is determined in step S62 that the picture to be encoded next is not a picture that is the first connection point with a portion that is not re-encoded, the process proceeds to step S65 described later.

  If it is determined in step S62 that the next picture to be encoded is a picture that is the first connection point with the part that is not re-encoded, the encoder 27 sends the next encoding to the CPU 20 in step S63. It is notified that the picture to be performed is the picture that is the first connection point with the part that is not re-encoded. The CPU 20 indicates whether or not a Sequence Header is inserted in the I picture 40 of the compressed material video 2 supplied from the CPU 11 or the decoder 23, and whether or not 1 is set in the Q matrix load flag. Based on the information, the sequence header is inserted or the Q matrix is loaded in the leading I picture of the part that is not re-encoded and combined before the consecutive B pictures at the end of the re-encoding It is judged whether it is done. In step S63, a sequence header is inserted or a Q matrix is set to be loaded in the first I picture of the part that is not re-encoded and joined before the consecutive B pictures at the end of re-encoding. If it is determined, the process proceeds to step S65 described later.

  In step S63, a setting is made so that the sequence header is not inserted and the Q matrix is loaded in the first I picture of the part that is not re-encoded and joined before the consecutive B pictures at the end of re-encoding. If it is determined that it is not, in step S64, the CPU 20 acquires from the decoder 23 or the CPU 11 the corresponding picture of the compressed material video 2 before editing, that is, the Q matrix of the I picture 40 of the compressed material video 2. The encoder 27 is controlled so that the B picture 81 is encoded using the same Q matrix. Based on the control of the CPU 20, the encoder 27 encodes the picture that is the first connection point with the portion that is not re-encoded, that is, the B picture 81 using the Q matrix of the I picture 40 of the compressed material video 2.

  If it is determined in step S62 that the next picture to be encoded is not a picture that is the first connection point with a portion that is not re-encoded, in step S63, the B pictures that are consecutive at the end of the re-encoding are determined. When it is determined that the sequence header is inserted in the first I picture of the part that is not re-encoded before being combined or the Q matrix is set to be loaded, or the process of step S64 In step S65, the encoder 27 determines whether or not the next picture to be encoded is a picture connected to the first I picture of the part that is not re-encoded, that is, the B picture 72 in FIG. Determine whether. If it is determined in step S65 that the picture to be encoded next is not a picture connected to the first I picture of the part that is not re-encoded, the process proceeds to step S69 described later.

  If it is determined in step S65 that the next picture to be encoded is a picture connected to the first I picture of the part that is not re-encoded, the encoder 27 sends the next to the CPU 20 in step S66. The picture to be encoded is notified that it is a picture connected to the first I picture of the part that is not re-encoded, and information about the Q matrix to be used to encode this picture, and Q Information indicating whether 1 is set in the matrix load flag is supplied. The CPU 20 supplies information related to the Q matrix to be used for encoding the picture connected to the I picture supplied from the encoder 27, and the compressed material video 2 before editing supplied from the CPU 11 or the decoder 23. A picture corresponding to a picture connected to the leading I picture of the part that is not re-encoded, that is, based on the information about the Q matrix of the I picture 40 of the compressed material video 2, the leading I picture of the part that is not re-encoded, It is determined whether the Q matrices of the pictures connected to this are the same. If it is determined in step S66 that the leading I picture of the part that is not re-encoded and the Q matrix of the picture connected thereto are the same, the process proceeds to step S69 described later.

  If it is determined in step S66 that the leading I picture of the portion that is not re-encoded and the Q matrix of the picture connected thereto are not the same, in step S67, the CPU 20 determines that the leading I picture of the portion that is not re-encoded. It is determined whether the picture connected to is set so that the Q matrix is loaded. If it is determined in step S67 that the picture connected to the first I picture of the part that is not re-encoded is set to be loaded with the Q matrix, the process proceeds to step S69 described later.

  If it is determined in step S67 that the picture connected to the first I picture of the part that is not re-encoded is not set to be loaded with the Q matrix, the CPU 20 controls the encoder 27 in step S68. Thus, the picture connected to the first I picture of the part that is not re-encoded, that is, the B picture 72 in FIG. 17 is set to be loaded with the Q matrix. Based on the control of the CPU 20, the encoder 27 is set so that the Q matrix is loaded, and encodes a picture connected to the first I picture of the part that is not re-encoded, that is, the B picture 72 in FIG.

  If it is determined in step S65 that the next picture to be encoded is not a picture connected to the leading I picture of the part that is not re-encoded, the leading I picture of the part that is not re-encoded is determined in step S66. If it is determined that the Q matrices of the pictures connected thereto are the same, in step S67, the picture connected to the first I picture of the portion that is not re-encoded is set so that the Q matrix is loaded. If it is determined that, or after the end of the process of step S68, in step S69, the encoder 27 determines that the next encoded picture is the last B picture of the part to be re-encoded, that is, the B picture in FIG. It is determined whether or not it is a picture 73.

  If it is determined in step S69 that the next picture to be encoded is the last B picture of the part to be re-encoded, in step S70, the encoder 27 informs the CPU 20 that the picture to be encoded next is Notify that it is the last B picture of the part to be re-encoded. The CPU 20 acquires the Q matrix of the B picture 39, which is the corresponding B picture of the compressed material video 2 before editing, supplied from the CPU 11, controls the encoder 27, and uses the acquired Q matrix of the B picture 39. Thus, encoding of the last B picture of the part to be re-encoded is executed. Based on the control of the CPU 20, the encoder 27 encodes the last B picture of the portion to be re-encoded, that is, the B picture 73 in FIG. 17, using the Q matrix of the B picture 39.

  If it is determined in step S69 that the next picture to be encoded is not the last B picture of the part to be re-encoded, that is, one of the pictures not connected to the part that is not re-encoded, in step S71, The encoder 27 performs encoding using a Q matrix defined by a normal algorithm.

  After the process of step S70 or step S71 is completed, in step S72, the encoder 27 determines whether or not all the data of the portion to be re-encoded has been re-encoded. If it is determined in step S72 that all the data in the re-encoded portion has not been re-encoded, the process returns to step S62, and the subsequent processes are executed.

  If it is determined in step S72 that all the data in the re-encoded portion has been re-encoded, a connection process described later with reference to FIG. 21 is executed in step S73, and the process proceeds to step S47 in FIG. Return and the process is terminated.

  By such processing, it is possible to prevent inconsistency of the Q matrix before and after editing at the connection point between the re-encoded portion and the non-re-encoded portion. Can be prevented.

  Next, the connection process executed in step S73 of FIG. 20 will be described with reference to the flowchart of FIG.

  In step S91, the stream splicer 25 supplies the data of the compressed material video 1 of the portion not re-encoded supplied from the PCI bridge 17, that is, in the case of FIG. 9 or FIG. The data of the previous picture is acquired (that is, the edited P picture 46).

  In step S92, the stream splicer 25 corresponds to the re-encoded compressed video data near the edit point supplied from the encoder 27, that is, in the case of FIG. 9, corresponding to the B picture 41 to the I picture 74 in the display order. Get a picture.

  In step S93, the stream splicer 25 encodes the re-encoded compressed video data near the editing point for encoding reference, that is, in the case of FIG. 9, P picture 41 and I picture 74. The picture corresponding to is discarded, and the portion of the compressed material video 1 that is not re-encoded is connected to the re-encoded compressed video data. That is, in the case of FIGS. 9 and 17, the stream splicer 25 connects the P picture 46 and the B picture 42 so as to be continuous in the display order.

  In step S94, the stream splicer 25 supplies the data of the compressed material video 2 of the portion not re-encoded supplied from the PCI bridge 17, that is, in the case of FIG. 9 or FIG. Data of pictures after (that is, I picture 47 after editing) is acquired.

In step S95, the stream splicer 25, in the case of FIG. 9, FIG. 10, or FIG. 17, B _{12 in the (} n + 1) th picture from the end of the re-encoded compressed video data near the editing point. Next to the picture corresponding to the picture 81, the first I picture in the coding order of the compressed material video 2 of the portion not re-encoded, that is, the picture corresponding to the I ₂ picture 47 in the case of FIG. 9, FIG. 10 or FIG. Connect

In step S96, the stream splicer 25 selects the first I picture in the coding order of the portion of the compressed material video 2 that is not re-encoded, that is, the picture corresponding to the I ₂ picture 47 in the case of FIG. 9, FIG. 10, or FIG. Further, n B pictures from the end of the compressed video data near the re-encoded edit point, that is, B ₀ picture 72 and B ₁ picture 73 are connected in the case of FIG. 9, FIG. 10 or FIG.

Then, in step S97, the stream splicer 25, the last B picture of the compressed video data in the vicinity of the editing point is re-encoded, i.e., FIG. 9, in the case of FIG. 10 or FIG. 17, the following B ₁ picture 73 In the case of the second I or P picture of the compressed material video 2 of the portion not to be re-encoded, that is, in the case of FIG. 9, FIG. 10, or FIG. 17, the P picture 82 is connected, and the processing returns to step S73 of FIG. The process is terminated.

  By such processing, when editing the compressed material video of OpenGOP of LongGOP, the generated code amount is controlled so that the VBV buffer does not break down, and the compression code of the re-encoded part whose picture type at the time of re-encoding is determined It is possible to connect the encoded data and the compressed encoded data of the part that has not been re-encoded.

  In the second embodiment, it has been described that the picture type of the picture after the (n + 1) th picture from the last in the display order is controlled so as not to be changed before and after editing, but is re-encoded. The present invention is also applicable when the picture type of a picture subsequent to that including a predetermined I picture or P picture in the range is controlled so as not to be changed before and after editing.

  In this way, by applying the present invention, in the editing using the method of partially decoding and re-encoding the video material compressed by the Open GOP method of Long GOP, the consistency of the Q matrix before and after editing is improved. Can be kept. In the editing of compressed video data having a different Q matrix, it is possible to select an optimum Q matrix at the time of encoding, so that it is possible to achieve high image quality of the compressed video.

  The series of processes described above can also be executed by software. The software is a computer in which the program constituting the software is incorporated in dedicated hardware, or various functions can be executed by installing various programs, for example, a general-purpose personal computer For example, it is installed from a recording medium. In this case, for example, the editing apparatus 1 described with reference to FIG. 4 includes a personal computer 301 as shown in FIG.

  In FIG. 22, a CPU (Central Processing Unit) 311 performs various processes according to a program stored in a ROM (Read Only Memory) 312 or a program loaded from a storage unit 318 to a RAM (Random Access Memory) 313. Execute. The RAM 313 also appropriately stores data necessary for the CPU 311 to execute various processes.

  The CPU 311, ROM 312, and RAM 313 are connected to each other via a bus 314. An input / output interface 315 is also connected to the bus 314.

  The input / output interface 315 includes an input unit 316 including a keyboard and a mouse, an output unit 317 including a display and a speaker, a storage unit 318 including a hard disk, and a communication unit 319 including a modem and a terminal adapter. It is connected. The communication unit 319 performs communication processing via a network including the Internet.

  A drive 320 is connected to the input / output interface 315 as necessary, and a magnetic disk 331, an optical disk 332, a magneto-optical disk 333, a semiconductor memory 334, or the like is appropriately mounted, and a computer program read from them is loaded. Installed in the storage unit 318 as necessary.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 22, this recording medium is distributed to supply a program to a user separately from the main body of the apparatus, and includes a magnetic disk 331 (including a floppy disk) on which a program is stored, an optical disk 332 ( Package media including CD-ROM (compact disk-read only memory), DVD (including digital versatile disk), magneto-optical disk 333 (including MD (mini-disk) (trademark)), or semiconductor memory 334 In addition to being configured, it is configured by a ROM 312 in which a program is stored and a hard disk included in the storage unit 318, which is supplied to the user in a state of being incorporated in the apparatus main body in advance.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the above-described embodiment, the editing device 1 has been described as having a decoder and an encoder. However, even when the decoder and the encoder are each configured as an independent device, The present invention is applicable. For example, as shown in FIG. 17, a decoding device 371 that decodes stream data and converts it into a baseband signal, and an encoding device 372 that encodes baseband signals and converts them into stream data are configured as independent devices. May be.

  At this time, the decoding device 371 not only decodes the compressed encoded data that is the video material and supplies it to the encoding device 372, but also is partially encoded by the encoding device 372 by applying the present invention. Thereafter, the compressed and encoded data generated by editing can be supplied, decoded, and converted into a baseband signal. The edited stream converted into the baseband signal is supplied to a predetermined display device and displayed, for example, or output to another device and subjected to necessary processing.

  Further, in the above-described embodiment, the decoders 22 to 24 do not completely decode the supplied compressed encoded data, and the corresponding encoder 27 partially converts the corresponding portion of the incompletely decoded data. The present invention can also be applied to the case of encoding to the above.

  For example, when the decoders 22 to 24 perform only the decoding and inverse quantization on the VLC code and have not performed the inverse DCT transform, the encoder 27 performs the quantization and variable length coding processing. Do not do. It goes without saying that the present invention can also be applied to an encoder that performs such partial encoding (encoding from an intermediate stage).

  Further, in the above-described embodiment, when the encoder 27 encodes the baseband signal completely decoded by the decoders 22 to 24 (for example, DCT conversion and quantization are performed but variable length coding processing is performed). And the decoders 22 to 24 are not completely decoded (for example, only decoding and inverse quantization are performed on the VLC code, and no inverse DCT transform is performed), so that encoding is performed halfway. The present invention can also be applied to the case where the encoder 27 further encodes the data to the middle stage (for example, the quantization is performed but the variable length encoding process is not performed).

  Furthermore, the decoding device 371 shown in FIG. 17 does not completely decode the supplied stream data, and the corresponding encoding device 372 partially encodes the corresponding part of the incompletely decoded data. Even in this case, the present invention is applicable.

  For example, when the decoding device 371 only performs decoding and inverse quantization on the VLC code and has not performed the inverse DCT transform, the encoding device 372 performs the quantization and variable length coding processing, but the DCT transform No processing is performed. In the decoding process of the decoding device 371 that performs such partial decoding processing (decoding up to the middle stage) and the encoding processing of the encoding device 372 that performs encoding (encoding from the middle stage), the present invention is Needless to say, it can be applied.

  Further, when the encoding device 372 encodes the baseband signal completely decoded by the decoding device 371 to an intermediate stage (for example, DCT transformation and quantization are performed but variable length coding processing is not performed), Since the decoding device 371 has not completely decoded (for example, only decoding and inverse quantization are performed on the VLC code and no inverse DCT conversion is performed), the data encoded to the middle stage is encoded. The present invention can also be applied to a case where the encoding device 372 further encodes to an intermediate stage (for example, quantization is performed but variable length encoding processing is not performed).

  Further, the encoding device 351 that performs such partial decoding (executes some of the decoding process steps) and performs partial encoding (executes some of the encoding process steps). The present invention can also be applied to the transcoder 381 configured by the encoding device 372. As such a transcoder 381, for example, an editing device 382 for performing editing such as splicing, that is, an editing device having a function that can be executed by the stream splicer 25 and the effect / switch 26 of the editing device 1 described above is used. Used in cases.

  Furthermore, in the above-described embodiment, the CPU 11 and the CPU 20 are configured in different forms. However, the present invention is not limited to this, and a form configured as one CPU that controls the entire editing apparatus 1 is also conceivable. Similarly, in the above-described embodiment, the memory 13 and the memory 21 are configured in different forms, but the present invention is not limited to this, and a form configured as one memory in the editing apparatus 1 is also conceivable.

  Further, in the above-described embodiment, the HDD 16, the decoders 22 to 24, the stream splicer 25, the effect / switch 26, and the encoder 27 are connected via a bridge and a bus, respectively, and integrated as an editing device. However, the present invention is not limited to this. For example, some of these components may be connected from the outside by wire or wirelessly. In addition, they may be connected to each other in various connection forms.

  Furthermore, in the above-described embodiment, the case where the compressed editing material is stored in the HDD has been described. However, the present invention is not limited to this, and for example, an optical disk, a magneto-optical disk, a semiconductor memory, a magnetic memory The present invention can also be applied when editing processing is performed using editing materials recorded on various recording media such as disks.

  Further, in the above-described embodiment, the decoders 22 to 24, the stream splicer 25, the effect / switch 26, and the encoder 27 are mounted on the same expansion card (for example, PCI card, PCI-Express card). For example, when the transfer speed between cards is high by a technique such as PCI-Express, they may be mounted on different expansion cards.

  The present invention can be applied to an information processing apparatus of a system having an encoding or decoding algorithm similar to the MPEG information processing apparatus.

It is a figure for demonstrating edit and partial re-encoding. It is a figure for demonstrating the edit and partial re-encoding in ClosedGOP. It is a figure for demonstrating the arrangement | sequence of the picture in a display order about the editing and partial re-encoding by ClosedGOP. It is a block diagram which shows the structure of the editing apparatus 1 to which this invention is applied. FIG. 5 is a diagram for describing partial re-encoding and editing processing that can be executed in the editing apparatus 1 of FIG. 4. FIG. 6 is a diagram for explaining the arrangement of pictures in a display order for the partial re-encoding and editing processing of FIG. 5. FIG. 6 is a diagram for explaining a VBV buffer when the partial re-encoding and editing process of FIG. 5 is executed. FIG. 6 is a diagram for describing a case where a VBV buffer breaks down when partial re-encoding and editing processing of FIG. 5 are executed. It is a figure for demonstrating the partial re-encoding and edit process which considered the VBV buffer. FIG. 10 is a diagram for explaining the arrangement of pictures in the display order for the partial re-encoding and editing processing of FIG. 9. FIG. 10 is a diagram for explaining a VBV buffer when the partial re-encoding and editing process of FIG. 9 is executed. It is a figure for demonstrating the mismatch of Q matrix which may generate | occur | produce in 1st Embodiment. It is a figure for demonstrating the process for preventing inconsistency of Q matrix in 1st Embodiment. 10 is a flowchart for explaining editing processing 1; 10 is a flowchart for explaining re-encoding and connection processing 1; It is a figure for demonstrating the mismatch of Q matrix which may generate | occur | produce in 2nd Embodiment. It is a figure for demonstrating the process for preventing inconsistency of Q matrix in 2nd Embodiment. 10 is a flowchart for explaining editing processing 2; 10 is a flowchart for explaining re-encoding and connection processing 2; 10 is a flowchart for explaining re-encoding and connection processing 2; It is a flowchart for demonstrating a connection process. It is a block diagram which shows the structure of a personal computer. It is a figure for demonstrating the structure of the different apparatus which can apply this invention.

Explanation of symbols

  1 Editing Device, 11 CPU, 16 HDD, 20 CPU, 22-24 Decoder, 25 Stream Splicer, 26 Effect / Switch, 27 Encoder, 28 Syntax Update Unit

Claims (14)

In an information processing apparatus that executes a process of editing by connecting the front end of the second compressed video data to the rear end of the first compressed video data,
Decoding means for decoding video data in a predetermined range near an edit point of the first compressed video data and the second compressed video data;
A first non-compressed video signal generated by decoding the first compressed video data by the decoding means, and a second non-compressed signal generated by decoding the second compressed video data by the decoding means Connecting means for connecting a video signal at the editing point to generate a third uncompressed video signal;
Encoding means for encoding the third uncompressed video signal generated by being connected by the connection means to generate third compressed video data;
Control means for acquiring information relating to a Q matrix of a predetermined picture of the second compressed video data, and controlling encoding using the Q matrix by the encoding means;
The first compressed video data in a predetermined range other than the vicinity of the editing point and the second compressed video data in a predetermined range other than the vicinity of the editing point, and the first compressed video data generated by being encoded by the encoding means. connect 3 the compressed video data, the information processing apparatus, characterized in that Ru and an edited video data generating means for generating compressed encoded edited image data. The control means includes
Of the second compressed video data, the edited video data generating means obtains information about the Q matrix of the first picture connected to the third compressed video data,
If the first picture meets a predetermined condition, the control means is configured to cause the second picture encoded by the encoding means to be encoded using the Q matrix of the first picture. Control the encoding means,
The information processing apparatus according to claim 1, wherein the edited video data generation unit connects the first picture subsequent to the second picture. The information processing apparatus according to claim 2, wherein the predetermined condition includes that a sequence header is not inserted before the first picture. The information processing apparatus according to claim 2, wherein the predetermined condition includes that the first picture is not set to load a Q matrix at the time of encoding. The control means is a picture encoded by the encoding means, and a sequence header is added to the picture connected to the first compressed video data in a predetermined range other than the vicinity of the editing point by the edited video data generating means. The information processing apparatus according to claim 1, wherein the encoding unit is controlled to be inserted. The control means includes a picture type of a portion that is temporally later in image display order than any intra-frame encoded image or inter-frame forward prediction encoded image of the third compressed video data. 2. The information according to claim 1, further comprising controlling the encoding process by the encoding unit so that the picture type is not changed from a corresponding picture type of the first compressed video data and the second compressed video data. Processing equipment. The control means includes
Of the second compressed video data, the edited video data generating means obtains information about the Q matrix of the first picture connected to the third compressed video data,
Determining whether the Q matrix of the first picture is equal to the Q matrix of the second picture connected subsequent to the first picture by the editing data generating means;
The second picture is set so as to load a Q matrix at the time of encoding when it is determined that the Q matrices of the first picture and the second picture are not equal. 6. The information processing apparatus according to 6. The control means includes
Obtaining information about the Q matrix of the second picture corresponding to the first picture that is the last picture of the third compressed video data out of the second compressed video data;
The information processing apparatus according to claim 6, wherein the encoding unit is controlled so that the first picture is encoded with the same Q matrix as the second picture. Update means for updating the syntax of the second compressed video data in a predetermined range other than the vicinity of the editing point;
The control means includes
Further controlling the processing of the syntax update control means;
Of the second compressed video data, a first picture that is an intra-frame encoded image or an inter-frame forward-predicted encoded image connected to the third compressed video data by the edited video data generation means And information on the Q matrix of the second picture that is the next interframe forward prediction encoded image,
If the Q matrix of the first picture and the second picture are different and the second picture is not set to load the Q matrix at the time of encoding, the syntax update control means is controlled. The information processing apparatus according to claim 1, further comprising: adding QuantMatrixExtention to the syntax of the second picture. In the information processing method of the information processing apparatus for executing processing for connecting and editing the front end of the second compressed video data to the rear end of the first compressed video data,
A decoding step of decoding a predetermined range of video data in the vicinity of an edit point of the first compressed video data and the second compressed video data;
The first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step, and the first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step. Connecting two uncompressed video signals at the editing point to generate a third uncompressed video signal;
The information about the Q matrix of the predetermined picture of the second compressed video data is acquired, and the third uncompressed video signal generated by being connected by the processing of the connecting step is obtained using the acquired information. An encoding step of encoding to generate third compressed video data;
The first compressed video data in a predetermined range other than the vicinity of the editing point and the second compressed video data in a predetermined range other than the vicinity of the editing point, and generated by being encoded by the process of the encoding step, An information processing method comprising: an edited video data generating step of connecting the third compressed video data and generating compressed encoded video data. A program for causing a computer to execute a process of editing by connecting the front end of the second compressed video data to the rear end of the first compressed video data,
A decoding step of decoding a predetermined range of video data in the vicinity of an edit point of the first compressed video data and the second compressed video data;
The first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step, and the first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step. Connecting two uncompressed video signals at the editing point to generate a third uncompressed video signal;
The information about the Q matrix of the predetermined picture of the second compressed video data is acquired, and the third uncompressed video signal generated by being connected by the processing of the connecting step is obtained using the acquired information. An encoding step of encoding to generate third compressed video data;
The first compressed video data in a predetermined range other than the vicinity of the editing point and the second compressed video data in a predetermined range other than the vicinity of the editing point, and generated by being encoded by the process of the encoding step, An edited video data generating step of connecting the third compressed video data to generate compressed encoded video data; Medium on which various programs are recorded. A program for causing a computer to execute a process of editing by connecting the front end of the second compressed video data to the rear end of the first compressed video data,
A decoding step of decoding a predetermined range of video data in the vicinity of an edit point of the first compressed video data and the second compressed video data;
The first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step, and the first uncompressed video signal generated by decoding the first compressed video data by the process of the decoding step. Connecting two uncompressed video signals at the editing point to generate a third uncompressed video signal;
The information about the Q matrix of the predetermined picture of the second compressed video data is acquired, and the third uncompressed video signal generated by being connected by the processing of the connecting step is obtained using the acquired information. An encoding step of encoding to generate third compressed video data;
The first compressed video data in a predetermined range other than the vicinity of the editing point and the second compressed video data in a predetermined range other than the vicinity of the editing point, and generated by being encoded by the process of the encoding step, An edited video data generating step of connecting the third compressed video data and generating compressed encoded video data. A program for causing a computer to execute the processing. In an information processing apparatus that executes a process of editing by connecting the front end of the second compressed video data to the rear end of the first compressed video data,
The first non-compressed video signal generated by decoding the first compressed video data in a predetermined range near the edit point and the second compressed video data are decoded in a predetermined range near the edit point. Encoding means for generating third compressed video data by encoding the third non-compressed video signal generated by connecting the second uncompressed video signal generated at the editing point;
Information on the Q matrix of a first picture that is a picture in a range other than a predetermined range near the editing point in the second compressed video data and is a picture connected to the third compressed video data. And when the first picture meets a predetermined condition, the encoding is performed so that a second picture encoded by the encoding means is encoded using the Q matrix of the first picture. An information processing apparatus comprising: control means for controlling encoding processing by the means. In the information processing method of the information processing apparatus for executing processing for connecting and editing the front end of the second compressed video data to the rear end of the first compressed video data,
The first non-compressed video signal generated by decoding the first compressed video data in a predetermined range near the edit point and the second compressed video data are decoded in a predetermined range near the edit point. Encoding a third uncompressed video signal generated by connecting the second uncompressed video signal generated at the editing point to generate third compressed video data;
Information on the Q matrix of a first picture that is a picture in a range other than a predetermined range near the editing point in the second compressed video data and is a picture connected to the third compressed video data. And if the first picture meets a predetermined condition, the second picture encoded by the process of the encoding step is encoded using the Q matrix of the first picture, And a control step for controlling an encoding process by the encoding step.

Images