JP2006345035A - Moving picture printing device and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology capable of leaving a still picture extracted from a moving picture as a hard copy. <P>SOLUTION: A motion vector extract section 24 extracts a motion vector from moving picture data and an operating position detection section 26 detects at least one of a zoom or panning operation start position, an operation intermediate position, and an operation end position of a camera when the moving picture data are acquired on the basis of the motion vector. A frame extract section 28 extracts a frame of at least one of the operation start position, the operation intermediate position, and the operation end position from the moving picture data, and a print section 20 prints out the extracted frame. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving image printing apparatus and method for printing out a frame included in a moving image, and a program for causing a computer to execute the moving image printing method.

Conventionally, as a method for grasping the contents of a moving image in a short time, a method of reproducing a moving image by thinning out the frames evenly or reproducing the moving image by changing the display speed has been used. Also, when decimating frames from a moving image, the motion vector between frames is detected by analyzing the moving image, and the operation start position or operation end position of the camera such as zoom and pan is estimated based on the motion vector. A system for creating a digest version of a moving image using a frame of an estimated operation start position or operation end position has been proposed (see Patent Document 1). Also, a technique for extracting a representative image representing a moving image from a moving image based on camera operation information such as camera zoom and pan has been proposed (see Patent Document 2).
Japanese Patent No. 3286360 Japanese Patent Laid-Open No. 7-23322

  However, although the methods described in Patent Documents 1 and 2 extract a still image from a moving image, there is no mention of leaving the extracted still image as a hard copy.

  The present invention has been made in view of the above circumstances, and an object thereof is to allow a still image extracted from a moving image to remain as a hard copy.

A moving image printing apparatus according to the present invention includes a motion vector acquisition means for acquiring a motion vector between frames constituting moving image data,
An operation position detecting means for detecting at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that has acquired the moving image data based on the motion vector;
Frame extraction means for extracting a frame at at least one of the operation start position, the operation intermediate position and the operation end position from the moving image data;
And a printing means for printing out the extracted frame.

  The “operation intermediate position” may be any position between the operation start position and the operation end position, but is preferably a central position.

  In the moving image printing apparatus according to the present invention, the motion vector acquisition unit may be a unit that acquires the motion vector by extracting a motion vector included in the moving image data.

  In the moving image printing apparatus according to the present invention, the motion vector acquisition means determines the format of the moving image data. If the moving image data is a format including a motion vector, the moving image data is obtained from the moving image data. The motion vector may be obtained by extracting the motion vector, and in other cases, the motion vector may be obtained by analyzing the moving image data.

A moving image printing method according to the present invention acquires a motion vector between frames constituting moving image data,
Based on the motion vector, detect at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that acquired the moving image data;
Extracting a frame at at least one of the operation start position, the operation intermediate position and the operation end position from the moving image data;
The extracted frame is printed out.

  In addition, you may provide as a program for making a computer perform the moving image printing method by this invention.

  According to the present invention, a motion vector between frames constituting moving image data is acquired, and based on the motion vector, at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that acquired the moving image data is acquired. The position is detected. Then, the frame at the detected position is extracted, and the extracted frame is printed out. For this reason, a still image extracted from a moving image can be left as a hard copy.

  In addition, when the moving image data includes a motion vector as in, for example, the MPEG format, a motion vector can be easily acquired by extracting the motion vector included in the moving image data and acquiring the motion vector. Can do.

  In addition, the format of the moving image data is determined, and if the moving image data is a format including a motion vector, the motion vector is obtained by extracting the motion vector from the moving image data. If a motion vector is acquired by analyzing image data, a still image print can be obtained from moving image data in any format.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing the configuration of a moving image printing apparatus according to the first embodiment of the present invention. As shown in FIG. 1, the moving image printing apparatus 1 according to the first embodiment includes a CPU 12 that controls each part of the apparatus 1, a ROM that stores programs and various constants for operating the CPU 12, and the CPU 12 A main memory 14 constituted by a RAM serving as a work area when executing the process, and a memory control unit 16 for controlling the main memory 14 are provided.

  The moving image printing apparatus 1 also reads out moving image data from a recording medium 2 on which moving image data acquired by a digital video camera or the like is recorded, and records a moving image data on the recording medium 2. 18, a print unit 20 that prints out the extracted frame as will be described later, and a print control unit 22 that controls the print unit 20.

  In addition, the moving image printing apparatus 1 includes a motion vector extracting unit 24 that extracts a motion vector from moving image data, and an operation start position, an operation intermediate position, and an operation end position of the camera that acquired the moving image data based on the motion vector. An operation position detection unit 26 that detects at least one position, and a frame extraction unit 28 that extracts a frame at a position detected by the operation position detection unit 26 from moving image data.

  In the first embodiment, the moving image data is assumed to be in the MPEG format. In the MPEG format, as frames constituting moving image data, an intra-frame encoded frame (I frame), in which an image can be constituted by the frame itself by performing compression only within the frame, In addition, prediction in the time axis forward direction only is taken in, and a forward inter-frame predictive encoded frame (P frame) in which compression is performed based on a difference from an intra-frame encoded frame, and the preceding and subsequent frames in addition to the intra-frame compression There is a bi-directional inter-frame predictive encoded frame (B frame) that employs bi-directional predictive compression using the difference between the two. In the MPEG format, compression / decompression is performed in units of mass frames called GOP (Group of Picture). For example, a GOP is configured in units of 15 frames, such as IBBPBBPBBPBBPBB (I is an I frame, P is a P frame, and B is a B frame). Each frame includes motion vector information.

  The motion vector extraction unit 24 extracts a motion vector included in each frame of the moving image data. Note that the motion vector extraction unit 24 does not extract motion vectors for all the pixels in each frame, and extracts motion vectors by thinning out pixels as appropriate.

  Based on the motion vector extracted by the motion vector extraction unit 24, the operation position detection unit 26 determines whether zoom or pan operation has been performed when shooting moving image data, and the zoom or pan operation is performed. In this case, at least one of a zoom or pan operation start position, an operation intermediate position, and an operation end position is detected. Hereinafter, detection of the zoom and pan operation start position, the operation intermediate position, and the operation end position will be described. First, the case of zoom will be described.

  FIG. 2 is a diagram showing a moving image during zoom operation. As shown in FIG. 2, during the zoom operation, after capturing the subject, the subject included in the screen gradually increases, and the zoom operation ends when the subject reaches a predetermined size. During the zoom operation, the motion vector of each frame of the moving image data appears radially from the center of the screen as shown in FIG. In addition, the size of the motion vector is larger in the periphery than in the center. On the other hand, before and after the zoom operation, the motion vectors do not appear radially as shown in FIG. 3, for example, after the zoom operation is finished, the motion vector of the subject portion is compared with the surrounding motion vectors as shown in FIG. Will appear small. Also, the direction of the motion vector of the subject portion is random. Before the zoom operation is started, the camera is moved so as to capture the subject, so the motion vector is in a completely random direction.

  Therefore, the operation position detection unit 26 determines that the zoom operation has been performed when a moving image includes a frame in which a motion vector appears radially from the center of the screen as illustrated in FIG. 3, and the motion vector is determined from the center of the screen. The position of the first frame that appears radially is detected as the zoom operation start position. Further, the position of the frame immediately before the frame where the motion vector is switched from the state where the motion vector appears radially from the center of the screen so that the motion vector of the subject portion appears smaller than the surrounding motion vector as shown in FIG. It is detected as the zoom operation end position. Further, the center position of the zoom operation start position and the zoom operation end position is detected as a zoom operation intermediate position.

  Next, the case of bread will be described. FIG. 5 is a diagram showing a moving image at the time of pan operation. Here, a case where the camera is panned to the right will be described. As shown in FIG. 5, at the time of pan operation, the subject included in the screen gradually moves to the opposite side (here, left) from the camera movement direction until the subject is captured at the center of the screen. The pan operation is finished when it is captured at the center of. During the pan operation, the motion vector of each frame of the moving image data appears so as to face the opposite side of the moving direction of the camera in the entire frame, as shown in FIG. The magnitude of the motion vector depends on the moving speed of the camera. On the other hand, before and after the pan operation, the motion vector does not appear in the same direction in the entire frame as shown in FIG. 6. For example, after the pan operation is finished, the motion of the subject portion is shown in FIG. The vector appears smaller than the surrounding motion vector. Since the camera is moved to supplement the subject before the panning operation is started, the motion vector is in a completely random direction.

  Therefore, the operation position detection unit 26 determines that the pan operation has been performed when the moving image includes a frame in which all the motion vectors in the frame are directed in the same direction as illustrated in FIG. The position of the first frame in which the motion vector appears in the same direction is detected as the pan operation start position. In addition, as shown in FIG. 4, the position of the frame immediately before the frame in which the motion vector appears so as to appear smaller than the surrounding motion vector is panned from the state where the motion vector appears in the same direction. It is detected as the operation end position. Further, the center position of the pan operation start position and the pan operation end position is detected as the pan operation intermediate position.

  The operation position detection unit 26 may detect an arbitrary position between the operation start position and the operation end position as an intermediate position. Here, in the present embodiment, since the frame at the zoom or pan operation end position is extracted as described later, the operation position detection unit 26 will be described below as detecting only the zoom or pan operation end position. To do.

  The frame extraction unit 28 extracts a frame at the operation end position detected by the operation position detection unit 26. That is, the frame shown in FIG. 2C is extracted from the moving image data in the case of zoom, and the frame shown in FIG. 5C is extracted in the case of pan.

  The print control unit 22 controls the print unit 20 to print out the frame extracted by the frame extraction unit 28.

  Next, processing performed in the first embodiment will be described. FIG. 7 is a flowchart showing processing performed in the first embodiment. The processing is started when moving image data is input from the recording medium 2 to the apparatus 1, and the frame extracted by the frame extracting unit 28 is set to an initial value so as to extract the first frame of the moving image data (Step S1). ST1), a frame is extracted (step ST2). Next, the motion vector extraction unit 24 extracts a motion vector from the extracted frame (step ST3). Then, it is determined whether or not motion vectors have been extracted for all frames (step ST4). If step ST4 is negative, the frame to be extracted is set to the next frame (step ST5), and the process returns to step ST2.

  When step ST4 is affirmed, the operation position detection unit 26 determines whether zoom or pan operation is performed when moving image data is captured based on the extracted motion vector (step ST6). If ST6 is negative, the process is terminated. If step ST6 is positive, the operation position detector 26 detects the zoom or pan operation end position (step ST7). Then, the frame extraction unit 28 extracts the frame at the operation end position from the moving image data (step ST8), the frame extracted by the print control unit 22 is printed out from the printing unit 20 (step ST9), and the process is terminated.

  As described above, according to the first embodiment, the motion vector between the frames constituting the moving image data is extracted, and the zoom or pan operation start position of the camera that captured the moving image data based on the motion vector, Since at least one of the operation intermediate position and the operation end position is detected, and a frame at at least one of the detected operation start position, operation intermediate position, and operation end position is printed out, the still image extracted from the moving image is output. The image can be left as a hard copy.

  In the first embodiment, since the moving image data includes a motion vector as in, for example, the MPEG format, the motion vector included in the moving image data is extracted to acquire the motion vector. A motion vector can be easily obtained.

  Next, a second embodiment of the present invention will be described. FIG. 8 is a schematic block diagram showing the configuration of a moving image printing apparatus according to the second embodiment of the present invention. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted here. The moving image printing apparatus 100 according to the second embodiment is different from the first embodiment in that a motion vector detection unit 30 is provided instead of the motion vector extraction unit 24.

  The motion vector detection unit 30 detects a motion vector by analyzing the input moving image data. Hereinafter, detection of a motion vector will be described. FIG. 9 is a diagram for explaining detection of a motion vector.

  As shown in FIG. 9A, the motion vector detection unit 30 divides the frame Fr1 included in the moving image data into a plurality of small regions of 8 × 8 pixels, for example. In FIG. 9, the frame Fr1 is divided into 6 × 4 areas for explanation. Then, each small region of the processing target frame Fr1 is translated on the frame Fr2 temporally adjacent to the frame Fr1, and a correlation value between each small region and the corresponding small region on the frame Fr2 is calculated. Specifically, the reciprocal of the cumulative sum of the pixel value differences in the small area is calculated as the correlation value. Then, the moving direction and the moving amount of the small area when the correlation value is the highest, that is, the cumulative sum of the pixel value differences in the small area is the smallest are detected as the motion vector V12.

  For example, as shown in FIG. 9B, when the small region A1 in the frame Fr1 has the highest correlation value with the small region A1 ′ in the frame Fr2, the small region A1 is projected onto the frame Fr2. A movement amount and a movement direction necessary for moving the small area A1 ″ to be moved to the small area A1 ′ are detected as a motion vector V12.

  The motion vector detection need not be performed for all the small areas included in the frame, and may be performed by thinning out the small areas as appropriate.

  Next, processing performed in the second embodiment will be described. FIG. 10 is a flowchart showing processing performed in the second embodiment. The processing is started when moving image data is input from the recording medium 2 to the apparatus 100, and the frame extracted by the frame extracting unit 28 is set to an initial value so as to extract the first frame of the moving image data (Step S1). ST11), a frame is extracted (step ST12). Next, the motion vector detection unit 30 detects a motion vector from the extracted frame (step ST13). Then, it is determined whether or not motion vectors have been detected for all frames (step ST14). If step ST14 is negative, the frame to be extracted is set to the next frame (step ST15), and the process returns to step ST12.

  When step ST14 is affirmed, the operation position detection unit 26 determines whether zoom or pan operation is performed when moving image data is captured based on the detected motion vector (step ST16). If ST16 is negative, the process is terminated. If step ST16 is positive, the operation position detector 26 detects the zoom or pan operation end position (step ST17). Then, the frame extraction unit 28 extracts the frame at the operation end position from the moving image data (step ST18), prints out the frame extracted by the print control unit 22 from the printing unit 20 (step ST19), and ends the process.

  As described above, in the second embodiment, a motion vector between frames constituting moving image data is detected, and the zoom or pan operation start position and operation of the camera that captured the moving image data are detected based on the motion vector. Since at least one of the intermediate position and the operation end position is detected, and a frame at at least one of the detected operation start position, operation intermediate position and operation end position is printed out, the still image extracted from the moving image is output. The image can be left as a hard copy.

  Next, a third embodiment of the present invention will be described. FIG. 11 is a schematic block diagram showing the configuration of a moving image printing apparatus according to the third embodiment of the present invention. Note that in the third embodiment, the same reference numerals are assigned to the same configurations as those in the first embodiment, and detailed description thereof is omitted here. The moving image printing apparatus 101 according to the third embodiment is different from the first embodiment in that a motion vector acquisition unit 32 is provided instead of the motion vector extraction unit 24.

  The motion vector acquisition unit 32 extracts a motion vector from the moving image data when the input moving image data has a format including a motion vector as in the MPEG format, and the moving image data does not include a motion vector. In this case, a motion vector is detected from the moving image data by analyzing the moving image data. The motion vector extraction process in the third embodiment is the same as the process performed by the motion vector extraction unit 24 in the first embodiment, and the motion vector detection process is the same as that in the second embodiment. Since the process is the same as that performed by the motion vector detection unit 30, detailed description thereof is omitted here.

  Next, processing performed in the third embodiment will be described. FIG. 12 is a flowchart showing processing performed in the third embodiment. Processing starts when moving image data is input from the recording medium 2 to the apparatus 101. First, the motion vector acquisition unit 32 determines whether or not a motion vector is included in the input moving image data (step ST21). ). If step ST21 is affirmed, the operation position detection unit 26, the motion vector acquisition unit 32, the frame extraction unit 28, and the print control unit 22 perform the same processing as that of the first embodiment shown in FIG. The frame at the end position is printed out (step ST22), and the process ends.

  If step ST21 is negative, the operation position detection unit 26, the motion vector acquisition unit 32, the frame extraction unit 28, and the print control unit 22 perform the same processing as that of the second embodiment shown in FIG. The frame at the end position is printed out (step ST23), and the process ends.

  As described above, according to the third embodiment, the format of the moving image data is determined, and when the format includes the motion vector, the motion vector is obtained by extracting the motion vector from the moving image data. In other cases, since the motion vector is obtained by analyzing the moving image data, a still image print can be obtained from moving image data in any format.

  Although the apparatus 1, 100, 101 according to the embodiment of the present invention has been described above, the computer is connected to the print control unit 22, the motion vector extraction unit 24, the operation position detection unit 26, the frame extraction unit 28, and the motion vector detection. A program that functions as means corresponding to the unit 30 and the motion vector acquisition unit 32 and performs processing as shown in FIGS. 7, 10, and 12 is also one embodiment of the present invention. A computer-readable recording medium that records such a program is also one embodiment of the present invention.

1 is a schematic block diagram showing the configuration of a moving image printing apparatus according to a first embodiment of the present invention. The figure which shows the moving picture at the time of zoom operation Diagram showing motion vector during zoom operation Diagram showing motion vector after zoom operation The figure which shows the moving picture at the time of pan operation Diagram showing motion vector during pan operation The flowchart which shows the process performed in 1st Embodiment. Schematic block diagram showing a configuration of a moving image printing apparatus according to a second embodiment of the present invention. Diagram for explaining motion vector detection The flowchart which shows the process performed in 2nd Embodiment. Schematic block diagram showing a configuration of a moving image printing apparatus according to a third embodiment of the present invention. The flowchart which shows the process performed in 3rd Embodiment

Explanation of symbols

1, 100, 101 Moving picture printing apparatus 2 Recording medium 12 CPU
DESCRIPTION OF SYMBOLS 14 Main memory 16, 18 Memory control part 20 Print part 22 Print control part 24 Motion vector extraction part 26 Operation position detection part 28 Frame extraction part 30 Motion vector detection part 32 Motion vector acquisition part

Claims (5)

Motion vector acquisition means for acquiring a motion vector between frames constituting moving image data;
An operation position detecting means for detecting at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that has acquired the moving image data based on the motion vector;
Frame extraction means for extracting a frame at at least one of the operation start position, the operation intermediate position and the operation end position from the moving image data;
A moving image printing apparatus comprising: a printing unit that prints out the extracted frame.   2. The moving image printing apparatus according to claim 1, wherein the motion vector acquisition means is means for acquiring the motion vector by extracting a motion vector included in the moving image data.   The motion vector acquisition means determines the format of the moving image data, and if the moving image data is in a format including a motion vector, extracts the motion vector from the moving image data to obtain the motion vector. The moving image printing apparatus according to claim 1, wherein the moving image printing apparatus is a means for acquiring the motion vector by acquiring and otherwise analyzing the moving image data. Get motion vectors between frames that make up the video data,
Based on the motion vector, detect at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that acquired the moving image data;
Extracting a frame at at least one of the operation start position, the operation intermediate position and the operation end position from the moving image data;
A moving image printing method, wherein the extracted frame is printed out. A procedure for obtaining a motion vector between frames constituting moving image data;
A procedure for detecting at least one of an operation start position, an operation intermediate position, and an operation end position of the camera that acquired the moving image data based on the motion vector;
A procedure for extracting a frame at at least one of the operation start position, the operation intermediate position and the operation end position from the moving image data;
A program for causing a computer to execute a moving image printing method, comprising: printing out the extracted frame.

Images