JP4945694B2 - Video playback apparatus and video playback method - Google Patents

Description

  The present invention relates to a video playback device and a video playback method.

  As a conventional technique, there is a video reproducing apparatus that can be operated as if it is actually touching a GUI (Graphical User Interface) displayed on a display screen (see, for example, Patent Document 1).

  The video reproduction apparatus includes a display information creation unit that creates an image including a GUI, an operation content determination unit that detects a user's specific input operation on the touch pad, and a user's contact with the touch pad as an operation position on the GUI. A body position display unit that creates an image showing a region, and an image composition unit that synthesizes the image created by the body position display unit and the display information created by the display information creation unit, and the body position display unit The image showing the created contact area is created by estimating from the user's operation position, that is, the position where the user's hand touched the touchpad, and is displayed in three dimensions with shadows. It is possible to operate as if the user actually touched the GUI displayed on the screen.

  However, according to the conventional video playback device, the user touches the touch pad to input an operation, and thus it is possible to recognize the relationship between the operation position on the flat display and the operation position of the user on the touch pad. There is a problem that the operation range is limited on the touchpad.

JP 2006-72854 A

  Therefore, an object of the present invention is to provide a video playback apparatus and a video playback method capable of recognizing a user's operation position with respect to an operation position on a display without limiting the user's operation as compared with the prior art. It is in.

(1) According to one aspect of the present invention, in order to achieve the above object, a distance information acquisition unit that acquires information about a distance between a distance sensor and a user from the distance sensor, and the distance acquired by the distance information acquisition unit Among the above information, an instruction coordinate calculation unit that calculates the coordinates of information of a distance close to the distance sensor as an instruction coordinate, an instruction image generation unit that generates an instruction image and an auxiliary image based on the instruction coordinates, and the instruction image An operation image generation unit that generates an operation image that is an operation target, and the instruction image is arranged with respect to the operation image based on the instruction coordinates, and a virtual image is provided between the distance sensor and the user. The auxiliary image is arranged at a position farther from the instruction image as the distance between the virtual operation surface provided and the designated coordinates is larger, and the auxiliary image is arranged as the distance between the virtual operation surface and the designated coordinates is smaller. To provide a video reproducing apparatus characterized by comprising a display control unit which synthesizes be placed close to the serial instruction image position.

  According to the configuration described above, the relationship between the operation position of the instruction image with respect to the operation image and the operation position of the user corresponding to the operation image can be recognized.

  According to the present invention, it is possible to recognize the user's operation position with respect to the operation position on the display without limiting the user's operation as compared with the related art.

It is the schematic which shows the structure of the video reproduction apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the main body of a video reproduction apparatus. (A)-(f) is the schematic which shows the acquisition operation | movement of the distance information of a distance image acquisition part. (A)-(c) is schematic which shows the example of the distance image in the calculation operation | movement of a two-handed coordinate, and the calculation operation | movement of a gravity center. (A)-(d) is the schematic which shows an example of the relationship between a gravity center and an operation reference plane, and the relationship between a distance image and an operation reference surface. (A)-(c) is the schematic which shows an example of the operation | movement which produces an instruction | indication image from a distance image, and the synthetic | combination operation | movement of an instruction | indication image and a GUI image. (A)-(f) is the schematic which shows the other example of the synthetic | combination operation | movement with an instruction | indication image and a GUI image. (A)-(f) is the schematic which shows the other example of the synthetic | combination operation | movement with an instruction | indication image and a GUI image.

  Embodiments of a video playback apparatus and video playback method according to the present invention will be described below in detail with reference to the drawings.

[Embodiment]
(Configuration of video playback device)
FIG. 1 is a schematic diagram showing a configuration of a video playback apparatus according to an embodiment of the present invention.

  The video playback device 1 can play back video content received by a tuner provided inside the main body 2, and the display unit 23 includes a display screen such as an LCD (Liquid Crystal Display) that displays the played back video. indicate.

  In addition, the video playback device 1 includes a distance sensor 3 that acquires distance information of an object including the user 4 facing the video playback device 1, and operates based on the distance information acquired by the distance sensor 3. The distance sensor 3 includes, for example, an infrared camera including an infrared laser and a plurality of light receiving elements, and obtains distance information in an image format by photographing the reflection of infrared rays emitted from the infrared laser with the infrared camera. Note that, as will be described later, the video reproduction device 1 is operated by a gesture or the like of the user 4 recognized by the distance information.

  The video reproduction apparatus 1 also includes a remote controller 2A composed of a plurality of operation switches, and a remote control receiver (not shown) that receives an operation signal transmitted to the main body 2 based on the operation of the operation switches from the remote controller 2A. Operates based on the signal.

  FIG. 2 is a block diagram showing a configuration of the main body 2 of the video reproduction apparatus 1.

  The main body 2 of the video reproduction device 1 includes a distance image acquisition unit 20, a distance image processing unit 21, a display control unit 22, a display unit 23, an input control unit 24, and a remote control information acquisition unit 25.

  The distance image acquisition unit 20 acquires distance information of a plurality of pixels acquired by the distance sensor 3 as a distance image.

  The distance image processing unit 21 processes the distance image acquired by the distance image acquiring unit 20 by the image dividing unit 21a, the centroid calculating unit 21c, the reference plane calculating unit 21d, and the two-handed coordinate calculating unit 21b.

  The image dividing unit 21a divides the distance image into a plurality of regions according to the distance information of each pixel. The two-hand coordinate calculation unit 21b detects the user's hands as the operation instruction position from the distance image. The centroid calculating unit 21c calculates the centroid of the depth of the distance image and the centroid of the image plane. The reference plane calculation unit 21d sets a virtual operation reference plane for the user.

  The display control unit 22 includes a GUI generation unit 22a and an instruction image generation unit 22b, and generates a display image.

  The GUI generation unit 22a generates a GUI image such as a switch as an operation target. The instruction image generation unit 22b processes the image output from the image division unit 21a based on the reference plane information calculated by the reference plane calculation unit 21d, and generates an instruction image imitating the user's hand. The instruction image generation unit 22b generates a shadow image that is paired with the instruction image according to the relationship between the coordinates of both hands detected by the two-hand coordinate calculation unit 21b and the reference plane information.

  The display unit 23 displays the video received by the tuner, the instruction image and the GUI image synthesized by the display control unit 22.

  The input control unit 24 controls each unit of the video reproduction device 1 based on a control signal output from the display control unit 22. Further, each unit of the video reproduction apparatus 1 is controlled based on a control signal output from a remote control information acquisition unit 25 described later.

  The remote control information acquisition unit 25 receives an operation signal from the remote control 2A via the remote control reception unit.

(Operation)
Hereinafter, the operation of the video reproduction apparatus according to the embodiment of the present invention will be described with reference to FIGS. 1 to 8. (1) Distance information acquisition operation, (2) Distance image segmentation operation, (3) Two-hand coordinate The calculation operation, (4) gravity center calculation operation, (5) operation reference surface and virtual operation surface determination operation, (6) instruction image generation operation and image composition operation, and (7) other operations will be described separately.

  When the user 4 faces the detection surface 30 of the distance sensor 3, the distance sensor 3 detects the user 4 as an object to be detected and acquires the distance information. Below, the distance information acquisition operation of the distance sensor 3 will be described.

(1) Distance Information Acquisition Operation FIGS. 3A to 3F are schematic diagrams illustrating the distance information acquisition operation of the distance image acquisition unit 20, and FIG. 3A is a perspective view and FIG. b) is a plan view from the positive direction of the y-axis, and FIG. 3C is a side view from the negative direction of the x-axis.

  As shown in FIGS. 3A to 3C, the distance sensor 3 has a detection surface 30 on the xy plane (z = 0). When the detection objects 3A and 3B are arranged at positions facing the detection surface 30, the distance sensor 3 acquires distance information for each pixel as shown in FIG.

  The distance information shown in FIG. 3D describes the distance to the detected object facing each of the divided detection surfaces by dividing the detection surface 30 of the distance sensor 3 into 25, for example. The unit is cm. Further, when there is no object to be detected or when the object to be detected is farther from the reference surface 3C at the position of the detection surface 30 to 40 cm, for example, the distance is represented as 0 cm. The number of divisions of the detection surface is 25 for simplification of description, but the detection surface is divided, for example, with a resolution of VGA (Video Graphics Array) composed of 640 × 480 dots. The upper limit of the number of divisions (number of pixels) is the number of light receiving elements of the distance sensor 3.

(2) Distance Image Dividing Operation Next, when the image dividing unit 21a of the distance image processing unit 21 acquires the distance information shown in FIG. 3D from the distance image acquiring unit 20, the distance of each divided detection surface Are grouped by close values, and divided into divided regions 30A and 30B as shown in FIG.

Next, as shown in FIG. 3F, the distance image acquisition unit 20 converts the acquired distance value into a distance from the depth reference plane 3C (40 cm). In other words, the distance information shown in FIG. 3 (f) by the value of _{d n} to the _{40-d n} of each pixel shown in FIG. 3 (e) is obtained. The value of the depth reference plane 30C, 40 cm, is an example, and is determined at the time of factory shipment in proportion to the screen size of the video display device. For example, when using a distance sensor attached to a 50-inch TV 5m is determined.

(3) Two-Hand Coordinate Calculation Operation FIGS. 4A to 4C are schematic diagrams illustrating examples of distance images in the two-hand coordinate calculation operation and the centroid calculation operation.

  The distance image acquisition unit 20 acquires a distance image as shown in FIG. Next, the image dividing unit 21a uses the method described in FIG. 3 to group the distance information that is close to each other and divide the divided areas 32a to 32c to obtain the distance image 31B illustrated in FIG. 4B. The distance between each of the divided areas 32a to 32c and the distance sensor 3 is, for example, 2m for the divided area 32a, 2.3m for the divided area 32b, and 2m for the divided area 32c.

  Next, as shown in the distance image 31C of FIG. 4C, the two-hand coordinate calculation unit 21b detects, for example, the closest one of the divided areas 32a to 32c as the right hand 310 and the left hand 311 and divides it. The right hand instruction coordinates are acquired from the center of the area 32b, and the left hand instruction coordinates are acquired from the center of the divided area 32a.

  Further, the right hand 310 and the left hand 311 are distinguished depending on whether the right hand pointing coordinate and the left hand pointing coordinate are located on the right side or the left side of the center of gravity 312. The center of gravity 312 is determined by the method described below. Calculated.

ただし、Ｄ（ｘ，ｙ）＝０の場合、ｎ（ｘ，ｙ）＝０、Ｄ（ｘ，ｙ）＞０の場合、ｎ（ｘ，ｙ）＝１であるとする。 (4) Center-of-gravity calculation operation When the detection surfaces divided by the distance image 31B are represented by (x, y) and the depth converted into the distance from the depth reference plane is D (x, y), the center of gravity 312 is obtained. The coordinates (x _Center , y _Center , z _Center ) are expressed by the following equations 1 to 3.

However, when D (x, y) = 0, n (x, y) = 0, and when D (x, y)> 0, n (x, y) = 1.

(5) Operation Reference Surface and Virtual Operation Surface Determination Operation FIGS. 5A to 5D are schematic diagrams illustrating an example of the relationship between the center of gravity and the operation reference surface and the relationship between the distance image and the operation reference surface. .

  As shown in FIG. 5A, the reference surface calculation unit 21d of the display control unit 22 operates the operation reference surface Sz on the detection surface 30 side by a predetermined interval dz from the center of gravity Gz in the distance direction calculated by the center of gravity calculation unit 21c. Set. The reference surface calculation unit 21d sets the virtual operation surface Sv on the detection surface 30 side by a predetermined interval dm from the operation reference surface Sz.

  A distance image 31C shown in FIG. 5B is the same as that shown in FIG. The instruction image generation unit 22b of the display control unit 22 divides the right hand 310 and the left hand 311 which are the divided regions of the distance image 31C at the distance corresponding to the operation reference plane Sz, and each of the front right hand shown in FIG. 310a and back right hand 310b, front left hand 311a and back left hand 311b.

  Next, the instruction image generation unit 22b extracts the near-right hand 310a and the near-left hand 311a corresponding to the left hand 4L and the right hand 4R of the user 4 on the detection surface 30 side from the operation reference plane Sz, from the distance image 31D, and FIG. A distance image 31E shown in d) is obtained.

(6) Instruction Image Generation Operation and Image Composition Operation FIGS. 6A to 6C are schematic diagrams illustrating an example of an operation for creating an instruction image from a distance image and a composition operation of the instruction image and a GUI image. .

  The instruction image generation unit 22b horizontally inverts the distance image 31F shown in FIG. 6A to obtain a distance image 31E shown in FIG. Next, the instruction image generation unit 22b performs three-dimensional processing by horizontally inverting the front right hand 310a and the front left hand 311a of the distance image 31F, so that the left hand image 240a and the right hand image shown in FIG. 241a is generated. In the three-dimensional process, the three-dimensional process is performed so as to feel the depth of the contours of the front right hand 310a and the front left hand 311a which are horizontally reversed. In the three-dimensional processing, for example, a gray value is set in advance according to the distance between the coordinates of the front right hand 310a and the front left hand 311a, and coloring is performed with a color generated based on the gray value and a predetermined standard skin color. Can be realized.

  Next, based on the distance relationship between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv shown in FIG. 5A, the instruction image generation unit 22b uses the left hand image 240a and the right hand image 241a as shown in FIG. Shadow images 240b and 241b shown in b) are generated as auxiliary images.

  Further, simultaneously with the generation operation of the left hand image 240a and the right hand image 241a of the instruction image generation unit 22b and the shadow images 240b and 241b, the GUI generation unit 22a of the display control unit 22 includes a GUI including the operation images 242a to 242c. An image 242 is generated.

  Next, the display control unit 22 combines the left hand image 240a and the right hand image 241a, the shadow images 240b and 241b, and the GUI image 242, generates a display image 24A, and outputs video information to the display unit 23. The display unit 23 displays the video information input from the display control unit 22. Note that the left-hand image 240a, the right-hand image 241a, and the shadow images 240b and 241b may be translucent in consideration of the visibility of the GUI image 242.

  The left hand image 240a and the right hand image 241a are drawn larger as the distance between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv increases, and the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv are drawn. The smaller the distance, the smaller the drawing. That is, for example, as illustrated in FIG. 6C, when the distance between the left hand 4L and the virtual operation surface Sv is smaller than that of the right hand 4R, the left hand image 240a is drawn and generated smaller than the right hand image 241a. The

  Further, the shadow images 240b and 241b are drawn larger as the distance between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv is larger, and are arranged at positions away from the left hand image 240a and the right hand image 241a. That is, for example, the left hand image 240a and the shadow image 240b shown in FIG. 6C are generated.

  In addition, the smaller the distance between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv, the closer the drawing is to the left hand image 240a and the right hand image 241a, and the closer to the left hand image 240a and the right hand image 241a. To do. That is, for example, when the right hand 4R of the user 4 coincides with the position of the virtual operation surface Sv, the right hand image 241a and the shadow image 241b shown in FIG. 6C are generated.

  In addition, when the left hand 4L and the right hand 4R of the user 4 coincide with the virtual operation surface Sv, the display control unit 22 outputs an operation signal to the input control unit 24. The operation signal depends on the position indicated by the left hand image 24a and the right hand image 241a. For example, as shown in FIG. 6C, when the right hand image 241a indicates the operation target 241b, the operation image 242b. It becomes a thing corresponding to. Similarly, different operation signals are associated with the operation image 242a and the operation image 242c, respectively, and when the left hand image 24a and the right hand image 241a indicate, the display control unit 22 controls the corresponding control signal. Is output to the input control unit 24.

  The input control unit 24 controls each unit of the main body 2 based on the control signal input from the display control unit 22. Similarly, each unit of the main body 2 is controlled based on a control signal input from the remote control information acquisition unit 25.

(7) Other Operations FIGS. 7A to 7F are schematic diagrams illustrating another example of the synthesis operation of the instruction image and the GUI image.

  For example, when the left hand 4L of the user 4 is presented, the instruction image generation unit 22b generates a left hand image 240a and a shadow image 240b. As illustrated in FIGS. 7A and 7D, the display image 24B is generated. Includes a plurality of GUI images 243 to 245 in the screen depth direction, and when the left hand image 240a is on the front side of the screen with respect to the GUI image 243, the display control unit 22 applies a shadow to the GUI image 243. The image 240b is synthesized.

  Similarly, as shown in FIGS. 7B and 7E, when the left-hand image 240a is at the back of the screen from the GUI image 243 and at the front side of the screen from the GUI image 244, the display control unit 22 displays the GUI image. The shadow image 240 b is synthesized with respect to 244.

  Also, as shown in FIGS. 7C and 7F, when the left hand image 240 a is at the back of the screen from the GUI image 244 and at the front side of the screen from the GUI image 245, the display control unit 22 displays the GUI image 245. On the other hand, the shadow image 240b is synthesized.

  FIGS. 8A to 8F are schematic diagrams illustrating other examples of the combining operation of the instruction image and the GUI image.

  For example, when the left hand 4L of the user 4 is presented, the instruction image generation unit 22b generates a left hand image 240a and a shadow image 240b. However, as illustrated in FIG. When located on the left rear side, as shown in FIG. 8A, the display control unit 22 generates the display image 24C by combining the shadow image 240b with the GUI image 246 so as to be located on the left side of the screen from the left hand image 240a. To do.

  Similarly, as shown in FIG. 8 (e), when the virtual illumination Lv is located behind the user, the display control unit 22 displays the left-hand image 240a and the horizontal direction of the screen as shown in FIG. 8 (b). Then, the shadow image 240b is synthesized with the GUI image 246 at the same position.

  Also, as shown in FIG. 8 (f), when the virtual illumination Lv is located on the right rear side of the user, the display control unit 22 is located on the left side of the screen from the left hand image 240a as shown in FIG. 8 (c). As described above, the shadow image 240 b is combined with the GUI image 246.

(Effect of embodiment)
According to the above-described embodiment, the video reproduction device 1 sets the operation reference surface Sz and the virtual operation surface Sv near the user 4, and the distance between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv. In order to change the display relationship between the GUI image 242 and the left-hand image 240a and the right-hand image 241a according to the relationship, the operation position on the three-dimensional display and the operation position of the user with respect to the operation position on the three-dimensional display Can be recognized.

  Further, the video reproduction device 1 generates and arranges the shadow images 240b and 241b as the display relationship between the GUI image 242 and the left-hand image 240a and the right-hand image 241a. It is possible to recognize the relationship between the operation position on the display and the operation position of the user with respect to the operation position on the three-dimensional display.

  The drawing size of the left hand image 240a and the right hand image 241a and the shadow images 240b and 241b, etc., as long as it changes based on the relationship between the left hand 4L and the right hand 4R of the user 4 and the virtual operation surface Sv, is described as an example. A method other than that shown in FIG. The left hand image 240a, the right hand image 241a, and the shadow images 240b and 241b may be replaced with other images such as a pointer and an icon.

  The invention described in the scope of claims at the time of the patent assessment of the original application of the present application will be appended below.

[1] A distance image acquisition unit that acquires, from the distance sensor, a distance image that associates distance information with a user facing the detection surface of the distance sensor for each pixel of the distance sensor;
A centroid calculating unit that calculates a centroid of the user's distance based on the distance information associated with the distance image;
An instruction coordinate calculation unit that calculates an instruction coordinate indicating a position where a user instructs an operation from the distance information associated with the distance image based on the relationship with the center of gravity;
A reference plane calculation unit that sets a reference plane based on the distance information and the center of gravity associated with the distance image, and calculates a distance between the reference plane and the distance sensor;
An instruction image generation unit that acquires an image located on the distance sensor side from the reference plane from the distance image, and generates an instruction image from the acquired image;
An operation image generation unit that generates an operation image that is an operation target of the instruction image;
A display control unit configured to arrange and synthesize the instruction image with respect to the operation image based on a positional relationship between a virtual operation surface set at a predetermined position from the reference surface and the instruction coordinates. A video reproducing apparatus characterized by that.

[2] The instruction image generation unit generates an auxiliary image according to the arrangement of the instruction image with respect to the operation image,
The video reproduction apparatus according to [1], wherein the display control unit arranges the auxiliary image with the instruction image and synthesizes the auxiliary image with the operation image.

[3] The video reproduction according to [1], wherein the display control unit outputs a control signal corresponding to the operation image when the designated coordinates coincide with the position of the operation image. apparatus.

[4] A distance image acquisition step of acquiring, from the distance sensor, a distance image that associates distance information with a user facing the detection surface of the distance sensor for each pixel of the distance sensor;
A centroid calculating step of calculating a centroid of the user's distance based on the distance information associated with the distance image;
An instruction coordinate calculation step for calculating an instruction coordinate indicating a position where a user instructs an operation from the distance information associated with the distance image based on the relationship with the center of gravity;
A reference plane calculating step for setting a reference plane based on the distance information and the center of gravity associated with the distance image, and calculating a distance between the reference plane and the distance sensor;
An instruction image generation step of acquiring an image positioned on the distance sensor side from the reference plane from the distance image, and generating an instruction image from the acquired image;
An operation image generation step of generating an operation image that is an operation target of the instruction image;
A display control step for arranging and synthesizing the instruction image with respect to the operation image based on a positional relationship between a virtual operation surface set at a predetermined position from the reference surface and the instruction coordinates. A video reproduction method characterized by the above.

DESCRIPTION OF SYMBOLS 1 ... Video reproduction apparatus, 2 ... Main body, 2A ... Remote control, 3 ... Distance sensor, 3A, 3B ... Object to be detected, 3C ... Reference plane, 4 ... User, 4L ... Left hand, 4R ... Right hand, 20 ... Acquisition of distance image , 21 ... Distance image processing unit, 21a ... Image division unit, 21b ... Two-hand coordinate calculation unit, 21c ... Center of gravity calculation unit, 21d ... Reference plane calculation unit, 22 ... Display control unit, 22a ... GUI generation unit, 22b ... Instruction Image generation unit, 23 ... display unit, 24 ... input control unit, 24A-24C ... display image, 25 ... remote control information acquisition unit, 30 ... detection surface, 30A, 30B ... divided region, 30C ... depth reference plane, 31A-31F ... distance image, 32a-32c ... divided area, 240a ... left hand image, 240b ... shadow image, 241a ... right hand image, 241a ... operation object, 241a ... right hand image, 241b ... shadow image, 242a-242c ... operation object, 2 42-246 ... GUI image, 310 ... Right hand, 310a ... Front right hand, 310b ... Back right hand, 311 ... Left hand, 311a ... Front left hand, 311b ... Back left hand, 312 ... Center of gravity, Gz ... Center of gravity, Lv ... Virtual illumination, Sv ... Virtual operation surface, Sz ... operation reference surface, dm ... interval, dz ... interval

Claims (3)

A distance information acquisition unit that acquires information on the distance between the distance sensor and the user from the distance sensor;
Among the information on the distance acquired by the distance information acquisition unit, an instruction coordinate calculation unit that calculates coordinates of distance information close to the distance sensor as an instruction coordinate;
An instruction image generation unit that generates an instruction image and an auxiliary image based on the instruction coordinates;
An operation image generation unit that generates an operation image that is an operation target of the instruction image;
The instruction image is arranged with respect to the operation image based on the instruction coordinates, and the distance between the virtual operation surface virtually provided between the distance sensor and the user and the instruction coordinates is larger. A display control unit that arranges the auxiliary image at a position away from the instruction image, and arranges and combines the auxiliary image at a position closer to the instruction image as the distance between the virtual operation surface and the instruction coordinates decreases. A video playback device comprising:   The video playback apparatus according to claim 1, wherein the display control unit outputs a control signal corresponding to the operation image when the designated coordinates coincide with a position of the operation image. A distance information acquisition step of acquiring distance information between the distance sensor and the user from the distance sensor;
An instruction coordinate calculation step for calculating, as instruction coordinates, coordinates of distance information close to the distance sensor among the distance information acquired in the distance information acquisition step;
An instruction image generation step of generating an instruction image and an auxiliary image based on the instruction coordinates;
An operation image generation step of generating an operation image that is an operation target of the instruction image;
The instruction image is arranged with respect to the operation image based on the instruction coordinates, and the distance between the virtual operation surface virtually provided between the distance sensor and the user and the instruction coordinates is larger. A display control step of arranging an auxiliary image at a position away from the instruction image, and arranging and combining the auxiliary image at a position closer to the instruction image as the distance between the virtual operation surface and the instruction coordinates is smaller. A video playback method comprising:

Images