TWI512678B - Non-transitory storage medium - Google Patents

Description

Non-transitory storage medium

The present invention relates to a non-transitory storage medium.

Due to the advancement of technology, the development of today's electronic products is not a priority to improve the performance and quality of products. Among them, in addition to providing a clearer and more comfortable display screen for the display device, various manufacturers have continuously introduced a variety of three-dimensional (3D) display devices, which can provide multi-view 3D images. To provide users with another visual reality of the reality.

At this stage, a 3D image generation system generates an original depth frame corresponding to the original color frame by using original 2D image data, that is, an original color frame. After combining the original color frame with the original depth of field frame, the combined original color frame and the original depth of field frame are transmitted to the user's 3D display device through the existing transmission device. When the 3D display device receives the color frame and the depth of field frame, a Depth-Image-based Rendering (DIBR) method can be used to obtain two or more multi-view images for use in any naked-eye 3D display device, or It is a left eye image and a right eye image of the glasses type 3D display device.

However, at present, the home TV that is popular in the receiving end is mainly a 2D display device, and has no function of processing multi-view images or left and right eye images. Therefore, when a 2D display device receives a 3D video signal, a left eye image is displayed. And the result of halving and splicing together the image of the right eye, or displaying the result of arranging the left and right sides of a single viewing angle. At present, the development period of 3D images is broadcast, and the above-mentioned splicing method or arrangement is broadcasted, and when the left and right eye images are half-spliced or the single-view single depth is arranged on the general 2D display device, the color frame and the depth of field frame are arranged. The 2D image (color frame) actually seen by the human eye is not only quite unnatural, but also produces an uncomfortable feeling. feel.

It is an object of the present invention to provide a non-transitory storage medium. Compared with the prior art, a packaged frame stored in a non-transitory storage medium can be displayed not only directly on the 2D display screen but also viewed by the human eye. The picture is quite natural and does not create an uncomfortable feeling.

To achieve the above object, a non-transitory storage medium in accordance with the present invention is accessible to a data processing system. The non-transitory storage medium includes a package frame, and the package frame is stored in the non-transitory storage medium and can be displayed on a display screen. The packaging frame includes a color frame and a re-adjustment depth of field frame corresponding to one of the color frames, and the center point of the color frame overlaps with the center point of the display screen.

In one embodiment, the display screen is a 2D display screen.

In one embodiment, the color frame is obtained by resizing the size of an original color frame.

In an embodiment, the original color frame has a preset frame size, and the size of the package frame is the same as the preset frame size.

In one embodiment, resizing the original color frame is obtained by reducing the size of the original color frame.

In one embodiment, resizing the original color frame is obtained by reducing the resolution of the original color frame.

In one embodiment, the size of the color frame is three-quarters of the original color frame in the row direction.

In one embodiment, the resizing of the depth of field map is obtained by resizing the size of an original depth of field frame.

In an embodiment, the original depth of field frame is a grayscale frame.

In one embodiment, the sub-pixel values of the pixels are equal in the grayscale frame.

In one embodiment, the size of the original depth of field frame is re-adjusted to obtain an intermediate depth of field frame, and the intermediate depth of field frame is subjected to pixel reordering to obtain a resized depth of field frame.

In an embodiment, the size of the intermediate depth of field frame is the original depth of field along the row direction. Three-quarters of the frame.

In one embodiment, the size of the rescaled depth of field frame is one-third of the intermediate depth of field frame along the row direction.

In one embodiment, the re-scaled depth of field frame has a plurality of pixels, each pixel having three sub-pixels corresponding to the sub-pixel values of the three pixels storing the intermediate depth of field frame.

In one embodiment, the re-adjusted depth of field frame is divided into two parts and combined on the upper side and the lower side of the color frame, respectively.

In one embodiment, the two dimensions of the depth of field frame are re-adjusted in combination with the upper and lower sides of the color frame, and the depth of field frame is flipped relative to the size.

In one embodiment, the rescaled depth of field frame is divided into two parts and combined on the left and right sides of the color frame.

In one embodiment, the dimensions of the left and right sides of the color frame are combined to re-adjust the two parts of the depth of field frame, and the depth of field frame is rotated relative to the size.

As described above, the package frame stored in the non-transitory storage medium according to the present invention can be displayed on the display screen, and the package frame includes a color frame and a re-adjusted depth map corresponding to the color frame. The frame, and the center point of the color frame overlaps with the center point of the display screen, preferably completely overlapping. Therefore, compared with the conventional one, the packaging frame of the non-transitory storage medium can be displayed not only directly on the 2D display screen, but also the image seen by the human eye is quite natural and does not cause an uncomfortable feeling.

1‧‧‧ Non-transitory storage media

2‧‧‧Data Processing System

D1‧‧‧ direction

D2‧‧‧ direction

O‧‧‧ Center Point

P‧‧‧Package frame

1 is a schematic diagram of a non-transitory storage medium and a data processing system in accordance with a preferred embodiment of the present invention.

2A to 2D are schematic diagrams showing a processing procedure of an original depth of field frame of the first embodiment.

3A and 3B are schematic diagrams showing a processing procedure of an original color frame of the first embodiment.

4A is a schematic view of a packaging frame of the first embodiment.

4B is a color diagram of the packaging frame of the first embodiment displayed on the 2D display device. Show the relative schematic of the screen.

4C is a schematic diagram of an image of a packaging frame of another embodiment.

5A to 5D are schematic diagrams showing a processing procedure of an original depth of field frame of the second embodiment.

6A and 6B are schematic diagrams showing a processing procedure of an original color frame of the second embodiment.

Fig. 7A is a schematic view of a package frame of the second embodiment.

FIG. 7B is a schematic diagram showing the relative color frame and display screen when the package frame of the second embodiment is displayed on the 2D display device.

7C is a schematic diagram of an image of a packaging frame of still another embodiment.

8A to 8D are schematic diagrams showing a processing procedure of an original depth of field frame of the third embodiment.

9A and 9B are schematic diagrams showing a processing procedure of an original color frame of the third embodiment.

Fig. 10A is a schematic view of a package frame of the third embodiment.

FIG. 10B is a schematic diagram showing the relative color frame and the display screen when the packaging frame of the third embodiment is displayed on the 2D display device.

Fig. 10C is a schematic view showing the image of a packaging frame of still another embodiment.

The non-transitory storage medium according to the preferred embodiment of the present invention will be described with reference to the accompanying drawings, wherein the same elements will be described with the same reference numerals.

Please refer to FIG. 1 , which is a schematic diagram of a non-transitory storage medium 1 and a data processing system 2 in accordance with a preferred embodiment of the present invention.

The non-transitory storage medium 1 is accessible to a data processing system 2. The non-transitory computer readable storage medium 1 is a non-transitory computer readable storage medium, and may include, for example, a memory, a memory card, a CD, a video tape, and a computer tape. , or any combination thereof. The memory may include a read only memory (ROM), a random access memory (RAM), a flash memory, or a Field-Programmable Gate Array (FPGA), or other Form of memory. In addition, the non-transitory storage medium 1 can be located on a stand-alone device (such as a personal computer, a tablet), a network device (such as a server), or a cloud device (such as a cloud server). In addition, the data processing system 2 can implement its functions in a software program manner, and can also be implemented in a hardware or firmware manner. The present invention is not particularly limited in terms of its function.

The non-transitory storage medium 1 stores a package frame P. The package frame P can be displayed directly on a display screen. Here, the display screen is a display screen of the 2D display device, and the resolution thereof is, for example but not limited to, 1920×1080 pixels. In addition, the packaging frame P of the present invention comprises a color frame and a re-adjustment depth of field frame corresponding to the color frame, and the center point of the color frame overlaps with the center point of the display screen, preferably completely overlapping . Wherein, the color frame is obtained by resizing the size of an original color frame, and the re-adjusting depth of field frame is obtained by re-adjusting the size of an original depth of field frame, the following will be actual The image shows how the color frame is obtained by re-adjusting the size of the original color frame, how the re-adjusted depth of field frame is obtained by resizing the original depth of field frame, and the technical features of the package frame P.

2A to 2D, FIG. 2A to FIG. 2D are schematic diagrams showing a processing procedure of an original depth of field frame of the first embodiment. 2A is a schematic diagram of an original depth of field frame, FIG. 2B is a schematic diagram of an intermediate depth of field frame, FIG. 2C is a schematic diagram of a re-adjusted depth of field frame, and FIG. 2D is a size of two parts after division and inversion Re-tune the schematic of the depth of field frame. In addition, referring to FIG. 3A to FIG. 3B, FIG. 3A and FIG. 3B are schematic diagrams showing the processing procedure of an original color frame of the first embodiment. 3A is a schematic diagram of an original color frame, and FIG. 3B is a schematic diagram of a color frame of FIG. 3A after resizing.

In this embodiment, the color frame is obtained by re-adjusting the size of the original color frame. The original color frame has a preset frame size, and is, for example, but not limited to, 1920×1080 pixels, which is the same as the image resolution of the current high-definition 2D display device. Here, the original depth of field frame is the same size as the original color frame, both of which are 1920×1080. Of course, in other implementations, the preset frame size can be a different value. In addition, the figure shows a column direction D1 and a row direction D2, the column direction D1 is the horizontal direction of the displayed image, and the row direction D2 is the vertical direction of the displayed image. In addition, it is particularly noted that although FIGS. 3A and 3B show images in black and white, in reality, FIGS. 3A and 3B are displayed as color images on the 2D color display device.

The original depth of field frame corresponds to the original color frame. Here, the "correspondence" means that the original depth of field frame is obtained from the depth of field values of all the objects of the original color frame, except that the size or resolution of the two are the same, and the original color frame and the original are Depth of field frame The depth of field image plotting method (DIBR) synthesizes 3D images that can be played by a 3D display device. Since the original depth of field frame corresponds to the original color frame, the original depth of field frame also corresponds to the color frame.

Resizing the depth of field frame is obtained by re-adjusting the size of the original depth of field frame (ie, resizing the size of Figure 2A to obtain Figure 2B). The original depth of field frame of FIG. 2A is a gray-scale frame, so the sub-pixel values of each pixel have equal values (having the same gray-scale value). The number of pixels can be greater than or equal to two. Here, each pixel has, for example, three sub-pixels R, G, and B as examples.

However, before the size of the depth of field map of FIG. 2C is obtained, the embodiment first re-adjusts the size of the original depth of field frame of FIG. 2A to obtain a middle depth of field frame of FIG. 2B, and then the middle depth of field of FIG. 2B. The frame is subjected to a subpixel packing rearrangement to obtain a re-adjusted depth of field frame of FIG. 2C. Among them, re-adjusting the size of the original depth of field frame to obtain the intermediate depth of field frame is achieved by reducing the size of the original depth of field frame or by lowering the resolution of the original depth of field frame. In the present embodiment, the original depth of field frame of FIG. 2A is downscaled to obtain the intermediate depth of field frame of FIG. 2B. Here, the size of the intermediate depth of field frame is reduced to three quarters of the original depth of field frame in the row direction D2. Therefore, the size of the intermediate depth of field frame is 1920×810 (810=1080×3/4).

In addition, the secondary pixel rearrangement obtains two secondary pixel values of at least two pixels of the intermediate depth of field frame, and respectively stores the secondary pixel values corresponding to one pixel of the size re-adjusted depth of field frame. Two times inside the picture. Here, since the original depth of field frame is a grayscale frame, the three secondary pixel values in each pixel are the same, and therefore, any of the pixel values may be represented in each pixel.

The sub-picture reordering system respectively stores the sub-pixel values of the three pixels of the intermediate depth-of-field frame in the three sub-pixels of one pixel of the re-enhanced depth-of-field frame. In other words, the secondary pixel value of the first pixel of the intermediate depth of field frame is stored in the first pixel of the first pixel of the rescaled depth of field frame, and the second pixel of the intermediate depth of field frame is The secondary pixel value is stored in the second pixel of the first pixel of the size re-adjusted depth of field frame, and the secondary pixel value of the third pixel of the intermediate depth of field frame is stored in the size re-adjusted depth of field frame. The third pixel of the first pixel, and so on. Here, the middle depth of field frame of FIG. 2B can be reduced in size by one third in the row direction D2, and the re-adjusted depth of field frame of FIG. 2C is obtained, and the resolution is 1920×270 (270= 810 × 1/3).

Therefore, the size of the re-adjusted depth of field frame of FIG. 2C of the present embodiment is one quarter (3/4×1/3) of the original depth of field frame in the row direction D2. Due to the technique of rearrangement of sub-pixels, the grayscale value of the three rows of pixels in the middle depth of field frame can be stored in the three sub-pixels of one pixel of the re-enhanced depth of field frame, so compared with the original The depth of field frame and the re-adjusted depth of field frame have the advantages of high coding efficiency, and can also reduce the amount of data. When applied to transmission, the transmission efficiency can be improved.

In addition, the color frame is obtained by re-adjusting the size of the original color frame. Resizing the original color frame is achieved by reducing the size of the original color frame or by reducing the resolution of the original color frame. In the present embodiment, the original color frame of FIG. 3A is reduced to obtain the color frame of FIG. 3B. Here, the size of the color frame of FIG. 3B is scaled down in the row direction D2 to three-quarters of the original color frame. In other words, in the present embodiment, the original color frame of FIG. 3A is down-scaled in the row direction D2 to the original three-quarters, and the color frame of FIG. 3B is obtained. Therefore, the resolution of the color frame is obtained. It is 1920×810 (810=1080×3/4). However, in other embodiments, the downsizing may be other different ratios, or may be reduced in size in the column direction D1, or simultaneously reduced in the row direction D2 and the column direction D1, and is not particularly limited.

After obtaining the color frame and re-adjusting the depth of field frame, combine the color frame and the size re-adjust the depth of field frame to obtain the package frame P. However, in the case of combining the color frame and re-adjusting the depth of field frame to become the package frame P, the embodiment needs to first split the size of the depth of field frame into two parts (divided along the column direction D1). After that, the two parts are flipped separately, and the second part of FIG. 2D is obtained (the size of each part is 1920×135), and the two parts of the re-adjusted depth of field frame are respectively combined. The upper and lower sides of the color frame are obtained, and the packaging frame P of Fig. 4A is obtained. Here, the inversion system means that the rotation is 180 degrees, so that the top and bottom are reversed. The size of the two parts of the re-adjusted depth of field frame after the division in this embodiment is the same.

Referring to FIG. 4B, which is a schematic diagram of the color frame and the display screen when the package frame P of the first embodiment is displayed on the 2D display device.

As shown in FIG. 4B, the package frame P can directly display the display of the 2D display device. The screen displays, and the center point of the color frame (that is, the intersection of the diagonals of the color frame) and the center point of the display screen (that is, the intersection of the diagonal lines of the display screen) are completely overlapped (both center point O). Therefore, the package frame P can be displayed not only directly on the 2D display screen, but also as shown in FIG. 4A, through the actual viewing of the human eye, the color frame (ie, 2D image) seen is quite natural, and does not generate no Comfortable feeling.

In addition, in the first embodiment, the size of the package frame P of FIG. 4A is the same as the size of the preset frame of the original color frame of FIG. 3A, and both are 1920×1080 (1080=135+). 810+135). Because the existing technology uses a single-view single-depth left-right arrangement in the arrangement of the original color frame and the original depth-of-field frame, the image resolution after the arrangement is doubled and the burden on the transmission bandwidth is caused. However, the size of the above-mentioned packaging frame is the same as the original color frame (or the original depth of field frame), which is 1920×1080. When applied to the transmission, the packaging frame P does not cause a burden on the transmission bandwidth, nor does it cause The amount of decompression operation is too large and the user's 3D display device cannot be loaded.

In addition, please refer to FIG. 5A to FIG. 5D , and FIG. 5A to FIG. 5D are schematic diagrams showing a processing procedure of an original depth of field frame of the second embodiment. 5A is a schematic diagram of an original depth of field frame, FIG. 5B is a schematic diagram of an intermediate depth of field frame, FIG. 5C is a schematic diagram of a re-adjusted depth of field frame, and FIG. 5D is a size of two parts after division and inversion Re-tune the schematic of the depth of field frame. In addition, please refer to FIG. 6A to FIG. 6B. FIG. 6A and FIG. 6B are schematic diagrams showing the processing procedure of an original color frame of the second embodiment. 6A is a schematic diagram of an original color frame, and FIG. 6B is a schematic diagram of a color frame of FIG. 6A after resizing. Although FIGS. 6A and 6B show images in black and white, actually, FIGS. 6A and 6B are displayed as color images on the 2D color display device.

The processing procedure of FIGS. 5A to 5D is the same as that of FIGS. 2A to 2D, but the height (1080) of the frame is kept constant, and the size of the frame is re-adjusted in the column direction D1. Wherein, the size of the re-adjusted depth of field frame of FIG. 5C is one quarter (480×1080) of the original depth of field frame of FIG. 5A along the column direction D1, and then the horizontally averaged and inverted size is re-adjusted to the depth of field. The two parts of the frame (240×1080, FIG. 5D) are respectively combined on the left and right sides of the color frame (1440×1080) which is reduced by three-quarters in the horizontal direction of FIG. 6B, and the package frame P of FIG. 7A is obtained. The display situation of the package frame P of FIG. 7A in the 2D display screen can be referred to FIG. 7B.

In particular, the color frame of the above embodiment is obtained by resizing the original color frame. However, in other embodiments, the color frame and the two parts of the re-adjusted depth of field frame may be directly combined to obtain a package frame P of different sizes. In addition, the above functions of resizing, dividing, combining, and flipping can be implemented in a software program or firmware. If implemented in a software program, for example, as follows:

The above software programs are only examples, and the relevant technicians can write different combinations of programs according to the above description.

In addition, please refer to FIG. 4C and FIG. 7C, which are respectively another embodiment. The image diagram of the packaging frame, wherein the dimensions of FIG. 4C and FIG. 7C are the same as 1920×1080.

As can be seen from FIG. 4C or FIG. 7C, the actual view of the human eye proves that the image of the person in the color frame seen is quite natural and does not cause an uncomfortable feeling.

In addition, please refer to FIG. 8A to FIG. 10A , which are schematic diagrams of the processing procedure of an original depth of field frame of the third embodiment. 8A is a schematic diagram of an original depth map, FIG. 8B is a schematic diagram of an intermediate depth of field frame, FIG. 8C is a schematic diagram of a re-adjusted depth of field frame, and FIG. 8D is a size of two parts after division and rotation. A schematic diagram of the depth of field frame. In addition, FIG. 9A and FIG. 9B are schematic diagrams showing a processing procedure of an original color frame of the third embodiment. 9A is a schematic diagram of an original color frame, and FIG. 9B is a schematic diagram of a color frame after resizing of FIG. 9A. In the third embodiment, the same original depth map frame and the original color frame are still explained in the same manner as the first embodiment, so 9A is the same as FIG. 2A, and FIG. 9A is the same as FIG. 3A. Although FIGS. 9A and 9B show images in black and white, actually, FIGS. 9A and 9B are displayed as color images on the 2D color display device.

As in the above embodiment, the size of the original depth of field map is re-adjusted to obtain a resized depth of field map (from Figs. 8A to 8C). However, before the size of the depth of field frame of FIG. 8C is obtained, the embodiment first re-adjusts the size of the original depth of field frame of FIG. 8A to obtain the middle depth of field frame of FIG. 8B, and then performs the intermediate depth of field frame. The pixels are rearranged to obtain the re-adjusted depth of field frame of Figure 8C. Here, the original depth of field frame of FIG. 8A is scaled down to obtain the intermediate depth of field frame of FIG. 8B. Wherein, the original depth of field frame of FIG. 8A is reduced to the original two-thirds in the row direction D2, and the size in the column direction D1 is reduced to nineteenths of the original to obtain the intermediate depth of field of FIG. 8B. The frame, so the resolution of the intermediate depth of field frame is 1080 × 720 (1080 = 1920 × 9 / 16, 720 = 1080 × 2 / 3). In addition, the content of the sub-pixel reordering has been detailed in the above, and will not be described again. Therefore, in this embodiment, after rearranging through the sub-pixels, the size of the middle depth map frame of FIG. 8B can be reduced to the original one-third in the row direction D2, so as to obtain the resolution of the re-adjusted depth of field frame of FIG. 8C. The degree is 1080 × 240 (240 = 720 × 1/3). Therefore, the size of the re-adjusted depth of field frame of Figure 8C is two-ninths (1/3 × 1/3) of the original depth-of-field frame along the row direction D2, and the sixteenth point of the original depth-of-field frame along the column direction D1. nine.

In addition, the original color frame of FIG. 9A is reduced to obtain the color frame of FIG. 9B. Here, the size of the color frame of FIG. 9B is scaled down along the column direction D1. The seven-eighth of the original color frame of 9A, therefore, the resolution of the color frame is 1680×1080 (1680=1920×7/8).

Then, the color frame and the size re-adjust the depth of field frame are combined to obtain the package frame P of FIG. 10A. However, before combining, it is necessary to first divide the horizontally-adjusted depth-of-field frame of FIG. 8C into two parts (after dividing the column direction D1), and then rotate the two parts separately to obtain the figure. The second part of 8D (each part has a size of 120×1080), and then the two parts of the re-adjusted depth of field frame of the rotated shape are respectively combined on the left and right sides of the color frame of FIG. 9B, and the result of FIG. 10A is obtained. Packing frame P. Here, the rotation system is rotated 90 degrees clockwise. Therefore, it can be seen from the packaging frame P of FIG. 10A that the size of the packaging frame P of the embodiment is the same as the size of the original frame of the original color frame, and is still 1920×1080 (1920=120+1680+120). ).

In addition, please refer to FIG. 10B, which is a schematic diagram of the color frame and the display screen when the package frame P of the third embodiment is displayed on the 2D display device.

As shown in FIG. 10B, the package frame P can be directly displayed on the display screen of the 2D display device, and the center point of the color frame (ie, the intersection of the diagonals of the color frame) and the center point of the display screen (ie, the display screen) The intersection of the diagonals is completely overlapping (both center points O). Therefore, the package frame P can be displayed not only directly on the 2D display screen, but also as shown in FIG. 10A, the actual color view frame (ie 2D image) is quite natural and less likely to be seen. Produces an uncomfortable feeling.

In addition, in the third embodiment, the size of the package frame P of FIG. 10A is the same as the size of the preset frame of the original color frame of FIG. 9A, and both are 1920×1080 (1080=135+). 810+135), so as with the first embodiment and the second embodiment, when the package frame P of the second embodiment is applied to the transmission, the transmission bandwidth is not burdened, and the operation amount of the decompression is not excessive. The user's 3D display device cannot be loaded.

In addition, please refer to FIG. 10C , which is a schematic diagram of another image of the package frame P, and its size is still 1920×1080.

As can be seen from Fig. 10C, the actual view of the human eye proves that the image of the person in the color frame seen is quite natural and does not cause an uncomfortable feeling.

In summary, the package map stored by the non-transitory storage medium according to the present invention The frame can be displayed on the display screen, and the package frame includes a color frame and a re-adjustment depth of field frame corresponding to the color frame, and the center point of the color frame overlaps with the center point of the display screen, preferably The systems are completely overlapping. Therefore, compared with the conventional one, the packaging frame of the non-transitory storage medium can be displayed not only directly on the 2D display screen, but also the image seen by the human eye is quite natural and does not cause an uncomfortable feeling.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

1‧‧‧ Non-transitory storage media

2‧‧‧Data Processing System

P‧‧‧Package frame

Claims (16)

A non-transitory storage medium is accessible to a data processing system, the non-transitory storage medium includes: a package frame, stored in the non-transitory storage medium, and displayed on a display screen, wherein the package The frame comprises a color frame and a re-adjustment depth of field frame corresponding to the color frame, the center point of the color frame completely overlapping the center point of the display screen, wherein the color frame is heavy The size of the original color frame is adjusted, and the original color frame has a preset frame size, and the size of the package frame is the same as the size of the preset frame. The non-transitory storage medium of claim 1, wherein the display screen is a 2D display screen. The non-transitory storage medium of claim 1, wherein the resizing of the original color frame is obtained by reducing the size of the original color frame. The non-transitory storage medium of claim 1, wherein the resizing of the original color frame is obtained by reducing the resolution of the original color frame. The non-transitory storage medium of claim 1, wherein the size of the color frame is three-quarters of the original color frame in the row direction. The non-transitory storage medium of claim 1, wherein the re-adjusting the depth of field frame is obtained by re-adjusting the size of an original depth of field frame. The non-transitory storage medium of claim 6, wherein the original depth of field frame is a grayscale frame. The non-transitory storage medium of claim 7, wherein in the grayscale frame, the secondary pixels of each pixel are equal. The non-transitory storage medium of claim 6, wherein the original depth of field frame is resized to obtain an intermediate depth of field frame, and the intermediate depth of field frame is reordered by pixels. Get the reordered depth of field frame for this size. The non-transitory storage medium of claim 9, wherein the size of the intermediate depth of field frame is three-quarters of the original depth of field frame along the row direction. The non-transitory storage medium of claim 9, wherein the size re-adjusts the depth of field The size of the frame is one-third of the intermediate depth of field frame along the row direction. The non-transitory storage medium of claim 9, wherein the re-adjusted depth of field frame has a plurality of pixels, each of the pixels having three sub-pixels, wherein the sub-pixels respectively store the middle The sub-pixel values of the three pixels of the depth of field frame. The non-transitory storage medium according to claim 1, wherein the re-adjusted depth of field frame is divided into two parts and combined on the upper side and the lower side of the color picture frame respectively. The non-transitory storage medium of claim 13, wherein the two dimensions of the re-adjusted depth of field frame combined on the upper side and the lower side of the color frame re-adjust the depth of field frame relative to the size The system has been flipped over. The non-transitory storage medium according to claim 1, wherein the re-adjusted depth of field frame is divided into two parts and combined on the left and right sides of the color frame respectively. The non-transitory storage medium according to claim 15, wherein the two parts of the size re-adjusted depth of field frame combined on the left and right sides of the color frame are re-adjusted with respect to the size of the depth of field frame Being rotated.