CN103327336B - A kind of method and apparatus of 3-dimensional encoding - Google Patents

Abstract

The embodiment of the invention discloses the method and apparatus of a kind of 3-dimensional encoding, the parameter of depth image is concentrated by parameter read-in sequence head or the sequential parameter of visible image, thus realize depth image and visible image and use different parameters that image is encoded, it is to avoid use identical parameter that depth image and visible image are encoded and then the problem of encoder complexity of the code efficiency of influence depth image and depth image.

Description

Three-dimensional coding method and equipment

Technical Field

The present invention relates to the field of video coding, and in particular, to a method and apparatus for three-dimensional coding.

Background

In order to reduce the bandwidth occupied by video transmission, video data needs to be encoded, wherein an intra-frame compression method and an inter-frame compression method are common video encoding technologies, and can compress video images to be transmitted to reduce video transmission data.

The intra-frame compression method is to perform encoding or decoding operation on the current image by using the information that the current image has been encoded or decoded.

The interframe compression method is a video coding technology based on motion estimation, and the process of coding a video image by a video coding end comprises the following steps: firstly, dividing an image block to be encoded into a plurality of sub-image blocks with equal size; then, aiming at each sub image block, searching an image block which is most matched with the current sub image block in a reference image as a prediction block; then, subtracting the corresponding pixel values of the sub image block and the prediction block to obtain a residual error, and combining the obtained residual errors corresponding to the sub image blocks together to obtain a residual error of the image block; then entropy coding is carried out on the value obtained after the residual error of the image block is transformed and quantized; and finally, transmitting the bit stream obtained by entropy coding and motion vector information to a decoding end, wherein the motion vector information represents the position difference between the current sub image block and the prediction block. And after receiving the bit stream and the motion vector information sent by the encoding end, the decoding end carries out a processing process opposite to that of the encoding end, and thus the original data of the corresponding image block can be obtained.

The above-described techniques are also used in three-dimensional video image coding. In a three-dimensional video system, two types of images, a view image and a depth image, are included. The view image contains information of the image itself, and the depth image contains depth information of the view image. Since three-dimensional video typically includes multiple video images, multiple depth images are also typically included in three-dimensional systems. In order to improve the compression efficiency of three-dimensional video, the view images can be encoded by using information between the view images in addition to the information of the images themselves. The depth image corresponding to the view image provides depth information for coding prediction between the view images. Since the depth image represents depth information of content in the view image, and the content of the depth image is derived from the view image, preset encoding parameters used for encoding the depth image for defining video attributes of the depth image are generally consistent with parameters of the view image, so that the number of encoding bits can be effectively saved. However, since the depth image only contains the depth information of the view image, the view image does not contain rich texture information. Using the same parameters as the view image may affect the coding efficiency of the depth image.

Disclosure of Invention

The embodiment of the invention provides a three-dimensional coding method, aiming at solving the problem that how to avoid the coding efficiency of a depth image and the coding complexity of the depth image from being influenced by the same parameters of the depth image and a view image.

In a first aspect, a method of three-dimensional encoding, the method comprising:

determining the maximum intra-frame conversion layer number of the visual image, the maximum inter-frame conversion layer number of the visual image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

writing the value of the maximum intra-frame conversion layer number of the depth image into a Sequence header or a Sequence parameter set Sequence header through the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and writing the value of the maximum inter-frame conversion layer number of the depth image into the Sequence header or the Sequence parameter set Sequence header through the relationship between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set Sequence header set according to a relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or Sequence parameter set Sequence header set according to a relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image includes:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

With reference to the first aspect, in a second possible implementation manner of the first aspect, the writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set Sequence header set according to a relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or Sequence parameter set Sequence header set according to a relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image includes:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

In a second aspect, a method of three-dimensional decoding, the method comprising:

determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set;

and decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the obtaining, according to a sequence header or a sequence parameter set, the maximum intra-frame transform layer number of depth images and the maximum inter-frame transform layer number of depth images includes:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

With reference to the second aspect, in a second possible implementation manner of the second aspect, the acquiring a maximum intra-frame transform layer number of the depth image and a maximum inter-frame transform layer number of the depth image according to the sequence header or the sequence parameter set includes:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

In a third aspect, an encoder comprises:

the determining unit is used for determining the maximum intra-frame conversion layer number of the view image, the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

the coding unit is used for coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

a writing unit, configured to write the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or a Sequence parameter set Sequence header according to a relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and write the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or the Sequence parameter set Sequence header according to a relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image.

With reference to the third aspect, in a first possible implementation manner of the third aspect, the writing unit is specifically configured to:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

With reference to the third aspect, in a second possible implementation manner of the third aspect, the writing unit is specifically configured to:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

In a fourth aspect, a decoder, the decoder comprising:

the determining unit is used for determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

the acquisition unit is used for acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set;

and the decoding unit is used for decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the obtaining unit is specifically configured to:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

With reference to the fourth aspect, in a second possible implementation manner of the fourth aspect, the obtaining unit is specifically configured to:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

Compared with the prior art, the invention provides a three-dimensional coding method, which writes the parameters of a depth image into a sequence header or a sequence parameter set through the parameters of a view image, thereby realizing that the depth image and the view image adopt different parameters to code the image, and avoiding the problem that the coding efficiency of the depth image and the coding complexity of the depth image are influenced by coding the depth image and the view image by using the same parameters.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic diagram of a method for encoding a view image and a depth image provided in the prior art;

FIG. 2 is a flow chart of a method for three-dimensional encoding according to an embodiment of the present invention;

FIG. 3 is a flowchart of a three-dimensional decoding method according to an embodiment of the present invention;

FIG. 4 is a block diagram of an encoder according to an embodiment of the present invention;

fig. 5 is a block diagram of a decoder according to an embodiment of the present invention;

FIG. 6 is a block diagram of an encoder according to an embodiment of the present invention;

fig. 7 is a block diagram of a decoder according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, fig. 1 is a schematic diagram of a method for encoding a view image and a depth image provided in the prior art. In a common three-dimensional video coding and decoding system, a video image and a depth image use two sets of coding parameters for respectively identifying the coding parameters of the video image and the coding parameters of the depth image. However, since the depth image and the view image have high correlation, most values of the two sets of coding parameters are the same, for example, the maximum number of partition layers for identifying a coding unit, the maximum size available for the coding unit, and the minimum size available for the coding unit. Therefore, using two sets of encoding parameters for identifying the view image and the depth image may result in a certain encoding overhead, and increase the number of bits for encoding. However, at the same time, because the video and the depth image still have a certain difference, if the video and the depth image both use the same set of coding parameters, the coding performance may be degraded, as shown in fig. 1, the solid line in the figure represents the division manner of the coding blocks, and the division manner of the coding blocks of the video and the depth image is the same, so the parameters related to the division of the coding units in the video and the depth image, such as the maximum number of division layers for identifying the coding units, the maximum size available for the coding units, and the minimum size available for the coding units, are the same; in the method of dividing the transform block indicated by the dotted line in the figure, it is seen that the method of dividing the transform block is different between the video image and the depth image, and therefore, the setting of the parameters related to the division of the transform block in the video image and the depth image is not consistent.

In a three-dimensional video coding and decoding system, both the view image and the depth image can use a layer-by-layer partitioning method to partition the transformation blocks. Since the view and depth images use the same encoding parameters, the quadtreetmaxdepthra parameter is used to control the number of maximum divided layers of the view and depth image intra-frame transform blocks, and the quadtreetmaxdepthra parameter is used to control the number of maximum divided layers of the view and depth image inter-frame transform blocks.

The layer-by-layer dividing method is effective for the image with certain texture information, and the depth image does not have obvious texture information. Therefore, the depth image is encoded using the same number of preset maximum divided layers as the view image, which does not effectively improve the encoding efficiency but increases the encoding complexity.

Therefore, the invention provides a method for separating and coding a layer-by-layer division method of a visual image and a depth image, and meanwhile, other coding parameters of the visual image and the depth image are still consistent, namely, only one set of parameters needs to be coded for other coding parameters. When a preset maximum number of partitionable transform layers is encoded, the maximum number of partitionable transform layers of the view image and the depth image are separately encoded. Therefore, the coding efficiency and flexibility of the visual image and the depth image can be considered.

Referring to fig. 2, fig. 2 is a flowchart of a three-dimensional encoding method according to an embodiment of the present invention. As shown in fig. 2, the method comprises the steps of:

step 201, determining the maximum intra-frame conversion layer number of a view image, the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of a depth image and the maximum inter-frame conversion layer number of the depth image;

specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, and DepthMapQuadtreeTUMaxDepthIntra and DepthMapQuadtreeTUMaxDepthInter are introduced to respectively control the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

Step 202, coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

step 203, writing the value of the maximum intra-frame transformation layer number of the depth image into a Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum intra-frame transformation layer number of the depth image and the maximum intra-frame transformation layer number of the view image, and writing the value of the maximum inter-frame transformation layer number of the depth image into the Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum inter-frame transformation layer number of the depth image and the maximum inter-frame transformation layer number of the view image.

Specifically, the encoding end determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, and writes the maximum intra-frame conversion layer number of the view image into a sequence header or a sequence parameter set; the decoding end analyzes the four parameters from the sequence head or the sequence parameter set and determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image.

Optionally, the writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set by the relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into a Sequence header or Sequence parameter set Sequence header by the relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image includes:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

Specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, DeltaQuadtreeTUMaxDepthIntra represents the difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and DeltaQuadtreeTUMaxDepthInter represents the difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image. Obtaining the maximum intra-frame conversion layer number DepthMapQuadtreeMaxDepthIntra of the depth image and the maximum inter-frame conversion layer number DepthMapQuadtreeMaxDepthInter of the depth image at a decoding end as follows:

DepthMapQuadtreeTUMaxDepthIntra=DeltaQuadtreeTUMaxDepthIntra+QuadtreeTUMaxDepthIntra；

DepthMapQuadtreeTUMaxDepthInter=DeltaQuadtreeTUMaxDepthInter+QuadtreeTUMaxDepthInter

in order to prevent the occurrence of negative values in depthMapQuadtreeTUMaxDepthIntra and depthMapQuadtreeTUMaxDepthInter, a judgment condition may be added: when the value of DepthMapQuadtreeTUMaxDepthIntra is less than 0, setting the value of DepthMapQuadtreeTUMaxDepthIntra to 0; when the value of DepthMapQuadtreeTUMaxDepthInter is less than 0, the value of DepthMapQuadtreeTUMaxDepthInter is set to 0.

Optionally, the writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set by the relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into a Sequence header or Sequence parameter set Sequence header by the relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image includes:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

Specifically, in order to improve the flexibility of depth image coding, a flag bit may be added to a sequence header or a sequence parameter set to identify whether the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and whether the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image. When the flag bit is 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image, and the view image and the depth image use the same set of coding parameters; when the flag bit is 0, it indicates that the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image, and the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image are controlled by independent parameters, and at this time, values of other coding parameters of the view image and the depth image are.

The invention provides a three-dimensional coding method, which writes parameters of a depth image into a sequence header or a sequence parameter set through parameters of a view image, thereby realizing that the depth image and the view image adopt different parameters to code the image, and avoiding the problem that the coding efficiency of the depth image and the coding complexity of the depth image are influenced by coding the depth image and the view image by using the same parameters.

Referring to fig. 3, fig. 3 is a flowchart of a three-dimensional decoding method according to an embodiment of the present invention. As shown in fig. 3, the method comprises the steps of:

step 301, determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

step 302, acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set;

specifically, the decoding end analyzes the four parameters from the sequence header or the sequence parameter set and determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image.

Optionally, the obtaining the maximum intra-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the depth image according to the sequence header or the sequence parameter set includes:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

Specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, DeltaQuadtreeTUMaxDepthIntra represents the difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and DeltaQuadtreeTUMaxDepthInter represents the difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image. Obtaining the maximum intra-frame conversion layer number DepthMapQuadtreeMaxDepthIntra of the depth image and the maximum inter-frame conversion layer number DepthMapQuadtreeMaxDepthInter of the depth image at a decoding end as follows:

DepthMapQuadtreeTUMaxDepthIntra=DeltaQuadtreeTUMaxDepthIntra+QuadtreeTUMaxDepthIntra；

DepthMapQuadtreeTUMaxDepthInter=DeltaQuadtreeTUMaxDepthInter+QuadtreeTUMaxDepthInter

in order to prevent the occurrence of negative values in depthMapQuadtreeTUMaxDepthIntra and depthMapQuadtreeTUMaxDepthInter, a judgment condition may be added: when the value of DepthMapQuadtreeTUMaxDepthIntra is less than 0, setting the value of DepthMapQuadtreeTUMaxDepthIntra to 0; when the value of DepthMapQuadtreeTUMaxDepthInter is less than 0, the value of DepthMapQuadtreeTUMaxDepthInter is set to 0.

Optionally, the obtaining the maximum intra-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the depth image according to the sequence header or the sequence parameter set includes:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

Specifically, in order to improve the flexibility of depth image coding, a flag bit may be added to a sequence header or a sequence parameter set to identify whether the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and whether the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image. When the flag bit is 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image, and the view image and the depth image use the same set of coding parameters; when the flag bit is 0, it indicates that the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image, and the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image are controlled by independent parameters, and at this time, values of other coding parameters of the view image and the depth image are.

And 303, decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

The invention provides a three-dimensional coding method, which writes parameters of a depth image into a sequence header or a sequence parameter set through parameters of a view image, thereby realizing that the depth image and the view image adopt different parameters to code the image, and avoiding the problem that the coding efficiency of the depth image and the coding complexity of the depth image are influenced by coding the depth image and the view image by using the same parameters.

Referring to fig. 4, fig. 4 is a structural diagram of an encoder according to an embodiment of the present invention. As shown in fig. 4, the encoder includes the following units:

a determining unit 401, configured to determine the maximum number of layers of intra-frame conversion of a view image, the maximum number of layers of inter-frame conversion of a view image, the maximum number of layers of intra-frame conversion of a depth image, and the maximum number of layers of inter-frame conversion of a depth image;

specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, and DepthMapQuadtreeTUMaxDepthIntra and DepthMapQuadtreeTUMaxDepthInter are introduced to respectively control the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

An encoding unit 402, configured to encode an image according to the maximum intra-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the depth image;

a writing unit 403, configured to write the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and write the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image.

Specifically, the encoding end determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, and writes the maximum intra-frame conversion layer number of the view image into a sequence header or a sequence parameter set; the decoding end analyzes the four parameters from the sequence head or the sequence parameter set and determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image.

Optionally, the writing unit 403 is specifically configured to:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

Specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, DeltaQuadtreeTUMaxDepthIntra represents the difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and DeltaQuadtreeTUMaxDepthInter represents the difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image. Obtaining the maximum intra-frame conversion layer number DepthMapQuadtreeMaxDepthIntra of the depth image and the maximum inter-frame conversion layer number DepthMapQuadtreeMaxDepthInter of the depth image at a decoding end as follows:

DepthMapQuadtreeTUMaxDepthIntra=DeltaQuadtreeTUMaxDepthIntra+QuadtreeTUMaxDepthIntra；

DepthMapQuadtreeTUMaxDepthInter=DeltaQuadtreeTUMaxDepthInter+QuadtreeTUMaxDepthInter

in order to prevent the occurrence of negative values in depthMapQuadtreeTUMaxDepthIntra and depthMapQuadtreeTUMaxDepthInter, a judgment condition may be added: when the value of DepthMapQuadtreeTUMaxDepthIntra is less than 0, setting the value of DepthMapQuadtreeTUMaxDepthIntra to 0; when the value of DepthMapQuadtreeTUMaxDepthInter is less than 0, the value of DepthMapQuadtreeTUMaxDepthInter is set to 0.

Optionally, the writing unit 403 is specifically configured to:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

Specifically, in order to improve the flexibility of depth image coding, a flag bit may be added to a sequence header or a sequence parameter set to identify whether the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and whether the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image. When the flag bit is 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image, and the view image and the depth image use the same set of coding parameters; when the flag bit is 0, it indicates that the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image, and the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image are controlled by independent parameters, and at this time, values of other coding parameters of the view image and the depth image are.

The invention provides an encoder, which is characterized in that parameters of a depth image are written into a sequence header or a sequence parameter set through parameters of a view image, so that the depth image and the view image are encoded by adopting different parameters, and the problem that the encoding efficiency of the depth image and the encoding complexity of the depth image are influenced by encoding the depth image and the view image by using the same parameters is solved.

Referring to fig. 5, fig. 5 is a block diagram of a decoder according to an embodiment of the present invention. As shown in fig. 5, the decoder includes the following units:

a determining unit 501, configured to determine the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

an obtaining unit 502, configured to obtain the maximum intra-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the depth image according to the sequence header or the sequence parameter set;

specifically, the decoding end analyzes the four parameters from the sequence header or the sequence parameter set and determines the maximum intra-frame conversion layer number of the depth image, the maximum inter-frame conversion layer number of the depth image, the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image.

Optionally, the obtaining unit 502 is specifically configured to:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

Specifically, QuadtreeTUMaxDepthIntra and QuadtreeTUMaxDepthInter are set to respectively control the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image, DeltaQuadtreeTUMaxDepthIntra represents the difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and DeltaQuadtreeTUMaxDepthInter represents the difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image. Obtaining the maximum intra-frame conversion layer number DepthMapQuadtreeMaxDepthIntra of the depth image and the maximum inter-frame conversion layer number DepthMapQuadtreeMaxDepthInter of the depth image at a decoding end as follows:

DepthMapQuadtreeTUMaxDepthIntra=DeltaQuadtreeTUMaxDepthIntra+QuadtreeTUMaxDepthIntra；

DepthMapQuadtreeTUMaxDepthInter=DeltaQuadtreeTUMaxDepthInter+QuadtreeTUMaxDepthInter

in order to prevent the occurrence of negative values in depthMapQuadtreeTUMaxDepthIntra and depthMapQuadtreeTUMaxDepthInter, a judgment condition may be added: when the value of DepthMapQuadtreeTUMaxDepthIntra is less than 0, setting the value of DepthMapQuadtreeTUMaxDepthIntra to 0; when the value of DepthMapQuadtreeTUMaxDepthInter is less than 0, the value of DepthMapQuadtreeTUMaxDepthInter is set to 0.

Optionally, the obtaining unit 502 is specifically configured to:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

Specifically, in order to improve the flexibility of depth image coding, a flag bit may be added to a sequence header or a sequence parameter set to identify whether the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and whether the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image. When the flag bit is 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image, and the view image and the depth image use the same set of coding parameters; when the flag bit is 0, it indicates that the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image, and the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image are controlled by independent parameters, and at this time, values of other coding parameters of the view image and the depth image are.

A decoding unit 503, configured to decode the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

The invention provides a decoder, which writes parameters of a depth image into a sequence header or a sequence parameter set through parameters of a view image, thereby realizing that the depth image and the view image adopt different parameters to code the image, and avoiding the problem that the coding efficiency of the depth image and the coding complexity of the depth image are influenced by coding the depth image and the view image by using the same parameters.

Referring to fig. 6, fig. 6 is a structural diagram of an encoder according to an embodiment of the present invention. Referring to fig. 6, fig. 6 is a block diagram of an encoder 600 according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the encoder 600. The encoder 600 includes:

a processor (processor)601, a communication Interface (Communications Interface)602, a memory (memory)603, and a bus 604.

The processor 601, the communication interface 602, and the memory 603 communicate with each other via the bus 604.

A communication interface 602 for communicating with a decoder;

a processor 601 for executing programs stored in the memory 603.

In particular, the program may include program code comprising computer operating instructions.

The processor 601 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention.

The memory 603 stores programs. The memory 603 may include a high-speed RAM memory and may also include a non-volatile memory (non-volatile memory). The program specifically comprises:

determining the maximum intra-frame conversion layer number of the visual image, the maximum inter-frame conversion layer number of the visual image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

writing the value of the maximum intra-frame conversion layer number of the depth image into a Sequence header or a Sequence parameter set Sequence header through the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and writing the value of the maximum inter-frame conversion layer number of the depth image into the Sequence header or the Sequence parameter set Sequence header through the relationship between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

The writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set according to the relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image, includes:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

The writing the value of the maximum intra-frame transform layer number of the depth image into a Sequence header or Sequence parameter set according to the relationship between the maximum intra-frame transform layer number of the depth image and the maximum intra-frame transform layer number of the view image, and writing the value of the maximum inter-frame transform layer number of the depth image into the Sequence header or Sequence parameter set Sequence header according to the relationship between the maximum inter-frame transform layer number of the depth image and the maximum inter-frame transform layer number of the view image, includes:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

Referring to fig. 7, fig. 7 is a block diagram of a decoder according to an embodiment of the present invention. Referring to fig. 7, fig. 7 is a decoder 700 according to an embodiment of the present invention, and the specific implementation of the decoder 700 is not limited in the embodiments of the present invention. The decoder 700 includes:

a processor (processor)701, a communication Interface (Communications Interface)702, a memory (memory)703, and a bus 704.

The processor 701, the communication interface 702, and the memory 703 communicate with each other via the bus 704.

A communication interface 702 for communicating with an encoder;

a processor 701 for executing programs stored in the memory 703.

In particular, the program may include program code comprising computer operating instructions.

The processor 701 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention.

The memory 703 is used for storing programs. The memory 703 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory). The program specifically comprises:

determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set;

and decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

The acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set includes:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

The acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to the sequence header or the sequence parameter set includes:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (12)

1. A method of three-dimensional encoding, the method comprising:

determining the maximum intra-frame conversion layer number of the visual image, the maximum inter-frame conversion layer number of the visual image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

writing the value of the maximum intra-frame conversion layer number of the depth image into a sequence head or a sequence parameter set through the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, writing the value of the maximum inter-frame conversion layer number of the depth image into the sequence head or the sequence parameter set through the relationship between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image, and writing the maximum intra-frame and inter-frame conversion layer number of the view image into the sequence head or the sequence parameter set.

2. The method according to claim 1, wherein the writing the value of the maximum number of intra-conversion layers for the depth image into a sequence header or a sequence parameter set through a relationship between the maximum number of intra-conversion layers for the depth image and the maximum number of intra-conversion layers for the view image, and the writing the value of the maximum number of inter-conversion layers for the depth image into a sequence header or a sequence parameter set through a relationship between the maximum number of inter-conversion layers for the depth image and the maximum number of inter-conversion layers for the view image comprises:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

3. The method according to claim 1, wherein the writing the value of the maximum number of intra-conversion layers for the depth image into a sequence header or a sequence parameter set through a relationship between the maximum number of intra-conversion layers for the depth image and the maximum number of intra-conversion layers for the view image, and the writing the value of the maximum number of inter-conversion layers for the depth image into a sequence header or a sequence parameter set through a relationship between the maximum number of inter-conversion layers for the depth image and the maximum number of inter-conversion layers for the view image comprises:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

4. A method of three-dimensional decoding, the method comprising:

determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to a sequence header or a sequence parameter set, wherein the sequence header or the sequence parameter set comprises the maximum intra-frame and inter-frame conversion layer number of the view image, the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and the relationship between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer of the view image;

and decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

5. The method of claim 4, wherein obtaining the maximum number of intra-frame transform layers of the depth image and the maximum number of inter-frame transform layers of the depth image according to the sequence header or the sequence parameter set comprises:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

6. The method of claim 4, wherein obtaining the maximum number of intra-frame transform layers of the depth image and the maximum number of inter-frame transform layers of the depth image according to the sequence header or the sequence parameter set comprises:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.

7. An encoder, characterized in that the encoder comprises:

the determining unit is used for determining the maximum intra-frame conversion layer number of the view image, the maximum inter-frame conversion layer number of the view image, the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

the coding unit is used for coding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image;

and the writing unit is used for writing the value of the maximum intra-frame conversion layer number of the depth image into a sequence header or a sequence parameter set through the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, writing the value of the maximum inter-frame conversion layer number of the depth image into the sequence header or the sequence parameter set through the relationship between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image, and writing the maximum intra-frame and inter-frame conversion layer number of the view image into the sequence header or the sequence parameter set.

8. The encoder according to claim 7, wherein the writing unit is specifically configured to:

determining a first difference value between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image;

determining a second difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image;

writing the first difference and the second difference into a sequence header or a sequence parameter set.

9. The encoder according to claim 7, wherein the writing unit is specifically configured to:

writing a preset flag bit 1 into a sequence header or a sequence parameter set; or,

writing a preset flag bit 0, a first difference value and a second difference value into a sequence header or a sequence parameter set;

when a flag bit is preset to be 1, the maximum intra-frame conversion layer number of the depth image is the same as the maximum intra-frame conversion layer number of the view image, and the maximum inter-frame conversion layer number of the depth image is the same as the maximum inter-frame conversion layer number of the view image; when the preset flag bit is 0, the maximum intra-frame conversion layer number of the depth image is different from the maximum intra-frame conversion layer number of the view image, or the maximum inter-frame conversion layer number of the depth image is different from the maximum inter-frame conversion layer number of the view image.

10. A decoder, characterized in that the decoder comprises:

the determining unit is used for determining the maximum intra-frame conversion layer number of the view image and the maximum inter-frame conversion layer number of the view image;

the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image according to a sequence header or a sequence parameter set, wherein the sequence header or the sequence parameter set comprises the maximum intra-frame and inter-frame conversion layer number of the view image, the relationship between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image, and the relationship between the maximum inter-frame conversion layer;

and the decoding unit is used for decoding the image according to the maximum intra-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the depth image.

11. The decoder according to claim 10, wherein the obtaining unit is specifically configured to:

acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value;

acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value;

the first difference is the difference between the maximum intra-frame conversion layer number of the depth image and the maximum intra-frame conversion layer number of the view image; the second difference value is a difference value between the maximum inter-frame conversion layer number of the depth image and the maximum inter-frame conversion layer number of the view image.

12. The decoder according to claim 10, wherein the obtaining unit is specifically configured to:

when the flag bit in the sequence header or the sequence parameter set is 1, acquiring the maximum intra-frame conversion layer number of the depth image according to the condition that the maximum intra-frame conversion layer number of the view image is the same as the maximum intra-frame conversion layer number of the depth image, and acquiring the maximum inter-frame conversion layer number of the depth image according to the condition that the maximum inter-frame conversion layer number of the view image is the same as the maximum inter-frame conversion layer number of the depth image;

when the flag bit is 0, acquiring the maximum intra-frame conversion layer number of the depth image according to the maximum intra-frame conversion layer number of the view image and the first difference value; and acquiring the maximum inter-frame conversion layer number of the depth image according to the maximum inter-frame conversion layer number of the view image and the second difference value.