阅读说明：本技术 基于混合编码的点云属性编解码方法及装置 (Point cloud attribute coding and decoding method and device based on hybrid coding ) 是由 张伟 杨付正 代娜 孙泽星 于 2020-12-03 设计创作，主要内容包括：本发明公开了一种基于混合编码的点云属性编解码方法及装置,所述编码方法包括：获取原始点云数据；基于重建几何信息对原始点云数据的属性信息进行空间变换和属性插值预测,得到重构点云属性信息；对重构点云属性信息进行处理,得到待编码信息；根据待编码信息的分布特性,采用不同的编码方式对其进行编码处理,得到属性码流信息。本发明提供的基于混合编码的点云属性编码方法降低了码流大小,提升了编码性能。(The invention discloses a point cloud attribute coding and decoding method and device based on hybrid coding, wherein the coding method comprises the following steps: acquiring original point cloud data; performing spatial transformation and attribute interpolation prediction on attribute information of original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information; processing the reconstructed point cloud attribute information to obtain information to be encoded; and according to the distribution characteristics of the information to be coded, coding the information by adopting different coding modes to obtain attribute code stream information. The point cloud attribute coding method based on the hybrid coding reduces the size of a code stream and improves the coding performance.)

1. A point cloud attribute coding method based on hybrid coding is characterized by comprising the following steps:

acquiring original point cloud data;

performing spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information;

processing the reconstructed point cloud attribute information to obtain information to be encoded;

and according to the distribution characteristics of the information to be coded, coding the information by adopting different coding modes to obtain attribute code stream information.

2. The point cloud attribute coding method based on hybrid coding according to claim 1, wherein processing the reconstructed point cloud attribute information to obtain information to be coded comprises:

performing attribute prediction processing on the reconstructed point cloud attribute information to obtain a prediction residual error;

and quantizing the prediction residual to obtain a quantized residual, and taking the quantized residual as information to be coded.

3. The point cloud attribute coding method based on hybrid coding according to claim 2, wherein the coding is performed by adopting different coding modes according to the distribution characteristics of the information to be coded to obtain attribute code stream information, and the method comprises the following steps:

traversing the quantization residual of each point, and counting the number of the quantization residual which is continuously zero; wherein the quantized residual comprises at least one component;

if the current quantization residual at the point is judged not to be zero, entropy coding is carried out on the number of the quantization residual which is continuously zero, the number is cleared after coding, and counting is carried out again;

entropy encoding the current quantized residual;

and repeating the steps until the quantization residual coding of all the points is finished, and obtaining attribute code stream information.

4. The hybrid coding-based point cloud attribute coding method of claim 3, wherein entropy coding the number of the quantized residuals that are consecutive to zero comprises:

determining a first preset value according to the quantization parameter;

if the number of the continuous zero of the quantized residual is judged to be less than a first preset value, a first zone bit and a second zone bit are used for respectively indicating whether the value of the number is 0 or 1, and when the number is 0 or 1, a first number of contexts are respectively allocated to the first zone bit and the second zone bit for arithmetic coding;

if the number of the continuous zero of the quantization residual errors is less than the first preset value and is not 0 or 1, subtracting 2 from the value of the number, and distributing a second number of contexts to the value obtained after subtracting 2 from the value of the number for arithmetic coding;

and if the number of the quantized residual errors which are continuously zero is judged to be greater than or equal to the first preset value, subtracting the first preset value from the number value, and distributing a third number of contexts for arithmetic coding to the value obtained after subtracting the first preset value from the number value.

5. The hybrid coding-based point cloud attribute coding method of claim 3, wherein entropy coding the current quantization residual comprises:

sequentially coding each component of the current quantization residual, and if judging that the current quantization residual is 0, entropy coding the current quantization residual by using context;

if the current quantization residual component is judged not to be 0, performing bypass coding on the symbol of the current quantization residual, and performing entropy coding on the current quantization residual by using context when the absolute value of the current quantization residual component is 1 or 2;

and if the absolute value of the current quantization residual component is judged to be more than or equal to 3, subtracting 3 from the absolute value of the component, and encoding the value of the absolute value of the component minus 3 by using the exponential golomb code.

6. The method for point cloud attribute coding based on hybrid coding according to claim 5, wherein the coding of the value of the component after subtracting 3 from the component value by using exponential Golomb code comprises:

if the current quantization residual is judged to be the reflectivity attribute information, encoding the current quantization residual by adopting K1 order exponential Golomb code;

and if the current quantization residual is judged to be the color attribute information, encoding the current quantization residual by adopting K2 order exponential Golomb code.

7. The hybrid coding-based point cloud attribute coding method according to claim 1, wherein the processing of the reconstructed point cloud attribute information to obtain information to be coded further comprises:

performing attribute transformation on the reconstructed point cloud attribute information to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded; or

And performing attribute prediction processing on the reconstructed point cloud attribute information to obtain a prediction residual error, performing attribute transformation on the prediction residual error to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded.

8. A point cloud attribute coding device based on hybrid coding is characterized by comprising:

the first information acquisition module (11) is used for acquiring original point cloud data;

the point cloud attribute reconstruction module (12) is used for carrying out spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information;

the data processing module (13) is used for processing the reconstructed point cloud attribute information to obtain information to be coded;

and the hybrid coding module (14) is used for coding the information to be coded by adopting different coding modes according to the distribution characteristics of the information to be coded to obtain attribute code stream information.

9. A point cloud attribute decoding method based on hybrid coding is characterized by comprising the following steps:

acquiring attribute code stream information;

sequentially decoding the attribute code stream information according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients;

performing attribute reconstruction on the point cloud data according to the decoding data to obtain reconstructed attribute information;

and performing inverse spatial transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

10. A point cloud attribute decoding device based on hybrid coding is characterized by comprising:

the second information acquisition module (21) is used for acquiring attribute code stream information;

the hybrid decoding module (22) is used for sequentially decoding the attribute code stream information according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients;

the attribute reconstruction module (23) is used for performing attribute reconstruction on the point cloud data according to the decoding data to obtain reconstructed attribute information;

and the inverse space transformation module (24) is used for performing inverse space transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

Technical Field

The invention belongs to the technical field of three-dimensional reconstruction, and particularly relates to a point cloud attribute coding and decoding method and device based on hybrid coding.

Background

The point cloud is a set of randomly distributed discrete points in space that represent the spatial structure and surface attributes of a three-dimensional object or scene. Each point in the point cloud has at least three-dimensional position information, and may have color, material or other information according to different application scenes. Typically, each point in the point cloud has the same number of additional attributes.

The point cloud can flexibly and conveniently express the space structure and the surface attribute of a three-dimensional object or a scene, so the application is wide. Some existing application scenarios of point cloud data can be mainly classified into two categories according to different characteristics of data use and processing: the method comprises the following steps that first, machine perception point clouds such as an autonomous navigation system, a real-time inspection system, a geographic information system, a visual sorting robot and an emergency rescue and relief robot are adopted; the second category is human eye perception point clouds, such as digital cultural heritage, free viewpoint broadcasting, three-dimensional immersion communication, three-dimensional immersion interaction and other application scenes. Aiming at the different point cloud application scenes, the corresponding point cloud representation and compression requirements are further refined.

At present, the digital Audio and Video coding Standard working group (AVS) in China is formulating a point cloud-oriented compression coding Standard. On the platform provided by the AVS, the geometric information and attribute information of the point cloud are separately encoded and decoded. At present, attribute coding is mainly performed on color information and reflectivity information, and mainly includes that attribute information of input point clouds is predicted to obtain prediction residual errors, and after the prediction residual errors are quantized, entropy coding is directly performed to obtain attribute code stream information.

However, the above method does not consider the distribution characteristics of the attribute prediction residual when performing entropy coding, for example, for the situation where the residual is continuously zero, if the entropy coding is directly performed, the coding code stream is large, the coding efficiency is low, and the coding performance is affected.

Disclosure of Invention

In order to solve the problems in the prior art, the invention provides a point cloud attribute coding and decoding method and device based on hybrid coding. The technical problem to be solved by the invention is realized by the following technical scheme:

a point cloud attribute coding method based on hybrid coding comprises the following steps:

acquiring original point cloud data;

performing spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information;

processing the reconstructed point cloud attribute information to obtain information to be encoded;

and according to the distribution characteristics of the information to be coded, coding the information by adopting different coding modes to obtain attribute code stream information.

In an embodiment of the present invention, processing the reconstructed point cloud attribute information to obtain information to be encoded includes:

performing attribute prediction processing on the reconstructed point cloud attribute information to obtain a prediction residual error;

and quantizing the prediction residual to obtain a quantized residual, and taking the quantized residual as information to be coded.

In an embodiment of the present invention, according to the distribution characteristics of the information to be encoded, encoding the information to be encoded by using different encoding methods to obtain attribute code stream information, including:

traversing the quantization residual of each point, and counting the number of the quantization residual which is continuously zero; wherein the quantized residual comprises at least one component;

if the current quantization residual at the point is judged not to be zero, entropy coding is carried out on the number of the quantization residual which is continuously zero, the number is cleared after coding, and counting is carried out again;

entropy encoding the current quantized residual;

and repeating the steps until the quantization residual coding of all the points is finished, and obtaining attribute code stream information.

In one embodiment of the present invention, entropy encoding the number of consecutive zeros of the quantized residual comprises:

determining a first preset value according to the quantization parameter;

if the number of the continuous zero of the quantized residual is judged to be less than a first preset value, a first zone bit and a second zone bit are used for respectively indicating whether the value of the number is 0 or 1, and when the number is 0 or 1, a first number of contexts are respectively allocated to the first zone bit and the second zone bit for arithmetic coding;

if the number of the continuous zero of the quantization residual errors is less than the first preset value and is not 0 or 1, subtracting 2 from the value of the number, and distributing a second number of contexts to the value obtained after subtracting 2 from the value of the number for arithmetic coding;

and if the number of the quantized residual errors which are continuously zero is judged to be greater than or equal to the first preset value, subtracting the first preset value from the number value, and distributing a third number of contexts for arithmetic coding to the value obtained after subtracting the first preset value from the number value.

In one embodiment of the present invention, entropy encoding the current quantized residual comprises:

sequentially coding each component of the current quantization residual, and if judging that the current quantization residual is 0, entropy coding the current quantization residual by using context;

if the current quantization residual component is judged not to be 0, performing bypass coding on the symbol of the current quantization residual, and performing entropy coding on the current quantization residual by using context when the absolute value of the current quantization residual component is 1 or 2;

and if the absolute value of the current quantization residual component is judged to be more than or equal to 3, subtracting 3 from the absolute value of the component, and encoding the value of the absolute value of the component minus 3 by using the exponential golomb code.

In an embodiment of the present invention, the encoding the value of the component value after subtracting 3 by using an exponential golomb code includes:

if the current quantization residual is judged to be the reflectivity attribute information, encoding the current quantization residual by adopting K1 order exponential Golomb code;

and if the current quantization residual is judged to be the color attribute information, encoding the current quantization residual by adopting K2 order exponential Golomb code.

In an embodiment of the present invention, processing the reconstructed point cloud attribute information to obtain information to be encoded further includes:

performing attribute transformation on the reconstructed point cloud attribute information to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded; or

And performing attribute prediction processing on the reconstructed point cloud attribute information to obtain a prediction residual error, performing attribute transformation on the prediction residual error to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded.

Another embodiment of the present invention further provides a point cloud attribute encoding apparatus based on hybrid encoding, including:

the first information acquisition module is used for acquiring original point cloud data;

the point cloud attribute reconstruction module is used for carrying out spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information;

the data processing module is used for processing the reconstructed point cloud attribute information to obtain information to be coded;

and the mixed coding module is used for coding the information to be coded by adopting different coding modes according to the distribution characteristics of the information to be coded to obtain attribute code stream information.

The invention further provides a point cloud attribute decoding method based on hybrid coding, which comprises the following steps:

acquiring attribute code stream information;

sequentially decoding the attribute code stream information according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients;

performing attribute reconstruction on the point cloud data according to the decoding data to obtain reconstructed attribute information;

and performing inverse spatial transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

Still another embodiment of the present invention further provides a point cloud attribute decoding apparatus based on hybrid coding, including:

the second information acquisition module is used for acquiring attribute code stream information;

the mixed decoding module is used for sequentially decoding the attribute code stream information according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients;

the attribute reconstruction module is used for performing attribute reconstruction on the point cloud data according to the decoding data to obtain reconstructed attribute information;

and the inverse space transformation module is used for performing inverse space transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

Compared with the prior art, the invention has the beneficial effects that:

1. when the point cloud attribute coding method provided by the invention is used for coding, the distribution characteristics of information to be coded are fully considered, different coding modes are adopted according to different distribution conditions, the size of a coding code stream is reduced on the premise of not increasing the coding complexity, and the coding performance is improved;

2. when the prediction residual is coded, the high-efficiency coding method of run-length coding is adopted for the prediction residual by counting the number of the continuous zeros of the quantized prediction residual, and the non-zero attribute residual is entropy coded, so that the mixed coding of the prediction residual is realized, and the coding efficiency is improved on the whole;

3. when the invention codes the number of the quantized prediction residual errors which are continuously zero, the quantization parameters are used as the basis, the first preset value is set in a self-adaptive mode, and different coding modes are selected according to the first preset value, so that the coding result is adaptive to the system parameters, and the better coding effect is obtained.

Drawings

Fig. 1 is a schematic flowchart of a point cloud attribute encoding method based on hybrid encoding according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of another point cloud attribute encoding method based on hybrid encoding according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a point cloud attribute encoding apparatus based on hybrid encoding according to an embodiment of the present invention;

fig. 4 is a schematic flowchart of a point cloud attribute decoding method based on hybrid coding according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a point cloud attribute decoding apparatus based on hybrid coding according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to specific examples, but the embodiments of the present invention are not limited thereto.

Example one

Referring to fig. 1, fig. 1 is a schematic flow chart of a point cloud attribute encoding method based on hybrid encoding according to an embodiment of the present invention, including:

step 1: acquiring original point cloud data;

in this embodiment, it is assumed that the acquired original point cloud includes N points, which are denoted as p (i) (i is 0,1 … N-1), and the original attribute value corresponding to each point is a_n,n＝0,1,...N-1。

Step 2: and performing spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information.

In general, when performing attribute encoding, a lossy encoding mode, that is, lossy compression, is generally adopted. Therefore, it is necessary to convert the color information of the point cloud data from the RGB color space to the luminance and chrominance color space.

Specifically, color information in the attribute information of the original point cloud data is converted from an RGB color space to a luminance and chrominance (e.g., YUV) color space based on the reconstruction geometry information.

And then, performing attribute interpolation processing on the point cloud data to enable the uncoded attribute information to correspond to the reconstructed geometric information to obtain reconstructed point cloud attribute information.

And step 3: and processing the reconstructed point cloud attribute information to obtain information to be encoded.

Further, the embodiment can perform attribute prediction processing on the attribute information of the reconstructed point cloud to obtain a prediction residual error; and then, quantizing the prediction residual to obtain a quantized residual, and taking the quantized residual as information to be coded.

Specifically, a predicted attribute value obtained by attribute prediction is set as B_nN is 0,1, …, N-1, and the original attribute value a is added_nN-1 is differentiated from the prediction attribute value to obtain a prediction residual error X_nAnd N is 0,1, …, N-1, then quantizing the prediction residual according to a preset quantization parameter QP, and entropy coding the quantized residual obtained after quantization as information to be coded.

And 4, step 4: and according to the distribution characteristics of the information to be coded, coding the information by adopting different coding modes to obtain attribute code stream information.

The point cloud attribute coding method provided by the embodiment fully considers the distribution characteristics of information to be coded when coding operation is performed, adopts different coding modes according to different distribution conditions, reduces the size of a coding code stream on the premise of not increasing the coding complexity, and improves the coding performance.

The following describes the quantized prediction residual, i.e. the quantized residual, as information to be encoded in detail. Referring to fig. 2, fig. 2 is a flowchart illustrating another point cloud attribute encoding method based on hybrid encoding according to an embodiment of the present invention, where run _ length represents the number of zero continuous quantization residuals, residual represents quantization residuals, and delta represents residual components.

Specifically, step 4 includes:

41) traversing the quantized residual errors of each point, and counting the number of the quantized residual errors which are continuously zero; wherein the quantized residual comprises at least one component.

Since the existing point cloud attribute coding is mainly performed on the reflectivity information and the color, the quantization residual may be a quantization residual of the reflectivity or a quantization residual of the color attribute. The quantized residual for reflectivity, which comprises one component, and the quantized residual for color properties, which may comprise three components, for example Y, U, V components.

It should be noted that, for a color attribute residual having multiple components, all of the multiple components are zero, and the quantized residual is regarded as zero.

And traversing the quantization residual error of each point, judging whether the quantization residual error is zero or not, and counting the number of the quantization residual errors through a run _ length variable.

42) And if the current quantization residual at the point is judged not to be zero, entropy coding is carried out on the number of the quantization residual which is continuously zero, the number is cleared after coding, and counting is carried out again.

In this embodiment, if the current quantization residual is not zero, that is, at least one component of the quantization residual is not zero, the current number run _ length is encoded, and the specific encoding method is as follows:

a) and determining a first preset value according to the quantization parameter.

Specifically, the distribution of the number of consecutive zeros is different for the residuals quantized using different quantization parameters QP. If a smaller quantization parameter is used, the number of consecutive zeros in the residual will also be smaller. Correspondingly, a smaller first preset value M needs to be selected as a selection basis for the run _ length coding mode. Wherein M is greater than or equal to 2.

For example, the present embodiment may set M to 2 when the quantization parameter QP is less than 32. When the quantization parameter is greater than 32, the value of M is increased accordingly.

b) If the number of the continuous zero of the quantized residual is judged to be less than the first preset value, the first zone bit and the second zone bit are used for respectively indicating whether the value of the number is 0 or 1, and when the number is 0 or 1, the first zone bit and the second zone bit are respectively allocated with a first number of contexts for arithmetic coding.

Specifically, the present embodiment adopts isszero and isOne to respectively represent a first flag bit and a second flag bit, which respectively indicate whether the value of run _ length is 0 or 1, and the first number may be set to 2. When the value of run _ length is 0 or 1, 2 contexts are respectively allocated to isZero and isOne for arithmetic coding.

c) If the number of the quantized residuals that are continuously zero is less than the first predetermined value and the number is not 0 or 1, subtracting 2 from the value of the number, and assigning a second number of contexts to the value after subtracting 2 from the value of the number for arithmetic coding.

Specifically, the second numerical value may be set to 3, that is, when the value of run _ length is less than M and the value thereof is not 0 nor 1, 2 is subtracted from run _ length, and then (run _ length-2) is assigned 3 contexts for arithmetic coding.

d) And if the number of the quantized residuals which are continuously zero is judged to be greater than or equal to the first preset value, subtracting the first preset value from the number value, and distributing a third number of contexts for arithmetic coding to the value obtained by subtracting the first preset value from the number value.

Specifically, the third quantity value may be set to 3, that is, when the value of run _ length is greater than M, M is subtracted from run _ length, and then (run _ length-M) is assigned 3 contexts for arithmetic coding.

After the coding of the number run _ length is completed, its value is set to 0 to restart the counting.

When the number of quantization residuals with continuous values of zero is encoded, the first preset value is adaptively set according to the quantization parameter, and different encoding modes are selected accordingly, so that the encoding result is adapted to the system parameter, and a better encoding effect is obtained.

43) Entropy coding the current quantized residual.

After run _ length entropy coding is performed in step 42), the quantization residual that is not zero at present needs to be coded, which is specifically as follows:

43-1) coding each component of the current quantization residual in turn, if the component of the current quantization residual is judged to be 0, entropy coding the component by using context.

43-2) if the current quantized residual component is not 0, bypass coding the symbol of the current quantized residual, and entropy coding the current quantized residual component using the context when the absolute value of the current quantized residual component is 1 or 2.

Specifically, since the prediction residual is obtained by differentiating the original attribute value and the prediction attribute value, the value of the quantization residual may be a positive number, a negative number, or zero. Therefore, before encoding, it is first required to determine and encode the symbol thereof.

Preferably, the present embodiment encodes the sign of the quantized residual using bypass coding.

After the symbols are coded, a context is allocated to entropy coding whether the absolute value of the residual is 1, and if the absolute value of the attribute residual is more than 1, a context is also allocated to entropy coding whether the absolute value of the attribute residual is equal to 2.

43-3) if the absolute value of the current quantization residual component is judged to be more than or equal to 3, subtracting 3 from the absolute value of the component, and encoding the value of the absolute value of the component after subtracting 3 from the absolute value of the component by using exponential golomb code.

Specifically, if the current quantization residual is determined to be the reflectivity attribute information, it is encoded by using an exponential golomb code of order K1.

Optionally, the present embodiment uses 3-order exponential golomb codes to encode the current quantization residual.

And if the current quantization residual is judged to be the color attribute information, encoding the current quantization residual by adopting K2 order exponential Golomb code.

Optionally, the present embodiment uses 1-order exponential golomb code to encode the current quantization residual.

44) And repeating the steps 41) to 43) until the quantization residual coding of all the points is finished, and obtaining the attribute code stream information.

It should be noted that, when encoding the reflectivity, when the prediction mode adopted for the reflectivity is adaptive prediction selection, because the method stores the reconstructed attribute values of the first N points of the current point to be predicted into a Buffer, and then selects the point with the minimum residual between the reconstructed attribute value and the real attribute value of the current point to be predicted from the N points as the prediction point, the index min _ idx of the prediction point in the Buffer needs to be encoded, and the encoding order at this time is: firstly, judging whether the quantization residual delta is 0, if the delta is 0, accumulating and counting run _ length, and storing the index of each predicted point. When the quantization residual error is non-zero, a run _ length is encoded first, then each stored min _ idx is encoded, finally the non-zero delta is encoded, and the run _ length is set to 0 to restart counting.

In the embodiment, when the quantized prediction residual is coded, the distribution characteristics of the prediction residual are fully considered, an effective run-length coding mode and a K-order exponential Golomb coding mode are combined, specifically, the number of continuous zeros of the prediction residual is counted, the run-length coding efficient coding method is adopted for the prediction residual, and meanwhile, the non-zero attribute residual is subjected to entropy coding, so that the mixed coding of the quantized prediction residual is realized, and the coding efficiency is improved on the whole.

In another embodiment of the present invention, processing the reconstructed point cloud attribute information to obtain information to be encoded further includes:

performing attribute transformation on the reconstructed point cloud attribute information to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded; or

And performing attribute prediction processing on the reconstructed point cloud attribute information to obtain a prediction residual error, performing attribute transformation on the prediction residual error to obtain a transformation coefficient, and taking the quantized transformation coefficient as information to be coded.

In this embodiment, the information to be coded is information obtained by quantizing a transform coefficient, where the transform coefficient may be a transform coefficient obtained by DCT transform or RAHT transform, and specifically, the coding process is the same as the coding process of the quantized prediction residual, which is not described herein again.

Example two

On the basis of the first embodiment, the present embodiment further provides a point cloud attribute encoding device based on hybrid coding, please refer to fig. 3, where fig. 3 is a schematic structural diagram of the point cloud attribute encoding device based on hybrid coding according to the embodiment of the present invention, and the apparatus includes:

the first information acquisition module 11 is used for acquiring original point cloud data;

the point cloud attribute reconstruction module 12 is used for performing spatial transformation and attribute interpolation prediction on the attribute information of the original point cloud data based on the reconstruction geometric information to obtain reconstructed point cloud attribute information;

the data processing module 13 is configured to process the reconstructed point cloud attribute information to obtain information to be encoded;

and the hybrid coding module 14 is configured to perform coding processing on the information to be coded by using different coding modes according to the distribution characteristics of the information to be coded, so as to obtain attribute code stream information.

The point cloud attribute encoding device based on hybrid encoding provided in this embodiment can implement the point cloud attribute encoding method based on hybrid encoding described in the first embodiment, and specific implementation processes are not described herein again.

EXAMPLE III

Fig. 4 shows a schematic flow chart of a hybrid coding-based point cloud attribute decoding method according to an embodiment of the present invention, where fig. 4 is a schematic flow chart of the hybrid coding-based point cloud attribute decoding method, and the method includes:

the method comprises the following steps: and acquiring attribute code stream information.

Specifically, in the encoding stage, the number run _ length of the prediction residuals which are continuously zero is encoded, and then the prediction residuals which are not 0 at present are determined and sequentially encoded, that is, the attribute code stream information obtained by encoding is arranged at intervals according to the run _ length and the prediction residuals. Therefore, correspondingly, in the decoding stage, the obtained attribute code stream information to be decoded is also arranged according to the mode.

Step two: sequentially decoding the attribute code stream information according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients.

Specifically, after the attribute code stream information is obtained, whether a certain section of binary code is run _ length encoded or quantized prediction residual encoded can be determined according to the code stream sequence, so that different encoding modes and corresponding decoding modes can be further obtained.

For example, when a bit is coded to 0,1, or 2 in the quantized prediction residual coding, indicating that the coding is performed directly by arithmetic coding in the coding stage, the residue is directly subjected to the arithmetic decoding method, that is, the residue 0,1, or 2 is directly returned. If the code of a certain bit is not 0,1 or 2, the digital Golomb coding mode adopted in the coding stage is described, then whether the code codes the color attribute or the reflectivity is specifically obtained according to the header information, if the code codes the color attribute, 1-order exponential Golomb code corresponding to the coding stage is adopted for decoding, and if the code codes the reflectivity attribute, the corresponding 3-order exponential Golomb code is adopted for decoding. And then, decoding the attribute code stream information segments according to different decoding modes until the whole attribute code stream information decoding operation is completed to obtain decoded data.

Because the information to be coded adopted in the coding stage may be a quantized prediction residual or a transform coefficient, correspondingly, in the decoding stage, the obtained decoded data may also be a quantized prediction residual and the number run _ length of the residual which is continuously zero, or a transform coefficient and its corresponding run _ length.

Step three: and performing attribute reconstruction on the point cloud data according to the decoded data to obtain reconstructed attribute information.

First, inverse quantization processing is performed on a quantized prediction residual or transform coefficient obtained by decoding, so as to obtain a prediction residual or transform coefficient.

And then performing attribute prediction or attribute transformation on the point cloud data according to the prediction residual or the transformation coefficient to obtain reconstructed attribute information.

Step four: and performing inverse spatial transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

And performing inverse space transformation on the reconstructed attribute information, and converting the reconstructed attribute information from a YUV space to an RGB space, so as to finish point cloud attribute decoding.

Example four

On the basis of the third embodiment, the present embodiment further provides a point cloud attribute decoding apparatus based on hybrid coding, please refer to fig. 5, where fig. 5 is a schematic structural diagram of the point cloud attribute decoding apparatus based on hybrid coding according to the third embodiment of the present invention, and the apparatus includes:

a second information obtaining module 21, configured to obtain attribute code stream information;

the hybrid decoding module 22 is configured to decode the attribute code stream information in sequence according to different decoding modes to obtain decoded data; wherein the decoded data comprises quantized prediction residuals or transform coefficients;

the attribute reconstruction module 23 is configured to perform attribute reconstruction on the point cloud data according to the decoded data to obtain reconstructed attribute information;

and the inverse space transformation module 24 is configured to perform inverse space transformation on the reconstructed attribute information to obtain decoded point cloud attribute information.

The point cloud attribute decoding device based on hybrid coding provided in this embodiment can implement the point cloud attribute decoding method based on hybrid coding described in the first embodiment, and specific implementation processes are not described herein again.

EXAMPLE five

To further illustrate the beneficial effects of the first embodiment, this embodiment tests the sequence with part of attribute information being color on the AVS platform under the condition of C2 (geometric lossless, attribute lossy) with the point cloud attribute encoding method based on hybrid encoding provided by the first embodiment, and the results are shown in the following table:

where Luma denotes brightness, Chroma Cb and Chroma Cr denote Chroma, and the parameter BD-rate denotes performance.

As can be seen from the above table, the BD-rates of all the sequences are negative, and the BD-rates are negative, which means that the performance becomes better, and on the basis of the performance gain is larger when the absolute value of the BD-rates is larger. Therefore, the BD-rate of the point cloud attribute coding method based on the hybrid coding provided by the invention is obviously improved, and the coding performance is improved.

The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.