阅读说明：本技术 一种基于三维可视化的自动化控制数据通信方式 (Automatic control data communication mode based on three-dimensional visualization ) 是由 胡彦明 陈云 王双 于 2020-06-24 设计创作，主要内容包括：本发明公开了一种基于三维可视化的自动化控制数据通信方式,包括如下步骤：通信终端通过采集模块采集物体或场景信息,并将信息通过网络发送至服务器；服务器将接收的数据信息作为三维重建的输入构建三维模型,并将三维模型数据转环为3D数字信号,通过网络将3D数字信号发送至通信对象的通信终端；通信对象的通信终端接收3D数字信号并将其还原为三维模型,通过渲染引擎对三维模型进行可视化渲染,并通过显示模块进行通信显示。通信时根据拍摄的原始深度图像和对应的原始二维图像生成针对当前物体的物体特征信息,从预先建立的三维模型库中获取对应的三维建模信息,生成当前物体的三维模型,从而快速将二维数据通信转化为三维可视化数据通信。(The invention discloses an automatic control data communication mode based on three-dimensional visualization, which comprises the following steps: the communication terminal collects object or scene information through the collection module and sends the information to the server through the network; the server constructs a three-dimensional model by taking the received data information as the input of three-dimensional reconstruction, converts the three-dimensional model data into 3D digital signals, and sends the 3D digital signals to a communication terminal of a communication object through a network; and the communication terminal of the communication object receives the 3D digital signal and restores the 3D digital signal into a three-dimensional model, the three-dimensional model is visually rendered through a rendering engine, and communication display is carried out through a display module. During communication, object characteristic information aiming at the current object is generated according to the shot original depth image and the corresponding original two-dimensional image, corresponding three-dimensional modeling information is obtained from a pre-established three-dimensional model base, and a three-dimensional model of the current object is generated, so that two-dimensional data communication is quickly converted into three-dimensional visual data communication.)

1. An automatic control data communication mode based on three-dimensional visualization is characterized by comprising the following steps:

s1, the communication terminal collects object or scene information through the collection module and sends the information to the server through the network;

s2, the server constructs a three-dimensional model by taking the received data information as the input of three-dimensional reconstruction, converts the three-dimensional model data into 3D digital signals, and sends the 3D digital signals to the communication terminal of a communication object through a network;

and S3, the communication terminal of the communication object receives the 3D digital signal and restores the signal into a three-dimensional model, the three-dimensional model is visually rendered through the rendering engine, and the three-dimensional model is displayed through the display module in a communication mode.

2. The automated control data communication method based on three-dimensional visualization as claimed in claim 1, wherein: in step S1, the acquisition module is a camera, and the communication terminal captures one or more images of the object and the scene through one or more cameras, and sends the images to the server in a summary manner.

3. The automated control data communication method based on three-dimensional visualization as claimed in claim 1, wherein: in step S2, the method for constructing a three-dimensional model by the server includes the following steps:

s201, generating object characteristic information aiming at the current object according to the original image and the corresponding original two-dimensional image;

s202, matching corresponding three-dimensional modeling information from a three-dimensional model database according to the extracted characteristic information, and feeding back matching information;

s203, the server generates a three-dimensional model according to the matching information;

and S204, translating and rotating the generated three-dimensional model to enable the three-dimensional model to be consistent with the angle of the original object, and carrying out surface mapping on the three-dimensional model through the color and texture of the original image to restore the real color.

4. The automated control data communication method based on three-dimensional visualization as claimed in claim 3, wherein: in step S201, the method for extracting feature information extracts feature information, such as color features, texture features, shape features, and spatial relationship features, of the three-dimensional depth map of the current object and the original two-dimensional image from a depth image obtained by stitching a plurality of images.

5. The automated control data communication method based on three-dimensional visualization as claimed in claim 3, wherein: in step S203, when the matching information received by the server indicates that three-dimensional modeling data matching the feature information exists in the three-dimensional model database, the corresponding three-dimensional modeling information is directly downloaded from the database for use.

6. The automated control data communication method based on three-dimensional visualization as claimed in claim 3, wherein: in step S203, when the matching information received by the server is that there is no matching information in the database, a three-dimensional point cloud data model of the current object is established according to the photographed original depth image, and the three-dimensional point cloud data model is subjected to surface fitting processing to obtain a three-dimensional model of the current object, and object feature information and corresponding three-dimensional model information are added to the three-dimensional model database, so as to facilitate later matching use.

7. The automated control data communication method based on three-dimensional visualization as claimed in claim 1, wherein: in step S2, the server converts the three-dimensional model data into a 3D digital signal, compresses the signal, and transmits the signal via a network.

8. The automated control data communication method based on three-dimensional visualization as claimed in claim 1, wherein: in step S3, the communication terminal receives the 3D digital signal, performs decompression and three-dimensional visualization rendering, and performs three-dimensional communication display through a naked eye 3D screen.

Technical Field

The invention relates to the technical field of data communication, in particular to an automatic control data communication mode based on three-dimensional visualization.

Background

Data communication is a new communication mode generated by combining a communication technology and a computer technology, and the current data communication modes are common two-dimensional information and audio communication, but as data become wider in dimension, larger in quantity and more complex in structure under the rapid development of the current internet, people want to clearly, quickly recognize and understand one piece of data, and a traditional two-dimensional plane chart cannot meet the requirement, so that an automatic control data communication mode based on three-dimensional visualization is provided for solving the problems.

Disclosure of Invention

The invention aims to provide an automatic control data communication mode based on three-dimensional visualization to solve the problems in the background technology.

In order to achieve the purpose, the invention provides the following technical scheme: an automatic control data communication mode based on three-dimensional visualization comprises the following steps:

s1, the communication terminal collects object or scene information through the collection module and sends the information to the server through the network;

s2, the server constructs a three-dimensional model by taking the received data information as the input of three-dimensional reconstruction, converts the three-dimensional model data into 3D digital signals, and sends the 3D digital signals to the communication terminal of a communication object through a network;

and S3, the communication terminal of the communication object receives the 3D digital signal and restores the signal into a three-dimensional model, the three-dimensional model is visually rendered through the rendering engine, and the three-dimensional model is displayed through the display module in a communication mode.

In a preferred embodiment, in step S1, the acquiring module is a camera, and the communication terminal captures one or more images of the object and the scene through one or more cameras, and sends the images to the server in a summary manner.

In a preferred embodiment, in step S2, the method for constructing the three-dimensional model by the server includes the following steps:

s201, generating object characteristic information aiming at the current object according to the original image and the corresponding original two-dimensional image;

s202, matching corresponding three-dimensional modeling information from a three-dimensional model database according to the extracted characteristic information, and feeding back matching information;

s203, the server generates a three-dimensional model according to the matching information;

and S204, translating and rotating the generated three-dimensional model to enable the three-dimensional model to be consistent with the angle of the original object, and carrying out surface mapping on the three-dimensional model through the color and texture of the original image to restore the real color.

In a preferred embodiment, in step S201, the method for extracting feature information splices a plurality of images to obtain a depth image, and extracts feature information such as color features, texture features, shape features, and spatial relationship features of the three-dimensional depth map of the current object and the original two-dimensional image.

In a preferred embodiment, in step S203, when the matching information received by the server results in that three-dimensional modeling data matching the feature information exists in the three-dimensional model database, the corresponding three-dimensional modeling information is directly downloaded from the database for use.

In step S203, when the matching information received by the server is that there is no matching information in the database, a three-dimensional point cloud data model of the current object is established according to the captured original depth image, and the three-dimensional point cloud data model is subjected to surface fitting processing to obtain a three-dimensional model of the current object, and the object feature information and the corresponding three-dimensional model information are added to the three-dimensional model database, so as to facilitate matching use later.

In a preferred embodiment, in step S2, the server transforms the three-dimensional model data into a 3D digital signal, compresses the signal, and transmits the signal through the network.

In a preferred embodiment, in step S3, the communication terminal receives the 3D digital signal, decompresses and renders three-dimensional visualization, and performs three-dimensional communication display through a naked eye 3D screen.

Compared with the prior art, the invention has the beneficial effects that: during communication, object characteristic information aiming at the current object is generated according to the shot original depth image and the corresponding original two-dimensional image, corresponding three-dimensional modeling information is obtained from a pre-established three-dimensional model base, and a three-dimensional model of the current object is generated, so that two-dimensional data communication is quickly converted into three-dimensional visual data communication.

Drawings

FIG. 1 is a flow chart of the present invention;

FIG. 2 is a flow chart of three-dimensional construction according to the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.