阅读说明：本技术 一种便于虚拟现实对象控制的低延迟控制方法 (Low-delay control method convenient for virtual reality object control ) 是由 马朋飞 于 2021-01-19 设计创作，主要内容包括：本发明公开了一种便于虚拟现实对象控制的低延迟控制方法,其方法包括如下步骤：在接收到虚拟现实显示请求时,从虚拟现实服务器中获取对应的虚拟现实配置文件,并获取虚拟现实场景视频信息,获得组成虚拟现实场景视频的视频帧,N≥2,然后通过编解码算法对获取的视频帧进行编码、传输和解码处理；本发明具有便于对虚拟现实对象进行控制,提高了虚拟现实场景的刷新频率,可以有效降低虚拟现实对象控制延迟的优点,解决了目前的控制方式使得虚拟现实服务器的处理速度变慢,同时传输延时过大会引起虚拟现实交互的响应过慢,导致虚拟现实对象无法与应用场景适配的问题,从而能够使虚拟现实的用户体验得到提升。(The invention discloses a low-delay control method convenient for virtual reality object control, which comprises the following steps: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, and then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm; the virtual reality server has the advantages of being convenient to control the virtual reality object, improving the refreshing frequency of the virtual reality scene, effectively reducing the control delay of the virtual reality object, and solving the problems that the processing speed of the virtual reality server is reduced by the existing control mode, and the response of virtual reality interaction is too slow due to too long transmission delay, so that the virtual reality object cannot be adapted to the application scene, and the user experience of the virtual reality can be improved.)

1. A low-latency control method that facilitates virtual reality object control, characterized by: the method comprises the following steps:

image acquisition and display: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm, and finally, displaying the decompressed image slice to a user by a display unit;

collecting control information: acquiring user feedback data from virtual reality control devices such as VR glasses and control handles, uploading the user feedback data to a virtual reality server, then performing display control on target object adaptation areas by the virtual reality server, issuing a control instruction sequence aiming at each target object adaptation area, and sending the control instruction sequence to virtual reality execution equipment;

the control instruction executes: the virtual reality execution equipment receives a control instruction sequence sent by the virtual reality server and executes preset operation corresponding to the control instruction sequence;

and (3) data uploading: the virtual reality server receives a control instruction from the virtual reality control device, the control instruction forms a data packet queue and is uploaded to a memory for caching, the virtual reality server determines coordinate offset adaptive parameters of a simulated scene and regional configuration parameters of an initial scene, and then parameter fusion information can be obtained;

virtual reality object control: and controlling the movement of the virtual reality object in the virtual reality scene according to the parameter fusion information, and simultaneously reading a rendering result corresponding to the virtual scene image slice, so that the virtual reality scene can be updated.

2. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (1), the frame rate of the video signal corresponding to the image frame is 30FPS to 60FPS, and the display unit outputs the video signal according to the refresh rate of 60Hz to 100 Hz.

3. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (1), the encoding and decoding algorithm is H.261, H.263, H.264 or H.265.

4. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (1), the encoding unit performs compression operation on the image frame through an encoding and decoding algorithm to obtain output code stream data, then the transmission unit transmits the output code stream data to the decoding unit, and the decoding unit performs decompression operation on the output code stream data through the encoding and decoding algorithm to obtain a decompressed image slice.

5. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (2), the user feedback data comprises human body movement signals and equipment control information, and the virtual reality server and the virtual reality control device are communicated through an internet network.

6. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (2), the virtual reality server adopts a WebSocket application layer protocol, and the virtual reality execution device sends a connection application to the WebSocket protocol to establish and maintain remote network connection communication.

7. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (3), the virtual reality execution device performs corresponding operation on the display object according to the control type, and switches the current virtual reality scene to a corresponding virtual reality simulation scene.

8. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (4), the memory is an FIFO memory, and the virtual reality server detects the cache information in the FIFO memory once every 5-10 ms.

9. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (4), the memory stores at least one executable control instruction, and the control instruction is executed by at least one virtual reality execution device.

10. A low-latency control method for facilitating virtual reality object control according to claim 1, wherein: in the step (5), the target position of the preset scene is updated according to the position information of the virtual reality object when the virtual reality object moves.

Technical Field

The invention relates to the technical field of virtual reality, in particular to a low-delay control method convenient for virtual reality object control.

Background

Virtual reality technology (VR) is a computer simulation system that can create and experience a virtual world, using a computer to create a simulated environment into which a user is immersed. The virtual reality technology is to combine electronic signals generated by computer technology with data in real life to convert the electronic signals into phenomena which can be felt by people, wherein the phenomena can be true and true objects in reality or substances which can not be seen by the naked eyes, and the phenomena are expressed by a three-dimensional model. The virtual reality has all human owned perception functions, such as auditory perception systems, visual perception systems, touch perception systems, taste perception systems, smell perception systems and the like, and finally, the virtual reality has a super-strong simulation system, so that man-machine interaction is really realized, people can operate freely in the operation process, and the feedback of the most real environment is obtained.

The control mode of the virtual reality object and the application scene in the virtual reality scene at present has certain disadvantages, so that the processing speed of a virtual reality server becomes slow, meanwhile, too long transmission delay can cause too slow response of virtual reality interaction, the virtual reality object cannot be adapted to the application scene, the environment of the application scene is usually fixed and unchanged, and the user experience is seriously influenced.

Disclosure of Invention

It is an object of the present invention to provide a low latency control method for facilitating virtual reality object control to solve the above-mentioned problems in the background art.

In order to achieve the purpose, the invention provides the following technical scheme: a low-latency control method for facilitating virtual reality object control, the method comprising the steps of:

(1) image acquisition and display: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm, and finally, displaying the decompressed image slice to a user by a display unit;

(2) collecting control information: acquiring user feedback data from virtual reality control devices such as VR glasses and control handles, uploading the user feedback data to a virtual reality server, then performing display control on target object adaptation areas by the virtual reality server, issuing a control instruction sequence aiming at each target object adaptation area, and sending the control instruction sequence to virtual reality execution equipment;

(3) the control instruction executes: the virtual reality execution equipment receives a control instruction sequence sent by the virtual reality server and executes preset operation corresponding to the control instruction sequence;

(4) and (3) data uploading: the virtual reality server receives a control instruction from the virtual reality control device, the control instruction forms a data packet queue and is uploaded to a memory for caching, the virtual reality server determines coordinate offset adaptive parameters of a simulated scene and regional configuration parameters of an initial scene, and then parameter fusion information can be obtained;

(5) virtual reality object control: and controlling the movement of the virtual reality object in the virtual reality scene according to the parameter fusion information, and simultaneously reading a rendering result corresponding to the virtual scene image slice, so that the virtual reality scene can be updated.

Preferably, in the step (1), the frame rate of the video signal corresponding to the image frame is 30FPS to 60FPS, and the display unit outputs the video signal at a refresh rate of 60Hz to 100 Hz.

Preferably, in the step (1), the codec algorithm is h.261, h.263, h.264, or h.265.

Preferably, in the step (1), the encoding unit performs compression operation on the image frame through an encoding and decoding algorithm to obtain output code stream data, then the transmission unit transmits the output code stream data to the decoding unit, and the decoding unit performs decompression operation on the output code stream data through the encoding and decoding algorithm to obtain a decompressed image slice.

Preferably, in the step (2), the user feedback data includes a human body movement signal and device control information, and the virtual reality server and the virtual reality control device communicate with each other through an internet network.

Preferably, in the step (2), the virtual reality server adopts a WebSocket application layer protocol, and the virtual reality execution device sends a connection application to the WebSocket protocol, and establishes and maintains remote network connection communication.

Preferably, in the step (3), the virtual reality execution device performs corresponding operation on the display object according to the control type, and switches the current virtual reality scene to a corresponding virtual reality simulation scene.

Preferably, in the step (4), the memory is an FIFO memory, and the virtual reality server detects the cache information in the FIFO memory once every 5 to 10 ms.

Preferably, in step (4), the memory stores at least one executable control instruction, and the control instruction is executed by at least one virtual reality execution device.

Preferably, in the step (5), the target position of the preset scene is updated according to the position information of the virtual reality object when the virtual reality object moves.

Compared with the prior art, the invention has the following beneficial effects:

the method for controlling the virtual reality object has the advantages of being convenient to control the virtual reality object, improving the refreshing frequency of the virtual reality scene and effectively reducing the control delay of the virtual reality object, and solves the problems that the processing speed of a virtual reality server is reduced in the existing control mode, and the response of virtual reality interaction is too slow due to too large transmission delay, so that the virtual reality object cannot be adapted to the application scene, and the user experience of the virtual reality can be improved.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The first embodiment is as follows:

a low-latency control method for facilitating virtual reality object control, the method comprising the steps of:

(1) image acquisition and display: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm, finally displaying decompressed image slices to a user by a display unit, wherein the frame rate of video signals corresponding to the image frames is 30FPS, the display unit outputs according to a refresh rate of 60Hz, so that flickering and incoherence of the virtual reality scene caused by too low refresh rate can be avoided, the image display effect and the visual perception can be improved, the encoding and decoding algorithm is H.261, H.263, H.264 or H.265, the encoding unit compresses the image frames through the encoding and decoding algorithm to obtain output code stream data, and then the transmission unit transmits the output code stream data to a decoding unit, the decoding unit decompresses the output code stream data through an encoding and decoding algorithm to obtain a decompressed image slice, so that the delay rate of the virtual reality scene can be reduced;

(2) collecting control information: acquiring user feedback data from virtual reality control devices such as VR glasses and control handles, uploading the user feedback data to a virtual reality server, then performing display control on target object adaptation areas by the virtual reality server, issuing a control instruction sequence aiming at each target object adaptation area, and sending the control instruction sequence to virtual reality execution equipment;

(3) the control instruction executes: the virtual reality execution equipment receives a control instruction sequence sent by the virtual reality server and executes preset operation corresponding to the control instruction sequence;

(4) and (3) data uploading: the virtual reality server receives a control instruction from the virtual reality control device, the control instruction forms a data packet queue and is uploaded to a memory for caching, the virtual reality server determines coordinate offset adaptive parameters of a simulated scene and regional configuration parameters of an initial scene, and then parameter fusion information can be obtained;

(5) virtual reality object control: and controlling the movement of the virtual reality object in the virtual reality scene according to the parameter fusion information, and simultaneously reading a rendering result corresponding to the virtual scene image slice, so that the virtual reality scene can be updated.

Example two:

a low-latency control method for facilitating virtual reality object control, the method comprising the steps of:

(1) image acquisition and display: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm, finally displaying decompressed image slices to a user by a display unit, wherein the frame rate of video signals corresponding to the image frames is 50FPS, the display unit outputs according to a refresh rate of 80Hz, so that flickering and incoherence of the virtual reality scene caused by too low refresh rate can be avoided, the image display effect and the visual perception can be improved, the encoding and decoding algorithm is H.261, H.263, H.264 or H.265, the encoding unit compresses the image frames through the encoding and decoding algorithm to obtain output code stream data, and then the transmission unit transmits the output code stream data to a decoding unit, the decoding unit decompresses the output code stream data through an encoding and decoding algorithm to obtain a decompressed image slice, so that the delay rate of the virtual reality scene can be reduced;

(2) collecting control information: the method comprises the steps that user feedback data are obtained from virtual reality control devices such as VR glasses and control handles and uploaded to a virtual reality server, then the virtual reality server performs display control on adaptation regions of target objects, a control instruction sequence is issued for each adaptation region of the target objects, the control instruction sequence is sent to virtual reality execution equipment, the user feedback data comprise human body motion signals and equipment control information, the virtual reality server is communicated with the virtual reality control devices through an internet network, the virtual reality server adopts a WebSocket application layer protocol, the virtual reality execution equipment sends connection application to the WebSocket protocol, remote network connection communication is established and maintained, connection can be established with the virtual reality server and data can be received circularly, and therefore full-duplex bidirectional communication of persistent connection can be achieved;

(3) the control instruction executes: the virtual reality execution equipment receives a control instruction sequence sent by the virtual reality server and executes preset operation corresponding to the control instruction sequence, and the virtual reality execution equipment performs corresponding operation on the display object according to the control type and switches the current virtual reality scene to a corresponding virtual reality simulation scene, so that the delay time of scene switching can be reduced, and meanwhile, the action of the virtual reality object in the virtual reality scene can be conveniently controlled;

(4) and (3) data uploading: the virtual reality server receives a control instruction from the virtual reality control device, the control instruction forms a data packet queue and is uploaded to the memory for caching, the virtual reality server determines coordinate offset adaptive parameters of a simulated scene and regional configuration parameters of an initial scene, and further parameter fusion information can be obtained, the memory is an FIFO memory, the virtual reality server detects the cache information in the FIFO memory every 10ms, the memory stores at least one executable control instruction, the control instruction is executed by at least one virtual reality execution device, the position information and the control instruction of a virtual reality object can be called, and further the virtual reality object can be rapidly controlled;

(5) virtual reality object control: and controlling the movement of the virtual reality object in the virtual reality scene according to the parameter fusion information, and simultaneously reading a rendering result corresponding to the virtual scene image slice, so that the virtual reality scene can be updated.

Example three:

a low-latency control method for facilitating virtual reality object control, the method comprising the steps of:

(1) image acquisition and display: when a virtual reality display request is received, acquiring a corresponding virtual reality configuration file from a virtual reality server, acquiring virtual reality scene video information, acquiring video frames forming a virtual reality scene video, wherein N is more than or equal to 2, then encoding, transmitting and decoding the acquired video frames through an encoding and decoding algorithm, finally displaying decompressed image slices to a user by a display unit, wherein the frame rate of video signals corresponding to the image frames is 60FPS, the display unit outputs according to a refresh rate of 100Hz, so that flickering and incoherence of the virtual reality scene caused by too low refresh rate can be avoided, the image display effect and the visual perception can be improved, the encoding and decoding algorithm is H.261, H.263, H.264 or H.265, the encoding unit compresses the image frames through the encoding and decoding algorithm to obtain output code stream data, and then the transmission unit transmits the output code stream data to a decoding unit, the decoding unit decompresses the output code stream data through an encoding and decoding algorithm to obtain a decompressed image slice, so that the delay rate of the virtual reality scene can be reduced;

(2) collecting control information: the method comprises the steps that user feedback data are obtained from virtual reality control devices such as VR glasses and control handles and uploaded to a virtual reality server, then the virtual reality server performs display control on adaptation regions of target objects, a control instruction sequence is issued for each adaptation region of the target objects, the control instruction sequence is sent to virtual reality execution equipment, the user feedback data comprise human body motion signals and equipment control information, the virtual reality server is communicated with the virtual reality control devices through an internet network, the virtual reality server adopts a WebSocket application layer protocol, the virtual reality execution equipment sends connection application to the WebSocket protocol, remote network connection communication is established and maintained, connection can be established with the virtual reality server and data can be received circularly, and therefore full-duplex bidirectional communication of persistent connection can be achieved;

(3) the control instruction executes: the virtual reality execution equipment receives a control instruction sequence sent by the virtual reality server and executes preset operation corresponding to the control instruction sequence, and the virtual reality execution equipment performs corresponding operation on the display object according to the control type and switches the current virtual reality scene to a corresponding virtual reality simulation scene, so that the delay time of scene switching can be reduced, and meanwhile, the action of the virtual reality object in the virtual reality scene can be conveniently controlled;

(4) and (3) data uploading: the virtual reality server receives a control instruction from the virtual reality control device, the control instruction forms a data packet queue and is uploaded to the memory for caching, the virtual reality server determines coordinate offset adaptive parameters of a simulated scene and regional configuration parameters of an initial scene, and further parameter fusion information can be obtained, the memory is an FIFO memory, the virtual reality server detects the cache information in the FIFO memory every 10ms, the memory stores at least one executable control instruction, the control instruction is executed by at least one virtual reality execution device, the position information and the control instruction of a virtual reality object can be called, and further the virtual reality object can be rapidly controlled;

(5) virtual reality object control: according to the parameter fusion information, the movement of the virtual reality object in the virtual reality scene is controlled, meanwhile, the rendering result corresponding to the image slice of the virtual scene is read, the virtual reality scene can be updated, the target position of the preset scene is updated according to the position information of the virtual reality object when the virtual reality object moves, the position of the virtual reality object in the virtual scene can be refreshed, and therefore the control delay and the scene delay of the virtual reality object are reduced.

The method for controlling the virtual reality object has the advantages of being convenient to control the virtual reality object, improving the refreshing frequency of the virtual reality scene and effectively reducing the control delay of the virtual reality object, and solves the problems that the processing speed of a virtual reality server is reduced in the existing control mode, and the response of virtual reality interaction is too slow due to too large transmission delay, so that the virtual reality object cannot be adapted to the application scene, and the user experience of the virtual reality can be improved.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.