阅读说明：本技术 一种应用于虚拟现实系统的交互系统及方法 (interaction system and method applied to virtual reality system ) 是由 马骏峰 于 2019-07-31 设计创作，主要内容包括：本发明公开了一种应用于虚拟现实系统的交互系统,所述系统包括：移动控制模块、旋转控制模块和用户交互意图处理模块,移动控制模块用于获取用户在虚拟现实场景中的移动交互意图,将与所述移动交互意图相应的第一交互数据发送给用户交互意图处理模块；旋转控制模块用于获取用户在虚拟现实场景中的旋转交互意图,将与所述旋转交互意图相应的第二交互数据发送给用户交互意图处理模块；用户交互意图处理模块用于对接收到的第一交互数据和/或第二交互数据进行处理,所述处理结果用于供对虚拟现实场景中的视图进行控制时使用。通过本发明的方案,提高用户在虚拟现实系统的交互的体验。(The invention discloses an interactive system applied to a virtual reality system, which comprises: the mobile control module is used for acquiring a mobile interaction intention of a user in a virtual reality scene and sending first interaction data corresponding to the mobile interaction intention to the user interaction intention processing module; the rotation control module is used for acquiring a rotation interaction intention of a user in a virtual reality scene and sending second interaction data corresponding to the rotation interaction intention to the user interaction intention processing module; the user interaction intention processing module is used for processing the received first interaction data and/or second interaction data, and the processing result is used for controlling the view in the virtual reality scene. Through the scheme of the invention, the interactive experience of the user in the virtual reality system is improved.)

1. An interactive system for a virtual reality system, the system comprising: a movement control module, a rotation control module and a user interaction intention processing module,

the mobile control module is used for acquiring a mobile interaction intention of a user in a virtual reality scene and sending first interaction data corresponding to the mobile interaction intention to the user interaction intention processing module;

The rotation control module is used for acquiring a rotation interaction intention of a user in a virtual reality scene and sending second interaction data corresponding to the rotation interaction intention to the user interaction intention processing module;

And the user interaction intention processing module is used for processing the received first interaction data and/or second interaction data, and the processing result is used for controlling the view in the virtual reality scene.

2. the interactive system applied to the virtual reality system, according to claim 1, wherein the system further comprises an operation control module;

the operation control module is used for acquiring control operation information of a user through an input key and sending third interaction data corresponding to the control operation information to the user interaction intention processing module, wherein the control operation information comprises confirmation operation information and return operation information;

And the user interaction intention processing module is further used for processing the received third interaction data, and the processing result is used for controlling the view in the virtual reality scene.

3. the interaction system applied to the virtual reality system according to claim 1, wherein the obtaining of the mobile interaction intention of the user in the virtual reality scene comprises:

Acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal;

And mapping the interaction intention data to obtain corresponding first interaction data.

4. The interaction system applied to the virtual reality system according to claim 1, wherein the acquiring of the rotational interaction intention of the user in the scene comprises:

Acquiring the rotation angle of a user in a scene through a gyroscope sensor to obtain angle data;

And mapping the angle data through integral processing to obtain corresponding second interactive data.

5. the interactive system applied to the virtual reality system according to claim 2,

the processing the obtained first interaction data and/or second interaction data includes: packaging the received first interactive data and/or second interactive data according to a predefined data format;

The processing the obtained third interaction data includes: and packaging the received third interactive data according to a predefined data format.

6. An interaction method applied to a virtual reality system, the method comprising:

The method comprises the steps of obtaining a mobile interaction intention and/or a rotary interaction intention of a user in a virtual reality scene, and respectively mapping the mobile interaction intention and/or the rotary interaction intention according to preset rules to obtain corresponding first interaction data and/or second interaction data;

and processing the obtained first interaction data and/or second interaction data, wherein the processing result is used for controlling the view in the virtual reality scene.

7. the interaction method applied to the virtual reality system according to claim 6, wherein the method further comprises:

Acquiring control operation information of a user through an input key, and acquiring third interactive data corresponding to the control operation information, wherein the control operation information comprises confirmation operation information and return operation information;

and processing the obtained third interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

8. the interaction method applied to the virtual reality system according to claim 7, wherein the obtaining of the mobile interaction intention and/or the rotational interaction intention of the user in the virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to a preset rule to obtain corresponding first interaction data and/or second interaction data comprises:

Acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal;

And mapping the interaction intention data to obtain corresponding first interaction data.

9. The interaction method applied to the virtual reality system according to claim 8, wherein the obtaining of the mobile interaction intention and/or the rotational interaction intention of the user in the virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to a preset rule to obtain corresponding first interaction data and/or second interaction data further comprises:

Acquiring the rotation angle of a user in a scene through a gyroscope sensor to obtain angle data;

And mapping the angle data through integral processing to obtain corresponding second interactive data.

10. The interaction method applied to the virtual reality system according to claim 7,

The processing the obtained first interaction data and/or second interaction data includes: packaging the received first interactive data and/or second interactive data according to a predefined data format;

the processing the obtained third interaction data includes: and packaging the received third interactive data according to a predefined data format.

Technical Field

the invention relates to the technical field of virtual reality, in particular to an interaction system and method applied to a virtual reality system.

Background

At present, in the 5G era, network resources are no longer the bottleneck of data transmission, which provides technical feasibility for Virtual Reality (Virtual Reality) technology implementation. The interaction mode in the virtual reality scene is obviously different from the traditional desktop PC interaction mode. Aiming at a machine room monitoring system based on a virtual reality technology, an interaction technology applied to the machine room monitoring system based on the virtual reality technology needs to be provided urgently, so that a user can obtain better interaction experience when using the machine room monitoring system based on the virtual reality technology.

Disclosure of Invention

in order to solve the technical problem, the invention provides an interaction system and method applied to a virtual reality system, which improve the user interaction experience through mapping processing of the movement or rotation interaction intention of a user.

In order to achieve the object of the present invention, the present invention provides an interactive system applied to a virtual reality system, the system comprising: a movement control module, a rotation control module and a user interaction intention processing module,

the mobile control module is used for acquiring a mobile interaction intention of a user in a virtual reality scene and sending first interaction data corresponding to the mobile interaction intention to the user interaction intention processing module;

The rotation control module is used for acquiring a rotation interaction intention of a user in a virtual reality scene and sending second interaction data corresponding to the rotation interaction intention to the user interaction intention processing module;

and the user interaction intention processing module is used for processing the received first interaction data and/or second interaction data, and the processing result is used for controlling the view in the virtual reality scene.

In an exemplary embodiment, the system further comprises an operation control module;

The operation control module is used for acquiring control operation information of a user through an input key and sending third interaction data corresponding to the control operation information to the user interaction intention processing module, wherein the control operation information comprises confirmation operation information and return operation information;

And the user interaction intention processing module is further used for processing the received third interaction data, and the processing result is used for controlling the view in the virtual reality scene.

In an exemplary embodiment, the obtaining of the mobile interaction intention of the user in the virtual reality scene includes:

Acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal;

And mapping the interaction intention data to obtain corresponding first interaction data.

In an exemplary embodiment, the acquiring the rotational interaction intention of the user in the scene includes:

Acquiring the rotation angle of a user in a scene through a gyroscope sensor to obtain angle data;

and mapping the angle data through integral processing to obtain corresponding second interactive data.

In an exemplary embodiment, the processing the obtained first interaction data and/or second interaction data includes: packaging the received first interactive data and/or second interactive data according to a predefined data format;

The processing the obtained third interaction data includes: and packaging the received third interactive data according to a predefined data format.

In order to solve the above problem, the present invention further provides an interaction method applied to a virtual reality system, where the method includes:

The method comprises the steps of obtaining a mobile interaction intention and/or a rotary interaction intention of a user in a virtual reality scene, and respectively mapping the mobile interaction intention and/or the rotary interaction intention according to preset rules to obtain corresponding first interaction data and/or second interaction data; and processing the obtained first interaction data and/or second interaction data, wherein the processing result is used for controlling the view in the virtual reality scene.

In an exemplary embodiment, the method further comprises:

acquiring control operation information of a user through an input key, and acquiring third interactive data corresponding to the control operation information, wherein the control operation information comprises confirmation operation information and return operation information;

And processing the obtained third interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

in an exemplary embodiment, the obtaining a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to preset rules respectively to obtain corresponding first interaction data and/or second interaction data includes:

acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal;

and mapping the interaction intention data to obtain corresponding first interaction data.

In an exemplary embodiment, the obtaining a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to preset rules respectively to obtain corresponding first interaction data and/or second interaction data further includes:

Acquiring the rotation angle of a user in a scene through a gyroscope sensor to obtain angle data;

And mapping the angle data through integral processing to obtain corresponding second interactive data.

in an exemplary embodiment, the processing the obtained first interaction data and/or second interaction data includes: packaging the received first interactive data and/or second interactive data according to a predefined data format;

The processing the obtained third interaction data includes: and packaging the received third interactive data according to a predefined data format.

compared with the prior art, the invention provides an interactive system applied to a virtual reality system, which comprises: the mobile control module is used for acquiring a mobile interaction intention of a user in a virtual reality scene and sending first interaction data corresponding to the mobile interaction intention to the user interaction intention processing module; the rotation control module is used for acquiring a rotation interaction intention of a user in a virtual reality scene and sending second interaction data corresponding to the rotation interaction intention to the user interaction intention processing module; and the user interaction intention processing module is used for processing the received first interaction data and/or second interaction data, and the processing result is used for controlling the view in the virtual reality scene. Through the scheme of the invention, the interactive experience of the user is improved through the mapping processing of the movement or rotation interactive intention of the user.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

drawings

The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.

Fig. 1 is a schematic diagram of an interactive system applied to a virtual reality system in an embodiment of the present invention;

FIG. 2 is a flowchart of an interaction method applied to a virtual reality system according to an embodiment of the present invention;

fig. 3 is a flowchart illustrating an interaction method applied to a virtual reality system according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.

the steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.

FIG. 1 is an interactive system applied to a virtual reality system according to the present invention, the system includes: the movement control module 101, the rotation control module 102, and the user interaction intention processing module 103:

the mobile control module 101 is configured to obtain a mobile interaction intention of a user in a virtual reality scene, and send first interaction data corresponding to the mobile interaction intention to the user interaction intention processing module.

In the embodiment, the movement interaction intention of the user in the virtual reality scene is obtained, and the movement can be that the user moves forward by 0.1 meter or moves leftward by 0.2 meter, and the like.

After the mobile interaction intention of the user in the virtual reality scene is obtained, first interaction data corresponding to the mobile interaction intention are sent to a user interaction intention processing module for processing.

in one exemplary embodiment, acquiring a mobile interaction intention of a user in a virtual reality scene comprises: acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal; and mapping the interaction intention data to obtain corresponding first interaction data. The user can input the key information according to the preset setting and the user requirement through the direction input key on the mobile terminal. Once the key is input, the specific setting corresponding to the fixed distance moved by the user can be set as required. For example: pressing the key once, which is equivalent to the user moving 0.1 meter; when the user moves 0.2 meters forward in the virtual reality scene, the up input key may be pressed 2 times in succession.

the rotation control module 102 is configured to acquire a rotation interaction intention of a user in a virtual reality scene, and send second interaction data corresponding to the rotation interaction intention to the user interaction intention processing module.

in this embodiment, when the user in the virtual reality scene performs the rotation operation according to the specified interaction rule (as shown in fig. 3), the second interaction data corresponding to the acquired rotation interaction intention is sent to the user interaction intention processing module. The prescribed interaction rule may be: the change around the z-axis angle is mapped to the left and right movement of the desktop pointer, and the change around the x-axis angle is mapped to the up and down movement of the desktop pointer. The interaction rule can be set according to the use habit of the user.

in an exemplary embodiment, the angle of the user rotating in the scene is acquired through a gyroscope sensor, and angle data is obtained; and mapping the angle data through integral processing to obtain corresponding second interactive data.

The gyroscope sensor is located in a wearing device of a user, wherein the wearing device can be a mobile terminal.

the specific implementation manner of acquiring the rotation angle of the user in the scene through the gyroscope sensor can be as follows: the motion state of the gyro sensor is monitored, and the angle of the user rotating in the scene can be determined according to the reading of the gyro sensor.

the motion state of the gyro sensor can be divided into two types: a "moving" state and an "unmoving" state. When the equipment where the gyroscope sensor is positioned is in a large-amplitude motion state, the equipment is judged to be in a motion state; when the equipment where the gyroscope sensor is located is in a static state or in uniform motion, the equipment is judged to be in an 'unmoved' state.

first, a preset threshold value is acquired.

next, the motion state of the gyro sensor is judged. When the reading of the gyroscope sensor is larger than a set threshold value, judging that the gyroscope sensor is in a motion state; and when the reading of the gyroscope sensor is smaller than a set threshold value, judging that the gyroscope sensor is in a non-motion state.

and finally, determining the rotating angle in the user scene according to the motion state of the gyroscope sensor.

And when the reading of the gyroscope sensor is larger than a set threshold value, judging that the gyroscope sensor is in a motion state, and using the output of the reading of the gyroscope sensor as the output data of the motion state of the current equipment.

And when the reading of the gyroscope sensor is smaller than a set threshold value, judging that the gyroscope sensor is in a non-motion state, and using the angle value calculated by the accelerometer and the magnetometer as the motion state output data of the current equipment. In this embodiment, the specific implementation of the angle values calculated using the accelerometer and the magnetometer may be as follows:

Firstly, reading of three axes of accelerometers ax, ay and az is obtained;

Secondly, after reading the readings of the three axes ax, ay and az by the accelerometer, calculating the instantaneous angle around the x axis and the instantaneous angle around the y axis by the following formulas:

the instantaneous angle around the x-axis is: θ ═ arcsin (-ax/g), where θ denotes the instantaneous angle around the x-axis and g denotes the acceleration of gravity;

the instantaneous angle around the y-axis is: phi is arctan (ay/az), where phi denotes the instantaneous angle around the y-axis;

Thirdly, after calculating the instantaneous angle around the x axis and the instantaneous angle around the y axis, acquiring the reading of the magnetometer;

Fourthly, calculating the angle of rotation around the z axis according to the reading of the magnetometer:

Where ψ denotes an angle of rotation about the z-axis, and Mx, My, and Mz are outputs of the magnetometer x, y, and z axes.

the interactive system applied to the virtual reality system further includes an operation control module (not shown in fig. 1).

and the operation control module is used for acquiring control operation information of a user through an input key and sending third interaction data corresponding to the control operation information to the user interaction intention processing module, wherein the control operation information comprises confirmation operation information and return operation information.

in this embodiment, the obtaining of the control operation information of the user through the input key may be that the user inputs corresponding control operation information through the input key of the mobile terminal when receiving the related information displayed by the virtual reality system. For example: when the virtual reality system display equipment is abnormal and whether the abnormal equipment is closed or not is prompted, the input confirmation operation can be selected, namely the abnormal equipment is closed.

the interactive system applied to the virtual reality system further includes a user interaction intention processing module 103,

And the user interaction intention processing module 103 is configured to process the received first interaction data and/or second interaction data, and the processing result is used for controlling a view in the virtual reality scene. In this embodiment, the received first interactive data and/or second interactive data are encapsulated according to a defined data format.

The user interaction intention processing module 103 is further configured to process the received third interaction data, where the processing result is used for controlling a view in a virtual reality scene.

Regarding the processing of the interactive data, the specific implementation process may be as follows, for example:

{

Move:[x,y,z],

Action:0/1

}。

In addition, the present application provides an embodiment of an interaction method applied to a virtual reality system, where the embodiment of the method corresponds to the embodiment of the apparatus shown in fig. 1.

in order to solve the above problem, as shown in fig. 2, the present invention further provides an interaction method applied to a virtual reality system.

Step 200: the method comprises the steps of obtaining a mobile interaction intention and/or a rotary interaction intention of a user in a virtual reality scene, and respectively mapping the mobile interaction intention and/or the rotary interaction intention according to preset rules to obtain corresponding first interaction data and/or second interaction data.

In this embodiment, a key or a sensor is used to acquire a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and the mobile interaction intention and/or the rotational interaction intention are/is mapped according to preset rules, so as to obtain corresponding first interaction data and/or second interaction data.

In an exemplary embodiment, control operation information of a user is acquired through an input key, and third interactive data corresponding to the control operation information is acquired, wherein the control operation information comprises confirmation operation information and return operation information; and processing the obtained third interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

In an exemplary embodiment, the obtaining a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to preset rules respectively to obtain corresponding first interaction data and/or second interaction data includes: when a mobile interaction intention is obtained, mapping the mobile interaction intention to obtain corresponding first interaction data; and when the rotary interaction intention is obtained, mapping the rotary interaction intention to obtain corresponding second interaction data.

In an exemplary embodiment, the obtaining a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to preset rules respectively to obtain corresponding first interaction data and/or second interaction data includes: acquiring interactive intentions of front, back, left and right movement of a user in a scene through a direction input key on the mobile terminal; and mapping the interaction intention data to obtain corresponding first interaction data.

in an exemplary embodiment, the obtaining a mobile interaction intention and/or a rotational interaction intention of a user in a virtual reality scene, and mapping the mobile interaction intention or the rotational interaction intention according to preset rules respectively to obtain corresponding first interaction data and/or second interaction data further includes: acquiring the rotation angle of a user in a scene through a gyroscope sensor to obtain angle data; and mapping the angle data through integral processing to obtain corresponding second interactive data.

Step 201: and processing the obtained first interaction data and/or second interaction data, wherein the processing result is used for controlling the view in the virtual reality scene.

In this embodiment, when the first interactive data is obtained, the obtained first interactive data is processed, and the processing result is used for controlling the view in the virtual reality scene. And when the second interactive data is obtained, processing the obtained second interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

the interaction method applied to the virtual reality system further comprises the following steps:

step 202 (not shown in fig. 2): and acquiring control operation information of a user through an input key, and acquiring third interactive data corresponding to the control operation information, wherein the control operation information comprises confirmation operation information and return operation information.

In this embodiment, the obtaining of the control operation information of the user through the input key may be that the user inputs corresponding control operation information through the input key of the mobile terminal when receiving the related information displayed by the virtual reality system. For example: when the virtual reality system display equipment is abnormal and whether the abnormal equipment is closed or not is prompted, the input confirmation operation can be selected, namely the abnormal equipment is closed.

Step 203 (not shown in fig. 2): and processing the obtained third interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

an exemplary embodiment of the invention is implemented as follows:

Step 400: and acquiring the interactive intentions of the user moving forwards, backwards, leftwards and rightwards in the scene through the direction input keys on the mobile terminal.

step 401: and mapping the interaction intention data to obtain corresponding first interaction data.

Step 402: and packaging the obtained first interactive data according to a predefined data format for use when controlling the view in the virtual reality scene.

An exemplary embodiment of the invention is implemented as follows:

step 500: and acquiring the rotating angle of the user in the scene through a gyroscope sensor to obtain angle data.

Step 501: and mapping the obtained angle data through integral processing to obtain corresponding second interactive data.

Step 502: and packaging the obtained second interactive data according to a predefined data format for use when controlling the view in the virtual reality scene.

An exemplary embodiment of the invention is implemented as follows:

step 600: and acquiring control operation information of a user through an input key, and acquiring third interactive data corresponding to the control operation information, wherein the control operation information comprises confirmation operation information and return operation information.

step 601: and processing the obtained third interactive data, wherein the processing result is used for controlling the view in the virtual reality scene.

based on a specific example of this embodiment, the interactive system applied to the machine room monitoring system of the virtual reality technology uses the key or the gyroscope sensor as the interactive input in the machine room monitoring system of the virtual reality technology, and the interactive mode is simple and easy to learn, conforms to the interaction habit developed by the user, has low learning cost, and has better user experience.

it will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.