阅读说明：本技术 一种混合现实模拟驾驶环境生成方法及系统 (Mixed reality simulation driving environment generation method and system ) 是由 王召福 陈永鹏 曾巧文 于 2021-07-30 设计创作，主要内容包括：本发明提供一种混合现实模拟驾驶环境生成方法,包括：服务器获取混合现实MR头戴显示器显示的虚拟场景信息和虚拟场景信息与环境控制指令的匹配关系；服务器根据虚拟场景信息和匹配关系,获取虚拟场景信息对应的环境控制指令；服务器向控制器发送虚拟场景信息对应的环境控制指令,使得控制器根据虚拟场景信息对应的环境控制指令控制终端设备。本发明还提供了相应的生成系统。本发明可以提供一个与虚拟场景匹配的现实环境,加强模拟驾驶的环境效果,提升模拟体验的真实感。(The invention provides a method for generating a mixed reality simulated driving environment, which comprises the following steps: the server acquires virtual scene information displayed by the mixed reality MR head-mounted display and a matching relation between the virtual scene information and an environment control instruction; the server acquires an environment control instruction corresponding to the virtual scene information according to the virtual scene information and the matching relation; and the server sends an environment control instruction corresponding to the virtual scene information to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the virtual scene information. The invention also provides a corresponding generation system. The invention can provide a real environment matched with the virtual scene, enhance the environmental effect of the simulated driving and improve the sense of reality of the simulated experience.)

1. A method for generating a mixed reality simulated driving environment, comprising:

the server acquires virtual scene information displayed by the mixed reality MR head-mounted display and a matching relation between the virtual scene information and an environment control instruction;

the server acquires an environment control instruction corresponding to the virtual scene information according to the virtual scene information and the matching relation;

and the server sends an environment control instruction corresponding to the virtual scene information to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the virtual scene information.

2. The mixed reality simulated driving environment generation method of claim 1, wherein the virtual scene information comprises a category of the virtual scene.

3. The mixed reality simulated driving environment generation method of claim 1, wherein the virtual scene information comprises a name of the virtual scene.

4. The mixed reality simulated driving environment generation method of claim 1, 2 or 3, wherein the environment control command corresponding to the virtual scene information comprises a light control command.

5. The mixed reality simulated driving environment generation method of claim 4, wherein the light control instruction comprises a light illumination control instruction.

6. The mixed reality simulated driving environment generation method of claim 4, wherein the light control instructions comprise color temperature control instructions.

7. The mixed reality simulated driving environment generation method of claim 1, 2 or 3, further comprising: after the server sends an environment control instruction corresponding to the virtual scene information to a controller, the server acquires vehicle state information sent by a simulated vehicle and a matching relation between the vehicle state and the environment control instruction;

the server acquires an environment control instruction corresponding to the vehicle state according to the vehicle state information and the matching relation;

and the server sends an environment control instruction corresponding to the vehicle state to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the vehicle state.

8. The mixed reality simulated driving environment generation method of claim 1, 2 or 3, further comprising: after the server sends the environment control instruction corresponding to the virtual scene information to the controller, when the server receives a signal of driving simulation ending, the server sends the environment control instruction corresponding to the signal of driving simulation ending to the controller according to the signal of driving simulation ending, so that the controller controls the terminal device according to the environment control instruction corresponding to the signal of driving simulation ending.

9. The mixed reality simulated driving environment generation method of claim 8, wherein the environment control command corresponding to the simulated driving end signal comprises a light control command.

10. A mixed reality simulated driving environment generation system, comprising: the system comprises a server, a controller, a mixed reality MR head-mounted display and terminal equipment, wherein the server is respectively connected with the controller and the MR head-mounted display through a network, and the controller is connected with the terminal equipment;

the server is used for acquiring the virtual scene information displayed by the MR head-mounted display and the matching relation between the virtual scene information and the environment control instruction; the environment control instruction corresponding to the virtual scene information is obtained according to the virtual scene information and the matching relation; the environment control instruction is used for sending the environment control instruction corresponding to the virtual scene information to the controller;

the controller is used for receiving the environment control instruction corresponding to the virtual scene information sent by the server and controlling the terminal equipment according to the environment control instruction corresponding to the virtual scene information.

Technical Field

The application relates to the technical field of mixed reality, in particular to a method and a system for generating a mixed reality simulated driving environment.

Background

Some current mixed reality holographic projection wear intelligent glasses throw virtual image on the lens of intelligent glasses for the person of wearing can see virtual image on the lens, can see through the lens again simultaneously and see actual scene, realizes mixed reality's effect. However, when the intelligent glasses are used for simulating driving, the environment of the virtual scene may be inconsistent with that of the actual scene, even the difference is large, and the effect of simulation experience is seriously influenced. For example, the situation of driving at night is simulated, the virtual scene is the environment of driving at night, and if the ambient light is strong, the fusion of the virtual scene and the actual scene has a bad effect.

Disclosure of Invention

The invention aims to provide a method and a system for generating a mixed reality simulated driving environment. By applying the method and the device, the environment of the actual scene matched with the virtual scene can be generated according to the virtual scene, and the simulated driving effect of mixed reality is improved.

A mixed reality simulated driving environment generation method comprises the following steps:

the server acquires virtual scene information displayed by the mixed reality MR head-mounted display and a matching relation between the virtual scene information and an environment control instruction;

the server acquires an environment control instruction corresponding to the virtual scene information according to the virtual scene information and the matching relation;

and the server sends an environment control instruction corresponding to the virtual scene information to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the virtual scene information.

Optionally, the virtual scene information includes a category of the virtual scene.

Optionally, the virtual scene information includes a name of the virtual scene.

Optionally, the environment control instruction includes a light control instruction.

Optionally, the light control instruction includes a light intensity control instruction.

Optionally, the light control instruction includes a color temperature control instruction.

Optionally, the method further includes: after the server sends an environment control instruction corresponding to the virtual scene information to a controller, the server acquires vehicle state information sent by a simulated vehicle and a matching relation between the vehicle state and the environment control instruction,

the server acquires an environment control instruction corresponding to the vehicle state according to the vehicle state information and the matching relation;

and the server sends an environment control instruction corresponding to the vehicle state to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the vehicle state.

Optionally, the method further includes: after the server sends the environment control instruction corresponding to the virtual scene information to the controller, when the server receives a signal of driving simulation ending, the server sends the environment control instruction corresponding to the signal of driving simulation ending to the controller according to the signal of driving simulation ending, so that the controller controls the terminal device according to the environment control instruction corresponding to the signal of driving simulation ending.

Optionally, the environment control instruction corresponding to the signal for simulating the driving end includes a light control instruction.

A mixed reality simulated driving environment generation system comprising: the system comprises a server, a controller, a mixed reality MR head-mounted display and terminal equipment, wherein the server is respectively connected with the controller and the MR head-mounted display through a network, and the controller is connected with the terminal equipment;

the server is used for acquiring the virtual scene information displayed by the MR head-mounted display and the matching relation between the virtual scene information and the environment control instruction; the environment control instruction corresponding to the virtual scene information is obtained according to the virtual scene information and the matching relation; the environment control instruction is used for sending the environment control instruction corresponding to the virtual scene information to the controller;

the controller is used for receiving the environment control instruction corresponding to the virtual scene information sent by the server and controlling the terminal equipment according to the environment control instruction corresponding to the virtual scene information.

By applying the method and the device, the environment of the actual scene matched with the virtual scene can be generated according to the virtual scene, so that the fusion effect of the virtual driving scene and the actual scene is better, and the fidelity of the simulated driving environment is improved.

Drawings

FIG. 1 is a flowchart illustrating steps of a method for generating a mixed reality simulated driving environment according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a mixed reality simulated driving environment generation system according to another embodiment of the present invention.

Detailed Description

As shown in fig. 1, an embodiment of the present invention provides a method for generating a mixed reality simulated driving environment, where the method is applied to a mixed reality simulated driving scene display system, and the system includes a server, a controller, a mixed reality MR head-mounted display, and a terminal device, where the server is connected to the controller and the MR head-mounted display through a network, respectively, and the controller is connected to the terminal device; the terminal equipment includes lamps, air conditioners, fans and the like.

A mixed reality simulated driving environment generation method comprises the following steps:

101. and the server acquires the virtual scene information displayed by the MR head-mounted display and the matching relation between the virtual scene information and the environment control instruction.

The virtual scene information displayed by the MR head-mounted display and the matching relation of the virtual scene information and the environment control instruction can be stored in a server. The virtual scene information displayed by the MR head mounted display may include information such as the category, name, content, time, etc. of the virtual scene.

The matching relationship between the virtual scene information and the environment control instruction can be embodied in the form of a matching table or remarks between the virtual scene information and the environment control instruction. For example, the categories of the virtual scenes match the environmental control command matching table, and each category of the virtual scenes matches the corresponding environmental control command. Specifically, the categories include night, evening, sunny day, rainy day, and the like. When the category of the virtual scene is night, the matched environment control instruction is used for setting the ambient light illumination for simulating night driving. When the personnel wear and start the MR head-mounted display, the server sends virtual scene content to be displayed to the MR head-mounted display, and meanwhile the server can acquire the virtual scene information displayed by the MR head-mounted display and the matching relation between the virtual scene information and the environment control instruction.

102. And the server acquires an environment control instruction corresponding to the virtual scene information according to the virtual scene information and the matching relation.

For example, the server obtains the environment control instruction corresponding to the category of the virtual scene according to the category of the virtual scene and the environment control instruction corresponding to the category. And when the type is the night, acquiring an environment control instruction corresponding to the night type.

103. And the server sends an environment control instruction corresponding to the virtual scene information to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the virtual scene information.

For example, when the type of the virtual scene is night, the environment control command corresponding to the night type is used to set the ambient light level simulating night driving. The controller receives the environment control instruction sent by the server, and controls the lighting equipment according to the instruction, such as adjusting the illumination intensity of the lighting.

Optionally, the environment control instruction includes a light control instruction, and the light control instruction is used for adjusting light.

Optionally, the light control instruction includes a light intensity control instruction. And the illuminance control instruction is used for adjusting the illuminance of lamplight and adjusting the illuminance of the actual scene into the illuminance matched with the virtual scene.

Optionally, the light control instruction includes a color temperature control instruction. The color temperature control instruction is used for adjusting the color temperature of the light and adjusting the color temperature of the actual scene into the color temperature matched with the virtual scene.

Optionally, the environmental control instruction comprises a temperature control instruction. The temperature control instruction is used for adjusting the temperature of the environment and adjusting the temperature of the actual scene to be the temperature matched with the virtual scene. The temperature control instruction can realize temperature adjustment through an air conditioner.

Optionally, the environment control instruction includes an air supply control instruction. And the air supply control instruction is used for adjusting the wind intensity of the environment and adjusting the wind intensity of the actual scene into the wind intensity matched with the virtual scene. The air supply control instruction can realize the adjustment of the wind intensity through the fan.

The actual scene is matched with the light environment of the virtual scene by adjusting the illuminance and the color temperature of the light, so that the actual scene and the virtual scene are perfectly fused, and a person wearing the MR head-mounted display can obtain good simulated driving experience.

It should be noted that the method of the present invention is applied to a darkroom, is not affected by external light, and can obtain a better application effect for simulating a driving environment at night.

Optionally, the method further includes: after the server sends the environment control instruction corresponding to the virtual scene information to the controller, the server obtains vehicle state information sent by the simulated vehicle and the matching relation between the vehicle state and the environment control instruction, and the server obtains the environment control instruction corresponding to the vehicle state according to the vehicle state information and the matching relation. And the server sends an environment control instruction corresponding to the vehicle state to the controller, so that the controller controls the terminal equipment according to the environment control instruction corresponding to the vehicle state.

The environment control instruction corresponding to the vehicle state comprises a light control instruction, and the light control instruction is used for adjusting light. For example, the light control instruction includes a light illumination control instruction, a color temperature control instruction, a light blinking instruction, and the like. When the vehicle state information shows that the vehicle state information is abnormal, the vehicle state information corresponds to a light flashing instruction, so that the controller controls the light equipment to emit flashing light to remind people in the field of the abnormal vehicle.

The method further comprises the following steps: after the server sends the environment control instruction corresponding to the virtual scene information to the controller, when the server receives a signal of driving simulation ending, the server sends the environment control instruction corresponding to the signal of driving simulation ending to the controller according to the signal of driving simulation ending, so that the controller controls the terminal device according to the environment control instruction corresponding to the signal of driving simulation ending. And the environment control instruction corresponding to the signal for simulating the driving end comprises a light control instruction. The light control instruction can be a preset light control instruction of a full-field lighting lamp. For example, when the simulated driving is finished, the server acquires a signal of finishing the simulated driving, and sends an environment control instruction corresponding to the signal of finishing the simulated driving, such as a control instruction of full-field lighting, to the controller, so that the controller controls the lighting equipment to realize the full-field lighting, and simulated drivers and workers in the dark room can be reminded in time.

The method further comprises the following steps: after the server sends the environment control instruction corresponding to the virtual scene information to the controller, when the server receives a signal of driving simulation ending, the server sends the driving simulation scoring information corresponding to the signal of driving simulation ending to the display device according to the signal of driving simulation ending, so that the display device displays the driving simulation scoring information according to the driving simulation scoring information corresponding to the signal of driving simulation ending. The display device can be an LED display large screen, and is helpful for the bystanders to quickly know the scores of the simulated driving.

Here, since the server is installed with the driving simulation application software, the server can acquire the start signal and the end signal of the driving simulation, the rating information of the driving simulation, the virtual scene information, and the like in time. The controller may be a gateway controller or the like.

As shown in fig. 2, an embodiment of the present invention further provides a mixed reality simulated driving environment generating system, including: the system comprises a server 401, a controller 402, an MR head-mounted display 403 and a terminal device 404, wherein the server 401 is respectively connected with the controller 402 and the MR head-mounted display 403 through a network, the controller 402 is connected with the terminal device 404, and the connection can be wired network connection or wireless network connection; the server 401 is configured to obtain virtual scene information displayed by the MR head-mounted display 403 and a matching relationship between the virtual scene information and an environment control instruction; the environment control instruction corresponding to the virtual scene information is obtained according to the virtual scene information and the matching relation; and an environment control instruction for sending the virtual scene information to the controller 402; the controller 402 is configured to receive an environment control instruction corresponding to the virtual scene information sent by the server 401, and control the terminal device 404 according to the environment control instruction corresponding to the virtual scene information. The virtual scene information may include information such as a category, a name, content, and time of the virtual scene.

Optionally, the terminal device 404 includes a lamp, an air conditioner, and a fan. The controller 402 may be a control device such as an intelligent gateway, and is used to control a lamp, an air conditioner, a fan, and the like.

Optionally, the environment control instruction includes a light control instruction, and the light control instruction is used for adjusting light. The light control instruction comprises a light illumination control instruction. And the illuminance control instruction is used for adjusting the illuminance of lamplight and adjusting the illuminance of the actual scene into the illuminance matched with the virtual scene.

Optionally, the light control instruction includes a color temperature control instruction. The color temperature control instruction is used for adjusting the color temperature of the light and adjusting the color temperature of the actual scene into the color temperature matched with the virtual scene.

Optionally, the environmental control instruction comprises a temperature control instruction. The temperature control instruction is used for adjusting the temperature of the environment and adjusting the temperature of the actual scene to be the temperature matched with the virtual scene. The temperature control instruction can realize temperature adjustment through an air conditioner.

Optionally, the environment control instruction includes an air supply control instruction. And the air supply control instruction is used for adjusting the wind intensity of the environment and adjusting the wind intensity of the actual scene into the wind intensity matched with the virtual scene. The air supply control instruction can realize the adjustment of the wind intensity through the fan.