阅读说明：本技术 特高压gis设备模拟检测操作远程协作培训系统及方法 (Extra-high voltage GIS equipment simulation detection operation remote cooperation training system and method ) 是由 聂德鑫 翟文苑 王敬一 王兆晖 刘春翔 梁文勇 肖黎 刘诣 刘充浩 周航 赵樱 于 2021-07-21 设计创作，主要内容包括：本发明提供了一种特高压GIS设备模拟检测操作远程协作培训系统及方法,包括学员头盔眼镜端、学员手柄端、服务端、专家头盔眼镜端、专家手柄端；服务端分别与学员头盔眼镜端和专家头盔眼镜端交互通信；学员头盔眼镜端本地存储有GIS设备实物同比例的高精度的虚拟三维场景。学员手柄端接收外部学员的操作指令并反馈至学员头盔眼镜端；专家手柄端接收外部专家的操作指令并反馈至专家头盔眼镜端。本发明能够大幅提升学员对GIS设备检测学习的深层次理解和动手能力。(The invention provides a remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment, which comprises a student helmet glasses end, a student handle end, a service end, an expert helmet glasses end and an expert handle end; the server side is in interactive communication with the student helmet glasses end and the expert helmet glasses end respectively; the student helmet glasses end locally stores a high-precision virtual three-dimensional scene with the same GIS equipment real object proportion. The student handle end receives an operation instruction of an external student and feeds back the operation instruction to the student helmet glasses end; the expert handle end receives an operation instruction of an external expert and feeds back the operation instruction to the expert helmet glasses end. The invention can greatly improve the deep understanding and the practical ability of the student on the GIS equipment detection learning.)

1. A remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment are characterized in that: comprises a student helmet glasses end, a student handle end, a service end, an expert helmet glasses end and an expert handle end; the server side is in interactive communication with the student helmet glasses end and the expert helmet glasses end respectively; the student helmet glasses end locally stores a high-precision virtual three-dimensional scene of GIS equipment in the same real object proportion;

loading and synchronously displaying a virtual three-dimensional scene at the glasses end of the student helmet; the student handle end receives an operation instruction of an external student and feeds back the operation instruction to the student helmet glasses end; the student helmet glasses end loads and displays the content of the operation instruction of the external student in the virtual three-dimensional scene and feeds back the operation instruction of the external student and the virtual three-dimensional scene to the server end; the server side sends the received virtual three-dimensional scene to an expert helmet glasses side;

displaying the received virtual three-dimensional scene at the glasses end of the expert helmet; the expert handle end receives an operation instruction of an external expert and feeds the operation instruction back to the expert helmet glasses end; the expert helmet glasses end loads and displays the content of the operation instruction of the external expert in the virtual three-dimensional scene and feeds back the operation instruction of the external expert to the server end;

the server side sends the content of the operation instruction of the external student to the expert helmet glasses side, and the expert helmet glasses side loads and displays the content of the operation instruction of the student expert in the virtual three-dimensional scene;

the server side sends the operation instruction content of the external expert to the student helmet glasses side, and the student helmet glasses side loads and displays the operation instruction content of the external expert in the virtual three-dimensional scene.

2. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: the student handle end communicates with the student helmet glasses end through Bluetooth; the expert handle end communicates with the expert helmet glasses end through Bluetooth.

3. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: and the student helmet glasses, the expert helmet glasses and the server side transmit information in real time through WIFI.

4. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 4 are characterized in that: and when the student glasses are in a WiFi-free environment, the student glasses end loads and displays the virtual three-dimensional scene information stored locally, the content of the operation instruction of the external student is stored locally, and the content of the operation instruction of the external student is uploaded to the server end after the student glasses are in the WiFi environment.

5. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: the student helmet glasses end has a binocular recognition function, automatically recognizes GIS real objects and key parts, and superimposes and fuses virtual three-dimensional scenes and real objects.

6. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: and the expert helmet glasses end is used for carrying out screenshot, editing and storing on the virtual three-dimensional scene.

7. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: the student handle end is used for providing operating keys and laser beams for students, and external students can carry out GIS equipment detection training operation on the virtual three-dimensional scene through controlling the operating keys and the laser beams.

8. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 7 are characterized in that: the expert helmet glasses end is used for receiving instruction information of an external expert, and the instruction information comprises characters, pictures and voice.

9. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: the GIS equipment real object same-proportion high-precision virtual three-dimensional scene is generated by fusing a GIS model scene and a GIS real object scene.

10. The system and the method for simulation, detection and operation remote collaborative training of extra-high voltage GIS equipment according to claim 1 are characterized in that: the method comprises the following steps:

a, after a student wears a student helmet glasses end and starts up, the student helmet glasses end displays a high-precision virtual three-dimensional scene which is in the same proportion with a GIS equipment real object in a space environment;

b, automatically identifying a GIS equipment real object and a key part thereof at the glasses end of the student helmet, and superposing and fusing a GIS virtual three-dimensional scene and a real object scene;

c, the student sends a control command to the helmet glasses end of the student through the handle end of the student; the student helmet glasses end generates student operation information based on the received control instruction and displays the student operation information on the fused virtual scene; the student helmet glasses end generates training data information from the whole operation process information of the student and performs local classified storage;

d, when the network environment does not exist, the training data information is only locally stored at the glasses end of the student helmet and displays the state to be transmitted, and when the network environment exists, the glasses end of the student helmet transmits the training data information to the server end in real time through a wireless network;

e, the server classifies and stores the training data information received by the student helmet glasses end, and simultaneously transmits the virtual environment information and the student operation information of the student helmet glasses end to the expert helmet glasses end in real time;

f, displaying real-time data transmitted by the expert helmet glasses end through the server end to display the virtual environment the same as that of the student and the student corresponding to the student operation information to carry out GIS equipment detection operation;

g, the expert helmet glasses end captures the virtual environment according to the control command sent by the expert operating handle end and edits the expert guidance information in the form of characters, pictures or voice, and the expert guidance information is transmitted to the server end through the wireless network and then sent to the student helmet glasses end;

and H, displaying the received expert guidance information at the glasses end of the student helmet, and carrying out corresponding detection operation by the student according to the expert guidance information.

Technical Field

The invention belongs to the technical field of GIS equipment detection training, and particularly relates to a remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment.

Background

GIS live detection and analysis is a skill with strong specialty and high technical threshold, and the number of professionals is especially insufficient along with the enlargement of the scale of power transformation equipment and the improvement of the operation safety requirement. In order to improve the quantity and quality of professionals, the training and popularization of the live detection technology are very important.

At present, training for operation and maintenance personnel of power transformation equipment mainly comprises theoretical training, real equipment practical training, multimedia and virtual reality simulation training and the like. In the virtual reality simulation training, students carry out relevant training courses according to the training outline flow according to the work, the training mode and the training content are relatively fixed, the students lack deep understanding and learning on the GIS equipment detection technology, and the training content cannot be flexibly applied to actual operation.

Disclosure of Invention

The invention aims to solve the defects of the background technology, provides a remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment, and can greatly improve deep understanding and practical ability of students for detection and learning of GIS equipment.

The technical scheme adopted by the invention is as follows: a remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment comprises a student helmet glasses end, a student handle end, a server end, an expert helmet glasses end and an expert handle end; the server side is in interactive communication with the student helmet glasses end and the expert helmet glasses end respectively; the student helmet glasses end locally stores a high-precision virtual three-dimensional scene of GIS equipment in the same real object proportion;

loading and displaying a virtual three-dimensional scene at the glasses end of the student helmet; the student handle end receives an operation instruction of an external student and feeds back the operation instruction to the student helmet glasses end; the student helmet glasses end loads and displays the content of the operation instruction of the external student in the virtual three-dimensional scene and feeds back the operation instruction of the external student and the virtual three-dimensional scene to the server end; the server side sends the received virtual three-dimensional scene to an expert helmet glasses side;

displaying the received virtual three-dimensional scene at the glasses end of the expert helmet; the expert handle end receives an operation instruction of an external expert and feeds the operation instruction back to the expert helmet glasses end; the expert helmet glasses end loads and displays the content of the operation instruction of the external expert in the virtual three-dimensional scene and feeds back the operation instruction of the external expert to the server end;

the server side sends the content of the operation instruction of the external student to the expert helmet glasses side, and the expert helmet glasses side loads and displays the content of the operation instruction of the student expert in the virtual three-dimensional scene;

the server side sends the operation instruction content of the external expert to the student helmet glasses side, and the student helmet glasses side loads and displays the operation instruction content of the external expert in the virtual three-dimensional scene.

Among the above-mentioned technical scheme, student's handle end communicates through bluetooth and student's helmet glasses end.

Among the above-mentioned technical scheme, expert's handle end communicates through bluetooth and expert's helmet glasses end.

Among the above-mentioned technical scheme, student's helmet glasses and expert's helmet glasses carry out information real-time transport with the server through WIFI.

In the technical scheme, when the student glasses are in a WiFi-free environment, the student glasses end loads and displays the virtual three-dimensional scene information stored locally, the content of the operation instruction of the external student is stored locally, and the content of the operation instruction of the external student is uploaded to the server end after the student glasses are in the WiFi environment.

According to the technical scheme, the glasses end of the student helmet has a binocular recognition function, GIS real objects and key parts are automatically recognized, and the virtual three-dimensional scene and the real object scene are overlapped and fused.

In the technical scheme, the glasses end of the expert helmet is used for screenshot, editing and storing the virtual three-dimensional scene.

According to the technical scheme, the handle end of the student is used for providing the operating keys and the laser beams for the student, and an external student carries out GIS equipment detection training operation on a virtual three-dimensional scene through controlling the operating keys and the laser beams.

In the technical scheme, the glasses end of the expert helmet is used for receiving instruction information of an external expert, and the instruction information comprises characters, pictures and voice.

In the technical scheme, the GIS equipment real object same-proportion high-precision virtual three-dimensional scene is generated by fusing a GIS model scene and a GIS real object scene.

The invention also provides a remote collaborative training method for simulation detection operation of the extra-high voltage GIS equipment, which comprises the following steps:

a, after a student wears a student helmet glasses end and starts up, the student helmet glasses end displays a high-precision virtual three-dimensional scene which is in the same proportion with a GIS equipment real object in a space environment;

b, automatically identifying a GIS equipment real object and a key part thereof at the glasses end of the student helmet, and superposing and fusing a GIS virtual three-dimensional scene and a real object scene;

c, the student sends a control command to the helmet glasses end of the student through the handle end of the student; the student helmet glasses end generates student operation information based on the received control instruction and displays the student operation information on the fused virtual scene; the student helmet glasses end generates training data information from the whole operation process information of the student and performs local classified storage;

d, when the network environment does not exist, the training data information is only locally stored at the glasses end of the student helmet and displays the state to be transmitted, and when the network environment exists, the glasses end of the student helmet transmits the training data information to the server end in real time through a wireless network;

e, the server classifies and stores the training data information received by the student helmet glasses end, and simultaneously transmits the virtual environment information and the student operation information of the student helmet glasses end to the expert helmet glasses end in real time;

f, displaying real-time data transmitted by the expert helmet glasses end through the server end to display the virtual environment the same as that of the student and the student corresponding to the student operation information to carry out GIS equipment detection operation;

g, the expert helmet glasses end captures the virtual environment according to the control command sent by the expert operating handle end and edits the expert guidance information in the form of characters, pictures or voice, and the expert guidance information is transmitted to the server end through the wireless network and then sent to the student helmet glasses end;

and H, displaying the received expert guidance information at the glasses end of the student helmet, and carrying out corresponding detection operation by the student according to the expert guidance information.

The invention has the beneficial effects that: the helmet glasses worn by the invention perform real-time data interaction with the server, a student and an expert are placed in a virtual same-scene environment, the expert can watch the whole process information of the student for carrying out GIS equipment detection in real time, including information such as operation actions, detection sequences, training results and the like, and remotely guides the student to carry out GIS equipment detection operation training in a voice, character and image mode, the expert can remotely guide the student to carry out equipment detection training on a GIS equipment virtual model, and meanwhile, the expert accurately guides error-prone points of the student in simulation operation by watching the whole process operation information of the student in real time, and finally deep understanding and manual capability of the student for GIS equipment detection learning are improved.

Drawings

FIG. 1 is a schematic block diagram of the present invention;

FIG. 2 is a schematic diagram of module communication according to the present invention;

FIG. 3 is a schematic diagram of an embodiment of the present invention.

Detailed Description

The invention will be further described in detail with reference to the following drawings and specific examples, which are not intended to limit the invention, but are for clear understanding.

As shown in the figure, the invention provides a remote collaborative training system and method for simulation detection operation of extra-high voltage GIS equipment, which comprises a student helmet glasses end, a student handle end, a service end, an expert helmet glasses end and an expert handle end; the server side is in interactive communication with the student helmet glasses end and the expert helmet glasses end respectively; the student helmet glasses end locally stores a high-precision virtual three-dimensional scene of GIS equipment in the same real object proportion;

loading and displaying a virtual three-dimensional scene at the glasses end of the student helmet; the student handle end receives an operation instruction of an external student and feeds back the operation instruction to the student helmet glasses end; the student helmet glasses end loads and displays the content of the operation instruction of the external student in the virtual three-dimensional scene and feeds back the operation instruction of the external student and the virtual three-dimensional scene to the server end; the server side sends the received virtual three-dimensional scene to an expert helmet glasses side;

displaying the received virtual three-dimensional scene at the glasses end of the expert helmet; the expert handle end receives an operation instruction of an external expert and feeds the operation instruction back to the expert helmet glasses end; the expert helmet glasses end loads and displays the content of the operation instruction of the external expert in the virtual three-dimensional scene and feeds back the operation instruction of the external expert to the server end; the server is mainly used for classified storage, information transmission and data analysis, and assists in guiding students to carry out targeted learning operation.

The server side sends the content of the operation instruction of the external student to the expert helmet glasses side, and the expert helmet glasses side loads and displays the content of the operation instruction of the student expert in the virtual three-dimensional scene;

the server side sends the operation instruction content of the external expert to the student helmet glasses side, and the student helmet glasses side loads and displays the operation instruction content of the external expert in the virtual three-dimensional scene.

As shown in fig. 3, the present embodiment provides a system and a method for remote collaborative training of simulation test operation of extra-high voltage GIS equipment, including a student helmet glasses end, a student handle end, a service end, an expert helmet glasses end, and an expert handle end; the server is respectively in wireless electrical connection with the student helmet glasses end and the expert helmet glasses end; the student handle end is in wireless electric connection with the helmet glasses end; the glasses end of the expert helmet is in wireless electrical connection with the handle end of the expert;

the glasses end of the student helmet is integrated with a first helmet processor, a student display screen and a first communication module which are respectively and electrically connected with the first helmet processor;

the student handle end is integrated with a first handle processor, a student key and a second communication module which are respectively and electrically connected with the first handle processor; the first communication module is in wireless connection with the second communication module and the server side respectively;

the expert helmet glasses end is integrated with a second helmet processor, an expert display screen and a third communication module which are respectively and electrically connected with the second helmet processor;

the expert handle end is integrated with a second handle processor, an expert key and a fourth communication module which are respectively and electrically connected with the second handle processor; the third communication module is in wireless connection with the fourth communication module and the server side respectively.

In the technical scheme, the first helmet processor is used for locally storing the high-precision virtual three-dimensional scene of the GIS equipment in the same real object proportion; the method comprises the steps that a first helmet processor loads and synchronously displays a virtual three-dimensional scene through a student display screen; the student key is used for receiving an operation instruction of an external student, generating a control command through the first handle processor and sending the control command to the first helmet processor; the first helmet processor is used for loading the contents of the control commands of the trainee in the virtual three-dimensional scene and displaying the contents of the control commands of the trainee through the display screen of the trainee, and feeding back the virtual three-dimensional scene loaded with the control of the trainee to the server; the server is used for sending the received virtual three-dimensional scene to the expert helmet glasses end;

the second helmet processor is used for receiving the virtual three-dimensional scene and displaying the virtual three-dimensional scene through the expert display screen; the expert key is used for receiving an operation instruction of an external expert, generating a control command through the second handle processor and sending the control command to the second helmet processor; the second helmet processor is used for loading and displaying the content of the control command of the external expert in the virtual three-dimensional scene and feeding back the control command of the external expert to the server;

the server is used for sending the control command content of the external expert to the first helmet processor, and the first helmet processor loads the control command content of the external expert in the virtual three-dimensional scene and displays the control command content of the external expert through the student display screen.

In the technical scheme, the handle end of the student communicates with the glasses end of the student helmet through Bluetooth; the expert handle end communicates with the expert helmet glasses end through Bluetooth.

Among the above-mentioned technical scheme, student's helmet glasses and expert's helmet glasses carry out information real-time transport with the server through WIFI.

In the technical scheme, when the student glasses are in a WiFi-free environment, the student glasses are used for loading and displaying the virtual three-dimensional scene information stored locally, locally storing the content of the operation instruction of the external student, and uploading the content of the operation instruction of the external student to the server side after the student glasses are in the WiFi environment.

In the technical scheme, the glasses end of the student helmet is integrated with the camera, the camera is electrically connected with the first helmet processor, the camera is used for acquiring a GIS equipment real object image and sending the GIS equipment real object image to the first helmet processor, and the first helmet processor is used for automatically identifying a GIS equipment real object and key parts of the GIS equipment real object image in the received GIS equipment real object image and superposing and fusing the virtual three-dimensional scene and the real object scene.

In the technical scheme, the second helmet processor is used for carrying out screenshot, editing and storing on the virtual three-dimensional scene displayed by the expert display screen according to the operation instruction of the external expert received by the expert key.

In the technical scheme, a handle end of a student is integrated with laser equipment, and the laser equipment is electrically connected with a first helmet processor; the first helmet processor sends an operation instruction to control the laser equipment to emit laser beams according to an external student through a student key.

In the technical scheme, a microphone is integrated at the glasses end of the expert helmet and is electrically connected with the second helmet processor; an earphone is integrated on the glasses end of the student helmet and electrically connected with the first helmet processor; the microphone is used for acquiring a new voice number of an external expert and transmitting the new voice number to an earphone worn by a student through the second helmet processor and the first helmet processor.

The invention also provides a remote collaborative training method for simulation detection operation of the extra-high voltage GIS equipment, which comprises the following steps:

1. after a student wears a student helmet and starts a machine at the glasses end, a high-precision virtual three-dimensional scene which is in the same proportion with a GIS equipment real object appears in a space environment displayed by a student display screen;

2. the student helmet glasses end has a binocular recognition function, a GIS real object and key parts can be automatically recognized, and the student can superpose and fuse a GIS virtual three-dimensional scene and a real object scene through the function;

3. the student carries out GIS equipment detection training and examination operations on the fused virtual scene through a laser line on the handle end of the student, and the student sends a control command to the helmet glasses end of the student through the handle end of the student; the student helmet glasses end generates student operation information based on the received control instruction and displays the student operation information on the fused virtual scene; and the student helmet glasses end generates training data information according to the whole operation process information of the student. The student helmet glasses end can locally store the whole operation process information (student information, action information and assessment results) in a classified manner;

4. when the network environment does not exist, training data information of the trainees is only locally stored at the glasses end of the trainee helmet and displays the state to be transmitted, and the training data information can be transmitted to the server end in real time through a wireless network when the network environment exists;

5. the server side classifies and stores the training data information received by the student helmet glasses end, and simultaneously transmits the virtual environment information and the student operation information of the student helmet glasses end to the expert helmet glasses end in real time;

6. the expert helmet glasses end receives real-time data of training data information transmitted by the server end and displays virtual environment information and student operation information through the display screen, so that an expert and a student can be in the same virtual environment and watch the student to carry out GIS equipment detection operation;

7. in the same scene virtual environment, the expert helmet glasses end can capture a picture of the virtual environment, edit and form expert guidance information in the form of characters, pictures or voice, transmit the expert guidance information to the server end through a wireless network and further transmit the expert guidance information to the student helmet glasses end;

8. when a student carries out GIS equipment detection training through a virtual model in a real environment, the student can operate a handle end to carry out corresponding detection operation according to expert guidance information received by a helmet glasses end of the student.

Those not described in detail in this specification are within the skill of the art.