阅读说明：本技术 一种基于可穿戴ar设备的轨道交通智能检修系统和方法 (Intelligent rail transit maintenance system and method based on wearable AR equipment ) 是由 胡明伟 赵千 何国庆 于 2021-07-22 设计创作，主要内容包括：本发明公开一种基于可穿戴AR设备的轨道交通智能检修系统和方法,包括：可穿戴式AR眼镜智能终端,用于采集检修设备的视频图像数据和音频数据；后台分析系统,用于将所述视频图像数据、音频数据与预存车辆信息模型库进行比对,以根据对比结果对检修操作关键流程进行卡口控制。采用本发明的技术方案,促使其严格按流程执行车辆检修作业,并对关键作业步骤进行卡控,同时实现现场维修人员与后方管理人员的音视频实时交互,达到远程作业指导和协助。(The invention discloses a system and a method for intelligent track traffic maintenance based on wearable AR equipment, which comprises the following steps: the wearable AR glasses intelligent terminal is used for acquiring video image data and audio data of the maintenance equipment; and the background analysis system is used for comparing the video image data and the audio data with a prestored vehicle information model base so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result. By adopting the technical scheme of the invention, the vehicle maintenance operation is strictly executed according to the flow, the key operation steps are controlled by the card, and the real-time audio and video interaction between field maintenance personnel and rear management personnel is realized, so that the remote operation guidance and assistance are achieved.)

1. The utility model provides a track traffic intelligence maintenance system based on wearable AR equipment which characterized in that includes:

the wearable AR glasses intelligent terminal is used for acquiring video image data and audio data of the maintenance equipment;

and the background analysis system is used for comparing the video image data and the audio data with a prestored vehicle information model base so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result.

2. The wearable AR device-based rail transit intelligent maintenance system of claim 1, wherein the wearable AR glasses smart terminal comprises: the intelligent voice call system comprises a high-definition camera, a voice call device, an intelligent adjusting lens, an intelligent control device, a two-way communication device and a power supply; the intelligent control device is respectively connected with the high-definition camera, the voice communication device, the intelligent adjusting lens, the two-way communication device and the power supply.

3. The intelligent track traffic maintenance system based on wearable AR equipment as claimed in claim 1, wherein said camera is used for collecting video image data of maintenance equipment, and comprises a camera fixed on AR glasses and a detachable external camera, and said detachable external camera is used for endoscopic detection on the bottom of a train or the inside of equipment difficult to access by limbs.

4. The wearable AR device based rail transit intelligent maintenance system of claim 1, wherein the voice communicator comprises a microphone, an earphone and a loud speaker, the voice communicator is used for realizing real-time voice interaction of a maintenance person with a background manager or technician or voice interaction with a background computer.

5. The intelligent wearable AR device-based rail transit maintenance system of claim 1, wherein the intelligent adjusting lens is configured to present an interactive interface and adjust the imaging resolution according to ambient lighting intensity.

6. The intelligent maintenance system for rail transit based on wearable AR equipment as claimed in claim 1, wherein the intelligent control device is used for providing control and operation of the high definition camera, the voice communication device and the intelligent adjusting lens, and providing power supply for the high definition camera, the voice communication device and the intelligent adjusting lens.

7. The intelligent maintenance system for rail transit based on wearable AR device as claimed in claim 1, wherein the two-way communication device is a cellular wireless communication device or a WiFi device.

8. The wearable AR device-based rail transit intelligent maintenance system of claim 1, wherein the background analysis system further comprises: the cloud server database is used for storing video image data and audio data sent by the wearable AR glasses intelligent terminal.

9. A rail transit intelligent maintenance method based on wearable AR equipment is characterized by comprising the following steps:

collecting video image data and audio data of maintenance equipment;

and comparing the video image data and the audio data with a prestored vehicle information model library so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result.

10. The intelligent rail transit overhaul method based on the wearable AR device as claimed in claim 1, further comprising: and storing the video image data and the audio data sent by the wearable AR glasses intelligent terminal.

Technical Field

The invention belongs to the field of intelligent operation and maintenance of rail transit, and particularly relates to an intelligent rail transit maintenance system and method based on wearable AR equipment.

Background

At present, urban rail transit and intercity rail transit in China have the advantages of fast increase of operation mileage, heavy operation and maintenance tasks, vehicle maintenance is one of main means for guaranteeing the operation safety of a rail transit system, and maintenance needs to guarantee the standard, accurate and efficient operation flow and the safety of operators. But train maintenance faces the dilemma of short window period, heavy operation task, fine and specialized division of labor, strong specialization, lack of skilled maintainers and the like. Along with the continuous promotion of rail transit system automation, synthesis, intelligent degree, it also receives more and more concern to promote vehicle maintenance safety and efficiency, and it is the important measure that improves maintenance management level, promotes the operating efficiency, guarantees train safe operation to strengthen maintenance operation flow standardization, visualization, paperless.

In the rail transit industry, a maintenance operation of vehicle equipment usually depends on two or more maintenance personnel to go to on-site maintenance equipment (the A corner undertakes the main maintenance task, and the B corner is responsible for checking, monitoring and recording), and the maintenance personnel judge whether a fault occurs and whether maintenance is needed according to an operation manual and experience, and then the maintenance operation is carried out and the equipment fault and maintenance operation information are recorded. And the rear rail transit manager communicates with the on-site maintenance personnel through remote voice communication, so that remote guidance is provided and the maintenance condition of on-site train equipment is mastered. However, the existing maintenance operation has the disadvantages of long time consumption, high execution cost, high manual investment, high labor intensity, poor real-time interactivity and the like, and particularly, in the maintenance process, the maintenance operation is limited by an operation field and an equipment space, part of the maintenance operation can only be completed by one-man operation, the cooperation of multiple persons is difficult to realize, a rear manager cannot master the operation progress and monitor the operation quality of the front maintainer, and the defects of missed inspection, quality failure to reach the standard or personnel injury and the like are easily caused due to heavy maintenance tasks.

Disclosure of Invention

The invention aims to solve the technical problem of providing an intelligent track traffic maintenance system and method based on wearable AR equipment to solve the problem.

In order to achieve the purpose, the invention adopts the following technical scheme:

a track traffic intelligent maintenance system based on wearable AR equipment includes:

the wearable AR glasses intelligent terminal is used for acquiring video image data and audio data of the maintenance equipment;

and the background analysis system is used for comparing the video image data and the audio data with a prestored vehicle information model base so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result.

Preferably, the wearable AR glasses smart terminal includes: the intelligent voice call system comprises a high-definition camera, a voice call device, an intelligent adjusting lens, an intelligent control device, a two-way communication device and a power supply; the intelligent control device is respectively connected with the high-definition camera, the voice communication device, the intelligent adjusting lens, the two-way communication device and the power supply.

Preferably, the camera is used for collecting video image data of the maintenance equipment, and comprises a camera fixedly connected to the AR glasses and a detachable external camera, the detachable external camera is used for carrying out endoscopic detection on the bottom of the train or the interior of the equipment, the limbs of which are difficult to approach, and the collected data of the detachable external camera is wirelessly transmitted to the intelligent control device.

Preferably, the voice communicator comprises a microphone, an earphone and a loudspeaker, and is used for realizing real-time voice interaction between a service person and a background manager or a technician or voice interaction between the service person and a background computer.

Preferably, the intelligent adjusting lens is used for presenting an interactive interface, and the imaging definition can be adjusted according to the intensity of external illumination.

Preferably, the intelligent control device is used for providing control and operation of the high-definition camera, the voice call device and the intelligent adjusting lens, and providing power supply for the high-definition camera, the voice call device and the intelligent adjusting lens.

Preferably, the two-way communication device is a cellular wireless communication device or a WiFi device.

Preferably, the background analysis system further includes: the cloud server database is used for storing video image data and audio data sent by the wearable AR glasses intelligent terminal.

A rail transit intelligent maintenance method based on wearable AR equipment comprises the following steps:

collecting video image data and audio data of maintenance equipment;

and comparing the video image data and the audio data with a prestored vehicle information model library so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result.

Preferably, the method further comprises the following steps: and storing the video image data and the audio data sent by the wearable AR glasses intelligent terminal.

The intelligent rail transit maintenance system and method based on the wearable AR equipment have the following characteristics: firstly, based on a first visual angle of a maintainer, real-time audio and video interaction between a field maintainer and a rear manager is realized, and remote operation guidance and assistance are achieved; secondly, the standardization and the operation quality of the operation flow are improved, the characters and pictures of the operation steps are projected to the eyes of an operator, the operator is prompted to strictly execute vehicle maintenance operation according to the flow, and the key operation steps are controlled in a clamping mode; and thirdly, recording marks in the storage and operation process by the cloud in the operation process so as to be ready for tracing the operation process and the quality.

Drawings

FIG. 1 is a schematic structural diagram of a track traffic intelligent maintenance system based on a wearable AR device according to the present invention;

FIG. 2 is a schematic data interaction diagram of the intelligent track traffic maintenance system based on the wearable AR device according to the present invention;

FIG. 3 is a schematic structural diagram of a wearable AR glasses intelligent terminal according to the present invention;

fig. 4 is a flowchart of the intelligent track traffic maintenance method based on the wearable AR device according to the present invention.

Detailed Description

For better illustration of the invention, the invention will be further described with reference to the accompanying drawings and the implementation process.

As shown in fig. 1 and 2, the invention provides a track traffic intelligent maintenance system based on wearable AR device, comprising: the system comprises a wearable AR glasses intelligent terminal and a background analysis system; the background analysis system and the wearable AR glasses intelligent terminal realize bidirectional interaction, which comprises voice interaction, image interaction, early warning prompt and operation monitoring, wherein,

the wearable AR glasses intelligent terminal is used for acquiring video image data and audio data of the maintenance equipment;

and the background analysis system is used for comparing the video image data and the audio data with a prestored vehicle information model base so as to carry out bayonet control on the key process of the maintenance operation according to the comparison result.

Further, as shown in fig. 3, the wearable AR glasses smart terminal includes: the intelligent voice call system comprises a high-definition camera, a voice call device, an intelligent adjusting lens, an intelligent control device, a two-way communication device and a power supply; the intelligent control device is respectively connected with the high-definition camera, the voice communication device, the intelligent adjusting lens, the two-way communication device and the power supply.

Further, the camera is used for gathering the video image data of overhauing equipment, including camera and detachable external camera of rigid coupling on AR glasses, detachable external camera is used for peeping the detection to train bottom or the inside equipment that the limbs are difficult to be close, and its data collection wireless transmission reaches intelligent control device.

Further, the voice communication device comprises a microphone, an earphone and an external loudspeaker, and the voice communication device is used for realizing real-time voice interaction between a maintainer and a background manager or a technician or voice interaction with a background computer.

Furthermore, the intelligent adjusting lens is used for presenting an interactive interface and adjusting the imaging definition according to the external illumination intensity. The interactive interface displays the maintenance operation steps, and a user can control the actions of the interactive interface such as up/down item, up/down page, zoom in/zoom out, confirm/reject/ignore through voice. The result of the background analysis system is displayed on the lens of the wearable AR glasses intelligent terminal in the form of images and the like, remote guidance is provided when the overhaul personnel encounter overhaul problems, and an alarm prompt is given when the operation of the overhaul personnel makes mistakes.

Furthermore, the intelligent control device is used for providing control and operation of the high-definition camera, the voice communication device and the intelligent adjusting lens, and providing power supply for the high-definition camera, the voice communication device and the intelligent adjusting lens.

Further, the two-way communication device is a cellular wireless communication device or a WiFi device.

Further, the background analysis system further comprises: the cloud server database is used for storing video image data and audio data sent by the wearable AR glasses intelligent terminal.

The specific implementation process of the intelligent track traffic maintenance system based on the wearable AR equipment comprises the following steps:

1. and dispatching the task to a specific maintainer through the background system, after receiving the maintenance task, the maintainer performs task preparation before maintenance according to the corresponding maintenance task and submits a corresponding maintenance operation authorization declaration in the vehicle section control center.

2. A maintainer wears an AR glasses intelligent terminal to arrive at a maintenance workshop, and the intelligent terminal can display maintenance task conditions, maintenance process steps and maintenance instrument positions;

3. selecting safety protection equipment to be checked on the intelligent terminal, checking whether protective clothing, insulating gloves, safety helmets and the like are intact or not, and correctly wearing the protective clothing, the insulating gloves, the safety helmets and the like;

4. after the safety protection equipment is worn, the intelligent terminal confirms the safety protection equipment and starts formal maintenance work;

5. carrying out maintenance work according to the task step prompt on the intelligent mobile terminal; data acquisition is carried out on the maintenance equipment and the control instrument through camera image recognition, video information and image information are transmitted back to a background analysis system, diagnosis and analysis are given in real time, and maintenance steps are transmitted back to the intelligent lens of the AR glasses for display;

6. remote monitoring is established through the AR glasses intelligent terminal and the background analysis system, voice and video information of a first visual angle of a maintainer is transmitted back in real time, and a specialist and a manager can conveniently assist and supervise remotely;

7. the background analysis system diagnoses the instrument index monitored in real time and the identified image, and if the diagnosis result is a fault, early warning information is sent out and can be synchronized to the AR glasses intelligent terminal;

8. video, voice and operation decision of the overhaul process of the maintainer can be stored in the background in real time, and the maintainer can conveniently look up and call the video, the voice and the operation decision in an irregular mode.

As shown in fig. 4, the present invention further provides a wearable AR device-based track traffic intelligent maintenance method, which includes the following steps:

s1, collecting video image data and audio data of the overhaul equipment;

and step S2, comparing the video image data and the audio data with a prestored vehicle information model base so as to carry out bayonet control on the key process of the overhaul operation according to the comparison result.

Further, still include: and storing the video image data and the audio data sent by the wearable AR glasses intelligent terminal.

The invention has the beneficial effects that:

1) can realize the high-efficient full flow collection of maintenance operation real-time information based on the first visual angle of rail transit vehicle maintainer, the information includes: video, image, audio, location, and personnel identity information.

2) The method provides the whole-process operation history inquiry and backtracking trace of each operator, and is favorable for solving the dispute of the overhaul quality and demonstrating and training the overhaul process.

3) The system can realize real-time monitoring of fixed point operation and mobile maintenance operation by background managers, overcomes the defects that the fixed camera is not completely covered, cannot approach a part to be maintained and has a blind area, enables the managers not to reach the site, can efficiently master and guide the site maintenance, and reduces the probability of injury and danger of the maintainers;

4) the key operation steps are controlled in a clamping mode through presetting the optional operation steps and an artificial intelligent image recognition algorithm, and if the overhaul personnel operate improperly or damage AR glasses, the alarm to the background personnel can be triggered.

5) Through voice and image real-time interaction, multi-person remote cooperative operation can be realized, advanced technicians can remotely guide complex, highly professional and dangerous operation, and the system gives an alarm for error operation, so that the overhauling efficiency and the overhauling accuracy are effectively improved.

6) When the operation is finished, the current operation summary can be provided for field maintainers, and operation statistical analysis reports can be provided for background managers according to different statistical calibers (designated time, designated operation flow and designated operator).

The invention discloses an intelligent maintenance system and method for rail transit based on wearable AR equipment, which applies AR technology to maintenance work of rail transit vehicle sections, and aims to assist field operation and improve operation efficiency, quality and safety. The two hands of the maintainer are liberated, the maintainer is guided to complete complex and high-strength operation at a first visual angle, and the maintainer does not need to remember operation key points and complex steps; the method has the advantages that the information is remotely shared and interacted with a manager in the maintenance process of the rail transit equipment, the key operation steps are controlled in a clamping mode, meanwhile, an alarm prompt is given when the maintenance personnel make mistakes in operation and the equipment is abnormal, the maintenance personnel are helped to solve difficulties in the maintenance process, and the maintenance task is completed safely and efficiently; and storing the operation records at the cloud end, and providing a statistical analysis report for a manager.

The above list is merely illustrative of the present invention and should not be construed as limiting the scope of the present invention, and all designs identical or similar to the present invention are within the scope of the present invention.