阅读说明：本技术 一种基于5g的远程驾驶培训平台 (Remote driving training platform based on 5G ) 是由 张燕梅 孟树兴 李晓伟 蒋代卫 于 2021-06-08 设计创作，主要内容包括：本发明涉及智慧驾驶技术领域,公开了一种基于5G的远程驾驶培训平台,平台包括：远程驾驶端,用于生成并发送远程驾驶请求指令及远程控制指令；接收并显示车辆运行状态；教练车端,用于接收远程驾驶端发送的远程驾驶请求指令及远程控制指令,基于远程驾驶请求指令及远程控制指令控制车辆行驶；云端,用于接收并转发教练车端信息至远程驾驶端及统计分析教练车端及远程驾驶端的数据；5G网络端,用于实现教练车端、远程驾驶端和云端之间的数据采集、分析与传输功能。本发明至少具有以下有益效果：实现高效智慧驾培,能够通过云端对驾驶指令和驾驶情况进行分析统计从而进一步指导驾驶培训,本发明的远程驾驶培训平台实现方案简单,培训效率高。(The invention relates to the technical field of intelligent driving, and discloses a remote driving training platform based on 5G, which comprises: the remote driving end is used for generating and sending a remote driving request instruction and a remote control instruction; receiving and displaying the running state of the vehicle; the coach vehicle end is used for receiving the remote driving request instruction and the remote control instruction sent by the remote driving end and controlling the vehicle to run based on the remote driving request instruction and the remote control instruction; the cloud end is used for receiving and forwarding the information of the coach vehicle end to the remote driving end and counting and analyzing data of the coach vehicle end and the remote driving end; and the 5G network terminal is used for realizing data acquisition, analysis and transmission functions among the coach vehicle terminal, the remote driving terminal and the cloud terminal. The invention has at least the following beneficial effects: the remote driving training platform has the advantages that efficient intelligent driving training is achieved, driving instructions and driving conditions can be analyzed and counted through the cloud, driving training is further guided, and the remote driving training platform is simple in implementation scheme and high in training efficiency.)

1. A remote driving training platform based on 5G is characterized by comprising:

the remote driving end is used for generating and sending a remote driving request instruction and a remote control instruction, and receiving and displaying the running state of the vehicle;

the training vehicle end is used for receiving the remote driving request instruction and the remote control instruction sent by the remote driving end and controlling the vehicle to run based on the remote driving request instruction and the remote control instruction;

the cloud end comprises a cloud server and is used for receiving and forwarding the coach vehicle end information to the remote driver end, receiving and forwarding the remote driver end information to the coach vehicle end, and performing statistical analysis on data of the coach vehicle end and the remote driver end;

the 5G network end, the 5G network end includes 5G network base station, control center, recognition device and guiding device, is used for realizing coach car end long-range driving end with data acquisition, analysis and transmission function between the high in the clouds.

2. The remote driving training platform based on 5G according to claim 1, wherein the remote driving end further comprises: the method comprises the steps of remotely switching driving vehicles based on driving requirements, remotely switching driving modes of the driving vehicles based on the driving requirements, and receiving and displaying video data and driving data of a coach vehicle end through the 5G network end, wherein the driving data comprises vehicle speed, gears and throttle data.

3. The remote driving training platform based on 5G according to claim 1 or 2, wherein the remote driving end further comprises: and judging whether a fault occurs in remote driving, and if the fault occurs, controlling the coach vehicle end to decelerate or stop.

4. The remote driving training platform based on 5G according to claim 3, wherein the remote driving end further comprises: and the functions of authority management and log recording.

5. The 5G-based remote driver training platform according to claim 1, wherein the generating and sending remote control instructions comprises: the remote driving end receives a steering wheel operation signal, an accelerator operation signal, a gear operation signal and a brake operation signal of the driving simulator, generates a remote control instruction, and uploads the remote control instruction to the cloud end, and the cloud end sends the remote control instruction to the coach vehicle end.

6. The remote driving training platform based on 5G according to claim 5, wherein the cloud analyzes driving data of a vehicle and operation data of the driving simulator through an artificial intelligence technology, analyzes driving operation of a remote driver, provides a correction scheme, and broadcasts the correction scheme through a voice device of the remote driving end.

7. The remote driving training platform based on 5G according to claim 5, wherein the remote driving end further comprises a 5G CPE, and the driving simulator is connected with the 5G CPE through a network interface.

8. The 5G-based remote driving training platform according to claim 1, wherein the generating and sending remote driving request instructions comprises: receiving a request instruction for logging in a remote control system, selecting a corresponding driving vehicle according to the request instruction for logging in the remote control system, generating a remote driving request instruction, uploading the remote driving request instruction to the cloud end, and sending the remote driving request instruction to the coach vehicle end through the cloud end.

9. The remote driving training platform based on 5G according to claim 1, wherein the coach vehicle end monitors the vehicle state through a positioning system, a control system and a camera; and realizing information interaction between the vehicle-mounted system and the drive test device and between the vehicle-mounted system and the cloud terminal based on the 5G network terminal.

10. The remote driving training platform based on 5G according to claim 9, wherein the vehicle-mounted system judges whether the operation during the driving of the vehicle is misoperation or operation which is not in accordance with safe driving by analyzing the driving environment, and if so, the vehicle is controlled to automatically complete braking.

Technical Field

The invention relates to the technical field of intelligent driving, in particular to a remote driving training platform based on 5G.

Background

With the rapid increase of the quantity of motor vehicles, the social demand on motor vehicle driving training is rapidly increased, the demand of coaches in driving schools is increasingly tense, and due to the fact that driving technologies of new learners are in the learning stage, different coaches have the possibility of teaching differences and potential safety hazards are prominent.

There is a remote driving device based on 5G among the prior art, including car end system and cabin end system, car end system includes car end video acquisition system and car end remote control system, and cabin end system includes cabin end video display system and cabin end remote driving control system, car end system carries out real-time network communication with cabin end system. And realizing safe driving control of the vehicle to be controlled.

The existing remote driving system or device is developed based on the safety requirement of an automatic driving automobile and is used for the safety guarantee of the remote driving of the automobile, and the difference between the safety guarantee and the driving training requirement is large. The driving training is generally a closed field scene, the vehicle of a driving school runs on a specific route, the running track is single, and the driving training aims to focus on the improvement of the driving operation skill of a student.

Disclosure of Invention

The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides a remote driving training platform based on 5G, which can realize coaching-free accompanying teaching.

According to a first aspect embodiment of the invention, the remote driving training platform based on 5G comprises: the remote driving end is used for generating and sending a remote driving request instruction and a remote control instruction, and receiving and displaying the running state of the vehicle; the training vehicle end is used for receiving the remote driving request instruction and the remote control instruction sent by the remote driving end and controlling the vehicle to run based on the remote driving request instruction and the remote control instruction; the cloud end comprises a cloud server and is used for receiving and forwarding the coach vehicle end information to the remote driver end, receiving and forwarding the remote driver end information to the coach vehicle end, and performing statistical analysis on data of the coach vehicle end and the remote driver end; the 5G network end, the 5G network end includes 5G network base station, control center, recognition device and guiding device, is used for realizing coach car end long-range driving end with data acquisition, analysis and transmission function between the high in the clouds.

According to some embodiments of the invention, the remote driving end further comprises: the method comprises the steps of remotely switching driving vehicles based on driving requirements, remotely switching driving modes of the driving vehicles based on the driving requirements, and receiving and displaying video data and driving data of a coach vehicle end through the 5G network end, wherein the driving data comprises vehicle speed, gears and throttle data.

According to some embodiments of the invention, the remote driving end further comprises: and judging whether a fault occurs in remote driving, and if the fault occurs, controlling the coach vehicle end to decelerate or stop.

According to some embodiments of the invention, the remote driving end further comprises: and the functions of authority management and log recording.

According to some embodiments of the invention, the generating and sending remote control instructions comprises: the remote driving end receives a steering wheel operation signal, an accelerator operation signal, a gear operation signal and a brake operation signal of the driving simulator, generates a remote control instruction, and uploads the remote control instruction to the cloud end, and the cloud end sends the remote control instruction to the coach vehicle end.

According to some embodiments of the invention, the cloud analyzes the driving data of the vehicle and the operation data of the driving simulator by an artificial intelligence technology, analyzes the driving operation of a remote driver, proposes a correction scheme, and broadcasts the correction scheme through a voice device of the remote driving end.

According to some embodiments of the invention, the remote driving end further comprises a 5G CPE, and the driving simulator is connected with the 5G CPE through a network interface.

According to some embodiments of the invention, the generating and sending the remote driving request instruction comprises: receiving a request instruction for logging in a remote control system, selecting a corresponding driving vehicle according to the request instruction for logging in the remote control system, generating a remote driving request instruction, uploading the remote driving request instruction to the cloud end, and sending the remote driving request instruction to the coach vehicle end through the cloud end.

According to some embodiments of the invention, the coach vehicle end monitors the vehicle state through a positioning system, a control system and a camera; and realizing information interaction between the vehicle-mounted system and the drive test device and between the vehicle-mounted system and the cloud terminal based on the 5G network terminal.

According to some embodiments of the invention, the vehicle-mounted system judges whether the operation in the running process of the vehicle is misoperation or operation which is not in accordance with safe driving by analyzing the driving environment, and if so, the vehicle is controlled to automatically complete braking.

The remote driving training platform based on 5G provided by the embodiment of the invention at least has the following beneficial effects: the technical scheme of the invention provides design and construction of the remote driving training platform, high-efficiency intelligent driving training is realized, and driving instructions and driving conditions can be analyzed and counted through a cloud terminal so as to further guide driving training.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a block diagram illustrating a platform structure according to an embodiment of the present invention.

FIG. 2 is a flow chart illustrating a method for remotely controlling a pilot in accordance with an embodiment of the present invention;

FIG. 3 is a flow chart illustrating a method of safety control according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating a method for generating and sending a control command according to an embodiment of the present invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.

It should be understood that, the sequence numbers of the steps in the embodiments of the present invention do not mean the execution sequence, and the execution sequence of each process should be determined by the function and the inherent logic of the process, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

In the description of the present invention, the meaning of a plurality of means is one or more, the meaning of a plurality of means is two or more, and more than, less than, more than, etc. are understood as excluding the present number, and more than, less than, etc. are understood as including the present number. If the first and second are described for the purpose of distinguishing technical features, they are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the precedence of the technical features indicated.

Interpretation of terms:

customer Premise Equipment (CPE), namely mobile signal access Equipment for receiving mobile signals and forwarding the mobile signals by wireless WIFI signals, and Equipment for converting high-speed 4G or 5G signals into WiFi signals.

According to the invention, the requirements of vehicle data acquisition, analysis and transmission are met by setting a 5G network base station, a control center, a ground identification and guide facility and the like in a driving training field.

Through the control system (including electronic system) to traditional learner-driven vehicle repacking upgrading, through induction system like radar, camera, sensor, high-accuracy map, voice interaction system etc. the vehicle can accomplish subject teaching function, operates the explanation to the student, and the student is when the operation simultaneously, and on-vehicle system carries out the analysis to the surrounding environment, if after the maloperation appears or surpass safe driving action, the automatic braking of accomplishing of vehicle, avoids because of the place accident that the maloperation leads to.

The operation images of the trainees and the vehicle information are transmitted to the cloud platform in real time through the 5G network, the artificial intelligence technology is combined, whether the driving track of the trainees operating the instructional car is correct or not is intelligently analyzed and judged, the driving behaviors of the trainees are timely corrected through language broadcasting, and efficient unmanned intelligent driving training is achieved.

The remote driving teaching system realizes remote driving teaching work through the vehicle, the remote driving terminal and the 5G network.

Referring to fig. 1, fig. 1 is a block diagram of a platform structure according to an embodiment of the present invention, including:

the remote driving end is used for generating and sending a remote driving request instruction and a remote control instruction; the vehicle running state is received and displayed, and the remote driving end comprises the following functions: the remote control system has the functions of requesting remote driving, generating a remote control instruction, sending the remote control instruction, receiving and displaying the vehicle state, switching the remote control vehicle, switching the driving mode, managing logs and managing personnel authority;

the train end, the train end is used for receiving remote driving request instruction and the remote control instruction that remote driving end sent, and the vehicle is controlled to travel based on remote driving request instruction and remote control instruction, and the train end includes following function: the system comprises a driving mode switching function, a remote driving function, a vehicle state feedback function, a real-time video feedback function, an active safety control function and a log management function;

the cloud end comprises a cloud server and has the functions of receiving and forwarding coach vehicle end information to the remote driving end, receiving and forwarding the remote driving end information to the coach vehicle end and counting and analyzing data of the coach vehicle end and the remote driving end, and the cloud end can receive vehicle information, forward the vehicle information, receive remote control end information, forward the remote control end information, display the vehicle state and position, count and analyze data, monitor the operation state and manage logs;

and the 5G network end comprises a 5G network base station, a control center, an identification device and a guiding device and is used for realizing the functions of data acquisition, analysis and transmission among the coach vehicle end, the remote driving end and the cloud end.

Fig. 2 shows a flow chart of a method for remotely controlling a driving end according to an embodiment of the present invention, which includes: the remote driving end is used for generating and sending a remote driving request instruction and a remote control instruction, remotely switching driving vehicles based on driving requirements, remotely switching driving modes of the driving vehicles based on the driving requirements, and receiving and displaying video data and driving data of the coach vehicle end through the 5G network end, wherein the driving data comprises vehicle speed, gears and accelerator data. Specifically, log on remote control system, send the remote control request after selecting the remote controlled vehicle, the navigating mate can switch different remote controlled vehicles according to the demand, remote control system passes through the high in the clouds service platform and receives the state information of controlled vehicle such as speed of a motor vehicle, gear, throttle etc. and show on the remote control display, the remote driving end passes through 5G communication, the video data that the receiving vehicle end uploaded shows, can switch the remote driving mode to manual driving mode after remote driving finishes.

Referring to fig. 3, fig. 3 is a schematic flow chart of a safety control method according to an embodiment of the present invention, including: whether a fault occurs in remote driving is judged, if the fault occurs, the coach vehicle end is controlled to decelerate or stop, and specifically, when the fault occurs in remote driving, collision can be avoided through modes of decelerating, stopping and the like.

In some specific embodiments of the present invention, the remote driving end further includes: and the authority management and log recording function can set the authority of the operator and record the related operation log.

Fig. 4 is a flowchart illustrating a method for generating and sending a control command according to an embodiment of the present invention, where as shown in the figure, generating and sending a remote control command includes: the steering wheel operating signal of driving simulator is received to long-range driver end, throttle operating signal, gear operating signal and braking operating signal, generate the remote control instruction, and upload the remote control instruction to the high in the clouds, send the remote control instruction to the coach car end through the high in the clouds, it is specific, the driver is to the steering wheel of field end driving simulator, the throttle, the gear, the braking is operated, generate control instruction, upload the remote control instruction to the high in the clouds through 5G CPE, the high in the clouds sends the remote control instruction to the coach car end through the 5G network, the coach car end is according to the vehicle of remote control instruction control and is gone.

In some specific embodiments of the invention, the cloud analyzes the driving data of the vehicle and the operation data of the driving simulator through an artificial intelligence technology to analyze the driving operation of the remote driver and provide a correction scheme, and simultaneously broadcasts the correction scheme through a voice device of the remote driving end, specifically, different software and hardware systems such as a V2X system, a whole vehicle control system, a video monitoring system and the like are integrated through a 5G network to form a set of mutually-related, unified and coordinated systems, and the operation behavior of the student is analyzed through the vehicle state and the driving simulator to provide the correction scheme and is issued to the student through voice broadcast.

In some embodiments of the present invention, the remote driving end further includes a 5G CPE, the driving simulator is connected to the 5G CPE through a network interface, and specifically, the matching between the simulator and the remote vehicle is realized through the modification of the driving simulator and the development of a software algorithm; the driving simulator is connected with the 5G CPE through a network interface to realize the issuing of a remote driving instruction; the 5G CPE receives vehicle data and camera data from the vehicle-mounted end and displays the data on a display screen.

In some embodiments of the invention, the generating and sending the remote driving request instruction comprises receiving a request instruction for logging in a remote control system, selecting to drive a vehicle and generating a remote driving request instruction according to the instruction request for logging in the remote control system, uploading the remote driving request instruction to a cloud end, and sending the remote driving request instruction to a coach vehicle end through the cloud end.

In some embodiments of the invention, the coach vehicle end monitors the vehicle state through the positioning system, the control system and the camera; realize the information interaction of on-vehicle system and drive-by-wire device and high in the clouds based on 5G network side, it is specific, the learner-driven vehicle realizes control through transforming steer-by-wire, brake-by-wire and drive-by-wire, wherein, equipment such as vehicle installation positioning system, control system, camera realize vehicle state monitoring, communication equipment such as vehicle installation OBU carries out information interaction through 5G with the roadside and high in the clouds.

In some embodiments of the invention, the vehicle-mounted system judges whether the operation in the running process of the vehicle is misoperation or operation which is not in accordance with safe driving based on the analysis of the driving environment, and if so, the vehicle is controlled to automatically complete braking.

The remote driving training platform comprises a learner-driven vehicle, a remote driving instrument, a network and the like. The construction of the vehicle can be directly solved by purchasing a mature new energy vehicle with the wire control. The remote pilot can be realized by purchasing the products of mature suppliers, the network environment is realized by building a 5G environment through an operator, and the normal work of the whole system is realized through the integration and debugging of software and hardware systems.

The invention can realize the coaching teaching without coaches, the trainee can finish the training subjects according to the voice prompt, and the intelligent driving training system controls and ensures the safety of the vehicle, thereby realizing the remote intelligent driving training work of the coaches.

Although specific embodiments have been described herein, those of ordinary skill in the art will recognize that many other modifications or alternative embodiments are equally within the scope of this disclosure. For example, any of the functions and/or processing capabilities described in connection with a particular device or component may be performed by any other device or component. In addition, while various illustrative implementations and architectures have been described in accordance with embodiments of the present disclosure, those of ordinary skill in the art will recognize that many other modifications of the illustrative implementations and architectures herein are also within the scope of the present disclosure.

Certain aspects of the present disclosure are described above with reference to block diagrams and flowchart illustrations of systems, methods, systems, and/or computer program products according to example embodiments. It will be understood that one or more blocks of the block diagrams and flowchart illustrations, and combinations of blocks in the block diagrams and flowchart illustrations, respectively, can be implemented by executing computer-executable program instructions. Also, according to some embodiments, some blocks of the block diagrams and flow diagrams may not necessarily be performed in the order shown, or may not necessarily be performed in their entirety. In addition, additional components and/or operations beyond those shown in the block diagrams and flow diagrams may be present in certain embodiments.

Accordingly, blocks of the block diagrams and flowchart illustrations support combinations of means for performing the specified functions, combinations of elements or steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the block diagrams and flowchart illustrations, and combinations of blocks in the block diagrams and flowchart illustrations, can be implemented by special purpose hardware-based computer systems that perform the specified functions, elements or steps, or combinations of special purpose hardware and computer instructions.

The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the gist of the present invention.