Method for managing unmanned vehicle based on mobile human-computer interaction equipment

文档序号:303618 发布日期:2021-11-26 浏览:4次 中文

阅读说明:本技术 一种基于移动人机交互设备管理无人驾驶车辆的方法 (Method for managing unmanned vehicle based on mobile human-computer interaction equipment ) 是由 尹伟 徐逸文 于 2021-08-31 设计创作,主要内容包括:本发明实施例涉及一种基于移动人机交互设备管理无人驾驶车辆的方法,所述方法包括:移动人机交互设备从第一数据接收端口接收第一接收数据;根据第一数据接收端口,对第一接收数据进行类型划分;当第一数据接收端口为预设的用户输入端口时,将第一接收数据作为第一管理指令数据,并根据第一管理指令数据进行对应的无人驾驶车辆常规管理;当第一数据接收端口为预设的车辆报警端口时,将第一接收数据作为第一车辆故障级别数据,并根据第一车辆故障级别数据进行对应的无人驾驶车辆应急管理。通过本发明,既能解决对多个无人驾驶车辆的常规化管理问题,又能对发生紧急情况的无人驾驶车辆进行及时的应急处理。(The embodiment of the invention relates to a method for managing an unmanned vehicle based on mobile human-computer interaction equipment, which comprises the following steps: the mobile man-machine interaction equipment receives first receiving data from a first data receiving port; according to the first data receiving port, performing type division on the first received data; when the first data receiving port is a preset user input port, the first received data are used as first management instruction data, and corresponding unmanned vehicle conventional management is carried out according to the first management instruction data; and when the first data receiving port is a preset vehicle alarm port, taking the first received data as first vehicle fault level data, and performing corresponding unmanned vehicle emergency management according to the first vehicle fault level data. The invention can solve the problem of conventional management of a plurality of unmanned vehicles and can carry out timely emergency treatment on the unmanned vehicles in emergency.)

1. A method for managing an unmanned vehicle based on a mobile human-computer interaction device, the method comprising:

the mobile man-machine interaction equipment receives first receiving data from a first data receiving port;

according to the first data receiving port, performing type division on the first received data; when the first data receiving port is a preset user input port, taking the first received data as first management instruction data, and performing corresponding conventional management on the unmanned vehicle according to the first management instruction data; and when the first data receiving port is a preset vehicle alarm port, taking the first received data as first vehicle fault level data, and performing corresponding unmanned vehicle emergency management according to the first vehicle fault level data.

2. The method for managing the unmanned vehicle based on the mobile human-computer interaction device according to claim 1, wherein the performing of the corresponding routine management of the unmanned vehicle according to the first management instruction data specifically comprises:

when first instruction head data of the first management instruction data are first instruction codes, extracting a first vehicle identification data set from first instruction body data of the first management instruction data; carrying out one-key starting processing on the unmanned vehicle according to the first vehicle identification data set; the first set of vehicle identification data comprises a plurality of first vehicle identification data;

when the first instruction head data is a second instruction code, extracting a first equipment data group set from the first instruction volume data; self-checking the unmanned vehicle equipment according to the first equipment data group set; the first set of device datasets includes a plurality of first device datasets; the first device data group includes second vehicle identification data and first device identification data;

when the first instruction head data is a third instruction code, extracting a first upgrading data group set from the first instruction volume data; carrying out remote upgrading processing on the unmanned vehicle according to the first upgrading data set; the first set of upgrade data sets comprises a plurality of first upgrade data sets; the first upgrade data group comprises third vehicle identification data, first upgrade module identification data and a first upgrade data packet;

when the first instruction head data is a fourth instruction code, a first user data group set is obtained from local; uploading user behavior data according to the first user data group set; a plurality of first user data groups comprised by the first set of user data groups; the first user data group comprises first user identification data and a first user historical behavior data set; the first set of user historical behavior data comprises a plurality of first user historical behavior data; the first user historical behavior data comprises first operation time information, first operation instruction information and first operation instruction feedback information;

when the first instruction head data is a fifth instruction code, extracting a first control instruction group set from the first instruction volume data; carrying out remote control processing on the unmanned vehicle according to the first control instruction set; the first set of control instruction sets comprises a plurality of first control instruction sets; the first control instruction group comprises fourth vehicle identification data and first control instruction data; the first control instruction data comprise an automatic driving control entering instruction, an automatic driving control exiting instruction, a lane changing control instruction, a camera opening control instruction, a camera closing control instruction and a remote assistance requesting control instruction;

when the first instruction head data is a sixth instruction code, extracting a first monitoring data group set from the first instruction volume data; carrying out remote monitoring processing on the unmanned vehicle according to the first monitoring data group set; the first monitoring dataset set comprises a plurality of first monitoring datasets; the first monitoring data set includes fifth vehicle identification data and a plurality of first monitoring identification data; the first monitoring identification data comprises first hard disk identification data, first network identification data and first memory identification data.

3. The method for managing an unmanned vehicle based on a mobile human-computer interaction device according to claim 2, wherein the performing the one-touch start processing on the unmanned vehicle according to the first vehicle identification data set specifically comprises:

sending one-key starting instruction data to a first unmanned vehicle corresponding to each first vehicle identification data of the first vehicle identification data set through a wireless network;

receiving first command feedback data sent back from each of the first unmanned vehicles;

if the first instruction feedback data is successful in execution, performing one-key starting instruction execution success information display processing according to the corresponding first vehicle identification data;

and if the first instruction feedback data is not successful in execution, performing one-key starting instruction execution failure information display processing according to the corresponding first vehicle identification data and the corresponding first instruction feedback data.

4. The method for managing the unmanned vehicle based on the mobile human-computer interaction device according to claim 2, wherein the performing the self-inspection of the unmanned vehicle device according to the first device data group set specifically comprises:

sending device self-check instruction data carrying the first device identification data to a second unmanned vehicle corresponding to the second vehicle identification data of each first device data group of the first device data group set through a wireless network;

receiving second command feedback data sent back from each of the second unmanned vehicles;

if the second instruction feedback data is successfully executed, displaying equipment self-checking instruction execution success information according to the corresponding first equipment data group;

and if the second instruction feedback data is not successful in execution, performing equipment self-checking instruction execution failure information display processing according to the corresponding first equipment data group and the second instruction feedback data.

5. The method for managing an unmanned vehicle based on mobile human-computer interaction equipment according to claim 2, wherein the performing of the unmanned vehicle remote upgrade processing according to the first upgrade data set specifically comprises:

sending remote upgrade instruction data carrying the first upgrade module identification data and the first upgrade data packet to a third unmanned vehicle corresponding to the third vehicle identification data of each first upgrade data group of the first upgrade data group set through a wireless network;

receiving third command feedback data sent back from each of the third unmanned vehicles;

if the third instruction feedback data is successfully executed, displaying and processing the information of successful execution of the remote upgrading instruction according to the corresponding third vehicle identification data and the first upgrading module identification data;

and if the third instruction feedback data is not successfully executed, performing remote upgrading instruction execution failure information display processing according to the corresponding third vehicle identification data, the first upgrading module identification data and the third instruction feedback data.

6. The method for managing an unmanned vehicle based on mobile human-computer interaction equipment according to claim 2, wherein the uploading of user behavior data according to the first user data group set specifically comprises:

acquiring a first cloud platform data interface from the local;

sending user behavior data uploading instruction data carrying the first user data group set to the first cloud platform data interface through a wireless network;

receiving fourth instruction feedback data sent back from the first cloud platform data interface;

if the fourth instruction feedback data is successfully executed, displaying and processing user behavior data uploading instruction execution success information according to the first cloud platform data interface;

and if the fourth instruction feedback data is not successfully executed, displaying and processing user behavior data uploading instruction execution failure information according to the first cloud platform data interface and the fourth instruction feedback data.

7. The method for managing an unmanned vehicle based on mobile human-computer interaction equipment according to claim 2, wherein the performing of the unmanned vehicle remote control processing according to the first control instruction set specifically comprises:

sending remote control instruction data carrying the first control instruction data to a fourth unmanned vehicle corresponding to the fourth vehicle identification data of each first control instruction group of the first control instruction group set through a wireless network;

receiving fifth instructional feedback data sent back from each of the fourth unmanned vehicles;

if the fifth instruction feedback data is successfully executed, performing remote control instruction execution success information display processing according to the corresponding fourth vehicle identification data and the corresponding first control instruction data;

and if the fifth instruction feedback data is not successfully executed, performing remote control instruction execution failure information display processing according to the corresponding fourth vehicle identification data, the first control instruction data and the fifth instruction feedback data.

8. The method for managing an unmanned vehicle based on mobile human-computer interaction equipment according to claim 2, wherein the performing of the unmanned vehicle remote monitoring processing according to the first monitoring data group set specifically comprises:

sending remote monitoring instruction data carrying the plurality of first monitoring identification data to a fifth unmanned vehicle corresponding to the fifth vehicle identification data of each first monitoring data group set of the first monitoring data group sets through a wireless network;

receiving sixth command feedback data sent back from each of the fifth unmanned vehicles;

if the sixth instruction feedback data is successfully executed, performing remote monitoring instruction execution success information display processing according to the corresponding fifth vehicle identification data and the plurality of first monitoring identification data; after the remote monitoring instruction executes successful information display processing, receiving a first vehicle monitoring data set sent back by the fifth unmanned vehicle at specified time intervals; analyzing each first vehicle monitoring data in the first vehicle monitoring data set to obtain corresponding health degree data, and if the health degree data exceeds a corresponding preset alarm threshold value, performing corresponding monitoring data acousto-optic alarm processing according to the health degree data;

and if the sixth instruction feedback data is not successfully executed, performing remote monitoring instruction execution failure information display processing according to the corresponding fifth vehicle identification data, the plurality of first monitoring identification data and the sixth instruction feedback data.

9. The method for managing the unmanned vehicle based on the mobile human-computer interaction device according to claim 1, wherein the performing of the corresponding unmanned vehicle emergency management according to the first vehicle fault level data specifically comprises:

extracting sixth vehicle identification data, first vehicle position data and first fault level data from the first vehicle fault level data; the first fault level data comprises a first level, a second level, and a third level; the fault levels corresponding to the first level, the second level to the third level are sequentially increased;

when the first fault level data is of a first level, acquiring a second cloud platform data interface from the local, and sending the first vehicle fault level data to the second cloud platform data interface through a wireless network;

when the first fault level data is in a second level, remotely calling a sixth unmanned vehicle corresponding to the sixth vehicle identification data through a wireless network to perform vehicle local fault acousto-optic alarm processing; remotely calling a sensor of the sixth unmanned vehicle to obtain environmental information around the vehicle, analyzing the environmental information around the vehicle to generate a corresponding first analysis conclusion, performing corresponding passenger prompt information conversion processing according to the first analysis conclusion in a preset passenger prompt mode to generate corresponding first passenger prompt information, and performing corresponding information display processing on the first passenger prompt information; sending corresponding alarm information to a preset external linkage alarm port; the passenger prompt mode comprises a text prompt, a voice prompt and a text and voice prompt; the external linkage alarm ports at least comprise a 110 alarm port, a 119 alarm port and a 120 alarm port;

when the first fault level data is a third level, remotely calling the sixth unmanned vehicle through a wireless network to start a local emergency power supply of the vehicle; calling a camera of the sixth unmanned vehicle to perform environment shooting processing to generate a plurality of first image data; performing disaster identification processing on each first image data to generate corresponding first disaster state data; if the first disaster condition data is not in a non-disaster condition state, remotely calling the sixth unmanned vehicle to perform corresponding vehicle local disaster avoidance emergency treatment; sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction device users with the distance to the first vehicle position data within a preset first distance range, and if the number of the other unmanned vehicles or the number of the mobile man-machine interaction device users within the first distance range is lower than the preset first user number, sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction device users with the distance to the first vehicle position data within a preset second distance range; the first disaster condition data at least comprises a non-disaster condition state and a disaster condition state, wherein the disaster condition state comprises a flood condition state, a fire condition state, a debris flow state, a mountain landslide state and a traffic accident state; the second distance range is greater than the first distance range.

10. An electronic device, comprising: a memory, a processor, and a transceiver;

the processor is used for being coupled with the memory, reading and executing the instructions in the memory to realize the method steps of any one of claims 1-9;

the transceiver is coupled to the processor, and the processor controls the transceiver to transmit and receive messages.

11. A computer-readable storage medium having stored thereon computer instructions which, when executed by a computer, cause the computer to perform the method of any of claims 1-9.

Technical Field

The invention relates to the technical field of data processing, in particular to a method for managing an unmanned vehicle based on mobile human-computer interaction equipment.

Background

For the management of manned operating vehicles, a fleet management mode is conventionally adopted, that is, a driver and/or one or more drivers and passengers are allocated to each operating vehicle, and the driver and the drivers gather various information of the vehicles and report the information to the fleet for unified management. This model is already well developed in the field of operation management of manned vehicles, but it is certainly not possible to move the model to the field of operation management of unmanned vehicles, for example, a driver is not present and the information gathering channel is different. Therefore, how to effectively manage a plurality of unmanned vehicles by using a conventional fleet management mode becomes a problem to be solved urgently.

Disclosure of Invention

The present invention is directed to provide a method, an electronic device and a computer readable storage medium for managing an unmanned vehicle based on a mobile human-computer interaction device, which provide a mobile human-computer interaction device for a fleet manager, and provide conventional unmanned vehicle management and emergency unmanned vehicle management for the unmanned vehicle through the mobile human-computer interaction device. The invention can solve the problem of conventional management of a plurality of unmanned vehicles and can carry out timely emergency treatment on the unmanned vehicles in emergency.

In order to achieve the above object, a first aspect of the embodiments of the present invention provides a method for managing an unmanned vehicle based on a mobile human-computer interaction device, where the method includes:

the mobile man-machine interaction equipment receives first receiving data from a first data receiving port;

according to the first data receiving port, performing type division on the first received data; when the first data receiving port is a preset user input port, taking the first received data as first management instruction data, and performing corresponding conventional management on the unmanned vehicle according to the first management instruction data; and when the first data receiving port is a preset vehicle alarm port, taking the first received data as first vehicle fault level data, and performing corresponding unmanned vehicle emergency management according to the first vehicle fault level data.

Preferably, the performing of the conventional management of the unmanned vehicle according to the first management instruction data specifically includes:

when first instruction head data of the first management instruction data are first instruction codes, extracting a first vehicle identification data set from first instruction body data of the first management instruction data; carrying out one-key starting processing on the unmanned vehicle according to the first vehicle identification data set; the first set of vehicle identification data comprises a plurality of first vehicle identification data;

when the first instruction head data is a second instruction code, extracting a first equipment data group set from the first instruction volume data; self-checking the unmanned vehicle equipment according to the first equipment data group set; the first set of device datasets includes a plurality of first device datasets; the first device data group includes second vehicle identification data and first device identification data;

when the first instruction head data is a third instruction code, extracting a first upgrading data group set from the first instruction volume data; carrying out remote upgrading processing on the unmanned vehicle according to the first upgrading data set; the first set of upgrade data sets comprises a plurality of first upgrade data sets; the first upgrade data group comprises third vehicle identification data, first upgrade module identification data and a first upgrade data packet;

when the first instruction head data is a fourth instruction code, a first user data group set is obtained from local; uploading user behavior data according to the first user data group set; a plurality of first user data groups comprised by the first set of user data groups; the first user data group comprises first user identification data and a first user historical behavior data set; the first set of user historical behavior data comprises a plurality of first user historical behavior data; the first user historical behavior data comprises first operation time information, first operation instruction information and first operation instruction feedback information;

when the first instruction head data is a fifth instruction code, extracting a first control instruction group set from the first instruction volume data; carrying out remote control processing on the unmanned vehicle according to the first control instruction set; the first set of control instruction sets comprises a plurality of first control instruction sets; the first control instruction group comprises fourth vehicle identification data and first control instruction data; the first control instruction data comprise an automatic driving control entering instruction, an automatic driving control exiting instruction, a lane changing control instruction, a camera opening control instruction, a camera closing control instruction and a remote assistance requesting control instruction;

when the first instruction head data is a sixth instruction code, extracting a first monitoring data group set from the first instruction volume data; carrying out remote monitoring processing on the unmanned vehicle according to the first monitoring data group set; the first monitoring dataset set comprises a plurality of first monitoring datasets; the first monitoring data set includes fifth vehicle identification data and a plurality of first monitoring identification data; the first monitoring identification data comprises first hard disk identification data, first network identification data and first memory identification data.

Further, the performing the one-key start processing of the unmanned vehicle according to the first vehicle identification data set specifically includes:

sending one-key starting instruction data to a first unmanned vehicle corresponding to each first vehicle identification data of the first vehicle identification data set through a wireless network;

receiving first command feedback data sent back from each of the first unmanned vehicles;

if the first instruction feedback data is successful in execution, performing one-key starting instruction execution success information display processing according to the corresponding first vehicle identification data;

and if the first instruction feedback data is not successful in execution, performing one-key starting instruction execution failure information display processing according to the corresponding first vehicle identification data and the corresponding first instruction feedback data.

Further, the self-checking processing of the unmanned vehicle device according to the first device data group set specifically includes:

sending device self-check instruction data carrying the first device identification data to a second unmanned vehicle corresponding to the second vehicle identification data of each first device data group of the first device data group set through a wireless network;

receiving second command feedback data sent back from each of the second unmanned vehicles;

if the second instruction feedback data is successfully executed, displaying equipment self-checking instruction execution success information according to the corresponding first equipment data group;

and if the second instruction feedback data is not successful in execution, performing equipment self-checking instruction execution failure information display processing according to the corresponding first equipment data group and the second instruction feedback data.

Further, the performing the remote upgrade processing on the unmanned vehicle according to the first upgrade data group set specifically includes:

sending remote upgrade instruction data carrying the first upgrade module identification data and the first upgrade data packet to a third unmanned vehicle corresponding to the third vehicle identification data of each first upgrade data group of the first upgrade data group set through a wireless network;

receiving third command feedback data sent back from each of the third unmanned vehicles;

if the third instruction feedback data is successfully executed, displaying and processing the information of successful execution of the remote upgrading instruction according to the corresponding third vehicle identification data and the first upgrading module identification data;

and if the third instruction feedback data is not successfully executed, performing remote upgrading instruction execution failure information display processing according to the corresponding third vehicle identification data, the first upgrading module identification data and the third instruction feedback data.

Further, the uploading of the user behavior data according to the first user data group set specifically includes:

acquiring a first cloud platform data interface from the local;

sending user behavior data uploading instruction data carrying the first user data group set to the first cloud platform data interface through a wireless network;

receiving fourth instruction feedback data sent back from the first cloud platform data interface;

if the fourth instruction feedback data is successfully executed, displaying and processing user behavior data uploading instruction execution success information according to the first cloud platform data interface;

and if the fourth instruction feedback data is not successfully executed, displaying and processing user behavior data uploading instruction execution failure information according to the first cloud platform data interface and the fourth instruction feedback data.

Further, the performing remote control processing on the unmanned vehicle according to the first control instruction set specifically includes:

sending remote control instruction data carrying the first control instruction data to a fourth unmanned vehicle corresponding to the fourth vehicle identification data of each first control instruction group of the first control instruction group set through a wireless network;

receiving fifth instructional feedback data sent back from each of the fourth unmanned vehicles;

if the fifth instruction feedback data is successfully executed, performing remote control instruction execution success information display processing according to the corresponding fourth vehicle identification data and the corresponding first control instruction data;

and if the fifth instruction feedback data is not successfully executed, performing remote control instruction execution failure information display processing according to the corresponding fourth vehicle identification data, the first control instruction data and the fifth instruction feedback data.

Further, the remote monitoring processing of the unmanned vehicle according to the first monitoring data group set specifically includes:

sending remote monitoring instruction data carrying the plurality of first monitoring identification data to a fifth unmanned vehicle corresponding to the fifth vehicle identification data of each first monitoring data group set of the first monitoring data group sets through a wireless network;

receiving sixth command feedback data sent back from each of the fifth unmanned vehicles;

if the sixth instruction feedback data is successfully executed, performing remote monitoring instruction execution success information display processing according to the corresponding fifth vehicle identification data and the plurality of first monitoring identification data; after the remote monitoring instruction executes successful information display processing, receiving a first vehicle monitoring data set sent back by the fifth unmanned vehicle at specified time intervals; analyzing each first vehicle monitoring data in the first vehicle monitoring data set to obtain corresponding health degree data, and if the health degree data exceeds a corresponding preset alarm threshold value, performing corresponding monitoring data acousto-optic alarm processing according to the health degree data;

and if the sixth instruction feedback data is not successfully executed, performing remote monitoring instruction execution failure information display processing according to the corresponding fifth vehicle identification data, the plurality of first monitoring identification data and the sixth instruction feedback data.

Preferably, the performing of the corresponding unmanned vehicle emergency management according to the first vehicle fault level data specifically includes:

extracting sixth vehicle identification data, first vehicle position data and first fault level data from the first vehicle fault level data; the first fault level data comprises a first level, a second level, and a third level; the fault levels corresponding to the first level, the second level to the third level are sequentially increased;

when the first fault level data is of a first level, acquiring a second cloud platform data interface from the local, and sending the first vehicle fault level data to the second cloud platform data interface through a wireless network;

when the first fault level data is in a second level, remotely calling a sixth unmanned vehicle corresponding to the sixth vehicle identification data through a wireless network to perform vehicle local fault acousto-optic alarm processing; remotely calling a sensor of the sixth unmanned vehicle to obtain environmental information around the vehicle, analyzing the environmental information around the vehicle to generate a corresponding first analysis conclusion, performing corresponding passenger prompt information conversion processing according to the first analysis conclusion in a preset passenger prompt mode to generate corresponding first passenger prompt information, and performing corresponding information display processing on the first passenger prompt information; sending corresponding alarm information to a preset external linkage alarm port; the passenger prompt mode comprises a text prompt, a voice prompt and a text and voice prompt; the external linkage alarm ports at least comprise a 110 alarm port, a 119 alarm port and a 120 alarm port;

when the first fault level data is a third level, remotely calling the sixth unmanned vehicle through a wireless network to start a local emergency power supply of the vehicle; calling a camera of the sixth unmanned vehicle to perform environment shooting processing to generate a plurality of first image data; performing disaster identification processing on each first image data to generate corresponding first disaster state data; if the first disaster condition data is not in a non-disaster condition state, remotely calling the sixth unmanned vehicle to perform corresponding vehicle local disaster avoidance emergency treatment; sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction device users with the distance to the first vehicle position data within a preset first distance range, and if the number of the other unmanned vehicles or the number of the mobile man-machine interaction device users within the first distance range is lower than the preset first user number, sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction device users with the distance to the first vehicle position data within a preset second distance range; the first disaster condition data at least comprises a non-disaster condition state and a disaster condition state, wherein the disaster condition state comprises a flood condition state, a fire condition state, a debris flow state, a mountain landslide state and a traffic accident state; the second distance range is greater than the first distance range.

A second aspect of an embodiment of the present invention provides an electronic device, including: a memory, a processor, and a transceiver;

the processor is configured to be coupled to the memory, read and execute instructions in the memory, so as to implement the method steps of the first aspect;

the transceiver is coupled to the processor, and the processor controls the transceiver to transmit and receive messages.

A third aspect of embodiments of the present invention provides a computer-readable storage medium storing computer instructions that, when executed by a computer, cause the computer to perform the method of the first aspect.

The embodiment of the invention provides a method for managing an unmanned vehicle based on a mobile human-computer interaction device, an electronic device and a computer readable storage medium, wherein the mobile human-computer interaction device is provided for a fleet manager, and conventional management and emergency management of the unmanned vehicle can be provided for the unmanned vehicle through the mobile human-computer interaction device. The invention can solve the problem of conventional management of a plurality of unmanned vehicles and can carry out timely emergency treatment on the unmanned vehicles in emergency.

Drawings

Fig. 1 is a schematic diagram of a method for managing an unmanned vehicle based on a mobile human-computer interaction device according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of an electronic device according to a second embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

An embodiment of the present invention provides a method for managing an unmanned vehicle based on a mobile human-computer interaction device, as shown in fig. 1, which is a schematic diagram of the method for managing an unmanned vehicle based on a mobile human-computer interaction device according to the embodiment of the present invention, the method mainly includes the following steps:

step 1, the mobile man-machine interaction equipment receives first receiving data from a first data receiving port.

Here, the mobile human-computer interaction device is a mobile device loaded with remote unmanned vehicle management software, and the mobile device may be any device with wireless communication function, such as a mobile phone, a PAD, a tablet computer, a mobile computer, a customized mobile terminal, and the like, and the wireless communication function of the mobile device at least comprises wireless local area network Wi fi, 4G/5G mobile communication. The mobile man-machine interaction equipment can be connected with one or more unmanned vehicles operated at the front end through a wireless network, and can also be connected with one or more cloud platforms monitored at the rear end through the wireless network;

the first data receiving port is a protocol port, but not an actual physical port; the first data receiving port can be any physical port, and the first data receiving port distinguishes the virtual port types by using the application layer protocol characters of the data received on each physical port; if the application layer protocol character of the data received on a certain physical port 1 is a preset user input data protocol character, the current physical port 1 is regarded as a first data receiving end 1 and the type is a user input port, and meanwhile, if the application layer protocol character of the data received on a certain physical port 2 is a preset vehicle alarm data protocol character, the current physical port 2 is regarded as a first data receiving end 2 and the type is a vehicle alarm port;

the first received data is application data or user data received at the first data receiving port without any communication protocol characters and application layer protocol characters.

Step 2, according to the first data receiving port, the type of the first receiving data is divided; when the first data receiving port is a preset user input port, the first received data are used as first management instruction data, and corresponding unmanned vehicle conventional management is carried out according to the first management instruction data; when the first data receiving port is a preset vehicle alarm port, the first receiving data are used as first vehicle fault level data, and corresponding unmanned vehicle emergency management is carried out according to the first vehicle fault level data;

the method specifically comprises the following steps: step 21, when the first data receiving port is a preset user input port, taking the first received data as first management instruction data, and performing corresponding conventional management on the unmanned vehicle according to the first management instruction data;

the first management instruction data comprises first instruction head data and first instruction body data;

here, the embodiment of the present invention provides at least six types of user management instructions: one-key starting, equipment self-checking, remote upgrading, user behavior data uploading, remote control and remote monitoring;

performing corresponding conventional management on the unmanned vehicle according to the first management instruction data, which specifically comprises the following steps: step 211, when the first command header data of the first management command data is the first command code, extracting a first vehicle identification data set from the first command body data of the first management command data; carrying out one-key starting processing on the unmanned vehicle according to the first vehicle identification data set;

wherein the first set of vehicle identification data comprises a plurality of first vehicle identification data;

the method for carrying out the one-key starting processing of the unmanned vehicle according to the first vehicle identification data set specifically comprises the following steps: sending one-key starting instruction data to a first unmanned vehicle corresponding to each first vehicle identification data of a first vehicle identification data set through a wireless network; receiving first command feedback data sent back from each first unmanned vehicle; if the first instruction feedback data is successful in execution, performing one-key starting instruction execution success information display processing according to the corresponding first vehicle identification data; if the first instruction feedback data is not successful in execution, performing one-key starting instruction execution failure information display processing according to the corresponding first vehicle identification data and the first instruction feedback data;

here, the first instruction code is an instruction header code of a preset first-class management instruction, and the first-class management instruction is a remote one-key start-up-class instruction; the user can simultaneously perform one-key starting operation on the plurality of unmanned vehicles through the mobile man-machine interaction device, so that the first vehicle identification data set input by the user can comprise identification information of the plurality of unmanned vehicles, namely first vehicle identification data, and certainly can also comprise identification information of one unmanned vehicle; the one-key starting instruction data is one of remote instructions prearranged by the mobile human-computer interaction equipment and an unmanned system of the unmanned vehicle, and when the unmanned vehicle receives the one-key starting instruction data sent by the mobile human-computer interaction equipment through a wireless network, a corresponding one-key starting processing flow is immediately called locally to convert the system state of the current vehicle from a starting state to an unmanned state;

after the unmanned vehicle successfully completes the one-key starting operation, corresponding instruction feedback information, namely first instruction feedback data, is sent back to the mobile man-machine interaction device through the wireless network, and the data actually comprises two parts: the vehicle identification data correspond to the first vehicle identification data and are used for identifying which vehicle the current feedback data are fed back from, and the instruction state data are agreed data used for representing the instruction execution condition;

when the instruction state data of the first instruction feedback data is successful in execution, which means that the one-key starting execution of the current vehicle is successful, the mobile man-machine interaction device performs the one-key starting instruction execution success information display processing through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely displays the information of the one-key starting success of the unmanned vehicle corresponding to the first vehicle identification data;

when the instruction state data of the first instruction feedback data is not successful in execution, the fact that one-key starting execution of the current vehicle fails means that the instruction state data of the first instruction feedback data is a specific error code or abnormal information, the mobile man-machine interaction device can perform one-key starting instruction execution failure information display processing through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely display the information of one-key starting failure of the unmanned vehicle corresponding to the first vehicle identification data, and explain the specific error or the abnormality according to the instruction state data of the first instruction feedback data;

step 212, when the first command header data is the second command code, extracting a first device data group set from the first command volume data; self-checking the unmanned vehicle equipment according to the first equipment data group set;

wherein the first set of device data groups comprises a plurality of first device data groups; the first device data group includes second vehicle identification data and first device identification data;

according to a first equipment data group set, self-checking processing of unmanned vehicle equipment is carried out, and the method specifically comprises the following steps: sending equipment self-checking instruction data carrying the first equipment identification data to a second unmanned vehicle corresponding to second vehicle identification data of each first equipment data group of the first equipment data group set through a wireless network; receiving second command feedback data sent back from each second unmanned vehicle; if the second instruction feedback data is successfully executed, displaying the successful execution information of the equipment self-checking instruction according to the corresponding first equipment data group; if the second instruction feedback data is not successfully executed, performing equipment self-checking instruction execution failure information display processing according to the corresponding first equipment data group and the second instruction feedback data;

here, the second instruction code is an instruction header code of a preset second type management instruction, and the second type management instruction is a remote device self-checking instruction; a user can simultaneously perform remote equipment self-checking operation on a plurality of equipment components of a plurality of unmanned vehicles through mobile human-computer interaction equipment, so that a first equipment data group set input by the user can comprise a plurality of unmanned vehicle identification information, namely second vehicle identification data, and a plurality of vehicle-mounted equipment identification information, namely first equipment identification data, and certainly can also comprise one piece of equipment of one unmanned vehicle;

here, if the second vehicle identification data of a certain first device data group is a preset full-queue character, it means that batch device self-inspection is performed on devices appointed by the first device identification data of the first device data group on all unmanned vehicles connected with the current mobile human-computer interaction device; if the first equipment identification data of a certain first equipment data group is a preset full equipment character, batch equipment self-inspection is carried out on all vehicle-mounted equipment on the unmanned vehicle corresponding to the first equipment data group;

the equipment self-checking instruction data is one of remote instructions predetermined by the mobile human-computer interaction equipment and an unmanned system of the unmanned vehicle, and when the unmanned vehicle receives the equipment self-checking instruction data sent by the mobile human-computer interaction equipment through a wireless network, a corresponding equipment self-checking processing flow is immediately called locally to carry out self-checking on the specified equipment of the current vehicle, for example, various radars, various cameras, a vehicle-mounted host computer, various sensors connected with the unmanned system, a controller and the like;

after the designated equipment on the unmanned vehicle successfully completes the equipment self-checking operation, corresponding instruction feedback information, namely second instruction feedback data, is sent back to the mobile man-machine interaction equipment through a wireless network, and the data actually comprises two parts: the vehicle identification data correspond to second vehicle identification data and are used for identifying which vehicle the current feedback data are fed back from, and the instruction state data are agreed data used for representing instruction execution conditions;

when the instruction state data of the second instruction feedback data is successfully executed, which means that the self-checking of the specified equipment of the current vehicle is successfully executed, the mobile man-machine interaction equipment can perform equipment self-checking instruction execution success information display processing through a display device of the mobile man-machine interaction equipment or a display device connected with the mobile man-machine interaction equipment, namely, equipment self-checking information of the unmanned vehicle corresponding to the second vehicle identification data is displayed;

when the instruction state data of the second instruction feedback data is not successful in execution, the current equipment self-checking execution of the vehicle fails, the instruction state data of the second instruction feedback data is a specific error code or abnormal information, the mobile man-machine interaction equipment displays the equipment self-checking instruction execution failure information through a display device of the mobile man-machine interaction equipment or a display device connected with the mobile man-machine interaction equipment, namely displays the information of the equipment self-checking failure of the driverless vehicle corresponding to the second vehicle identification data, and explains the specific error or the abnormality according to the instruction state data of the second instruction feedback data;

step 213, when the first command header data is the third command code, extracting a first upgrade data set from the first command body data; carrying out remote upgrading processing on the unmanned vehicle according to the first upgrading data set;

wherein the first set of upgrade data sets comprises a plurality of first upgrade data sets; the first upgrade data group includes third vehicle identification data, first upgrade module identification data, and a first upgrade data packet;

and carrying out remote upgrading treatment on the unmanned vehicle according to the first upgrading data group set, which specifically comprises the following steps: sending remote upgrade instruction data carrying first upgrade module identification data and a first upgrade data packet to a third unmanned vehicle corresponding to third vehicle identification data of each first upgrade data group of the first upgrade data group set through a wireless network; receiving third command feedback data sent back from each third unmanned vehicle; if the third instruction feedback data is successfully executed, performing remote upgrading instruction execution success information display processing according to the corresponding third vehicle identification data and the first upgrading module identification data; if the third instruction feedback data is not successfully executed, performing remote upgrading instruction execution failure information display processing according to the corresponding third vehicle identification data, the first upgrading module identification data and the third instruction feedback data;

here, the third instruction code is an instruction header code of a preset third type management instruction, and the third type management instruction is a remote upgrade instruction; a user can simultaneously carry out remote upgrading operation on a plurality of software and hardware modules of a plurality of unmanned vehicles through mobile man-machine interaction equipment, so that a first upgrading data set input by the user can comprise a plurality of unmanned vehicle identification information, namely third vehicle identification data, and a plurality of software and hardware module identification information, namely first upgrading module identification data, and certainly can also comprise only one module of one unmanned vehicle;

the remote upgrading instruction data is one of remote instructions prearranged by the mobile man-machine interaction equipment and an unmanned system of the unmanned vehicle, when the unmanned vehicle receives the remote upgrading instruction data sent by the mobile man-machine interaction equipment through a wireless network, a corresponding equipment upgrading processing flow is immediately called locally to upgrade the appointed equipment of the current vehicle, for example, unmanned system software, map data, route planning software and data, operation strategy software and data, driving or control software of various hardware modules or sensors and the like;

after the designated module on the unmanned vehicle successfully finishes the upgrading operation, corresponding instruction feedback information, namely third instruction feedback data, is sent back to the mobile man-machine interaction device through a wireless network, and the data actually comprises two parts: the vehicle identification data correspond to the third vehicle identification data and are used for identifying which vehicle the current feedback data are fed back from, and the instruction state data are agreed data used for representing the instruction execution condition;

when the instruction state data of the third instruction feedback data is successfully executed, which means that the upgrade of the specified module of the current vehicle is successfully executed, the mobile man-machine interaction device can perform the successful information display processing of the remote upgrade instruction execution through the display device of the mobile man-machine interaction device or the display device connected with the mobile man-machine interaction device, namely, the remote upgrade information of the unmanned vehicle corresponding to the third vehicle identification data is displayed;

when the instruction state data of the third instruction feedback data is not successful in execution, the remote upgrading execution of the current vehicle fails, the instruction state data of the third instruction feedback data is a specific error code or abnormal information, the mobile man-machine interaction device can display the remote upgrading instruction execution failure information through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely display the information of upgrading failure of the unmanned vehicle module corresponding to the third vehicle identification data, and explain specific errors or abnormalities according to the instruction state data of the third instruction feedback data;

step 214, when the first command header data is the fourth command code, acquiring the first user data group set from the local; uploading user behavior data according to the first user data group set;

wherein the first set of user data groups comprises a plurality of first user data groups; the first user data group comprises first user identification data and a first user historical behavior data set; the first set of user historical behavior data comprises a plurality of first user historical behavior data; the first user historical behavior data comprises first operation time information, first operation instruction information and first operation instruction feedback information;

the method for uploading user behavior data according to the first user data group set specifically includes: acquiring a first cloud platform data interface from the local; sending user behavior data uploading instruction data carrying a first user data group set to a first cloud platform data interface through a wireless network; receiving fourth instruction feedback data sent back from the first cloud platform data interface; if the fourth instruction feedback data is successfully executed, displaying and processing successful execution information of the user behavior data uploading instruction according to the first cloud platform data interface; if the fourth instruction feedback data is not successfully executed, performing user behavior data uploading instruction execution failure information display processing according to the first cloud platform data interface and the fourth instruction feedback data;

here, the fourth instruction code is an instruction header code of a preset fourth type management instruction, and the fourth type management instruction is a user behavior data uploading instruction; the user can upload historical behavior data of a plurality of users locally stored on the mobile man-machine interaction device to a designated cloud platform through the mobile man-machine interaction device, so that a first user data group set input by the user can comprise identification information of the plurality of users, namely first user identification data and historical behavior data of each user, namely a first user historical behavior data set; the first user historical behavior data set can be regarded as a user operation record log taking time as a main line, and then each first user historical behavior data is a specific user operation record, first operation time information of the first user historical behavior data is occurrence time of a current record, first operation instruction information is a user operation mode (such as clicking, keyboard input and the like) and operation content (such as content of clicking, content of keyboard input and the like) recorded in the current record, and the first operation instruction feedback information is system feedback information (such as clicking, response information generated after keyboard input and the like) of the user operation recorded in the current record;

the user behavior data uploading instruction data is one of remote instructions appointed in advance by the mobile human-computer interaction device and the remote cloud platform, and when the remote cloud platform receives the user behavior data uploading instruction data sent by the mobile human-computer interaction device through a wireless network, corresponding user behavior data storage and analysis processes are immediately called locally to store and analyze currently uploaded user data;

after the cloud platform receives the user behavior data uploading instruction data, corresponding instruction feedback information, namely fourth instruction feedback data, is immediately sent back to the mobile man-machine interaction device through the wireless network, and the data actually comprises two parts: the cloud platform identification data correspond to a first cloud platform data interface and are used for identifying which cloud platform the current feedback data are fed back from, and the instruction state data are appointed data used for representing instruction execution conditions;

when the instruction state data of the fourth instruction feedback data is successfully executed, which means that the user behavior data is successfully uploaded and executed, the mobile man-machine interaction device displays successful information uploading instructions and successful information uploading of the user behavior data through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely displays successful information uploading of the user behavior data of the cloud platform corresponding to the first cloud platform data interface;

when the instruction state data of the fourth instruction feedback data is not successfully executed, the user behavior data uploading execution fails, the instruction state data of the fourth instruction feedback data is a specific error code or abnormal information, the mobile man-machine interaction device displays the user behavior data uploading instruction execution failure information through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely displays the user behavior data uploading failure information of the cloud platform corresponding to the first cloud platform data interface, and explains the specific error or abnormality according to the instruction state data of the fourth instruction feedback data;

step 215, when the first command header data is the fifth command code, extracting a first control command group set from the first command volume data; carrying out remote control processing on the unmanned vehicle according to the first control instruction group set;

wherein the first control instruction group set comprises a plurality of first control instruction groups; the first control instruction group comprises fourth vehicle identification data and first control instruction data; the first control instruction data comprise an automatic driving control entering instruction, an automatic driving control exiting instruction, a lane changing control instruction, a camera opening control instruction, a camera closing control instruction and a remote assistance requesting control instruction;

according to the first control instruction group set, the unmanned vehicle remote control processing is carried out, and the method specifically comprises the following steps: sending remote control instruction data carrying the first control instruction data to a fourth unmanned vehicle corresponding to fourth vehicle identification data of each first control instruction group of the first control instruction group set through a wireless network; receiving fifth instruction feedback data sent back from each fourth unmanned vehicle; if the fifth instruction feedback data is successfully executed, performing remote control instruction execution success information display processing according to corresponding fourth vehicle identification data and the first control instruction data; if the fifth instruction feedback data is not successfully executed, performing remote control instruction execution failure information display processing according to corresponding fourth vehicle identification data, first control instruction data and fifth instruction feedback data;

here, the fifth instruction code is an instruction header code of a preset fifth type of management instruction, and the fifth type of management instruction is a remote control instruction; the user can simultaneously carry out remote control operation on a plurality of unmanned vehicles through the mobile man-machine interaction device, so that a first control instruction group set input by the user can comprise a plurality of unmanned vehicle identification information, namely fourth vehicle identification data, and a specific control instruction, namely first control instruction data;

the remote control instruction data is one of remote instructions prearranged by the mobile man-machine interaction equipment and the unmanned system of the unmanned vehicle, when the unmanned vehicle receives the remote control instruction data sent by the mobile man-machine interaction equipment through the wireless network, the corresponding instruction processing flow can be immediately called locally, for example, after receiving an automatic driving control instruction, the corresponding automatic driving processing flow is started to convert the state of the vehicle into an unmanned state, after receiving an automatic driving control instruction, the corresponding automatic driving stopping processing flow is started to convert the state of the vehicle from the unmanned state into a starting state, after receiving a lane change control instruction, the corresponding lane change decision processing flow is started to switch the driving road of the vehicle, when receiving a camera control instruction, the corresponding camera working processing flow is started to configure the camera, and after receiving a camera opening control instruction, the corresponding camera working processing flow is started to switch the driving road of the vehicle, Or remote calling and other operations, starting a corresponding camera to stop a processing flow to shut down the camera after receiving a camera closing control instruction, and starting a corresponding remote assistance processing flow to send a remote assistance application to a specified cloud platform after receiving a remote assistance request control instruction;

after the specified control command is completed on the unmanned vehicle, corresponding command feedback information, namely fifth command feedback data, is sent back to the mobile man-machine interaction device through the wireless network, and the data actually comprises two parts: the vehicle identification data correspond to the fourth vehicle identification data and are used for identifying which vehicle the current feedback data are fed back from, and the instruction state data are agreed data used for representing the instruction execution condition;

when the instruction state data of the fifth instruction feedback data is successfully executed, which means that the remote control instruction of the current vehicle is successfully executed, the mobile man-machine interaction device can perform successful information display processing of the remote control instruction execution through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely display the remote control information of the unmanned vehicle corresponding to the fourth vehicle identification data;

when the instruction state data of the fifth instruction feedback data is not successful in execution, the execution of the remote control instruction of the current vehicle is failed, the instruction state data of the fifth instruction feedback data is a specific error code or abnormal information, the mobile man-machine interaction device can display the information of the remote control instruction execution failure through a display device of the mobile man-machine interaction device or a display device connected with the mobile man-machine interaction device, namely display the information of the remote control failure of the unmanned vehicle corresponding to the fourth vehicle identification data, and explain the specific error or the abnormality according to the instruction state data of the fifth instruction feedback data;

step 216, when the first instruction header data is a sixth instruction code, extracting a first monitoring data group set from the first instruction volume data; carrying out remote monitoring processing on the unmanned vehicle according to the first monitoring data group set;

wherein the first monitoring data set comprises a plurality of first monitoring data sets; the first monitoring data group includes fifth vehicle identification data and a plurality of first monitoring identification data; the first monitoring identification data comprises first hard disk identification data, first network identification data and first memory identification data;

here, the sixth instruction code is an instruction header code of a preset sixth type management instruction, and the sixth type management instruction is a remote monitoring instruction; a user can simultaneously perform remote monitoring operation on a plurality of unmanned vehicles through mobile man-machine interaction equipment, so that a first monitoring data group set input by the user can comprise a plurality of unmanned vehicle identification information, namely fifth vehicle identification data, and identification information of a specific monitoring object, namely first monitoring identification data, wherein the monitoring object at least comprises a hard disk, a memory, a network state and the like, and the corresponding first monitoring identification data also comprises first hard disk identification data, first network identification data and first memory identification data;

according to the first monitoring data group set, the unmanned vehicle remote monitoring processing is carried out, and the method specifically comprises the following steps:

step A1, sending remote monitoring instruction data carrying a plurality of first monitoring identification data to a fifth unmanned vehicle corresponding to the fifth vehicle identification data of each first monitoring data group set of the first monitoring data group sets through a wireless network; receiving sixth command feedback data sent back from each fifth unmanned vehicle;

here, the remote monitoring instruction data is one of remote instructions agreed in advance by the mobile human-computer interaction device and the unmanned system of the unmanned vehicle, and when the unmanned vehicle receives the remote monitoring instruction data sent by the mobile human-computer interaction device via the wireless network, a corresponding instruction processing flow is called locally immediately, for example, after receiving the first hard disk identification data, a local hard disk state acquisition processing flow is called, and the obtained hard disk state (total capacity, used capacity, hard disk health state, etc.) monitoring data is incorporated into sixth instruction feedback data; after receiving the first network identification data, calling a local network state acquisition processing flow and incorporating the obtained network state (network operator, network signal strength and the like) monitoring data into sixth instruction feedback data; after receiving the first memory identification data, calling a local memory state acquisition processing flow and incorporating the obtained memory state (total memory capacity, total memory usage capacity, memory allocation information and the like) monitoring data into sixth instruction feedback data; if the execution of each flow is successful, state information related to the successful execution of each monitoring instruction is also included in the sixth instruction feedback data; if the execution of each flow fails, simultaneously incorporating identification data and failure state information related to monitoring failure into sixth instruction feedback data;

after the unmanned vehicle finishes the specified monitoring instruction, corresponding instruction feedback information, namely sixth instruction feedback data, is sent back to the mobile man-machine interaction device through the wireless network, and the data actually comprises three parts: the system comprises vehicle identification data, instruction state data and instruction feedback data, wherein the vehicle identification data corresponds to fifth vehicle identification data and is used for identifying which vehicle the current feedback data is fed back from, the instruction state data is agreed data used for representing the successful or failed condition of instruction execution, and the instruction feedback data is various monitoring data (hard disk state monitoring data, network state monitoring data, memory state monitoring data and the like) mentioned above;

step A2, if the sixth instruction feedback data is successfully executed, performing remote monitoring instruction execution success information display processing according to the corresponding fifth vehicle identification data and the plurality of first monitoring identification data; after the remote monitoring instruction executes successful information display processing, receiving a first vehicle monitoring data set sent back by a corresponding fifth unmanned vehicle at specified time intervals; analyzing each first vehicle monitoring data in the first vehicle monitoring data set to obtain corresponding health degree data, and if the health degree data exceeds a corresponding preset alarm threshold value, performing corresponding monitoring data sound-light alarm processing according to the health degree data;

here, when the instruction state data of the sixth instruction feedback data is successfully executed, which means that the remote monitoring instruction of the current vehicle is successfully executed, the mobile human-computer interaction device performs successful information display processing of the remote control instruction execution through a display device of the mobile human-computer interaction device or a display device connected with the mobile human-computer interaction device, that is, displays the remote monitoring information of the unmanned vehicle corresponding to the fifth vehicle identification data, that is, the instruction feedback data of the sixth instruction feedback data;

it should be noted that, after the remote monitoring instruction of the embodiment of the present invention is successfully executed for the first time, the corresponding unmanned vehicle may regularly send real-time monitoring information to the mobile human-computer interaction device, that is, send a first vehicle monitoring data set at specified time intervals, where the first vehicle monitoring data set includes own vehicle identification data and a plurality of first vehicle monitoring data, each first vehicle monitoring data includes monitoring object identification data and state monitoring data, the monitoring object identification data corresponds to the first hard disk identification data, the first network identification data or the first memory identification data, and the state monitoring data corresponds to the hard disk state monitoring data, the network state monitoring data or the memory state monitoring data; the mobile human-computer interaction equipment extracts first vehicle monitoring data from the first vehicle monitoring data set, performs data state analysis to obtain corresponding health degree probability (namely health degree data (such as hard disk health degree data, network health degree data and memory health degree data)), and the smaller the numerical value of the health degree data, the better the state, otherwise, the worse the state; comparing the real-time health degree data with a preset health degree alarm threshold value, namely a preset alarm threshold value (for example, a hard disk health degree alarm threshold value, a network health degree alarm threshold value and a memory health degree alarm threshold value), and if the health degree data is higher than the preset alarm threshold value, starting a corresponding sound-light alarm processing flow by the mobile man-machine interaction equipment to prompt a user of the mobile man-machine interaction equipment that the health degree of a monitored object of the current unmanned vehicle is in a problem;

step A3, if the sixth instruction feedback data is not successfully executed, performing remote monitoring instruction execution failure information display processing according to the corresponding fifth vehicle identification data, the plurality of first monitoring identification data and the sixth instruction feedback data;

here, when the instruction state data of the sixth instruction feedback data is not successful in execution, it means that the remote monitoring instruction of the current vehicle is failed in execution, the instruction state data of the sixth instruction feedback data is a specific error code or abnormal information, the mobile human-computer interaction device performs information display processing on the remote monitoring instruction execution failure through a display device of the mobile human-computer interaction device or a display device connected with the mobile human-computer interaction device, that is, displays the information on the unmanned vehicle remote monitoring failure corresponding to the fifth vehicle identification data, and explains the specific error or abnormality according to the instruction state data of the sixth instruction feedback data;

step 22, when the first data receiving port is a preset vehicle alarm port, taking the first received data as first vehicle fault level data, and performing corresponding unmanned vehicle emergency management according to the first vehicle fault level data;

here, embodiments of the present invention provide at least three levels of fault emergency management measures: a first level fault emergency management measure, a second level fault emergency management measure and a third level fault emergency management measure; the fault levels corresponding to the first level, the second level and the third level are sequentially increased;

wherein, carry out the emergent management of corresponding unmanned vehicle according to first vehicle fault level data, specifically include:

step 221, extracting sixth vehicle identification data, first vehicle position data and first fault level data from the first vehicle fault level data;

wherein the first fault level data comprises a first level, a second level, and a third level;

here, the first vehicle fault level data is fault alarm information sent by a certain unmanned vehicle to the mobile man-machine interaction device through a wireless network, the sixth vehicle identification data of the first vehicle fault level data is identification information of the unmanned vehicle, the first vehicle position data of the first vehicle fault level data is current positioning information of the unmanned vehicle, and the first fault level data of the first vehicle fault level data is the current fault level of the unmanned vehicle;

step 222, when the first fault level data is of a first level, acquiring a second cloud platform data interface from the local, and sending the first vehicle fault level data to the second cloud platform data interface through a wireless network;

here, if the first fault level data is a first level, the mobile human-computer interaction device according to the embodiment of the present invention sends the fault information, that is, the first vehicle fault level data, to the specified cloud platform interface, that is, the second cloud platform data interface; after the cloud platform corresponding to the second cloud platform data interface receives the first vehicle fault level data, position information is extracted from the first vehicle fault level data, and the unmanned vehicle is remotely controlled, for example, the fault vehicle is driven to a specified position from the current position through remote control, and for example, the fault vehicle is remotely overhauled through remote control;

step 223, when the first fault level data is a second level, remotely calling a sixth unmanned vehicle corresponding to sixth vehicle identification data through a wireless network to perform vehicle local fault acousto-optic alarm processing; remotely calling a sensor of a sixth unmanned vehicle to obtain environmental information around the vehicle, analyzing the environmental information around the vehicle to generate a corresponding first analysis conclusion, performing corresponding passenger prompt information conversion processing according to a preset passenger prompt mode according to the first analysis conclusion to generate corresponding first passenger prompt information, and performing corresponding information display processing on the first passenger prompt information; sending corresponding alarm information to a preset external linkage alarm port;

wherein the passenger prompt mode comprises a text prompt, a voice prompt and a text + voice prompt; the external linkage alarm ports at least comprise a 110 alarm port, a 119 alarm port and a 120 alarm port;

if the first fault level data is of a second level, the mobile man-machine interaction device can remotely control the unmanned vehicle to locally execute acousto-optic alarm operation, so that timely information prompt can be given to surrounding vehicles and people in the same trip; meanwhile, a sensor such as an unmanned camera or a radar is opened through a remote control/monitoring instruction to capture the surrounding environment information of the vehicle, after the surrounding environment information of the vehicle is obtained, the mobile man-machine interaction equipment also can perform scene recognition on the surrounding environment information and takes the recognition result as a first analysis conclusion, then content prompt of characters, voice or characters and voice is performed on passengers according to the first analysis conclusion, and meanwhile alarm information is sent to a 110 alarm port, a 119 alarm port or a 120 alarm port according to the first analysis conclusion;

step 224, when the first fault level data is a third level, remotely calling a sixth unmanned vehicle through a wireless network to start a local emergency power supply of the vehicle; calling a camera of a sixth unmanned vehicle to carry out environment shooting processing to generate a plurality of first image data; carrying out disaster identification processing on each first image data to generate corresponding first disaster state data; if the first disaster condition data is not in the non-disaster condition state, remotely calling a sixth unmanned vehicle to perform corresponding vehicle local disaster avoidance emergency treatment; sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction equipment users with the distance to the first vehicle position information within a preset first distance range, and if the number of the other unmanned vehicles or the number of the mobile man-machine interaction equipment users within the first distance range is lower than the preset first user number, sending distress information to a plurality of other unmanned vehicles or mobile man-machine interaction equipment users with the distance to the first vehicle position information within a preset second distance range;

the first disaster condition data at least comprises a non-disaster condition state and a disaster condition state, wherein the disaster condition state comprises a flood condition state, a fire condition state, a debris flow state, a mountain landslide state and a traffic accident state; the second distance range is greater than the first distance range.

If the first fault level data is a third level, the mobile man-machine interaction device remotely turns on the vehicle emergency power supply at the first time, obtains a real-time image of a scene, namely first image data, performs disaster recognition on the first image data, and takes a recognition result as first disaster state data; if the first disaster state data shows that a disaster (such as a flood, a fire, a debris flow, a landslide or a traffic accident) exists, the unmanned vehicle can be immediately and remotely controlled to perform corresponding vehicle local disaster avoidance emergency treatment, such as sending alarm information to a 110 alarm port, a 119 alarm port or a 120 alarm port, automatically opening a vehicle door, automatically starting a vehicle-mounted fire extinguishing device and the like; meanwhile, the mobile man-machine interaction equipment can also send real-time distress information to the periphery, the processing rule for sending the distress information is that the range is gradually expanded outwards from the nearest first distance range, the activation condition for expanding the range each time is to judge the number of feedback information responding to the distress information, the feedback information comes from other unmanned vehicles close to a fault vehicle or other mobile man-machine interaction equipment users under the same system, if the number of the feedback information is too small to be lower than the preset number of first users, the distress effect is not good, and the current distress signal sending range is expanded.

In summary, the embodiment of the invention provides six types of management methods and three levels of emergency treatment measures for the unmanned vehicle based on the mobile human-computer interaction device through the steps 1-2.

Fig. 2 is a schematic structural diagram of an electronic device according to a second embodiment of the present invention. The electronic device may be a terminal device or a server for implementing the method of the embodiment of the present invention, or may be a terminal device or a server connected to the terminal device or the server for implementing the method of the embodiment of the present invention. As shown in fig. 2, the electronic device may include: a processor 301 (e.g., a CPU), a memory 302, a transceiver 303; the transceiver 303 is coupled to the processor 301, and the processor 301 controls the transceiving operation of the transceiver 303. Various instructions may be stored in memory 302 for performing various processing functions and implementing the processing steps described in the foregoing method embodiments. Preferably, the electronic device according to an embodiment of the present invention further includes: a power supply 304, a system bus 305, and a communication port 306. The system bus 305 is used to implement communication connections between the elements. The communication port 306 is used for connection communication between the electronic device and other peripherals.

The system bus 305 mentioned in fig. 2 may be a peripheral Component interconnect Standard (PCI) bus, an Extended I Standard architecture (E I SA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The communication interface is used for realizing communication between the database access device and other equipment (such as a client, a read-write library and a read-only library). The Memory may include a Random Access Memory (RAM) and may also include a Non-volatile Memory (Non-Vo l at i l e Memory), such as at least one disk Memory.

The Processor may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), a Graphics Processor (GPU), and the like; but also a Digital Signal Processor (DSP), an application specific integrated circuit (App I cat I on Spec I C I integrated Ci, AS ic), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, discrete hardware component.

It should be noted that the embodiment of the present invention also provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to execute the method and the processing procedure provided in the above-mentioned embodiment.

The embodiment of the present invention further provides a chip for executing the instructions, where the chip is configured to execute the processing steps described in the foregoing method embodiment.

The embodiment of the invention provides a method for managing an unmanned vehicle based on a mobile human-computer interaction device, an electronic device and a computer readable storage medium, wherein the mobile human-computer interaction device is provided for a fleet manager, and conventional management and emergency management of the unmanned vehicle can be provided for the unmanned vehicle through the mobile human-computer interaction device. The invention can solve the problem of conventional management of a plurality of unmanned vehicles and can carry out timely emergency treatment on the unmanned vehicles in emergency.

Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

21页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:数据处理装置、方法、芯片、计算机设备及存储介质

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!