阅读说明：本技术 移动平台控制系统、方法、终端设备及遥控设备 (Mobile platform control system, method, terminal equipment and remote control equipment ) 是由 戚华飞 刘怀宇 于 2019-06-14 设计创作，主要内容包括：本申请实施例提供了移动平台控制系统、方法、终端设备及遥控设备。一种移动平台控制系统包括：至少一个终端设备、移动平台、至少一个遥控设备,移动平台控制系统被配置为：通过与移动平台之间的无线通信链路接收移动平台的移动关联数据；通过终端设备与终端设备对应的遥控设备之间的通信连接从遥控设备接收遥控数据以及通过终端设备与移动平台之间的无线通信链路将遥控数据发送至移动平台,终端设备对应的遥控设备从至少一个遥控设备中被选取出。(The embodiment of the application provides a mobile platform control system, a mobile platform control method, terminal equipment and remote control equipment. A mobile platform control system comprising: at least one terminal device, mobile platform, at least one remote control device, mobile platform control system is configured to: receiving mobile association data of the mobile platform through a wireless communication link with the mobile platform; the remote control data is received from the remote control device through the communication connection between the terminal device and the remote control device corresponding to the terminal device, and the remote control data is sent to the mobile platform through the wireless communication link between the terminal device and the mobile platform, and the remote control device corresponding to the terminal device is selected from at least one remote control device.)

1. A mobile platform control system, comprising: at least one terminal device, a mobile platform, at least one remote control device, the system configured to:

receiving mobile associated data of the mobile platform through a wireless communication link between the terminal device and the mobile platform;

receiving remote control data from the remote control device through a communication connection between the terminal device and the remote control device corresponding to the terminal device;

and sending the remote control data to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform, wherein the remote control equipment corresponding to the terminal equipment is selected from the at least one remote control equipment.

2. The system of claim 1, wherein the system is configured to:

sending a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data;

receiving remote control data collected by the remote control device from the remote control device;

and sending the remote control data collected by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

3. The system of claim 2, wherein the operation time period of the remote operation performed on the remote control device comprises: a plurality of remote control data transmission time slots.

4. The system of claim 3, wherein the remote control data is partitioned for transmission in each of the plurality of remote control data transmission time slots.

5. The system of claim 3, wherein the remote control data includes at least a stick amount, a function instruction of the remote control device.

6. The system of claim 3, wherein the remote control data has an operation interval substantially greater than the remote control data transmission time slot.

7. The system of claim 1, wherein each terminal device corresponds to a respective remote control device, and the remote control device corresponding to each terminal device is different from the remote control devices corresponding to the other terminal devices.

8. The system of claim 1, wherein the mobile platform movement association data comprises: the first person perspective image is collected by the mobile platform.

9. The system of claim 1, wherein each of the at least one terminal device comprises a smart wearable device.

10. The system of claim 9, wherein the smart wearable device comprises smart glasses.

11. The system of claim 10, wherein the smart glasses are configured to display the images captured by the mobile platform in real-time.

12. The system of claim 10, wherein the mobile platform is one of: unmanned aerial vehicle, ground remote-control robot, unmanned vehicle.

13. A mobile platform control method, comprising: at least one terminal equipment, mobile platform, at least one remote control equipment, the method includes:

receiving mobile associated data of the mobile platform through a wireless communication link between the terminal device and the mobile platform;

receiving remote control data from the remote control device through a communication connection between the terminal device and the remote control device corresponding to the terminal device;

and sending the remote control data to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform, wherein the remote control equipment corresponding to the terminal equipment is selected from the at least one remote control equipment.

14. The method of claim 13, wherein: receiving remote control data from the remote control device through a communication connection between the terminal device and the remote control device corresponding to the terminal device includes:

sending a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data;

receiving remote control data collected by the remote control device from the remote control device; and

sending the remote control data to the mobile platform over a wireless communication link between the terminal device and the mobile platform comprises:

and sending the remote control data collected by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

15. The method of claim 14, wherein the operation time period of the remote operation performed on the remote control device comprises: a plurality of remote control data transmission time slots.

16. The method of claim 15, wherein the remote control data is partitioned for transmission in each of the plurality of remote control data transmission time slots.

17. The method of claim 15, wherein the remote control data comprises a stick amount, a function instruction, of the remote control device.

18. The method of claim 15, wherein the remote control data has an operation interval substantially greater than the remote control data transmission time slot.

19. The method according to claim 13, wherein each terminal device corresponds to a respective remote control device, and the remote control device corresponding to each terminal device is different from the remote control devices corresponding to the other terminal devices.

20. The method of claim 13, wherein the mobile platform movement association data comprises: the first person perspective image is collected by the mobile platform.

21. The method of claim 13, wherein each of the at least one terminal device comprises a smart wearable device.

22. The method of claim 21, wherein the smart wearable device comprises smart glasses.

23. The method of claim 22, wherein the smart glasses are configured to display the images captured by the mobile platform in real time.

24. A terminal device, comprising a processor and a memory, wherein the memory stores operating instructions, and the processor operates the instructions to:

receiving mobile association data for a mobile platform from the mobile platform over a wireless communication link with the mobile platform;

receiving remote control data from a remote control device over a communication connection with the remote control device;

and sending the remote control data to the mobile platform through the wireless communication link between the mobile platform and the remote control data.

25. The terminal device of claim 24, wherein the processor is further operable with the instructions to:

sending a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data;

receiving remote control data collected by the remote control device from the remote control device;

and sending the remote control data collected by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

26. The terminal device according to claim 25, wherein the operation period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots.

27. The terminal device of claim 26, wherein the remote control data is partitioned for transmission in each of the plurality of remote control data transmission time slots.

28. The terminal device of claim 26, wherein the remote control data comprises at least a stick amount, a function instruction of the remote control device.

29. The terminal device of claim 26, wherein the remote control data has an operation interval substantially greater than the remote control data transmission time slot.

30. The terminal device of claim 24, wherein the terminal device corresponds to one or more remote control devices.

31. The terminal device of claim 24, wherein the mobile platform movement-related data comprises: the first person perspective image is collected by the mobile platform.

32. The terminal device of claim 24, wherein the terminal device comprises a smart wearable device.

33. The terminal device of claim 32, wherein the smart wearable device comprises smart glasses.

34. The terminal device of claim 33, wherein the smart glasses are configured to display the images captured by the mobile platform in real time.

35. The terminal device of claim 33, wherein the mobile platform is one of: unmanned aerial vehicle, ground remote-control robot, unmanned vehicle.

36. A mobile platform control method, the method comprising:

a terminal device receives mobile associated data of a mobile platform from the mobile platform through a wireless communication link between the terminal device and the mobile platform;

the terminal equipment receives remote control data from the remote control equipment through communication connection with the remote control equipment;

and the terminal equipment sends the remote control data to the mobile platform through the wireless communication link between the terminal equipment and the mobile platform.

37. The method of claim 36, wherein the terminal device receiving remote control data from a remote control device via a communication connection with the remote control device comprises: the terminal equipment sends a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data; receiving remote control data collected by the remote control device from the remote control device; and

the terminal equipment sends the remote control data to the mobile platform through the wireless communication link between the terminal equipment and the mobile platform comprises the following steps: and the terminal equipment sends the remote control data acquired by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

38. The method of claim 37, wherein the operation time period of the remote operation performed on the remote control device comprises: a plurality of remote control data transmission time slots.

39. The method of claim 38, wherein the remote control data is partitioned for transmission in each of the plurality of remote control data transmission time slots.

40. The method of claim 38, wherein the remote control data comprises at least a stick amount, a function instruction of the remote control device.

41. The method of claim 38, wherein the remote control data has an operation interval substantially greater than the remote control data transmission time slot.

42. The method of claim 36, wherein the terminal device corresponds to one or more remote control devices.

43. The method of claim 36, wherein the mobile platform movement association data comprises: the first person perspective image is collected by the mobile platform.

44. The method of claim 36, wherein the terminal device comprises a smart wearable device.

45. The method of claim 44, wherein the smart wearable device comprises smart glasses.

46. The method of claim 45, wherein the smart glasses are configured to display the images captured by the mobile platform in real time.

47. The method of claim 45, wherein the mobile platform is one of: unmanned aerial vehicle, ground remote-control robot, unmanned vehicle.

48. A remote control device comprising a processor and a memory, the memory having stored therein operating instructions, the processor operating the instructions to:

performing a remote control associated operation, the remote control associated operation comprising:

collecting remote control data;

and sending the remote control data to the terminal equipment through communication connection with the terminal equipment, wherein the terminal equipment sends the remote control data to the mobile platform through a wireless communication link with the mobile platform after receiving the remote control data.

49. The remote control device of claim 48, wherein the processor operates the instructions to further:

and responding to a remote control data acquisition instruction sent by the terminal equipment received through the communication connection with the terminal equipment, and executing remote control associated operation.

50. The remote control device according to claim 49, wherein an operation period of a remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots.

51. The remote control device of claim 50, wherein the remote control data is partitioned for transmission in each of the plurality of remote control data transmission time slots.

52. A mobile platform control method, the method comprising:

the remote control device executes remote control associated operations including:

collecting remote control data;

and sending the remote control data to the terminal equipment through communication connection with the terminal equipment, wherein the terminal equipment sends the remote control data to the mobile platform through a wireless communication link with the mobile platform after receiving the remote control data.

53. The method of claim 52, wherein the remote control device performing remote control associated operations comprises:

and the remote control equipment responds to a remote control data acquisition instruction sent by the terminal equipment and received through the communication connection with the terminal equipment, and executes remote control associated operation.

54. The method of claim 53, wherein the operation time period of the remote control operation performed on the remote control device comprises: a plurality of remote control data transmission time slots.

55. The method of claim 54, wherein the remote control data is transmitted in a split manner in each of a plurality of remote control data transmission slots.

Technical Field

The present application belongs to the field of control technologies, and in particular, to a mobile platform control system, method, terminal device, and remote control device.

Background

Mobile platforms such as Unmanned Aerial Vehicles (UAVs) are widely used in the fields of Aerial photography, urban management, agriculture, geology, weather, emergency and disaster relief, and the like.

Among the remote control modes of the mobile platform, there is a remote control mode that enhances the real experience of the user, that is, a remote controller of the mobile platform remotely controls the mobile platform according to the data collected by the mobile platform. For example, a remote controller of the mobile platform sees a first person perspective image (FPV) acquired by the mobile platform through a terminal device communicating with the mobile platform, so as to see the environment around the mobile platform in the current flight process of the mobile platform from the perspective of the mobile platform, and remotely control the mobile platform.

When the mobile platform is remotely controlled by using the remote control mode, at least the following problems exist: the remote control device needs to send remote control data to the mobile platform through a communication link with the mobile platform. Accordingly, the remote control device needs to be configured with devices required for communication with the mobile platform, which results in higher cost of the remote control device.

Disclosure of Invention

The embodiment of the application provides a mobile platform control system, a mobile platform control method, terminal equipment and remote control equipment.

In a first aspect, an embodiment of the present application provides a mobile platform control system, including: at least one terminal device, a mobile platform, at least one remote control device, the system configured to:

receiving mobile associated data of the mobile platform through a wireless communication link between the terminal device and the mobile platform;

receiving remote control data from the remote control device through a communication connection between the terminal device and the remote control device corresponding to the terminal device;

and sending the remote control data to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform, wherein the remote control equipment corresponding to the terminal equipment is selected from the at least one remote control equipment.

In a second aspect, an embodiment of the present application provides a mobile platform control method, including:

receiving mobile associated data of the mobile platform through a wireless communication link between the terminal device and the mobile platform;

receiving remote control data from the remote control device through a communication connection between the terminal device and the remote control device corresponding to the terminal device;

and sending the remote control data to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform, wherein the remote control equipment corresponding to the terminal equipment is selected from the at least one remote control equipment.

In a third aspect, an embodiment of the present application provides a mobile platform control method, where the mobile platform control method includes: a terminal device receives mobile associated data of a mobile platform from the mobile platform through a wireless communication link between the terminal device and the mobile platform;

the terminal equipment receives remote control data from the remote control equipment through communication connection with the remote control equipment;

and the terminal equipment sends the remote control data to the mobile platform through the wireless communication link between the terminal equipment and the mobile platform.

In a fourth aspect, an embodiment of the present application provides a mobile platform control method, where the mobile platform control method includes:

remote control data are collected by remote control equipment;

the remote control data are sent to the terminal equipment by the remote control equipment through communication connection between the remote control equipment and the terminal equipment, wherein the terminal equipment sends the remote control data to the unmanned aerial vehicle through a wireless communication link between the terminal equipment and the unmanned aerial vehicle after receiving the remote control data.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

1) and under the condition that the remote control equipment does not need to establish communication connection with the mobile platform, the remote control data is sent to the mobile platform to remotely control the mobile platform. Therefore, under the condition that the remote control equipment does not need to be provided with devices such as radio frequency circuits and antennas required for communicating with the mobile platform, the mobile platform is remotely controlled, and the cost of the remote control equipment is saved.

2) And completing operations of triggering the remote control equipment to collect remote control data, sending the remote control data to the mobile platform and the like in each remote control data transmission time slot. Thus, the remote control data is transmitted to the mobile platform with an ultra-low latency, so that the remote controller remotely controls the mobile platform with an ultra-low latency.

3) In the training mode, the remote control data of any one remote control device is not required to be transmitted to the mobile platform through other remote control devices, the transmission delay of the remote control data is reduced, communication connection is not required to be established between any two remote control devices, correspondingly, any two remote control devices are not required to be connected together through a transmission line, and the complexity of a remote controller for using the remote control devices is reduced.

The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 schematically shows a schematic diagram of a low latency transmission of remote control data;

FIG. 2 schematically illustrates a timing diagram for collecting remote control data;

fig. 3 schematically illustrates a schematic structural diagram of a mobile platform control system according to an embodiment of the present application;

fig. 4 schematically illustrates another structural diagram of a mobile platform control system according to an embodiment of the present application;

fig. 5 schematically illustrates a flowchart of a mobile platform control method provided in an embodiment of the present application;

fig. 6 schematically illustrates a flowchart of a mobile platform control method provided in an embodiment of the present application;

fig. 7 schematically illustrates a flowchart of a mobile platform control method provided in an embodiment of the present application;

fig. 8 schematically shows a structural diagram of flying glasses that can be used as a terminal device;

fig. 9 schematically shows a schematic configuration of a remote controller that can be a remote control device;

fig. 10 schematically shows a structural diagram of a terminal device that can implement the mobile platform control method provided in the embodiment of the present application;

fig. 11 schematically shows a structural diagram of a remote control device that can implement the mobile platform control method provided in the embodiment of the present application.

DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The mobile platform control system provided by the embodiment of the application comprises: the system comprises at least one terminal device, a mobile platform and at least one remote control device.

In this application, the mobile platform control system is configured to: receiving mobile associated data of a mobile platform through a wireless communication link between a terminal device and the mobile platform; receiving remote control data from a remote control device corresponding to the terminal device through a communication connection between the terminal device and the remote control device corresponding to the terminal device; and sending the remote control data to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform, wherein the remote control equipment corresponding to the terminal equipment is selected from at least one remote control equipment.

In the present application, operations that the mobile platform control system is configured to perform may be performed by one or more modules in one or more devices in the mobile platform control system. For example, by one or more modules in one or more terminal devices in the mobile platform control system.

In the application, when the number of the terminal devices in the mobile platform control system is multiple, each terminal device establishes a communication connection with the mobile platform.

In this application, when the number of the terminal devices and the number of the remote control devices in the mobile platform control system are both multiple, each terminal device may correspond to one or more remote control devices in all the remote control devices.

Correspondingly, when one terminal device corresponds to a plurality of remote control devices in all the remote control devices, the terminal device and each remote control device in the plurality of remote control devices are in communication connection. For each of the plurality of remote control devices, when the mobile platform is remotely controlled by the remote control device, the terminal device transmits remote control data generated on the remote control device to the mobile platform to remotely control the mobile platform.

In some embodiments, the mobile platform control system is configured to: sending a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data; receiving remote control data collected by the remote control equipment from the remote control equipment; and transmitting the remote control data acquired by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

In the present application, the terminal device may communicate with the mobile platform through a wireless communication technology specifically used for communicating with the mobile platform. Accordingly, the wireless communication link between the terminal device and the mobile platform may be a wireless communication link defined in a wireless communication technology dedicated to communicating with the mobile platform.

In this application, the communication connection between the terminal device and the remote control device may be a wired communication connection.

For example, the terminal device communicates with the remote control device by USB technology. The communication connection between the terminal device and the remote control device is a USB connection as defined in USB technology.

In the application, under the condition that the remote control equipment does not need to establish a wireless communication link with the mobile platform, the remote control data is sent to the mobile platform to remotely control the mobile platform. Therefore, under the condition that devices required for communicating with the mobile platform do not need to be configured in the remote control equipment, the mobile platform is remotely controlled, and the cost of the remote control equipment is saved.

For example, a device in communication with a mobile platform communicates with the mobile platform via a wireless communication technology that is dedicated to communicating with the mobile platform. Devices that communicate with mobile platforms are equipped with radio frequency circuitry, antennas, etc. necessary to communicate using the wireless communication technology. The remote control equipment does not need to be provided with devices such as a radio frequency circuit, an antenna and the like required by the wireless communication technology for communication, so that the cost of the remote control equipment is saved.

In this application, when the number of the terminal devices in the mobile platform control system is multiple, each terminal device establishes a wireless communication link with the mobile platform.

In this application, when the number of the terminal devices and the number of the remote control devices in the mobile platform control system are both multiple, each terminal device may correspond to one or more remote control devices in all the remote control devices.

Correspondingly, when one terminal device corresponds to a plurality of remote control devices in all the remote control devices, the terminal device and each remote control device in the plurality of remote control devices are in communication connection. For each of the plurality of remote control devices, when the mobile platform is remotely controlled by the remote control device, the terminal device transmits remote control data generated on the remote control device to the mobile platform to remotely control the mobile platform.

For example, all terminal devices in a mobile platform control system include: terminal equipment 1, terminal equipment 2, all remote control equipment in the mobile platform control system include: remote control device 1, remote control device 2, remote control device 3, remote control device 4. The terminal device 1 and the remote control device 1 have a communication connection therebetween, and the terminal device 1 and the remote control device 2 have a communication connection therebetween. The terminal device 2 has a communication connection with the remote control device 3, and the terminal device 2 has a communication connection with the remote control device 4.

The remote control device corresponding to the terminal device 1 includes: remote control device 1, remote control device 2. The remote control device corresponding to the terminal device 2 includes: remote control device 3, remote control device 4.

When a remote controller of the mobile platform remotely controls the mobile platform using the remote control device 1 or the remote control device 2, remote control data generated on the remote control device 1 or remote control data generated on the remote control device 2 is transmitted to the mobile platform by the terminal device 1 to remotely control the mobile platform.

When a remote controller of the mobile platform remotely controls the mobile platform using the remote control device 3 or the remote control device 4, remote control data generated on the remote control device 3 or remote control data generated on the remote control device 4 is transmitted to the mobile platform by the terminal device 2 to remotely control the mobile platform.

In this application, when the number of the terminal devices and the number of the remote control devices in the mobile platform control system are both multiple, multiple terminal devices in all the terminal devices may correspond to the same remote control device. For example, multiple remotes of a mobile platform take turns remotely controlling the mobile platform using the same remote control device. Each remote operator uses a respective terminal device to receive the movement related data from the mobile platform and to display the movement related data.

Correspondingly, when a plurality of terminal devices in all the terminal devices correspond to the same remote control device and the mobile platform is remotely controlled by the remote control device, the remote control device sends remote control data generated on the remote control device to the terminal device used by the current remote controller of the mobile platform, and the terminal device used by the current remote controller of the mobile platform sends the remote control data generated on the remote control device to the mobile platform to remotely control the mobile platform.

For example, all terminal devices include: terminal equipment 1, terminal equipment 2, terminal equipment 3, terminal equipment 4, all remote control equipment include: remote control device 1, remote control device 2.

The terminal device 1 has a communication connection with the remote control device 1, and the terminal device 2 has a communication connection with the remote control device 1. The terminal device 3 has a communication connection with the remote control device 2 and the terminal device 4 has a communication connection with the remote control device 2.

The remote control device corresponding to the terminal device 1 and the remote control device corresponding to the terminal device 2 are both the remote control device 1. The remote control device corresponding to the terminal device 3 and the remote control device corresponding to the terminal device 4 are both the remote control device 2.

When a current remote controller of the mobile platform utilizes the remote control device 1 to remotely control the mobile platform, the remote control device 1 sends remote control data generated on the remote control device 1 to the terminal device 1 or the terminal device 2 used by the current remote controller of the mobile platform, and the terminal device 1 or the terminal device 2 used by the current remote controller of the mobile platform sends the remote control data generated on the remote control device 1 to the mobile platform to remotely control the mobile platform.

When the current remote controller of the mobile platform utilizes the remote control device 2 to remotely control the mobile platform, the remote control device 2 sends the remote control data generated on the remote control device 2 to the terminal device 3 or the terminal device 4 used by the current remote controller of the mobile platform, and the terminal device 3 or the terminal device 4 used by the current remote controller of the mobile platform sends the remote control data generated on the remote control device 2 to the mobile platform to remotely control the mobile platform.

In the present application, the mobile associated data of the mobile platform includes: the mobile platform is moved by data collected by associated sensors on the mobile platform.

For example, the mobile platform is a drone, and the movement-related data of the drone includes, but is not limited to: flight speed, flight altitude, flight direction, flight environment images, and the like. The flight environment image may describe the environment around the drone during the current flight.

In some embodiments, the remote control data includes at least a stick amount, functional instructions of the remote control device. The stick amount may be a vector and may include a value of the stick amount, e.g., an offset direction, representing the current position of the stick on the remote control device relative to the origin at which the stick would be if it were not operated.

In the application, a remote controller of the mobile platform can perform remote control operation on the remote control equipment, and generate a remote control instruction through the remote control operation.

For example, the remote control device includes: rocker, button. The remote control operation of the remote controller of the mobile platform on the remote control equipment can comprise the operation of the remote controller of the mobile platform on the rocker and the pressing operation of the button, the operation of the remote controller of the mobile platform on the rocker generates the lever amount, and the pressing operation of the remote controller of the mobile platform on the button generates the functional instruction.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots. Remote control data transmitted to the mobile platform through a wireless communication link between the terminal device and the mobile platform is generated based on remote control operation performed on the remote control device. The remote control data collected by the remote control device is received from the remote control device, and the remote control data collected by the remote control device is sent to the mobile platform through the wireless communication link between the terminal device and the mobile platform, wherein the remote control data can be completed through a plurality of remote control data transmission time slots or a part of the remote control data transmission time slots.

During each remote control data transmission time slot associated with operations of receiving remote control data collected by the remote control device from the remote control device and transmitting the remote control data collected by the remote control device to the mobile platform through a wireless communication link between the terminal device and the mobile platform, a remote control data collection instruction may be transmitted to the remote control device to trigger the remote control device to collect remote control data.

In some embodiments, the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be split for transmission in each transmission time slot, i.e., a portion of the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be received from the remote control device and transmitted to the mobile platform in each remote control data transmission time slot.

In some embodiments, the remote control data is operated at intervals much larger than the remote control data transmission time slots. The operation interval of the remote control data may be understood as a time length of the remote control operation for generating the remote control data. For example, the time duration of the remote control data transmission time slot is 5ms, and the time duration of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device is also several seconds at the shortest. The operation interval of the remote control data is much larger than the remote control data transmission time slot.

In this application, a time slot may be understood as a time period. The remote control data transmission time slot may be a time slot for transmitting remote control data to the mobile platform.

In the present application, the duration of the remote control data transmission timeslot is much shorter than the duration of the remote control operation that the remote controller of the mobile platform performs on the remote control device to generate the remote control data.

For example, the duration of the remote control data transmission timeslot may be set to be in the millisecond level, for example, the duration of the remote control data transmission timeslot is 5ms, and the duration of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device is shortest and also in several seconds, that is, the duration of the operation time period of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device is shortest and also in several seconds.

Correspondingly, the operation time period of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device includes: a plurality of remote control data transmission time slots.

The remote controller of the mobile platform carries out remote control operation on the remote control equipment corresponding to the terminal equipment, can trigger the remote control equipment corresponding to the terminal equipment to acquire remote control data in each remote control data transmission time slot in a plurality of remote control data transmission time slots in an operation time period of the remote control operation, and in each remote control data transmission time slot, the remote control equipment corresponding to the terminal equipment receives the remote control data acquired by the remote control equipment corresponding to the terminal equipment and sends the remote control equipment corresponding to the terminal equipment to the mobile platform.

In the application, operations such as triggering the remote control device corresponding to the terminal device to acquire the remote control data, receiving the remote control data acquired by the remote control device corresponding to the terminal device from the remote control device corresponding to the terminal device, sending the remote control device corresponding to the terminal device to the mobile platform, and the like can be completed in each remote control data transmission time slot of the plurality of remote control data transmission time slots.

Thus, the remote control data is transmitted to the mobile platform with an ultra-low latency, and the remote operator of the mobile platform remotely controls the mobile platform with an ultra-low latency.

The principle of low-latency transmission of remote control data is explained as follows:

firstly, the remote control data high-delay transmission situation is illustrated: when a remote controller of the mobile platform needs to send acquired remote control data after acquiring the remote control data in the process of one remote control operation, if the equipment for sending the remote control data sends other data to the mobile platform, the acquired remote control data can be transmitted only by waiting for the completion of the transmission of the other data, and the remote control data can reach the mobile platform after high delay. Accordingly, the mobile platform may respond to the remote operation with a high latency.

In addition, in the remote control process, a remote controller of the mobile platform often makes a plurality of remote control operations continuously in a short time, and at this time, the delay time may further increase, for example, when the remote controller of the mobile platform is currently performing one remote control operation, there is a possibility that the mobile platform is currently responding to a remote control operation before the currently performed remote control operation due to high-delay transmission of remote control data.

In the present application, for each remote control operation performed by a remote controller of the mobile platform, after acquiring remote control data in any remote control data transmission timeslot within an operation time period of the remote control operation, there is no need to wait related to a high-latency transmission condition, and the acquired remote control data is directly and timely transmitted to the mobile platform within the remote control data transmission timeslot. Accordingly, the mobile platform can respond to the remote control operation in time based on the remote control data after receiving the remote control data each time.

In the present application, by the above-mentioned manner of transmitting the remote control data with low delay, the delay of the remote control data reaching the mobile platform is only the unavoidable delay of the sum of the time length from the remote control device to the terminal device and the time length from the terminal device to the mobile platform.

Referring to fig. 1, a schematic diagram of low-latency remote control data transmission is shown.

The remote operator of the mobile platform performs remote control operation a on a remote control device in one remote control process. In the remote control process, remote control data generated on the remote control device is transmitted to the mobile platform by a terminal device communicating with the remote control device.

The manner in which the remote commander transmits remote control data with low delay in the operation period of the remote control operation before the remote control operation a or the manner in which the remote commander transmits remote control data with low delay in the operation period of the remote control operation after the remote control operation a may refer to the manner in which remote control data is transmitted with low delay in the operation period of the remote control operation a described below.

The duration of the remote control operation a is in the order of seconds, the duration of the remote control data transmission time slot is very short, for example, 5ms, the duration of the remote control data transmission time slot is much shorter than the duration of the remote control operation a, and accordingly, the operation time slot of the remote control operation a may include a plurality of remote control data transmission time slots associated with the terminal device. The operation time period of the remote control operation a includes: the remote control data transmission time slot a1-AN associated with the terminal device.

A1 denotes the first remote control data transmission slot among all the remote control data transmission slots included in the operation period of the remote control operation a, a2 denotes the second remote control data transmission slot among all the remote control data transmission slots included in the operation period of the remote control operation a, A3 denotes the third remote control data transmission slot among all the remote control data transmission slots included in the operation period of the remote control operation a, and AN denotes the nth remote control data transmission slot among all the remote control data transmission slots included in the operation period of the remote control operation a.

The time slot between any two adjacent remote control data transmission time slots may be a time slot for transmitting other types of data. For example, the time slot between a1 and a2 is a time slot for transmitting mobile associated data collected by a mobile platform. The time slot between A2 and A3 is the time slot for transmitting the mobile associated data collected by the mobile platform.

It should be understood that the positions of a1, a2, A3, AN at the start time and the end time of the time axis t are all exemplary. For example, in an actual remote control process, a1 is not the first time slot in the operation period of the remote control operation a, and the start time of a1 is not the start time of the operation period of the remote control operation a. The AN is not the last time slot in the operation period of the remote control operation a, and the end time of the AN is not the end time of the operation period of the remote control operation a.

In the present application, in the remote control data segment of the remote control operation a, remote control data is collected and transmitted to the mobile platform in each remote control data transmission time slot of a 1-AN.

The remote control data collected in each remote control data transmission time slot of A1-AN does not need to wait related to high-delay transmission condition, and the collected remote control data is directly and timely sent to the mobile platform in the remote control data transmission time slot. Accordingly, the mobile platform can respond to the remote control operation in time based on the remote control data after receiving the remote control data each time.

Referring to fig. 2, a timing diagram of remote control data acquisition is shown.

In fig. 2, a plurality of pulses are shown, which may be generated by a crystal oscillator on a remote control device. The acquisition process of the remote control data may be triggered by the falling edge of the pulse. Each time the falling edge of a pulse is reached, a remote control data acquisition circuit on the remote control device can be triggered to acquire a stick quantity. The stick amount may be a vector and may include a value of the stick amount, e.g., an offset direction, representing the current position of the stick on the remote control device relative to the origin at which the stick would be if it were not operated. The type of the value of the bar quantity can be a current value, a voltage value and the like, is specifically determined according to the type of the output data output by the acquisition circuit, and is not limited in the application.

The duration of the pulses may be much shorter than the duration of the remote control data transmission time slots, and accordingly, in each remote control data transmission time slot, a plurality of pulses may be included, and in each remote control data transmission time slot, for example, in each remote control data transmission time slot having a duration of 5ms, a plurality of rod amounts may be collected. And then, in a remote control data transmission time slot, transmitting the collected pole amount set to the mobile platform through the communication connection between the terminal equipment and the remote control equipment corresponding to the terminal equipment and the wireless communication link between the terminal equipment and the mobile platform.

The duration of the remote control data transmission time slot is far shorter than the duration of remote control operation performed by a remote controller of the mobile platform, the duration of the pulse is far shorter than the duration of the remote control operation performed by the remote controller of the mobile platform, the acquisition process of the remote control data generated based on the remote control operation performed by the remote controller of the mobile platform is equivalent to the step of dividing the remote control operation performed by the remote controller of the mobile platform into a plurality of small operations which are continuous in time sequence, and the rod amount set generated based on the small operations is acquired each time. And in the remote control data transmission time slot, the collected pole amount is sent to the mobile platform in a set mode through the communication connection between the terminal equipment and the remote control equipment corresponding to the terminal equipment and through the wireless communication link between the terminal equipment and the mobile platform, and waiting related to the high-delay transmission condition is not needed.

In some embodiments, the mobile associated data of the mobile platform comprises: and the first-person visual angle image is collected by the mobile platform. A first person perspective image may be received and displayed. The remote controller of the mobile platform can remotely control the mobile platform according to the seen first person-person view image, so that the mobile platform is remotely controlled according to the view angle of the mobile platform.

In some embodiments, each of the at least one terminal device comprises a smart wearable device. The intelligent wearing equipment comprises intelligent glasses. The intelligent glasses are used for displaying the images collected by the mobile platform in real time.

For example, each terminal device is smart glasses. And the intelligent glasses are in communication connection with the mobile platform. The smart glasses have a wireless communication link with the remote control device. The smart glasses may receive movement-related data from the mobile platform over a wireless communication link with the mobile platform and display the received movement-related data. The smart glasses receive remote control data from the remote control device through a communication connection between the remote control device and transmit the remote control data to the mobile platform through a wireless communication link with the mobile platform.

When the remote controller of the mobile platform wears the intelligent glasses, the remote controller of the mobile platform can know the flight condition of the mobile platform according to the mobile associated data displayed by the intelligent glasses. Then, the remote controller of the mobile platform can perform remote control operation on the remote control device corresponding to the intelligent glasses, the remote control device sends remote control data generated based on the remote control operation of the remote controller to the intelligent glasses through communication connection with the intelligent glasses, and then the intelligent glasses send the remote control data to the mobile platform through a wireless communication link with the mobile platform. Therefore, under the condition that the intelligent glasses do not need to establish communication connection with the mobile platform, the mobile platform is remotely controlled.

In some embodiments, each terminal device corresponds to a remote control device, and the remote control device corresponding to each terminal device is different from the remote control devices corresponding to the other terminal devices.

Please refer to fig. 3, which illustrates a schematic structural diagram of a mobile platform control system according to an embodiment of the present application.

In fig. 3, a terminal device, a mobile platform, a remote control device are shown. The remote control device corresponding to the terminal device is the remote control device.

The terminal device has a wireless communication link 301 with the mobile platform and a communication connection 302 with the remote control device. The terminal equipment comprises a processor, a memory and a display screen. For example, the terminal device may be a mobile terminal, a notebook computer, or the like. The remote control device includes a processor, a memory, and a remote control unit operable by a remote operator of the mobile platform. Remote control components may include, but are not limited to: rocker, button.

The terminal device may communicate with the mobile platform via a wireless communication technology that is dedicated to communicating with the mobile platform. Accordingly, the wireless communication link 301 between the terminal device and the mobile platform may be a wireless communication link defined in a wireless communication technology specifically used for communicating with the mobile platform.

The communication connection 302 between the terminal device and the remote control device may be a wired communication connection.

For example, the terminal device communicates with the remote control device by USB technology. The communication connection between the terminal device and the remote control device is a USB connection as defined in USB technology.

The following illustrates a process for remotely controlling a mobile platform using a mobile platform control system:

the following description will be given by taking the example of forwarding remote control data to a mobile platform through terminal equipment:

the terminal equipment is intelligent glasses. The remote controller of the mobile platform wears the intelligent glasses. The mobile platform acquires a first-person visual angle image through an image sensor of the mobile platform in the flight process. The smart glasses receive the first-person perspective image from the mobile platform over the wireless communication link 301 and display the first-person perspective image. And a remote controller of the mobile platform sees the first person visual angle image through the intelligent glasses. The remote operator of the mobile platform performs remote operations on the remote control device. The remote control device transmits remote control data generated based on remote control operations by a remote controller of the mobile platform to the first smart eyewear over the communication connection 302. The smart glasses send remote control data to the mobile platform over wireless communication link 301 to remotely control the mobile platform.

Please refer to fig. 4, which illustrates another structural diagram of a mobile platform control system according to an embodiment of the present application.

In fig. 4, a first terminal device, a first remote control device, a mobile platform, a second terminal device, a second remote control device, and a communication connection relationship between the devices are shown. Those skilled in the art will appreciate that the present embodiment is only an exemplary description, and more terminals, such as a third terminal and a third remote control device, may be configured for controlling the mobile platform; a fourth terminal, a fourth remote control device, etc.

Each terminal device corresponds to a remote control device, and the remote control device corresponding to each terminal device is different from the remote control devices corresponding to other terminal devices. The first terminal device corresponds to the first remote control device, and the second terminal device corresponds to the second remote control device.

The following description will be given by taking the example of forwarding remote control data to a mobile platform through terminal equipment:

the terminal device may be a wearable device, for example, flight glasses with display functionality. In one aspect, the flying glasses receive video images from the mobile platform aerial via the communication map transmission link and display the video images to a user wearing the glasses via a display device of the glasses. On the other hand, the user controls the posture and the motion of the mobile platform through the remote controller.

In an alternative solution, the terminal device, for example, the flight glasses with display function and the remote controller communicate with the mobile platform via separate communication links. The flight glasses are mainly communicated with the mobile platform through the image transmission link, and the remote controller is communicated with the mobile platform through the control link. The scheme has certain disadvantages, for example, the communication stability of the control link is poor, and when the mobile platform flies to a longer distance, the control is possibly lost; establishing a high quality communication link between the mobile platform and the remote control alone implies higher costs.

In an alternative solution, a terminal device, such as flight glasses with display capability, and a remote control share a communication link to communicate with the mobile platform. The flight glasses are mainly communicated with the mobile platform through the image transmission link, and the remote controller is also communicated with the mobile platform through the image transmission link. As an alternative embodiment, the remote controller is connected with the flying glasses through a wire, and the control signal is transmitted to the image-transmitting transmitter of the flying glasses through a wire mode, and is transmitted to the mobile platform through the image-transmitting transmitter in an uplink mode. The scheme has the advantages that the transmission of the control signal and the image transmission signal can be realized by using one set of transmitting equipment, the image transmission signal has very good stability, and the effectiveness of the control signal can still be ensured in a longer distance range. Optionally, the remote controller and the flying glasses can be connected in a wireless mode, the remote controller sends a control signal generated by the operation of the remote controller by a user to the terminal device through the wireless module, and the terminal device forwards the control signal to the mobile platform.

The first remote control device and the second remote control device each comprise a processor, a memory, a remote control unit which can be operated by a remote controller of the mobile platform, and a connecting unit which is connected with the terminal device in a wired or wireless mode. Remote control components may include, but are not limited to: rocker, button. The first terminal device and the second terminal device both comprise a processor, a memory and a display screen.

The first terminal device has a wireless communication link 401 with the mobile platform and the first terminal device has a communication connection 402 with the first remote control device. The second terminal device has a wireless communication link 403 with the mobile platform and a communication connection 404 with the second remote control device.

The first terminal device is configured to: receive mobile platform movement associated data from the mobile platform over the wireless communication link 401 and display the movement associated data; remote control data generated by a remote control operation on the first remote control device is received from the first remote control device over the communication connection 402 and transmitted to the mobile platform over the wireless communication link 401.

The second terminal device is configured to: receive mobile platform movement associated data from the mobile platform over the wireless communication link 403 and display the movement associated data; remote control data generated by a remote control operation on the second remote control device is received from the second remote control device over the communication connection 404 and transmitted to the mobile platform over the wireless communication link 403.

In this application, the first remote control device and the second remote control device may alternately remotely control the mobile platform. In the process that the first remote control device and the second remote control device remotely control the mobile platform in turn, the remote control data of any one remote control device is not required to be forwarded to the mobile platform through other remote control devices, the transmission delay of the remote control data is reduced, communication connection is not required to be established between the first remote control device and the second remote control device, correspondingly, the first remote control device and the second remote control device are not required to be connected together through a transmission line, and the complexity of a remote controller for using the remote control devices is reduced.

For example, a first remote control device is used by a coach demonstrating the remote control mode of the mobile platform and a second remote control device is used by a student learning the remote control mode of the mobile platform. The remote control of the mobile platform by the trainer and trainee in turn may be referred to as a trainer mode. In the training mode, the remote control data generated by the remote control operation on the first remote control device is not required to be transmitted to the mobile platform through the second remote control device, and the remote control data generated by the remote control operation on the second remote control device is not required to be transmitted to the mobile platform through the first remote control device, so that the transmission delay of the remote control data is reduced. Accordingly, the first remote control device used by the coach and the second remote control device used by the student are not required to be connected together through a transmission line, and the complexity of using the remote control devices by a remote controller is reduced.

The following illustrates a process for remotely controlling a mobile platform using a mobile platform control system:

the first terminal equipment is first intelligent glasses, and the second terminal equipment is second intelligent glasses. The coach wears the first intelligent glasses, and the student wears the second intelligent glasses. The coach uses the first smart glasses and the first remote control device to remotely control the mobile platform, and the student uses the second smart glasses and the second remote control device to remotely control the mobile platform.

The mobile platform acquires a first-person visual angle image through an image sensor of the mobile platform in the flight process.

The first smart glasses receive the first person perspective image from the mobile platform over the wireless communication link 401 and display the first person perspective image. The second smart glasses receive the first-person perspective image from the mobile platform over the wireless communication link 403 and display the first-person perspective image.

Firstly, a coach utilizes the first intelligent glasses and the first remote control equipment to remotely control the mobile platform so as to demonstrate the remote control mode of the mobile platform for a student. The coach can see the first person perspective image through the first smart glasses worn. The coach performs remote control operations on the first remote control device. The first remote control device transmits remote control data generated based on the remote control operation of the trainer to the first smart glasses through the communication connection 402. The first smart glasses send the remote control data to the mobile platform via the wireless communication link 401 to remotely control the mobile platform.

During the time period when the coach utilizes the first intelligent glasses and the first remote control equipment to remotely control the mobile platform, the trainee can see the flight process of the mobile platform through the first person visual angle image displayed by the second intelligent glasses during the time period. Then, the student can remotely control the mobile platform by using the second intelligent glasses and the second remote control equipment to learn the remote control mode of the mobile platform demonstrated by the coach.

The trainee performs remote control operation on the second remote control device. The second remote control device transmits remote control data generated based on the remote control operation by the student to the second smart glasses through the communication connection 404. The second smart glasses transmit remote control data generated based on the remote control operation of the trainee to the mobile platform through the wireless communication link 403 to remotely control the mobile platform.

Referring to fig. 5, a flowchart of a mobile platform control method according to an embodiment of the present application is shown. The mobile platform control method provided by the embodiment of the application is suitable for the situation that at least one terminal device and at least one remote control device are used for remotely controlling the mobile platform. The method comprises the following steps:

step 501, receiving mobile associated data of a mobile platform through a wireless communication link between a terminal device and the mobile platform.

In this application, mobile association data for a mobile platform may be received by one or more modules on one or more of at least one terminal device over a wireless communication link between the terminal device and the mobile platform.

In this application, when the number of the terminal devices is multiple, each terminal device establishes a wireless communication link with the mobile platform.

In this application, when the number of the terminal devices and the number of the remote control devices are both multiple, each terminal device may correspond to one or more remote control devices of all the remote control devices.

Correspondingly, when one terminal device corresponds to a plurality of remote control devices in all the remote control devices, the terminal device and each remote control device in the plurality of remote control devices are in communication connection. For each of the plurality of remote control devices, when the mobile platform is remotely controlled by the remote control device, remote control data generated on the remote control device may be transmitted to the mobile platform by the terminal device to remotely control the mobile platform.

In some embodiments, the mobile associated data of the mobile platform comprises: and the first-person visual angle image is collected by the mobile platform. The terminal device may receive the first-person perspective image and display the first-person perspective image. The remote controller of the mobile platform can remotely control the mobile platform according to the seen first person-person view image, so that the mobile platform is remotely controlled according to the view angle of the mobile platform.

In some embodiments, each of the at least one terminal device comprises a smart wearable device. The intelligent wearing equipment comprises intelligent glasses. The intelligent glasses are used for displaying the images collected by the mobile platform in real time.

Step 502, receiving remote control data from the remote control device through the communication connection between the terminal device and the remote control device corresponding to the terminal device, and sending the remote control data to the mobile platform through the wireless communication link between the terminal device and the mobile platform.

In this application, remote control data may be received from a remote control device by one or more modules on one or more of the at least one terminal device through a communication connection between the terminal device and a remote control device corresponding to the terminal device, and transmitted to the mobile platform through a wireless communication link between the terminal device and the mobile platform.

In some embodiments, each of the at least one terminal device corresponds to a remote control device, and the remote control device corresponding to each terminal device is different from the remote control devices corresponding to the other terminal devices.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots. Remote control data transmitted to the mobile platform through a wireless communication link between the terminal device and the mobile platform is generated based on remote control operation performed on the remote control device. The remote control data collected by the remote control device is received from the remote control device, and the remote control data collected by the remote control device is sent to the mobile platform through the wireless communication link between the terminal device and the mobile platform, wherein the remote control data can be completed through a plurality of remote control data transmission time slots or a part of the remote control data transmission time slots.

During each remote control data transmission time slot associated with operations of receiving remote control data collected by the remote control device from the remote control device and transmitting the remote control data collected by the remote control device to the mobile platform through a wireless communication link between the terminal device and the mobile platform, a remote control data collection instruction may be transmitted to the remote control device to trigger the remote control device to collect remote control data.

In some embodiments, the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be split for transmission in each transmission time slot, i.e., a portion of the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be received from the remote control device in each remote control data transmission time slot, and a portion of the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform.

In some embodiments, the remote control data is operated at intervals much larger than the remote control data transmission time slots. The operation interval of the remote control data may be understood as a time length of the remote control operation for generating the remote control data. For example, the time duration of the remote control data transmission time slot is 5ms, and the time duration of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device is also several seconds at the shortest. The operation interval of the remote control data is much larger than the remote control data transmission time slot.

Referring to fig. 6, a flowchart of a mobile platform control method according to an embodiment of the present application is shown. The steps may be performed by a terminal device, the method comprising the steps of:

step 601, the terminal device receives mobile associated data of the mobile platform through a wireless communication link between the terminal device and the mobile platform.

In this application, the terminal device has a wireless communication link with the mobile platform. The terminal equipment can receive mobile associated data of the mobile platform from the mobile platform through a wireless communication link with the mobile platform and can also display the mobile associated data.

In the present application, the terminal device may communicate with the mobile platform through a wireless communication technology specifically used for communicating with the mobile platform. Accordingly, the wireless communication link between the terminal device and the mobile platform may be a wireless communication link defined in a wireless communication technology dedicated to communicating with the mobile platform.

In the present application, the mobile associated data of the mobile platform includes: the mobile platform collects the first-person view angle image. The terminal device may receive the first-person perspective image and display the first-person perspective image. The remote operator of the mobile platform can see the first person perspective image displayed through the terminal device. The remote controller of the mobile platform can remotely control the mobile platform according to the seen first person-person view image, so that the mobile platform is remotely controlled according to the view angle of the mobile platform.

In this application, the terminal device may be smart glasses. A remote operator of the mobile platform may wear smart glasses that receive mobile associated data of the mobile platform from the mobile platform and display the mobile associated data over a wireless communication link with the mobile platform.

In step 602, the terminal device receives remote control data from the remote control device through a communication connection with the remote control device and transmits the remote control data to the mobile platform through a wireless communication link with the mobile platform.

In this application, the communication connection between the terminal device and the remote control device may be a wired communication connection. The communication connection between the terminal device and the remote control device is, for example, a USB connection as defined in USB technology. The terminal device may receive remote control data from the remote control device via a USB connection with the remote control device.

In the application, a remote controller of the mobile platform can perform remote control operation on the remote control equipment, and remote control data can be generated through the remote control operation.

For example, the remote control device includes: a rocker. The remote operation on the remote control device by a remote operator of the mobile platform may be an operation of a joystick by the remote operator of the mobile platform.

In the application, after the terminal device receives the remote control data from the remote control device through the wireless communication link with the mobile platform, the terminal device can send the remote control data to the mobile platform through the wireless communication link with the mobile platform so as to remotely control the mobile platform.

For example, the terminal device is smart glasses. A remote controller of a mobile platform wears a pair of intelligent glasses, communication connection is arranged between the pair of intelligent glasses and the mobile platform, and communication connection is arranged between the pair of intelligent glasses and a remote control device used by the remote controller. The smart eyewear has received a first-person perspective image from a mobile platform over a wireless communication link with the mobile platform and displayed the first-person perspective image in step 601. The remote operator of the mobile platform performs remote operations on the remote control device. The intelligent glasses send remote control data generated based on remote control operation of the remote controller to the intelligent glasses through communication connection with the remote control device, and the intelligent glasses send the remote control data to the mobile platform through communication connection with the mobile platform.

In some embodiments, the terminal device receiving remote control data from the remote control device via a communication connection with the remote control device comprises: the terminal equipment sends a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data; receiving remote control data collected by the remote control equipment from the remote control equipment; and the terminal equipment sends the remote control data to the mobile platform through a wireless communication link with the mobile platform, and the method comprises the following steps: and the terminal equipment transmits the remote control data acquired by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

In some embodiments, the terminal device may correspond to one or more remote control devices. When the terminal device corresponds to a plurality of remote control devices, the terminal device and each remote control device in the plurality of remote control devices are in communication connection. For each of the plurality of remote control devices, when the mobile platform is remotely controlled by the remote control device, the terminal device transmits remote control data generated on the remote control device to the mobile platform to remotely control the mobile platform.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots. Remote control data transmitted to the mobile platform through a wireless communication link between the terminal device and the mobile platform is generated based on remote control operation performed on the remote control device. The remote control data collected by the remote control device is received from the remote control device, and the remote control data collected by the remote control device is sent to the mobile platform through the wireless communication link between the terminal device and the mobile platform, wherein the remote control data can be completed through a plurality of remote control data transmission time slots or a part of the remote control data transmission time slots.

During each remote control data transmission time slot associated with operations of receiving remote control data collected by the remote control device from the remote control device and transmitting the remote control data collected by the remote control device to the mobile platform through a wireless communication link between the terminal device and the mobile platform, a remote control data collection instruction may be transmitted to the remote control device to trigger the remote control device to collect remote control data.

In some embodiments, the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be split for transmission in each of a plurality of remote control data transmission time slots, i.e., a portion of the remote control data transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be received from the remote control device and transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform in each of the plurality of remote control data transmission time slots.

In some embodiments, the remote control data is operated at intervals much larger than the remote control data transmission time slots. The operation interval of the remote control data may be understood as a time length of the remote control operation for generating the remote control data.

For example, the time duration of the remote control data transmission time slot is 5ms, and the time duration of the remote control operation performed by the remote controller of the mobile platform on the remote control device corresponding to the terminal device is also several seconds at the shortest. The operation interval of the remote control data is much longer than the duration of the remote control data transmission time slot. The terminal equipment completes operations of triggering the remote control equipment to collect remote control data, receiving the remote control data from the remote control equipment, sending the remote control data to the mobile platform and the like in each remote control data transmission time slot in the plurality of remote control data transmission time slots. Thus, the remote control data is transmitted to the mobile platform with an ultra-low latency, so that a remote operator of the mobile platform remotely controls the mobile platform with an ultra-low latency.

Referring to fig. 7, a flowchart of a mobile platform control method according to an embodiment of the present application is shown. The various steps may be performed by a remote control device, the method comprising the steps of:

step 701, the remote control device collects remote control data.

In the application, the remote control device can detect the remote control operation of a remote controller of the mobile platform in the process of collecting remote control data. When the remote control device detects a remote operation by a remote operator of the mobile platform, the remote control device may generate remote control data in response to the remote operation by the remote operator of the mobile platform.

For example, the remote control device includes: a rocker. The remote operation by the remote operator of the mobile platform may be an operation of a joystick by the remote operator of the mobile platform. The remote operator of the mobile platform can move the rocker in the up, down, left, right directions, etc. When the remote control equipment detects that a remote controller of the unmanned aerial vehicle moves a rocker, the remote control equipment generates remote control data. The remote control data includes a stick amount.

Step 702, the remote control device sends remote control data to the terminal device through the communication connection with the terminal device.

In the application, the remote control device is in communication connection with the terminal device, and the terminal device is in communication connection with the mobile platform.

In this application, the communication connection between the remote control device and the terminal device may be a wired communication connection.

The communication connection between the remote control device and the terminal device is, for example, a USB connection as defined in USB technology.

In the application, the remote control device can transmit the acquired remote control data to the terminal device through the communication connection between the remote control device and the terminal device. After the terminal device receives the remote control data from the remote control device through the communication connection with the remote control device, the terminal device can send the remote control data to the mobile platform through the wireless communication link with the mobile platform so as to remotely control the mobile platform.

In some embodiments, the remote control device performs step 701 and step 702 in response to receiving a remote control data acquisition instruction sent by the terminal device through a communication connection with the terminal device.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots. Remote control data collected by the remote control device is generated based on a remote control operation performed on the remote control device.

The remote control device collects remote control data, sends the remote control data to the terminal device, and sends the remote control data collected by the remote control device to the mobile platform through a wireless communication link between the terminal device and the mobile platform, wherein the remote control data can be transmitted through a plurality of remote control data transmission time slots or a part of the remote control data transmission time slots.

In each remote control data transmission time slot associated with the mobile platform, the remote control device can receive a remote control data acquisition instruction at a moment in the remote control data transmission time slot and respond to the remote control data acquisition instruction to acquire remote control data.

In some embodiments, remote control data collected by the remote control device transmitted to the mobile platform over the wireless communication link between the terminal device and the mobile platform may be split for transmission in each of a plurality of remote control data transmission time slots. In each remote control data transmission time slot of the plurality of remote control data transmission time slots, a part of remote control data transmitted to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform can be collected, the part of remote control data is transmitted to the terminal equipment, and then the terminal equipment transmits the part of remote control data to the mobile platform through the wireless communication link between the terminal equipment and the mobile platform.

In each of the plurality of remote control data transmission time slots, the remote control device may perform steps 701 to 702 in the remote control data transmission time slot in response to receiving a remote control data acquisition instruction from the terminal device through a communication connection with the terminal device at a certain time in the remote control data transmission time slot.

In an alternative embodiment, shown in FIG. 8, a flying eyewear body 800, and a flying eyewear headband 801 as in the previous embodiments. The flight glasses headband 801 is assembled with the flight glasses body 800 via a docking assembly 803. The battery assembly is arranged in the second head ring main body 802, so that the balance weight of the video glasses head band 801 can be improved, the weight distribution of the whole machine is more balanced, and the wearing experience of a user is improved. The antenna assembly is additionally arranged in the first head ring main body 801 of the video glasses head band 801, so that the video glasses head band is wider in radiation range and more accurate in somatosensory remote control. Specifically, the antenna assembly includes an antenna 841 provided in the first and/or second head ring body 1 and 2. In this embodiment, an antenna assembly is added to the video headband, and the antenna assembly can be disposed in the first headband body 1 or the second headband body 2, so that the radiation range of the video headband is wider, and the radiation performance of the antenna 841 is improved.

In an alternative embodiment, as shown in fig. 9, the remote control may include an antenna, a joystick, a wired/wireless communication interface, and the like. On one hand, the remote controller can communicate with the mobile platform through the antenna to control the mobile platform; on the other hand, the remote controller can transmit the remote control command of the remote controller to the flight glasses such as shown in fig. 8 through the wired/wireless interface, and then transmit the remote controller command by using the image-transmitting transmitter of the flight glasses.

The embodiment of the present application further provides a terminal device, where the terminal device includes a processor and a memory, where the memory stores an operation instruction, and the processor operates the instruction, and is configured to: receiving mobile association data for a mobile platform from the mobile platform over a wireless communication link with the mobile platform; receiving remote control data from a remote control device over a communication connection with the remote control device; and transmitting the remote control data to the mobile platform through a wireless communication link with the mobile platform.

In some embodiments, the processor operates the instructions to further: sending a remote control data acquisition instruction to the remote control equipment to trigger the remote control equipment to acquire remote control data; receiving remote control data collected by the remote control device from the remote control device; and sending the remote control data collected by the remote control equipment to the mobile platform through a wireless communication link between the terminal equipment and the mobile platform.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots.

In some embodiments, the remote control data is transmitted in a split manner in each of a plurality of remote control data transmission time slots.

In some embodiments, the remote control data includes at least a stick amount, functional instructions of the remote control device.

In some embodiments, the remote control data is operated at intervals substantially greater than the remote control data transmission time slots.

In some embodiments, the terminal device corresponds to one or more remote control devices.

In some embodiments, the mobile associated data of the mobile platform comprises: and the first-person visual angle image is collected by the mobile platform.

In some embodiments, the terminal device comprises a smart wearable device.

In some embodiments, the smart wearable device includes smart glasses.

In some embodiments, smart glasses are used to display images captured by the mobile platform in real-time.

In some embodiments, the mobile platform may be a drone, a ground-based telerobot, an unmanned vehicle.

Referring to fig. 10, a schematic structural diagram of a terminal device that can implement the mobile platform control method provided in the embodiment of the present application is shown.

The terminal device comprises a processor 1010, a computer program product or computer readable medium in the form of a memory 1020, a display 1030. The memory 1020 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM.

The memory 1020 has storage space for program code for performing any of the method steps in the mobile platform control method described above. For example, the memory space for the program code may comprise respective program codes for implementing the respective steps in the above method, respectively. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such computer program products are typically portable or fixed storage units. The memory unit may have memory segments, memory spaces, etc. arranged similarly to memory 1020. The program code may be compressed, for example, in a suitable form. Typically, the memory unit comprises computer readable code, i.e. code that can be read by a processor, such as 1010 for example, which when run by a terminal device causes the terminal device to perform the steps of the mobile platform control method described above.

An embodiment of the present application further provides a remote control device, where the remote control device includes a processor and a memory, where an operation instruction is stored in the memory, and the processor operates the instruction, and is configured to: performing a remote control associated operation, the remote control associated operation comprising:

collecting remote control data;

and sending the remote control data to the terminal equipment through communication connection with the terminal equipment, wherein the terminal equipment sends the remote control data to the mobile platform through a wireless communication link with the mobile platform after receiving the remote control data.

In some embodiments, the processor operates the instructions to further:

and responding to a remote control data acquisition instruction sent by the terminal equipment received through the communication connection with the terminal equipment, and executing remote control associated operation.

In some embodiments, the operation time period of the remote control operation performed on the remote control device includes: a plurality of remote control data transmission time slots.

In some embodiments, the remote control data is transmitted in a split manner in each of the plurality of remote control data transmission slots.

Referring to fig. 11, a schematic structural diagram of a remote control device that can implement the mobile platform control method provided in the embodiment of the present application is shown.

The remote control device includes a processor 1110, a computer program product or computer readable medium in the form of a memory 1120, a joystick 1130, and buttons 1140. The memory 1120 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM.

The memory 1120 has storage space for program code for performing any of the method steps of the mobile platform control method described above. For example, the memory space for the program code may comprise respective program codes for implementing the respective steps in the above method, respectively. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such computer program products are typically portable or fixed storage units. The memory unit may have memory segments, memory spaces, etc. arranged similarly to the memory 1120. The program code may be compressed, for example, in a suitable form. Typically, the memory unit comprises computer readable code, i.e. code that can be read by a processor, such as 1110, for example, which code, when executed by a remote control device, causes the remote control device to perform the steps of the mobile platform control method described above.

The various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of a terminal device or remote control device according to embodiments of the present application. The present application may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present application may be stored on a computer readable medium or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

Reference herein to "one embodiment," "an embodiment," or "one or more embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Moreover, it is noted that instances of the word "in one embodiment" are not necessarily all referring to the same embodiment.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.