阅读说明：本技术 无人车提醒行人或车辆避让的方法、装置、无人车 (Method and device for reminding pedestrians or vehicles to avoid by unmanned vehicle and unmanned vehicle ) 是由 罗翔 于 2021-06-22 设计创作，主要内容包括：本公开公开了一种无人车提醒行人或车辆避让的方法,涉及人工智能领域,尤其涉及深度学习、云计算、NLP等领域,可以用于自动驾驶场景。具体实现方案为：获取用于提醒行人或车辆避让的提示语；以及在无人车的显示单元上显示提示语,其中,显示单元包括以下中的至少之一：挡风玻璃、车窗玻璃、安装在挡风玻璃上的投影屏幕、安装在车窗玻璃上的投影屏幕。(The utility model discloses a method for reminding pedestrians or vehicles to avoid by an unmanned vehicle, which relates to the field of artificial intelligence, in particular to the fields of deep learning, cloud computing, NLP and the like, and can be used in automatic driving scenes. The specific implementation scheme is as follows: acquiring a prompt word for reminding pedestrians or vehicles to avoid; and displaying a prompt on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.)

1. A method for reminding pedestrians or vehicles to avoid by an unmanned vehicle comprises the following steps:

acquiring a prompt word for reminding pedestrians or vehicles to avoid; and

displaying the prompt on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

2. The method of claim 1, wherein the windshield comprises at least one of: front windshield, rear windshield.

3. The method of claim 1 or 2, wherein said displaying the cue on the display unit of the unmanned vehicle comprises at least one of: based on the unmanned vehicle driving intention expressed by the cue words,

displaying the prompt in a specific position of the display unit of the unmanned vehicle;

displaying the prompt on the display unit of the unmanned vehicle with a specific text attribute;

and enabling the unmanned vehicle to display the prompt words on the display unit within a specific time period.

4. The method of claim 1, wherein the obtaining of the prompt for prompting the pedestrian or vehicle to avoid comprises:

acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data;

identifying the data currently acquired by the unmanned vehicle to obtain a corresponding identification result;

determining an unmanned vehicle driving scene matched with the recognition result; and

and acquiring a prompt associated with the driving scene of the unmanned vehicle to remind pedestrians or vehicles around the unmanned vehicle to avoid.

5. The method of claim 4, further comprising:

and under the condition that the driving scene of the unmanned vehicle matched with the recognition result is not determined, obtaining a prompt word issued by the server according to the recognition result and/or the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

6. The method of claim 1, wherein the obtaining of the prompt for prompting the pedestrian or vehicle to avoid comprises:

acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data;

uploading the data currently acquired by the unmanned vehicle to a server; and

and acquiring a prompt word issued by the server according to the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

7. The method of claim 4, further comprising:

transmitting unmanned vehicle data to a server, wherein the unmanned vehicle data comprises at least one of:

data currently acquired by the unmanned vehicle;

the recognition result;

unmanned vehicle driving scene information matched with the recognition result;

and a prompt associated with the unmanned vehicle driving scene information.

8. The method of claim 1, further comprising:

acquiring update data issued by a server; and

updating, using the update data, at least one of: the system comprises unmanned vehicle driving scene information stored locally by the unmanned vehicle, a prompt associated with the unmanned vehicle driving scene information stored locally by the unmanned vehicle, and an association relation between the unmanned vehicle driving scene information stored locally by the unmanned vehicle and the corresponding prompt.

9. An unmanned vehicle reminds pedestrians or vehicles to avoid, comprising:

the first acquisition module is used for acquiring a prompt for reminding pedestrians or vehicles to avoid; and

the display module is used for displaying the prompt words on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following components: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

10. The apparatus of claim 9, wherein the windshield comprises at least one of: front windshield, rear windshield.

11. The apparatus of claim 9 or 10, wherein the display module is further configured to perform at least one of the following operations based on the unmanned vehicle driving intention expressed by the cue:

displaying the prompt in a specific position of the display unit of the unmanned vehicle;

displaying the prompt on the display unit of the unmanned vehicle with a specific text attribute;

and enabling the unmanned vehicle to display the prompt words on the display unit within a specific time period.

12. The apparatus of claim 9, wherein the first obtaining means comprises:

the first acquisition unit is used for acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data;

the identification unit is used for identifying the data currently acquired by the unmanned vehicle to obtain a corresponding identification result;

the determining unit is used for determining the unmanned vehicle driving scene matched with the recognition result; and

and the second acquisition unit is used for acquiring a prompt associated with the driving scene of the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

13. The apparatus of claim 12, further comprising:

and the second acquisition module is used for acquiring a prompt word issued by the server according to the recognition result and/or the data currently acquired by the unmanned vehicle under the condition that the unmanned vehicle driving scene matched with the recognition result is determined not to be generated so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

14. The apparatus of claim 9, wherein the first obtaining means comprises:

a third obtaining unit, configured to obtain data currently collected by the unmanned vehicle, where the data currently collected by the unmanned vehicle includes at least one of: image data, radar data;

the uploading unit is used for uploading the data currently acquired by the unmanned vehicle to a server; and

and the fourth acquisition unit is used for acquiring a prompt word issued by the server according to the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

15. The apparatus of claim 12, further comprising:

the uploading module is used for transmitting the unmanned vehicle data to the server, wherein the unmanned vehicle data comprises at least one of the following data:

data currently acquired by the unmanned vehicle;

the recognition result;

unmanned vehicle driving scene information matched with the recognition result;

and a prompt associated with the unmanned vehicle driving scene information.

16. The apparatus of claim 9, further comprising:

the third acquisition module is used for acquiring the update data issued by the server; and

an updating module for updating at least one of the following data using the update data: the system comprises unmanned vehicle driving scene information stored locally by the unmanned vehicle, a prompt associated with the unmanned vehicle driving scene information stored locally by the unmanned vehicle, and an association relation between the unmanned vehicle driving scene information stored locally by the unmanned vehicle and the corresponding prompt.

17. An unmanned vehicle comprising: the unmanned vehicle of any one of claims 9 to 16, wherein the unmanned vehicle is a pedestrian or vehicle avoidance reminder.

18. A server, comprising:

the sending module is used for issuing a prompt for reminding pedestrians or vehicles to avoid to the unmanned vehicle, so that the unmanned vehicle obtains the prompt and displays the prompt on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following components: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

19. An unmanned vehicle reminder system comprising:

the unmanned vehicle of claim 17; and

the server of claim 18.

20. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

21. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-8.

22. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-8.

Technical Field

The present disclosure relates to the field of artificial intelligence, and in particular to the fields of deep learning, cloud computing, NLP, etc., which can be used in an autopilot scenario. In particular to a method and a device for reminding pedestrians or vehicles to avoid by an unmanned vehicle, the unmanned vehicle, a server, an unmanned vehicle reminding system, electronic equipment, a storage medium and a computer program product.

Background

With the rapid development of unmanned vehicles (called unmanned vehicles for short), more and more unmanned vehicles begin to shuttle in streets and alleys.

Disclosure of Invention

The present disclosure provides a method and apparatus for an unmanned vehicle to remind pedestrians or vehicles to avoid, an unmanned vehicle, a server, an unmanned vehicle reminding system, an electronic device, a storage medium, and a computer program product.

According to one aspect of the disclosure, a method for reminding a pedestrian or a vehicle to avoid by an unmanned vehicle is provided, wherein a prompt for reminding the pedestrian or the vehicle to avoid is obtained; and displaying the prompt on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

According to another aspect of the present disclosure, there is provided a device for reminding a pedestrian or a vehicle to avoid by an unmanned vehicle, including: the first acquisition module is used for acquiring a prompt for reminding pedestrians or vehicles to avoid; and the display module is used for displaying the prompt words on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following components: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

According to another aspect of the present disclosure, there is provided an unmanned vehicle including: the unmanned vehicle reminds pedestrians or vehicles to avoid in the embodiment of the disclosure.

According to another aspect of the present disclosure, there is provided a server including: the sending module is used for issuing a prompt for reminding pedestrians or vehicles to avoid to the unmanned vehicle, so that the unmanned vehicle obtains the prompt and displays the prompt on a display unit of the unmanned vehicle, wherein the display unit comprises at least one of the following components: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

According to another aspect of the present disclosure, there is provided an unmanned vehicle reminder system, comprising: the unmanned vehicle of the embodiment of the disclosure; and the server according to the embodiment of the disclosure.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method according to the embodiments of the present disclosure.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements a method according to embodiments of the present disclosure.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 illustrates a system architecture suitable for embodiments of the present disclosure;

FIG. 2 illustrates a flow chart of a method of an unmanned vehicle alerting a pedestrian or vehicle to avoid in accordance with an embodiment of the present disclosure;

FIG. 3 illustrates a schematic diagram of an unmanned vehicle alerting a pedestrian or vehicle to avoid in accordance with an embodiment of the present disclosure;

FIG. 4 illustrates a block diagram of an apparatus for an unmanned vehicle to alert a pedestrian or vehicle to avoid in accordance with an embodiment of the present disclosure;

FIG. 5 illustrates a block diagram of an unmanned vehicle, according to an embodiment of the present disclosure;

FIG. 6 illustrates a block diagram of a server, according to an embodiment of the present disclosure;

FIG. 7 illustrates a block diagram of an unmanned vehicle reminder system according to an embodiment of the present disclosure; and

FIG. 8 illustrates a block diagram of an electronic device used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

At present, though an unmanned vehicle is provided with a series of sensors and a high-precision recognition algorithm, surrounding pedestrians or vehicles can be recognized, and collision conflict with the surrounding pedestrians or vehicles is avoided. However, pedestrians or vehicles around the unmanned vehicle cannot communicate with the unmanned vehicle, so that the pedestrians or vehicles often cannot accurately and effectively understand the driving intention of the unmanned vehicle, and further potential road safety risks exist.

For example, when meeting a narrow-road meeting, vehicles moving in opposite directions can know their own driving intentions by flashing lights, whistling, language, gestures, facial expressions and the like under the condition that the driver exists, so that the vehicles can finally safely pass through the meeting road section.

When the unmanned vehicle gives a gift to pedestrians, the unmanned vehicle backs a car, the unmanned vehicle breaks down and the like, if surrounding vehicles and pedestrians can intuitively and effectively understand the current driving intention of the unmanned vehicle, the efficiency of safe road passing can be greatly improved.

In this regard, two solutions for the unmanned vehicle to express the driving intention of the unmanned vehicle are provided in the related art.

Scheme 1 utilizes on-vehicle signal lamp to remind vehicle, pedestrian in unmanned car the place ahead.

Scheme 2 utilizes the voice broadcast system of installing outside the car, reminds vehicle, pedestrian around the unmanned car.

It should be understood that, with the solution 1, there is no unified standard at present, the reminding modes of different vehicles are different, and even there are cases that the meanings of the same signal lamp color expressed in different brand vehicle types are completely opposite, thereby causing the driving intention of the unmanned vehicle to be difficult to be understood by surrounding pedestrians and vehicles. Further, in the case of the scheme 1, the in-vehicle signal lamp generally transmits the warning information in such a manner that the color of the lamp is changed, the frequency of blinking, or the like. The information transmission method transmits too few kinds of information, and cannot cover various complicated road scenes.

It should also be understood that with scheme 2, if the sound is too small when the voice is broadcasted, it is difficult to convey the reminding information to be conveyed to other vehicles or pedestrians in a noisy environment; if the voice is broadcast, the pedestrian is frightened if the voice is too loud. Furthermore, such a voice announcement system may not function at all for drivers in vehicles with particularly well-closed windows, or for pedestrians wearing headphones, or for pedestrians with hearing impairments.

Based on this, the embodiment of the disclosure provides a scheme that an unmanned vehicle can display the driving intention of the unmanned vehicle to remind pedestrians or vehicles to avoid, so that the probability of road safety accidents caused by misjudgment of the driving intention of the unmanned vehicle can be reduced, and the efficiency of road safe passing can be improved to a certain extent.

The present disclosure will be described in detail below with reference to the drawings and specific embodiments.

A system architecture of a method and a device for reminding pedestrians or vehicles to avoid by unmanned vehicles according to the embodiments of the present disclosure is introduced as follows.

FIG. 1 illustrates a system architecture suitable for embodiments of the present disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be used in other environments or scenarios.

As shown in fig. 1, the system architecture 100 may include: unmanned vehicle 101 and server 102.

The unmanned vehicle 101 may include a data collection module 1011, a central control vehicle module 1012, and a display module 1013. The server 102 may include a cloud control module 1021.

The data collection module 1011 may include an image acquisition device (e.g., a camera) and a radar. The image capture device may capture image data for an environment surrounding the unmanned vehicle. The radar may collect radar data for the environment surrounding the unmanned vehicle. The data collection module 1011 may send the collected image data and radar data to the central locomotive module 1012.

The central control vehicle module 1012 can identify the image data and the radar data acquired by the data acquisition module 1011, match a corresponding driving scene according to the identification result, associate a corresponding prompt capable of expressing the current driving intention of the unmanned vehicle according to the matched driving scene, and finally send the prompt to the display module 1013 for displaying, so that the purpose of expressing the current driving intention of the unmanned vehicle to remind surrounding pedestrians and vehicles to avoid is finally achieved.

In addition, the central car-mounted module 1012 can also send image data and radar data collected by the data collection module 1011, and other data to the cloud control module 1021. Wherein the other data includes: the central control car machine module 1012 obtains the recognition result, the driving scene matched by the recognition result, and the prompt associated by the driving scene.

In addition, in the case of a failure of an unmanned vehicle, the central vehicle module 1012 may further send an alarm message to the cloud control module 1021.

The display module 1013 may display a prompt to remind pedestrians and vehicles around the unmanned vehicle to avoid.

The server 102 may issue a corresponding prompt to the unmanned vehicle 101 according to the information uploaded by the unmanned vehicle 101 in case of a fault or other special conditions of the unmanned vehicle 101, so as to remind pedestrians and vehicles around the unmanned vehicle to avoid.

It should be understood that the number of unmanned vehicles and servers in fig. 1 is merely illustrative. There may be any number of unmanned vehicles and servers, as desired for implementation.

Application scenarios of the method and the device for reminding pedestrians or vehicles to avoid by the unmanned vehicle in the embodiment of the disclosure are introduced as follows.

It should be understood that the scheme for reminding pedestrians or vehicles to avoid by the unmanned vehicle provided by the embodiment of the disclosure can be applied to scenes such as automatic driving and intelligent transportation.

According to an embodiment of the disclosure, a method for reminding pedestrians or vehicles to avoid by an unmanned vehicle is provided.

Fig. 2 illustrates a flow chart of a method for an unmanned vehicle to alert pedestrians or vehicles to avoid according to an embodiment of the present disclosure.

As shown in fig. 2, a method 200 for an unmanned vehicle to alert a pedestrian or a vehicle to avoid may include: operations S210 to S220.

In operation S210, a prompt for prompting a pedestrian or a vehicle to avoid is obtained.

Operation S220, a prompt is displayed on a display unit of the unmanned vehicle, wherein the display unit includes at least one of: the screen comprises a windshield, a window glass, a projection screen arranged on the windshield and a projection screen arranged on the window glass.

In some embodiments of the present disclosure, in operation S210, a prompt that can express the current driving intention of the unmanned vehicle according to the image data and the radar data collected by the unmanned vehicle may be obtained.

Or, in other embodiments of the present disclosure, in operation S210, a prompt that can express the current driving intention of the unmanned vehicle and is issued by the cloud control module may be obtained.

Or, in other embodiments of the present disclosure, in operation S210, under normal conditions, a prompt that can express the current driving intention of the unmanned vehicle according to the image data and the radar data acquired by the unmanned vehicle may be obtained; under an abnormal condition, such as the condition that the unmanned vehicle has a fault or the unmanned vehicle cannot obtain a proper prompt language according to the image data and the radar data acquired by the unmanned vehicle, the prompt language which is issued by the cloud control module and can express the current driving intention of the unmanned vehicle can be obtained.

In the embodiment of the disclosure, the unmanned vehicle can display the prompt words at least one of the front windshield, the rear windshield, the left window, the right window, the projection screens arranged on the front windshield and the rear windshield, and the projection screens arranged on the left window and the right window, so as to express the driving intention of the unmanned vehicle and remind pedestrians and vehicles around the unmanned vehicle to avoid.

By adopting the embodiment of the disclosure, the driving intention of the unmanned vehicle is expressed by displaying the image-text prompt information, so that the aim of facilitating surrounding pedestrians and vehicles to understand the current driving intention of the unmanned vehicle can be achieved, the interference of the surrounding environment can be reduced, and the aim of effectively and accurately conveying the driving intention of the unmanned vehicle can be achieved.

In addition, through the embodiment of the disclosure, the functions and experiences in the related fields of automatic driving can be further improved, and the worry of the public on the driving safety of the unmanned automobile can be reduced.

As an alternative embodiment, the windscreen may comprise at least one of the following: front windshield, rear windshield.

Because no driver is arranged in the unmanned vehicle, the problem that the driving safety is affected due to the fact that the view of the unmanned vehicle is blocked does not exist. Thus, in the embodiments of the present disclosure, the driving intention of the unmanned vehicle may be expressed by only the front windshield, may be expressed by only the rear windshield, and may be expressed by both the front windshield and the rear windshield.

Through the embodiment of the disclosure, the prompt expressing the driving intention of the unmanned vehicle is displayed at least one of the front windshield and the rear windshield, and the problem that the sight line of a driver is blocked does not exist, so that the normal driving of the vehicle is not influenced, and the structure of the unmanned vehicle does not need to be changed. Moreover, vehicles and pedestrians around the unmanned vehicle can accurately and effectively understand the driving intention of the unmanned vehicle.

In addition, in the embodiment of the present disclosure, the display unit may further include an information projection screen installed on the front and rear windshields of the unmanned vehicle and/or an information projection screen installed on the left and right windows of the unmanned vehicle, and receive display data sent from the vehicle control unit module in the vehicle, and project image-text information to be displayed on the information projection screens of the front and rear windshields or the information projection screens of the left and right windows.

It should be appreciated that such a display unit does not require a change in the structure of the unmanned vehicle and does not affect the field of view of the unmanned vehicle.

As an alternative embodiment, displaying the cue on the display unit of the unmanned vehicle may include, based on the unmanned vehicle driving intention expressed by the cue, performing at least one of the following operations: displaying a prompt in a specific position of a display unit of the unmanned vehicle; displaying a prompt language with a specific text attribute on a display unit of the unmanned vehicle; and enabling the unmanned vehicle to display the prompt words on the display unit within a specific time period.

In the embodiment of the disclosure, the display time, the display position, the display style and the like of the prompt on the display unit can be flexibly controlled according to the unmanned vehicle driving intention expressed by the prompt.

For example, in the case where the message contains related information indicating the attention of the rear vehicle or the pedestrian, the message may be displayed on the rear windshield of the unmanned vehicle. Similarly, in the case where the message contains information related to the attention of a preceding vehicle or a pedestrian, the message may be displayed on the front windshield of the unmanned vehicle.

For example, for a particularly dangerous driving scene, the prompt may be displayed in red to indicate that the safety level is high and requires special attention from surrounding pedestrians and vehicles.

As an alternative embodiment, the prompt for reminding the pedestrian or the vehicle to avoid is obtained, and the method comprises the following operations.

Acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data.

And identifying the data currently acquired by the unmanned vehicle to obtain a corresponding identification result.

And determining the unmanned vehicle driving scene matched with the recognition result.

And acquiring a prompt word associated with the driving scene of the unmanned vehicle to remind pedestrians or vehicles around the unmanned vehicle to avoid.

It should be understood that the image data and radar data may reflect the conditions of the environment around the unmanned vehicle and the driving intent of the unmanned vehicle.

In the embodiment of the present disclosure, various driving scenes and various prompts may be preset, and a mapping relationship between each driving scene and each prompt may be configured. Therefore, in the driving process of the unmanned vehicle, the corresponding driving scene and the prompt words can be sequentially matched according to the recognition results aiming at the image data and the radar data, and the prompt words are displayed in the display unit so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

For example, in embodiments of the present disclosure, an unmanned vehicle may include a data collection module that may include, for example, a 360 ° wrap around vehicle-mounted infrared camera and a vehicle-mounted radar sensor. The data collection module can send image data and radar data to a central control vehicle machine module of the unmanned vehicle in real time after collecting the data, the central control vehicle machine module identifies the data to obtain a corresponding identification result, then matches a corresponding driving scene, further associates a corresponding prompt, and sends the prompt to the display unit for displaying.

Through the embodiment of the disclosure, the unmanned vehicle can identify and match the prompt words corresponding to the current driving scene by itself so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

Further, as an optional embodiment, the method may further include: and under the condition that the driving scene of the unmanned vehicle matched with the recognition result is not determined, obtaining a prompt word issued by the server according to the recognition result and/or the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

In some embodiments of the present disclosure, in some special cases, for example, in a case that the unmanned vehicle cannot match the current driving scene of the unmanned vehicle, a prompt issued by the server for the recognition result and/or the data currently acquired by the unmanned vehicle may be obtained and displayed to prompt pedestrians or vehicles around the unmanned vehicle to avoid.

Or, in other embodiments of the present disclosure, when the unmanned vehicle has a fault, a prompt issued by the server for the recognition result and/or the data currently acquired by the unmanned vehicle may be obtained and displayed to prompt pedestrians or vehicles around the unmanned vehicle to avoid the fault.

Or, in other embodiments of the present disclosure, in some special cases, for example, in a case that the unmanned vehicle cannot match the current driving scene of the unmanned vehicle, a default prompt may be further displayed to remind pedestrians or vehicles around the unmanned vehicle to avoid.

In addition, in this embodiment of the disclosure, under the condition that the unmanned vehicle breaks down or the unmanned vehicle cannot match the current driving scene of the unmanned vehicle, the unmanned vehicle may send warning information to the cloud control module to prompt the cloud to issue a corresponding prompt.

Through the embodiment of the disclosure, under the special condition or under the condition of unmanned vehicle fault, the prompt matched with the current driving scene of the unmanned vehicle can be issued by the cloud through the intervention of the cloud, so that the unmanned vehicle can accurately and effectively express the driving intention of the unmanned vehicle under the special condition, the road traffic rate is improved, and the traffic safety is ensured.

As an alternative embodiment, obtaining the prompt for reminding the pedestrian or the vehicle to avoid may include the following operations.

Acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data.

And uploading the data currently acquired by the unmanned vehicle to a server.

And obtaining a prompt language issued by the server according to the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

It should be noted that, in the embodiment of the present disclosure, a corresponding prompt may be obtained at the unmanned vehicle end according to data acquired by the unmanned vehicle, or a corresponding prompt may also be obtained at the cloud end according to data acquired by the unmanned vehicle, where a method for the cloud end to obtain the corresponding prompt according to the data acquired by the unmanned vehicle is similar to a method for the unmanned vehicle end to obtain the corresponding prompt according to the data acquired by the unmanned vehicle, and is not described herein again.

Through the embodiment of the disclosure, except for special conditions, under normal conditions, the prompt words matched with the current driving scene of the unmanned vehicle can be issued by the cloud through the intervention of the cloud, so that the aim of expressing the driving intention of the unmanned vehicle in multiple channels is fulfilled.

As an alternative embodiment, the method may further comprise: and transmitting the unmanned vehicle data to a server (such as a cloud server, short for cloud). Wherein the unmanned vehicle data comprises at least one of: data currently acquired by the unmanned vehicle; identifying a result; unmanned vehicle driving scene information matched with the recognition result; and a prompt associated with the unmanned vehicle driving scene information.

In the embodiment of the disclosure, the unmanned vehicle can acquire the data uploaded by the unmanned vehicle in real time, learn more driving scenes and driving intentions based on the acquired data, and provide data support for subsequent updating and upgrading of the unmanned vehicle system.

In addition, in this disclosed embodiment, unmanned car administrator can look over the content that unmanned car camera was shot in real time through high in the clouds control module to and the driving intention that the vehicle given. When the vehicle is in fault or cannot be matched with any built-in prefabricated driving scene, the unmanned vehicle management personnel can see the warning information and can select manual intervention to send the graphic and text information to be displayed to the central control vehicle machine module of the vehicle through the network, the central control vehicle machine module analyzes the data and then sends the data to the display unit, and finally, the corresponding graphic and text information is displayed to remind pedestrians and other vehicles around the vehicle to avoid the vehicle.

Through this disclosed embodiment, the high in the clouds can be according to more driving scenes of data study that unmanned car uploaded and the prompt language that corresponds to carry out system upgrade or data update to unmanned car, thereby continuously update perfect unmanned car's functional experience.

As an alternative embodiment, the method may further include the following operations.

And acquiring the update data issued by the server.

Updating, with the update data, at least one of: the method comprises the steps of obtaining unmanned vehicle driving scene information stored locally by an unmanned vehicle, prompting words related to the unmanned vehicle driving scene information stored locally by the unmanned vehicle, and the incidence relation between the unmanned vehicle driving scene information stored locally by the unmanned vehicle and the corresponding prompting words.

Through the embodiment of the disclosure, system upgrading or data updating can be carried out on the unmanned vehicle, so that the function experience of the unmanned vehicle is continuously updated and perfected.

The implementation principle of the embodiment of the present disclosure will be explained in detail below with reference to fig. 3.

As shown in fig. 3, the unmanned vehicle may collect image data and radar data of a surrounding environment through the data collection module 301, and send the collected image data and radar data to the central control vehicle module 302 of the unmanned vehicle in real time.

The unmanned vehicle can identify the image data and the radar data collected by the data collection module 301 through the central control vehicle module 302, match a corresponding driving scene according to an identification result, associate a corresponding prompt word capable of expressing the current driving intention of the unmanned vehicle according to the matched driving scene, and finally send the prompt word to the display module 303 in real time for displaying, so that the purpose of expressing the current driving intention of the unmanned vehicle to remind surrounding pedestrians and vehicles to avoid is finally achieved.

In addition, the central control locomotive module 302 can also send the image data and radar data collected by the data collection module 301, and other data to the cloud control module 304.

In addition, under the condition that the unmanned vehicle has a fault, the central vehicle control unit module 302 may further send warning information to the cloud control module 304.

The display module 303 may display a prompt to remind pedestrians and vehicles around the unmanned vehicle to avoid.

The cloud control module 304 may issue a corresponding prompt to the central control vehicle module 302 of the unmanned vehicle according to information uploaded by the unmanned vehicle when the unmanned vehicle has a fault or under other special conditions, so as to remind pedestrians and vehicles around the unmanned vehicle to avoid.

According to the embodiment of the disclosure, the disclosure further provides a device for reminding pedestrians or vehicles to avoid by the unmanned vehicles.

Fig. 4 illustrates a block diagram of an apparatus for an unmanned vehicle to alert a pedestrian or vehicle to avoid according to an embodiment of the present disclosure.

As shown in fig. 4, the device 400 for reminding a pedestrian or a vehicle of avoidance by an unmanned vehicle may include: a first acquisition module 410 and a display module 420.

The first obtaining module 410 is configured to obtain a prompt for reminding a pedestrian or a vehicle of avoiding.

A display module 420, configured to display the prompt on a display unit of the unmanned vehicle, where the display unit includes at least one of: the screen comprises a windshield, a vehicle window glass, a projection screen arranged on the windshield and a projection screen arranged on the vehicle window glass.

As an alternative embodiment, the windscreen comprises at least one of: front windshield, rear windshield.

As an optional embodiment, the display module is further configured to perform at least one of the following operations based on the unmanned vehicle driving intention expressed by the cue word: displaying the prompt in a specific position of the display unit of the unmanned vehicle; displaying the prompt words on the display unit of the unmanned vehicle according to specific text attributes; and enabling the unmanned vehicle to display the prompt words on the display unit within a specific time period.

As an alternative embodiment, the first obtaining module includes: the first acquisition unit is used for acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data; the identification unit is used for identifying the data currently acquired by the unmanned vehicle to obtain a corresponding identification result; the determining unit is used for determining the unmanned vehicle driving scene matched with the recognition result; and the second acquisition unit is used for acquiring a prompt associated with the driving scene of the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

As an alternative embodiment, the apparatus further comprises: and the second acquisition module is used for acquiring a prompt word issued by the server according to the recognition result and/or the data currently acquired by the unmanned vehicle under the condition that the unmanned vehicle driving scene matched with the recognition result is determined not to be generated so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

As an alternative embodiment, the first obtaining module includes: the third acquiring unit is used for acquiring data currently acquired by the unmanned vehicle, wherein the data currently acquired by the unmanned vehicle comprises at least one of the following data: image data, radar data; the uploading unit is used for uploading the data currently acquired by the unmanned vehicle to a server; and the fourth acquisition unit is used for acquiring a prompt word issued by the server aiming at the data currently acquired by the unmanned vehicle so as to remind pedestrians or vehicles around the unmanned vehicle to avoid.

As an alternative embodiment, the apparatus further comprises: the uploading module is used for transmitting the unmanned vehicle data to the server, wherein the unmanned vehicle data comprises at least one of the following data: data currently acquired by the unmanned vehicle; the recognition result; unmanned vehicle driving scene information matched with the recognition result; and a prompt associated with the unmanned vehicle driving scene information.

As an alternative embodiment, the apparatus further comprises: the third acquisition module is used for acquiring the update data issued by the server; and an updating module for updating at least one of the following data using the update data: the system comprises unmanned vehicle driving scene information locally stored by the unmanned vehicle, a prompt associated with the unmanned vehicle driving scene information locally stored by the unmanned vehicle, and an association relation between the unmanned vehicle driving scene information locally stored by the unmanned vehicle and the corresponding prompt.

It should be understood that the embodiments of the apparatus part of the present disclosure are the same as or similar to the embodiments of the method part of the present disclosure, and the technical problems to be solved and the technical effects to be achieved are also the same as or similar to each other, and the detailed description of the present disclosure is omitted.

According to the embodiment of this disclosure, this disclosure still provides an unmanned vehicle.

Fig. 5 illustrates a block diagram of an unmanned vehicle, according to an embodiment of the disclosure.

As shown in fig. 5, the unmanned vehicle 500 may include: and a device 510 for reminding pedestrians or vehicles to avoid by the unmanned vehicles.

It should be noted that, regarding the device 510 for reminding a pedestrian or a vehicle to avoid by an unmanned vehicle in the embodiment of the present disclosure, reference may be made to the related description in the foregoing embodiment, and details are not repeated herein.

According to an embodiment of the present disclosure, the present disclosure also provides a server.

Fig. 6 illustrates a block diagram of a server according to an embodiment of the present disclosure.

As shown in fig. 6, the server 600 may include: a sending module 610.

The sending module 610 is configured to issue a prompt for prompting a pedestrian or a vehicle to avoid to an unmanned vehicle, so that the unmanned vehicle obtains the prompt and displays the prompt on a display unit of the unmanned vehicle, where the display unit includes at least one of the following: the screen comprises a windshield, a vehicle window glass, a projection screen arranged on the windshield and a projection screen arranged on the vehicle window glass.

It should be noted that, regarding the unmanned vehicle in the embodiment of the present disclosure, reference may be made to the related description in the foregoing embodiment, and details are not repeated herein. In addition, the server in this embodiment may be a cloud server. The method for the server to obtain and issue the prompt to the unmanned vehicle may refer to the related description in the foregoing embodiments, and is not described herein again.

According to the embodiment of the disclosure, the disclosure further provides an unmanned vehicle reminding system.

Fig. 7 illustrates a block diagram of an unmanned vehicle reminder system according to an embodiment of the present disclosure.

As shown in fig. 7, the unmanned vehicle reminder system 700 may include: unmanned vehicle 710 and server 720.

It should be noted that, regarding the unmanned vehicle in the embodiment of the present disclosure, reference may be made to the related description in the foregoing embodiment, and details are not repeated herein. In addition, regarding the server in the embodiment of the present disclosure, reference may be made to the related description in the foregoing embodiment, and details are not repeated here.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 8 illustrates a schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 8, the electronic device 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic apparatus 800 can also be stored. The calculation unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

A number of components in the electronic device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, or the like; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, or the like; and a communication unit 809 such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

Computing unit 801 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The computing unit 801 performs the various methods and processes described above, such as a method in which an unmanned vehicle reminds a pedestrian or a vehicle to avoid. For example, in some embodiments, the method of an unmanned vehicle alerting a pedestrian or vehicle to avoid may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the memory unit 808. In some embodiments, part or all of the computer program can be loaded and/or installed onto device 800 via ROM 802 and/or communications unit 809. When loaded into RAM 803 and executed by computing unit 801, may perform one or more of the steps of the above-described method of unmanned vehicle alerting of pedestrians or vehicles to avoid. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the method of the unmanned vehicle alerting pedestrians or vehicles to avoid by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server may be a cloud Server, which is also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service extensibility in a traditional physical host and a VPS service ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server incorporating a blockchain.

In the technical scheme of the disclosure, the related data recording, storage, application and the like all accord with the regulations of related laws and regulations, and do not violate the good custom of the public order.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.