阅读说明：本技术 车辆轨迹预测方法、装置及电子设备 (Vehicle track prediction method and device and electronic equipment ) 是由 魏崇山 徐修信 魏晓宇 张艺浩 李东晨 韩志华 张旭 于 2021-09-15 设计创作，主要内容包括：本发明提供了一种车辆轨迹预测方法、装置及电子设备,在获取交通路口区域的信号灯信息后,根据信号灯信息以及预先获取的障碍物车辆的行驶信息,确定障碍物车辆的行驶逻辑,然后基于障碍物车辆的行驶逻辑及障碍物车辆的行驶信息,预测障碍物车辆的轨迹。本发明基于信号灯信息确定了障碍物车辆的行车逻辑,并基于行车逻辑和行驶信息预测障碍物车辆的轨迹,提高了轨迹预测的准确性。(The invention provides a vehicle track prediction method, a vehicle track prediction device and electronic equipment. The method and the device determine the driving logic of the obstacle vehicle based on the signal lamp information, and predict the track of the obstacle vehicle based on the driving logic and the driving information, so that the accuracy of track prediction is improved.)

1. A vehicle trajectory prediction method, characterized by comprising:

acquiring signal lamp information of a traffic intersection region;

determining the driving logic of the obstacle vehicle according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance;

and predicting the track of the obstacle vehicle based on the running logic and the running information of the obstacle vehicle.

2. The method of claim 1, wherein the step of obtaining signal light information for a traffic intersection region comprises:

determining whether the current vehicle drives into a related area of a traffic intersection area or not based on the acquired positioning information and map information of the current vehicle;

and if the current vehicle drives into the related area of the traffic intersection area, acquiring the signal lamp information of the traffic intersection area.

3. The method of claim 1, wherein the signal light information includes signal light information corresponding to a driving direction of a current vehicle;

determining a driving logic of the obstacle vehicle according to the signal light information and the driving information of the obstacle vehicle acquired in advance, wherein the step comprises the following steps:

determining signal lamp information corresponding to the driving direction of the obstacle vehicle according to the signal lamp information corresponding to the driving direction of the current vehicle and the driving information of the obstacle vehicle acquired in advance;

and determining the driving logic of the obstacle vehicle according to the signal lamp information corresponding to the driving direction of the obstacle vehicle and the driving information of the obstacle vehicle.

4. The method of claim 3, wherein the signal light information includes the number, position and color of signal lights corresponding to the driving direction of the current vehicle; the driving information of the obstacle vehicle comprises a driving direction of the obstacle vehicle and a current driving lane;

the step of determining the signal light information corresponding to the driving direction of the obstacle vehicle according to the signal light information corresponding to the driving direction of the current vehicle includes:

when the number of the signal lamps is one and the color of the signal lamp corresponding to the driving direction of the current vehicle is green, if the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is red;

when the number of the signal lamps is one and the color of the signal lamp corresponding to the running direction of the current vehicle is red, if the running direction of the obstacle vehicle is the same as or opposite to the running direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red; if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is green;

when the number of the signal lamps is two, the color of the signal lamp at the position corresponding to the running direction of the current vehicle, which is the left side, and the color of the signal lamp at the position corresponding to the running direction of the current vehicle are both red, and when the running direction of the obstacle vehicle is the same as or opposite to the running direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is green;

when the number of the signal lamps is two, the color of the signal lamp corresponding to the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, and the color of the signal lamp corresponding to the obstacle vehicle is determined to be green when the position corresponding to the driving direction of the current vehicle is the left signal lamp or the position corresponding to the right signal lamp; when the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is red;

when the number of the signal lamps is three, the color of the signal lamp at the left side corresponding to the driving direction of the current vehicle and the color of the signal lamp at the middle position are both red, and when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is green;

when the number of the signal lamps is three, the color of the signal lamp corresponding to the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, and the color of the signal lamp corresponding to the obstacle vehicle is determined when the position corresponding to the driving direction of the current vehicle is the left signal lamp or the color of the signal lamp corresponding to the middle position is green; and when the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red.

5. The method according to claim 3, wherein the signal light information corresponding to the traveling direction of the obstacle vehicle includes a color of a signal light corresponding to the traveling direction of the obstacle vehicle; the travel information of the obstacle vehicle includes a current position of the obstacle vehicle;

a step of determining a driving logic of the obstacle vehicle based on signal light information corresponding to a driving direction of the obstacle vehicle and the driving information, including:

if the color of the signal lamp corresponding to the driving direction of the obstacle vehicle is green, determining that the driving logic of the obstacle is to continue to move forwards;

if the color of a signal lamp corresponding to the driving direction of the obstacle vehicle is red, judging whether the current position of the obstacle vehicle exceeds a preset stop line or not;

if the vehicle speed exceeds the preset speed, determining that the driving logic of the obstacle vehicle is to continue to advance;

if not, determining that the barrier vehicle's travel logic is to stop before the stop-line.

6. The method of claim 1, wherein the driving information comprises road topology information; the road topology information comprises a plurality of driving lanes;

the step of predicting the trajectory of the obstacle vehicle based on the travel logic of the obstacle vehicle and the travel information includes:

inputting the road topology information of the obstacle vehicle into a pre-trained neural network to obtain the probability that the obstacle vehicle runs along a preset running lane in the topology information;

determining a preset driving lane with the probability larger than a preset threshold value as a predicted driving lane of the obstacle vehicle;

predicting a trajectory of the obstacle vehicle based on the travel logic of the obstacle vehicle, the predicted travel lane, and the travel information.

7. The method according to claim 6, wherein the travel information of the obstacle vehicle includes a travel speed and an acceleration of the obstacle vehicle;

predicting a trajectory of the obstacle vehicle based on the travel logic of the obstacle vehicle, the predicted travel lane, and the travel information, comprising:

if the driving logic of the obstacle vehicle is stopping before the stop line, fitting to obtain a track from the obstacle vehicle to the stop line stopping process based on a preset algorithm and the predicted driving lane, speed and acceleration of the obstacle vehicle;

and if the driving logic of the obstacle vehicle is to continue to advance, fitting to obtain the track of the obstacle vehicle in the preset time based on a preset algorithm and the predicted driving lane, the speed and the acceleration of the obstacle vehicle.

8. A vehicle trajectory prediction device characterized by comprising:

the information acquisition device is used for acquiring signal lamp information of a traffic intersection region;

the driving logic determination module is used for determining the driving logic of the obstacle vehicle according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance;

a trajectory prediction module to predict a trajectory of the obstacle vehicle based on the travel logic of the obstacle vehicle and the travel information.

9. An electronic device, comprising a processor and a memory, the memory storing computer-executable instructions executable by the processor, the processor executing the computer-executable instructions to implement the vehicle trajectory prediction method of any one of claims 1 to 7.

10. A computer-readable storage medium having computer-executable instructions stored thereon which, when invoked and executed by a processor, cause the processor to implement the vehicle trajectory prediction method of any one of claims 1 to 7.

Technical Field

The present invention relates to the field of trajectory prediction technologies, and in particular, to a vehicle trajectory prediction method, a vehicle trajectory prediction device, and an electronic device.

Background

In the traffic intersection area, the predicted track of other obstacle vehicles greatly influences the decision and planning of the own vehicle. In the prior art, the track of the obstacle vehicle is generally predicted based on the motion parameters of the obstacle vehicle. However, the prediction accuracy of this approach is low.

Disclosure of Invention

In view of the above, the present invention provides a method, an apparatus and an electronic device for predicting a vehicle trajectory, so as to improve the accuracy of the trajectory prediction.

In a first aspect, an embodiment of the present invention provides a vehicle trajectory prediction method, including: acquiring signal lamp information of a traffic intersection region; determining the driving logic of the obstacle vehicle according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance; the trajectory of the obstacle vehicle is predicted based on the travel logic and the travel information of the obstacle vehicle.

With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the step of acquiring signal light information of a traffic intersection area includes: determining whether the current vehicle drives into a related area of a traffic intersection area or not based on the acquired positioning information and map information of the current vehicle; and if the current vehicle drives into the related area of the traffic intersection area, acquiring the signal lamp information of the traffic intersection area.

With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the signal light information includes signal light information corresponding to a current driving direction of the vehicle; the method for determining the driving logic of the obstacle vehicle according to the signal light information and the driving information of the obstacle vehicle acquired in advance comprises the following steps: determining signal lamp information corresponding to the driving direction of the obstacle vehicle according to signal lamp information corresponding to the driving direction of the current vehicle and the driving information of the obstacle vehicle acquired in advance; and determining the driving logic of the obstacle vehicle according to the signal light information and the driving information corresponding to the driving direction of the obstacle vehicle.

With reference to the second possible implementation manner of the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the signal light information includes the number, the position, and the color of a signal light corresponding to the current driving direction of the vehicle; the driving information of the obstacle vehicle comprises the driving direction of the obstacle vehicle and the current driving lane; the step of determining signal light information corresponding to the driving direction of the obstacle vehicle according to the signal light information corresponding to the driving direction of the current vehicle includes: when the number of the signal lamps is one and the color of the signal lamp corresponding to the driving direction of the current vehicle is green, if the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is red; when the number of the signal lamps is one and the color of the signal lamp corresponding to the driving direction of the current vehicle is red, if the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red; if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; when the number of the signal lamps is two, the color of the signal lamp at the position corresponding to the driving direction of the current vehicle, which is the left side, and the color of the signal lamp at the position corresponding to the right side are both red, and when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; when the number of the signal lamps is two, the color of the signal lamp corresponding to the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, and the position corresponding to the driving direction of the current vehicle is the left signal lamp or the position corresponding to the right signal lamp is green; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, determining that the color of a signal lamp corresponding to the obstacle vehicle is red; when the number of the signal lamps is three, the color of the signal lamp at the left side corresponding to the driving direction of the current vehicle and the color of the signal lamp at the middle position are red, and when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; when the number of the signal lamps is two or three, the color of the signal lamp corresponding to the obstacle vehicle is green, and the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle; and when the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red.

With reference to the second possible implementation manner of the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, wherein the signal light information corresponding to the driving direction of the obstacle vehicle includes a color of a signal light corresponding to the driving direction of the obstacle vehicle; the travel information of the obstacle vehicle includes a current position of the obstacle vehicle; the step of determining a driving logic of the obstacle vehicle based on the traffic light information and the driving information corresponding to the driving direction of the obstacle vehicle includes: if the color of the signal lamp corresponding to the driving direction of the obstacle vehicle is green, determining that the driving logic of the obstacle is to continue to move forwards; if the color of a signal lamp corresponding to the driving direction of the obstacle vehicle is red, judging whether the current position of the obstacle vehicle exceeds a preset stop line or not; if the vehicle speed exceeds the preset speed, determining that the driving logic of the obstacle vehicle is to continue to advance; if not, the barrier vehicle's travel logic is determined to be stopped before the stop line.

With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the step of predicting the trajectory of the obstacle vehicle based on the driving logic and the driving information of the obstacle vehicle includes: inputting the road topology information of the obstacle vehicle into a pre-trained neural network to obtain the probability that the obstacle vehicle runs along a preset running lane in the road topology information; determining a preset driving lane with the probability larger than a preset threshold value as a predicted driving lane of the obstacle vehicle; the trajectory of the obstacle vehicle is predicted based on the travel logic, the predicted travel lane, and the travel information of the obstacle vehicle.

With reference to the fifth possible implementation manner of the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, wherein the running information of the obstacle vehicle includes a running speed and an acceleration of the obstacle; the step of predicting a trajectory obstacle of the obstacle vehicle based on the travel logic, the predicted travel lane, and the travel information of the obstacle vehicle includes: if the driving logic of the obstacle vehicle is stopping before the stop line, fitting to obtain a track of the obstacle vehicle to the stop line stopping process based on a preset algorithm and the predicted driving lane, speed and acceleration of the obstacle vehicle; and if the driving logic of the obstacle vehicle is to continue to move forward, fitting to obtain the track of the obstacle vehicle in the preset time based on a preset algorithm and the predicted driving lane, speed and acceleration of the obstacle vehicle.

In a second aspect, an embodiment of the present invention further provides a vehicle trajectory prediction apparatus, including: the information acquisition device is used for acquiring signal lamp information of a traffic intersection region; the driving logic determination module is used for determining the driving logic of the obstacle vehicle according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance; and the track prediction module is used for predicting the track of the obstacle vehicle based on the running logic and the running information of the obstacle vehicle.

In a third aspect, an embodiment of the present invention further provides an electronic device, including a processor and a memory, where the memory stores machine executable instructions capable of being executed by the processor, and the processor executes the machine executable instructions to implement the vehicle trajectory prediction method.

In a fourth aspect, embodiments of the present invention also provide a machine-readable storage medium storing machine-executable instructions that, when invoked and executed by a processor, cause the processor to implement the vehicle trajectory prediction method described above.

The embodiment of the invention has the following beneficial effects:

according to the vehicle track prediction method, the vehicle track prediction device and the electronic equipment, after signal lamp information of a traffic intersection area is obtained, the driving logic of an obstacle vehicle is determined according to the signal lamp information and the driving information of the obstacle vehicle obtained in advance, and then the track of the obstacle vehicle is predicted based on the driving logic of the obstacle vehicle and the driving information of the obstacle vehicle. The method determines the driving logic of the obstacle vehicle based on the signal lamp information, and predicts the track of the obstacle vehicle based on the driving logic and the driving information, so that the accuracy of track prediction is improved.

Additional features and advantages of the disclosure will be set forth in the description which follows, or in part may be learned by the practice of the above-described techniques of the disclosure, or may be learned by practice of the disclosure.

In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a flow chart of a vehicle trajectory prediction method according to an embodiment of the present invention;

FIG. 2 is a flow chart of another vehicle trajectory prediction method provided by an embodiment of the present invention;

FIG. 3 is a flow chart of another vehicle trajectory prediction method provided by an embodiment of the present invention;

FIG. 4 is a logic flow diagram of a signal lamp according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a vehicle trajectory prediction apparatus according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

At present, trajectory prediction is one of the difficulties in the field of automatic driving, particularly, the prediction difficulty is increased in a complex scene of a traffic intersection, and the current algorithms mainly include a markov model, a dynamic bayesian network model and the like based on a traditional machine learning model, or a multi-layer perceptron model, a long-short term memory model, a graph neural network and the like based on deep learning.

The predicted tracks of other barrier vehicles at the traffic intersection greatly influence the decision and planning of the vehicles, wherein the influence of traffic lights on track prediction is often decisive, and the current algorithm has little information and is difficult to add the information of the traffic lights into the algorithm, so that the accuracy of the predicted result of the vehicle tracks in the traffic intersection area is low.

Based on this, the vehicle track prediction method, the device and the system provided by the embodiment of the invention can be applied to the positions of areas such as traffic intersections.

For the convenience of understanding the present embodiment, a vehicle trajectory prediction method disclosed in the present embodiment will be described in detail first.

An embodiment of the present invention provides a vehicle trajectory prediction method, as shown in fig. 1, the method includes the following steps:

and S100, acquiring signal lamp information of a traffic intersection region.

The signal light information may include the number, position information and color information of signal lights in the current vehicle driving direction or all directions, and may also be semantic information of the signal lights. The position information of the signal lamps can be relative position information of each signal lamp, for example, if a group of signal lamps is arranged in the driving direction of the current vehicle, the group of signal lamps comprises two signal lamps, namely a signal lamp positioned on the left side and used for indicating a left turn and a signal lamp positioned on the right side and used for indicating a straight running and a right turn. The acquired signal light information may be that the number of the group of signal lights is 2, the position information is left and right, the color information is that the color of the signal light on the left side is red, the signal light on the right side is red, and the corresponding semantic information may be that the left turn and the straight movement are prohibited for the driving direction of the current vehicle, and the right turn is possible.

And step S102, determining the driving logic of the obstacle vehicle according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance.

When the traffic light information includes the location, color, semantic information, etc. of the traffic light in the current vehicle traveling direction, since the indication information of the traffic light in each direction has a certain logical relationship, the traveling logic of the obstacle vehicle, such as continuing traveling or stopping before the stop line, can be determined based on the traveling information of the obstacle vehicle, such as the traveling direction of the current obstacle vehicle, the relationship (such as direction, reverse direction, etc.) between the traveling direction and the current vehicle traveling direction. If the signal lights of the current vehicle in the running direction are all red and the running direction of the obstacle vehicle is the same as or opposite to the current vehicle running direction, if the obstacle vehicle does not exceed the stop line, the running logic of the obstacle vehicle is to stop before the stop line, and if the obstacle vehicle exceeds the stop line, the running logic of the obstacle vehicle is to continue running.

When the traffic light information includes traffic light positions, colors, semantic information, or the like for all traveling directions, the traveling logic of the obstacle vehicle may be determined based on the traffic light positions, colors, semantic information, or the like corresponding to the traveling lane of the obstacle vehicle.

In step S104, the trajectory of the obstacle vehicle is predicted based on the travel logic and the travel information of the obstacle vehicle.

Specifically, different prediction methods may be employed for obstacle vehicles having different travel logics. For example, for an obstacle vehicle whose travel logic is stopping before the stop line, the trajectory of the obstacle vehicle stopping before the stop line may be generated based on a preset algorithm using the travel information such as the speed, acceleration, and current position of the obstacle vehicle. For the obstacle vehicle with the running logic of continuous running, the track of continuous running of the obstacle vehicle within the preset time can be generated by using the running information such as the speed, the acceleration and the current position of the obstacle vehicle based on a preset algorithm.

In addition, since the obstacle vehicle may have a lane change, before the trajectory of the obstacle vehicle is predicted, the probability that the obstacle vehicle travels along a certain lane in the road topology may be determined by a preset neural network model or the like, and if the probability is smaller than a preset probability threshold, the trajectory is not predicted.

According to the vehicle track prediction method provided by the embodiment of the invention, after the signal lamp information of the traffic intersection area is acquired, the driving logic of the obstacle vehicle is determined according to the signal lamp information and the driving information of the obstacle vehicle acquired in advance, and then the track of the obstacle vehicle is predicted based on the driving logic of the obstacle vehicle and the driving information of the obstacle vehicle. The method determines the driving logic of the obstacle vehicle based on the signal lamp information, and predicts the track of the obstacle vehicle based on the driving logic and the driving information, so that the accuracy of track prediction is improved.

The embodiment of the invention also provides another vehicle track prediction method which is realized on the basis of the method shown in the figure 1. The method mainly describes a specific process of acquiring signal light information of a traffic intersection area, and a specific process of determining a driving logic of an obstacle vehicle according to the signal light information and pre-acquired driving information of the obstacle vehicle, and as shown in fig. 2, the method comprises the following steps:

and step S200, determining whether the current vehicle enters the related area of the traffic intersection area or not based on the acquired positioning information and map information of the current vehicle. Usually, the map information is acquired in advance, and the map information includes position information of each traffic intersection. Whether the current vehicle drives into a relevant area of the traffic intersection area can be determined by judging whether the position of the current vehicle is within a certain area range including the traffic intersection area.

Step S202, if the current vehicle enters the related area of the traffic intersection area, the signal lamp information of the traffic intersection area is obtained. The signal light information may include signal light information corresponding to a driving direction of the current vehicle.

Step S204, signal lamp information corresponding to the driving direction of the obstacle vehicle is determined according to the signal lamp information corresponding to the driving direction of the current vehicle and the driving information of the obstacle vehicle acquired in advance.

Specifically, the signal light information may include the number, position, and color of signal lights corresponding to the current driving direction of the vehicle; the driving information of the obstacle vehicle may include a driving direction of the obstacle vehicle and a current driving lane.

When the number of the signal lamps is one and the color of the signal lamp corresponding to the driving direction of the current vehicle is green, if the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green; and if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red.

When the number of the signal lamps is one and the color of the signal lamp corresponding to the driving direction of the current vehicle is red, if the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red; and if the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is green.

When the number of the signal lamps is two, the color of the signal lamp at the position corresponding to the driving direction of the current vehicle, which is the left side, and the color of the signal lamp at the position corresponding to the right side are both red, and when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be green, and the color of the signal lamp corresponding to the current vehicle is red, so that the current vehicle is not influenced.

When the number of the signal lamps is two, the color of the signal lamp corresponding to the current driving lane of the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle when the color of the signal lamp corresponding to the current driving direction of the obstacle vehicle is green and the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, and at the moment, the color of the signal lamp corresponding to the current driving lane of the obstacle vehicle is determined according to whether the current driving lane of the obstacle vehicle is a left driving lane, a straight driving lane or a right driving lane, so that the color of the signal lamp corresponding to the obstacle vehicle is determined; and when the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red.

When the number of the signal lamps is three, the color of the signal lamp at the left side corresponding to the driving direction of the current vehicle and the color of the signal lamp at the middle position are red, and when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be red; when the driving direction of the obstacle vehicle is different from or opposite to the driving direction of the current vehicle, the color of the signal lamp corresponding to the obstacle vehicle is determined to be green, and the color of the signal lamp corresponding to the current vehicle is red, so that the current vehicle is not influenced.

When the number of the signal lamps is three, the color of the signal lamp corresponding to the obstacle vehicle is determined based on the current driving lane of the obstacle vehicle when the driving direction of the obstacle vehicle is the same as or opposite to the driving direction of the current vehicle, and the color of the signal lamp corresponding to the obstacle vehicle is determined when the position corresponding to the driving direction of the current vehicle is the left signal lamp or the position corresponding to the middle signal lamp is green; and when the driving direction of the obstacle vehicle is not the same as or opposite to the driving direction of the current vehicle, determining that the color of the signal lamp corresponding to the obstacle vehicle is red.

In step S206, the driving logic of the obstacle vehicle is determined based on the traffic light information and the driving information corresponding to the driving direction of the obstacle vehicle.

The traffic light information corresponding to the driving direction of the obstacle vehicle may include a color of a traffic light corresponding to the driving direction of the obstacle vehicle; the travel information of the obstacle vehicle may include a current position of the obstacle vehicle. When the driving logic is determined, if the color of a signal lamp corresponding to the driving direction of the obstacle vehicle is green, determining that the driving logic of the obstacle is to continue to move forwards; if the color of a signal lamp corresponding to the driving direction of the obstacle vehicle is red, judging whether the current position of the obstacle vehicle exceeds a preset stop line or not; if the vehicle speed exceeds the preset speed, determining that the driving logic of the obstacle vehicle is to continue to advance; if not, the barrier vehicle's travel logic is determined to be stopped before the stop line.

Step S208, the road topology information of the obstacle vehicle is input into a pre-trained neural network, and the probability that the obstacle vehicle runs along a preset running lane in the road topology information is obtained.

And step S210, determining the preset driving lane with the probability greater than the preset threshold value as the predicted driving lane of the obstacle vehicle.

In step S212, the trajectory of the obstacle vehicle is predicted based on the travel logic, the predicted travel lane, and the travel information of the obstacle vehicle.

The driving information of the obstacle vehicle includes a driving speed and an acceleration of the obstacle; if the driving logic of the obstacle vehicle is stopping before the stop line, fitting to obtain a track of the obstacle vehicle to the stop line stopping process based on a preset algorithm and the predicted driving lane, speed and acceleration of the obstacle vehicle; and if the driving logic of the obstacle vehicle is to continue to move forward, fitting to obtain the track of the obstacle vehicle in the preset time based on a preset algorithm and the predicted driving lane, speed and acceleration of the obstacle vehicle.

In the method, in the process of predicting the track of the obstacle vehicle, the signal lamp information of the traffic intersection is referred, so that the accuracy of track prediction is improved.

The embodiment of the invention also provides another vehicle track prediction method which is realized on the basis of the method shown in the figure 1. As shown in fig. 3, the method comprises the steps of:

1. making a road topological graph: firstly, a road topological graph is established for each vehicle needing prediction according to map information, for example, a current lane of the vehicle is a lane sequence, id is 0, a left lane is a lane sequence, id is 1, a right lane is a lane sequence, id is 2, each lane sequence contains one or more lanes, for example, one lane every 50 meters on the current lane, and the search range of each lane sequence is set to be 100 meters, so that two lanes may be included in the lane sequence of the current road of the vehicle at a certain moment, and id is 1001 and 1002 respectively.

2. Sensing front signal lamp information by the self vehicle: the method comprises the steps that a road scene in front is obtained according to positioning information and map information of a vehicle, and when the vehicle approaches a traffic intersection, a perception camera can identify the color of a traffic light in the traffic intersection in front and output the color.

3. Reasoning signal lamps in the whole intersection according to the signal lamps observed by the vehicle: after the self-vehicle senses the information of the front signal lamps, the id of the traffic light corresponding to the current road of the self-vehicle is obtained according to the map information, and then the traffic light information of the left side, the right side and the opposite direction can be deduced according to the information of the front traffic light, as shown in fig. 4, the logic is as follows (the condition that the right signal lamps are arrow lamps is not considered at present):

a, when there is only one traffic light in the front, if it is green, the left turn (u-turn), straight going and right turn are all green, then the lights in the opposite direction are the same as the front, and the left turn (u-turn), straight going and right turn on the left and right sides are all red.

b when the front side has two traffic lights, the traffic light on the left side controls left turning (turning around), and the traffic light on the right side controls straight going and right turning. The signals in the opposite direction are consistent with the signals in the front direction, when the signals in the left turn (turn around) or the straight line in the front direction are red and green, the signals in the left turn (turn around) and the straight line in the left and right sides are red, and the signals in the right turn are green, otherwise, the signals in the left turn (turn around), the straight line and the right turn in the left and right sides are green.

And c, when three traffic lights exist at the front, the light at the left side correspondingly turns left (turns around), the light at the middle correspondingly moves straight, and the light at the right side correspondingly turns right. The inference logic is the same as for the two traffic lights described above.

4. Acquiring information of signal lamp groups in the junction, wherein the information comprises the signal lamp id in each group and the relation between each group: the method comprises the steps of obtaining information in a forward traffic intersection junction according to map information, wherein the information comprises the ids of all signal lamp groups in the junction in the same direction, each signal lamp group comprises a plurality of signal lamps, each signal lamp is provided with a corresponding id, a left turn lamp, a straight lamp and a right turn lamp, and the relative position relation of each signal lamp group, such as the id of a signal lamp group in the opposite direction of a signal lamp group No. 1 is 3, the id of a signal lamp group on the left side is 2, and the id of a signal lamp group on the right side is 4.

5. And judging whether the signal lamp corresponding to the lane where the own vehicle is located is green. When the traffic light corresponding to the lane where the own vehicle is located is green, the id of the red light in each direction can be found out according to the traffic light information in each direction deduced before, and the lane id corresponding to the traffic light can be searched in the map.

6. Judging whether the obstacle does not pass through the stop line: in the case of a red light for some obstacles that do not comply with traffic regulations, the prediction before passing the stop-line is stop, but the prediction is done with the green light logic if the stop-line is exceeded.

7. Finding all obstacle vehicles needing to be predicted, filtering all obstacle vehicles which pass through the stop line, traversing each lane in each lane sequence in the rest obstacles, and if lanes corresponding to red lamps exist in the obstacles, adding the attribute of the stop line in the lane sequence.

8. Inputting the characteristics of the remaining lane sequence and some characteristics of the obstacle into a neural network of one MLP, and predicting the probability of whether the obstacle runs along the lane sequence.

9. And after the probability of each lane sequence is obtained, screening the lane sequences with the probability greater than 0.5, if a stop line exists in the lane sequences, fitting a uniform deceleration track from the position coordinates of the obstacle to the midpoint of the stop line by an interpolation method according to the current speed, and if the stop line does not exist, fitting a uniform deceleration track from the position coordinates of the obstacle to the center line of the lane sequences for 7 seconds by the interpolation method.

The method includes the steps that the traffic light state of the whole intersection is deduced according to the traffic light signal in front of the traffic light observed by a vehicle, the lane sequence corresponding to the red light is found out in a lane sequence mode according to the traffic light information, a stop line is set, and meanwhile 3, if a vehicle which does not comply with traffic rules runs the red light, prediction is carried out according to the red light before the vehicle passes the stop line, and once the vehicle passes the stop line, prediction is carried out according to the green light state. Compared with other models which are learned through machines or in depth, the method increases the logic of the signal lamp, can effectively improve the accuracy of prediction, judges vehicles which do not comply with traffic rules, and gives different predictions.

Corresponding to the above method embodiment, an embodiment of the present invention further provides a vehicle trajectory prediction apparatus, as shown in fig. 5, the apparatus including:

the information acquisition device 500 is used for acquiring signal lamp information of a traffic intersection area;

a driving logic determination module 502, configured to determine a driving logic of the obstacle vehicle according to the signal light information and the driving information of the obstacle vehicle acquired in advance;

and a trajectory prediction module 504 for predicting a trajectory of the obstacle vehicle based on the driving logic and the driving information of the obstacle vehicle.

The implementation principle and the generated technical effects of the vehicle trajectory prediction device provided by the embodiment of the invention are the same as those of the vehicle trajectory prediction method embodiment, and for brief description, the corresponding contents in the vehicle trajectory prediction method embodiment can be referred to where the embodiment of the vehicle trajectory prediction device is not mentioned in part.

An embodiment of the present invention further provides an electronic device, as shown in fig. 6, the electronic device includes a processor 130 and a memory 131, the memory 131 stores machine executable instructions that can be executed by the processor 130, and the processor 130 executes the machine executable instructions to implement the vehicle trajectory prediction method.

Further, the electronic device shown in fig. 6 further includes a bus 132 and a communication interface 133, and the processor 130, the communication interface 133, and the memory 131 are connected through the bus 132.

The Memory 131 may include a high-speed Random Access Memory (RAM) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 133 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used. The bus 132 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 6, but that does not indicate only one bus or one type of bus.

The processor 130 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 130. The Processor 130 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 131, and the processor 130 reads the information in the memory 131 and completes the steps of the method of the foregoing embodiment in combination with the hardware thereof.

The embodiment of the present invention further provides a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by a processor, the machine-executable instructions cause the processor to implement the vehicle trajectory prediction method.

The vehicle trajectory prediction method and apparatus and the computer program product of the electronic device provided in the embodiments of the present invention include a computer-readable storage medium storing program codes, where instructions included in the program codes may be used to execute the method described in the foregoing method embodiments, and specific implementations may refer to the method embodiments and are not described herein again.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.