阅读说明：本技术 用于监视机动车基础设施的区域的方法、设备及存储介质 (Method, device and storage medium for monitoring a region of a motor vehicle infrastructure ) 是由 S·诺德布鲁赫 于 2019-08-12 设计创作，主要内容包括：本发明涉及一种用于监视机动车基础设施的区域的方法,其中,在所述机动车基础设施内存在用于监视区域的环境传感器,所述方法包括以下步骤：对探测到所述环境传感器的功能故障做出响应地产生并且输出委托信号,该委托信号代表用于手动地分析对所述区域的辅助感测的委托,在输出所述委托信号之后接收结果分析信号,该结果分析信号代表所委托的对所述区域的辅助感测手动执行的分析的结果。本发明还涉及一种设备,一种计算机程序以及一种机器可读的存储介质。(The invention relates to a method for monitoring a region of a motor vehicle infrastructure, wherein an environmental sensor for monitoring the region is present in the motor vehicle infrastructure, comprising the following steps: generating and outputting a commission signal representing a commission for manually analyzing the assisted sensing of the zone in response to detecting a malfunction of the environmental sensor, and receiving a result-analysis signal representing a result of the manually performed analysis of the commissioned assisted sensing of the zone after outputting the commission signal. The invention also relates to a device, a computer program and a machine-readable storage medium.)

1. A method for monitoring a region of an automotive infrastructure (401), wherein there is an environmental sensor (407,411) within the automotive infrastructure (401) for monitoring the region (413), the method comprising the steps of:

generating (103) and outputting (105) a commissioning signal in response to detecting (101) a functional failure (415) to the environmental sensor (411), the commissioning signal representing a commission for manually analyzing the ancillary sensing of the area (413),

-receiving (107), after outputting the delegation signal, a result analysis signal representing a result of a delegated analysis performed manually for assisted sensing of the region (413).

2. Method according to claim 1, wherein in response to detecting a malfunction (415) of the environmental sensor (411), ascertaining whether an auxiliary sensing of the area (413) should be performed manually and/or with the use of one or more further environmental sensors (503,505), wherein the commissioning signal is generated based on the ascertaining such that commissioning comprises the following statements: the auxiliary sensing of the area (413) should be performed manually and/or with the use of one or more further environmental sensors (503, 505).

3. The method according to claim 2, wherein the one or more further environmental sensors (503,505) are each an element selected from the following group of environmental sensors: an environmental sensor of a vehicle, for example of a motor vehicle (405) or of an unmanned aircraft, an environmental sensor arranged statically in the motor vehicle infrastructure (401).

4. A method according to claim 2 or 3, wherein a request signal is generated and output, which request signal represents a request for said one or more further environmental sensors (503,505) for sensing said area (413).

5. The method according to any one of the preceding claims, wherein control signals for at least partially automatically controlling a lateral guidance and a longitudinal guidance of a motor vehicle (405) located within the motor vehicle infrastructure (401) are generated and output on the basis of the resulting analysis signal in order to at least partially automatically guide the motor vehicle (405) within the motor vehicle infrastructure (401) on the basis of the resulting analysis signal.

6. The method of any of the above claims, wherein a communication message is generated based on the resulting analysis signal, the communication message comprising a result of an analysis performed manually for assisted sensing of the area, wherein the communication message is transmitted over a communication network to a motor vehicle (405) located within the motor vehicle infrastructure (401).

7. The method of any preceding claim, wherein a commission transmission signal representative of an end of commission for manually analyzing ancillary sensing of the area (413) is generated and output in response to replacement or servicing of an environmental sensor.

8. The method according to any one of the preceding claims, wherein the motor vehicle infrastructure (401) is comprised by a manufacturing facility for the motor vehicle (405) or by an operator yard operated by logistics or by a parking lot.

9. A device (201) set up for carrying out all the steps of the method according to any one of the preceding claims.

10. A computer program (303) comprising instructions which, when executed by a computer, arrange the computer to carry out the method according to any one of claims 1 to 8.

11. A machine-readable storage medium (301) on which a computer program (303) according to claim 10 is stored.

Technical Field

The invention relates to a method for monitoring a region of a motor vehicle infrastructure. The invention also relates to a device which is set up to carry out all the steps of the method for monitoring a region of a motor vehicle infrastructure. The invention also relates to a computer program and a machine-readable storage medium.

Background

In the context of an automatic parking process, a motor vehicle is usually driven at least partially automatically in a parking space. For this purpose, for example, a plurality of environmental sensors monitoring the parking lot are arranged in the parking lot. The motor vehicle can be guided at least partially automatically on the basis of the monitoring.

A failure of such an environmental sensor may result in that a certain region of the parking area can no longer be monitored, which may result in the automatic parking process of the motor vehicle having to be stopped.

Publication WO 2015/180931 a1 discloses a vehicle control system for autonomously guiding a vehicle. Known vehicle control systems comprise a control device for autonomously guiding a vehicle on the basis of sensor signals of vehicle sensors. The control device is configured to sense a malfunction of the vehicle sensor. The known vehicle control system further comprises a communication interface configured for requesting an auxiliary sensor signal over a communication network in response to sensing of a sensor malfunction by the controller and receiving the requested auxiliary sensor signal over the communication network. The control device is configured for autonomously guiding the vehicle based on the received auxiliary sensor signal.

Disclosure of Invention

The object on which the invention is based is to provide a solution for the efficient monitoring of regions of a motor vehicle infrastructure.

This object is achieved by the invention. Advantageous configurations of the invention are the respective preferred embodiments.

According to a first aspect, a method for monitoring a region of a motor vehicle infrastructure is provided, wherein an environmental sensor for monitoring the region is present within the motor vehicle infrastructure, the method comprising the following steps: in response to detecting a malfunction of the environmental sensor, a commission signal is generated and output, the commission signal representing a commission for manually analyzing the assisted sensing of the zone, and a result-analysis signal is received after the commission signal is output, the result-analysis signal representing a result of the analysis manually performed by the commissioned assisted sensing of the zone.

According to a second aspect, an apparatus is provided which is set up for carrying out all the steps of the method according to the first aspect.

According to a third aspect, there is provided a computer program comprising instructions which, when executed by a computer, arrange the computer to perform the method according to the first aspect.

According to a fourth aspect, there is provided a machine-readable storage medium on which the computer program according to the third aspect is stored.

The solution described here is based on the following, the above problem being solved in the following way: in the event of a malfunction of the environmental sensor, the principal analyzes the auxiliary sensing of the area and provides the result of the analysis, for example by transmitting it by means of the communication unit, for example by means of a mobile terminal, for example by means of a mobile telephone.

That is, monitoring of the area is at least partially transferred to the person.

This results in particular in the following technical advantages: the area can continue to be monitored even in the event of a failure or malfunction of the environmental sensor.

The following technical advantages therefore arise in particular: a solution for efficiently monitoring a region of a motor vehicle infrastructure is provided.

The expression "manually" in the sense of this description means in particular that the respective step is performed by a person.

That is, the person analyzes the assisted sensing of the area.

In one embodiment, provision is made for, in response to a detection of a malfunction of an environmental sensor, ascertaining whether an auxiliary sensing of the region is to be carried out manually and/or using one or more further environmental sensors, wherein a request signal is generated on the basis of the ascertaining, such that the request includes the following statements: the auxiliary sensing of the area should be performed manually and/or with the use of one or more further environmental sensors.

This results in the following technical advantages, for example: the area can be sensed efficiently even in the event of a functional failure of the environmental sensor.

"auxiliary sensing of the area should be manually performed" means that a person senses the area. In this case, the person assumes the function of an environmental sensor and senses the area itself.

The advantage of manual sensing is, in particular, that no additional environmental sensors are required for this purpose.

By "using one or more further environmental sensors for auxiliary sensing of the area" is meant that one or more further environmental sensors are used by means of which the area is sensed.

The one or more additional environmental sensors are distinct from the environmental sensor having a functional failure.

An environmental sensor in the sense of this description is for example one of the following environmental sensors: radar sensors, video sensors, ultrasonic sensors, infrared sensors, magnetic field sensors, and lidar sensors.

Based on the respective sensing of the area by the one or more further environmental sensors, individual sensor images of the sensed area are provided, which sensor images may be manually analyzed.

For example, the manual analysis includes the analysis of radar images and/or video images and/or infrared images and/or ultrasound images and/or lidar images.

In particular, video images can be efficiently analyzed by a person.

In one embodiment, it is provided that the one or more further environmental sensors are elements selected from the following group of environmental sensors: an environmental sensor of a vehicle, for example of a motor vehicle or an unmanned aircraft, an environmental sensor arranged statically in the vehicle infrastructure.

This results in the following technical advantages, for example: these environmental sensors of the environmental sensor group can be efficiently utilized.

In particular, the provision of an unmanned aerial vehicle comprising an environmental sensor has the following advantages: such an aircraft may be efficiently moved within the infrastructure to sense multiple regions. Thus, for example, regions which are difficult to sense or even impossible to sense by means of vehicle sensors can also be sensed.

An environmental sensor that is arranged statically in the vehicle infrastructure is, for example, an environmental sensor that was not originally provided for monitoring the region of the vehicle infrastructure and is now used for this task.

In one embodiment, it is provided that a request signal is generated and output, which represents a request for the one or more further environmental sensors for sensing the region.

This results in the following technical advantages, for example: the one or more additional environmental sensors may be efficiently requested. This, for example, further brings about the following technical advantages: the requested environmental sensor may reserve the capability to sense the area accordingly

In one embodiment, it is provided that, based on the resulting evaluation signal, a control signal for at least partially automatically controlling the transverse guidance and the longitudinal guidance of the motor vehicle located in the motor vehicle infrastructure is generated and output in order to at least partially automatically guide the motor vehicle in the motor vehicle infrastructure based on the resulting evaluation signal.

This results in the following technical advantages, for example: even in the event of a malfunction of the environmental sensor, the motor vehicle can continue to be guided efficiently, at least partially automatically, within the motor vehicle infrastructure.

In other words, the automatic parking process can continue to be performed in the vehicle infrastructure, for example, even in the event of a failure of the environmental sensor. The following technical advantages are thereby brought about in particular in general: efficient operation of the vehicle infrastructure can be ensured.

According to one specific embodiment, a communication message is generated on the basis of the resulting evaluation signal, said communication message comprising the result of the evaluation performed manually for the auxiliary sensing of the area, wherein said communication message is transmitted to a motor vehicle located in the motor vehicle infrastructure via a communication network.

This results in the following technical advantages, for example: the results of the manually performed analysis can be efficiently understood. In particular, the motor vehicle can be driven in a fully automated manner in the motor vehicle infrastructure, for example, on the basis of the results of the manually performed analysis. This results in the following technical advantages, for example: the motor vehicle can be driven within the motor vehicle infrastructure without a driver on the basis of this result of the manually performed analysis.

The expression "at least partially automatically controlled or directed" includes the following cases: the motor vehicle is controlled or guided partially automatically, highly automatically, fully automatically, without a driver, remotely.

"partially automatically controlled or guided" means that the longitudinal guidance and the transverse guidance of the motor vehicle are automatically controlled in the particular application (for example: driving on a highway, driving in a parking lot, passing an object, driving in a traffic lane determined by a traffic lane marking). The driver of the motor vehicle does not need to control the longitudinal guidance and the transverse guidance of the motor vehicle manually by himself. However, the driver must constantly monitor the automatic control of the longitudinal guidance and the transverse guidance in order to be able to intervene manually if necessary.

"highly automated control or guidance" means that the longitudinal guidance and the transverse guidance of the motor vehicle are automatically controlled in certain application situations (for example: driving on a highway, driving in a parking lot, passing objects, driving in a traffic lane determined by a traffic lane marking). The driver of the motor vehicle does not need to control the longitudinal guidance and the transverse guidance of the motor vehicle manually by himself. The driver does not need to continuously monitor the automatic control of the longitudinal guidance and the transverse guidance in order to be able to intervene manually if necessary. When necessary, a take-over request is automatically output to the driver to take over the control of the longitudinal guidance and the lateral guidance. The driver must potentially be able to take over control of longitudinal guidance and lateral guidance.

"fully automatically controlled or guided" means that the longitudinal guidance and the transverse guidance of the motor vehicle are automatically controlled in certain application situations (for example: driving on a highway, driving in a parking lot, passing an object, driving in a traffic lane determined by a traffic lane marking). The driver of the motor vehicle does not need to control the longitudinal guidance and the transverse guidance of the motor vehicle manually by himself. The driver does not need to monitor the automatic control of the longitudinal guidance and the transverse guidance in order to be able to intervene manually if necessary. In this particular application case no driver is required.

"driver-free control or guidance" means that the longitudinal guidance and the transverse guidance of the motor vehicle are automatically controlled independently of the particular application (e.g., driving on a highway, driving in a parking lot, passing an object, driving in a traffic lane determined by a traffic lane marking). The driver of the motor vehicle does not need to control the longitudinal guidance and the transverse guidance of the motor vehicle manually by himself. The driver does not need to monitor the automatic control of the longitudinal guidance and the transverse guidance in order to be able to intervene manually if necessary. Thus, for example, longitudinal guidance and lateral guidance of the vehicle are automatically controlled under all road types, speed ranges and environmental conditions. Thus, the entire driving task of the driver is automatically taken over. The driver is therefore no longer required. The motor vehicle can also be driven from any starting position to any target position without a driver. The potential problem is solved automatically, i.e. without driver assistance.

By "remotely controlling the motor vehicle" is meant that the lateral guidance and the longitudinal guidance of the motor vehicle are remotely controlled. For example, remote control signals for remote control of the transverse guidance and the longitudinal guidance are transmitted to the motor vehicle. The remote control is performed, for example, by means of a remote control device.

In one embodiment, it is provided that, in response to the replacement or repair of the environmental sensor, a request signal is generated and output which represents the end of the request for the manual evaluation of the auxiliary sensing of the region.

This results in the following technical advantages, for example: the original delegation can be efficiently ended. In particular, a person who has manually analyzed the secondary sensing may be removed from the task.

This, for example, further brings about the following technical advantages: one or more additional environmental sensors used for secondary sensing may again be used for other tasks.

This enables, for example, an efficient operation of the further environmental sensor.

In one embodiment, it is provided that the vehicle infrastructure is comprised by a manufacturing facility for vehicles or by an operating field operated by logistics or by a parking lot.

This results in the following technical advantages, for example: it is possible to efficiently monitor a manufacturing facility or an operation site or a parking lot.

According to one embodiment, a manufacturing facility for an automotive vehicle includes a manufacturing line for automotive vehicle manufacturing. For example, it is provided that the motor vehicle is guided at the end of the production line (also referred to as the end of the production line) at least partially automatically to a parking space and parked there. The parking space is comprised, for example, by a loading bay for a motor vehicle.

According to one specific embodiment, the method according to the first aspect is carried out with an apparatus according to the second aspect.

Device features are analogously derived from corresponding method features and vice versa.

That is to say that the technical functions of the device are analogously obtained by corresponding technical functions of the method, and vice versa.

A communication network in the sense of this description comprises for example a mobile radio network and/or a WLAN communication network.

According to one embodiment, the outputting of the delegation signal includes sending the delegation signal, for example, to the terminal device over a communication network. The terminal device is for example assigned to a person.

A terminal device in the sense of this description is, for example, a mobile terminal device, for example a mobile telephone.

The result analysis signal is, for example, a result analysis signal transmitted by the terminal device through the communication network.

The foregoing embodiments in terms of transmitting the delegation signal over the communication network are similarly applicable to outputting the delegation transmission signal. The request may be transmitted to the terminal device via a communication network.

In one embodiment, it is provided that control signals for at least partially automatically controlling the transverse guidance and the longitudinal guidance are transmitted to the motor vehicle via a communication network in order to remotely control the motor vehicle.

In one embodiment, the vehicle infrastructure includes a plurality of environmental sensors, each of which monitors a region of the vehicle infrastructure.

The expression "also or" especially includes the expression "and/or".

The expression "or" for example includes the expression "also or".

Drawings

Embodiments of the invention are illustrated in the drawings and are set forth in detail in the following description. The figures show:

figure 1 is a flow chart of a method for monitoring a region of a motor vehicle infrastructure,

FIG. 2 shows a device which is set up for carrying out all the steps of a method for monitoring a region of a motor vehicle infrastructure,

figure 3 is a storage medium that is machine-readable,

FIG. 4A motor vehicle infrastructure with environmental sensor failure, and

fig. 5 shows a motor vehicle infrastructure, which is monitored according to the solution described here, in fig. 4.

Detailed Description

Fig. 1 shows a flow chart of a method for monitoring a region of a motor vehicle infrastructure.

Environmental sensors for monitoring areas are present in the vehicle infrastructure.

In one embodiment, the vehicle infrastructure includes a plurality of environmental sensors that each monitor a region of the vehicle infrastructure.

The method comprises a step 101 of detecting a malfunction of an environmental sensor. According to step 101, a detection of a malfunction of one of a plurality of environmental sensors is provided in the case of said plurality of environmental sensors.

In one embodiment, it is provided that the detection of the malfunction comprises receiving a communication message comprising a damage report via the communication network, wherein the damage report indicates that the environmental sensor has damage. For example, it is possible that a person damages the surroundings sensor, for example by hitting it (anfahren) with his motor vehicle. The person reports the damage, for example, by sending such damage reports over a communication network using a mobile terminal, for example a mobile telephone. The person reporting the damage is not necessarily the one who damaged the environmental sensor.

In step 103, it is provided that, in response to the detection of a malfunction of the environmental sensor, a request signal is generated which represents a request for the manual evaluation of the auxiliary sensing of the region.

In step 105, the generated request signal is output.

According to step 107, it is provided that after the output of the request signal a result-analysis signal is received which represents the result of the analysis performed manually by the requested auxiliary sensing of the area.

According to one specific embodiment, the generated request signal is transmitted via a communication network to a terminal, wherein the terminal is assigned to a person. That is, the delegation is determined for a person. That is, a person is delegated to manually analyze the assisted sensing of the area.

In one embodiment, it is provided that the result evaluation signal is transmitted by a human terminal. That is, the person transmits the result analysis signal while using the terminal device.

In one embodiment, the automotive infrastructure includes a server. The server is set up, for example, for processing environmental signals of environmental sensors for monitoring the area in order to monitor the corresponding area. The environmental sensor signal represents the sensed area.

In one embodiment, it is provided that the human terminal transmits the result evaluation signal to the server.

According to one embodiment, the server is comprised by a management system for managing and/or operating the vehicle infrastructure.

If the vehicle infrastructure is comprised by a parking lot, for example, the server is comprised by a parking lot management system of the parking lot, for example.

Fig. 2 shows a device 201.

The device 201 is set up to carry out all the steps of the method for monitoring a region of a motor vehicle infrastructure.

The device 201 comprises a processor 203 which is set up for generating a commissioning signal in response to detecting a malfunction of the environmental sensor, the commissioning signal representing a commission for manually analyzing the assisted sensing of the zone.

The device 201 further comprises an output 205 which is set up for outputting the generated commission signal.

The device 201 also comprises an input 207 which is set up for receiving, after the output of the delegation signal, a result-analysis signal which represents the result of the delegated auxiliary sensing of an analysis performed manually for the area.

In general, the signal to be output is output via the output 205. For example, it is generally provided that the signal to be received is received by means of an input 207.

In one embodiment, a plurality of processors are provided in place of the processor 203.

Fig. 3 illustrates a machine-readable storage medium 301.

A computer program 303 is stored on the machine-readable storage medium 301. The computer program 303 comprises instructions which, when the computer program 303 is executed by a computer, such as the device 201, arrange the computer to perform a method for monitoring a region of an automobile infrastructure.

Fig. 4 shows a simplified plan view of a motor vehicle infrastructure 401.

The vehicle infrastructure 401 comprises a traffic lane 403, on which a vehicle 405 is guided at least partially automatically.

The traffic lane 403 leads, for example, from the end of the manufacturing line to a parking space of the vehicle infrastructure 401.

The direction of travel of the motor vehicle 405 is symbolically illustrated by means of an arrow with reference numeral 406.

The vehicle infrastructure 401 includes a plurality of environmental sensors 407 arranged along the traffic lane 403.

The environmental sensors 407 sense corresponding regions 409 of their environment.

Thus, the vehicle infrastructure 401 can be monitored by means of the environmental sensors 407.

One of these environmental sensors 407 has a functional failure, which is symbolically shown by a sawtooth arrow in the form of lightning with reference 415. The corresponding environmental sensor 407 is additionally labeled with reference numeral 411. The monitored area corresponding to this environmental sensor 411 is additionally marked with reference number 413.

That is, zone 413 can no longer be monitored due to environmental sensor 411 failing.

However, since at least partially automated guidance of the motor vehicle 405 is carried out on the basis of monitoring of the region 409, this execution is influenced in this respect by the failure of the environmental sensor 411. The execution must even be stopped if necessary.

This means, for example, for a manufacturing facility for a motor vehicle, that the manufacturing of the motor vehicle is stopped or at least delayed.

This means, for example, for a parking lot that the operation of the parking lot is interrupted. If necessary, the parking lot must be at least temporarily shut down before the environmental sensor 411 can be repaired or replaced.

This means, for example, that the supply may be delayed for a carrier of the logistics operation.

One possibility for compensating for the failure of the environmental sensors can consist in redundantly providing some environmental sensors. However, this compensation is a very expensive and laborious measure to implement.

In order to compensate for a failure or malfunction of the environmental sensor 411, the corresponding monitoring is at least partially, for example completely, transferred to a person, as in the case of the solution arrangement described above and/or below.

This is exemplarily shown in fig. 5.

There, a person 501 is symbolically shown, who, in response to the receipt of a request signal by means of his terminal, moves towards the area 413 and there monitors the area 413 instead of the failed environmental sensor 411. Thus, the person 501 performs manual assisted sensing of the region 413.

The person 501 further analyzes the manual assistance sensing and transmits the results of the analysis by means of his terminal device over a communication network to remote participants of the communication network. The remote participant is for example the aforementioned server.

According to one embodiment, the results of the analysis of the assisted sensing generally include the following description: whether the respective zone is free or occupied, i.e. whether a motor vehicle is located in the zone.

According to one embodiment, to aid in sensing the area, another environmental sensor may be used instead of or in addition to the person 501. Here, a video camera 503 including a video sensor not shown is exemplarily drawn.

The video images captured by means of the video camera 503 are manually analyzed, i.e. evaluated in particular, by the person 501, so that the person 501 can send information to the server as to whether the area is free or occupied.

In one embodiment, it is provided that the analysis of the video image comprises a computer-aided analysis or evaluation of the video image. The person 501 is computer-assisted, for example, when he performs the analysis. Such a computer is, for example, a mobile terminal device, for example a mobile telephone, a tablet computer or a notebook computer. Thus, the computer analyzes the video image and provides the results of its analysis to the person for further analysis.

According to one embodiment, for example, an unmanned aerial vehicle, such as a drone (Drohne), including environmental sensors, such as video sensors, may be provided to assist in sensing region 413.

The corresponding sensor image, for example a video image, is also evaluated or analyzed by the person 501.

According to one specific embodiment, it is provided that the terminal of the person 501 receives the environmental sensor signals of the one or more additional environmental sensors and displays them with the aid of the terminal.

In one general embodiment, the environmental sensors 407 are comprised by a monitoring system that is assigned to the vehicle infrastructure.

According to one embodiment, the further environmental sensors, i.e., for example, the video camera 503 and the unmanned aerial vehicle 505, are not environmental sensors associated with the monitoring system of the motor vehicle infrastructure 401.

The further environmental sensor is an environmental sensor which is not originally provided for monitoring an area but which is originally used for other tasks or purposes.

In one embodiment, it is provided that, in response to the replacement or maintenance of the surroundings sensor 411, a request signal is generated and transmitted to the terminal of the person 501, wherein the request signal represents the end of the request for manual evaluation of the assistance sensing of the region 413.

That is, in response to receiving the entrusted transmission signal by the terminal device of the person 501, the person 501 ends to manually analyze the auxiliary sensing of the area 413.

For example, setting, the person 501 turns to engage in other tasks.

The solution described here has the advantage, in particular, that the vehicle infrastructure can still be operated by at least partially transferring the monitoring of the region, which was originally monitored by the environmental sensor, which has a functional fault, to the person. For example, the operation may continue with one or more restrictions. For example, the limitation means that a motor vehicle guided at least partially automatically within the motor vehicle infrastructure travels at a lower speed than before a malfunction of the environmental sensor is detected. For example, it is provided that, in response to the detection of a malfunction, the maximum number of vehicles which can be guided in the vehicle infrastructure at the same time at least partially automatically is reduced.

In this way, at least a minimum availability of the vehicle infrastructure is advantageously ensured. That is, the operation of the vehicle infrastructure, although limited, can continue at least generally.