阅读说明：本技术 一种智能车载安全监测系统 (Intelligent vehicle-mounted safety monitoring system ) 是由 程涛 于 2020-10-20 设计创作，主要内容包括：本发明提供了一种智能车载安全监测系统,包括状态检测模块,用于检测车辆状态信息；图像获取模块,用于获取车辆内部的图像信息；图像处理模块,用于接收所述车辆状态信息和所述图像信息,并生成增强图像信息和司乘人员状态信息；通信模块,用于将所述增强图像信息和所述司乘人员状态信息发送至云系统；云系统,用于接收所述增强图像信息和所述司乘人员状态信息,并将所述增强图像信息和所述司乘人员状态信息发送至通知模块；通知模块,用于将所述增强图像信息和所述司乘人员状态信息发送至相关人员。可以全天候监测车辆内的状态,可以及时将车辆内的图像信息和异常的司乘人员状态信息发送给相关人员,极大地增加了系统的安全性。(The invention provides an intelligent vehicle-mounted safety monitoring system, which comprises a state detection module, a safety monitoring module and a safety monitoring module, wherein the state detection module is used for detecting vehicle state information; the image acquisition module is used for acquiring image information of the interior of the vehicle; the image processing module is used for receiving the vehicle state information and the image information and generating enhanced image information and driver and passenger state information; the communication module is used for sending the enhanced image information and the state information of the drivers and conductors to a cloud system; the cloud system is used for receiving the enhanced image information and the state information of the drivers and conductors and sending the enhanced image information and the state information of the drivers and conductors to a notification module; and the notification module is used for sending the enhanced image information and the state information of the drivers and conductors to related personnel. The system can monitor the state in the vehicle all weather, can send the image information and abnormal driver and passenger state information in the vehicle to related personnel in time, and greatly improves the safety of the system.)

1. The utility model provides an on-vehicle safety monitoring system of intelligence which characterized in that includes:

the state detection module is used for detecting vehicle state information and sending the vehicle state information to the image acquisition module and the image processing module;

the image acquisition module is used for acquiring image information in the vehicle and sending the image information to the image processing module;

the image processing module is used for receiving the vehicle state information and the image information and generating enhanced image information and driver and passenger state information;

the communication module is used for sending the enhanced image information and the state information of the drivers and conductors to a cloud system;

the cloud system is used for receiving the enhanced image information and the state information of the drivers and conductors and sending the enhanced image information and the state information of the drivers and conductors to a notification module;

and the notification module is used for sending the enhanced image information and the state information of the drivers and conductors to related personnel.

2. The intelligent vehicle-mounted safety monitoring system according to claim 1, wherein: the state monitoring module comprises an ignition switch ACC gear detection module, a door switch state detection module and a door lock state detection module.

3. The intelligent vehicle-mounted safety monitoring system according to claim 1, wherein: the image acquisition module comprises a 360-degree high-definition night vision camera, and the 360-degree high-definition night vision camera is installed at the center of the top in the automobile body.

4. The intelligent vehicle-mounted safety monitoring system according to claim 3, wherein: the image acquisition module further comprises an anti-shake module, and the anti-shake module is connected to the 360-degree high-definition night vision camera.

5. The intelligent vehicle-mounted safety monitoring system according to claim 4, wherein: the image processing module comprises a raspberry pi based image processing module.

6. The intelligent vehicle-mounted safety monitoring system according to claim 5, wherein: the image processing module further comprises a filtering processing module.

7. The intelligent vehicle-mounted safety monitoring system according to any one of claims 1-6, wherein: the notification module comprises a voice notification module, and the voice notification module is installed in the vehicle body.

8. The intelligent vehicle-mounted safety monitoring system according to claim 7, wherein: the notification module also comprises a text notification module which is in communication connection with the client terminal.

9. The intelligent vehicle-mounted safety monitoring system according to claim 8, wherein: the cloud system is connected to an authorization platform, and the text notification module is in communication connection with the authorization platform.

Technical Field

The invention relates to the field of vehicle safety monitoring, in particular to an intelligent vehicle-mounted safety monitoring system.

Background

In recent years, automobiles have become more popular, and more families have private cars, but due to lack of safety awareness of drivers and negligence in operation, many cases of children are locked in the cars, and finally death is suffocated. In the case of public reports from 2006 to 2017 of media only, at least 25 children are forgotten in the car in China, and more than 20 people die. The accident that personnel in the car are locked to be dead constantly takes place, and it is very necessary to develop a device for monitoring the safety of vehicle-mounted personnel. At present, few alarm products are locked in a vehicle by people in the market, and almost no professional or more perfect alarm products exist, so that an intelligent vehicle-mounted safety monitoring system is urgently needed to be developed, and safety accidents after the vehicle is locked by mistake are reduced as far as possible.

Disclosure of Invention

The technical problem to be solved by the invention is as follows: the intelligent vehicle-mounted safety monitoring system can monitor the state in a vehicle on line in real time, give an alarm in time when an abnormal condition occurs, and inform related personnel of rescue.

In order to solve the technical problems, the invention adopts the technical scheme that: the utility model provides an on-vehicle safety monitoring system of intelligence specifically includes:

the state detection module is used for detecting vehicle state information and sending the vehicle state information to the image acquisition module and the image processing module;

the image acquisition module is used for acquiring image information in the vehicle and sending the image information to the image processing module;

the image processing module is used for receiving the vehicle state information and the image information and generating enhanced image information and driver and passenger state information;

the communication module is used for sending the enhanced image information and the state information of the drivers and conductors to a cloud system;

the cloud system is used for receiving the enhanced image information and the state information of the drivers and conductors and sending the enhanced image information and the state information of the drivers and conductors to a notification module;

and the notification module is used for sending the enhanced image information and the state information of the drivers and conductors to related personnel.

Further, the state monitoring module comprises an ignition switch ACC gear detection module, a door switch state detection module and a door lock state detection module.

Further, the image acquisition module comprises a 360-degree high-definition night vision camera, and the 360-degree high-definition night vision camera is installed at the top center position in the automobile body.

Further, the image acquisition module further comprises an anti-shake module, and the anti-shake module is connected to the 360-degree high-definition night-vision camera.

Further, the image processing module comprises a raspberry pi based image processing module.

Further, the image processing module further comprises a filtering processing module.

Further, the notification module comprises a voice notification module, and the voice notification module is installed in the vehicle body.

Further, the notification module further comprises a text notification module, and the text notification module is in communication connection with the client terminal.

Further, the cloud system is connected to an authorization platform, and the text notification module is in communication connection with the authorization platform.

The invention has the beneficial effects that: the state monitoring module can detect the state information of the vehicle, sense and detect scenes in the vehicle, and when the condition that the engine of the vehicle is closed and the door of the vehicle is locked is detected, the state information of the vehicle is sent to the image acquisition module and the image processing module, and the image acquisition module and the image processing module are started. The image acquisition module is used for acquiring image information in the vehicle and sending the image information to the image processing module in real time, and the image processing module further enhances and processes the image information and generates driver and passenger state information according to the states of drivers and passengers. The communication module is connected with the image processing module and sends the enhanced image information and the state information of the drivers and conductors to the cloud system in real time, so that 24-hour uninterrupted monitoring in cross-region and cross-space is realized. When the enhanced image information and the state information of the driver and the passengers are abnormal, the notification module sends out an alarm or notifies related personnel to carry out rescue. The intelligent vehicle-mounted safety monitoring system provided by the invention can monitor the state in the vehicle all weather, and can send the image information and abnormal driver and passenger state information in the vehicle to related personnel in time, thereby greatly improving the safety of the system.

Drawings

The specific structure of the invention is detailed below with reference to the accompanying drawings:

FIG. 1 is a first structural diagram of an intelligent vehicle-mounted safety monitoring system according to the present invention;

fig. 2 is a structural diagram of an intelligent vehicle-mounted safety monitoring system of the invention.

In the figure: 10-a state detection module, 11-an ignition switch ACC gear detection module, 12-a door switch state detection module, 13-a door lock state detection module, 20-an image acquisition module, 21-an anti-shake module, 30-an image processing module, 31-a raspberry group-based image processing module, 32-a filtering processing module, 40-a communication module, 50-a cloud system, 60-a notification module, 61-a voice notification module and 62-a text notification module.

Detailed Description

In order to explain technical contents, structural features, and objects and effects of the present invention in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.

In the last few years, many suffocation accidents caused by the fact that the driver and passengers are locked in the vehicle have occurred. In these accidents, there are children who are mistakenly locked in the car, and there are passengers who cannot accidentally lock the door in the car. If a novel sensing device is arranged in the vehicle, the condition in the vehicle can be identified and the alarm can be given in time, so that the accident can be immediately avoided, and the lives of one another can be saved. The invention provides an intelligent vehicle-mounted safety monitoring system, please refer to fig. 1 and fig. 2, which specifically comprises:

the state detection module 10 is configured to detect vehicle state information and send the vehicle state information to the image acquisition module and the image processing module.

It will be appreciated that the condition detection module 10 is used in combination with one or more sensors, primarily to detect the condition of the vehicle. When a driver drives normally in the cab or the door of the vehicle is not closed, the vehicle is in a controllable state, and the driver, passengers or passersby can deal with the situation in the vehicle at any time. After the vehicle engine is closed and the door is locked, the vehicle may be in an unsupervised state, and at the moment, the danger is large, the vehicle needs to be monitored safely through the intelligent vehicle-mounted safety monitoring system, so that the safety of personnel and property is ensured, and the suffocation accident caused by the fact that children or drivers and conductors are locked in the vehicle by mistake for a long time is avoided. When the state detection module 10 detects that the engine of the vehicle is closed and the door of the vehicle is locked, the vehicle state information is sent to the image acquisition module 20 and the image processing module 30, and the intelligent vehicle-mounted safety monitoring system is started.

In one embodiment, the state detection module 10 includes an ignition switch ACC position detection module 11, a door switch state detection module 12, and a door lock state detection module 13. The ignition switch ACC gear detection module 11 is used for detecting whether the vehicle is in a flameout state or not, and when the vehicle normally runs, the vehicle is in a controllable state and does not need to start the intelligent vehicle-mounted safety monitoring system. The door opening and closing state detection module 12 and the door lock state detection module 13 are used for detecting whether the door of the vehicle can be opened or not, and when the door is in an opening state or an unlocking state, the intelligent vehicle-mounted safety monitoring system does not need to be started. Only when the vehicle is flamed out and door lock is in the closed condition simultaneously, the driver and crew in the car has the risk of being locked by mistake and stifling, and the safety monitoring system starts, and each module is in the open condition.

The image acquisition module 20 is configured to acquire image information of the interior of the vehicle and send the image information to the image processing module.

It is understood that when the vehicle is in a flameout state and the doors are locked closed, there is a risk that the driver and the passengers cannot control the vehicle. At this time, the image information in the vehicle is acquired by the image acquisition module 20, so that the condition in the vehicle can be timely fed back to relevant personnel. In the prior art, a vehicle event data recorder and a front row of cameras are generally installed, 1 to 2 cameras are installed in a cabin, and the form can only realize off-line monitoring and cannot realize real-time monitoring. In one embodiment, a 360-degree high-definition night-vision camera can be mounted at the center of the top of the vehicle body, image information of all corners in the vehicle can be clearly obtained, and the situation that the camera is mounted in the front row or the rear row and the monitoring range is insufficient is avoided. The image acquisition module 20 acquires image information in the vehicle and then sends the image information to the image processing module 30.

Specifically, in order to increase the definition of the image acquisition module 20 when capturing the images of the drivers and passengers in the vehicle, the image acquisition module 20 is prevented from being in a shake state during capturing to avoid image blurring. In one embodiment, the image capturing module 20 further comprises an anti-shake module 21, and the anti-shake module 21 is connected to a 360-degree high-definition night-vision camera.

And the image processing module 30 is used for receiving the vehicle state information and the image information and generating enhanced image information and driver and passenger state information.

It can be understood that the image processing module 30 can perform photo pixel enhancement under different light rays to achieve the acquisition of suspicious photos in the best state, and can perform integrated management and control on data such as real-time acquisition, processing, display, access, remote wireless transmission, receiving control instructions of a monitoring cloud, real-time interaction and the like.

With the development of micro-PCs and embedded system technologies, the development of raspberry pi-based image processing systems can improve the functionality and performance of products. In one embodiment, the image processing module 30 includes a raspberry-based image processing module 31, which identifies and processes the situation of the vehicle occupant and performs data processing and transmission functions. The method fully utilizes the advantages of the multi-mode digital mobile network communication technology, can carry out real-time monitoring and has low cost.

When the vehicle is in the conditions of engine closing, door locking and the like, the intelligent vehicle-mounted safety monitoring system is triggered and started. The image processing module 31 based on the raspberry pi controls the image acquisition module 20 to snapshot drivers and conductors in the vehicle, and effective information is acquired. When a person is in the vehicle, the image processing module 31 based on the raspberry pi performs face detection based on Haar features to frame out a face range, and identifies the type and state of the person. When the person in the vehicle moves or is in a suspicious state, the image processing module 31 based on the raspberry group can snapshot the face of the person in the vehicle to obtain the key frame. The image processing module 31 based on the raspberry pi uses the HaarCascade classifier for face recognition, and only needs to download an important classifier file HaarCascade _ frontage _ default. First, the algorithm requires many positive examples (pictures containing faces) and negative examples (pictures containing no faces) to train the classifier. We then want to extract some features from these pictures in a similar way as the convolution kernel. Calculating all possible sizes and locations of each core yields a large number of features. This feature is extremely large, for example, a 24x24 sized sliding window feature exceeds 160000. In order to solve the problem of large amount of calculation, the concept of integral image is introduced, which greatly simplifies the calculation of pixel sum, only about the operation of the order of magnitude of the number of pixels is needed, and each operation only involves 4 pixels.

After the image capturing module 20 captures the drivers and passengers in the vehicle, there is a possibility that the quality of the pictures is poor and the noise is large due to factors such as dark light or small jitter in the vehicle. In an embodiment, the picture may be filtered, so as to enhance the display effect of the picture. Specifically, the image processing module 30 further includes a filtering processing module 32, which performs bilateral filtering processing on the photo, removes the photo noise, and implements the function of image enhancement.

The gaussian filtering takes only the spatial distance between the peripheral point and the central point into account to calculate the weight. First, for image filtering, a common intuition is: the (natural) image changes slowly in space so that neighboring pixel points are more similar, but this assumption becomes false at the edges of the image. If the filtering is performed at the edge by using the idea, that is, the adjacent pixels are considered to be close, the obtained result inevitably blurs the edge, which is unreasonable, so that the value of the pixel point is considered to be reused for supplement, and the weight of the points at the two sides of the edge is greatly different when the points are weighted. It can be understood that a neighborhood to be used for filtering is divided or classified according to the pixel value, then a relatively high weight is given to the class to which the point belongs, and then neighborhood weighted summation is carried out to obtain a final result.

Compared with Gaussian filtering, the bilateral filtering can better retain the edge information of the image, and the principle is that a Gaussian kernel function related to the space distance is multiplied by a Gaussian function related to the gray scale distance. For Gaussian filtering, the gray value of the central point is determined only by convolving the weight coefficient kernel of the spatial distance with the image. I.e. the closer to the center point, the larger its weight coefficient. The weight of the gray information is added in the bilateral filtering, namely, in the field, the more the gray value is close to the gray value of the central point, the more the weight of the point is, and the less the weight of the point with large gray value difference is. The weight is determined by a value range gaussian function. The two weight coefficients are multiplied to obtain a final convolution template, the bilateral filtering needs the gray information of each central point field to determine the coefficient, so the speed is much slower than that of the general filtering, and the increment speed of the calculated amount is the square of the size of the kernel.

And the communication module 40 is used for sending the enhanced image information and the state information of the drivers and conductors to a cloud system.

It can be understood that the communication module 40 uploads the photo information and the driver and passenger status information processed by the image processing module 30 to the cloud in time, so as to realize 24-hour uninterrupted monitoring. Specifically, the communication module 40 is an ad hoc network WiFi/4G communication module.

And the cloud system 50 is used for receiving the enhanced image information and the state information of the drivers and conductors and sending the enhanced image information and the state information of the drivers and conductors to the notification module.

It is understood that the cloud system 50 includes a cloud storage and distributed computing monitoring cloud system, and whether the image information acquired by the image acquisition module 20 or the result of the identification and processing performed by the image processing module 30 is uploaded to the cloud system 50 in real time, the cloud system 50 may also perform comprehensive computing processing on all the information.

And a notification module 60, configured to send the enhanced image information and the driver and passenger status information to relevant persons.

It can be understood that the notification module 60 sends an alarm to the driver, the guardian or the passerby when receiving the abnormal information transmitted from the cloud system 50, so as to notify the relevant personnel in time and handle the abnormal situation in the vehicle as soon as possible.

In one embodiment, the notification module 60 includes a voice notification module 61, which sounds a whistle or voice alarm when receiving the abnormal message, and transmits the abnormal message to the relevant person in the form of voice.

Preferably, the notification module 60 further includes a text notification module 62, which sends the received abnormal information to the client terminal of the authorizer in the form of a short message to remind the authorizer of paying attention to the abnormal information in the vehicle. The cloud system 50 is also connected to authorization platforms, and if the authorizer or guardian does not respond within a certain time, the cloud system 50 may send a short message directly to an authorization platform, such as an alarm platform, in case of emergency. Police can log in the cloud system through an APP terminal or a Web terminal to check the conditions in the vehicle in real time, acquire various data across regions and space-time, check historical data and real-time data, and obtain complete state information of drivers and passengers in the vehicle.

The intelligent vehicle-mounted safety monitoring system provided by the invention is carried out according to the following steps during working:

firstly, a state detection module detects and senses state information of a vehicle and judges whether the engine is flamed out and a vehicle door is locked;

when the engine is not flamed out or the vehicle door is not locked, the state detection module is in a detection sensing state;

when the engine is flamed out and the vehicle door is locked, starting the image acquisition module and the image processing module;

secondly, an image acquisition module shoots images in the vehicle, and an image processing module captures face images and judges whether people locked in the vehicle exist or not;

if no person is locked in the vehicle, the face image is grabbed again;

if the person is locked in the vehicle, enhancing and identifying the image, and uploading the image to a cloud system;

and thirdly, starting a notification module.

In a second step, authorized personnel and the authorization platform may log into the cloud system to view information within the vehicle.

In summary, in the intelligent vehicle-mounted safety monitoring system provided by the invention, the state monitoring module can detect the state information of the vehicle, sense and detect the scene in the vehicle, and when the engine of the vehicle is detected to be closed and the door of the vehicle is detected to be locked, the state information of the vehicle is sent to the image acquisition module and the image processing module, and the image acquisition module and the image processing module are started. The image acquisition module is used for acquiring image information in the vehicle and sending the image information to the image processing module in real time, and the image processing module further enhances and processes the image information and generates driver and passenger state information according to the state of the driver and passenger. The communication module is connected with the image processing module and sends the enhanced image information and the state information of the drivers and conductors to the cloud system in real time.