Embedded multidimensional perception driver safety assistance and alarm system

文档序号：1808860 发布日期：2021-11-09 浏览：23次中文

阅读说明：本技术 一种基于嵌入式的多维感知驾驶员安全辅助和报警系统 (Embedded multidimensional perception driver safety assistance and alarm system ) 是由魏启康朱文忠候亚妮江嘉文谢鑫煌陈国尧于 2021-08-19 设计创作，主要内容包括：本发明公开了一种基于嵌入式的多维感知驾驶员安全辅助和报警系统,所述多维感知驾驶员安全辅助和报警系统包括疲劳状态检测子系统、车内环境检测子系统、分心驾驶检测子系统、定位报警子系统,包括以下所述工作步骤：一：图像采集模块和图像处理分析模块、二：酒精检测模块、三：一氧化碳检测模块和二氧化碳检测模块、四：甲醛检测模块和温度检测模块、五：计时模块和定位模块；六：报警模块、七：显示模块、八：中央处理模块。本发明通过将对驾驶人员的疲劳检测、分心驾驶检测和车内环境安全检测结合起来,可以为驾驶人员提供一个更加安全可靠的驾驶环境,通过对车内环境的实时检测,保护了驾驶人员的生命安全。(The invention discloses an embedded multidimensional perception driver safety assisting and alarming system, which comprises a fatigue state detection subsystem, an in-vehicle environment detection subsystem, a distraction driving detection subsystem and a positioning alarming subsystem, and comprises the following working steps: firstly, the method comprises the following steps: the image acquisition module and the image processing and analyzing module: alcohol detection module, III: carbon monoxide detection module and carbon dioxide detection module, four: formaldehyde detection module and temperature detection module, five: the timing module and the positioning module; sixthly, the method comprises the following steps: alarm module, seventeen: display module, eight: a central processing module. The invention can provide a safer and more reliable driving environment for the driver by combining fatigue detection, distracted driving detection and in-vehicle environment safety detection for the driver, and protects the life safety of the driver by detecting the in-vehicle environment in real time.)

1. The utility model provides a driver safety is supplementary and alarm system based on embedded multidimension perception which characterized in that: the multidimensional perception driver safety assisting and alarming system comprises a fatigue state detection subsystem, an in-vehicle environment detection subsystem, a distraction driving detection subsystem and a positioning alarming system, and comprises the following working steps:

the method comprises the following steps of firstly, acquiring an image module and processing and analyzing the image;

secondly, an alcohol detection module;

thirdly, a carbon monoxide detection module and a carbon dioxide detection module;

fourthly, a formaldehyde detection module and a temperature detection module;

fifthly, a timing module and a positioning module;

sixthly, an alarm module;

seventhly, a display module;

and eighthly, a central processing module.

2. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the image acquisition module in the first step comprises: the image acquisition module is used for acquiring human face characteristics, detecting the blinking frequency of a driver, detecting the transverse-longitudinal ratio of the mouth of the driver, detecting whether a safety belt is fastened or not and detecting the head position state of the driver through a side end machine learning model;

the image processing and analyzing module in the first step comprises: the image processing and analyzing module sends the result analyzed by the machine learning model to the central processing module, the central processing module judges whether a fatigue driving state, a non-safety belt fastening state and a distraction driving state exist according to the result, and if the fatigue driving state, the non-safety belt fastening state and the distraction driving state exist, an instruction is sent to the alarm module.

3. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 2, wherein: the image processing and analyzing module detects a safety belt of a driver through a side end machine learning model.

4. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the alcohol detection module in the second step comprises: the alcohol detection module is placed right in front of the driver and used for detecting whether the gas exhaled by the driver contains alcohol or not, and if yes, the alarm module gives an alarm sound prompt.

5. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the carbon monoxide detection module in the third step comprises: the carbon monoxide detection module is used for detecting the concentration of carbon monoxide in the vehicle, and if the concentration of carbon monoxide in the vehicle is too high, the alarm module can give out an alarm sound prompt;

the carbon dioxide detection module in the third step comprises: the carbon dioxide detection module is used for detecting the concentration of carbon dioxide in the vehicle, and if the concentration of carbon dioxide in the vehicle is too high, the alarm module can send out alarm sound prompt.

6. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the formaldehyde detection module in the fourth step comprises: the formaldehyde detection module is used for detecting the concentration of formaldehyde in the vehicle, and if the concentration of formaldehyde in the vehicle is too high, the alarm module can give out an alarm sound prompt;

the temperature detection module in the fourth step comprises: the temperature detection module is used for detecting temperature information in the vehicle, and if the temperature in the vehicle is too high, the alarm module can give out an alarm sound prompt.

7. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the timing module in the fifth step comprises: the timing module is used for counting the one-time continuous driving time of a driver, and if the one-time continuous driving time exceeds a set threshold value, the alarm module can give out an alarm sound prompt;

the positioning module in the fifth step comprises: the positioning module is used for acquiring the position information of the vehicle in real time and sending the acquired position information to the central processing unit.

8. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the alarm module in the sixth step comprises: the alarm module is used for providing an alarm function for abnormal information, is connected with the central processing unit and is a voice alarm and a remote alarm module;

the remote alarm module in the sixth step comprises: the remote alarm module uploads the vehicle alarm information to the service background, and a signal transmission module is arranged in the remote alarm module.

9. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the display module in the seventh step comprises: the display module is used for displaying the state information of the driver, the environment information in the vehicle, the continuous driving time length information and the position information, and is connected with the central processing unit.

10. The embedded multi-dimensional perception-based driver safety assistance and warning system as claimed in claim 1, wherein: the CPU module in the step eight comprises: the central processing unit module is used for judging whether fatigue driving exists according to the detected eye and mouth states, judging whether a safety belt is fastened according to the detected safety belt states, judging whether distracted driving exists according to the head state of the driver, and judging whether drunk driving and the safety condition of the environment in the vehicle exist in the driver according to the numerical values detected by the alcohol sensor, the carbon monoxide sensor, the carbon dioxide sensor, the formaldehyde sensor and the temperature sensor.

Technical Field

The invention relates to the technical field of automobile auxiliary driving systems, in particular to an embedded multi-dimensional perception driver safety auxiliary and alarm system.

Background

With the continuous improvement of the living standard of people, the conservation quantity of private cars in China is increased year by year. The holding capacity of motor vehicles and the number of drivers are continuously increased, and the probability of personal safety accidents caused by automobiles is also continuously increased.

Safety accidents mainly comprise two types: one is because dangerous driving behaviors such as driver not wearing the safety belt, fatigue driving, low head play cell-phone, wine drive are leading factor that leads to the car accident to take place, and the accident that here fatigue driving leads to accounts for than the accident that leads to that is far higher than non-fatigue driving accounts for, and another is because the personal safety accident that the environmental safety in the car causes, the sealing performance of family expenses sedan-chair door window is good now, and various poisonous harmful gas such as in the car: the carbon monoxide, the carbon dioxide, the formaldehyde and the like can cause dizziness, nausea, depression, dysphoria, incapability of concentrating attention and slow reaction of drivers and passengers, thereby not only harming the health of the drivers and passengers, but also easily causing traffic safety accidents.

The method is used for detecting fatigue driving and detecting the environment in the vehicle. Various detection systems have appeared, but the existing systems do not integrate the two detection and alarm together, and the life safety of drivers cannot be effectively protected more comprehensively, so that a set of embedded multidimensional perception driver safety assistance and alarm system is necessary to be developed, dangerous driving behaviors of drivers are detected and alarmed through a side end machine learning model, main harmful gases in a vehicle can be monitored in real time, alarm prompt information can be given in time, personal safety accidents caused by the dangerous driving behaviors such as fatigue and the harm of harmful gases in the vehicle to the drivers can be greatly reduced, and the system has important significance for guaranteeing the life and property safety of people and improving the driving environment safety.

A driver safety assistance and alarm system among the prior art shortcoming is not enough:

1. a comparison document CN107330378A discloses a driver behavior detection system based on embedded image processing, which includes: the system comprises a main control module, an information transmission module, a functional module and an alarm module; the information transmission module comprises an image video transmission unit and a driving behavior state signal transmission unit; the functional module comprises an image preprocessing unit, an image video storage unit, a fatigue driving detection unit, a blind driving detection unit and an illegal driving detection unit; the function module processes and analyzes images and videos and generates driving behavior state signals, and the alarm module analyzes the driving behavior state signals to evaluate the danger degree, determines whether to start the alarm or not and selects the alarm level according to the analysis result. Has the advantages that: the driver can be detected in various behaviors and states, the detection range is wide, the applicability is strong, the driver can be effectively reminded of paying attention to bad driving behaviors and driving states, and the occurrence of traffic accidents is effectively reduced, but the detection of the driving by man and the real-time detection of the environment in the vehicle are lacked in the patent, the two detections and the alarm are not fused together, and the life safety of the driver cannot be effectively protected in a more comprehensive manner;

2. in the prior art, when part of the existing intelligent monitoring devices for the automobile are used for safely monitoring drivers, the time delay is high, the power consumption is high, and privacy protection is lacked;

3. a driver safety assists and alarm system among the prior art, current part is intelligent monitoring device for car, when carrying out the safety monitoring to the driver, when the vehicle accident sends out the police dispatch newspaper, the external rescue of connection that can not be timely leads to the practicality of device not enough.

Disclosure of Invention

The invention aims to provide an embedded multidimensional perception-based driver safety assistance and alarm system to solve the problems in the background technology.

In order to achieve the above object, the present invention provides the following technical solution, an embedded multidimensional sensing driver safety assistance and alarm system, which comprises a fatigue state detection subsystem, an in-vehicle environment detection subsystem, a distraction driving detection subsystem, and a positioning alarm subsystem, and comprises the following working steps:

the method comprises the following steps of firstly, acquiring an image module and processing and analyzing the image;

secondly, an alcohol detection module;

thirdly, a carbon monoxide detection module and a carbon dioxide detection module;

fourthly, a formaldehyde detection module and a temperature detection module;

fifthly, a timing module and a positioning module;

sixthly, an alarm module;

seventhly, a display module;

and eighthly, a central processing module.

Preferably, the image acquisition module in the first step includes: the image acquisition module is used for acquiring human face characteristics, detecting the blinking frequency of a driver, detecting the transverse-longitudinal ratio of the mouth of the driver, detecting whether a safety belt is fastened or not and detecting the head position state of the driver through a side end machine learning model;

Preferably, in the first step, the image processing and analyzing module detects the position of the driver through a side end machine learning model.

Preferably, the alcohol detection module in the second step includes: the alcohol detection module is placed right in front of the driver and used for detecting whether the gas exhaled by the driver contains alcohol or not, and if yes, the alarm module gives an alarm sound prompt.

Preferably, the carbon monoxide detecting module in step three includes: the carbon monoxide detection module is used for detecting the concentration of carbon monoxide in the vehicle, and if the concentration of carbon monoxide in the vehicle is too high, the alarm module can give out an alarm sound prompt;

Preferably, the formaldehyde detection module in the fourth step comprises: the formaldehyde detection module is used for detecting the concentration of formaldehyde in the vehicle, and if the concentration of formaldehyde in the vehicle is too high, the alarm module can give out an alarm sound prompt;

Preferably, the timing module in the fifth step includes: the timing module is used for counting the one-time continuous driving time of a driver, and if the one-time continuous driving time exceeds a set threshold value, the alarm module can give out an alarm sound prompt;

Preferably, the alarm module in the sixth step includes: the alarm module is used for providing an alarm function for abnormal information, is connected with the central processing unit and is a voice alarm and a remote alarm module;

the remote alarm module in the sixth step comprises: the remote alarm module uploads the vehicle alarm information and the position information to the service background, and a signal transmission module is arranged in the remote alarm module.

Preferably, the display module in the seventh step includes: the display module is used for displaying the state information of the driver, the environment information in the vehicle and the continuous driving time length information and is connected with the central processing unit.

Preferably, in the step eight, the central processor module includes: the central processing unit module is used for judging whether fatigue driving exists according to the detected eye and mouth states and the continuous driving time length, judging whether a safety belt is fastened according to the detected safety belt state, judging whether distracted driving exists according to the detected head state information, and judging whether drunk driving and the safety condition of the environment in the automobile exist in the driver according to the values detected by the alcohol sensor, the carbon monoxide sensor, the carbon dioxide sensor, the formaldehyde sensor and the temperature sensor.

Compared with the prior art, the invention has the following beneficial effects:

1. the invention can provide a safer and more reliable driving environment for the driver by combining fatigue detection, distraction detection and in-vehicle environment safety detection for the driver, can effectively avoid the harm of toxic and harmful gas to the body of the driver by detecting the in-vehicle environment in real time, and protects the life safety of the driver.

2. The system is an independent intelligent hardware device, can be installed on all types of automobiles, and can detect whether a driver has fatigue driving behaviors or distraction driving behaviors or not in real time and detect the environmental safety in the automobile in real time. The method integrates the factors of the driver and the factors of the environment in the vehicle, and has good practical value and popularization value. The driving environment in China is improved, the traffic accident rate is reduced, the life and property safety of drivers is guaranteed, and huge economic benefit and social benefit can be brought.

3. The invention can effectively avoid traffic accidents and protect the life and property safety of the driver and passengers by detecting the fatigue driving behavior and the distraction driving behavior of the driver in real time and giving an alarm. The probability of car accidents is reduced, a good road driving environment is created, and the alarming times, alarming contents and vehicle position information are uploaded through the remote alarming module, so that background service personnel can be detected in time conveniently, other informing modes are adopted, and rescue is provided for vehicles in time.

Drawings

Fig. 1 is a schematic system structure diagram of the terminal of the present invention;

fig. 2 is a data processing flow chart of the terminal of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the description of the present invention, it should be noted that the terms "upper", "lower", "inner", "outer", "front", "rear", "both ends", "one end", "the other end", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "disposed," "connected," and the like are to be construed broadly, such as "connected," which may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Referring to fig. 1 and fig. 2, an embodiment of the present invention provides an embedded multidimensional sensing-based driver safety assistance and warning system, including: the central processing unit is used for receiving data from the image acquisition equipment, the timing module, the positioning module, the alcohol sensor, the carbon monoxide sensor, the carbon dioxide sensor, the formaldehyde sensor and the temperature sensor, processing and analyzing the data and outputting corresponding data to the alarm; the image acquisition equipment is electrically connected with the central processing unit and is used for transmitting the acquired image to the central processing unit; the acquisition information of the image acquisition equipment comprises eye blinking frequency of a driver, mouth opening amplitude, whether a safety belt is fastened or not and a head position state; then the collected information is transmitted to a central processing unit, whether a driver is in a fatigue driving state, whether a safety belt is not fastened or not and whether the driver is in a distracted driving state are detected through a side end machine learning model, if the detection result exceeds a threshold value, the central processing unit outputs a signal to an alarm module, and the alarm module sends out an alarm sound after receiving the signal of the central processing unit; the timing module is used for counting the time length of one-time continuous driving of a driver and transmitting the time length to the central processing unit, if the time length exceeds a threshold value, the central processing unit outputs a signal to the alarm module, and the alarm module sends an alarm sound after receiving the signal of the central processing unit; the positioning module is used for recording the position information of the vehicle in real time and transmitting the position information to the central processing unit, and is used for uploading the position information of the vehicle to the service background in dangerous situations; the alcohol sensor, the carbon monoxide sensor, the carbon dioxide sensor, the formaldehyde sensor and the temperature sensor are used for acquiring alcohol concentration, carbon monoxide concentration, carbon dioxide concentration, formaldehyde concentration and temperature in the vehicle and transmitting the acquired data to the central processing unit, once the acquired data exceed a threshold value, the central processing unit outputs a signal to the alarm module, and the alarm module sends an alarm sound after receiving the signal of the central processing unit; alarm module and central processing unit electric connection, alarm module is the speaker, contain remote alarm module in the alarm module, remote alarm module uploads vehicle alarm information and vehicle position information to the service backstage, carries out the monitoring and the artificial suggestion of record and the relevant personnel of being convenient for, provides emergency rescue for the vehicle.

The first embodiment is as follows:

s1: acquiring a video image of a driver and environment information in a vehicle;

s2: extracting the characteristics of the video image, and positioning eyes, lips and safety belts;

s3: analyzing the blinking frequency, the opening range of the lips, the head position state and whether a safety belt is fastened or not according to a preset side end machine learning model;

s4: judging whether a fatigue driving state exists or not and whether a behavior of not fastening a safety belt exists or not according to the analysis result of the side end machine learning model;

s5: the machine learning model includes: a blink frequency threshold;

s6: judging whether the blink frequency characteristic parameter exceeds a blink frequency threshold value, if so, judging that the driving state of the driver is a fatigue driving state and sending an alarm prompt;

s7: the machine learning model includes: lip opening amplitude threshold:

s8: judging whether the characteristic parameter of the lip opening amplitude exceeds a lip opening amplitude threshold value or not, if so, judging that the driving state of the driver is a fatigue driving state and sending an alarm prompt;

s9: the machine learning model includes: safety belt detection;

s10: detecting the safety belt and determining whether the image area contains a safety belt image or not;

s11: if the safety belt image information is not found, judging that the driver does not fasten the safety belt and giving an alarm prompt;

s12, the machine learning model comprises: detecting the position state of the head;

s13, detecting the head position state of the driver, and determining that the head of the driver faces to the front and the state of looking at the mobile phone by head or speaking by head deviation does not occur;

s14, if the head is down or off-center, judging that the driver has the distracted driving state and sending out an alarm prompt;

s15: counting the continuous driving time of the driver, if the continuous driving time exceeds a set threshold value, judging the condition that the driver has a fatigue driving state, and sending an alarm prompt;

s16: the in-vehicle environment information includes: alcohol concentration;

s17: detecting the alcohol concentration information, and if the alcohol concentration information exceeds an alcohol concentration threshold value, judging that the driver drives after drinking and sending an alarm prompt;

s18: the in-vehicle environment information includes: the concentration of carbon monoxide;

s19: detecting the concentration of the carbon monoxide, and if the concentration of the carbon monoxide exceeds a carbon monoxide concentration threshold value, sending an alarm prompt;

s20: the in-vehicle environment information includes: the concentration of carbon dioxide;

s21: detecting the concentration of the carbon dioxide, and if the concentration of the carbon dioxide exceeds a carbon dioxide concentration threshold value, sending an alarm prompt;

s22: the in-vehicle environment information includes: the concentration of formaldehyde;

s23: detecting the concentration of the formaldehyde, and if the concentration of the formaldehyde exceeds a formaldehyde concentration threshold value, sending an alarm prompt;

s24: the in-vehicle environment information includes: (ii) temperature;

s25: detecting the temperature, and if the temperature exceeds a temperature threshold value, sending an alarm prompt;

s26: the alarm module includes: alarming and prompting;

s27: and uploading the alarm prompt, and if the times are more, prompting through a background artificial telephone.

Example two: