阅读说明：本技术 一种疲劳预警方法、眼镜、系统和计算机可读存储介质 (Fatigue early warning method, glasses, system and computer readable storage medium ) 是由 雷晓辉 于 2021-08-12 设计创作，主要内容包括：本申请公开了一种疲劳预警方法、眼镜、系统和计算机可读存储介质,该疲劳预警眼镜包括支撑组件、第一摄像组件、第二摄像组件以及预警组件,第一摄像组件设置于支撑组件上,用于采集道路视频数据并发送至处理设备；第二摄像组件设置于支撑组件上,用于采集检测目标的眼睛视频数据并发送至处理设备；预警组件设置于支撑组件上,预警组件用于基于处理设备的处理结果进行疲劳预警。通过上述方式,本申请能够提升疲劳检测的准确率,提升安全性。(The application discloses a fatigue early warning method, glasses, a system and a computer readable storage medium, wherein the fatigue early warning glasses comprise a supporting component, a first camera shooting component, a second camera shooting component and an early warning component, wherein the first camera shooting component is arranged on the supporting component and used for acquiring road video data and sending the road video data to a processing device; the second camera shooting assembly is arranged on the supporting assembly and used for collecting eye video data of a detection target and sending the eye video data to the processing equipment; the early warning assembly is arranged on the supporting assembly and used for carrying out fatigue early warning based on a processing result of the processing equipment. Through the mode, the accuracy rate of fatigue detection can be improved, and the safety is improved.)

1. The fatigue early warning glasses are characterized by comprising a supporting component, a first camera shooting component, a second camera shooting component and an early warning component, wherein the first camera shooting component is arranged on the supporting component and used for acquiring road video data and sending the road video data to a processing device; the second camera shooting assembly is arranged on the supporting assembly and used for collecting eye video data of a detection target and sending the eye video data to the processing equipment; the early warning assembly is arranged on the supporting assembly and used for carrying out fatigue early warning based on a processing result of the processing equipment.

2. The fatigue warning glasses according to claim 1,

the supporting component comprises a fixing component and a glasses component, and the fixing component is connected with the glasses component and used for fixing the glasses component.

3. The fatigue warning glasses according to claim 2,

the fixed subassembly includes first mounting, second mounting and connecting piece, first mounting with the second mounting is connected, the second mounting with the glasses subassembly is connected, first camera subassembly sets up on the second mounting.

4. The fatigue warning glasses according to claim 3,

the fixed component further comprises an extension rod, the extension rod is connected with the first fixing piece, and the second camera shooting component is arranged at one end, far away from the first fixing piece, of the extension rod.

5. The fatigue warning glasses according to claim 3,

the connecting piece includes truss, movable block, head rod and connecting pipe, the truss set up in on the second mounting, the one end of movable block with truss sliding connection, the other end of movable block with the one end of head rod is connected, the other end of head rod with the connecting pipe rotates to be connected.

6. The fatigue warning glasses according to claim 5,

the glasses assembly comprises a glasses frame, lenses and a threaded rod, and the glasses frame is detachably connected with the lenses; the mirror holder is close to the one end of connecting pipe is provided with the threaded rod, the threaded rod with connecting pipe screwed connection.

7. The fatigue warning glasses according to claim 3,

the first camera shooting assembly comprises a connecting block, a second connecting rod and a first camera, the connecting block is fixedly arranged at the bottom end of the connecting piece, a movable groove is formed in the connecting block, one end of the second connecting rod is arranged in the movable groove, and the other end of the second connecting rod is connected with the first camera; the second camera shooting component is a second camera.

8. The fatigue warning glasses according to claim 1,

the processing result comprises a triggering signal and the fatigue degree of a detection target, and the road video data and the eye video data are processed by the processing equipment to obtain the fatigue degree; when the fatigue degree is larger than a preset fatigue threshold value, the processing equipment generates the trigger signal; and the early warning assembly vibrates and/or generates current after receiving the trigger signal.

9. The fatigue warning glasses according to claim 1,

the fatigue early warning glasses comprise the processing equipment, and the processing equipment is fixed on the supporting component; or

The fatigue early warning glasses comprise a communication component, and the communication component is in communication connection with the processing equipment so as to transmit the road video data and the eye video data to the processing equipment.

10. A fatigue warning method applied to the processing device of any one of claims 1 to 9, the method comprising:

acquiring road video data and eye video data of a detection target;

processing the road video data and the eye video data to obtain the fatigue degree of the detection target;

and when the fatigue degree meets the early warning condition, generating a processing result and sending the processing result to an early warning component in the fatigue early warning glasses so that the early warning component carries out fatigue early warning.

11. The fatigue warning method according to claim 10, wherein the step of processing the road video data and the eye video data to obtain the fatigue degree of the detection target comprises:

processing the road video data by adopting a first machine learning model to obtain a first fatigue value;

processing the eye video data by adopting a second machine learning model to obtain characteristic information; calculating a second fatigue value based on the characteristic information;

determining the degree of fatigue based on the first fatigue value and the second fatigue value.

12. The fatigue warning method according to claim 11, wherein the second fatigue value is an eye-closing rate, the characteristic information includes an eyelid opening degree of the detection target, and the step of calculating the second fatigue value based on the characteristic information includes:

counting the time length of the eyelid opening degree which is greater than a preset eyelid opening degree threshold value to obtain the eye closing time;

and dividing the eye closing time by preset analysis time to obtain the eye closing rate.

13. The fatigue warning method according to claim 11, wherein the first fatigue value is a ratio of a road picture in the road video data, and the step of determining the fatigue degree based on the first fatigue value and the second fatigue value comprises:

judging whether the ratio is larger than a preset ratio threshold value or not;

if not, the fatigue degree is the second fatigue value;

and if so, carrying out weighted summation on the first fatigue value and the second fatigue value to obtain the fatigue degree.

14. The fatigue warning method according to claim 11, wherein the fatigue degree includes the first fatigue value and the second fatigue value, the method further comprising:

judging whether the first fatigue value is smaller than a preset duty threshold or whether the second fatigue value is larger than a preset eye closing rate;

and if so, determining that the early warning condition is met.

15. Fatigue warning glasses comprising a memory and a processing device connected to each other, wherein the memory is configured to store a computer program, which when executed by the processing device is configured to implement the fatigue warning method of any one of claims 10-14.

16. A fatigue warning system, comprising fatigue warning glasses and a processing device, which are connected with each other, wherein the fatigue warning glasses are used for collecting road video data and eye video data of a detected target, and the processing device is used for receiving the road video data and the eye video data, and the processing device is used for implementing the fatigue warning method according to any one of claims 10 to 14.

17. A computer-readable storage medium storing a computer program, wherein the computer program is configured to implement the fatigue warning method according to any one of claims 10 to 14 when executed by a processing device.

Technical Field

The application relates to the technical field of glasses, in particular to a fatigue early warning method, glasses, a system and a computer readable storage medium.

Background

As the number of automobiles increases, traffic accidents occur continuously, and among the traffic accidents, the reason for the occurrence of many traffic accidents is fatigue driving of drivers, so that the reminding of the fatigue driving becomes the key point of research; the fatigue state of the person can be expressed from the state of the eyes, so that the fatigue state of the person can be monitored by collecting the information of the eyes in real time, and the driver is reminded when the fatigue of the driver is detected.

Disclosure of Invention

The application provides a fatigue early warning method, glasses, a system and a computer readable storage medium, which can improve the accuracy of fatigue detection and improve the safety.

In order to solve the technical problem, the technical scheme adopted by the application is as follows: there is provided fatigue warning glasses including: the system comprises a supporting component, a first camera component, a second camera component and an early warning component, wherein the first camera component is arranged on the supporting component and is used for acquiring road video data and sending the road video data to a processing device; the second camera shooting assembly is arranged on the supporting assembly and used for collecting eye video data of a detection target and sending the eye video data to the processing equipment; the early warning assembly is arranged on the supporting assembly and used for carrying out fatigue early warning based on a processing result of the processing equipment.

In order to solve the above technical problem, another technical solution adopted by the present application is: the fatigue early warning method is applied to the processing equipment in the technical scheme, and comprises the following steps: acquiring road video data and eye video data of a detection target; processing the road video data and the eye video data to obtain the fatigue degree of the detection target; and when the fatigue degree meets the early warning condition, generating a processing result and sending the processing result to an early warning assembly in the fatigue early warning glasses so that the early warning assembly carries out fatigue early warning.

In order to solve the above technical problem, another technical solution adopted by the present application is: the fatigue early warning glasses comprise a memory and a processing device which are connected with each other, wherein the memory is used for storing a computer program, and the computer program is used for realizing the fatigue early warning method in the technical scheme when being executed by the processing device.

In order to solve the above technical problem, another technical solution adopted by the present application is: the fatigue early warning system comprises fatigue early warning glasses and processing equipment, wherein the fatigue early warning glasses and the processing equipment are connected with each other, the fatigue early warning glasses are used for collecting road video data and eye video data of a detection target, the processing equipment is used for receiving the road video data and the eye video data, and the processing equipment is used for realizing the fatigue early warning method in the technical scheme.

In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided a computer readable storage medium for storing a computer program, which when executed by a processing device, is used to implement the fatigue pre-warning method in the above technical solution.

Through the scheme, the beneficial effects of the application are that: the fatigue early warning glasses comprise a supporting component, a first camera shooting component, a second camera shooting component and an early warning component, wherein the first camera shooting component is used for collecting road video data, and the second camera shooting component is used for collecting eye video data of a detection target; the processing equipment is used for processing the road video data and the eye video data to obtain a processing result, and the processing equipment sends the processing result to the early warning assembly, so that the early warning assembly carries out fatigue early warning based on the processing result, and people wearing fatigue early warning glasses are reminded to keep awake. Because the road video data collected by the first camera shooting assembly is used as one of the bases for judging the fatigue degree of the driver, the estimation on the fatigue degree accuracy is realized, the situation that the person wearing fatigue early warning glasses is in a waking state when the person is fatigue is prevented, the probability of traffic accidents caused by fatigue is reduced, and the safety of a detection target is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:

fig. 1 is a schematic structural diagram of an embodiment of fatigue warning glasses provided in the present application;

fig. 2 is a schematic diagram of an explosion structure of the fatigue warning glasses in fig. 1;

fig. 3 is a schematic structural view of a connecting member and a first camera module in the fatigue warning glasses in fig. 1;

FIG. 4 is a schematic view of the configuration of the eyewear assembly of the fatigue warning eyewear of FIG. 1;

fig. 5 is a schematic flowchart of an embodiment of a fatigue warning method provided in the present application;

fig. 6 is a schematic structural diagram of another embodiment of fatigue warning glasses provided by the present application;

FIG. 7 is a schematic structural diagram of an embodiment of a fatigue warning system provided in the present application;

FIG. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The fatigue state monitoring device in the related art comprises a camera and a warning device which are arranged in front of a driver seat, the camera shoots the image of the whole head of a driver in real time, and then the fatigue state of the driver is judged according to the eye movement condition (namely the opening and closing condition of eyes) of the driver, and the camera in the scheme is easy to be interfered by natural factors and has an unsatisfactory detection effect on a specific state; in the identification of the human eye state, the opening degree of the human eye can be identified by performing human eye fitting on a human eye region or adopting an integral projection method on the human eye region, the shape fitting method is interfered by the head posture, and the integral projection method is very strict on a detection region of the human eye and is easily interfered by natural light in an actual application environment.

The fatigue state monitoring device is complex to install and poor in portability in the prior art, and is easily interfered by head postures and natural light in the using process to influence the fatigue judgment accuracy. The application provides glasses for preventing fatigue driving and a method for achieving the same, and the scheme adopted by the application is elaborated in detail below.

Referring to fig. 1 to 4, fig. 1 is a schematic structural diagram of an embodiment of fatigue warning glasses provided in the present application, fig. 2 is a schematic structural diagram of an explosion of the fatigue warning glasses in fig. 1, fig. 3 is a schematic structural diagram of a connecting member and a first camera module in the fatigue warning glasses in fig. 1, and fig. 4 is a schematic structural diagram of an eyeglass assembly in the fatigue warning glasses in fig. 1, where the fatigue warning glasses include a supporting assembly (not shown), a first camera module 10, and a second camera module 20.

The supporting component comprises a fixing component 30 and an eyeglass component 40, the fixing component 30 is connected with the eyeglass component 40, and the fixing component 30 is used for fixing the eyeglass component 40.

In a specific embodiment, as shown in fig. 1, the fixing assembly 30 includes a first fixing member 31, a second fixing member 32 and a connecting member 33, the first fixing member 31 is connected to the second fixing member 32, the second fixing member 32 is connected to the glasses assembly 40, and the first camera assembly 10 is disposed on the second fixing member 32. Specifically, the first fixing member 31 may be an elastic hoop; the number of the second fixing parts 32 is two, the second fixing parts 32 can be ear hooks, the tail ends of the left side and the right side of the elastic hoop are respectively fixedly connected with an ear hook, one ear hook of the two ear hooks is provided with a connecting piece 33, and the ear hook is movably connected with the connecting piece 33.

Further, as shown in fig. 3, the connecting member 33 includes a slot frame 331, a movable block 332, a first connecting rod (not shown), and a connecting pipe 333, the slot frame 331 is disposed on the second fixed member 32, and the slot frame 331 may be in an arc shape, that is, the arc-shaped slot frame 331 is fixedly connected to the ear hook. One end of the movable block 332 is slidably connected to the slot frame 331, the other end of the movable block 332 is connected to one end of a first connecting rod, the other end of the first connecting rod is rotatably connected to the connecting pipe 333, that is, the movable block 332 is slidably connected to the inside of the slot frame 331, the first connecting rod is fixedly connected to the movable block 332, the tail end of the first connecting rod is rotatably connected to the connecting pipe 333, and an internal thread is arranged inside the connecting pipe 333.

Referring to fig. 3 and 4, the glasses assembly 40 includes a frame 41, lenses 42 and a threaded rod 43, wherein the frame 41 is detachably connected to the lenses 42, that is, the detachable lenses 42 are fixedly mounted on the frame 41; a threaded rod 43 is fixedly arranged at one end of the lens frame 41 close to the connecting pipe 333, and the threaded rod 43 is spirally connected with the connecting pipe 333.

First subassembly 10 of making a video recording sets up on the supporting component, and first subassembly 10 of making a video recording is used for gathering road video data and sends processing equipment, and this road video data is for being located the road that wears fatigue early warning glasses's personnel the place ahead and shoot the video data that obtains.

In a specific embodiment, as shown in fig. 3, the first camera assembly 10 includes a connecting block 11, a second connecting rod (not shown), and a first camera 12, the connecting block 11 is fixedly disposed at the bottom end of the connecting member 33, and a movable groove (not shown) is disposed inside the connecting block 11, and the movable groove may be a spherical movable groove; one end of the second connecting rod is arranged in the movable groove, the other end of the second connecting rod is connected with the first camera 12, namely, the second connecting rod is movably connected in the spherical movable groove, and the tail end of the second connecting rod is fixedly connected with the first camera 12; the first camera 12 is parallel to the driver's line of sight and may be used to monitor whether the driver's line of sight is continuously looking forward.

The second camera component 20 is arranged on the supporting component, and the second camera component 20 is used for collecting eye video data of a detection target and sending the eye video data to the processing equipment; specifically, the second camera assembly 20 is a second camera, and the detection target is a person wearing fatigue warning glasses, such as: a driver; the eye video data is generated by shooting the eyes of the detection target by the second camera, namely the second camera is used for monitoring the opening and closing conditions of the eyes of the driver. It is understood that the position of the second camera in the vertical direction is lower than the position of the eyes of the driver in the vertical direction in order not to obstruct the field of view of the driver.

In a specific embodiment, as shown in fig. 1, the fixing assembly 30 further includes an extension rod 34, the extension rod 34 is connected to the first fixing member 31, and one end of the extension rod 34 away from the first fixing member 31 is provided with the second camera assembly 20, that is, one end of the extension rod 34 is connected to the second camera assembly 20, and the other end of the extension rod 34 is connected to the end of the first fixing member 31; further, the fatigue warning glasses further include a radio microphone 50, one end of the extension rod 34 far away from the elastic hoop is fixedly connected with the radio microphone 50, the radio microphone 50 is rotatably installed by the inner side to form a second camera module 20, the radio microphone 50 can collect sound signals in the surrounding environment and transmit the sound signals to a processing device for analysis and processing, so as to determine whether the detected target needs help, for example: in the event of a traffic accident, the driver may describe the current situation via the radio microphone 50 so that the processing device can determine whether an alarm or other assistance is needed.

The processing device (not shown in the figure) is in communication connection with the first camera assembly 10 and the second camera assembly 20, and the processing device is used for receiving the road video data sent by the first camera assembly 10 and the eye video data sent by the second camera assembly 20, and processing the road video data and the eye video data to obtain a processing result.

Furthermore, the fatigue early warning glasses also comprise processing equipment, and the processing equipment is fixed on the supporting component, namely the processing equipment belongs to a component part of the fatigue early warning glasses; or the processing device is an external device independent from the fatigue warning glasses, the fatigue warning glasses further include a communication component (not shown in the figure), the communication component is in communication connection with the processing device to transmit the road video data and the eye video data to the external device, the external device is in wireless communication with the first camera component 10 and the second camera component 20, and the external device may be a device with information processing capability, such as a computer or a mobile terminal.

In a specific embodiment, as shown in fig. 4, the fatigue warning glasses further include a warning component 44, and the warning component 44 is fixedly disposed on the supporting component; specifically, the inner side wall of the mirror frame 41 is fixedly provided with the warning assembly 44, and the warning assembly 44 is arranged near the temple of the driver.

The processing result comprises the fatigue degree of the detection target, the road video data and the eye video data are processed by the processing equipment to obtain the fatigue degree, and when the fatigue degree meets the early warning condition, the early warning component 44 carries out fatigue early warning; specifically, the processing result further includes a trigger signal, the early warning condition includes whether the fatigue degree is greater than a preset fatigue threshold, the processing device compares the fatigue degree with the preset fatigue threshold, when the fatigue degree is greater than the preset fatigue threshold, it is determined that the early warning condition is met, the processing device generates the trigger signal, and sends the trigger signal to the early warning component 44, so that the early warning component 44 performs fatigue early warning.

Further, the early warning component 44 vibrates and/or generates current to alert the detection target after receiving the trigger signal; it is to be understood that the current generated by the warning assembly 44 is a micro current that is safe for human body, and the warning manner includes, but is not limited to: vibrate, sound or generate an electric current.

The embodiment provides a pair of glasses for preventing fatigue driving, wherein a first camera for real-time monitoring is designed on one side of an ear hook, and road video data acquired by the first camera is used as one of the bases for judging the fatigue degree of a driver and can also be used as a driving recorder; in addition, a second camera for monitoring the eye movement condition is installed on the extension rod, the second camera is installed below the sight line of the driver, the normal sight line of the driver cannot be influenced, the eye movement condition of the driver can be directly recorded by adjusting the second camera to an angle towards the eyes of the driver, and convenience is provided for subsequent calculation of the fatigue degree; moreover, still install the early warning subassembly on the body of glasses, the position of early warning subassembly is close to driver's temple, both can send vibrations and remind, also can produce little electric current amazing driver's skin and remind, can play better suggestion warning effect to the driver, reduces because of the probability that fatigue driving leads to taking place the traffic accident, promotes the security of driving.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating an embodiment of a fatigue warning method applied to a processing apparatus in the foregoing embodiment, the method including:

step 51: and acquiring road video data and eye video data of a detection target.

In order to realize the purpose of reminding the driver, the driver correctly wears the glasses for preventing fatigue driving, and can manually adjust the postures of the first camera and the second camera, ensure that the first camera can monitor the road surface driving picture, and simultaneously ensure that the second camera can accurately record the eye movement condition of the wearer. Further, when the postures of the first camera and the second camera are adjusted, the first camera is adjusted to be parallel to the sight line of a driver, and the first camera acquires a real-time video of a road surface in the driving process; the second camera is adjusted to an angle capable of directly recording the eye change of the driver, and the sight line of the driver cannot be influenced.

In a specific embodiment, a start button can be arranged on the fatigue early warning glasses, and a driver can make the first camera and the second camera shoot by pressing the start button to respectively generate road video data and eye video data; the processing equipment can receive road video data sent by the first camera and eye video data sent by the second camera; or the processing device actively reads the road video data and the eye video data from the storage device.

In other embodiments, the video pictures acquired by the first camera and the second camera may be preprocessed (for example, filtered, enhanced, or resized) to ensure the validity of the acquired video data.

Step 52: and processing the road video data and the eye video data to obtain the fatigue degree of the detection target.

The fatigue degree is obtained by adopting the following steps:

(1) and processing the road video data by adopting a first machine learning model to obtain a first fatigue value.

The first machine learning model can be a convolutional neural network, and for the preprocessing result of the road video data shot by the first camera, feature extraction processing is carried out on the preprocessing result through the convolutional neural network, and feature data of a road driving picture in the road video data are extracted so as to judge whether a driver keeps watching the front driving in the driving process; for example, whether there is a traffic violation or whether the road picture is large can be analyzed by the convolutional neural network.

(2) Processing the eye video data by adopting a second machine learning model to obtain characteristic information; based on the characteristic information, a second fatigue value is calculated.

The second machine learning model can be a convolutional neural network, and coarse positioning can be performed on a preprocessing result of the eye video data shot by the second camera to obtain eye movement characteristic data, namely the position of eyes in the eye video data is found; and processing the eye movement characteristic data through a convolution neural network, calculating the eyelid openness of human eyes, and generating characteristic information, wherein the characteristic information comprises the eyelid openness corresponding to each frame of image in the eye video data, and the eyelid openness is the distance between the upper face eyes and the lower face eyes.

Further, the second fatigue value is an eye closing rate, the characteristic information comprises eyelid opening of the detection target, and the duration that the eyelid opening is larger than a preset eyelid opening threshold value is counted to obtain eye closing time; and dividing the eye closing time by the preset analysis time to obtain the eye closing rate. For example, a statistical frame number is set, an initial value of the statistical frame number is 0, whether the eyelid opening degree corresponding to each frame of image is greater than a preset eyelid opening degree threshold is judged by taking a certain time as a statistical start time, if the eyelid opening degree is greater than the preset eyelid opening degree threshold, the statistical frame number is increased by one, and after the statistical end time (i.e., a time interval of a preset analysis time) is reached, the statistical frame number is converted into a time value, so that the eye closure time can be obtained.

In a specific embodiment, the first 10 complete blink cycles of the driver in the waking state can be selected, and the maximum value and the minimum value of the eyelid openness in each blink cycle are respectively extracted; then, an average value of the maximum eyelid opening values and an average value of the minimum eyelid opening values are calculated, and the preset eyelid opening threshold value is defined as follows:

wherein ET is the preset eyelid openingThe threshold value of the degree is set to be,is the average of the maximum values of the eyelid opening,is the average of the minimum values of eyelid opening.

Assuming that the preset analysis time is recorded as T, and the total time that the eyelid opening degree is smaller than the preset eyelid opening degree threshold value in the preset analysis time is T, the calculation formula of the eye closing rate is as follows:

wherein PERCLOS is the eye-closing rate.

The average blink time is 10-20 times per minute, the normal blink time is 0.2-0.3 s, the eye-closing rate is in the range of [ 3.3%, 10% ] under the normal condition, and when the total blink time of a person reaches 0.5-3 s within a certain minute, the person can be regarded as being in a fatigue state.

(3) Based on the first fatigue value and the second fatigue value, a fatigue degree is determined.

Determining the fatigue state of the driver by combining the first fatigue value and the second fatigue value; specifically, the first fatigue value is the ratio of road pictures in the road video data within the preset analysis time, and whether the ratio is greater than a preset ratio threshold value can be judged; if the occupation ratio is less than or equal to a preset occupation ratio threshold value, the fatigue degree is a second fatigue value; and if the ratio is larger than a preset ratio threshold, carrying out weighted summation on the first fatigue value and the second fatigue value to obtain the fatigue degree. According to the embodiment, the fatigue degree of the driver is judged through the proportion of the road picture in the data recorded by the first camera and the eye closing rate of the eyes in the data recorded by the second camera, and the accuracy of fatigue detection is improved.

Step 53: and when the fatigue degree meets the early warning condition, generating a processing result and sending the processing result to an early warning assembly in the fatigue early warning glasses so that the early warning assembly carries out fatigue early warning.

And judging whether the fatigue degree is greater than a preset fatigue threshold value or not, if so, indicating that the fatigue degree meets the early warning condition, namely, the driver is in a fatigue state, and at the moment, the early warning component sends out vibration and/or releases micro current to stimulate the skin of the driver so as to play a role in prompting and warning.

In other embodiments, other manners may also be adopted to determine whether the early warning condition is currently satisfied, for example, the fatigue degree includes a first fatigue value and a second fatigue value, and determine whether the first fatigue value is smaller than a preset proportion threshold or whether the second fatigue value is greater than a preset eye closure rate, where the preset eye closure rate is a value set according to experience; if the first fatigue value is smaller than a preset ratio threshold value or the second fatigue value is larger than a preset eye closing rate, determining that an early warning condition is met, and judging fatigue driving and dangerous driving of a driver; such as: when the eye closing rate of the driver is more than 15%, the driver is judged to be in a fatigue driving state. Further, different warning levels may be set, such as: when the first fatigue value is smaller than a preset ratio threshold value or the second fatigue value is larger than a preset fatigue threshold value, a first early warning level is used for reminding; and when the first fatigue value is smaller than the preset ratio threshold value and the second fatigue value is larger than the preset fatigue threshold value, reminding by using a second early warning level, wherein the reminding intensity of the second early warning level is larger than that of the first early warning level, and the reminding intensity can be vibration intensity, current intensity or sound intensity.

The embodiment provides a method for preventing fatigue driving matched with glasses for preventing fatigue driving, which combines the processing results of data collected by a first camera and a second camera, and the two are complementary to each other and used as a judgment standard of the fatigue degree of a driver; taking the proportion of the road picture in the shot picture of the first camera as a judgment basis, and judging fatigue driving and dangerous driving if the proportion of the road picture is smaller than a preset proportion threshold value; further, the closed-eye rate calculated using the data recorded by the second camera is used as a main determination index, and if the closed-eye rate of the driver is greater than a preset closed-eye rate during driving, it is determined that the driver is in a fatigue driving state. In addition, in the using process, when the driver is judged to be in the fatigue driving state by utilizing any data in the first camera and the second camera, the driver is reminded through the early warning assembly, if the judgment results of the first camera and the second camera are in the fatigue driving state, stronger prompt and warning are provided, and the purpose of reminding the driver is achieved by setting reminding modes of different levels so as to improve the driving safety.

Referring to fig. 6, fig. 6 is a schematic structural diagram of another embodiment of fatigue warning glasses provided in the present application, a fatigue warning glasses 60 includes a memory 61 and a processing device 62 connected to each other, where the memory 61 is used for storing a computer program, and the computer program is used for implementing the fatigue warning method in the foregoing embodiment when being executed by the processing device 62.

Referring to fig. 7, fig. 7 is a schematic structural diagram of an embodiment of a fatigue early warning system provided in the present application, the fatigue early warning system 70 includes fatigue early warning glasses 71 and a processing device 72 that are connected to each other, the fatigue early warning glasses 71 are used for acquiring road video data and eye video data of a detection target, the processing device 72 is used for receiving the road video data and the eye video data, and the processing device 72 is used for implementing the fatigue early warning method in the above embodiment.

Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium 80 provided in the present application, where the computer-readable storage medium 80 is used to store a computer program 81, and when the computer program 81 is executed by a processing device, the computer program is used to implement the fatigue warning method in the foregoing embodiment.

The computer readable storage medium 80 may be a server, a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various media capable of storing program codes.

In conclusion, the application provides glasses for preventing fatigue driving and an implementation method thereof, and the first camera and the second camera are matched for use, so that a better monitoring effect can be achieved on the state of a driver; meanwhile, an early warning component is designed, so that a better warning and reminding effect can be achieved for a driver; the implementation method for preventing fatigue driving is combined with the glasses, the proportion of the road pictures and the eye closing rate of a driver are combined to serve as a judgment basis of the fatigue degree, the accuracy of fatigue degree judgment is better guaranteed, the glasses are simple to install, and the problems that equipment in the related technology is complex to install, poor in portability, prone to being interfered by head gestures or natural light in the using process and the like are solved.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.