阅读说明：本技术 基于人脸识别及声音识别的行李箱盖自动开启系统及方法 (Automatic trunk lid opening system and method based on face recognition and voice recognition ) 是由 张菁 周大光 王雁 刘晨 彭景辉 刘金阳 宋子利 温泉 于 2021-01-29 设计创作，主要内容包括：本发明公开了一种基于人脸识别及声音识别的行李箱盖自动开闭系统及方法,包括：人脸识别模块,用于识别操作者身份,人脸识别模块同时与声音识别模块及检测模块通讯连接；声音识别模块,用于进一步识别操作者身份以及进行操作者语义识别,声音识别模块与检测模块通讯连接；检测模块,其接收人脸识别模块及声音识别模块发送的操作者身份识别结果,生成行李箱盖操作指令,将行李箱盖操作指令发送给行李箱盖控制系统；行李箱盖控制系统,其接收检测模块发送的行李箱盖操作指令,进行行李箱盖的自动开启或关闭的相关操作。(The invention discloses a luggage case cover automatic opening and closing system and method based on face recognition and voice recognition, which comprises the following steps: the face recognition module is used for recognizing the identity of an operator and is in communication connection with the voice recognition module and the detection module; the voice recognition module is used for further recognizing the identity of an operator and performing semantic recognition on the operator and is in communication connection with the detection module; the detection module receives the operator identity recognition results sent by the face recognition module and the voice recognition module, generates a trunk lid operation instruction and sends the trunk lid operation instruction to a trunk lid control system; and the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.)

1. The utility model provides an automatic switching system of suitcase lid based on face identification and voice recognition which characterized in that includes:

the identity recognition module is used for recognizing the identity of an operator and performing identity verification and is in communication connection with the detection module;

the detection module receives the operator identity recognition result sent by the identity recognition module, determines the identity of the operator, generates a trunk lid operation instruction according to the operator voice, and sends the trunk lid operation instruction to the trunk lid control system;

and the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

2. The system as claimed in claim 1, wherein the identity recognition module comprises:

the face recognition module is used for recognizing the identity of an operator, is in communication connection with the voice recognition module and the detection module at the same time, can enter the next voice recognition step only through identity verification, and sends the identity recognition result of the operator to the detection module;

and the voice recognition module is used for further recognizing the identity of an operator and performing semantic recognition on the operator, is in communication connection with the detection module, and sends an operator identity recognition result and an operator semantic recognition result to the detection module.

The face recognition and voice recognition module has strong computing capability, can judge and recognize the face and voice of the driver under different situations, and ensures no false recognition and false opening and closing. False recognition is not responded, and the accuracy of the recognition result of automatic opening and closing of the trunk lid is ensured to be higher. Simultaneously, face recognition and voice control recognition are simultaneously performed to ensure that the starting accuracy is close to 100%.

3. The automatic trunk lid opening and closing system based on face recognition and voice recognition as claimed in claim 1, wherein the trunk lid control system comprises:

the trunk lid lock controller is electrically connected with the trunk lid lock executor and receives and processes a trunk lid operation instruction generated and sent by the detection module, and the trunk lid lock execution instruction is generated and sent to the trunk lid lock executor;

and the trunk lid lock actuator receives a trunk lid lock execution command sent by the trunk lid lock control, and unlocks or locks the trunk lid lock.

4. The automatic trunk lid opening and closing system based on face recognition and voice recognition as claimed in claim 3, wherein the trunk lid control system further comprises:

the trunk lid power assisting mechanism receives the generated trunk lid operation instruction sent by the detection module and is used for matching with the trunk lid lock to automatically open or close the trunk lid.

5. The control method of the automatic opening and closing system of the trunk lid based on the face recognition and the voice recognition as claimed in claim 1, characterized by comprising the following steps:

s1, identifying and verifying the identity of an operator through an identity identification module, and performing semantic identification on an operator voice instruction if the identity verification is passed;

s2, the detection module receives the operator identity information and semantic identification information of the operator voice instruction, generates a trunk lid operation instruction according to the semantic identification information and sends the trunk lid operation instruction to a trunk lid control system;

and S3, the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

6. The method as claimed in claim 5, wherein the step S1 includes:

s11, identifying and verifying the identity of an operator through a face identification module, and entering the next step of voice identification through identity verification;

s12, the voice recognition module carries out identity recognition and verification on the operator again, and carries out semantic recognition after the identity verification is passed;

and S13, the voice recognition module carries out semantic recognition on the voice of the operator and sends a semantic recognition result to the detection module.

7. The method as claimed in claim 5, wherein the step S3 includes:

s31, the trunk lid lock controller receives and processes a trunk lid operation generating instruction sent by the detection module, generates a trunk lid lock execution instruction and sends the trunk lid lock execution instruction to the trunk lid lock executor;

s32, the trunk lid lock executor receives a trunk lid lock execution instruction sent by trunk lid lock control, and unlocks or locks the trunk lid lock;

and S33, the trunk lid power assisting mechanism receives a generated trunk lid operation instruction sent by the detection module and is matched with the trunk lid lock to automatically open or close the trunk lid.

Technical Field

The invention relates to an automatic opening and closing system and method for a trunk lid, in particular to an automatic opening and closing system and method for the trunk lid based on face recognition and voice recognition.

Background

With the increasing demands of drivers and passengers on the performance of the entire automobile, the technology for automatically opening and closing the trunk lid becomes a research hotspot in recent years, and the technology is realized in mass production in most automobile models. With the development of intelligent technology and electronic control technology, people have higher and higher requirements on the self-adaption of the automobile trunk lid, and a vehicle only provided with a single mode for opening and closing the trunk lid cannot meet the requirements of people, so that the technology for automatically opening and closing the trunk lid is widely researched. The existing trunk lid automatic opening and closing technology is mostly based on a limb operation mode of a driver, and the trunk lid opening and closing requirements of the driver cannot be intelligently responded.

Patent document 1 discloses an automatic automobile unlocking control method and system based on face and gesture recognition, which includes the following steps that an acquisition module monitors an external environment and acquires an external image; the face detection module identifies face images and matches the face images; judging whether the vehicle is the vehicle owner or not, if so, prompting by a prompting module, and waiting for the vehicle owner to make a gesture; the acquisition module captures the gesture of the vehicle owner; the gesture detection module identifies the gesture of the car owner and sends a signal to the lock module to unlock the car door when the unlocking action is identified. However, the scheme has no voice recognition, and the trunk lid is not automatically opened, so that the requirement of automatically opening the trunk lid by a driver cannot be met.

Disclosure of Invention

In order to solve the problems that most existing trunk lid control systems are opened or closed in a limb operation mode, the intelligent degree is not high, and the perception requirements of users cannot be automatically matched, the invention provides a trunk lid automatic opening system and method based on face recognition and voice recognition, which aim to improve the high-level behavior perception of a trunk lid of a vehicle and the automatic opening and closing mode of the trunk lid, better adapt to the requirements of drivers, and improve the intelligent level and the driving experience of the vehicle through the diversity switching of the automatic opening and closing mode of the trunk lid.

The purpose of the invention is realized by the following technical scheme:

as an aspect of the present invention, there is provided an automatic trunk lid opening and closing system based on face recognition and voice recognition, including:

the identity recognition module is used for recognizing the identity of an operator and performing identity verification and is in communication connection with the detection module;

the detection module receives the operator identity recognition result sent by the identity recognition module, determines the identity of the operator, generates a trunk lid operation instruction according to the operator voice, and sends the trunk lid operation instruction to the trunk lid control system;

and the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

Further, the identity module comprises:

the face recognition module is used for recognizing the identity of an operator, is in communication connection with the voice recognition module and the detection module at the same time, can enter the next voice recognition step only through identity verification, and sends the identity recognition result of the operator to the detection module;

and the voice recognition module is used for further recognizing the identity of an operator and performing semantic recognition on the operator, is in communication connection with the detection module, and sends an operator identity recognition result and an operator semantic recognition result to the detection module.

The face recognition and voice recognition module has strong computing capability, can judge and recognize the face and voice of the driver under different situations, and ensures no false recognition and false opening and closing. False recognition is not responded, and the accuracy of the recognition result of automatic opening and closing of the trunk lid is ensured to be higher. Simultaneously, face recognition and voice control recognition are simultaneously performed to ensure that the starting accuracy is close to 100%.

Further, the trunk lid control system includes:

the trunk lid lock controller is electrically connected with the trunk lid lock executor and receives and processes a trunk lid operation instruction generated and sent by the detection module, and the trunk lid lock execution instruction is generated and sent to the trunk lid lock executor;

and the trunk lid lock actuator receives a trunk lid lock execution command sent by the trunk lid lock control, and unlocks or locks the trunk lid lock.

Still further, the trunk lid control system further includes:

the trunk lid power assisting mechanism receives the generated trunk lid operation instruction sent by the detection module and is used for matching with the trunk lid lock to automatically open or close the trunk lid.

As another aspect of the present invention, a method for controlling an automatic trunk lid opening and closing system based on face recognition and voice recognition is provided, which includes the following steps:

s1, identifying and verifying the identity of an operator through an identity identification module, and performing semantic identification on an operator voice instruction if the identity verification is passed;

s2, the detection module receives the operator identity information and semantic identification information of the operator voice instruction, generates a trunk lid operation instruction according to the semantic identification information and sends the trunk lid operation instruction to a trunk lid control system;

and S3, the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

Further, the step S1 includes:

s11, identifying and verifying the identity of an operator through a face identification module, and entering the next step of voice identification through identity verification;

s12, the voice recognition module carries out identity recognition and verification on the operator again, and carries out semantic recognition after the identity verification is passed;

and S13, the voice recognition module carries out semantic recognition on the voice of the operator and sends a semantic recognition result to the detection module.

Further, the step S3 includes:

s31, the trunk lid lock controller receives and processes a trunk lid operation generating instruction sent by the detection module, generates a trunk lid lock execution instruction and sends the trunk lid lock execution instruction to the trunk lid lock executor;

s32, the trunk lid lock executor receives a trunk lid lock execution instruction sent by trunk lid lock control, and unlocks or locks the trunk lid lock;

and S33, the trunk lid power assisting mechanism receives a generated trunk lid operation instruction sent by the detection module and is matched with the trunk lid lock to automatically open or close the trunk lid.

The invention has the advantages that:

compared with the existing automatic trunk lid opening and closing system, the automatic trunk lid opening and closing system has the advantages that the identity of an operator is identified by combining the identification of the face identification function and the voice identification function; the detection module further performs safety evaluation on the whole vehicle state according to the recognition result of the face recognition module and the voice recognition module, performs opening and closing actions on the trunk lid on the premise of ensuring the parking safety of the whole vehicle, and avoids opening and closing in the driving process, for example, if the face and the voice are recognized to be correct, but the whole vehicle is not completely parked or is driving, the opening command is not started; the detection module transmits the driver information to the trunk lid lock BCM controller, the trunk lid is unlocked, and the trunk lid is automatically opened, closed or opened under the cooperation of the trunk lid power-assisted mechanism.

The invention can realize full intellectualization and automation of opening and closing of the trunk lid, realize intellectualization to meet the requirements of a driver, improve the advanced sensing function and the coordination control performance of the vehicle, and bring more use convenience and driving pleasure to the driver.

Drawings

FIG. 1 is a schematic flow chart of the present invention for automatically opening the trunk lid;

fig. 2 is a schematic flow chart of the present invention for automatically closing the trunk lid.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention.

The utility model provides an automatic switching system of suitcase lid based on face identification and voice recognition, includes:

the identity recognition module is used for recognizing the identity of an operator and performing identity verification and is in communication connection with the detection module;

the detection module receives the operator identity recognition result sent by the identity recognition module, determines the identity of the operator, generates a trunk lid operation instruction according to the operator voice, and sends the trunk lid operation instruction to the trunk lid control system;

and the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

Further, the identity module comprises:

the face recognition module is used for recognizing the identity of an operator, is in communication connection with the voice recognition module and the detection module at the same time, can enter the next voice recognition step only through identity verification, and sends the identity recognition result of the operator to the detection module;

and the voice recognition module is used for further recognizing the identity of an operator and performing semantic recognition on the operator, is in communication connection with the detection module, and sends an operator identity recognition result and an operator semantic recognition result to the detection module.

The face recognition and voice recognition module has strong computing capability, can judge and recognize the face and voice of the driver under different situations, and ensures no false recognition and false opening and closing. False recognition is not responded, and the accuracy of the recognition result of automatic opening and closing of the trunk lid is ensured to be higher. Simultaneously, face recognition and voice control recognition are simultaneously performed to ensure that the starting accuracy is close to 100%.

Further, the trunk lid control system includes:

the trunk lid lock controller is electrically connected with the trunk lid lock executor and receives and processes a trunk lid operation instruction generated and sent by the detection module, and the trunk lid lock execution instruction is generated and sent to the trunk lid lock executor;

and the trunk lid lock actuator receives a trunk lid lock execution command sent by the trunk lid lock control, and unlocks or locks the trunk lid lock.

Still further, the trunk lid control system further includes:

the trunk lid power assisting mechanism receives the generated trunk lid operation instruction sent by the detection module and is used for matching with the trunk lid lock to automatically open or close the trunk lid.

A control method of an automatic trunk lid opening and closing system based on face recognition and voice recognition comprises the following steps:

s1, identifying and verifying the identity of an operator through an identity identification module, and performing semantic identification on an operator voice instruction if the identity verification is passed;

s2, the detection module receives the operator identity information and semantic identification information of the operator voice instruction, generates a trunk lid operation instruction according to the semantic identification information and sends the trunk lid operation instruction to a trunk lid control system;

and S3, the trunk lid control system receives the trunk lid operation instruction sent by the detection module and performs related operation of automatic opening or closing of the trunk lid.

Further, the step S1 includes:

s11, identifying and verifying the identity of an operator through a face identification module, and entering the next step of voice identification through identity verification;

s12, the voice recognition module carries out identity recognition and verification on the operator again, and carries out semantic recognition after the identity verification is passed;

and S13, the voice recognition module carries out semantic recognition on the voice of the operator and sends a semantic recognition result to the detection module.

Further, the step S3 includes:

s31, the trunk lid lock controller receives and processes a trunk lid operation generating instruction sent by the detection module, generates a trunk lid lock execution instruction and sends the trunk lid lock execution instruction to the trunk lid lock executor;

s32, the trunk lid lock executor receives a trunk lid lock execution instruction sent by trunk lid lock control, and unlocks or locks the trunk lid lock;

and S33, the trunk lid power assisting mechanism receives a generated trunk lid operation instruction sent by the detection module and is matched with the trunk lid lock to automatically open or close the trunk lid.

Example 1

The utility model provides an automatic switching system of suitcase lid based on face identification and voice recognition, includes:

the face recognition module is used for recognizing the identity of an operator, is in communication connection with the voice recognition module and the detection module at the same time, can enter the next voice recognition step only through identity verification, and sends the identity recognition result of the operator to the detection module;

the voice recognition module is used for further recognizing the identity of an operator and performing semantic recognition on the operator, is in communication connection with the detection module, and sends an operator identity recognition result and an operator semantic recognition result to the detection module;

the detection module receives the operator identity recognition results sent by the face recognition module and the voice recognition module, determines the identity of the operator, generates a trunk lid operation instruction according to the operator semantic recognition result sent by the voice recognition module, and sends the trunk lid operation instruction to the trunk lid lock controller and the trunk lid auxiliary execution mechanism;

the trunk lid lock controller is electrically connected with the trunk lid lock executor and receives and processes a trunk lid operation instruction generated and sent by the detection module, and the trunk lid lock execution instruction is generated and sent to the trunk lid lock executor;

the trunk lid lock actuator receives a trunk lid lock execution instruction sent by trunk lid lock control, and unlocks or locks the trunk lid lock;

the trunk lid power assisting mechanism, such as a trunk lid body, a trunk lid power assisting mechanism and the like, receives the generated trunk lid operation instruction sent by the detection module and is used for matching with the trunk lid lock to perform related operations of automatically opening or closing the trunk lid.

Example 2

As shown in fig. 1, when the trunk lid is opened, the system performs driver face recognition and voice recognition through the face recognition module and the voice recognition module, after confirming that the trunk is parked safely, the electric trunk lid opening switch is triggered, the trunk lid lock is controlled to be unlocked through the BCM, the electric trunk lid support rod is driven to extend through the signal sent by the ECU, and the electric opening of the trunk lid is realized.

Example 3

As shown in fig. 2, when the trunk lid is automatically closed, the voice recognition controller performs voice recognition on a driver, after the parking safety is confirmed, the BCM controls the trunk lid lock and the automatic unlocking, and the ECU sends a signal to drive the trunk lid electric support rod to shorten, so that the trunk lid is electrically closed.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.