阅读说明：本技术 用于手势识别及防撞提醒的控制系统和移动终端 (Control system and mobile terminal for gesture recognition and anti-collision reminding ) 是由 周杰 张轩轩 武书源 于 2020-05-12 设计创作，主要内容包括：本发明公开了一种用于手势识别及防撞提醒的控制系统和移动终端,涉及电子信息技术领域。包括用于手势识别的第一雷达传感器、用于防撞提醒的第二雷达传感器、识别组件、控制器、收发组件和提醒组件,所述控制器分别与所述第一雷达传感器、所述第二雷达传感器、所述识别组件和所述提醒组件电连接,所述第一雷达传感器和所述第二雷达传感器分别与所述收发组件电连接。能够同时具有手势识别和防撞提醒的设计,提升移动终端的适用性和多功能化。(The invention discloses a control system and a mobile terminal for gesture recognition and anti-collision reminding, and relates to the technical field of electronic information. Including the first radar sensor that is used for gesture recognition, the second radar sensor that is used for the anticollision to remind, discernment subassembly, controller, receiving and dispatching subassembly and warning subassembly, the controller respectively with first radar sensor the second radar sensor the discernment subassembly with remind the subassembly electricity and connect, first radar sensor with the second radar sensor respectively with receiving and dispatching subassembly electricity is connected. The design that gesture recognition and anticollision were reminded can have simultaneously, promotes mobile terminal's suitability and multi-functional.)

1. The utility model provides a control system for gesture recognition and anticollision are reminded, its characterized in that, including the first radar sensor that is used for gesture recognition, the second radar sensor that is used for the anticollision to remind, identification component, controller, send and receive subassembly and remind the subassembly, the controller respectively with first radar sensor the second radar sensor the identification component with remind the subassembly electricity and connect, first radar sensor with the second radar sensor respectively with send and receive subassembly electricity and connect.

2. The control system for gesture recognition and collision avoidance reminding of claim 1, wherein the transceiver component comprises a first transceiver antenna and a second transceiver antenna, the first transceiver antenna is connected with the first radar sensor, and the second transceiver antenna is connected with the second radar sensor.

3. The control system for gesture recognition and anti-collision reminding according to claim 2, wherein the first transceiving antenna and the second transceiving antenna are both multi-input multi-output antennas.

4. The control system for gesture recognition and anti-collision reminding as claimed in claim 2, wherein the first radar sensor comprises a power divider, and a voltage controlled oscillator and a mixer respectively connected to the power divider, wherein the power divider is further connected to the first transceiving antenna through a transceiving converter, the transceiving converter is connected to the mixer through an amplifier, and the mixer is connected to the controller through an analog-to-digital converter.

5. The control system for gesture recognition and anti-collision reminding according to claim 1, wherein the frequency band of the electromagnetic wave emitted by the first radar sensor is 60 GHz.

6. The control system for gesture recognition and anti-collision reminding according to claim 1, wherein the frequency band of the electromagnetic wave emitted by the second radar sensor is 24 GHz.

7. The control system for gesture recognition and anti-collision reminding according to any one of claims 1 to 6, wherein the effective range of the gesture recognition of the first radar sensor is 5 cm-30 cm.

8. The control system for gesture recognition and collision avoidance reminding according to any one of claims 1 to 6, wherein the reminding component sends out a reminding signal when the distance of the second radar sensor detecting the obstacle is less than or equal to 80 cm.

9. A mobile terminal, characterized in that, it includes a front end face with a display interface and a back end face deviating from the display interface, and the control system for gesture recognition and anti-collision reminding of any one of claims 1 to 8, wherein the first transceiver antenna of the control system for gesture recognition and anti-collision reminding faces the front end face, and the second transceiver antenna faces the back end face.

10. The mobile terminal of claim 9, wherein the second transceiving antenna has a predetermined angle with the rear end surface.

Technical Field

The invention relates to the technical field of electronic information, in particular to a control system and a mobile terminal for gesture recognition and anti-collision reminding.

Background

With the development of society, the rhythm of life of people is accelerated, the demand for function diversification and the use frequency of mobile terminal products are higher and higher, and the mobile terminal products are possibly required to be used whenever and wherever. For example, when the walking process requires the mobile terminal to return a message, search for a file or play, the eyes generally pay attention to the walking blind in the state of the mobile terminal, i.e., the head of a person is lowered. However, there are various vehicles, trees, trash cans or pedestrians in front on the roads or shade roads of the modern society, which increases the walking risk of the people with low heads.

In addition, when the mobile terminal is in a wet hand state or has other things on hand, the mobile terminal is inconvenient to hold on hand for operation, and man-machine interaction through gesture recognition is a good solution. In the prior art, most of gestures are recognized based on image processing, graphic image data of human gestures are acquired through a single or a plurality of image acquisition sensors, then the acquired image data are subjected to imaging analysis, and finally, the acquired image data are compared with a gesture model established in the past for analysis, so that the specific gesture posture of a book is judged, and the purpose of interaction is achieved.

Based on this, the mobile terminal is required to have the design of gesture recognition and anti-collision reminding at the same time so as to meet the increasing social demands.

Disclosure of Invention

The invention aims to provide a control system and a mobile terminal for gesture recognition and anti-collision reminding, which can simultaneously have the design of gesture recognition and anti-collision reminding, and improve the applicability and the multiple functions of the mobile terminal.

The embodiment of the invention is realized by the following steps:

in one aspect of the embodiment of the invention, a control system for gesture recognition and anti-collision reminding is provided, and the control system comprises a first radar sensor for gesture recognition, a second radar sensor for anti-collision reminding, a recognition component, a controller, a transceiving component and a reminding component, wherein the controller is respectively electrically connected with the first radar sensor, the second radar sensor, the recognition component and the reminding component, and the first radar sensor and the second radar sensor are respectively electrically connected with the transceiving component.

Optionally, the transceiver component includes a first transceiver antenna and a second transceiver antenna, the first transceiver antenna is connected to the first radar sensor, and the second transceiver antenna is connected to the second radar sensor.

Optionally, the first transceiving antenna and the second transceiving antenna are both mimo antennas.

Optionally, the first radar sensor includes a power divider, and a voltage-controlled oscillator and a mixer respectively connected to the power divider, where the power divider is further connected to the first transceiving antenna through a transceiving converter, the transceiving converter is connected to the mixer through an amplifier, and the mixer is connected to the controller through an analog-to-digital converter.

Optionally, the frequency band of the electromagnetic wave emitted by the first radar sensor is 60 GHz.

Optionally, the frequency band of the electromagnetic wave emitted by the second radar sensor is 24 GHz.

Optionally, the effective range of the first radar sensor gesture recognition is 5cm to 30 cm.

Optionally, when the distance that the second radar sensor detects the obstacle is less than or equal to 80cm, the reminding component sends out a reminding signal.

In another aspect of the embodiments of the present invention, a mobile terminal is provided, which includes a front end surface having a display interface, a rear end surface facing away from the display interface, and the control system for gesture recognition and anti-collision reminding as described above, wherein a first transceiver antenna of the control system for gesture recognition and anti-collision reminding faces the front end surface, and a second transceiver antenna faces the rear end surface.

Optionally, a preset included angle is formed between the second transceiving antenna and the rear end face.

The embodiment of the invention has the beneficial effects that:

according to the control system and the mobile terminal for gesture recognition and anti-collision reminding, which are provided by the embodiment of the invention, the first radar sensor for gesture recognition and the first radar sensor transceiving component receive and transmit electromagnetic waves for detection, no matter the intensity of light, the color of the background, whether a hand is provided with gloves or whether water stains exist on the hand or not, the electromagnetic waves can detect a real target without being influenced, and the recognition is reliable and stable. After the target is identified through the first radar sensor (namely the corresponding gesture), the controller receives the scanning target of the first radar sensor, then the target information is forwarded to the identification component, the preset specific gesture is compared, the comparison result is sent to the controller through the identification component, and the controller makes a control instruction according to the corresponding gesture, so that the purpose of gesture identification is achieved. Similarly, the second radar sensor receives and transmits electromagnetic waves through the receiving and transmitting assembly to detect, the controller compares the received distance information with the preset distance after receiving the obstacle distance detected by the second radar sensor, and when the detected distance is smaller than or equal to the preset distance, the controller sends a control instruction to the reminding assembly to enable the reminding assembly to operate so as to remind a user of paying attention. The control system for gesture recognition and anti-collision reminding can simultaneously have the design of gesture recognition and anti-collision reminding, so that the applicability and the multiple functions of the mobile terminal are improved, and better experience is used for improvement.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.

Fig. 1 is a schematic structural diagram of a control system for gesture recognition and collision avoidance reminding according to an embodiment of the present invention;

FIG. 2 is a diagram illustrating a preset gesture of a recognition component according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a first radar sensor according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.

Icon: 100-a control system for gesture recognition and collision avoidance alerting; 110 — a first radar sensor; 111-power divider; 112-a voltage controlled oscillator; 113-a transmit-receive converter; 114-an amplifier; 115-a mixer; 120-a second radar sensor; 130-an identification component; 131-a first gesture; 133-a second gesture; 135-third gesture; 137-fourth gesture; 139-fifth gesture; 140-a controller; 150-a transceiver component; 152-a first transceiving antenna; 154-a second transceiving antenna; 160-a reminder component; 170-analog-to-digital converter; 200-a mobile terminal; 210-a front end face; 220-rear end face.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.

Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Furthermore, the terms "first," "second," and the like are used merely to distinguish one description from another, and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "connected," and "connected" are to be construed broadly, e.g., as meaning fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Referring to fig. 1, the present embodiment provides a control system 100 for gesture recognition and anti-collision reminding, including a first radar sensor 110 for gesture recognition, a second radar sensor 120 for anti-collision reminding, a recognition component 130, a controller 140, a transceiver component 150, and a reminding component 160, where the controller 140 is electrically connected to the first radar sensor 110, the second radar sensor 120, the recognition component 130, and the reminding component 160, respectively, and the first radar sensor 110 and the second radar sensor 120 are electrically connected to the transceiver component 150, respectively.

It should be noted that, the first radar sensor 110 and the second radar sensor 120 are millimeter-wave radars, which can distinguish and identify very small targets and can identify multiple targets at the same time; the system has the characteristics of high resolution, small volume, strong anti-interference capability, good maneuverability and the like. And the millimeter wave thunder method has good detection and identification capabilities on slow targets and vibrating targets, and is easy to identify target characteristics by using target Doppler frequency characteristics.

Second, the first radar sensor 110 and the second radar sensor 120 respectively radiate electromagnetic waves into the atmosphere through the transceiving module 150, and form a beam to propagate forward in a specific range. When the electromagnetic wave encounters a target in the beam, the electromagnetic wave is reflected along various directions, and a part of the electromagnetic wave is reflected back to the direction of the electromagnetic wave emission and is acquired by the transceiver module 150. The acquired electromagnetic waves are processed by the first radar sensor 110 and the second radar sensor 120 to obtain required information. For example, the first radar sensor 110 recognizes gesture information, and the second radar sensor 120 recognizes distance information to perform corresponding functions.

Fourth, both the first radar sensor 110 and the second radar sensor 120 may be in the form of a timing transmitting FMCW (Frequency Modulated Continuous Wave). Referring to fig. 2, five groups of gestures are preset in the recognition component 130, wherein a first gesture 131 is used for waking up the gesture recognition function, a second gesture 133 is used for calling out a menu, a third gesture 135 is used for sliding up and down, a fourth gesture 137 is used for sliding left and right (which may correspond to a return function), and a fifth gesture 139 is used for click confirmation. When the recognition component 130 receives the gesture information detected by the second radar sensor 120, the gesture information is compared to confirm the operation category of the gesture, and then a corresponding function response is performed through the controller 140. The user can also customize the gesture to operate by the gesture that the user is accustomed to.

Fourthly, taking a sawtooth system FMCW radar as an example, the second radar sensor 120 mixes the received Signal with the transmitted Signal to obtain an intermediate frequency Signal (IF Signal), performs fourier transform on the intermediate frequency Signal to find out a peak position of an amplitude spectrum, so as to obtain an obstacle distance, so that when the distance is too small, the controller 140 controls the reminding component 160 to operate in time to realize a reminding response. Similarly, an FMCW radar of a triangular wave system may be used, after a transmission signal (electromagnetic wave) is transmitted, an echo signal reflected by a target may be delayed, and in a frequency change of a triangle, distance measurement may be performed on both a rising edge and a falling edge, so as to obtain an obstacle distance.

According to the control system 100 for gesture recognition and anti-collision reminding provided by the embodiment of the invention, the first radar sensor 110 for gesture recognition and the first radar sensor 110 transceiving component 150 transmit and receive electromagnetic waves for detection, so that no matter whether the light is strong or weak, the background is in any color, whether a hand is provided with gloves or not, whether water stains exist on the hand or not, the electromagnetic waves can detect a real target without being influenced, and the recognition is reliable and stable. After the target is identified by the first radar sensor 110 (i.e. the corresponding gesture), the controller 140 forwards the target information to the identification component 130 after receiving the scanned target of the first radar sensor 110, compares the preset specific gesture, the identification component 130 sends the comparison result to the controller 140, and the controller 140 makes a control instruction according to the corresponding gesture, thereby achieving the purpose of gesture identification. Similarly, the second radar sensor 120 receives and transmits electromagnetic waves through the transceiver component 150 to perform detection, the controller 140 compares the received distance information with the preset distance after receiving the obstacle distance detected by the second radar sensor 120, and when the detected distance is less than or equal to the preset distance, the controller 140 sends a control instruction to the reminder component 160 to enable the reminder component 160 to operate so as to remind the user of the attention. The control system 100 for gesture recognition and anti-collision reminding provided by the application can simultaneously have the design of gesture recognition and anti-collision reminding, so that the applicability and the multiple functions of the mobile terminal are improved, and better experience is used for improvement.

As shown in fig. 1, the transceiver component 150 includes a first transceiver antenna 152 and a second transceiver antenna 154, the first transceiver antenna 152 is connected to the first radar sensor 110, and the second transceiver antenna 154 is connected to the second radar sensor 120.

Specifically, the first transceiving antenna 152 is connected to the first radar sensor 110, and forms electromagnetic signal transmission with the first radar sensor 110. The second transmitting/receiving antenna 154 is connected to the second radar sensor 120, and forms electromagnetic signal transmission with the second radar sensor 120. The first transceiving antenna 152 and the second transceiving antenna 154 may operate independently without affecting each other. Thereby guarantee gesture recognition and the stability that anticollision was reminded.

To further improve the performance of the transceiving antennas, the first transceiving antenna 152 and the second transceiving antenna 154 may both adopt a Multiple Input Multiple Output (MIMO) antenna. MIMO refers to the use of multiple transmitting antennas and multiple receiving antennas at the transmitting end and the receiving end, respectively, to transmit and receive signals through the multiple antennas at the transmitting end and the receiving end, thereby improving communication quality. The multi-antenna multi-transmission multi-receiving system can fully utilize space resources, realize multi-transmission and multi-reception through a plurality of antennas, and improve the system channel capacity by times under the condition of not increasing frequency spectrum resources and antenna transmitting power. Thus, the performance of the first radar sensor 110 and the second radar sensor 120 can be improved by improving the performance of the transmitting/receiving antenna.

As shown in fig. 3, the first radar sensor 110 is taken as an example for illustration, and the first radar sensor 110 may be similar to or slightly modified from the second radar sensor 120. The first radar sensor 110 includes a power divider 111, and a Voltage controlled oscillator 112 (VCO) and a mixer 115 respectively connected to the power divider 111, wherein the power divider 111 is further connected to a first transceiver antenna 152 through a transceiver converter 113, the transceiver converter 113 is connected to the mixer 115 through an amplifier 114, and the mixer 115 is connected to the controller 140 through an Analog-to-digital converter 170 (ADC).

Specifically, the working process of the first radar sensor 110 is as follows: the voltage-controlled oscillator 112 generates a frequency-modulated continuous wave, a part of the electromagnetic waves are transmitted to the first transceiving antenna 152 through the transceiving converter 113 through the power divider 111, and are transmitted out through the first transceiving antenna 152, the electromagnetic waves are reflected after encountering human body gestures and are received through the first transceiving antenna 152, received electromagnetic wave signals enter the frequency mixer 115 through the transceiving converter 113, and because the received electromagnetic wave signals are weak, the received electromagnetic wave signals can be amplified through the amplifier 114 and then transmitted to the frequency mixer 115 before being transmitted to the frequency mixer 115. The electromagnetic wave signal is converted into an intermediate frequency signal after being subjected to frequency conversion and low-pass filtering by the frequency mixer 115, the intermediate frequency signal reaches the analog-to-digital converter 170, and the analog-to-digital converter 170 performs sampling to send data carrying the gesture target transmission information to the controller 140. The controller 140 sends the data information to the recognition component 130, determines a specific gesture type through the recognition component 130, and feeds the gesture type back to the controller 140, so that the gesture recognition is realized to perform the operation and control of the mobile terminal.

The frequency band of the electromagnetic wave emitted by the first radar sensor 110 is 60GHz, the frequency spectrum range of the 60GHz frequency band is 57-66 GHz, and the unlicensed resource is adopted nowadays when the frequency spectrum resources are increasingly scarce, so that high cost for using the frequency band is not required, and the production and use cost is favorably reduced. And the frequency band of 60GHz has higher resolution ratio, is favorable to promoting the precision of gesture recognition.

The frequency band of the electromagnetic wave emitted by the second radar sensor 120 is 24 GHz. 24GHz radar sensor, second radar sensor 120 of this application can be through the transmission with receive frequency be the existence of object, velocity of motion, static distance, the angle etc. that the object was located for 24.125GHz, combine microstrip antenna technique, have characteristics such as small, integrated degree height, response sensitivity. If a parameter (distance) such as the distance from an obstacle to the second radar sensor 120 is to be measured, for example, the radar is obtained in the triangular-wave FMCW system, only linear ascending or descending slopes are selected as the time-dependent function of the transmitting frequency, and the distance from the object can be obtained according to the calculation formula of the delay effect. The whole power consumption can be reduced on the basis of accurate distance measurement, and the occupied space is reduced, so that the difficulty of integrating the mobile terminal is reduced.

The effective range of the gesture recognition of the first radar sensor 110 is 5cm to 30 cm. Therefore, the interference of the external environment can be avoided, other clutter factors are removed, and the accuracy of gesture recognition is improved. When the user controls the mobile terminal through the gesture recognition function, accurate recognition can be achieved when the distance from the mobile terminal is 5cm, 10cm, 20cm or 30cm, and the improvement of interaction experience is facilitated.

The anti-collision reminder is generally applied to the situation that the user uses the mobile terminal during walking, and when the distance from the second radar sensor 120 to the obstacle is less than or equal to 80cm, the reminder component 160 sends out a reminder signal.

Specifically, when the user holds the mobile terminal and walks, the controller 140 controls the operation of the reminder assembly 160 when the distance detected by the second radar sensor 120 is within a preset threshold interval, such as 80cm or 70cm, so that the reminder assembly 160 sends out a reminder signal. The reminding component 160 can adopt a vibration mode, a mode of making a mobile terminal display screen highlight and flash, or a mode of sound reminding and other signals, and the application does not specifically limit the above mode, so long as the purpose of reminding a user in time can be achieved.

Referring to fig. 4, the present application further provides a mobile terminal 200, which includes a front end face 210 having a display interface and a rear end face 220 facing away from the display interface, and the control system 100 for gesture recognition and anti-collision reminding in the foregoing embodiment, wherein the first transceiver antenna 152 of the control system 100 for gesture recognition and anti-collision reminding faces the front end face 210, and the second transceiver antenna 154 faces the rear end face 220.

Specifically, the control system 100 for gesture recognition and anti-collision reminding can be integrally assembled with the mobile terminal 200 through a PCB. When the transceiver module 150 is disposed, the first transceiver antenna 152 of the transceiver module 150 faces the front end surface 210, i.e., between the PCB and the front end surface 210, and the second transceiver antenna 154 faces the rear end surface 220, i.e., between the PCB and the rear end surface 220, i.e., the first transceiver antenna 152 and the second transceiver antenna 154 are located at two opposite sides of the PCB. In this way, the positions of the first transmitting/receiving antenna 152 and the second transmitting/receiving antenna 154 can be set in a targeted manner depending on the functions to be performed by the first radar sensor 110 and the second radar sensor 120. In the process of realizing the gesture recognition and anti-collision reminding functions, signals are stably transmitted, and signal loss caused by shielding is avoided.

It should be noted that the mobile terminal 200 may be a mobile phone, a tablet computer, a laptop computer, a Personal Digital Assistant (PDA), etc., and the control system 100 for gesture recognition and anti-collision reminding may be a component in a mobile phone, a component in a tablet computer, a component in a laptop computer, a component in a PDA, etc. For example, when the Control system 100 for gesture recognition and anti-collision reminding is used as a component of a mobile phone, the controller 140 may be connected to a processor (CPU) in the mobile phone by using an Electronic Control Unit (ECU), so as to integrate the required functions.

In addition, a predetermined angle is formed between the second transceiving antenna 154 and the rear end surface 220. Thus, when the user holds the mobile terminal 200 and moves, the receiving and transmitting transmission side of the second receiving and transmitting antenna 154 can move in a direction better than the moving direction, which is beneficial to reducing the influence of ground clutter, reducing the difficulty of data processing and improving the accuracy of distance detection.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.