阅读说明：本技术 智能鞋及下蹲动作识别方法 (Intelligent shoe and squatting action identification method ) 是由 郑学龙 牟森林 陈仲军 于 2021-08-19 设计创作，主要内容包括：本发明提供了一种智能鞋及下蹲动作识别方法,所述智能鞋包括脚踏部、下蹲检测装置及控制装置；所述下蹲检测装置包括位于脚踏部内的光源与光敏传感器,所述脚踏部受压而改变光敏传感器所接收到的光源发出的光线的传输路径的长度,所述光敏传感器侦测其所接收的所述光线的强度,输出表征光强变化的电信号；所述控制装置包括：控制单元,其根据所述电信号判断脚踏部处于预设受压状态而产生下蹲指令；通信单元,用于无线发送所述下蹲指令。本发明的智能鞋可通过获取受压数据而计算获取用于表征下蹲动作的下蹲指令,通过该下蹲指令与终端设备进行交互。所述下蹲动作识别方法步骤简单,可精确的识别用户的下蹲动作。(The invention provides an intelligent shoe and a squatting action identification method, wherein the intelligent shoe comprises a pedal part, a squatting detection device and a control device; the squatting detection device comprises a light source and a photosensitive sensor which are positioned in a pedal part, the pedal part is pressed to change the length of a transmission path of light rays emitted by the light source received by the photosensitive sensor, and the photosensitive sensor detects the intensity of the light rays received by the photosensitive sensor and outputs an electric signal representing the change of light intensity; the control device includes: the control unit judges that the pedal part is in a preset pressed state according to the electric signal to generate a squatting instruction; and the communication unit is used for wirelessly sending the squatting instruction. The intelligent shoe can calculate and obtain a squatting instruction for representing a squatting action by acquiring the pressure data, and interacts with the terminal equipment through the squatting instruction. The squatting action identification method is simple in steps and can accurately identify the squatting action of the user.)

1. An intelligent shoe is characterized by comprising a pedal part, a squatting detection device and a control device;

the squatting detection device comprises a light source and a photosensitive sensor which are positioned in a pedal part, the pedal part is pressed to change the length of a transmission path of light rays emitted by the light source received by the photosensitive sensor, and the photosensitive sensor detects the intensity of the light rays received by the photosensitive sensor and outputs an electric signal representing the change of light intensity;

the control device includes:

the control unit judges that the pedal part is in a preset pressed state according to the electric signal to generate a squatting instruction;

and the communication unit is used for wirelessly sending the squatting instruction.

2. The intelligent shoe as claimed in claim 1, wherein the light source and the light sensor are disposed opposite to each other in a thickness direction of the foothold, and the foothold is pressed to change a relative distance between the light source and the light sensor.

3. The intelligent shoe as claimed in claim 1, wherein the light source and the photosensitive sensor are disposed in or outside the installation cavity of the foot pedal portion, an emission port of the light source and a receiving port of the photosensitive sensor face in the same direction, and the light emitted by the photosensitive sensor is reflected by the installation cavity or the foot pedal portion and received by the photosensitive sensor.

4. The intelligent shoe according to claim 2, wherein the foothold comprises a sole layer and an insole layer, and the light source and the light sensor are arranged in a mounting cavity of the insole layer and oppositely arranged along the thickness direction of the insole layer.

5. The intelligent shoe according to any one of claims 1 to 4, wherein the installation cavity is located in a heel region of the shoe body.

6. A squat motion recognition method for smart shoes as recited in claim 1, comprising the steps of:

acquiring an electric signal which is collected by a photosensitive sensor in the intelligent shoe and represents the light intensity change of the received light;

calculating the pressure data of the pedal part based on the electric signals, and judging that the pedal part is in a preset pressure state to generate a squatting instruction when a pressure model formed by modeling a plurality of continuous pressure data is matched with a preset squatting pressure model;

the squat instruction is wirelessly transmitted through a communication unit.

7. The squat motion recognition method as claimed in claim 6, wherein the step of calculating the pressure data of the pedal part based on the electrical signal, and determining that the pedal part is in the preset pressure state to generate the squat command when the pressure model formed by modeling a plurality of continuous pressure data matches the preset squat pressure model, comprises the following steps:

sampling a plurality of continuously acquired electrical signals to obtain pressure data;

starting a sliding window with fixed duration to model a plurality of continuous pressure data in time sequence so as to construct a corresponding pressure model;

judging whether the pressure model is matched with a preset squat pressure model or not according to the preset squat pressure model, and judging that the pedal part is in a preset pressure state when the pressure model is matched with the preset squat pressure model;

and when the pedal part is in a preset pressed state, the squatting instruction is generated.

8. A squat motion recognition method as claimed in claim 7, wherein the step of determining whether the pressure receiving model matches the predetermined pressure receiving model based on a predetermined squat pressure model, and determining that the step part is in a predetermined pressure receiving state, comprises the steps of:

judging whether a first pressure stable region set by a squat pressure model exists in the pressure-bearing model according to a time sequence, if not, judging that the pressure-bearing model and the squat pressure model are not matched, and if so, continuing;

continuously judging whether a pressure weightlessness area set by the squat pressure model exists in the pressure-bearing model according to the time sequence, if not, judging that the pressure weightlessness area and the squat pressure model are not matched, and if so, continuing;

continuously judging whether a pressure overweight area set by the squat pressure model exists in the pressure model according to the time sequence, if not, judging that the pressure overweight area and the pressure overweight area are not matched, and if so, continuing;

and continuously judging whether a second pressure stable area set by the squat pressure model exists in the pressure-bearing model according to the time sequence, if not, judging that the pressure-bearing model and the squat pressure model are not matched, and if so, judging that the pressure-bearing model and the squat pressure model are matched.

9. A squat gesture recognition method as claimed in claim 6, wherein in the step of wirelessly sending the squat command via the communication unit, the squat command is sent via the communication unit to a terminal device in a wireless connection state with the smart shoe, and the virtual character in the graphical user interface of the terminal device is controlled to perform posture adjustment to a squat state.

10. A squat movement recognition method as claimed in claim 6, wherein the step of wirelessly transmitting the squat command via the communication unit comprises the specific steps of:

monitoring a squat instruction generated by the intelligent shoe and the intelligent shoe matched with the intelligent shoe according to claim 1;

and judging whether the respective squatting instructions of the two intelligent shoes are received at the same time, and sending the squatting instructions through the communication unit when the two intelligent shoes generate the squatting instructions.

Technical Field

The invention relates to the technical field of action recognition, in particular to an intelligent shoe and a squatting action recognition method.

Background

In recent years, with the rise of AR and VR technologies, motion sensing games have been popular with people because of their excellent realistic experiences. In the motion sensing game, by capturing various gesture motions of a human body, gesture changes of a character in the motion sensing game or special effect output can be controlled.

In order to capture various gesture actions of a human body, a corresponding game device is generally required to be configured for the motion sensing game so as to accurately control the motion of the motion sensing game. For example, when a player is provided with two handles, and each of the two hands of the player holds one handle, the handles detect the movement path of the arm to control the arm of the character of the motion sensing game to perform the same movement path, thereby achieving good game control.

However, the squat action is always a difficulty in motion detection in the motion sensing game, and in the industry, a plurality of cameras are arranged indoors, the motion action of the human body is captured in real time through the cameras, the human body action obtained by the cameras is analyzed through a computer to obtain the squat action, and then the squat action is output by the computer to control the motion of the motion sensing game. However, in this squat motion detection method, a plurality of cameras need to be arranged indoors, so that the economic cost of a player is greatly increased, and a computer needs to perform complicated calculation and analysis to recognize squat motions, so that the operation load of the computer is increased, the situation that the calculation time is too long easily occurs, the squat motions cannot be timely output to a motion sensing game, the operation of the motion sensing game is controlled, and the experience of the motion sensing game is affected. Moreover, when the human body moves to the blind area of the camera, the camera cannot capture the human body action, and further cannot acquire the squat action, so that the operation of the motion sensing game is controlled, and the motion sensing game is greatly restricted.

In order to solve the problem, the industry also provides that a motion sensor is arranged in a shoe of a player to acquire the squatting data of the human body in real time and control the operation of the motion sensing game. However, whether the human body squats is generally difficult to accurately judge through the motion data acquired by the motion sensor arranged in the shoe, and the misjudgment condition is easy to occur, so that the squat data is output when the human body does not squat, and the squat data is not output when the human body squats, so that the experience of the motion sensing game is poor.

Disclosure of Invention

The first purpose of the invention is to provide an intelligent shoe capable of judging squatting actions.

The invention further aims to provide a squat action recognition method capable of accurately judging squat actions.

In order to meet various purposes of the invention, the invention adopts the following technical scheme:

the invention provides an intelligent shoe which is suitable for the first purpose and comprises a pedal part, a squatting detection device and a control device;

the squatting detection device comprises a light source and a photosensitive sensor which are positioned in a pedal part, the pedal part is pressed to change the length of a transmission path of light rays emitted by the light source received by the photosensitive sensor, and the photosensitive sensor detects the intensity of the light rays received by the photosensitive sensor and outputs an electric signal representing the change of light intensity;

the control device includes:

the control unit judges that the pedal part is in a preset pressed state according to the electric signal to generate a squatting instruction;

and the communication unit is used for wirelessly sending the squatting instruction.

Further, the light source and the photosensitive sensor are arranged oppositely along the thickness direction of the pedal part, and the pedal part is pressed to change the relative distance between the light source and the photosensitive sensor.

Furthermore, the light source and the photosensitive sensor are arranged in the installation cavity of the pedal part or outside the installation cavity, the emission port of the light source and the receiving port of the photosensitive sensor face to the same direction, and light rays emitted by the photosensitive sensor are reflected by the installation cavity or the pedal part and are received by the photosensitive sensor.

Furthermore, the tread portion includes sole layer and shoe pad layer, light source and photosensitive sensor arrange the installation cavity of shoe pad layer in, set up along the thickness direction of shoe pad layer in opposite directions.

Specifically, the installation cavity is located in the heel area of the shoe body.

The invention is suitable for the next purpose of the invention and provides a squatting action recognition method of an intelligent shoe, which comprises the following steps:

acquiring an electric signal which is collected by a photosensitive sensor in the intelligent shoe and represents the light intensity change of the received light;

calculating the pressure data of the pedal part based on the electric signals, and judging that the pedal part is in a preset pressure state to generate a squatting instruction when a pressure model formed by modeling a plurality of continuous pressure data is matched with a preset squatting pressure model;

the squat instruction is wirelessly transmitted through a communication unit.

Further, the step of calculating the pressure data of the pedal part based on the electrical signal, and when a pressure model formed by modeling a plurality of continuous pressure data matches a preset squat pressure model, determining that the pedal part is in a preset pressure state to generate a squat command includes the following specific steps:

sampling a plurality of continuously acquired electrical signals to obtain pressure data;

starting a sliding window with fixed duration to model a plurality of continuous pressure data in time sequence so as to construct a corresponding pressure model;

judging whether the pressure model is matched with a preset squat pressure model or not according to the preset squat pressure model, and judging that the pedal part is in a preset pressure state when the pressure model is matched with the preset squat pressure model;

and when the pedal part is in a preset pressed state, the squatting instruction is generated.

Further, the step of judging whether the pressure bearing model is matched with a preset squat pressure model or not according to the preset squat pressure model and judging that the pedal part is in a preset pressure bearing state comprises the following steps:

judging whether a first pressure stable region set by a squat pressure model exists in the pressure-bearing model according to a time sequence, if not, judging that the pressure-bearing model and the squat pressure model are not matched, and if so, continuing;

continuously judging whether a pressure weightlessness area set by the squat pressure model exists in the pressure-bearing model according to the time sequence, if not, judging that the pressure weightlessness area and the squat pressure model are not matched, and if so, continuing;

continuously judging whether a pressure overweight area set by the squat pressure model exists in the pressure model according to the time sequence, if not, judging that the pressure overweight area and the pressure overweight area are not matched, and if so, continuing;

and continuously judging whether a second pressure stable area set by the squat pressure model exists in the pressure-bearing model according to the time sequence, if not, judging that the pressure-bearing model and the squat pressure model are not matched, and if so, judging that the pressure-bearing model and the squat pressure model are matched.

Further, in the step of wirelessly sending the squat instruction through the communication unit, the squat instruction is sent to the terminal device in a wireless connection state with the intelligent shoe through the communication unit, and the virtual role in the graphical user interface of the terminal device is controlled to execute the posture adjustment to the squat state.

Further, the step of wirelessly sending the squat instruction through the communication unit includes the following specific steps:

monitoring a squat instruction generated by the intelligent shoe and the intelligent shoe matched with the intelligent shoe according to claim 1;

and judging whether the respective squatting instructions of the two intelligent shoes are received at the same time, and sending the squatting instructions through the communication unit when the two intelligent shoes generate the squatting instructions.

Compared with the prior art, the invention has the following advantages:

first, the smart shoe of the present invention can detect whether the user squats based on the electrical signal acquired by the squat detection device thereof. The squat detection device comprises a light source and a photosensitive sensor, when the pedal part is pressed to deform, the length of a transmission path of light emitted by the light source received by the photosensitive sensor is increased, and the light intensity of the light is inversely proportional to the length of the transmission path of the light, so that the photosensitive sensor outputs an electric signal representing different light intensities. The photosensitive sensor is sensitive to the light intensity of the light emitted by the light source, can quickly and accurately output electric signals representing different light intensities, reflects slight distance change between the insole layer and the sole layer, analyzes pressure data with different sizes, and judges whether a user squats down.

Secondly, the intelligent shoe can judge whether the user performs squatting action or not based on the pressure data acquired by the electric signals acquired by the photosensitive sensor, and accordingly trigger a corresponding squatting instruction. The squat motion recognition method is small in code amount, small in calculation amount, high in operation efficiency and accurate in calculation, and is particularly suitable for intelligent shoes developed by economic chips such as single-chip microcomputers.

And thirdly, when the user squats, the weight of the user can be weightless firstly, then overweight and finally restored to the original weight, and when the change of the pressure data is matched with the weight change of the user squats, whether the user squats or not can be judged. The squat action recognition method is suitable for the principle, electric signals are collected in real time through the squat detection device arranged on the pedal part of the intelligent shoe, the electric signals are analyzed, the pressure data can be obtained, the pressure data obtaining mode is simple, convenient and efficient, and the method is very effective for representing the action mode of the user.

In addition, the squat action recognition method sends the obtained squat instruction to the terminal equipment so as to implement interaction with the terminal equipment based on the squat instruction, so that the user obtains good experience of the motion sensing game and the interestingness is enhanced.

Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Drawings

The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a partial sectional view of a smart shoe according to an exemplary embodiment of the present invention.

Fig. 2 is a partial sectional view of a smart shoe according to another embodiment of the present invention.

Fig. 3 is a schematic circuit diagram of a smart shoe according to an exemplary embodiment of the present invention.

FIG. 4 is a schematic view of the weight change of the squat of the present invention.

Fig. 5 is a graph of the squat weight change of the present invention.

Fig. 6 is a flowchart of a squat action recognition method according to an exemplary embodiment of the present invention.

Fig. 7 is a flowchart of step S12 of the squat motion recognition method of the present invention.

Fig. 8 is a flowchart of step S123 of the squat motion recognition method of the present invention.

Fig. 9 is a flowchart of step S14 of the squat motion recognition method of the present invention.

Fig. 10 is a flowchart of step S13 of the squat motion recognition method of the present invention.

Detailed Description

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

The person skilled in the art will know this: although the various methods and apparatus of the present invention have been described based upon the same general concepts that are common to each other, they may operate independently unless otherwise specified. In the same way, for the embodiments disclosed in the present invention, the same inventive concept is proposed, and therefore, concepts expressed in the same and, although the concepts expressed in the same are different, those merely changed appropriately for convenience should be equally understood.

The invention provides a squat action recognition method, which is used for recognizing squat actions of a user and generating computer instructions related to the squat actions of the user. The user can interact with the external electronic equipment in real time by making a squatting action to participate in various electronic data activities. For example, when the motion sensing game is controlled through the intelligent shoe, the external electronic device acquires the squat action of the user through the intelligent shoe, further determines the action executed by the user in the interaction process of the motion sensing game on the basis, analyzes the action into an action instruction, executes corresponding feedback, and ensures that the human-computer interaction operation is realized between the user and the motion sensing game.

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In an exemplary embodiment of the present invention, referring to fig. 1, 2 and 3, the present invention provides an intelligent shoe 10 suitable for detecting a squat action, wherein the intelligent shoe 10 comprises a shoe body, a squat detection device and a control device, wherein the squat detection device and the control device are arranged in the shoe body.

The shoe body comprises a pedal part 11, wherein the pedal part 11 comprises a sole layer 112 and an insole layer 111 arranged on the sole layer 112. The insole layer 111 is made of a flexible material such as rubber or foam, and when an acting force in a direction of the sole layer 112 is applied to the insole layer 111, the insole layer 111 is stressed to deform.

Generally, when the user stands, the weight of the user will always be maintained in a steady state since the position of the center of gravity of the user is always maintained; when the user squats, the gravity center of the user can be changed along with the squat action, so that the weight of the user can be suddenly changed in a short time, and when the user maintains a fixed action, the gravity center can be maintained in a stable state and then can recover the weight of the user.

Specifically, with reference to fig. 4 and 5, when the user maintains the standing state, the weight of the user at this time is set as a standard value; when the user is converted from the standing state to the semi-squatting state, the gravity center of the user moves upwards, so that the user enters a weightlessness state, and the weight of the user is smaller than a standard value, namely the weight of the user is lightened; when the user is switched from the half-squatting state to the full-squatting state, the gravity center of the user moves downwards to the hip, so that the user enters the overweight state, the weight of the user is greater than the standard value, namely the weight of the user is increased; after the user maintains the squatting action, the gravity center of the user is restored to the original position, and the weight of the user is restored to the standard value. For example, in conjunction with FIG. 4, when the user has an actual weight of 500N, the user is doing a squat action; when the user is converted from the standing state to the semi-squatting state, the center of gravity of the user moves upwards, the user enters a weightlessness state, and the weight of the user is 250N; when the user is switched from the half-squatting state to the full-squatting state, the gravity center of the user moves downwards, the user enters an overweight state, and the weight of the user is 725N; after the user keeps squatting, the gravity center of the user is kept in a stable state, and the weight of the user is recovered to be 500N.

Therefore, when the user squats, the weight of the user enters a weightlessness state from a stable state, then enters an overweight state from the weightlessness state, and then returns to the stable state from the overweight state.

Therefore, when the user wears the intelligent shoe 10 of the present invention and performs a squatting motion, the pressure applied to the insole layer 111 by the user is changed due to the change of the weight, so that the distance between the insole layer 111 and the sole is changed.

Specifically, the distance between the bottom surface of the insole layer 111 and the top surface of the sole layer 112 when the user stands is taken as a standard distance; when the user does the squatting action weightlessness, the pressure of the user on the insole layer 111 becomes small, which causes the distance between the top surface of the insole layer 111 and the top surface of the sole layer 112 to become large, and the distance is larger than the standard distance; when the user squats to be overweight, the pressure of the user on the insole is increased, which causes the distance between the top surface of the insole layer 111 and the top surface of the sole layer 112 to be decreased; when the user maintains the squat motion, the pressure of the user on the insole layer 111 is restored to the standing state, so that the distance between the top surface of the insole layer 111 and the top surface of the sole layer 112 is restored to the standard distance.

The squat detection device comprises a light source 12 and a photosensitive sensor 13. Light source 12 and photosensitive sensor 13 set up along the thickness direction of pedal portion 11 in opposite directions, and light source 12 is towards photosensitive sensor 13 emission light, and photosensitive sensor 13 receives behind the light, the output signal of telecommunication, and photosensitive sensor 13 exports the signal of telecommunication that the representation light intensity changes based on the intensity of light, and the light intensity of light is the inverse ratio with the length of the transmission path of light. The photosensitive sensor 13 can sensitively recognize the change of the intensity of the light, so as to output electric signals representing different light intensities, and accurately judge squatting.

Because the squat detection device is disposed on the foot rest 11, when the foot rest 11 is pressed, the distance between the insole layer 111 and the sole layer 112 will be changed, so that the distance between the light source 12 and the light sensor 13 can be changed. When the distance between the light source 12 and the photosensor 13 changes, the light intensity of the light emitted from the light source 12 received by the photosensor 13 changes due to the fact that the light intensity of the light is inversely proportional to the length of the transmission path of the light, and the photosensor 13 correspondingly outputs an electrical signal for representing the change of the light intensity, specifically, the electrical signal reflects the change of the light intensity through the change of the current or the voltage of the electrical signal. And the light sensor 13 can sensitively recognize the change of the light intensity, so as to reflect the slight distance change between the insole layer 111 and the sole layer 112, and further accurately reflect the pressure change, and recognize the squat action.

In an exemplary embodiment of the present invention, the light source 12 is disposed on the insole layer 111, the light sensor 13 is disposed on the sole layer 112, the insole layer 111 is provided with a first installation cavity 1111 corresponding to the light source 12, and the light source 12 is disposed at the bottom of the first installation cavity 1111; the sole layer 112 is provided with a second mounting cavity 1121 corresponding to the light sensor 13, and the light sensor 13 is disposed at the bottom of the second mounting cavity 1121. The opening of the first mounting cavity 1111 faces the opening of the second mounting cavity 1121, and the first mounting cavity 1111 and the second mounting cavity 1121 are both arranged along the thickness direction of the pedal portion 11. In another embodiment, the light source may be mounted to the second mounting cavity and the light sensitive sensor may be mounted to the first mounting cavity.

When the user dresses intelligent shoes 10, when the action of squatting, can take place the sudden change because of user's weight, make when the difference of user's weight, it is also different to the pressure of foot rest portion 11, thereby change the distance between the top surface of insole layer 111 and the top surface of sole layer 112, change the distance between light source 12 that sets up on insole layer 111 and the photosensor 13 that sets up on sole layer 112, the light intensity of light is inversely proportional with the length of the transmission path of light, make the light intensity of the light that photosensor 13 received change along with the change of the distance between light source 12 and the photosensor 13, and then make the signal of telecommunication of the changeable light intensity of the outputation sign of photosensor 13. Therefore, the distance change between the light source 12 and the photosensitive sensor 13 can be calculated through the electric signal which is output by the photosensitive sensor 13 and represents the light intensity change, the pressure change of the insole layer 111 can be reflected, and when the pressure change of the insole layer 111 meets the pressure change of the insole layer 111 in the squatting process, the squatting action of the user can be judged.

In one embodiment, the light source 12 and the photosensor 13 can be disposed in the first mounting cavity of the insole layer 111 at the same time, and the light source 12 and the photosensor 13 are disposed at two ends of the first mounting cavity along the thickness direction of the footrest portion 11, respectively. When the pressure to the insole layer 111 is different, the insole layer 111 will be deformed differently, and thus the distance between the light source 12 and the photosensor 13 will be changed, so that the photosensor 13 outputs an electrical signal representing the change in light intensity.

In another embodiment, the emitting port of the light source 12 for emitting light and the receiving port of the photosensor 13 for receiving light face in the same direction, and the light source 12 and the photosensor 13 are disposed side by side in the installation cavity 114 of the foothold 11 or outside the installation cavity 114. Preferably, the emission port of the light source 12 and the receiving port of the photosensitive sensor 13 are on the same plane.

Referring to fig. 2, when the light source 12 and the photosensor 13 are disposed in the installation cavity 114 or outside the installation cavity 114, and the emitting port of the light source 12 and the receiving port of the photosensor 13 face the bottom of the installation cavity 114 at the same time, after the light emitted by the light source 12 reaches the bottom of the installation cavity 114, the light may be diffusely reflected toward the direction of the photosensor 13 and the light source 12, so that the photosensor 13 may receive the light emitted by the light source 12. When the user dresses intelligent shoes 10, when the action of squatting, can take place the sudden change because of user's weight, make when the difference of user's weight, also different to pedal portion 11's pressure, thereby change the distance between light source 12 and photosensitive sensor 13 and the installation cavity 114 chamber end, change the length of the transmission path of the light that photosensitive sensor 13 received, the length of the transmission path of light because of the light intensity of light and light is the inverse ratio, will change the light intensity of the light that photosensitive sensor 13 received, and then make the signal of telecommunication of the outputable sign light intensity change of photosensitive sensor 13.

Referring to fig. 2, when the light sensor 12 and the light sensor 13 are disposed in the mounting cavity 114, and the emitting port of the light source 12 and the receiving port of the light sensor 13 face the opening of the mounting cavity 114 at the same time, the light emitted from the light source 12 can diffuse toward the light sensor 13 and the light source 12 after passing through the opening of the mounting cavity 114 to the pedal portion, so that the light sensor 13 can receive the light emitted from the light source 12. When the user dresses intelligent shoes 10, when the action of squatting, can take place the sudden change because of user's weight, make when the difference of user's weight, also different to pedal portion 11's pressure, thereby change the distance between light source 12 and photosensitive sensor 13 and the installation cavity 114 accent, change the length of the transmission path of the light that photosensitive sensor 13 received, be the inverse ratio because of the light intensity of light and the length of the transmission path of light, will change the light intensity of the light that photosensitive sensor 13 received, and then make the signal of telecommunication of the outputable sign light intensity change of photosensitive sensor 13.

In one embodiment, the photosensor 13 may be a photo-resistor or a photo-transistor, and the light source 12 may be a light emitting diode or an LED lamp or a general incandescent lamp.

In one embodiment, to detect the pressure variation of the foot rest 11, a squat detection device is disposed in the heel area of the foot rest 11 with a larger thickness, so as to have a larger distance buffer between the photosensitive sensor 13 and the light source 12. Therefore, the light sensor 13 and the light source 12 are arranged in the installation cavity and are also arranged in the heel area correspondingly.

In an exemplary embodiment of the invention, in connection with fig. 3, the control means comprises a control unit 14 and a communication unit 15.

The control unit 14 is electrically connected to the communication unit 15, the photosensor 13 and the light source 12. The photosensor 13 outputs the obtained electric signal for representing the light intensity change to the control unit 14, the control unit 14 calculates the pressure change to which the insole layer 111 is subjected based on the electric signal, and when the pressure change of the insole layer 111 meets the judgment condition of the preset squat pressure model, the control unit 14 obtains the squat instruction and wirelessly transmits the obtained squat instruction to the terminal device through the communication unit 15. The communication unit 15 is preferably bluetooth or other near field communication technology, although communication mechanisms based on mobile communication, WiFi, etc. are not excluded, and those skilled in the art can flexibly select the communication mechanism.

The control unit 14 transmits the obtained squat instruction to the terminal device via the communication unit 15, so that the control unit 14 and the terminal device realize interaction based on the squat instruction. And after receiving the squat instruction, the terminal equipment controls the role in the application program running in the terminal equipment to make corresponding posture adjustment. For example, after receiving a squat instruction, the terminal device controls a character of the motion sensing game running therein to perform a squat action.

The invention also provides intelligent wearing equipment which comprises a pair of the intelligent shoes, wherein the two shoes of the pair of the shoes are respectively called as a first intelligent shoe and a second intelligent shoe. When a user feels a game in a body, usually, the user wears the first intelligent shoe and the second intelligent shoe at the same time, the two intelligent shoes can be preset as a main-slave relation when leaving a factory, so that the two intelligent shoes can be mutually backed up when necessary, and when the user works, the first intelligent shoe can be used for establishing wireless communication connection with the terminal equipment, the second intelligent shoe only needs to synchronize a squatting instruction generated by the second intelligent shoe to the first intelligent shoe, and the first intelligent shoe is used for carrying out related judgment and outputting data to the terminal equipment.

The two intelligent shoes are in wireless communication through respective communication units so as to carry out data interaction. The communication unit of the first intelligent shoe outputs the received second squat instruction to the control unit of the first intelligent shoe; if the first intelligent shoe obtains a squat instruction (called a first squat instruction) by detecting the pressure data, the first intelligent shoe encapsulates the first squat instruction and the second squat instruction into a squat instruction, and the squat instruction is sent to the terminal equipment through the communication unit of the first intelligent shoe so as to perform human-computer interaction with the terminal equipment based on the squat instruction. That is, when the control unit of the first intelligent shoe receives the respective squat command of the pair of intelligent shoes at the same time, the control unit sends the squat command to the terminal device through the communication unit.

It is understood that, in an embodiment, the master-slave relationship between the first intelligent shoe and the second intelligent shoe may be switched or a disaster-backup relationship may be formed at any time, that is, when the communication link between the first intelligent shoe and the terminal device is disconnected, a control instruction may be sent to control the second intelligent shoe to establish a communication link with the terminal device, instead of the first intelligent shoe communicating with the terminal device. In this case, the second smart shoe and the first smart shoe are exchanged in roles. Therefore, those skilled in the art should understand that the serial numbers of the first intelligent shoe and the second intelligent shoe are assigned to the roles played by the intelligent shoes, and are not specific to the intelligent shoes.

In an exemplary embodiment of the invention, in combination with the intelligent shoe, the invention provides a squat motion recognition method based on the intelligent shoe, which reflects the pressure change of the intelligent shoe by the user through the electric signal collected by the photosensitive sensor and used for representing the light intensity, and outputs a squat command after the pressure change meets the judgment condition of a preset squat pressure model. With reference to fig. 6, the squat motion recognition method includes the following steps:

step S11, acquiring electric signals which are collected by the photosensitive sensor in the intelligent shoe and represent the light intensity change of the received light:

when the user dresses during the intelligent shoes, the user will produce certain pressure to the pedal portion of intelligent shoes, and after the insole layer of pedal portion received pressure, the distance between the top surface of insole layer and the bottom of sole layer will change for the length that sets up the transmission path of the light that the light source that photosensitive sensor in the insole layer received sent changes, thereby makes the light intensity of the light that photosensitive sensor received change, and then makes the light intensity change's of its receipt light of outputtable representation of photosensitive sensor signal of telecommunication. That is, the electrical signal based on the change in the characteristic light intensity may reflect a change in the magnitude of the pressure to which the insole layer is subjected.

When the photosensitive sensor detects and acquires the electric signal, the photosensitive sensor outputs the electric signal to the control unit.

Step S12, calculating the pressure data of the pedal part based on the electric signals, and when the pressure model formed by modeling a plurality of continuous pressure data is matched with a preset squat pressure model, judging that the pedal part is in a preset pressure state to generate a squat command:

after the control unit receives the electric signals, the electric signals are calculated to analyze the pressure data of the user on the insole layer, a pressure model is built according to the plurality of pressure data, and when the pressure model corresponds to the squat pressure model, the user is judged to squat, and a squat instruction is obtained. Specifically, in conjunction with fig. 7, the step S12 further includes the following sub-steps:

step S121, sampling a plurality of the electrical signals collected continuously into pressure data:

the photosensor continuously outputs the electric signals acquired by the photosensor to the control unit, and the electric signals can reflect the light intensity change of the light received by the photosensor, and specifically, the electric signals reflect the light intensity change of the light through the voltage or current of the electric signals. The control unit calculates the length of a transmission path of light rays emitted by the light source received by the photosensitive sensor based on the voltage or the current of the electric signal so as to reflect the distance between the insole layer and the sole layer and acquire the deformation degree of the insole layer under pressure. The control unit calculates the compression data of the insole layer based on the compression deformation degree of the insole layer, namely the pressure applied to the insole layer by the user.

The photosensitive sensor continuously outputs a plurality of electric signals acquired by the photosensitive sensor to the control unit, and the control unit analyzes a plurality of pressure data based on the continuous electric signals.

Step S122, starting a sliding window with fixed duration to model a plurality of continuous pressurized data in time sequence so as to construct a corresponding pressurized model:

the control unit sequences a plurality of pressure data acquired by analyzing the plurality of electric signals according to a time sequence to construct a pressure sequence so as to reflect the change of the pressure applied by the user on the intelligent shoe. The control unit sets a sliding window with fixed time duration, collects a plurality of pressure data in the pressure sequence within the fixed time duration into the sliding window according to the time sequence, and models all the pressure data in the sliding window to construct a corresponding pressure model. Specifically, all the pressure data in the sliding window are fitted to construct a pressure change curve to reflect the change of the pressure applied by the user to the intelligent shoe.

Step S123, judging whether the pressed model is matched with a preset squat model, and when the pressed model is matched with the preset squat model, judging that the pedal part is in a preset pressed state:

as described above, when the user squats, the weight of the user enters the weightlessness state from the steady state, then enters the overweight state from the weightlessness state, and finally returns to the steady state from the overweight state. From this, when the user wears the intelligent shoes action of squatting, the user's weight will be exerted the pedal portion for intelligent shoes through the form of pressure, and the change of the insole layer of pedal portion receives the pressure accords with the change of user's weight, promptly, when the user squats, the user enters into the state that the pressure diminishes to the insole layer suddenly from the steady state, enters into the state that pressure is greater than the steady state by the state that the pressure diminishes again, later resumes to the steady state again.

When the compression model constructed by all the compression data acquired by the control unit in the sliding window accords with the compression change condition of the insole layer caused by the squat action of the user, the pedal part of the intelligent shoe is judged to be in a preset compression state.

In order to conveniently judge whether the pressure data in each time period in the pressure model meets the judgment condition of the squat pressure model, the squat pressure model is sequentially divided into a first pressure stable area, a pressure weightlessness area, a pressure overweight area and a second pressure stable area according to the pressure change of the insole layer when a user squats. Divide the pressurized model into a plurality of pressure areas according to time sequence, if each pressure area of pressurized model respectively with each pressure area of the pressure model of squatting when matching, then judge that the user has carried out the action of squatting, the pedal portion of intelligent shoes is in and predetermines the pressurized state.

The multiple pressure areas of the pressure-bearing model are a first pressure area, a second pressure area, a third pressure area and a fourth pressure area in sequence according to time sequence; when the first pressure area of the pressure-bearing model is matched with the first pressure stable area of the squat pressure model, the second pressure area of the pressure-bearing model is matched with the pressure weightlessness area of the squat pressure model, the third pressure area of the pressure-bearing model is matched with the pressure overweight area of the squat pressure model, and the fourth pressure area of the pressure-bearing model is matched with the second pressure stable area of the squat pressure model, the user is judged to squat, and the pedal part of the intelligent shoe is in a preset pressure-bearing state. With reference to fig. 8, the matching manner of the specific pressure model in step S123 and each pressure area of the squat pressure model includes the following sub-steps:

step S1231, judging whether a first pressure stable region set by a squat pressure model exists in the pressure model according to a time sequence, if not, judging that the pressure stable region and the squat pressure model do not match, and if so, continuing:

and according to the time sequence, when the first pressure area of the pressure-bearing model is matched with the first pressure stable area of the squat pressure model, the characteristic that the user is still in a standing state and the user does not squat is shown. At this time, the weight of the user is the standard value and is kept stable and unchanged within a certain time period; therefore, when the pressure data of the first pressure zone maintains stable change and is within the preset value range, the first pressure zone is judged to be matched with the first pressure stable zone, and then the next matching is carried out in time sequence.

When the first pressure area is matched with the first pressure stable area, a pressure change curve is obtained by fitting all pressure data in the sliding window, and when the pressure change curve is in the first pressure area, the curve is approximately parallel to the X axis.

Step S1232, continuously judging whether the pressure loss area set by the squat pressure model exists in the pressure model according to the time sequence, if not, judging that the pressure loss area and the squat pressure model do not match, and if so, continuously:

and according to the time sequence, when the second pressure area of the pressure-bearing model is matched with the pressure weightlessness area of the squat pressure model, representing that the user performs the semi-squat action and does not complete the whole squat action. At this time, when the weight of the user is smaller than the standard value within a certain time period and the pressure data of the first pressure area are smaller than the standard value, the second pressure area is judged to be matched with the pressure weight loss area, and then the next step of matching is carried out according to the time sequence.

When the second pressure area is matched with the pressure weightlessness area, the pressure change curve is obtained by fitting all the pressure data in the sliding window, and the curve of the pressure change curve is in a wave trough shape when the pressure change curve is in the second pressure area.

Step S1233, continuously judging whether the pressure overweight area set by the squat pressure model exists in the pressure model according to the time sequence, if not, judging that the pressure overweight area and the squat pressure model do not match, and if so, continuing:

and when the third pressure area of the pressure model is matched with the pressure overweight area of the squat pressure model in time sequence, the representation that the user possibly completes the squat action is carried out. At this time, when the weight of the user is greater than the standard value within a certain time period and the pressure data of the third pressure area is greater than the standard value, the third pressure area is judged to be matched with the pressure overweight area, and then the next step of matching is carried out according to the time sequence.

When the third pressure area is matched with the pressure overweight area, the curve of the pressure change curve is in a wave crest shape when the pressure change curve is in the third pressure area according to the pressure change curve obtained by fitting all the pressure data in the sliding window.

Step S1234, continuously determining, according to a time sequence, whether a second pressure stable region set by the squat pressure model exists in the pressure model, if not, determining that the pressure stable region and the squat pressure model do not match, and if so, determining that the pressure stable region and the squat pressure model match:

and when the fourth pressure area of the pressure-bearing model is matched with the second pressure stable area of the squat pressure model in time sequence, representing that the user completes squat action. At the moment, the weight of the user is recovered to the standard value, and the weight is maintained for a certain time, the fourth pressure area is judged to be matched with the second pressure stable area, the judgment of the squatting action is completed, and the pedal part of the intelligent shoe is in the preset pressed state.

And when the fourth pressure area is matched with the fourth pressure stable area, a pressure change curve is obtained by fitting all the pressure data in the sliding window, and when the pressure change curve is in the fourth pressure area, the curve is approximately parallel to the X axis.

Therefore, when the four pressure areas of the pressure-receiving model correspond to the four pressure areas of the squat pressure model, the user can be judged to finish the squat action. If one of the four pressure areas in the pressure-bearing model is not matched with the pressure area of the corresponding squat pressure model, the squat judgment is stopped, and the squat action of the user is represented.

Step S124, when the pedal is in the preset pressed state, generating the squat command:

when the pressure model is matched with the squat pressure model, the pedal part of the intelligent shoe is represented to be in a preset pressure state, and the control unit generates a squat instruction.

Step S13, the squat instruction is wirelessly sent by the pass unit:

and after the control unit acquires the squat instruction, the communication unit sends the squat instruction to the terminal equipment so that the control unit realizes interaction with the terminal equipment based on the squat instruction.

Furthermore, when the intelligent shoe implementing the method is used for interacting with terminal equipment such as an intelligent television, a mobile terminal and a game machine, the intelligent shoe can be used as an input device for user instructions. In this case, the control unit of the intelligent shoe establishes communication connection with the terminal device through the communication unit, and outputs a squatting instruction obtained after the control unit recognizes the squatting action to the terminal device in real time. When the terminal equipment starts the related game program or health data APP, the squatting instruction can also be regarded as the related user instruction or user data, correspondingly, the program process of the terminal equipment responds to the squatting instruction and can also feed back information or send a notification to the intelligent shoe, for example, a notification instruction for controlling the vibration alarm of the vibration sensor of the intelligent shoe is sent, and the like.

In a game scene applying the invention, after the posture of the user is determined to face, the intelligent shoe can output a squatting instruction of the user to terminal equipment such as an intelligent television, a mobile terminal and a game machine through the communication unit, and after the terminal equipment receives the squatting instruction of the user, a computer control instruction can be generated based on the data so as to guide the user to carry out man-machine interaction control on the terminal equipment and improve the interestingness of the game.

In one embodiment, in conjunction with fig. 9, the step S14 of the control unit interacting with the terminal device based on the squat command includes sending the squat command to the terminal device in the wireless connection state with the smart shoe through the communication unit, and controlling the virtual character in the graphical user interface of the terminal device to perform posture adjustment to the squat state:

the application program running on the terminal equipment is a motion sensing game, the control unit sends the obtained squat instruction to the terminal equipment through the communication unit, and the terminal equipment controls game roles in the motion sensing game to make corresponding posture adjustment or release a corresponding special effect based on the squat instruction. For example, the terminal device controls a game character in the motion sensing game to perform a squat action based on a squat instruction.

In one embodiment, when the user uses the above-mentioned intelligent wearable device, if the user outputs a squat instruction to the terminal device, the user only needs to output the squat instruction to the terminal device after a pair of intelligent shoes of the intelligent wearable device simultaneously acquire the squat instruction. Specifically, in conjunction with fig. 10, the following steps are included:

s131, monitoring a squatting instruction generated by the intelligent shoe and another intelligent shoe matched with the intelligent shoe;

the control unit of second intelligent shoes obtains based on the pressurized data the instruction of squatting (being called the second instruction of squatting), and the control unit of second intelligent shoes will obtain the second instruction of squatting and send the communication unit of first intelligent shoes to through its communication unit, and the communication unit of first intelligent shoes will obtain the second instruction of squatting and export the control unit of first intelligent shoes.

Step S132, judging whether the respective squat instruction of the two intelligent shoes is received in the same time, and sending the squat instruction through the communication unit when the two intelligent shoes generate the squat instruction:

when the control unit of the first intelligent shoe obtains a second squat instruction output by the second intelligent shoe, if the control unit of the first intelligent shoe also obtains a squat instruction (called as a first squat instruction) at the same time, the control unit of the first intelligent shoe encapsulates the two squat instructions into one squat instruction and outputs the squat instruction to the terminal equipment; otherwise, the squat instruction is not sent to the terminal equipment.

From this, if the user dresses two intelligent shoes of intelligent wearing equipment, obtain the instruction of squatting simultaneously through two intelligent shoes, can be better judge whether the user has carried out the action of squatting.

The invention also provides terminal equipment suitable for the squatting action identification method, and the terminal equipment is in wireless connection with the intelligent shoes. At least one process running in the terminal device triggers another computer event in response to the squat instruction, and controls the role in the application program to make a corresponding posture adjustment based on the squat instruction.

The invention also provides a computer device which is wirelessly connected with the intelligent shoe as described in the above, wherein at least one process running in the computer device responds to the event notification and triggers another computer event to change the self-executed business process.

The present application further provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the squat action recognition method as described above. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

In summary, the intelligent shoe and the squat action recognition method can calculate and obtain a squat instruction for representing squat action by obtaining the pressure data, and interact with the terminal equipment through the squat instruction. The squatting action identification method is simple in steps and can accurately identify the squatting action of the user.

Because the situation is complicated and cannot be illustrated by a list, a person skilled in the art can realize that many examples exist according to the basic method principle provided by the application and the practical situation, and the protection scope of the application should be protected without enough inventive work.

The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.

It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.