阅读说明：本技术 基于混合现实设备的智能按摩的方法及装置 (Intelligent massage method and device based on mixed reality equipment ) 是由 刘海涛 张豫辉 曹洪源 周健 于 2018-06-07 设计创作，主要内容包括：本发明公开了一种基于混合现实设备的智能按摩的方法及装置,方法包括：混合现实设备接收用户的用户属性信息；用户属性信息包括用户的体型和关节位置；根据用户属性信息,为用户匹配相应的虚拟人体三维模型；利用虚拟人体三维模型建立与用户相对应的虚拟图像的按摩提示点；根据所述按摩提示点,加载预设的按摩方式程序；其中,按摩方式程序为依据按摩提示点配以虚拟3D按摩手法和虚拟按摩力度；根据按摩提示点的指令,启动按摩方式程序对用户进行智能按摩。本发明能让普通人按照提示为其他人进行准确有效的按摩、没有使用门槛的要求、使按摩变得更加方便且价格低廉、可以灵活选择不同的按摩方式程序。(the invention discloses an intelligent massage method and device based on mixed reality equipment, wherein the method comprises the following steps: the mixed reality equipment receives user attribute information of a user; the user attribute information comprises the body type and joint position of the user; matching a corresponding virtual human body three-dimensional model for the user according to the user attribute information; establishing a massage prompt point of a virtual image corresponding to a user by using the virtual human body three-dimensional model; loading a preset massage mode program according to the massage prompt point; wherein, the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points; and according to the instruction of the massage prompt point, starting a massage mode program to carry out intelligent massage on the user. The invention can enable common people to carry out accurate and effective massage for other people according to the prompt, has no requirement of using a threshold, leads the massage to be more convenient and have low cost, and can flexibly select different massage mode programs.)

1. An intelligent massage method based on mixed reality equipment is characterized by comprising the following steps:

The mixed reality equipment receives user attribute information of a user; the user attribute information includes a body type and a joint position of the user;

matching a corresponding virtual human body three-dimensional model for the user according to the user attribute information;

Establishing a massage prompt point of a virtual image corresponding to the user by using the virtual human body three-dimensional model;

Loading a preset massage mode program according to the massage prompt point; the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points;

and starting the massage mode program to carry out intelligent massage on the user according to the instruction of the massage prompt point.

2. the method of intelligent massage based on mixed reality devices of claim 1, further comprising, before the mixed reality device receives user attribute information of a user:

and programming the massage therapy to obtain the massage mode program, and storing the massage mode program in the cloud or the mixed reality equipment.

3. the method of intelligent massage based on mixed reality devices of claim 1, wherein the massage cue points comprise:

The massage prompting point is characterized in that a set shape is adopted as a prompting mark, different colors are adopted for the massage prompting point to represent different force, when the color displayed by the massage prompting point is a first color, the represented force is a high force, when the color displayed by the massage prompting point is a second color, the represented force is a medium force, and when the color displayed by the massage prompting point is a third color, the represented force is a soft force.

4. the intelligent massage method based on the mixed reality device according to claim 1, wherein the loading of the preset massage mode program according to the massage cue points comprises:

Responding to the massage cue point;

And downloading the massage mode program through the cloud end or the local end of the mixed reality equipment.

5. the method for intelligent massage based on mixed reality equipment according to any one of claims 1 to 4, wherein the massage mode program is started to perform intelligent massage on the user according to the instruction of the massage prompt point, and further comprising:

Performing intelligent massage on the user according to the instruction of the current massage prompt point;

and continuing to perform intelligent massage on the user according to the instruction of the next massage prompt point until the mixed reality equipment sends a voice command to finish the intelligent massage on the user.

6. The method of mixed reality device-based intelligent massage according to any one of claims 1 to 4, further comprising:

Receiving application evaluation information of the user on the massage mode program;

According to the application evaluation information, the massage mode programs are subjected to priority ranking;

and adaptively adjusting the massage mode program according to the sequencing result.

7. the utility model provides a device of intelligence massage based on mixed reality equipment which characterized in that includes:

a first receiving unit: the mixed reality device is used for receiving user attribute information of a user; the user attribute information includes a body type and a joint position of the user;

A matching unit: the virtual human body three-dimensional model matching module is used for matching a corresponding virtual human body three-dimensional model for the user according to the user attribute information;

the establishing unit: a massage prompt point used for establishing a virtual image corresponding to the user by utilizing the virtual human body three-dimensional model;

A loading unit: the massage device is used for loading a preset massage mode program according to the massage prompt point; the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points;

a starting unit: and the massage mode program is started to carry out intelligent massage on the user according to the instruction of the massage prompt point.

8. The apparatus for intelligent massage based on mixed reality device of claim 7, further comprising:

A program unit: the massage mode program is obtained after the massage therapy is programmed and stored in the cloud or the mixed reality equipment.

9. The device of claim 7, wherein the massage cue points comprise:

The massage prompting point is characterized in that a set shape is adopted as a prompting mark, different colors are adopted for the massage prompting point to represent different force, when the color displayed by the massage prompting point is a first color, the represented force is a high force, when the color displayed by the massage prompting point is a second color, the represented force is a medium force, and when the color displayed by the massage prompting point is a third color, the represented force is a soft force.

10. The apparatus for intelligent massage based on mixed reality device of claim 7, wherein the loading unit comprises:

A response subunit: for responding to the massage cue point;

A downloading subunit: the massage mode program is downloaded through the cloud end or the local end of the mixed reality equipment.

11. The apparatus for mixed reality device-based intelligent massage according to any one of claims 7 to 10, wherein the starting unit comprises:

Current instruction subunit: the intelligent massage system is used for intelligently massaging the user according to the instruction of the current massage prompt point;

a termination subunit: and the intelligent massage device is used for continuing to carry out intelligent massage on the user according to the instruction of the next massage prompt point until the mixed reality equipment sends a voice command to finish the intelligent massage on the user.

12. The apparatus for intelligent massage based on mixed reality device of any one of claims 7 to 10, further comprising:

A second receiving unit: the massage mode program is used for receiving application evaluation information of a user on the massage mode program;

a sorting unit: the massage mode programs are used for carrying out priority sequencing according to the application evaluation information;

An adjusting unit: and the massage mode program is used for adaptively adjusting the massage mode program according to the sequencing result.

Technical Field

The invention relates to the technical field of mixed reality, in particular to an intelligent massage method and device based on mixed reality equipment.

Background

the massage means that the muscles under the skin are overstocked or stretched by contacting the body, so as to dredge the channels and collaterals, smooth the joints, promote the circulation of qi and blood, adjust the functions of the viscera and enhance the disease resistance of the human body, thereby achieving the purpose of curing the pain. At present, massage is a common physical therapy and relaxation mode, ordinary people need to go to a professional clinic or beauty salon for massage therapy or massage relaxation, and ordinary people cannot accurately and effectively massage other people at home. The cost is also high if the patient frequently goes to a professional clinic or beauty salon for massage treatment or massage relaxation, and the patient cannot be consumed by every common family. The massage method generally adopted at present is to mark massage point maps on massage clothes, users can massage according to the positions of points on books and clothes, but the massage sequence, the massage method and the massage force still need to be mastered within a certain learning time, namely, the requirements of the users on the specialty and the experience are met, in addition, the massage clothes can not dynamically adapt to different body types, and different massage therapies can not be switched and selected in real time to massage, so that the existing massage method is lack of flexibility.

Mixed Reality (MR), which includes both augmented reality and augmented virtual, refers to a new visualization environment created by merging real and virtual worlds. Physical and digital objects coexist in the new visualization environment and interact in real time. The virtual reality technology is further developed, and by introducing real scene information into a virtual environment, an interactive feedback information loop is built among a virtual world, the real world and a user so as to enhance the sense of reality of user experience. At present, the mixed reality technology is not applied to the intelligent massage field, and great convenience can be brought if the mixed reality equipment can be applied to the intelligent massage field in the future.

disclosure of Invention

The technical problem to be solved by the present invention is to provide an intelligent massage method and device based on mixed reality equipment, which can enable ordinary people to perform accurate and effective massage for other people according to prompts, has no requirement of using a threshold, enables the massage to be more convenient and cheap, and can flexibly select different massage mode programs.

The technical scheme adopted by the invention for solving the technical problems is as follows: a method for constructing intelligent massage based on mixed reality equipment comprises the following steps:

the mixed reality equipment receives user attribute information of a user; the user attribute information includes a body type and a joint position of the user;

Matching a corresponding virtual human body three-dimensional model for the user according to the user attribute information;

Establishing a massage prompt point of a virtual image corresponding to the user by using the virtual human body three-dimensional model;

loading a preset massage mode program according to the massage prompt point; the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points;

And starting the massage mode program to carry out intelligent massage on the user according to the instruction of the massage prompt point.

In the method for intelligent massage based on mixed reality equipment, before the mixed reality equipment receives user attribute information of a user, the method further comprises:

And programming the massage therapy to obtain the massage mode program, and storing the massage mode program in the cloud or the mixed reality equipment.

In the method for intelligent massage based on mixed reality equipment, the massage prompt points include:

The massage prompting point is characterized in that a set shape is adopted as a prompting mark, different colors are adopted for the massage prompting point to represent different force, when the color displayed by the massage prompting point is a first color, the represented force is a high force, when the color displayed by the massage prompting point is a second color, the represented force is a medium force, and when the color displayed by the massage prompting point is a third color, the represented force is a soft force.

In the method for intelligent massage based on mixed reality equipment, the loading of the preset massage mode program according to the massage prompt point includes:

responding to the massage cue point;

and downloading the massage mode program through the cloud end or the local end of the mixed reality equipment.

In the method for intelligent massage based on mixed reality equipment, the massage mode program is started to carry out intelligent massage on the user according to the instruction of the massage prompt point, and the method further comprises the following steps:

Performing intelligent massage on the user according to the instruction of the current massage prompt point;

And continuing to perform intelligent massage on the user according to the instruction of the next massage prompt point until the mixed reality equipment sends a voice command to finish the intelligent massage on the user.

In the method for intelligent massage based on mixed reality equipment, the invention further comprises the following steps:

Receiving application evaluation information of the user on the massage mode program;

according to the application evaluation information, the massage mode programs are subjected to priority ranking;

And adaptively adjusting the massage mode program according to the sequencing result.

the invention also relates to an intelligent massage device based on the mixed reality equipment, which comprises:

a first receiving unit: the mixed reality device is used for receiving user attribute information of a user; the user attribute information includes a body type and a joint position of the user;

A matching unit: the virtual human body three-dimensional model matching module is used for matching a corresponding virtual human body three-dimensional model for the user according to the user attribute information;

the establishing unit: a massage prompt point used for establishing a virtual image corresponding to the user by utilizing the virtual human body three-dimensional model;

a loading unit: the massage device is used for loading a preset massage mode program according to the massage prompt point; the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points;

A starting unit: and the massage mode program is started to carry out intelligent massage on the user according to the instruction of the massage prompt point.

The intelligent massage device based on the mixed reality equipment further comprises:

A program unit: the massage mode program is obtained after the massage therapy is programmed and stored in the cloud or the mixed reality equipment.

In the device for intelligent massage based on mixed reality equipment of the present invention, the massage cue point comprises:

the massage prompting point is characterized in that a set shape is adopted as a prompting mark, different colors are adopted for the massage prompting point to represent different force, when the color displayed by the massage prompting point is a first color, the represented force is a high force, when the color displayed by the massage prompting point is a second color, the represented force is a medium force, and when the color displayed by the massage prompting point is a third color, the represented force is a soft force.

In the device for intelligent massage based on mixed reality equipment, the loading unit includes:

A response subunit: for responding to the massage cue point;

A downloading subunit: the massage mode program is downloaded through the cloud end or the local end of the mixed reality equipment.

in the device for intelligent massage based on mixed reality equipment, the starting unit includes:

Current instruction subunit: the intelligent massage system is used for intelligently massaging the user according to the instruction of the current massage prompt point;

A termination subunit: and the intelligent massage device is used for continuing to carry out intelligent massage on the user according to the instruction of the next massage prompt point until the mixed reality equipment sends a voice command to finish the intelligent massage on the user.

The intelligent massage device based on the mixed reality equipment further comprises:

A second receiving unit: the massage mode program is used for receiving application evaluation information of a user on the massage mode program;

A sorting unit: the massage mode programs are used for carrying out priority sequencing according to the application evaluation information;

An adjusting unit: and the massage mode program is used for adaptively adjusting the massage mode program according to the sequencing result.

The intelligent massage method and device based on the mixed reality equipment have the following beneficial effects: because a set of massage mode programs which are liked by the user or have higher scores can be selected after the user attribute information of the user is obtained through three-dimensional scanning of the mixed reality equipment, the massage prompt points are established on the body of the user by using the virtual images, and the prompts of virtual 3D massage manipulation, virtual massage strength and virtual massage time are matched, so that a set of relatively professional massage treatment course can be implemented according to the prompts by ordinary people (massagers) without training, different massage treatments can be selected according to different massage mode programs on the mixed reality equipment, the massage is very flexible, the massage can be carried out at home, the massage treatment or massage relaxation does not need to be carried out in a professional clinic or beauty salon any more, the convenience is improved, and the expenditure can be saved for the ordinary family The requirement of using a threshold is not required, the massage is more convenient and the cost is low, and different massage mode programs can be flexibly selected.

Drawings

in order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a flow chart of a method in an embodiment of the present invention for a mixed reality device based intelligent massage method and apparatus;

FIG. 2 is a schematic diagram of a virtual 3D massage manipulation portion during the massage process in the embodiment;

fig. 3 is a schematic display diagram of a portion matched with virtual massage force and virtual massage time in the massage process in the embodiment;

FIG. 4 is a specific flowchart of the embodiment of using a virtual three-dimensional human body model to establish massage cue points of a virtual image corresponding to a user;

Fig. 5 is a schematic structural diagram of the device in the embodiment.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the embodiment of the intelligent massage method and device based on mixed reality equipment, the flow chart of the intelligent massage method based on mixed reality equipment is shown in fig. 1. In fig. 1, the intelligent massage method based on mixed reality equipment comprises the following steps:

and step S001, programming the massage therapy to obtain a massage mode program, and storing the massage mode program in a cloud or mixed reality device.

specifically, in this step, a massage therapy is programmed, during the process of programming the massage therapy, a massage position, a massage manipulation, a massage force and massage time information corresponding to the massage position are configured, meanwhile, a corresponding description and an evaluation of the massage therapy by other people are added to the massage therapy, the information of the position to be massaged, the massage manipulation, the massage force and the massage time is configured, and after the description and the evaluation are added, a massage mode program is generated and stored in a cloud or mixed reality device in a configuration file manner. In this step, can carry out the procedure with a plurality of massage therapy according to above-mentioned method, will obtain a plurality of massage mode procedure like this, then upload these massage mode procedures to the cloud end and save, the user can download some massage mode procedures to mixed reality equipment from the cloud end according to actual demand, saves it in mixed reality equipment, when calling up massage mode procedure, just can show corresponding information.

Certainly, in practical application, if a user finds that a certain massage therapy made by the user is good in effect, the new massage therapy made by the user can be programmed according to the method and then uploaded to the cloud for sharing, so that other people can download the new massage therapy from the cloud for viewing, and can evaluate the new massage therapy after being used by other people and upload the evaluation to the cloud, so that more people can use the new massage therapy.

A mixed reality technology used by mixed reality equipment belongs to wearable equipment. In this embodiment, the mixed reality device is a mixed reality helmet, for example, the microsoft corporation HoloLens may be used. Of course, in practical application, other kinds of mixed reality devices can be selected according to actual requirements to meet the requirements of different users.

This step belongs to the preprocessing step, if in actual conditions, the cloud or mixed reality device has stored the corresponding massage mode program in advance, and then the step does not need to be executed, and the process directly enters step S01. If the cloud or the mixed reality device does not store the corresponding massage mode program, the step needs to be executed first.

Step S01, the mixed reality device receives user attribute information of a user;

Wherein the user attribute information includes a body type and a joint position of the user.

particularly, in this step, the massor adopts mixed reality equipment to lie flat or lie prone to carry out three-dimensional scanning to the user on the physiotherapy bed (being massor promptly), specifically adopts the 3D camera on the mixed reality equipment to lie flat or lie prone to carry out three-dimensional scanning to the user on the physiotherapy bed, can obtain scanning information after the scanning, and mixed reality equipment just can judge this user's user attribute information according to this scanning information.

the step is mainly to judge the attribute information of the user through the main 12 major joints of the user according to the positions of bones and joints matched with the human body structure. The 12 major joints include mandibular joint, cervical joint, thoracic joint, lumbar joint, shoulder joint, elbow joint, wrist joint, finger joint, hip joint, knee joint, ankle joint and toe joint. The bone size can be obtained as long as the joint position is known, and therefore the body type of the user can be judged.

Step S02 matches the corresponding virtual human body three-dimensional model for the user according to the user attribute information.

specifically, the virtual three-dimensional human body model stored in advance can be called out through the mixed reality device, and the called out virtual three-dimensional human body model is adjusted to be suitable for the user attribute information according to the user attribute information, so that the virtual three-dimensional human body model suitable for the user attribute information can be matched for the user.

Step S03 is to establish a massage cue point of a virtual image corresponding to the user using the virtual three-dimensional human body model.

Specifically, with the virtual human body three-dimensional model, a massage cue point is established with a virtual image on the body of the user using a mixed reality device, that is, a massage cue point of a virtual image corresponding to the user is established, the massage cue point being a virtual point. The establishment process of the massage cue points will be described in detail later.

Step S04, loading a preset massage mode program according to the massage prompt point;

Wherein, the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points.

Specifically, this can be achieved by: firstly responding to a massage prompt point; and then, downloading a massage mode program through a cloud end or a local end of the mixed reality equipment.

further, a massager or a user selects a set of massage mode programs which are liked by the user or have a higher score from the massage mode programs stored at the local end of the mixed reality device, or enters an AR program interface of the mixed reality device, the classification of the massage mode programs and the description of the massage mode programs (namely the introduction of the massage mode programs) can be checked from the list of the AR program, then the massage mode programs which are liked by the user or have a higher score are selected by clicking, the mixed reality device uploads the information selected by clicking to the cloud, the corresponding massage mode programs are called by the cloud, and the called massage mode programs are downloaded to the mixed reality device, so that the called massage mode programs can be used. Because the massagers or users can see the evaluation of other people on the massage mode programs and the introduction of the massage mode programs, the massagers or users can select the corresponding massage mode programs according to the actual conditions.

in addition, the intelligent massage method based on the mixed reality equipment can download a plurality of massage mode programs to the local end (namely the mixed reality equipment), can select the corresponding massage mode programs from the local end, and can also select the corresponding massage mode programs from the AR program list in the mixed reality equipment and then download the massage mode programs from the cloud end, so that the method is as simple as starting a headline and watching news, and is very simple and convenient. The operator does not need other equipment, and all interactions are finished in the point selection in the interface of the AR program of the mixed reality equipment, so that the operation is simple and convenient, and other equipment is saved, thereby reducing the use cost.

the mixed reality device is a massage prompt point matched with the prompts of a virtual 3D massage manipulation, a virtual massage force and a virtual massage time, please refer to a display schematic diagram of a part matched with the virtual 3D massage manipulation in the massage process in fig. 2, and a display schematic diagram of a part matched with the virtual massage force and the virtual massage time in the massage process in fig. 3, wherein the prompt of the virtual massage time is prompted in a countdown stopwatch mode. Therefore, the masseur can visually see the prompts of the virtual 3D massage manipulation, the virtual massage strength and the virtual massage time in the process of massaging the user, and can massage the user according to the gradual prompts of the virtual 3D massage manipulation, the virtual massage strength and the virtual massage time. The masseur can combine the massage prompt point, the virtual 3D virtual manipulation, the virtual massage strength and the virtual massage time to prompt step by step, and the physical therapy massage process can be started without any advance learning preparation, so the use is very simple and convenient.

it should be noted that, in the method for intelligent massage based on mixed reality device of the present invention, the massage cue points include: a set shape is used as the cue marker, and the set shape may be any shape, for example: circular, square, oval, polygonal, etc. In this embodiment, a circular shape is used. The massage suggestion point can have the differentiation of colour according to different dynamics, and is concrete, and the massage suggestion point adopts different colours to express different dynamics, and when the colour that the massage suggestion point shows was first colour, the dynamics of expression was big dynamics, and when the colour that the massage suggestion point shows was the second colour, the dynamics of expression was well dynamics, and when the colour that the massage suggestion point shows was the third colour, the dynamics of expression was gentle. Such as: when the first color is red, the second color is yellow, and the third color is green, the red represents a strong force, the yellow represents a medium force, and the green represents a soft force. Of course, in practical applications, the first color, the second color and the third color may be arbitrarily set, but it is ensured that the first color, the second color and the third color are different.

And step S05, according to the instruction of the massage prompt point, starting a massage mode program to carry out intelligent massage on the user.

specifically, this can be achieved by: firstly, the user is intelligently massaged according to the instruction of the current massage prompt point, and then the user is continuously intelligently massaged according to the instruction of the next massage prompt point until the mixed reality equipment sends out a voice command to finish the intelligent massage on the user.

Further, when the time of the countdown stopwatch becomes 0, it indicates that the massage mode program completes the intelligent massage for the user according to the instruction of the current massage prompt point, and after the massager completes the intelligent massage corresponding to the instruction of the current massage prompt point, the mixed reality device prompts the position of the next massage prompt point by using a voice command according to the next massage prompt point provided in the massage mode program, such as: the AR program of the mixed reality device directly says 'next step' by voice control, the massage mode program can automatically prompt the next massage prompt point, and at the moment, a massager can continue to carry out intelligent massage on the user according to the instruction of the next massage prompt point. Because the hands of the massagers are occupied (doing massage), after a massage prompt point is finished, the massagers do not need to stop to click to select the next step, so that the hands of the massagers can be liberated, the massagers can massage with great concentration, the 'next step' is selected without complicated clicking, and the massage efficiency is improved. And when the voice command of the mixed reality equipment is finished, finishing the intelligent massage on the user.

The intelligent massage method based on the mixed reality equipment programs the massage therapy, uploads the programmed massage mode program to the cloud, a user can download the favorite or higher-grade massage mode program on line, a massager combines step-by-step prompt of virtual 3D massage manipulation, virtual massage strength and virtual massage time, the physiotherapy massage process can be started without any advance learning preparation, and the use is very simple and convenient. The method can enable the massage to be carried out at home, so that the massage treatment or massage relaxation by going to a professional clinic or beauty parlor is not needed, the convenience is improved, and meanwhile, the expenditure can be saved for a common family.

in the method for intelligent massage based on mixed reality device of the present invention, if the massor or the user needs to evaluate the massage therapy used, the method for intelligent massage based on mixed reality device further comprises the following steps:

step S06 receives the application evaluation information of the massage mode program from the user.

Specifically, in this step, after the user has finished massaging the user, if the user or the massager feels that the effect is good and wants to evaluate the massage method program used, the massage method program may be evaluated in the AR program of the mixed reality device, the evaluation may be performed in a manner of scoring or in a manner of text description, and after the evaluation is finished, the AR program of the mixed reality device uploads the application evaluation information of the massage method program to the cloud for storage, so that when another user wants to download the massage method program, the application evaluation information of the massage method program can be viewed.

step S07 prioritizes the massage mode programs according to the application evaluation information.

Specifically, the massage system programs of the same function are prioritized in order of the scores from high to low or in order of the goodness of merit according to the application evaluation information of the user of the massager on the massage system programs.

and step S08, adaptively adjusting the massage mode program according to the sorting result.

Specifically, according to the ranking result of the same-function massage mode programs, the massage mode programs with the highest scores or the highest good scores are automatically matched or adaptively adjusted, so that the user can enjoy the massage mode programs with high evaluation.

For the present embodiment, the step S03 can be further refined, and the detailed flowchart is shown in fig. 4. In fig. 4, the step S03 further includes the following steps:

Step S31 calculates the bone size of the user after the joint position is determined.

Specifically, in this step, after the joint positions are determined, since the adjacent joints are bones, the size of the bones between the adjacent joints can be directly obtained by calculating the distance between the adjacent joints, and thus the size of the bones of the user can be calculated after the joint positions are determined.

step S32 calculates the position of the massage point according to the selected massage mode program, the relative position between the massage point and the bone, and the distance relationship between the massage point and the bone.

Specifically, in this step, the position of the massage point can be calculated according to the selected massage mode program, the relative position between the massage point and the bone, and the distance relationship between the massage point and the bone. In other words, when the position of the joint is known, the corresponding massage point position can be generated according to the distance relationship between the massage point position and the joint, for example, the center of the left and right shoulder axes is 10cm lower.

Step S33, according to the size and position of the skeleton, the mixed reality device calls a layer of transparent human body three-dimensional model and covers the transparent human body three-dimensional model on the surface of the human body of the user.

Specifically, in this step, the mixed reality device calls a layer of transparent virtual three-dimensional human body model stored in advance according to the size and position of the skeleton, and the virtual three-dimensional human body model is sleeved on the surface of the human body of the user. The virtual human body three-dimensional model is manufactured in advance and led into the mixed reality equipment, when the virtual human body three-dimensional model is manufactured, the virtual human body three-dimensional model can be built by adopting the existing three-dimensional modeling software, and after the virtual human body three-dimensional model is built, the virtual human body three-dimensional model is led into the mixed reality equipment to be stored. The method for establishing the virtual human body three-dimensional model adopts the method in the prior art.

And step S34, stretching the three-dimensional model of the human body correspondingly according to the height proportion of the user.

Specifically, in this step, the called three-dimensional human body model is correspondingly stretched according to the height ratio of the user, for example: to the tensile of height, width and thickness, when tensile, according to the actual conditions of user's the height proportion, can only stretch to height, can only stretch to width, can only stretch to thickness, can stretch to height and width simultaneously, can stretch to height and thickness simultaneously, can stretch to width and thickness simultaneously, can also stretch to height, width and thickness simultaneously, until tensile to make three-dimensional model of human accord with user's height proportion.

And step S35, establishing visual massage prompt points on the human body surface of the user according to the distance between the massage point positions and the joints.

Specifically, in this step, visual massage prompt points are established on the surface of the human body of the user according to the distance between the massage point locations and the joints, and different massage prompt points respectively correspond to different massage point locations of the human body of the user. By performing the above steps S31 to S35, the establishment of the massage cue points using the virtual image can be realized.

The embodiment also relates to an intelligent massage device based on mixed reality equipment, the structural schematic diagram of the device is shown in fig. 5, and in fig. 5, the device comprises a program unit 1, a first receiving unit 2, a matching unit 3, a building unit 4, a loading unit 5 and a starting unit 6.

the program unit 1 is used for obtaining a massage mode program after programming the massage therapy, and storing the massage mode program in a cloud or mixed reality device. Specifically, the massage therapy is programmed, in the process of programming the massage therapy, a massage position, a massage manipulation, a massage strength and massage time information corresponding to the massage position are configured, meanwhile, corresponding descriptions and evaluations of other people on the massage therapy are added to the massage therapy, the massage position, the massage manipulation, the massage strength and the massage time information are configured, and after the descriptions and the evaluations are added, a massage mode program is generated and stored in a cloud or mixed reality device in a configuration file mode. The massage therapy can be programmed according to the method, a plurality of massage mode programs can be obtained, the massage mode programs are uploaded to the cloud for storage, a user can download some massage mode programs from the cloud to the mixed reality equipment according to actual requirements, the massage mode programs are stored in the mixed reality equipment, and corresponding information can be displayed when the massage mode programs are called.

certainly, in practical application, if a user finds that a certain massage therapy made by the user is good in effect, the new massage therapy made by the user can be programmed according to the method and then uploaded to the cloud for sharing, so that other people can download the new massage therapy from the cloud for viewing, and can evaluate the new massage therapy after being used by other people and upload the evaluation to the cloud, so that more people can use the new massage therapy.

a mixed reality technology used by mixed reality equipment belongs to wearable equipment. In this embodiment, the mixed reality device is a mixed reality helmet, for example, the microsoft corporation HoloLens may be used. Of course, in practical application, other kinds of mixed reality devices can be selected according to actual requirements to meet the requirements of different users.

If in actual conditions, the cloud or the mixed reality device stores the corresponding massage mode program in advance, the program unit 1 is not needed. The program unit 1 is needed if the cloud or mixed reality device does not store a corresponding massage mode program.

the first receiving unit 2 is used for enabling the mixed reality equipment to receive user attribute information of a user; the user attribute information includes a body shape and joint positions of the user. Particularly, the massor adopts mixed reality equipment to lie flat or lie prone to carry out three-dimensional scanning to the user on the physiotherapy bed (being massor promptly), adopts the 3D camera on the mixed reality equipment to lie flat or lie prone to carry out three-dimensional scanning to the user on the physiotherapy bed, can obtain scanning information after the scanning, and mixed reality equipment just can judge this user's user attribute information according to this scanning information.

the first receiving unit 2 mainly determines the user attribute information through the main 12 major joints of the user according to the human body structure matching skeleton and joint positions. The 12 major joints include mandibular joint, cervical joint, thoracic joint, lumbar joint, shoulder joint, elbow joint, wrist joint, finger joint, hip joint, knee joint, ankle joint and toe joint. The bone size can be obtained as long as the joint position is known, and therefore the body type of the user can be judged.

And the matching unit 3 is used for matching the corresponding virtual human body three-dimensional model for the user according to the user attribute information. Specifically, the virtual three-dimensional human body model stored in advance can be called out through the mixed reality device, and the called out virtual three-dimensional human body model is adjusted to be suitable for the user attribute information according to the user attribute information, so that the virtual three-dimensional human body model suitable for the user attribute information can be matched for the user.

and the establishing unit 4 is used for establishing a massage prompt point of a virtual image corresponding to the user by using the virtual human body three-dimensional model. Specifically, with the virtual human body three-dimensional model, a massage cue point is established with a virtual image on the body of the user using a mixed reality device, that is, a massage cue point of a virtual image corresponding to the user is established, the massage cue point being a virtual point. The setup unit 4 comprises a first calculation subunit 41, a second calculation subunit 42, a recall subunit 43, a stretch subunit 44 and a setup subunit 45.

The first calculating subunit 41 is configured to calculate the bone size of the user after the joint position is determined. Specifically, after the joint positions are determined, since the adjacent joints are bones, the size of the bones between the adjacent joints can be directly obtained by calculating the distance between the adjacent joints, and therefore, the size of the bones of the user can be calculated after the joint positions are determined.

and the second calculating subunit 42 is configured to calculate the position of the massage point according to the selected massage mode program, the relative position between the massage point and the bone, and the distance relationship between the massage point and the bone. Specifically, the position of the massage point can be calculated according to the selected massage mode program, the relative position between the massage point and the bone, and the distance relationship between the massage point and the bone. In other words, when the position of the joint is known, the corresponding massage point position can be generated according to the distance relationship between the massage point position and the joint, for example, the center of the left and right shoulder axes is 10cm lower.

And the calling subunit 43 is used for calling out a layer of transparent human body three-dimensional model by the mixed reality equipment according to the size and the position of the skeleton, and sleeving the transparent human body three-dimensional model on the surface of the human body of the user. Specifically, according to the size and the position of the skeleton, the mixed reality device calls a layer of transparent virtual human body three-dimensional model stored in advance and sleeves the virtual human body three-dimensional model on the surface of the human body of the user. The virtual human body three-dimensional model is manufactured in advance and led into the mixed reality equipment, when the virtual human body three-dimensional model is manufactured, the virtual human body three-dimensional model can be built by adopting the existing three-dimensional modeling software, and after the virtual human body three-dimensional model is built, the virtual human body three-dimensional model is led into the mixed reality equipment to be stored. The method for establishing the virtual human body three-dimensional model adopts the method in the prior art.

and the adjusting subunit 44 is used for correspondingly stretching the three-dimensional model of the human body according to the height proportion of the user. Specifically, according to the height ratio of the user, the called three-dimensional human body model is correspondingly stretched, such as: to the tensile of height, width and thickness, when tensile, according to the actual conditions of user's the height proportion, can only stretch to height, can only stretch to width, can only stretch to thickness, can stretch to height and width simultaneously, can stretch to height and thickness simultaneously, can stretch to width and thickness simultaneously, can also stretch to height, width and thickness simultaneously, until tensile to make three-dimensional model of human accord with user's height proportion.

and the establishing subunit 45 is used for establishing a visual massage prompt point on the human body surface of the user according to the distance between the massage point position and the joint. Specifically, visual massage prompt points are established on the surface of the human body of the user according to the distance between the massage point positions and the joints, and different massage prompt points respectively correspond to different massage point positions of the human body of the user. By implementing the first calculation subunit 41, the second calculation subunit 42, the retrieving subunit 43, the stretching subunit 44, and the establishing subunit 45, the establishment of the massage cue points with the virtual image can be achieved.

The loading unit 5 is used for loading a preset massage mode program according to the massage prompt point; wherein, the massage mode program is matched with a virtual 3D massage manipulation and a virtual massage strength according to the massage prompt points. Specifically, the loading unit 5 includes a response subunit 51 and a download subunit 52, the response subunit, 51 is used for responding to the massage cue point; the download subunit 52 is configured to download the massage mode program through the cloud or the local end of the mixed reality device.

further, a massager or a user selects a set of massage mode programs which are liked by the user or have a higher score from the massage mode programs stored at the local end of the mixed reality device, or enters an AR program interface of the mixed reality device, the classification of the massage mode programs and the description of the massage mode programs (namely the introduction of the massage mode programs) can be checked from the list of the AR program, then the massage mode programs which are liked by the user or have a higher score are selected by clicking, the mixed reality device uploads the information selected by clicking to the cloud, the corresponding massage mode programs are called by the cloud, and the called massage mode programs are downloaded to the mixed reality device, so that the called massage mode programs can be used. Because the massagers or users can see the evaluation of other people on the massage mode programs and the introduction of the massage mode programs, the massagers or users can select the corresponding massage mode programs according to the actual conditions.

In addition, the device can download a plurality of massage mode programs to a local end (namely mixed reality equipment), can select corresponding massage mode programs from the local end, and can also select corresponding massage mode programs from a list of AR programs in the mixed reality equipment and then download the corresponding massage mode programs from the cloud end, so that the device is simple as just starting a headline to watch news, and is very simple and convenient. The operator does not need other equipment, and all interactions are finished in the point selection in the interface of the AR program of the mixed reality equipment, so that the operation is simple and convenient, and other equipment is saved, thereby reducing the use cost.

the mixed reality equipment is matched with the prompt of virtual 3D massage manipulation, virtual massage strength and virtual massage time for a massage prompt point, wherein the prompt of the virtual massage time is prompted in the form of a countdown stopwatch. Therefore, the masseur can visually see the prompts of the virtual 3D massage manipulation, the virtual massage strength and the virtual massage time in the process of massaging the user, and can massage the user according to the gradual prompts of the virtual 3D massage manipulation, the virtual massage strength and the virtual massage time. The masseur can combine the massage prompt point, the virtual 3D virtual manipulation, the virtual massage strength and the virtual massage time to prompt step by step, and the physical therapy massage process can be started without any advance learning preparation, so the use is very simple and convenient.

In the apparatus of the present invention, the massage point includes: a set shape is used as the cue marker, and the set shape may be any shape, for example: circular, square, oval, polygonal, etc. In this embodiment, a circular shape is used. The massage suggestion point can have the differentiation of colour according to different dynamics, and is concrete, and the massage suggestion point adopts different colours to express different dynamics, and when the colour that the massage suggestion point shows was first colour, the dynamics of expression was big dynamics, and when the colour that the massage suggestion point shows was the second colour, the dynamics of expression was well dynamics, and when the colour that the massage suggestion point shows was the third colour, the dynamics of expression was gentle. Such as: when the first color is red, the second color is yellow, and the third color is green, the red represents a strong force, the yellow represents a medium force, and the green represents a soft force. Of course, in practical applications, the first color, the second color and the third color may be arbitrarily set, but it is ensured that the first color, the second color and the third color are different.

and the starting unit 6 is used for starting a massage mode program to carry out intelligent massage on the user according to the instruction of the massage prompt point. Specifically, the starting unit 6 includes a current instruction subunit 61 and an ending subunit 62; the current instruction subunit 61 is configured to perform intelligent massage on the user according to the instruction of the current massage prompt point; the ending subunit 62 is configured to continue to perform intelligent massage on the user according to the instruction of the next massage prompt point until the mixed reality device issues a voice command to end the intelligent massage on the user.

further, when the time of the countdown stopwatch becomes 0, it indicates that the massage mode program completes the intelligent massage for the user according to the instruction of the current massage prompt point, and after the massager completes the intelligent massage corresponding to the instruction of the current massage prompt point, the mixed reality device prompts the position of the next massage prompt point by using a voice command according to the next massage prompt point provided in the massage mode program, such as: the AR program of the mixed reality device directly says 'next step' by voice control, the massage mode program can automatically prompt the next massage prompt point, and at the moment, a massager can continue to carry out intelligent massage on the user according to the instruction of the next massage prompt point. Because the hands of the massagers are occupied (doing massage), after a massage prompt point is finished, the massagers do not need to stop to click to select the next step, so that the hands of the massagers can be liberated, the massagers can massage with great concentration, the 'next step' is selected without complicated clicking, and the massage efficiency is improved. And when the voice command of the mixed reality equipment is finished, finishing the intelligent massage on the user.

The intelligent massage method based on the mixed reality equipment programs the massage therapy, uploads the programmed massage mode program to the cloud, a user can download the favorite or higher-grade massage mode program on line, a massager combines step-by-step prompt of virtual 3D massage manipulation, virtual massage strength and virtual massage time, the physiotherapy massage process can be started without any advance learning preparation, and the use is very simple and convenient. The mode can lead the massage to be carried out at home, does not need to go to a professional clinic or beauty parlor for massage treatment or massage relaxation, increases the convenience and saves the expenditure for the common family, therefore, the device of the invention can lead the common people to carry out accurate and effective massage for other people according to the prompt, has no requirement of using a threshold, leads the massage to be more convenient and lower in cost and can flexibly select different massage mode programs.

In the device of the present invention, if the massor or user needs to evaluate the massage therapy used, the device further comprises a second receiving unit 7, a sorting unit 8 and an adjusting unit 9.

The second receiving unit 7 is used for receiving the application evaluation information of the massage mode program from the user. Specifically, after the massage of the user is finished, if the massage is better or the user feels that the effect is better, the user wants to evaluate the used massage mode program, the massage mode program can be evaluated in the AR program of the mixed reality device, the evaluation mode can be scoring or can be evaluation in a text description mode, and after the evaluation is finished, the AR program of the mixed reality device uploads the application evaluation information of the massage mode program to the cloud for storage, so that when other users want to download the massage mode program, the application evaluation information of the massage mode program can be checked.

And the sequencing unit 8 is used for carrying out priority sequencing on the massage mode programs according to the application evaluation information. Specifically, the massage system programs of the same function are prioritized in order of the scores from high to low or in order of the goodness of merit according to the application evaluation information of the user of the massager on the massage system programs.

and the adjusting unit 9 is used for adaptively adjusting the massage mode program according to the sequencing result. Specifically, according to the ranking result of the same-function massage mode programs, the massage mode programs with the highest scores or the highest good scores are automatically matched or adaptively adjusted, so that the user can enjoy the massage mode programs with high evaluation.

In a word, the invention utilizes the mixed reality technology, utilizes the virtual human body three-dimensional model to establish the massage prompt points of the virtual image corresponding to the user, applies the massage prompt points to massage, carries out programming on the massage therapy to obtain a massage mode program, uploads the massage mode program to the cloud, the user can select the massage mode program which likes or has higher score, and downloads the massage mode program into the mixed reality equipment, the user can select different massage mode programs to carry out massage, in the massage process, the massage prompt points are matched with the prompts of virtual 3D massage manipulation, virtual massage force and virtual massage time, a massager can start the physiotherapy massage process by combining the step prompt of the virtual 3D massage manipulation, the virtual massage force and the virtual massage time without any advance learning preparation, the use is very simple and convenient, and the use threshold is reduced. The massage mode program can be used as an online service to be downloaded by a user, the user can evaluate the massage mode program and can also make a new massage therapy by himself, and after the new massage therapy is programmed, the obtained new massage mode program is uploaded to the cloud to achieve sharing. The invention can enable common people to carry out accurate and effective massage for other people according to the prompt, has no requirement of using a threshold, leads the massage to be more convenient and have low cost, and can flexibly select different massage mode programs.

In practical application, under the condition that the cost and the usability are not required, a user can be shot by using a camera, and dynamic massage point prompting is realized by technical means such as image recognition, projection and the like, but the cost is high, the usability is poor, and the popularization is not easy. Compared with the traditional Chinese medicine massage pillow, the traditional Chinese medicine massage pillow has the advantages that the advantages are obvious, ordinary people can accurately and effectively massage other people according to prompts by using a simple method, the cost is low, the usability is good, and the popularization is easy.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.