阅读说明：本技术 一种基于音乐节奏的舞蹈动作实时生成系统 (Dance action real-time generation system based on music rhythm ) 是由 何甲麒 樊一帆 石佳银 付宁 于 2021-08-26 设计创作，主要内容包括：本发明提供一种基于音乐节奏的舞蹈动作实时生成系统,涉及运动仿真和游戏动画技术领域。该基于音乐节奏的舞蹈动作实时生成系统,包括处理模块、存储模块、输出模块、输入模块,所述输入模块包括3D舞蹈采集模块和音频采集模块,所述处理模块包括音频识别模块、音频分析模块、3D舞蹈分析模块、3D舞蹈组合模块、AI人物更换模块、3D舞蹈对比模块、评分模块。通过利用3D舞蹈分析模块分析对比音频和舞蹈动作的特征,3D舞蹈组合模块通过3D舞蹈对比模块选取3D动作库内的3D动作进行组合,利用全息投影技术实时输出3D舞蹈动作,实现生成的舞蹈动作具有真实人物画面感,提高了视觉效果,便于用户提高舞蹈能力。(The invention provides a dance action real-time generation system based on music rhythm, and relates to the technical field of motion simulation and game animation. This dance action real-time generation system based on music rhythm, including processing module, storage module, output module, input module includes 3D dance acquisition module and audio acquisition module, processing module includes audio identification module, audio analysis module, 3D dance combination module, AI personage change module, 3D dance contrast module, grade module. Through utilizing 3D dance analysis module analysis contrast audio frequency and dance action's characteristic, 3D dance combination module selects the 3D action in the 3D action storehouse through 3D dance contrast module and makes up, utilizes holographic projection technique real-time output 3D dance action, realizes that the dance action of generation has real personage's picture and feels, has improved visual effect, and the user of being convenient for improves the dance ability.)

1. The utility model provides a dance action real-time generation system based on music rhythm, includes processing module, storage module, output module, input module, its characterized in that: the input module comprises a 3D dance acquisition module and an audio acquisition module, the processing module comprises an audio recognition module, an audio analysis module, a 3D dance combination module, an AI figure replacement module, a 3D dance comparison module and a grading module, the storage module comprises a 3D portrait library and a 3D action library, and the output module comprises a 3D output module and a 2D output module;

the 3D action library comprises a high-difficulty action library, a simple action library and a general action library.

2. A dance motion real-time generation system based on music tempo according to claim 1, wherein: audio acquisition module connects audio frequency identification module, audio frequency identification module connects audio analysis module, 3D dance analysis module is connected to audio analysis module, 3D dance combination module is connected to 3D dance analysis module, 3D dance contrast module and 3D dance combination module interconnect, 3D dance combination module is connected with AI personage and changes the module, AI personage changes the module and connects 3D output module.

3. A dance motion real-time generation system based on music tempo according to claim 2, wherein: the dance music recognition system comprises an audio recognition module, a 3D dance combination module, a 3D dance output module and a 3D dance analysis module, wherein the audio recognition module is used for recognizing the style and the beat of audio, the audio analysis module and the 3D dance analysis module are used for analyzing and comparing the characteristics of dance motions of the audio and the 3D dance motion library, the 3D dance combination module is used for combining the 3D motion library to form a complete dance motion, the 3D dance comparison module is used for selecting motions for the 3D dance combination module, and the 3D output module is used for holographic projection of the complete dance motion.

4. A dance motion real-time generation system based on music tempo according to claim 2, wherein: the 3D portrait library is connected with the AI personage replacing module through the 3D dance comparison module and the 3D dance combination module, and the AI personage replacing module is used for replacing different personages.

5. A dance motion real-time generation system based on music tempo according to any one of claims 1 to 4, wherein: the 3D dance acquisition module comprises a 3D camera and 3D modeling software, the 3D camera is used for scanning and acquiring 3D action image information of professional dancers, the 3D camera is also used for acquiring 3D action videos of users in real time, the 3D modeling software is used for establishing the 3D action image information of dance actions, and the 3D action image information is used for establishing a 3D action library.

6. A dance motion real-time generation system based on music tempo according to claim 1, wherein: the 3D dance acquisition module is connected with the 3D dance comparison module, the 3D dance comparison module is connected with the scoring module, and the scoring module is connected with the 2D output module.

7. A dance motion real-time generation system based on music rhythm according to claim 6, wherein: the scoring module is used for scoring the result of the 3D dance comparison module and outputting the result through the 2D output module, the 3D dance comparison module is used for comparing the information acquired by the 3D dance acquisition module with the 3D action library, and the 2D output module is used for outputting the scoring result and the comparison result.

8. A dance motion real-time generation system based on music tempo according to any one of claims 1 to 7, wherein: the 3D dance comparison module is connected with the 3D action library.

Technical Field

The invention relates to the technical field of motion simulation and game animation, in particular to a dance motion real-time generation system based on music rhythm.

Background

The 3D holographic projection is a 3D technology which can make audiences see a three-dimensional virtual character without wearing glasses, the holographic stereoscopic projection equipment is not realized by using a digital technology, but the projection equipment projects images with different angles onto an imported MP holographic projection film, so that the people cannot see other images which do not belong to the own angle, thereby realizing the real holographic stereoscopic image.

Dance and music are often closely related, the complexity of dance and music, and their synchronicity make them well suited to learning from a computational creativity perspective, although some techniques have been focused on generating dance for a given music, the generated 2D video is not vivid enough, the user cannot intuitively watch the learning, and the user experience is reduced; the problem that the effect of the user following dance exercise cannot be monitored exists, so that improvement cannot be well provided for the user, and the dance ability cannot be improved by the user.

Disclosure of Invention

Technical problem to be solved

Aiming at the defects of the prior art, the invention provides a dance action real-time generation system based on music rhythm, and solves the problems of poor visual effect and incapability of improving dance ability.

(II) technical scheme

In order to achieve the purpose, the invention is realized by the following technical scheme: a dance action real-time generation system based on music rhythm comprises a processing module, a storage module, an output module and an input module, wherein the input module comprises a 3D dance acquisition module and an audio acquisition module, the processing module comprises an audio identification module, an audio analysis module, a 3D dance combination module, an AI character replacement module, a 3D dance comparison module and a grading module, the storage module comprises a 3D portrait library and a 3D action library, and the output module comprises a 3D output module and a 2D output module;

the 3D action library comprises a high-difficulty action library, a simple action library and a general action library.

Preferably, the audio acquisition module is connected with the audio recognition module, the audio recognition module is connected with the audio analysis module, the audio analysis module is connected with the 3D dance analysis module, the 3D dance combination module is connected with the 3D dance analysis module, the 3D dance comparison module is connected with the 3D dance combination module, the 3D dance combination module is connected with the AI personage replacement module, and the AI personage replacement module is connected with the 3D output module.

Preferably, the audio frequency identification module is used for identifying the style and the beat of audio frequency, audio frequency analysis module and 3D dance analysis module are used for analyzing and comparing the characteristics of the dance action of audio frequency and 3D action storehouse, 3D dance combination module is used for combining the 3D action storehouse to form complete dance action, 3D dance comparison module is used for selecting the action for 3D dance combination module, and 3D output module is used for the holographic projection of complete dance action.

Preferably, the 3D portrait library is connected with the AI persona replacement module through the 3D dance comparison module and the 3D dance combination module, and the AI persona replacement module is used for replacing different personas.

Preferably, the 3D dance acquisition module comprises a 3D camera and 3D modeling software, the 3D camera is used for scanning and acquiring 3D action image information of professional dancers, the 3D camera is further used for acquiring 3D action videos of users in real time, the 3D modeling software is used for establishing the 3D action image information of dance actions, and the 3D action image information is used for establishing a 3D action library.

Preferably, the 3D dance acquisition module is connected with the 3D dance comparison module, the 3D dance comparison module is connected with the scoring module, and the scoring module is connected with the 2D output module.

Preferably, the scoring module is used for scoring the result of the 3D dance comparison module and outputting the result through the 2D output module, the 3D dance comparison module is used for comparing the information acquired by the 3D dance acquisition module with the 3D action library, and the 2D output module is used for outputting the scoring result and the comparison result.

Preferably, the 3D dance comparison module is connected with the 3D action library.

The working principle is as follows: the music dance system comprises an audio acquisition module, an audio identification module, an audio analysis module, a 3D dance combination module, a 3D dance comparison module, an AI character replacement module, a 3D dance output module, a 3D dance analysis module, a 3D dance combination module, a 3D dance selection module, a 3D action library and a holographic projection module, wherein the audio acquisition module is connected with the audio identification module, the audio identification module is connected with the audio analysis module, the beat and the style of music can be acquired and analyzed through the audio acquisition module, the audio analysis module is connected with the 3D dance analysis module, the 3D dance combination module is connected with the 3D dance combination module, the 3D dance combination module selects 3D actions in the 3D action library through the 3D dance comparison module to combine, a set of 3D dance actions according with the music beat and the style are formed, and the 3D dance actions are output in real time through the holographic projection technology, connect AI personage change module and 3D portrait storehouse through 3D dance contrast module and 3D dance combination module, can change the 3D personage of output, satisfy the different role hobby of user, connect 3D dance contrast module through 3D dance collection module, 3D dance contrast module connects the module of grading, the module of grading is connected to the module of grading, can be when the user imitates dance action through 3D dance collection module, gather the action video in real time, contrastive analysis through 3D dance contrast module, with the difference of action and similarity score through 2D output module to user feedback, the user of being convenient for improves the dance ability, it participates in the desire to increase the user.

(III) advantageous effects

The invention provides a dance action real-time generation system based on music rhythm. The method has the following beneficial effects:

1. according to the invention, the characteristics of audio and dance actions are analyzed and compared by using the 3D dance analysis module, the 3D dance combination module selects and combines the 3D actions in the 3D action library through the 3D dance comparison module to form a set of 3D dance actions according with music beats and styles, the 3D dance actions are output in real time by using the holographic projection technology, the AI character changing module and the 3D portrait library are connected through the 3D dance comparison module and the 3D dance combination module, the output 3D character can be changed, different character preferences of a user are met, the generated dance actions have real character picture feeling, vivid image, visual effect is improved, experience feeling and participation feeling of the user are improved, and real-time music dancing can be provided for the user.

2. The invention connects the 3D dance comparison module through the 3D dance collection module, the 3D dance comparison module is connected with the 3D action library, the 3D dance comparison module is connected with the grading module, the grading module is connected with the 2D output module, the action video can be collected in real time when the user imitates dance actions through the 3D dance collection module, the different points and similarity scores of the actions are fed back to the user through the 2D output module through the contrast analysis of the 3D dance comparison module, so that the user can learn dance actions in real time along with music, on the other hand, the user can know the accuracy of the actions in real time, the system selects the actions with corresponding difficulty according to the accuracy of the actions, if the accuracy is high, the high-difficulty action library is selected, if the accuracy is low, the actions of the simple action library are selected, and the difficulty of the generated dance actions can be increased step by step, the dance device is convenient for the user to improve the dance ability and increase the participation desire of the user.

Drawings

FIG. 1 is a detailed system block diagram of the present invention;

FIG. 2 is a block diagram of the system of the present invention;

FIG. 3 is a system block diagram of a processing module of the present invention;

FIG. 4 is a system block diagram of an input module of the present invention;

FIG. 5 is a system block diagram of a memory module of the present invention;

FIG. 6 is a system block diagram of an output module of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Example (b):

as shown in FIGS. 1-6, an embodiment of the invention provides a dance action real-time generation system based on music rhythm, which comprises a processing module, a storage module, an output module and an input module, wherein the input module comprises a 3D dance acquisition module and an audio acquisition module, 3D dance actions can be input into a 3D action library through the input module, music signals can be input into the system, the processing module comprises an audio recognition module, an audio analysis module, a 3D dance combination module, an AI character replacement module, a 3D dance comparison module and a grading module, the input dance actions and music signals can be analyzed and processed through the processing module, so that the 3D dance actions can be generated in real time along with music, the storage module comprises a 3D portrait library and a 3D action library, and the 3D action library comprises a high-difficulty action library, A simple action library and a general action library, the storage module can store instruction sets and data for the processing module, the output module comprises a 3D output module and a 2D output module, the 3D dance comparison module is connected with the 3D action library, the 3D dance comparison module has the function of selecting the 3D action library, the 3D picture of dance movement and the 2D picture of analysis and scoring result can be output simultaneously through the output module, by the system, a user can learn dance movements in real time along with music, and the user can know the accuracy of the movements in real time, the system selects the movements with corresponding difficulty according to the accuracy of the movements, if the accuracy is high, the high difficulty action library is selected more, if the accuracy is lower, the action of the simple action library is selected more, the difficulty of the generated dance actions can be gradually increased, and the difficulty of the dance simulation of the user can be gradually increased.

The music dance combination module selects and combines 3D actions in a 3D action library through the 3D dance comparison module to form a set of 3D dance actions according with music beats and styles, and outputs the 3D dance actions in real time by utilizing a holographic projection technology, connect AI personage change module and 3D portrait storehouse through 3D dance contrast module and 3D dance composite module, can change the 3D personage of output, satisfy the different role hobby of user, realize the vivid purpose of dance action that generates, improved user's experience sense, participate in the sense, the characteristics of dance action are clearly judged to the user of being convenient for, improve visual effect, can provide real-time music for the user and compile and dance, be worth wideling popularize.

The audio frequency identification module is used for identifying the style and the beat of audio frequency, the audio frequency analysis module and the 3D dance analysis module are used for analyzing and comparing the characteristics of dance movements of the audio frequency and the 3D movement library, the 3D dance combination module is used for combining the 3D movement library to form a complete dance movement, the 3D dance comparison module is used for selecting the movement for the 3D dance combination module, and the 3D output module is used for holographic projection of the complete dance movement.

The AI persona is changed the module through 3D dance contrast module and 3D dance combination module connection in the 3D persona storehouse, the AI persona is changed the module and is used for changing different personas, input module includes user operation module, convenience of customers operates the system, abundant persona information in through the 3D persona storehouse, can make the user conveniently select different personas, after the user selects the persona, make up role model and dance action through 3D dance contrast module and 3D dance combination module, form real vivid 3D dance action, and visual effect is improved, be convenient for improve user experience and feel.

The 3D dance acquisition module comprises a 3D camera and 3D modeling software, the 3D camera is used for scanning and acquiring 3D action image information of professional dancers, the 3D camera is further used for acquiring 3D action videos of users in real time, the 3D modeling software is used for establishing the 3D action image information of dance actions, the 3D action image information is used for constructing a 3D action library, dance action information can be continuously acquired through the 3D camera, and the 3D action library is continuously updated.

3D dance collection module connects 3D dance contrast module, and 3D dance contrast module connects the module of grading, and the module of grading is connected 2D output module, can gather the action video in real time when the user imitates the dance action through 3D dance collection module, through the contrastive analysis of 3D dance contrast module, with the difference and the similarity score of action through 2D output module to user feedback, the user of being convenient for improves the dance ability, increases user participation desire.

The module of grading is used for grading the result of 3D dance contrast module and exports through 2D output module, 3D dance contrast module is used for comparing the information and the 3D action storehouse of 3D dance collection module collection, 2D output module is used for exporting result of grading and contrast result, can compare the information and the 3D action storehouse of 3D dance collection module collection through 3D dance contrast module, 2D output module can export result of grading and contrast result, be convenient for the user to improve the dance action that improves self.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.