阅读说明：本技术 一种vr技术的音乐教学平台 (Music teaching platform of VR technique ) 是由 颜彬 于 2019-10-28 设计创作，主要内容包括：本发明的目的是提供一种VR技术的音乐教学平台,其特征在于：由电子乐器、3D扫描设备、动作捕捉设备、光学捕捉设备、VR平台、场景与乐器定制模块、竞技模块、DLC扩充模块、资源整合接入模块和数据库模块组成；整个平台系统基于VR技术,思路清晰、覆盖面广,以电子乐器为输入设备,能够将教学功能通过演示、指导、跟踪的形式呈现出来,以及结合互联网或者局域网配合演奏、练习、升级线上拟真乐器,去实现竞技以及多项体感功能,完善了硬件设施,为乐器产品提供线上预览和提供技术解决方案,为实体与虚拟乐器个性化定制带来新的可行性变化,让体验更加自由灵活,娱乐性更强、体验以及在线数据查看更全面,让使用者能够提升演奏技能和水平。(The invention aims to provide a music teaching platform based on VR technology, which is characterized in that: the system comprises an electronic musical instrument, a 3D scanning device, a motion capture device, an optical capture device, a VR platform, a scene and musical instrument customization module, a competition module, a DLC expansion module, a resource integration access module and a database module; the whole platform system is based on VR technology, the thought is clear, the coverage is wide, use electronic musical instrument as input device, can show the teaching function through demonstration, guide, the form of tracking, and combine internet or LAN cooperation to play, practice, upgrade online simulation musical instrument, go to realize the competition and the function is felt to multinomial body, the hardware facilities have been perfected, on-line preview and provide technical solution for the musical instrument product, bring new feasibility change for entity and virtual instrument personalized customization, let experience more freely nimble, recreational stronger, experience and online data look over more comprehensively, let the user can promote performance skill and level.)

1. The utility model provides a music teaching platform of VR technique which characterized in that: comprises an electronic musical instrument, a 3D scanning device, a motion capture device, an optical capture device, a VR platform, a scene and musical instrument customization module, a competition module, a DLC expansion module, a resource integration access module and a database module, the 3D scanning device, the motion capture device and the optical capture device are all connected with the electronic musical instrument by lines, the VR platform is positioned at the next stage of the electronic musical instrument, the VR platform is also provided with a demonstration module, a tracking exercise module, an independent exercise module, an open course recording module and a professional course module, the VR platform is connected with the Internet or a local area network by a line, the database module is positioned at the next stage of the VR platform, the database module is connected with the VR platform through a line, and the scene, the musical instrument customization module, the competition module, the DLC expansion module and the resource integration access module are all located at the next level of the database module.

2. The music teaching platform of VR technology of claim 1, wherein: the 3D scanning device, the motion capture device and the optical capture device are all freely-adjustable simulator terminals with inherent color, metal property, roughness, highlight, concave-convex property, transparency, reflection and refraction properties, and the 3D scanning device, the motion capture device and the optical capture device are all provided with independent levels of waveforms containing sound, concurrence of the sound, phase, set point of a main sound and width of an overtone.

3. The music teaching platform of VR technology of claim 1, wherein: the working method of the demonstration module can simply and clearly guide the user how to do and what to do, and guide the user what the user should learn and master through the motion demonstration of the electronic musical instrument and the demonstration of a virtual teacher in a game.

4. The music teaching platform of VR technology of claim 1, wherein: the working method of the tracking exercise module is synchronous operation with the simulation exercise, and the tracking exercise module can judge the exercise result, can synchronously operate with the intelligent course and provides an intuitive visual indication system.

5. The music teaching platform of VR technology of claim 1, wherein: the working method of the independent exercise module is that the exercise is carried out under the condition of no prompt, the system can correct errors and guide in time, the playing result is judged through the system, and corresponding guide is given out outside the fault tolerance range.

6. The music teaching platform of VR technology of claim 1, wherein: the working method of the open course input module is that courses can be directly input in the system through an electric signal output and input system of a musical instrument, rhythm and strength information can be perfectly recorded, and music scores and courses in a teaching mode are automatically generated.

7. The music teaching platform of VR technology of claim 1, wherein: the working method of the professional course module is a complete learning scheme which accords with course systems of various musical instruments and is from zero-base learning to professional musicians.

8. The music teaching platform of VR technology of claim 1, wherein: the working method of the VR platform realizes artificial intelligence cooperative playing, namely single-person operation, and realizes multi-person playing in a local area network and multi-person playing in a regional network, namely multi-person online playing.

9. The music teaching platform of VR technology of claim 1, wherein: the working method of the scene and musical instrument customization module is to continuously update various different scenes on the VR platform, and upload own musical instrument schemes to the platform to share the schemes to all users, so that more various choices are brought to the users.

10. The music teaching platform of VR technology of claim 1, wherein: the working method of the competition module is that the using time of an individual including the continuous times, the course completion and the tasks is recorded, the user data is recorded by continuously updating various challenge tasks, and the ranking condition and the ranking list of all VR platforms on the Internet are given.

Technical Field

The invention relates to the field of VR body feeling entertainment music teaching, in particular to a music teaching platform based on VR technology.

Background

The VR technology, namely the virtual reality technology, is a new generation information interaction technology, and in recent years, the VR technology is continuously developed and perfected, is rapidly and widely applied to various fields and industries, and has a good enhancement effect on the perception experience of people. For VR technology, it is basically characterized by combining multiple scientific technologies such as computer simulation, intelligent sensor and graphic display, etc., and is used for creating virtual space in the same way as human real world perception, giving users an immersive experience; at present, in the field of music teaching, a traditional teaching mode is basically adopted, students can achieve the targets and the scores actually required by the students by utilizing self-contained musical instruments and through the guidance of teachers and a large amount of repeated practice, the teaching in the curing mode enables music learning to be dull and long-lasting, the learning interest of the students is reduced, the practice level and the scores cannot be improved better, along with the improvement and the development of VR technology, the teaching can also be carried out by utilizing VR technology, simulation demonstration, competition interaction, data online and updating and other resources sharing are realized, an electronic musical instrument is used as an input device, certain entertainment is achieved, errors of the students in practice are corrected in time, various sound waveforms are simulated through a series of operations, the teaching and the entertainment are combined, and a database and the internet are utilized, The local area network is used as a basis for information and data interaction, so that self-learning, competition and ranking can be performed on the VR platform in parallel, and the learning interest and the playing level of students are improved.

Disclosure of Invention

The invention aims to provide a music teaching platform based on VR technology, which takes an electronic musical instrument as an input device, has certain entertainment, can show a teaching function in the forms of demonstration, guidance and tracking, and can cooperate with playing, practicing and upgrading an online simulation instrument by combining the Internet or a local area network to realize competition and multiple somatosensory functions, so that a user can improve playing skills and level.

The technical scheme of the invention is as follows: the utility model provides a music teaching platform of VR technique which characterized in that: comprises an electronic musical instrument, a 3D scanning device, a motion capture device, an optical capture device, a VR platform, a scene and musical instrument customization module, a competition module, a DLC expansion module, a resource integration access module and a database module, the 3D scanning device, the motion capture device and the optical capture device are all connected with the electronic musical instrument by lines, the VR platform is positioned at the next stage of the electronic musical instrument, the VR platform is also provided with a demonstration module, a tracking exercise module, an independent exercise module, an open course recording module and a professional course module, the VR platform is connected with the Internet or a local area network by a line, the database module is positioned at the next stage of the VR platform, the database module is connected with the VR platform through a line, and the scene, the musical instrument customization module, the competition module, the DLC expansion module and the resource integration access module are all located at the next level of the database module.

Further, the 3D scanning device, the motion capture device, and the optical capture device are all freely adjustable simulator terminals with inherent color, metal property, roughness, highlight, ruggedness, transparency, reflection, and refraction properties, and the 3D scanning device, the motion capture device, and the optical capture device are all provided with independent levels including a waveform of sound, concurrence of sound, phase, set point of dominant sound, and width of overtone.

Furthermore, the working method of the demonstration module can simply and clearly guide the user how to do and what to do, and guide the user what the user should learn and master through the motion demonstration of the electronic musical instrument and the demonstration of a virtual teacher in the game.

Furthermore, the working method of the tracking exercise module is synchronously operated with the simulation exercise, and the exercise result is judged, so that the tracking exercise module can be synchronously operated with the intelligent course, and an intuitive visual indication system is provided.

Furthermore, the working method of the independent exercise module is that the exercise is carried out under the condition of no prompt, the system can correct errors and guide in time, and corresponding guide is given out outside the fault-tolerant range through judging the performance result by the system.

Furthermore, the working method of the open course input module can directly input courses in the system through the electric signal output and input system of the musical instrument, can record rhythm and strength information perfectly, and can automatically generate courses of music scores and teaching modes.

Furthermore, the working method of the professional course module is a complete learning scheme which accords with course systems of various musical instruments and is from zero-base learning to professional musicians.

Furthermore, the working method of the VR platform realizes artificial intelligence cooperative playing, namely single-person operation, and realizes multi-person playing in a local area network and multi-person playing in a regional network, namely multi-person online playing.

Furthermore, the working method of the scene and musical instrument customization module is to continuously update various different scenes on the VR platform, and upload the own musical instrument schemes to the platform to share the schemes to all users, so that more various choices are brought to the users.

Further, the working method of the competition module is to record the use time of an individual, including the continuous times, the course completion and the tasks, to record the user data by continuously updating various challenge tasks, and to give ranking conditions and ranking lists of all VR platforms on the Internet.

The invention has the beneficial effects that: the music teaching method is based on a music teaching platform of VR technology, the electronic musical instruments can select various electronic musical instruments as basic operation equipment of the whole VR platform, 3D scanning equipment, motion capture equipment and optical capture equipment all adopt freely-adjustable simulator terminals with inherent color, metal property, roughness, highlight, concave-convex property, transparency, reflection and refraction properties, the 3D scanning equipment, the motion capture equipment and the optical capture equipment are all provided with independent levels of waveforms containing sound, concurrence, phase and main tone setting points of the sound and width of overtones, and the independent levels are used for connecting the VR platform and used as basic hardware facilities for simulating true musical instrument experience to capture the actions of users and the triggering of the electronic musical instruments used by the users; the VR platform is connected with the Internet or a local area network by a line, so that artificial intelligent cooperative playing, namely single-person operation, multi-person playing in the local area network and regional network multi-person playing, namely multi-person online playing, are realized, the whole VR platform is connected with the database module and used for data caching and updating, and a huge data storage space is provided for the VR platform; the whole platform system has clear and transparent structural thought, wide coverage and convenient and fast expansion, takes the electronic musical instrument as input equipment, and has certain entertainment, can show the teaching function in the forms of demonstration, guidance and tracking, and combines the internet or the local area network to cooperate with playing, practicing and upgrading the on-line simulation musical instrument to realize the functions of competition and multiple somatosensory, so that the user can improve the playing skill and the level of the music teaching platform based on the VR technology, the hardware facility is perfected, the foundation for the continuous development of the entity and the virtual product is established, the on-line preview is provided for the musical instrument product, and the online simulation instrument experience provides a technical solution, new feasibility changes are brought for the personalized customization of the entity and the virtual instrument, the experience is more free and flexible, and more comprehensive user experience and more comprehensive and visual online data check are provided for online purchasing of the instrument.

Drawings

Fig. 1 is a front view of the present invention.

Wherein: 1. electronic musical instrument 2, 3D scanning device 3, and motion capture device

4. Optical capture device 5, VR platform 6, demonstration module

7. Tracking exercise module 8, independent exercise module 9 and open course recording module

10. Professional course module 11, scene and musical instrument customization module 12 and competition module

13. DLC expansion module 14, resource integration access module 15 and database module

Detailed Description

The following provides a brief description of embodiments of the present invention with reference to the accompanying drawings.

As shown in fig. 1, a music teaching platform of VR technology is characterized in that: the electronic musical instrument comprises an electronic musical instrument 1, a 3D scanning device 2, a motion capture device 3, an optical capture device 4, a VR platform 5, a scene and musical instrument customization module 11, a competition module 12, a DLC expansion module 13, a resource integration access module 14 and a database module 15, wherein the 3D scanning device 2, the motion capture device 3 and the optical capture device 4 are all connected with the electronic musical instrument 1 through lines, the VR platform 5 is positioned at the next stage of the electronic musical instrument 1, the VR platform 5 is also provided with a demonstration module 6, a tracking exercise module 7, an independent exercise module 8, an open course entry module 9 and a professional course module 10, the VR platform 5 is connected with the Internet or a local area network through lines, the database module 15 is positioned at the next stage of the VR platform 5, the database module 15 is connected with the VR platform 5 through lines, and the scene and musical instrument customization module 11, The competition module 12, the DLC expansion module 13 and the resource integration access module 14 are all positioned at the next stage of the database module 15. The 3D scanning device 2, the motion capture device 3, and the optical capture device 4 are all freely adjustable simulator terminals with inherent color, metal property, roughness, highlight, concave-convex, transparent, reflective, and refractive properties, and the 3D scanning device 2, the motion capture device 3, and the optical capture device 4 are all provided with independent levels including a waveform of sound, concurrence of sound, phase, setup of dominant tone, and width of overtone. The working method of the demonstration module 6 is to simply and clearly guide the user how to do and what to do, and guide the user what the user should learn and master through the motion demonstration of the electronic musical instrument 1 and the demonstration of a virtual teacher in the game. The working method of the tracking exercise module 7 is synchronous operation with the simulation exercise, and the exercise result is judged, so that the tracking exercise module can be synchronous operation with the intelligent course, and an intuitive visual indication system is provided. The working method of the independent exercise module 8 is to exercise without prompting, the system can correct errors and guide in time, and corresponding guide is given out outside the fault-tolerant range through judging the performance result by the system. The working method of the open course recording module 9 is that courses can be directly recorded in the system through the electric signal output and input system of the musical instrument, rhythm and strength information can be perfectly recorded, and music scores and courses in a teaching mode can be automatically generated. The working method of the professional course module 10 is a complete learning scheme which accords with course systems of various musical instruments and is from zero-base learning to professional musicians. The working method of the VR platform 5 is to realize artificial intelligence cooperative playing, namely single-person operation, and realize multi-person playing in a local area network and multi-person playing in a regional network, namely multi-person online playing. The scene and musical instrument customizing module 11 works by continuously updating various different scenes on the VR platform 5, uploading own musical instrument schemes to the platform, sharing the schemes to all users, and bringing more various choices to the users. The working method of the competition module 12 is to record the use time of an individual, including the continuous times, the course completion and the tasks, to record the user data by continuously updating various challenge tasks, and to give the ranking conditions and the ranking lists of all VR platforms 5 on the Internet. The working method of the DLC expansion module 13 is to download the expansion packets of skin, scene, musical instrument, sound source and music on the Internet in time. The resource integration access module 14 works by accessing and covering a PC, a home entertainment host, and VR head-mounted and body-sensing hardware facilities.

The working mode is as follows: the music teaching method is based on a music teaching platform of VR technology; mainly by electronic musical instrument 1, 3D scanning device 2, motion capture device 3, optics capture device 4, VR platform 5, scene and musical instrument customization module 11, competition module 12, DLC extension module 13, resource integration access module 14 and database module 15 to constitute, wherein, electronic musical instrument 1 can select various electronic musical instruments as the basic operation device of the whole VR platform 5, the 3D scanning device 2, motion capture device 3, optics capture device 4 all adopt the free regulation simulator terminal with inherent color, metallicity, roughness, highlight, concave-convex, transparent, reflection, refraction attribute, and 3D scanning device 2, motion capture device 3, optics capture device 4 all have the waveform containing sound, the concurrency, phase, the set point of the dominant tone, the independent hierarchy of the width of the overtone of sound, they are used for connecting VR platform 5, and as the basic hardware facility of the simulation musical instrument experience, the action of the user and the triggering of the electronic musical instrument 1 used by the user are captured; this VR platform 5 utilizes the circuit to be connected with internet or LAN, has realized artificial intelligence cooperation and has played, single operation promptly, many people in the LAN play and many people in regional network play, many people play on-line promptly, and this VR platform 5 divide into teaching mode, scene and musical instrument customization mode, the sports mode, DLC expands the mode, these five high power modules of resource integration mode, whole VR platform 5 is connected with database module 15, be used for data cache and update, provide a huge data storage space for VR platform 5.

Function one, teaching mode: the lower part of the VR platform 5 is divided into five sub-functions, namely a demonstration module 6, a tracking exercise module 7, an independent exercise module 8, an open course recording module 9 and a professional course module 10; the working method of the demonstration module 6 can simply and clearly guide the user how to do and what to do, and guides the user what the user should learn and master through the motion demonstration of the electronic musical instrument 1 and the demonstration of a virtual teacher in a game; the working method of the tracking exercise module 7 is to synchronously operate with the simulation exercise and judge the exercise result, so that the tracking exercise module can synchronously operate with the intelligent course to provide an intuitive visual indication system; the working method of the independent exercise module 8 is that the exercise is carried out under the condition of no prompt, the system can correct errors and guide in time, the playing result is judged through the system, and corresponding guide is given out outside the fault tolerance range; the working method of the open course recording module 9 is that courses can be directly recorded in the system through the electric signal output and input system of the musical instrument, rhythm and strength information can be perfectly recorded, and music scores and courses in a teaching mode can be automatically generated; the working method of the professional course module 10 is a complete learning scheme which accords with course systems of various musical instruments and is from zero-base learning to professional musicians.

Function two, scene and instrument customization mode: the mode is mainly based on the next level of the VR platform 5 and the database module 15, namely the scene and musical instrument customization module 11, the working method of the model is to continuously update various different scenes on the VR platform 5, more various choices are brought to users, the scene customization function is opened, users can create distinctive user spaces, various musical instrument combination forms, materials and shapes can be freely adjusted, the requirements of consumers on musical instruments and playing effects are met, the sounds of the musical instruments can be freely adjusted, and the musical instrument schemes of the users can be uploaded to the platform and shared by all users.

Function three, sports mode: the mode is parallel to a scene and musical instrument customization mode, namely a competition module 12, the working method of the competition module can be divided into three modes, the first mode is a personal achievement system, and the mode records the use time, continuous hitting number, course completion and tasks of a person; the second is official challenge, and the mode can continuously update various challenge tasks, record user data and give a full platform ranking; and the third method is to set up various ranking lists, including the best course design, the best instrument modification and the best sound sampling, and show the ranking lists on a full platform, and a framework with a band PK mode is used for team competition.

Function four, DLC extension mode: the mode is parallel to a scene customization mode and a musical instrument customization mode and a competition mode, the DLC expansion module 13 is used as a support, and the working method is that the expansion package of skin, scene, musical instrument, sound source and music on the Internet can be downloaded in time.

Function five, resource integration mode: the mode is parallel to a scene, a musical instrument customization mode, a competition mode and a DLC expansion mode, a resource integration access module 14 is utilized for architecture, the working method can be divided into three items, the first item is entertainment market cooperation, cooperates with worldwide platforms such as Steam, Microsoft, Sony, App Store and the like, and covers most entertainment equipment such as a PC, a home entertainment host, VR head-mounted equipment and the like; the second item is development cooperation of hardware, and a research and development team and a production team are built in the external part of the electroacoustic musical instrument and are focused on developing the electroacoustic musical instrument suitable for software; the third item is education cooperation, which can actively focus on music education institutions and develop cooperative negotiation in universities in various aspects such as teaching and courses.

The whole platform system has clear and transparent structural thought, wide coverage and convenient and fast expansion, takes the electronic musical instrument as input equipment, and has certain entertainment, can show the teaching function in the forms of demonstration, guidance and tracking, and combines the internet or the local area network to cooperate with playing, practicing and upgrading the on-line simulation musical instrument to realize the functions of competition and multiple somatosensory, so that the user can improve the playing skill and the level of the music teaching platform based on the VR technology, the hardware facility is perfected, the foundation for the continuous development of the entity and the virtual product is established, the on-line preview is provided for the musical instrument product, and the online simulation instrument experience provides a technical solution, new feasibility changes are brought for the personalized customization of the entity and the virtual instrument, the experience is more free and flexible, and more comprehensive user experience and more comprehensive and visual online data check are provided for online purchasing of the instrument.

In the description of the present invention, it should be noted that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "inner", "outer", "top", "bottom", "end", etc., indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

While one embodiment of the present invention has been described in detail, the description is only a preferred embodiment of the present invention and should not be taken as limiting the scope of the invention. All equivalent changes and modifications made within the scope of the present invention shall fall within the scope of the present invention.