阅读说明：本技术 一种基于5g实时传输的vr沉浸式中医药文化传播系统 (VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission ) 是由 宋鑫 吴晓龙 李辉辉 于 2021-07-23 设计创作，主要内容包括：本发明涉及中医药文化传播技术领域,提供一种基于5G实时传输的VR沉浸式中医药文化传播系统,包括信息采集端、信息处理端、5G传输基站和沉浸式VR终端,所述信息采集端、所述信息处理端和所述沉浸式VR终端相互之间通过所述5G传输基站的5G网络进行通信。所述的一种基于5G实时传输的VR沉浸式中医药文化传播系统为体验者提供沉浸式、交互式的虚拟现实场景体验,增加了中医药文化传播的趣味性,可以让体验者进行养生保健动作跟练,对体验者动作进行打分评价,并对体验者动作给出改进建议,互动性强,对体验者吸引度高；对中医药文化传播,形式新颖且效果佳,可以将中医药知识进行有效的传播推广。(The invention relates to the technical field of Chinese medicine culture transmission, and provides a VR immersion type Chinese medicine culture transmission system based on 5G real-time transmission, which comprises an information acquisition end, an information processing end, a 5G transmission base station and an immersion type VR terminal, wherein the information acquisition end, the information processing end and the immersion type VR terminal are communicated with each other through a 5G network of the 5G transmission base station. The VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission provides immersive and interactive virtual reality scene experience for an experiencer, increases the interestingness of traditional Chinese medicine culture transmission, enables the experiencer to carry out health preserving and health care actions and exercise, scores the actions of the experiencer and gives improvement suggestions to the actions of the experiencer, and is strong in interactivity and high in attractiveness to the experiencer; the Chinese medicine culture transmission is novel in form and good in effect, and the Chinese medicine knowledge can be effectively transmitted and popularized.)

1. A VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission comprises an information acquisition end, an information processing end, a 5G transmission base station and an immersion type VR terminal, and is characterized in that the information acquisition end, the information processing end and the immersion type VR terminal are communicated with each other through a 5G network of the 5G transmission base station;

the information acquisition end comprises a visual acquisition module, a voice acquisition module and a first wireless transmission module;

the vision acquisition module: the system comprises a 360-degree panoramic image used for collecting the actions of an experiencer;

the voice acquisition module: the voice command is used for collecting the voice command of the experiencer;

the first wireless transmission module: the 5G network is used for transmitting the data acquired by the information acquisition end to the information processing end through the 5G transmission base station;

the information processing terminal comprises a cloud storage module, a cloud vision computing module, a cloud evaluation suggestion module, a cloud voice interaction module, a first wireless data receiving module and a second wireless transmission module;

the cloud storage module: used for storing the relevant data of the knowledge culture of the traditional Chinese medicine;

the related data comprises but is not limited to famous traditional Chinese medicine story cases, health-care action cases, classical traditional Chinese medicine cases and brief introduction cases of traditional Chinese medicinal materials;

the cloud vision computing module: the system comprises a vision acquisition module, a cloud storage module and a virtual reality scene, wherein the vision acquisition module is used for acquiring an experiencer action image, calculating and converting the experiencer action image acquired by the vision acquisition module into a virtual reality scene, extracting a key frame action image and registering the key frame action image with the health-care action case stored in the cloud storage module;

the cloud evaluation suggestion module: according to the registration result of the cloud vision computing module, scoring evaluation is carried out on the actions of the experiencers, and improvement suggestions are given to the actions of the experiencers;

the cloud voice interaction module: the voice command recognition and processing system is used for recognizing the voice command of the processing experiencer and executing operation according to the voice command;

the first wireless data receiving module: the data processing terminal is used for receiving data information for the information processing terminal;

the second wireless transmission module: the 5G network is used for transmitting the data processed by the information processing terminal to the immersive VR terminal through the 5G transmission base station;

the immersive VR terminal comprises a VR visual presentation module, a somatosensory recognition module and a second wireless data receiving module;

the VR visual presentation module: the cloud storage module is used for calling a target case to be used from the cloud storage module by an experiencer, restoring various conditions of the target case in a real scene to simulate actual conditions, and enabling the experiencer to enter a virtual reality scene of the target case;

the somatosensory recognition module is: the virtual reality system is used for capturing hand motions of an experiencer and transmitting hand operation information of the experiencer to the VR visual presentation device in real time so as to be fused with the virtual reality scene of the target case and reflect the hand operation information of the experiencer in the virtual reality scene of the target case;

the second wireless data receiving module: for receiving data information for the immersive VR terminal.

2. The VR immersive traditional Chinese medicine and cultural transmission system based on 5G real-time transmission of claim 1, wherein the vision capture module captures 360 degree panoramic real-time images through the input ends of a plurality of sensors oriented in different directions.

3. The VR immersive traditional Chinese medicine culture propagation system based on 5G real-time transmission of claim 2, wherein the cloud voice interaction module comprises a voice wake-up mechanism, a semantic analysis mechanism and a program control mechanism;

the voice awakening mechanism: the system is used for receiving and identifying a wake-up word sent by a user and waking up and operating the semantic analysis mechanism;

the semantic analysis mechanism: analyzing and identifying the semantics of the voice instruction of the experiencer, and transmitting instruction information data to the program control mechanism;

the program control mechanism: and the required case is called from the cloud storage module according to the voice instruction information of the experiencer.

4. The VR immersive traditional Chinese medicine culture propagation system based on 5G real-time transmission of claim 3, wherein a default "wake word" of the voice wake mechanism is a "Xiaoshen medical".

5. The VR immersive TCM culture propagation system of any of claims 1 to 4 based on 5G real-time transmission, wherein the VR visual presentation module is a multi-functional VR headset.

6. The VR immersion type traditional Chinese medicine and drug culture transmission system based on 5G real-time transmission of claim 5, wherein the somatosensory recognition module is a somatosensory operating glove connected with an infrared emitting device.

Technical Field

The invention relates to the technical field of Chinese medicine culture transmission, in particular to a VR immersion type Chinese medicine culture transmission system based on 5G real-time transmission.

Background

The traditional Chinese medicine is a great creation of Chinese nationality, is a treasure of Chinese ancient science, is also a key for opening a Chinese civilization treasure house, makes a great contribution to the multiplication of Chinese nationality, and has a positive influence on the progress of world civilization.

China also needs to select and build a lot of traditional Chinese medicine culture experience venues integrating health care knowledge, health care experience and leisure and entertainment based on traditional Chinese medicine culture propaganda and education bases in vigorous propaganda, and technical means such as digital voice, panoramic images, three-dimensional images, virtual reality and augmented reality are fully utilized to form a traditional Chinese medicine culture propagation and display system with outstanding characteristics.

The 5G technology is a latest generation cellular mobile communication technology and is an extension of 4G (LTE-A, WiMax), 3G (UMTS, LTE) and 2G (gsm) systems, the performance goal of 5G is high data rate, delay reduction, energy saving, cost reduction, system capacity improvement and large-scale device connection, and with the rapid development of the internet of things technology, more and more VR devices are using the 5G communication technology.

At present, the propagation of traditional Chinese medicine culture is limited to book and network video science popularization, the form is single, the effect is poor, the requirements of audiences in the information era cannot be met, and the traditional Chinese medicine culture is difficult to effectively propagate.

Therefore, a VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission is designed, and the problems are solved.

Disclosure of Invention

The invention provides a VR immersion type traditional Chinese medicine and drug culture transmission system based on 5G real-time transmission, which overcomes the defects and comprises an information acquisition end, an information processing end, a 5G transmission base station and an immersion type VR terminal, wherein the information acquisition end, the information processing end and the immersion type VR terminal are communicated with each other through a 5G network of the 5G transmission base station;

the information acquisition end comprises a visual acquisition module, a voice acquisition module and a first wireless transmission module;

the vision acquisition module: the system comprises a 360-degree panoramic image used for collecting the actions of an experiencer;

the voice acquisition module: the voice command is used for collecting the voice command of the experiencer;

the first wireless transmission module: the 5G network is used for transmitting the data acquired by the information acquisition end to the information processing end through the 5G transmission base station;

the information processing terminal comprises a cloud storage module, a cloud vision computing module, a cloud evaluation suggestion module, a cloud voice interaction module, a first wireless data receiving module and a second wireless transmission module;

the cloud storage module: used for storing the relevant data of the knowledge culture of the traditional Chinese medicine;

the related data comprises but is not limited to famous traditional Chinese medicine story cases, health-care action cases, classical traditional Chinese medicine cases and brief introduction cases of traditional Chinese medicinal materials;

the cloud vision computing module: the system comprises a vision acquisition module, a cloud storage module and a virtual reality scene, wherein the vision acquisition module is used for acquiring an experiencer action image, calculating and converting the experiencer action image acquired by the vision acquisition module into a virtual reality scene, extracting a key frame action image and registering the key frame action image with the health-care action case stored in the cloud storage module;

the cloud evaluation suggestion module: according to the registration result of the cloud vision computing module, scoring evaluation is carried out on the actions of the experiencers, and improvement suggestions are given to the actions of the experiencers;

the cloud voice interaction module: the voice command recognition and processing system is used for recognizing the voice command of the processing experiencer and executing operation according to the voice command;

the first wireless data receiving module: the data processing terminal is used for receiving data information for the information processing terminal;

the second wireless transmission module: the 5G network is used for transmitting the data processed by the information processing terminal to the immersive VR terminal through the 5G transmission base station;

the immersive VR terminal comprises a VR visual presentation module, a somatosensory recognition module and a second wireless data receiving module;

the VR visual presentation module: the cloud storage module is used for calling a target case to be used from the cloud storage module by an experiencer, restoring various conditions of the target case in a real scene to simulate actual conditions, and enabling the experiencer to enter a virtual reality scene of the target case;

the somatosensory recognition module is: the virtual reality system is used for capturing hand motions of an experiencer and transmitting hand operation information of the experiencer to the VR visual presentation device in real time so as to be fused with the virtual reality scene of the target case and reflect the hand operation information of the experiencer in the virtual reality scene of the target case;

the second wireless data receiving module: for receiving data information for the immersive VR terminal.

Preferably, the vision acquisition module performs 360-degree panoramic real-time shooting through the recording ends of the sensors in different directions.

Preferably, the cloud voice interaction module comprises a voice awakening mechanism, a semantic analysis mechanism and a program control mechanism;

the voice awakening mechanism: the system is used for receiving and identifying a wake-up word sent by a user and waking up and operating the semantic analysis mechanism;

the semantic analysis mechanism: analyzing and identifying the semantics of the voice instruction of the experiencer, and transmitting instruction information data to the program control mechanism;

the program control mechanism: and the required case is called from the cloud storage module according to the voice instruction information of the experiencer.

Preferably, the default "wake word" of the voice wake-up mechanism is "minimal mythics".

Preferably, the VR visual presentation module is a multifunctional VR headset.

Preferably, the somatosensory recognition module is a somatosensory operating glove connected with an infrared emitting device.

The working method of the invention is as follows:

the information acquisition end, the information processing end and the immersive VR terminal of the VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission are communicated with each other through a 5G network of the 5G transmission base station;

an experiencer of the traditional Chinese medicine culture propagation system wears a multifunctional helmet of an immersive VR terminal and is provided with a somatosensory operation glove, the experiencer firstly sends a wake-up word 'Xiaoshengli', voice signals are collected and transmitted to the cloud voice interaction module through the voice collection module, the voice wake-up mechanism wakes up the semantic analysis mechanism to operate, a voice instruction is sent out according to the experiencer, the semantic analysis mechanism analyzes and identifies the semantics of the voice instruction of the experiencer and transmits instruction information data to the program control mechanism, the program control mechanism calls a required case from the cloud storage module according to the voice instruction information, the VR visual presentation module restores various conditions of the target case in a real scene so as to simulate actual conditions, so that the experiencer enters a virtual reality scene of the target case, and the somatosensory recognition module captures hand motions of the experiencer, transmitting the hand operation information of the experiencer to the VR visual presentation device in real time so as to be fused with the virtual reality scene of the target case, and reflecting the hand operation information of the experiencer in the virtual reality scene of the target case;

when the experiencer selects the health care action case, the experiencer can follow the health care action imitation presented by the VR visual presentation module, the vision acquisition module carries out 360-degree panoramic real-time shooting on the actions of an experiencer through the input ends of a plurality of sensors in different directions, the vision acquisition module transmits panoramic real-time shooting information to the cloud vision computing module, the cloud vision computing module computes and converts the experiencer action image acquired by the vision acquisition module into a virtual reality scene, the virtual reality scene is displayed by the VR vision presenting module, and a key frame action image is extracted, and the cloud evaluation suggestion module scores and evaluates the actions of the experiencers according to the registration result of the cloud vision computing module and gives an improvement suggestion to the actions of the experiencers.

The invention has the beneficial effects that:

(1) all modules of the VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission rely on wireless transmission in a 5G network environment, and the VR immersive traditional Chinese medicine culture transmission system is high in data transmission rate, low in delay, high in fluency and good in use experience effect;

(2) the VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission can enable an experiencer to enter a virtual reality scene world of traditional Chinese medicine culture, provide immersive and interactive virtual reality scene experience for the experiencer, and increase interestingness of traditional Chinese medicine culture transmission;

(3) the VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission can enable an experiencer to conduct health-care action follow-up training, score evaluation is conducted on actions of the experiencer, improvement suggestions are given to the actions of the experiencer, interactivity is strong, and attractiveness to the experiencer is high;

(4) the VR immersion type Chinese medicine culture transmission system based on 5G real-time transmission is used for transmitting Chinese medicine culture, is novel in form and good in effect, and can effectively transmit and popularize Chinese medicine knowledge.

Drawings

FIG. 1 is a block diagram of the system of the present invention;

FIG. 2 is a flowchart illustrating the operation of the cloud voice interaction module according to the present invention;

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The invention relates to a VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission, which comprises an information acquisition end, an information processing end, a 5G transmission base station and an immersion type VR terminal, wherein the information acquisition end, the information processing end and the immersion type VR terminal are communicated with each other through a 5G network of the 5G transmission base station;

the information acquisition end comprises a visual acquisition module, a voice acquisition module and a first wireless transmission module;

the vision acquisition module: the system comprises a 360-degree panoramic image used for collecting the actions of an experiencer;

the voice acquisition module: the voice command is used for collecting the voice command of the experiencer;

the first wireless transmission module: the 5G network is used for transmitting the data acquired by the information acquisition end to the information processing end through the 5G transmission base station;

the information processing terminal comprises a cloud storage module, a cloud vision computing module, a cloud evaluation suggestion module, a cloud voice interaction module, a first wireless data receiving module and a second wireless transmission module;

the cloud storage module: used for storing the relevant data of the knowledge culture of the traditional Chinese medicine;

the related data includes but is not limited to various traditional Chinese medicine diagnosis cases, health care action cases, famous traditional Chinese medicine story cases and traditional Chinese medicine introduction cases;

the cloud vision computing module: the system comprises a vision acquisition module, a cloud storage module and a virtual reality scene, wherein the vision acquisition module is used for acquiring an experiencer action image, calculating and converting the experiencer action image acquired by the vision acquisition module into a virtual reality scene, extracting a key frame action image and registering the key frame action image with the health-care action case stored in the cloud storage module;

the cloud evaluation suggestion module: according to the registration result of the cloud vision computing module, scoring evaluation is carried out on the actions of the experiencers, and improvement suggestions are given to the actions of the experiencers;

the cloud voice interaction module: the voice command recognition and processing system is used for recognizing the voice command of the processing experiencer and executing operation according to the voice command;

the first wireless data receiving module: the data processing terminal is used for receiving data information for the information processing terminal;

the second wireless transmission module: the 5G network is used for transmitting the data processed by the information processing terminal to the immersive VR terminal through the 5G transmission base station;

the immersive VR terminal comprises a VR visual presentation module, a somatosensory recognition module and a second wireless data receiving module;

the VR visual presentation module: the cloud storage module is used for calling a target case to be used from the cloud storage module by an experiencer, restoring various conditions of the target case in a real scene to simulate actual conditions, and enabling the experiencer to enter a virtual reality scene of the target case;

the somatosensory recognition module is: the virtual reality system is used for capturing hand motions of an experiencer and transmitting hand operation information of the experiencer to the VR visual presentation device in real time so as to be fused with the virtual reality scene of the target case and reflect the hand operation information of the experiencer in the virtual reality scene of the target case;

the second wireless data receiving module: for receiving data information for the immersive VR terminal.

The vision acquisition module carries out 360-degree panoramic real-time shooting through the recording ends of the sensors in different directions.

The cloud voice interaction module comprises a voice awakening mechanism, a semantic analysis mechanism and a program control mechanism;

the voice awakening mechanism: the system is used for receiving and identifying a wake-up word sent by a user and waking up and operating the semantic analysis mechanism;

the semantic analysis mechanism: analyzing and identifying the semantics of the voice instruction of the experiencer, and transmitting instruction information data to the program control mechanism;

the program control mechanism: and the required case is called from the cloud storage module according to the voice instruction information of the experiencer.

Wherein the default wake-up word of the voice wake-up mechanism is 'Xiaosheniat'.

Wherein, VR vision presents the module for multi-functional VR helmet.

Wherein, the somatosensory recognition module is a somatosensory operating glove connected with an infrared transmitting device

The first embodiment is as follows:

traditional chinese medicine culture transmission system experience person wears the multi-functional helmet at immersive VR terminal to take the upper body to feel operating glove, experience person sends: the wonderful doctor needs to know the famous traditional Chinese medicine story, the wonderful doctor wakes up the cloud voice interaction module through the voice acquisition module and operates the semantic analysis mechanism, the program control mechanism calls a 'famous traditional Chinese medicine story case' list from the cloud storage module according to a voice instruction analysis result for an experiencer to select, and the experiencer sends out: 'I want to enter the traditional Chinese medicine world of Li Shizhen', the multifunctional helmet presents the virtual reality scene of the Li Shizhen story case for the experiencer.

Example two:

traditional chinese medicine culture transmission system experience person wears the multi-functional helmet at immersive VR terminal to take the upper body to feel operating glove, experience person sends: the cloud voice interaction module is awakened by an awakening word of the Xiaosheng doctor, the semantic analysis mechanism is operated, the program control mechanism calls the honeysuckle introduction in the traditional Chinese medicine introduction case from the cloud storage module according to the voice instruction analysis result after the analysis of the semantic analysis mechanism, and the multifunctional helmet presents the related virtual reality scene of the honeysuckle case for an experiencer.

Example three:

traditional chinese medicine culture transmission system experience person wears the multi-functional helmet at immersive VR terminal to take the upper body to feel operating glove, experience person sends: the wonderful doctor needs to do health-care exercises, the cloud voice interaction module is awakened by an awakening word of the wonderful doctor through the voice acquisition module, the semantic analysis mechanism is operated, the wonderful doctor is analyzed by the semantic analysis mechanism, the program control mechanism calls a health-care action case list from the cloud storage module according to a voice instruction analysis result to be selected by an experiencer, and the experiencer sends out the following results: 'I need to do cervical vertebra exercises', the multifunctional helmet presents a virtual reality scene of a cervical vertebra exercise action case for an experiencer, the experiencer follows and imitates cervical vertebra exercise actions in the virtual reality scene, the vision acquisition module carries out 360-degree panoramic real-time shooting on the actions of the experiencer through the input ends of a plurality of sensors in different directions, the vision acquisition module transmits panoramic real-time shooting information to the cloud vision computing module, the cloud vision computing module calculates and converts action images of the experiencer acquired by the vision acquisition module into virtual reality scenes to be presented through the VR vision presentation module, extracts key frame action images to be registered with the health-care action case stored in the cloud storage module, and the cloud evaluation suggestion module carries out scoring evaluation on the actions of the experiencer according to the registration results of the cloud vision computing module, the final finish score is 85 points, and it is recommended that the neck part is not enough in downward shrinkage during the shoulder-lifting and necking actions, the shoulders are slowly lifted, and the neck part is shrunk as far as possible.

All modules of the VR immersive traditional Chinese medicine culture transmission system based on 5G real-time transmission rely on wireless transmission in a 5G network environment, and the VR immersive traditional Chinese medicine culture transmission system is high in data transmission rate, low in delay, high in fluency and good in use experience effect; the experience person can enter the virtual reality scene world of the traditional Chinese medicine culture, immersive and interactive virtual reality scene experience is provided for the experience person, and the interestingness of the traditional Chinese medicine culture propagation is increased; the health-care action follow-up training of the experiencer can be realized, the actions of the experiencer are scored and evaluated, and an improvement suggestion is given to the actions of the experiencer, so that the interaction is strong, and the attraction degree of the experiencer is high; the Chinese medicine culture transmission is novel in form and good in effect, and the Chinese medicine knowledge can be effectively transmitted and popularized.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art through specific situations.

Relational terms such as "first" and "second," and the like, may be used solely to distinguish one element from another element having the same name, without necessarily requiring or implying any actual such relationship or order between such elements.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.