阅读说明：本技术 一种传统中国民族乐器的音符比对系统及其使用方法 (Note comparison system of traditional Chinese national musical instrument and use method thereof ) 是由 邵曦 朱欣岳 于 2020-05-07 设计创作，主要内容包括：本发明公开了一种传统中国民族乐器的音符比对系统及其使用方法,能够准确、实时地将中国传统民族乐器演奏发出的声音转写为通用的MIDI音频数字信号,通过音符比对系统,让弹琴者实时得到自己的演奏音符与师傅演奏音符的差别,客观准确地评价自己的演奏；提高了弹琴者辨别弹奏的力度、音高、音符时值的能力,通过智能终端来显示五线谱、古琴谱、简谱、瀑布流等格式的谱子,辅以音符比对系统,提高了用户获取谱面信息和自己演奏评价的效率；教琴者可以更加直观地得到弹琴者的练琴各项数据,让教琴者更加准确地评价弹琴者演奏,给出指导意见,实现智能教学。(The invention discloses a note comparison system of a traditional Chinese national musical instrument and a use method thereof, which can accurately and real-timely transcribe the sound generated by playing the traditional Chinese national musical instrument into a universal MIDI audio digital signal, and enable a player playing a piano to obtain the difference between the played note and a master played note in real time through the note comparison system, thereby objectively and accurately evaluating the playing of the player; the capability of a player for distinguishing the playing strength, the playing pitch and the note duration is improved, staff in the formats of a staff, an ancient piano score, a numbered musical notation, a waterfall flow and the like are displayed through an intelligent terminal, and the efficiency of acquiring the staff information and performing evaluation by the user is improved by assisting with a note comparison system; the religion musical instrument person can obtain the person playing the musical instrument of playing the musical instrument more directly perceivedly each item data, lets the religion musical instrument person evaluate the person playing the musical instrument more accurately, gives and guides the suggestion, realizes intelligent teaching.)

1. A note comparison system of a traditional Chinese national musical instrument is characterized by comprising a display screen, an audio receiving module, an audio transcription control module and an intelligent terminal; the intelligent terminal is respectively connected with the audio transcription control module and the display screen through a signal line or a communication module; displaying a music score corresponding to the performance of a user in real time by taking the musical notes as units on a display screen; the audio transcription control module is connected with the audio receiving module through a signal line or a communication module; audio transcription control module includes audio signal transcription module and MIDI data processing module, and audio receiving module gathers the performance audio signal of traditional chinese national musical instrument, and will audio signal transmits audio transcription module in real time, and audio transcription module uses musical note to be played audio signal real-time transcription for playing MIDI audio digital signal as the unit, and MIDI data processing module plays MIDI audio digital signal and compares in real time with the master MIDI audio digital signal that prepares, carries out real-time judgement and aassessment to playing the effect.

2. The system of claim 1, wherein the master MIDI audio digital signal sources comprise: the former performance data recorded by the local user, the other user data transmitted by the network and the MIDI audio digital signal played by the grandmaster piano.

3. The system of claim 1, wherein the system comprises an exercise mode and a performance mode, wherein in the exercise mode, the notes in the master MIDI audio digital signals are synchronously played in real time, the received MIDI audio digital signals are compared with each other, and if the difference between the notes in the MIDI audio digital signals is less than the error threshold, the system displays the correct information for the performance and continues to play the next note in the first MIDI audio digital signals; if the error threshold value is larger than the error threshold value, displaying and prompting the information of playing errors, and stopping playing the next note in the master MIDI audio digital signal; and during the playing mode, notes in the master MIDI audio digital signals are continuously played, and after the playing is finished, the played MIDI audio digital signals are compared with the master MIDI audio digital signals, the difference is evaluated, and the score is given to the user for the playing.

4. The system of claim 3, wherein the MIDI audio digital signals are visually displayed on an intelligent terminal or a screen in real time in a manner of staff, guqin, numbered musical notation and waterfall flow.

5. The system of claim 3, wherein the error threshold includes but is not limited to: incorrect pitch, too large force difference, too long note duration, too short note duration.

6. The system of claim 3, wherein the user can define the playing duration, the number of playing notes, the playing start time, and the playing end time.

7. The system of claim 1, wherein the audio transmission method comprises network transmission, cable transmission of digital signals and bluetooth transmission.

8. The note comparison system for traditional chinese national musical instruments according to claim 1, wherein the intelligent terminal comprises an intelligent tablet, a smart phone, a smart tv, and an intelligent projector.

9. The method for using the note matching system of the traditional chinese national musical instrument according to any one of claims 1-8, comprising the steps of:

step 1, collecting playing audio signals of a traditional Chinese national musical instrument through an audio receiving module, and transmitting the audio signals to an audio transcription module in real time;

step 2, by the audio transcription module, taking the musical notes as units, transcribing the playing audio signals into playing MIDI audio digital signals in real time, wherein the data in the playing MIDI audio digital signals comprise: pitch, note duration, note event start time, note event end time, note velocity, and the number of notes in the performance;

and 3, comparing the played MIDI audio digital signal with a pre-made master MIDI audio digital signal in real time, and judging and evaluating the playing effect in real time.

Technical Field

The invention relates to a note comparison system of a traditional Chinese national musical instrument and a using method thereof.

Background

The traditional Chinese national musical instruments are various in types, including koto, guqin, flute and the like, have good timbre, are inheritable to history and culture, and are irreplaceable to electric musical instruments and electronic musical instruments. However, the teaching of the traditional Chinese national musical instrument is on-site teaching, and at present, a few violators with the teaching experience and capability of the traditional Chinese national musical instrument are difficult to popularize, so that the inheritance and the development of the traditional Chinese national musical instrument are limited.

With the development of electronic science and information technology, intelligent musical instruments such as "intelligent guitar", "intelligent piano", and the like have appeared, and more people use the intelligent musical instruments when teaching or practicing the musical instruments. However, the intelligent musical instrument usually depends on the built-in components of the electronic musical instrument, which often means that a trainee who owns the musical instrument needs to purchase a new electronic musical instrument at a high cost, and the trainee often cannot achieve the original purpose of learning the traditional musical instrument in mind. In addition, the traditional Chinese national musical instruments have fewer intelligent musical instruments, and the hardware systems of the intelligent musical instruments are based on the principle of contact sensing, so that the wooden structures of the musical instruments are easily damaged, and the traditional Chinese national musical instruments are not suitable.

Disclosure of Invention

The purpose of the invention is as follows: the invention aims to provide a note comparison system of a traditional Chinese national musical instrument, which utilizes an automatic transcription technology to identify notes in sound emitted by the musical instrument, distinguish playing strength, pitch, note duration and the like, give guidance suggestions and realize intelligent teaching in the process of playing the traditional Chinese national musical instrument.

The technical scheme is as follows: the invention relates to a note comparison system of a traditional Chinese national musical instrument, which comprises a display screen, an audio receiving module, an audio transcription control module and an intelligent terminal, wherein the display screen is used for displaying a note comparison result; the intelligent terminal is respectively connected with the audio transcription control module and the display screen through a signal line or a communication module; displaying a music score corresponding to the performance of a user in real time by taking the musical notes as units on a display screen; the audio transcription control module is connected with the audio receiving module through a signal line or a communication module; audio transcription control module includes audio signal transcription module and MIDI data processing module, and audio receiving module gathers the performance audio signal of traditional chinese national musical instrument, and will audio signal transmits audio transcription module in real time, and audio transcription module uses musical note to be played audio signal real-time transcription for playing MIDI audio digital signal as the unit, and MIDI data processing module plays MIDI audio digital signal and compares in real time with the master MIDI audio digital signal that prepares, carries out real-time judgement and aassessment to playing the effect.

Further, the master MIDI audio digital signal source includes: the former performance data recorded by the local user, the other user data transmitted by the network and the MIDI audio digital signal played by the grandmaster piano.

Further, the method comprises an exercise mode and a playing mode, wherein in the exercise mode, notes in the master MIDI audio digital signal are synchronously played in real time, the received playing MIDI audio digital signal is compared with the received playing MIDI audio digital signal, and if the difference between the playing notes and the notes in the master MIDI audio digital signal is smaller than an error threshold value, correct playing information is displayed, and the next note in the first MIDI audio digital signal is continuously played; if the error threshold value is larger than the error threshold value, displaying and prompting the information of playing errors, and stopping playing the next note in the master MIDI audio digital signal; and during the playing mode, notes in the master MIDI audio digital signals are continuously played, and after the playing is finished, the played MIDI audio digital signals are compared with the master MIDI audio digital signals, the difference is evaluated, and the score is given to the user for the playing.

Further, the method comprises an exercise mode and a playing mode, wherein in the exercise mode, notes in the master MIDI audio digital signal are synchronously played in real time, the received playing MIDI audio digital signal is compared with the received playing MIDI audio digital signal, and if the difference between the playing notes and the notes in the master MIDI audio digital signal is smaller than an error threshold value, correct playing information is displayed, and the next note in the first MIDI audio digital signal is continuously played; if the error threshold value is larger than the error threshold value, displaying and prompting the information of playing errors, and stopping playing the next note in the master MIDI audio digital signal; and during the playing mode, notes in the master MIDI audio digital signals are continuously played, and after the playing is finished, the played MIDI audio digital signals are compared with the master MIDI audio digital signals, the difference is evaluated, and the score is given to the user for the playing.

Further, error thresholds include, but are not limited to: incorrect pitch, too large force difference, too long note duration, too short note duration.

Further, the user can define the playing time length, the number of playing notes, the playing start time and the playing end time by himself.

Further, the transmission method of the performance audio comprises network transmission, digital signal wired transmission and Bluetooth transmission.

Furthermore, the intelligent terminal comprises an intelligent tablet, an intelligent mobile phone, an intelligent television and an intelligent projector.

The purpose of the invention is as follows: the invention aims to provide a using method of a note comparison system of a traditional Chinese national musical instrument.

The technical scheme is as follows: the invention relates to a using method of a note comparison system of a traditional Chinese national musical instrument, which comprises the following steps:

step 1, collecting playing audio signals of a traditional Chinese national musical instrument through an audio receiving module, and transmitting the audio signals to an audio transcription module in real time;

step 2, by the audio transcription module, taking the musical notes as units, transcribing the playing audio signals into playing MIDI audio digital signals in real time, wherein the data in the playing MIDI audio digital signals comprise: pitch, note duration, note event start time, note event end time, note velocity, and the number of notes in the performance;

and 3, comparing the played MIDI audio digital signal with a pre-made master MIDI audio digital signal in real time, and judging and evaluating the playing effect in real time.

Has the advantages that: compared with the prior art, the invention has the advantages that:

1. the system can accurately and real-timely transcribe the sound generated by playing the traditional Chinese national musical instrument into a universal MIDI audio digital signal, thereby facilitating the transmission and processing of a computer;

2. through the note comparison system, the player can obtain the difference between the played note and the master played note in real time, and objectively and accurately evaluate the playing; the capability of a player for distinguishing the playing strength, the pitch and the note duration is improved;

3. the intelligent terminal is used for displaying the staff in the formats of staff, ancient music score, numbered musical notation, waterfall flow and the like, and the note comparison system is used for assisting, so that the efficiency of acquiring the staff information and performing evaluation by the user is improved;

4. the religion musical instrument person can obtain the person playing the musical instrument of playing the musical instrument more directly perceivedly each item data, lets the religion musical instrument person evaluate the person playing the musical instrument more accurately, gives and guides the suggestion, realizes intelligent teaching.

Drawings

FIG. 1 is a flow chart of a method for using a note comparison system of a traditional Chinese musical instrument;

FIG. 2 is a schematic diagram of a note alignment system of a traditional Chinese musical instrument.

Detailed Description

As shown in FIG. 1, a method for using a note comparison system of a traditional Chinese musical instrument includes the following steps

Step 1, collecting playing audio signals of traditional Chinese national musical instruments such as a guqin or a zither and the like through an audio receiving module, and transmitting the audio signals to an audio transcription module in real time;

step 2, by the audio transcription module, taking the musical notes as units, transcribing the playing audio signals into playing MIDI audio digital signals in real time, wherein the data in the playing MIDI audio digital signals comprise: pitch, note duration, note event start time, note event end time, note velocity, and the number of notes in the performance;

and 3, comparing the played MIDI audio digital signal with a pre-made master MIDI audio digital signal in real time, and judging and evaluating the playing effect in real time.

As shown in fig. 2, the above steps are based on operations performed by using a note comparison system of a traditional chinese national musical instrument, which includes a display screen, an audio receiving module, an audio transcription control module, and an intelligent terminal; the intelligent terminal is respectively connected with the audio transcription control module and the display screen through a signal line or a communication module; displaying a music score corresponding to the performance of a user in real time by taking the musical notes as units on a display screen; the audio transcription control module is connected with the audio receiving module through a signal line or a communication module; audio transcription control module includes audio signal transcription module and MIDI data processing module, and audio receiving module gathers the performance audio signal of traditional chinese national musical instrument, and will audio signal transmits audio transcription module in real time, and audio transcription module uses musical note to be played audio signal real-time transcription for playing MIDI audio digital signal as the unit, and MIDI data processing module plays MIDI audio digital signal and compares in real time with the master MIDI audio digital signal that prepares, carries out real-time judgement and aassessment to playing the effect.

The MIDI data processing module is based on the technology of automatic transcription of polyphonic music and applies the deep learning method of a cyclic neural network and a convolutional neural network.

Wherein, master MIDI audio digital signal source includes: the former performance data recorded by the local user, the other user data transmitted by the network and the MIDI audio digital signal played by the grandmaster piano.

The comparison system comprises an exercise mode and a playing mode, wherein in the exercise mode, notes in the master MIDI audio digital signals are synchronously played in real time, the received playing MIDI audio digital signals are compared with the received notes, and if the difference between the playing notes and the notes in the master MIDI audio digital signals is smaller than an error threshold value, correct playing information is displayed, and the next note in the first MIDI audio digital signals is continuously played; if the error threshold value is larger than the error threshold value, displaying and prompting the information of playing errors, and stopping playing the next note in the master MIDI audio digital signal; and during the playing mode, notes in the master MIDI audio digital signals are continuously played, and after the playing is finished, the played MIDI audio digital signals are compared with the master MIDI audio digital signals, the difference is evaluated, and the score is given to the user for the playing.

The comparison system also comprises an exercise mode and a playing mode, wherein in the exercise mode, notes in the master MIDI audio digital signal are synchronously played in real time, the received playing MIDI audio digital signal is compared with the received playing MIDI audio digital signal, and if the difference between the playing notes and the notes in the master MIDI audio digital signal is less than an error threshold value, correct playing information is displayed, and the next note in the first MIDI audio digital signal is continuously played; if the error threshold value is larger than the error threshold value, displaying and prompting the information of playing errors, and stopping playing the next note in the master MIDI audio digital signal; and during the playing mode, notes in the master MIDI audio digital signals are continuously played, and after the playing is finished, the played MIDI audio digital signals are compared with the master MIDI audio digital signals, the difference is evaluated, and the score is given to the user for the playing.

Wherein the error threshold includes but is not limited to: incorrect pitch, too large force difference, too long note duration, too short note duration.

The user can define the playing time length, the number of playing notes, the playing starting time and the playing ending time by himself.

The transmission method for playing the audio by the contrast system comprises network transmission, digital signal wired transmission and Bluetooth transmission and various modes of transmission.

The intelligent terminal comprises an intelligent tablet, an intelligent mobile phone, an intelligent television and an intelligent projector, and is displayed in multiple modes.

The traditional Chinese national musical instruments referred to in the application include guqin and zither. In the case of a guqin, the tones of the current performance are transcribed into MIDI signals which can be processed by a computer in real time through the above steps, and the MIDI signals are transmitted to an intelligent terminal for real-time comparison and evaluation.

The intelligent terminal stores the master MIDI signal in advance, and the master MIDI signal is the template played in the section. The intelligent terminal compares the MIDI playing signal with the MIDI master signal in real time, and if there is a difference of rhythm, intonation, force and the like, the difference is recorded. And if the difference is larger than the error threshold value, defining the difference as a playing error, displaying the error on a screen in real time, and reminding the user of the error in real time during playing, wherein the error needs to be stopped and corrected.

The real-time comparison process displays the music score on a screen in a form of following the music score in real time, namely where the music score is flicked and where the music score cursor moves; the same score may be presented in the form of a piano waterfall, i.e., where to bounce and where to fall.

After the performance is finished, the errors of the performance are collected, an evaluation report of the performance is generated and displayed on a screen, and the evaluation report is used for evaluating indexes such as accuracy and proficiency of the performance, so that the player can accurately recognize the performance level of the player.