阅读说明：本技术 一种钢琴弹奏的教学辅助系统 (Teaching auxiliary system for piano playing ) 是由 赵妍 郑清 李媛 于 2020-05-18 设计创作，主要内容包括：本发明涉及一种钢琴弹奏的教学辅助系统。将电子结构安装到机械钢琴上,避免了现有的数字钢琴或者电子钢琴其本身的手感不适或者声音不真实的问题；其次使用电容的力度采集方式,采集时对于手感的影响降至最低；使用力度采集和音频采集双采集模式,采集力度时多线程处理,提高采集速度,降低采集延迟,且可以将力度和响度同时对比,避免了钢琴不同键位区声音对于力度的响应的非线性问题。标准电子乐谱可以随意编辑,增强了系统对于不同阶段练习者的适应性。此外,本系统的设备都不影响机械钢琴本身的结构,音频采集器和力度感应器都可以安装在普通的机械钢琴上,经济性更强。(The invention relates to a teaching auxiliary system for piano playing. The electronic structure is arranged on the mechanical piano, so that the problems of uncomfortable hand feeling or unreal sound of the conventional digital piano or electronic piano are solved; secondly, a strength acquisition mode of capacitance is used, and the influence on hand feeling during acquisition is reduced to the minimum; by using the dual acquisition mode of force acquisition and audio acquisition, multithreading processing is performed during force acquisition, the acquisition speed is improved, the acquisition delay is reduced, the force and the loudness can be simultaneously compared, and the problem of nonlinearity of response of sounds of different key position areas of the piano to the force is avoided. The standard electronic music score can be edited at will, so that the adaptability of the system to trainees in different stages is enhanced. In addition, the equipment of the system does not influence the structure of the mechanical piano, the audio collector and the force sensor can be arranged on the common mechanical piano, and the economical efficiency is higher.)

1. A teaching auxiliary system for piano playing comprises a main control module, a mechanical piano, a force sensor, an audio collector, an audio player, a comparison processor, a display, a memory and an input device; the method is characterized in that:

the main control module is connected with the force sensor, the audio collector, the audio player, the comparison processor, the display, the memory and the input equipment;

the main control module collects force signals and audio signals collected by the force sensor and the audio collector at the same time, converts the force signals and the audio signals into a played electronic music score, and the comparison processor compares the played electronic music score with a standard electronic music score stored in the memory; the main controller displays the comparison result on a display.

2. A teaching assistance system for piano playing according to claim 1, wherein:

the mechanical piano is a common upright piano or grand piano and is provided with keys (1) and a soundboard; the force sensor is arranged below the keys (1), can collect the time, the release time and the force of each key (1) when being pressed down, and sends the codes, the pressing time, the release time and the force of the keys (1) to the main control module; the audio collector is arranged on a soundboard of the mechanical piano, can collect the sound emitted by the mechanical piano, converts the sound into a digital signal and sends the digital signal to the main control module; the audio player comprises a loudspeaker and is used for playing the audio files stored in the memory under the control of the main control module;

the input device comprises an input keyboard which is used for inputting control signals into the main control module and realizing the control of software in the main control module.

3. A teaching assistance system for piano playing according to claim 2, wherein:

each key (1) is provided with a force sensor, and each force sensor comprises a first capacitive sensor (4), a second capacitive sensor (5) and a signal processor (3); the mechanical piano comprises keys (1) and a support bottom plate (2) for mounting the keys (1), the first capacitive sensor (4) comprises two electrode plates which are respectively arranged on the lower side of the key (1) close to the root of the key (1) and the support bottom plate (2) at the corresponding position of the key, and the second capacitive sensor (5) comprises two electrode plates which are respectively arranged on the lower side of the key (1) close to the head of the key (1) and the support bottom plate (2) at the corresponding position of the key; when the key (1) is pressed, the distance between the two electrode plates of the first capacitive sensor (4) changes, so that the capacitance value of the first capacitive sensor (4) changes, the capacitance value of the second capacitive sensor (5) also changes, and the capacitance change of the second capacitive sensor (5) is larger than the change of the first capacitive sensor (4); the signal processor (3) acquires a capacitance curve of the first capacitance sensor (4) and a capacitance curve of the second capacitance sensor (5);

when the capacitance values of the first capacitance sensor (4) and the second capacitance sensor (5) are changed, the signal processor (3) records the moment when the capacitance value of the first capacitance sensor (4) enters a certain threshold range as the moment when the key (1) is pressed down, and records the moment when the capacitance value of the first capacitance sensor (4) leaves the certain threshold range as the moment when the key (1) is released; the signal processor (3) records the derivative of a second capacitance value change curve corresponding to the pressing moment of the key (1) as the pressing force;

the first capacitive sensor (4) and the second capacitive sensor (5) work in parallel, and the signal processor (3) processes the analysis of the first capacitive sensor (4) and the second capacitive sensor (5) in parallel.

4. A teaching assistance system for piano playing according to claim 2, wherein:

the audio collector collects the sound emitted by the soundboard and converts the sound into an audio digital signal; the main controller module collects and analyzes the audio digital signals, and time alignment is carried out on the audio digital signals and the data sent by the force sensor; then, the main control module carries out Fourier transformation on the audio digital signals within the time period from the moment that each key (1) is pressed to the moment that the key (1) is released; screening out a frequency range corresponding to the sound of the pressed key (1) from the frequency spectrum signals after Fourier transform, and calculating the loudness of the frequency range; the key code N is obtained at the moment, the moment T1 when the key (1) is pressed down, the moment T2 when the key (1) is released, the force F when the key (1) is pressed down and the loudness I of the corresponding audio digital signal are generated;

the main controller acquires the above N, T1, T2, F, I of each key (1); then, obtaining a played electronic music score according to N, T1, T2 and F, I, and displaying the played electronic music score on a display; playing the electronic music score by taking time as a horizontal axis and then taking the codes N of the keys as a vertical axis, wherein each key code corresponds to the range of the vertical axis, so that the time period from the key (1) being pressed to the key being released can be displayed as a small rectangle in the playing electronic music score; expressing the loudness I by using a gray value of a small rectangle; and the force F is represented numerically on a small rectangle.

5. A teaching assistance system for piano playing according to claim 4, wherein:

the memory stores standard electronic music scores which also comprise N, T1, T2 and F, I, the comparison processor compares the played electronic music scores with the standard electronic music scores, then compares N, T1, T2 and F, I generated in the played electronic music scores and the standard electronic music scores in sequence along a time axis, after the music is finished, the comparison result is displayed on the display, and a plurality of positions with the largest difference between the played electronic music scores and the standard electronic music scores are marked by red.

6. A teaching assistance system for piano playing according to claim 5, wherein:

the standard electronic music score is obtained by recording the electronic music score generated when a performer performs.

7. A teaching assistance system for piano playing according to claim 5, wherein:

the standard electronic score is obtained by inputting values of each group N, T1, T2, F, I through an input device in an editing mode of the teaching assistance system.

8. A teaching assistance system for piano playing according to claim 5, wherein:

the standard electronic score is obtained by recording the played electronic score generated when a player plays, and adjusting the value of each group N, T1, T2 and F, I by the input device in the editing mode of the teaching auxiliary system.

9. A teaching assistance system for piano playing according to any one of claims 1-8, wherein:

the audio player is used to play the accompaniment or metronome born sound of other musical instruments stored in the memory.

10. A teaching assistance system for piano playing according to any one of claims 1-8, wherein:

the instructional system includes a plurality of usage patterns: an editing mode, a playing mode and an exercise mode;

when the music book is in an editing mode, the standard electronic music book can be added, deleted and modified into the memory through the main control module by the input equipment;

when the music playing device is in a playing mode, the main control module plays the accompaniment in the memory, the playing of music can be realized through the playing mechanical piano, the audio collector collects the audio at the moment and sends the audio to the main controller, the main controller subtracts the collected audio signal and the audio signal of the played accompaniment, and then the audio signal obtained after subtraction is stored in the memory to realize recording;

in the practice mode, a part of the standard electronic music score can be selected through the input device, the time axis of the selected part is subjected to time scaling adjustment, namely the music score can be continuously practiced at different speeds, and the performance electronic music score generated by practice can be compared with the standard electronic music score, and the comparison result is displayed on the display.

Technical Field

The invention relates to the field of musical instruments, in particular to a teaching auxiliary system for piano playing.

Background

A piano (italian: pianoforte) is a keyboard instrument in western classical music, and has a name of "king of instrument". With the development of material culture, more and more people start learning pianos. However, since the learning of the piano involves many factors such as intonation, dynamics, emotion and rhythm, after the player plays, if no professional teacher monitors, it may be difficult for the ordinary people to find the defects, which affects the improvement of the player level.

CN104766505A discloses an intelligent teaching piano and a piano teaching method. The learner can learn progressively through the teaching information (pictures, videos, audios and the like) stored in the recording unit, the learning rhythm is mastered by the learner, another lesson is learned after one lesson is learned, and meanwhile, the learner can look over the learning record through the recording unit, check the accuracy in time and improve the enthusiasm and the efficiency of learning. But the midi signals used by the method have less recorded information, and the recording of details is insufficient, so that the method is difficult to guide a high-level user;

CN108364528A discloses a system and method for correcting piano playing note, wherein, in the course of practicing playing, a trainee can immediately pick up playing sound through a sound pick-up device and convert the sound into digital signals, meanwhile, the sound digital signals and the note digital signals are compared in similarity, so as to greatly improve the accuracy of identification, the comparison result is marked on the note of the practice playing music in real time through a music display module, so that the trainee can know the playing situation, and can timely find the note with poor control, so that the training process has pertinence, and the trainee can also practice by himself without the help of a guiding teacher. But only compares the audio signals of the notes, and it is known that the processing of the audio signals requires a lot of computing power, and furthermore, the loudness and the strength of the control keys are very important details when playing on a piano, and needs to be strengthened in this respect. The strength collection in the prior art is generally carried out on an electronic piano, but the hand feeling of the electronic piano is different from that of a mechanical piano, the sound emitting mode of the electronic piano is greatly different from that of a real mechanical piano, the electronic piano is not very suitable for high-level players, and in addition, the purchase of a set of electronic piano equipment is also a waste for families which purchase pianos at home.

Disclosure of Invention

Aiming at the content, in order to solve the problems, the teaching auxiliary system for piano playing is provided, which comprises a main control module, a mechanical piano, a force sensor, an audio collector, an audio player, a comparison processor, a display, a memory and an input device;

the main control module is connected with the force sensor, the audio collector, the audio player, the comparison processor, the display, the memory and the input equipment;

the main control module collects force signals and audio signals collected by the force sensor and the audio collector at the same time, converts the force signals and the audio signals into a played electronic music score, and the comparison processor compares the played electronic music score with a standard electronic music score stored in the memory; the main controller displays the comparison result on a display.

The mechanical piano is a common upright piano or grand piano and is provided with keys and a soundboard; the force sensor is arranged below the keys, can collect the time, the release time and the force of each key when being pressed, and sends the codes, the pressing time, the release time and the force of the keys to the main control module; the audio collector is arranged on a soundboard of the mechanical piano, can collect the sound emitted by the mechanical piano, converts the sound into a digital signal and sends the digital signal to the main control module; the audio player comprises a loudspeaker and is used for playing the audio files stored in the memory under the control of the main control module;

the input device comprises an input keyboard which is used for inputting control signals into the main control module and realizing the control of software in the main control module.

Each key is provided with a force sensor, and each force sensor comprises a first capacitive sensor, a second capacitive sensor and a signal processor; the mechanical piano comprises keys and a support bottom plate for mounting the keys, the first capacitive sensor comprises two electrode plates which are respectively arranged on the lower sides of the keys close to the roots of the keys and the support bottom plate at the corresponding positions of the keys, and the second capacitive sensor comprises two electrode plates which are respectively arranged on the lower sides of the keys close to the heads of the keys and the support bottom plate at the corresponding positions of the keys; when the key is pressed, the distance between the two electrode plates of the first capacitive sensor changes, so that the capacitance value of the first capacitive sensor changes, meanwhile, the capacitance value of the second capacitive sensor also changes, and the capacitance change of the second capacitive sensor is larger than that of the first capacitive sensor; the signal processor acquires a capacitance curve of the first capacitive sensor and a capacitance curve of the second capacitive sensor;

when the capacitance values of the first capacitive sensor and the second capacitive sensor change, the moment when the capacitance value of the first capacitive sensor enters a certain threshold value range is recorded as the moment when the key is pressed down by the signal processor, and the moment when the capacitance value of the first capacitive sensor leaves the certain threshold value range is recorded as the moment when the key is released by the signal processor; the signal processor records the derivative of a second capacitance value change curve corresponding to the key pressing time as the pressing force;

the first capacitive sensor and the second capacitive sensor operate in parallel, and the signal processor processes the analysis of the first capacitive sensor and the second capacitive sensor in parallel.

The audio collector collects the sound emitted by the soundboard and converts the sound into an audio digital signal; the main controller module collects and analyzes the audio digital signals, and time alignment is carried out on the audio digital signals and the data sent by the force sensor; then the main control module performs Fourier transformation on the audio digital signals within a time period from the moment that each key is pressed to the moment that the key is released; screening out a frequency range corresponding to the sound of the pressed key from the frequency spectrum signals after Fourier transform, and calculating the loudness of the frequency range; at the moment, the code N of the key is obtained, the time T1 when the key is pressed, the time T2 when the key is released, the force F when the key is pressed and the loudness I of the corresponding audio digital signal are obtained;

the main controller acquires the above N, T1, T2, F, I for each key; then, obtaining a played electronic music score according to N, T1, T2 and F, I, and displaying the played electronic music score on a display; playing the electronic music score by taking time as a horizontal axis and then taking the codes N of the keys as a vertical axis, wherein each key code corresponds to the range of the vertical axis, so that the time period from the key depression to the release of the key can be displayed as a small rectangle in the playing electronic music score; expressing the loudness I by using a gray value of a small rectangle; and the force F is represented numerically on a small rectangle.

The memory stores standard electronic music scores which also comprise N, T1, T2 and F, I, the comparison processor compares the played electronic music scores with the standard electronic music scores, then compares N, T1, T2 and F, I generated in the played electronic music scores and the standard electronic music scores in sequence along a time axis, after the music is finished, the comparison result is displayed on the display, and a plurality of positions with the largest difference between the played electronic music scores and the standard electronic music scores are marked by red.

The standard electronic music score is obtained by recording the electronic music score generated when a performer performs.

The standard electronic score is obtained by inputting values of each group N, T1, T2, F, I through an input device in an editing mode of the teaching assistance system.

The standard electronic score is obtained by recording the played electronic score generated when a player plays, and adjusting the value of each group N, T1, T2 and F, I by the input device in the editing mode of the teaching auxiliary system.

The audio player is used to play the accompaniment or metronome born sound of other musical instruments stored in the memory.

The instructional system includes a plurality of usage patterns: an editing mode, a playing mode and an exercise mode;

when the music book is in an editing mode, the standard electronic music book can be added, deleted and modified into the memory through the main control module by the input equipment;

when the music playing device is in a playing mode, the main control module plays the accompaniment in the memory, the playing of music can be realized through the playing mechanical piano, the audio collector collects the audio at the moment and sends the audio to the main controller, the main controller subtracts the collected audio signal and the audio signal of the played accompaniment, and then the audio signal obtained after subtraction is stored in the memory to realize recording;

in the practice mode, a part of the standard electronic music score can be selected through the input device, the time axis of the selected part is subjected to time scaling adjustment, namely the music score can be continuously practiced at different speeds, and the performance electronic music score generated by practice can be compared with the standard electronic music score, and the comparison result is displayed on the display.

The electronic structure is arranged on the mechanical piano, so that the problems of uncomfortable hand feeling or unreal sound of the conventional digital piano or electronic piano are solved; secondly, a strength acquisition mode of capacitance is used, and the influence on hand feeling during acquisition is reduced to the minimum; by using the dual acquisition mode of force acquisition and audio acquisition, multithreading processing is performed during force acquisition, the acquisition speed is improved, the acquisition delay is reduced, the force and the loudness can be simultaneously compared, and the problem of nonlinearity of response of sounds of different key position areas of the piano to the force is avoided. The standard electronic music score can be edited at will, so that the adaptability of the system to trainees in different stages is enhanced. In addition, the equipment of the system does not influence the structure of the mechanical piano, the audio collector and the force sensor can be arranged on the common mechanical piano, and the economical efficiency is higher.

Drawings

The accompanying drawings, which are included to provide a further understanding of the disclosed subject matter, are incorporated in and constitute a part of this specification. The drawings illustrate the implementations of the disclosed subject matter and, together with the detailed description, serve to explain the principles of implementations of the disclosed subject matter. No attempt is made to show structural details of the disclosed subject matter in more detail than is necessary for a fundamental understanding of the disclosed subject matter and various modes of practicing the same.

FIG. 1 is a schematic view of the overall structure of the present invention;

fig. 2 is a schematic view of a key structure of the present invention;

fig. 3 is a schematic diagram of the appearance of the music score of the present invention.

Detailed Description

The advantages, features and methods of accomplishing the same will become apparent from the drawings and the detailed description that follows.