阅读说明：本技术 适用于多人k歌的音频同步方法、装置及存储介质 (Audio synchronization method, device and storage medium suitable for multiple K songs ) 是由 牛继华 魏耀都 陈华 于 2021-07-08 设计创作，主要内容包括：本发明提供一种适用于多人K歌的音频同步方法、装置及存储介质,在执行本方法的步骤前,预先设置多组扬声器和麦克风,每一组扬声器和麦克风对应一个歌唱人员,包括以下步骤：通过多个扬声器对多个歌唱人员同步播放伴奏信息；每个麦克风获取音频生成第一音频信息；将每个麦克风得到的第一音频信息发送至其他麦克风形成其他麦克风的第二音频信息；每个麦克风将采集的第一音频信息、接收到的第二音频信息以及伴奏信息进行混音处理后得到播放音频通过对应的扬声器播放。本发明提供的技术方案,能够在多个人进行K歌时通过扬声器同时播放伴奏和每个人的歌声,使得每个人基于扬声器听到的音频是多个人合唱的歌声,实用性较强。(The invention provides an audio synchronization method, a device and a storage medium suitable for multiple K songs, wherein a plurality of groups of loudspeakers and microphones are preset before the steps of the method are executed, each group of loudspeakers and microphones corresponds to a singer, and the method comprises the following steps: synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers; each microphone acquires audio to generate first audio information; sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones; and each microphone performs sound mixing processing on the collected first audio information, the received second audio information and the accompaniment information to obtain playing audio to be played through a corresponding loudspeaker. According to the technical scheme provided by the invention, the accompaniment and the singing voice of each person can be played simultaneously through the loudspeaker when a plurality of persons carry out the K song, so that the audio heard by each person based on the loudspeaker is the singing voice of the plurality of persons, and the practicability is high.)

1. A audio synchronization method suitable for multiple K songs is characterized in that a plurality of groups of loudspeakers and microphones are preset before the steps of the method are executed, each group of loudspeakers and microphone corresponds to a singing person, and the method comprises the following steps:

synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers;

each microphone acquires audio to generate first audio information;

sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones;

and each microphone performs sound mixing processing on the collected first audio information, the received second audio information and the accompaniment information to obtain playing audio to be played through a corresponding loudspeaker.

2. The audio synchronization method for multiple Karaoke as claimed in claim 1,

each microphone plays the collected first audio information, the received second audio information and the accompaniment information through a corresponding loudspeaker after carrying out sound mixing processing, and the sound mixing processing comprises the following steps:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

3. The audio synchronization method for multiple Karaoke as claimed in claim 1,

each microphone carries out sound mixing processing on the collected first audio information, the received second audio information and the accompaniment information to obtain playing audio, and the playing audio is played through a corresponding loudspeaker, wherein the playing audio comprises the following steps:

presetting maximum delay time;

acquiring the transmission delay of the currently received second audio information, and comparing the transmission delay with the maximum delay time;

and if the transmission delay is greater than the maximum delay time, playing the received second audio information after the maximum delay time.

4. The audio synchronization method for multiple Karaoke as claimed in claim 1,

the step of sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones comprises the following steps:

acquiring an adjusting function, wherein the adjusting function is used for adjusting second audio information between any two groups of loudspeakers and microphones;

and adjusting the second audio information received at the current moment based on the adjusting function to obtain the adjusted second audio information.

5. The audio synchronization method for multiple Karaoke as claimed in claim 4,

the obtaining an adjustment function includes:

any loudspeaker plays a white noise signal;

other groups of microphones record white noise signals;

performing cross-correlation calculation and low-pass filtering on the recorded white noise signal and the played white noise signal to obtain a transfer function between any two groups of equipment;

and the initial amplitude adjustment coefficient of the second audio information after passing through the transfer function is 1.

6. The audio synchronization method for multiple Karaoke as claimed in claim 5,

adjusting the initial amplitude adjustment coefficient by the following steps of:

acquiring distance information between any two groups of equipment based on the acoustic feedback information, wherein the distance information comprises a previous time distance and a current time distance;

calculating an amplitude adjustment factor by the following formula, including:

where A is the previous time distance and B is the previous time distance.

7. The audio synchronization method for multiple Karaoke as claimed in claim 1,

each microphone acquiring audio to generate first audio information comprises:

receiving the audio characteristics corresponding to each microphone;

and extracting audio information corresponding to the audio features in the audio as first audio information.

8. The utility model provides an audio synchronizer suitable for many people K song sets up multiunit speaker and microphone in advance, and each group's speaker and microphone correspond a singing personnel, its characterized in that includes:

the synchronous playing module is used for synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers;

the generating module is used for enabling each microphone to acquire audio to generate first audio information;

the sending module is used for sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones;

and the sound mixing module is used for carrying out sound mixing processing on the first audio information, the received second audio information and the accompaniment information which are collected by each microphone to obtain playing audio and playing the playing audio through the corresponding loudspeaker.

9. The audio synchronizer for multiple Karaoke as claimed in claim 8,

the mixing module is further configured to perform the following steps, including:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

10. A readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the method of any one of claims 1 to 7.

Technical Field

The invention relates to the technical field of audio data transmission, in particular to an audio synchronization method, an audio synchronization device and a storage medium suitable for multiple K songs.

Background

With the rapid development of science and technology and music culture, the way of singing (singing) is more and more diversified. The mode of carrying out K song based on mobile terminal has the advantage of convenience, easy operation, and is most favored by everyone. In the process of singing K, there may be situations where multiple people chorus. In the prior art, the chorus audio is synchronized in the following ways, including:

1) mobile terminal + true wireless headset:

the mobile terminal is connected with the two earphones through a Bluetooth protocol, the mobile terminal is connected with one earphone through the Bluetooth protocol, and the earphone is connected with the other earphone through the Bluetooth protocol. After both earphones receive the music content to be played currently, the two earphones synchronously play the music to be played currently.

2) Two mobile terminals:

the method comprises the steps that data connection is established between two mobile terminals, audio to be played is transmitted between the two mobile terminals through the data connection, and after the two mobile terminals both have the content to be played, the two mobile terminals synchronously play music to be played.

In the above 2 karaoke and chorus modes, the audio and music contents of the accompaniment are played to a plurality of singers, but the singing voices among different persons cannot be fed back and returned mutually, so that the practicability is poor.

Disclosure of Invention

The embodiment of the invention provides an audio synchronization method, device and storage medium suitable for multiple people K singing, which can play accompaniment and singing voice of each person simultaneously through a loudspeaker when multiple people carry out K singing, so that the audio heard by each person based on the loudspeaker is the singing voice of multiple people, and the practicability is high.

In a first aspect of the embodiments of the present invention, an audio synchronization method applicable to multiple K songs is provided, where before the steps of the method are performed, multiple sets of speakers and microphones are preset, and each set of speaker and microphone corresponds to a singing person, including:

synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers;

each microphone acquires audio to generate first audio information;

sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones;

and each microphone performs sound mixing processing on the collected first audio information, the received second audio information and the accompaniment information to obtain playing audio to be played through a corresponding loudspeaker.

Optionally, in a possible implementation manner of the first aspect, each of the microphones playing the collected first audio information, the received second audio information, and the accompaniment information through a corresponding speaker after performing audio mixing processing includes:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

Optionally, in a possible implementation manner of the first aspect, each of the microphones performs mixing processing on the collected first audio information, the received second audio information, and the accompaniment information to obtain a playing audio, and the playing audio is played through a corresponding speaker, where the mixing processing includes:

presetting maximum delay time;

acquiring the transmission delay of the currently received second audio information, and comparing the transmission delay with the maximum delay time;

and if the transmission delay is greater than the maximum delay time, playing the received second audio information after the maximum delay time.

Optionally, in a possible implementation manner of the first aspect, sending the first audio information obtained by each microphone to other microphones to form second audio information of the other microphones includes:

acquiring an adjusting function, wherein the adjusting function is used for adjusting second audio information between any two groups of loudspeakers and microphones;

and adjusting the second audio information received at the current moment based on the adjusting function to obtain the adjusted second audio information.

Optionally, in a possible implementation manner of the first aspect, the obtaining an adjustment function includes:

any loudspeaker plays a white noise signal;

other groups of microphones record white noise signals;

performing cross-correlation calculation and low-pass filtering on the recorded white noise signal and the played white noise signal to obtain a transfer function between any two groups of equipment;

and the initial amplitude adjustment coefficient of the second audio information after passing through the transfer function is 1.

Optionally, in a possible implementation manner of the first aspect, the adjusting the initial amplitude adjustment coefficient by the following steps includes:

acquiring distance information between any two groups of equipment based on the acoustic feedback information, wherein the distance information comprises a previous time distance and a current time distance;

calculating an amplitude adjustment factor by the following formula, including:

where A is the previous time distance and B is the previous time distance.

Optionally, in one possible implementation manner of the first aspect, the acquiring audio by each microphone generates first audio information including:

receiving the audio characteristics corresponding to each microphone;

and extracting audio information corresponding to the audio features in the audio as first audio information.

In a second aspect of the embodiments of the present invention, an audio synchronization apparatus suitable for multiple K songs is provided, in which multiple sets of speakers and microphones are preset, and each set of speaker and microphone corresponds to a singer, including:

the synchronous playing module is used for synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers;

the generating module is used for enabling each microphone to acquire audio to generate first audio information;

the sending module is used for sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones;

and the sound mixing module is used for carrying out sound mixing processing on the first audio information, the received second audio information and the accompaniment information which are collected by each microphone to obtain playing audio and playing the playing audio through the corresponding loudspeaker.

Optionally, in a possible implementation manner of the second aspect, the mixing module is further configured to perform the following steps, including:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

Optionally, in a possible implementation manner of the second aspect, the mixing module is further configured to perform the following steps, including:

presetting maximum delay time;

acquiring the transmission delay of the currently received second audio information, and comparing the transmission delay with the maximum delay time;

and if the transmission delay is greater than the maximum delay time, playing the received second audio information after the maximum delay time.

Optionally, in a possible implementation manner of the second aspect, the generating module is further configured to perform the following steps, including:

receiving the audio characteristics corresponding to each microphone;

and extracting audio information corresponding to the audio features in the audio as first audio information.

In a third aspect of the embodiments of the present invention, a readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, is adapted to carry out the method according to the first aspect of the present invention and various possible designs of the first aspect of the present invention.

The audio synchronization method, the device and the storage medium suitable for the multiple K songs provided by the invention can acquire the respective voices through the corresponding microphone of each person when the multiple persons perform the K songs, then send the respective voices to the microphones of other persons, and finally mix the voices of all persons with the accompaniment to obtain the played audio, thereby achieving the purpose and the effect of simultaneously playing the K songs and chorusing by the multiple persons. In the process of sending the voices to each other, the voice data can be detected, the phenomenon that echo occurs when packet loss occurs is avoided, and the stability of the technical scheme provided by the invention is guaranteed.

Drawings

FIG. 1 is a flow chart of a first embodiment of an audio synchronization method for multiple songs K;

FIG. 2 is a diagram illustrating an embodiment of voice information and data transmission according to the present invention;

FIG. 3 is a schematic diagram of a measurement phase of an acoustic feedback loop characteristic;

FIG. 4 is a schematic diagram of a tracking phase of an acoustic feedback loop feature;

fig. 5 is a structural diagram of a first embodiment of an audio synchronizer suitable for multiple songs K.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.

It should be understood that, in various embodiments of the present invention, the sequence numbers of the processes do not mean the execution sequence, and the execution sequence of the processes should be determined by the functions and the internal logic of the processes, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

It should be understood that in the present application, "comprising" and "having" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

It should be understood that, in the present invention, "a plurality" means two or more. "and/or" is merely an association describing an associated object, meaning that three relationships may exist, for example, and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "comprises A, B and C" and "comprises A, B, C" means that all three of A, B, C comprise, "comprises A, B or C" means that one of A, B, C comprises, "comprises A, B and/or C" means that any 1 or any 2 or 3 of A, B, C comprises.

It should be understood that in the present invention, "B corresponding to a", "a corresponds to B", or "B corresponds to a" means that B is associated with a, and B can be determined from a. Determining B from a does not mean determining B from a alone, but may be determined from a and/or other information. And the matching of A and B means that the similarity of A and B is greater than or equal to a preset threshold value.

As used herein, "if" may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context.

The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

The invention provides an audio synchronization method suitable for multiple K songs, which is characterized in that a plurality of groups of loudspeakers and microphones are preset before the steps of the method are executed, and each group of loudspeakers and microphone corresponds to a singer.

In one possible implementation, a plurality of mobile terminals are included, each mobile terminal is respectively provided with a set of loudspeaker and microphone, and each singer can hold one mobile terminal to perform karaoke simultaneously.

In a possible implementation, including 1 mobile terminal, this 1 mobile terminal is connected with a plurality of integrative earphones, bluetooth headset etc. and every integrative earphone, bluetooth headset correspond a singing personnel, realizes that a plurality of singing personnel carry out the K song simultaneously through 1 mobile terminal and a plurality of integrative earphones, bluetooth headset.

As shown in the flow chart of fig. 1, the present invention comprises the following steps:

step S110, playing accompaniment information synchronously for a plurality of singers through a plurality of loudspeakers. In the process of synchronously playing the accompaniment information, the speakers can be controlled simultaneously on the basis of one terminal, or the speakers can be controlled respectively on the basis of a plurality of terminals.

And step S120, each microphone acquires audio to generate first audio information. Since each microphone is located closer to the person holding it, it is easier to acquire the voice of the corresponding person, and the voice of the corresponding person is predominant in the first audio information.

And step S130, sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones. In the case where a plurality of singers sing at the same time, it is necessary to transmit the singing voice of each singer to other microphones to form the second audio information.

Step S140, each microphone performs audio mixing processing on the collected first audio information, the received second audio information, and the accompaniment information to obtain a playing audio, and the playing audio is played through a corresponding speaker. After each microphone obtains the singing voice collected by other microphones, the singing voice and the accompaniment information of all the singing personnel are processed to obtain the playing audio which is the chorus audio, and the chorus audio is played through each loudspeaker so that each singing personnel can hear the chorus singing voice.

In a possible embodiment, as shown in fig. 2, a schematic diagram of voice information and data transmission for 2 singing users to sing simultaneously is shown, where the schematic diagram includes a singing user a and a singing user B, and a group of microphones and speakers are respectively disposed at the singing user a and the singing user B, where the terminals at this time may be 2 terminals or 1 terminal, that is, the terminals a and B in the diagram may be the same or different. The method comprises the steps of acquiring corresponding voices through a microphone respectively, carrying out recording caching to obtain first audio information, caching the first audio information after obtaining the first audio information, sending the first audio information to other terminals, meanwhile, caching to receive second audio information sent by other terminals, introducing packet loss hiding (error hiding) processing when a packet loss condition occurs, and predicting lost packets. And carrying out sound mixing and sound feedback inhibition processing on the first audio information, the second audio information and the accompaniment information according to the condition of packet loss concealment to obtain played audio.

Furthermore, each microphone mixes the collected first audio information, the received second audio information and the accompaniment information and then plays the audio information through a corresponding loudspeaker, and the method comprises the following steps:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

In one possible embodiment, as shown in fig. 3, the mobile terminal is configured in advance, and when the loudspeaking/karaoke is not performed, the mobile terminal needs to be configured first, and the loudspeaking of the mobile terminal does not play singing voice or music. Firstly, a mobile terminal loudspeaker is used for actively playing various sound feedback detection signals, a mobile terminal microphone is used for recording the signals, and echo power, frequency response and environment sound mixing impulse response are obtained through analysis and calculation. And storing the obtained calculation result as the acoustic feedback loop characteristic, and carrying out acoustic feedback suppression processing on the played audio according to the acoustic feedback loop characteristic.

In a possible implementation manner, as shown in fig. 4, during the process of loudspeaking/singing, the environment of the mobile terminal may change, the present invention can further change the characteristics of the acoustic feedback loop according to the change of the environment of the mobile terminal, so that the mobile terminal can automatically adapt to the change of the environment and change the characteristics of the acoustic feedback loop, that is, when the environment information and the position information of the mobile terminal change, wherein the environment information and the position information include the attitude, the position and the moving speed of the mobile terminal, the echo power, the frequency response and the impulse response of the environment mixing sound are changed based on the environment information and the position information.

Further, step S140 includes:

the maximum delay time is set in advance. In the actual karaoke process, the sound discrimination of the human ears is temporal, if the interval between two sounds is short enough, the same sound is heard by the human ears, so the maximum delay time set in the method can be obtained according to the sound discrimination interval of the human ears.

And acquiring the transmission delay of the currently received second audio information, and comparing the transmission delay with the maximum delay time. By comparing the transmission delay of the second audio information sent by the microphones of the user with the maximum delay, whether the Karaoke and the chorus are not synchronous can be judged.

And if the transmission delay is greater than the maximum delay time, playing the received second audio information after the maximum delay time. When the transmission delay is larger than the maximum delay time, the chorus asynchronism may occur at the moment, so that the received second audio information sent by other microphones is played first, and the situations of karaoke and chorus asynchronism are avoided.

Further, the sending the first audio information obtained by each microphone to other microphones to form second audio information of the other microphones includes:

acquiring an adjusting function, wherein the adjusting function is used for adjusting second audio information between any two groups of loudspeakers and microphones;

and adjusting the second audio information received at the current moment based on the adjusting function to obtain the adjusted second audio information. And after the second audio information is adjusted, performing acoustic enhancement processing, respectively performing acoustic feedback inhibition processing on the first audio information, all the second audio information and the accompaniment, and finally enhancing the sound amplification effect and playing the sound.

Further, the obtaining the adjustment function includes:

any loudspeaker plays a white noise signal;

other groups of microphones record white noise signals;

performing cross-correlation calculation and low-pass filtering on the recorded white noise signal and the played white noise signal to obtain a transfer function between any two groups of equipment;

and the initial amplitude adjustment coefficient of the second audio information after passing through the transfer function is 1.

Further, the adjusting of the initial amplitude adjustment coefficient by the following steps includes:

and acquiring distance information between any two groups of equipment based on the acoustic feedback information, wherein the distance information comprises a previous time distance and a current time distance. Wherein the acoustic feedback information may be the acoustic feedback loop characteristics described above. The acoustic feedback information may also be obtained by processing characteristics of the acoustic feedback loop, and because the characteristics of the acoustic feedback loop include environmental changes and changes in influence between different terminals, the characteristics of the acoustic feedback loop may also be obtained by removing environmental changes and only preserving changes in influence between different terminals.

Calculating an amplitude adjustment factor by the following formula, including:

where A is the previous time distance and B is the previous time distance.

According to the technical scheme provided by the invention, the change of the distance between the terminals can be calculated according to the position information change relation in the acoustic feedback information, and the amplitude adjustment coefficient after passing through the transfer function is adjusted. The distance between the terminals is shortened, the amplitude is increased, the distance between the terminals is lengthened, and the amplitude is decreased. Further, step S120 includes:

and receiving the audio characteristics corresponding to each microphone. The audio feature may be a tone color, and since the tone color of each person is different, the attribution of the audio may be distinguished according to the tone color.

And extracting audio information corresponding to the audio features in the audio as first audio information. For example, if the singing user corresponds to the microphone a, the singing voice (audio information) recorded by the microphone a during the singing process is processed, and the first audio information with the corresponding tone color characteristic of a in the audio information is extracted, wherein the first audio information is defaulted as the singing voice of the singing user with the microphone.

The synchronization process provided by the invention at least comprises the following characteristics:

1) each terminal downloads the accompaniment respectively, and only the start time of the synchronous playing is carried out during the playing.

2) After the current terminal collects the sound, the collected sound is directly sent to other terminals so as to shorten the delay time.

3) When the current terminal receives the sound sent by other terminals, a maximum delay time is set, and the time is used as a judgment threshold for transmission packet loss, namely all data with the transmission delay larger than the threshold are considered to be packet loss. The current terminal starts playing the received voice after waiting for the time, and when data is lost, packet loss hiding (error hiding) processing is introduced to predict the lost packet.

4) When the sound of other terminals received by the current terminal is played at the current terminal, the sound effect is controlled by the current terminal.

The invention also provides an audio synchronizer suitable for multiple people singing with karaoke, which is preset with a plurality of groups of speakers and microphones, each group of speakers and microphone corresponds to a singing person, and the structure schematic diagram shown in fig. 5 comprises:

the synchronous playing module is used for synchronously playing accompaniment information for a plurality of singers through a plurality of loudspeakers;

the generating module is used for enabling each microphone to acquire audio to generate first audio information;

the sending module is used for sending the first audio information obtained by each microphone to other microphones to form second audio information of other microphones;

and the sound mixing module is used for carrying out sound mixing processing on the first audio information, the received second audio information and the accompaniment information which are collected by each microphone to obtain playing audio and playing the playing audio through the corresponding loudspeaker.

In one embodiment, the mixing module is further configured to perform the following steps, including:

mixing the first audio information, the second audio information and the accompaniment information to obtain playing audio;

and carrying out acoustic feedback suppression processing and sound amplification processing on the played audio so as to enable a loudspeaker to play the played audio.

In one embodiment, the mixing module is further configured to perform the following steps, including:

presetting maximum delay time;

acquiring the transmission delay of the currently received second audio information, and comparing the transmission delay with the maximum delay time;

and if the transmission delay is greater than the maximum delay time, playing the received second audio information after the maximum delay time.

In one embodiment, the generation module is further configured to perform steps comprising:

receiving the audio characteristics corresponding to each microphone;

and extracting audio information corresponding to the audio features in the audio as first audio information.

The readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, a readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Additionally, the ASIC may reside in user equipment. Of course, the processor and the readable storage medium may also reside as discrete components in a communication device. The readable storage medium may be a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The present invention also provides a program product comprising execution instructions stored in a readable storage medium. The at least one processor of the device may read the execution instructions from the readable storage medium, and the execution of the execution instructions by the at least one processor causes the device to implement the methods provided by the various embodiments described above.

In the above embodiments of the terminal or the server, it should be understood that the Processor may be a Central Processing Unit (CPU), other general-purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.