阅读说明：本技术 适用于移动终端的数字音量扩增方法、装置及存储介质 (Digital volume amplification method and device suitable for mobile terminal and storage medium ) 是由 李好博 王国腾 陈华 于 2021-07-08 设计创作，主要内容包括：本发明提供一种适用于移动终端的数字音量扩增方法、装置及存储介质,包括：获取移动终端的声反馈回路特征,基于所述声反馈回路特征生成防啸叫策略；基于麦克风获取歌声得到歌声信息,将所述歌声信息与伴奏信息进行音频混合得到音频信息；基于麦克风获取环境噪声得到噪声信息,得到环境噪声的时频特征；根据所述防啸叫策略和环境噪声的时频特征对所述音频信息处理得到能量重分配后的外放音频。本发明提供的技术方案,能够在不改变原有扬声器功率的前提下,对音频进行扩音的效果。并且,在进行扩音效果添加的过程中,会引入声反馈回路特征,使得本发明在尽量提高音量的同时避免啸叫的发声,提供了一种稳定的数字音量扩增方法、扩音方法。(The invention provides a digital volume amplification method, a device and a storage medium suitable for a mobile terminal, wherein the method comprises the following steps: the method comprises the steps of obtaining acoustic feedback loop characteristics of the mobile terminal, and generating a howling prevention strategy based on the acoustic feedback loop characteristics; acquiring singing voice based on a microphone to obtain singing voice information, and carrying out audio mixing on the singing voice information and the accompaniment information to obtain audio information; acquiring environmental noise based on a microphone to obtain noise information and obtain time-frequency characteristics of the environmental noise; and processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio after energy redistribution. The technical scheme provided by the invention can realize the effect of amplifying the audio without changing the power of the original loudspeaker. In addition, in the process of adding the sound amplification effect, the characteristic of an acoustic feedback loop is introduced, so that the sound volume is improved as much as possible, the sound production of howling is avoided, and a stable digital sound volume amplification method and a sound amplification method are provided.)

1. A digital volume amplification method suitable for a mobile terminal is characterized by comprising the following steps:

the method comprises the steps of obtaining acoustic feedback loop characteristics of the mobile terminal, and generating a howling prevention strategy based on the acoustic feedback loop characteristics;

acquiring singing voice based on a microphone to obtain singing voice information, and carrying out audio mixing on the singing voice information and the accompaniment information to obtain audio information;

acquiring environmental noise based on a microphone to obtain noise information and obtain time-frequency characteristics of the environmental noise;

and processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio after energy redistribution.

2. The digital volume amplification method for a mobile terminal according to claim 1,

acquiring singing voice based on a microphone to obtain singing voice information, and performing audio mixing on the singing voice information and accompaniment information to obtain audio information, wherein the audio information comprises:

reverberation processing is performed on the singing voice information to extend a time during which a sound played based on the singing voice information can be perceived.

3. The digital volume amplification method for a mobile terminal according to claim 1,

the processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the outplayed audio after energy redistribution comprises the following steps:

based on the howling prevention strategy, obtaining howling thresholds of a plurality of frequency points;

acquiring an auditory masking threshold of environmental noise;

calculating an upper limit value of allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the frequency points;

and processing the audio information based on the upper limit value of the energy which can be distributed to each frequency point to obtain the external audio after the energy is redistributed.

4. The digital volume amplification method for a mobile terminal according to claim 3,

obtaining the auditory masking threshold of the environmental noise comprises:

and performing time-frequency transformation processing on the time-frequency characteristics of the environmental noise to obtain an auditory masking threshold of the environmental noise.

5. The digital volume amplification method for a mobile terminal according to claim 4,

the calculating the upper limit value of the allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the frequency points comprises:

acquiring a howling threshold and an auditory masking threshold of each frequency point;

if the howling threshold of the frequency point is lower than the masking threshold, setting the upper limit value of the allocable energy of the frequency point to be close to zero;

and if the howling threshold is higher than the masking threshold, setting the upper limit value of the allocable energy of the frequency point as the howling threshold.

6. The digital volume amplification method for a mobile terminal according to claim 5,

acquiring any adjacent preset frame number in audio information, and adjusting the energy value of the adjacent preset frame number to the howling threshold.

7. The digital volume amplification method for a mobile terminal according to claim 1,

the step of processing the audio information to obtain the played audio after the energy is redistributed based on the upper limit value of the energy which can be distributed to each frequency point comprises the following steps:

adjusting the value of the allocable energy of each frequency point in the audio information to be the upper limit value;

performing energy redistribution on the audio information based on the adjusted upper limit value of the frequency point;

and performing time-frequency inverse transformation on the audio information after the energy redistribution to obtain the play-out audio which can be played through a loudspeaker.

8. The digital volume amplification method for a mobile terminal according to claim 7,

the method for acquiring the acoustic feedback loop characteristics of the mobile terminal and generating the howling prevention strategy based on the acoustic feedback loop characteristics comprises the following steps:

sending a preset audio signal to a space where the mobile terminal is located through a loudspeaker of the mobile terminal;

receiving a feedback audio signal of a space through the microphone;

and comparing the preset audio signal with the feedback audio signal to obtain the characteristics of the acoustic feedback loop in the current space.

9. A digital volume amplification device for a mobile terminal, comprising:

the system comprises an acquisition module, a feedback module and a feedback module, wherein the acquisition module is used for acquiring the characteristics of an acoustic feedback loop of the mobile terminal and generating a howling prevention strategy based on the characteristics of the acoustic feedback loop;

the mixing module is used for acquiring singing voice information based on a microphone and mixing the singing voice information and the accompaniment information to obtain audio information;

the obtaining module is used for obtaining the environmental noise based on the microphone to obtain noise information and obtain the time-frequency characteristics of the environmental noise;

and the processing module is used for processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio with redistributed energy.

10. A readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the method of any one of claims 1 to 8.

Technical Field

The invention relates to the technical field of audio data processing, in particular to a digital volume amplification method and device suitable for a mobile terminal and a storage medium.

Background

With the rapid development of science and technology and music culture, the way of singing (singing) is more and more diversified. The mode of carrying out K based on mobile terminal sings has the advantage of convenience, easy operation, and most favoured by everyone, in the present scheme of carrying out K based on mobile terminal sings, what decide K sings volume upper limit often is speaker power, so people can handle the audio frequency under the certain circumstances of speaker power, have reached the purpose that the volume enlarges, in prior art, have several kinds of following modes at least, include:

1) and (3) manually using a compression effect device to perform compression treatment: generally, the method is used for manual post-production in a recording studio, and the specific method is that a compression effector is used to reduce the amplitude of each sampling point in a wave pattern to be within a certain lower upper limit and lower limit according to a certain nonlinear mapping curve (for example, the larger the amplitude of the sampling point is, the larger the reduction proportion is, but the size relationship among the sampling points is maintained) in digital audio, and then the amplitude of each sampling point in the wave pattern is reduced to be amplified in the same proportion as the wave pattern, so that the compression processing for increasing the listening volume is realized;

2) dynamic gain control: the method is applied to scenes such as voice communication, manual post-production in a recording studio, and the like, and the processing aim is to amplify the part with smaller amplitude of a sampling point in the same audio frequency in unequal proportion and reduce the part with larger amplitude of the sampling point in unequal proportion, so that the auditory sound volume in the whole audio frequency tends to be consistent, and on the basis, the whole wave pattern can be amplified in equal proportion, so that the effect of increasing the auditory sound volume is realized;

3) the energy redistribution technology comprises the following steps: when the target sound propagates in the space, if other interfering sounds (noise) exist in the space, a part of the target sound is masked. The energy redistribution technique distributes the power of the loudspeaker more to the unmasked portion, reducing the power of the masked or nearly masked portion, and thus achieving an acoustically significant volume amplification. The specific method comprises the following steps: the method comprises the steps of collecting target audio and noise audio in real time, converting the target audio and the noise audio through time-frequency conversion respectively to obtain respective time-frequency characteristics, determining a covering condition through comparison on the time-frequency characteristics, adjusting energy distribution of the target audio according to the covering condition, and converting the adjusted audio into a wave-type form to play.

In several existing digital volume amplification modes, when the volume is amplified, a microphone of the mobile terminal needs to be kept in a closed state, and when the microphone is turned on, the digital volume amplification cannot be performed, so that the digital volume amplification scheme in the prior art has certain limitations. In addition, in the existing energy redistribution technology, only noise information is referred to, and it is difficult to avoid that some time frequency points exceed the non-howling critical value of the acoustic feedback after being amplified by a small amplitude, so that howling is generated, and the practicability is poor.

Disclosure of Invention

Embodiments of the present invention provide a digital volume amplification method, apparatus, and storage medium suitable for a mobile terminal, which can change the content of a digital audio frequency under the condition that the power of a speaker is unchanged and a microphone and the speaker are simultaneously turned on, so that the volume in the sense of hearing is increased, exceeds or is equivalent to the volume at which the user listens to his own voice, and no howling occurs, and therefore the present invention has strong practicability.

In a first aspect of the embodiments of the present invention, a digital volume amplification method suitable for a mobile terminal is provided, including:

the method comprises the steps of obtaining acoustic feedback loop characteristics of the mobile terminal, and generating a howling prevention strategy based on the acoustic feedback loop characteristics;

acquiring singing voice based on a microphone to obtain singing voice information, and carrying out audio mixing on the singing voice information and the accompaniment information to obtain audio information;

acquiring environmental noise based on a microphone to obtain noise information and obtain time-frequency characteristics of the environmental noise;

and processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio after energy redistribution.

Optionally, in a possible implementation manner of the first aspect, the obtaining singing voice information based on a microphone, and the audio mixing the singing voice information with the accompaniment information to obtain audio information includes:

reverberation processing is performed on the singing voice information to extend a time during which a sound played based on the singing voice information can be perceived.

Optionally, in a possible implementation manner of the first aspect, the processing the audio information according to the howling prevention policy and the time-frequency characteristics of the environmental noise to obtain an outgoing audio with reallocated energy includes:

based on the howling prevention strategy, obtaining howling thresholds of a plurality of frequency points;

acquiring an auditory masking threshold of environmental noise;

calculating an upper limit value of allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the frequency points;

and processing the audio information based on the upper limit value of the energy which can be distributed to each frequency point to obtain the external audio after the energy is redistributed.

Optionally, in a possible implementation manner of the first aspect, the obtaining an auditory masking threshold of the environmental noise includes:

and performing time-frequency transformation processing on the time-frequency characteristics of the environmental noise to obtain an auditory masking threshold of the environmental noise.

Optionally, in a possible implementation manner of the first aspect, the calculating an upper limit value of allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the multiple frequency points includes:

acquiring a howling threshold and an auditory masking threshold of each frequency point;

if the howling threshold of the frequency point is lower than the masking threshold, setting the upper limit value of the allocable energy of the frequency point to be close to zero;

and if the howling threshold is higher than the masking threshold, setting the upper limit value of the allocable energy of the frequency point as the howling threshold.

Optionally, in a possible implementation manner of the first aspect, any adjacent preset frame number in the audio information is obtained, and an energy value of the adjacent preset frame number is adjusted to the howling threshold.

Optionally, in a possible implementation manner of the first aspect, the processing the audio information based on the upper limit value of the allocable energy of each frequency point to obtain the played audio after energy reallocation includes:

adjusting the value of the allocable energy of each frequency point in the audio information to be the upper limit value;

performing energy redistribution on the audio information based on the adjusted upper limit value of the frequency point;

and performing time-frequency inverse transformation on the audio information after the energy redistribution to obtain the play-out audio which can be played through a loudspeaker.

Alternatively, in one possible implementation form of the first aspect,

the method for acquiring the acoustic feedback loop characteristics of the mobile terminal and generating the howling prevention strategy based on the acoustic feedback loop characteristics comprises the following steps:

sending a preset audio signal to a space where the mobile terminal is located through a loudspeaker of the mobile terminal;

receiving a feedback audio signal of a space through the microphone;

and comparing the preset audio signal with the feedback audio signal to obtain the characteristics of the acoustic feedback loop in the current space.

In a second aspect of the embodiments of the present invention, a digital volume increasing apparatus suitable for a mobile terminal is provided, including:

the system comprises an acquisition module, a feedback module and a feedback module, wherein the acquisition module is used for acquiring the characteristics of an acoustic feedback loop of the mobile terminal and generating a howling prevention strategy based on the characteristics of the acoustic feedback loop;

the mixing module is used for acquiring singing voice information based on a microphone and mixing the singing voice information and the accompaniment information to obtain audio information;

the obtaining module is used for obtaining the environmental noise based on the microphone to obtain noise information and obtain the time-frequency characteristics of the environmental noise;

and the processing module is used for processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio with redistributed energy.

In a third aspect of the embodiments of the present invention, a readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, is adapted to carry out the method according to the first aspect of the present invention and various possible designs of the first aspect of the present invention.

The digital volume amplification method, the digital volume amplification device and the storage medium which are suitable for the mobile terminal can amplify the audio frequency under the premise of not changing the power of the original loudspeaker. In addition, in the process of adding the sound amplification effect, the characteristic of an acoustic feedback loop is introduced, so that the sound volume is increased as much as possible, the sound production of howling is avoided, and a stable sound amplification method is provided.

Drawings

Fig. 1 is a flowchart of a first embodiment of a digital volume augmentation method for a mobile terminal;

FIG. 2 is a diagram of a first embodiment of information processing for digital volume augmentation;

FIG. 3 is a diagram of a second embodiment of information processing for digital volume augmentation;

FIG. 4 is a schematic diagram of a measurement phase of an acoustic feedback loop characteristic;

FIG. 5 is a schematic diagram of a tracking phase of an acoustic feedback loop feature;

fig. 6 is a block diagram of a first embodiment of a digital volume amplification apparatus applied to a mobile terminal.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.

It should be understood that, in various embodiments of the present invention, the sequence numbers of the processes do not mean the execution sequence, and the execution sequence of the processes should be determined by the functions and the internal logic of the processes, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

It should be understood that in the present application, "comprising" and "having" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

It should be understood that, in the present invention, "a plurality" means two or more. "and/or" is merely an association describing an associated object, meaning that three relationships may exist, for example, and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "comprises A, B and C" and "comprises A, B, C" means that all three of A, B, C comprise, "comprises A, B or C" means that one of A, B, C comprises, "comprises A, B and/or C" means that any 1 or any 2 or 3 of A, B, C comprises.

It should be understood that in the present invention, "B corresponding to a", "a corresponds to B", or "B corresponds to a" means that B is associated with a, and B can be determined from a. Determining B from a does not mean determining B from a alone, but may be determined from a and/or other information. And the matching of A and B means that the similarity of A and B is greater than or equal to a preset threshold value.

As used herein, "if" may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context.

The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

The invention provides a digital volume amplification method suitable for a mobile terminal, and a flow chart shown in figure 1 comprises the following steps:

and S110, acquiring the acoustic feedback loop characteristics of the mobile terminal, and generating a howling prevention strategy based on the acoustic feedback loop characteristics. Each mobile terminal may have different acoustic feedback loop characteristics under different environments, and the present invention obtains the acoustic feedback loop characteristics of the current mobile terminal under the current scene before performing digital volume amplification.

And step S120, acquiring singing voice information based on a microphone, and carrying out audio mixing on the singing voice information and the accompaniment information to obtain audio information. Because the invention aims to amplify the digital volume of the sound obtained by fusing the singing voice and the accompanying voice, the invention firstly mixes the singing voice information and the accompanying information to obtain the audio information.

Step S130, obtaining the environmental noise based on the microphone to obtain noise information, and obtaining the time-frequency characteristics of the environmental noise.

And step S140, processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio with redistributed energy. The method can process the audio according to the howling prevention strategy and the environmental noise when the digital volume is amplified, and can amplify the digital volume to the maximum on the premise of ensuring that the processed audio does not have howling.

In one possible embodiment, as shown in fig. 2, step S120 includes:

reverberation processing is performed on the singing voice information to extend a time during which a sound played based on the singing voice information can be perceived.

In one possible embodiment, as shown in fig. 3, step S140 includes:

and obtaining the howling thresholds of the multiple frequency points based on the howling prevention strategy. And obtaining the howling thresholds of the multiple frequency points through the avoidance information of the acoustic feedback loop.

An auditory masking threshold for ambient noise is obtained. The auditory masking threshold is the masking of the pure tone by the noise, and the greater the intensity of the noise, the more obvious the masking effect, so the invention needs to confirm the auditory masking threshold to judge the situation of generating the masking under what conditions.

And calculating the upper limit value of the allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the frequency points. When the upper limit value of each frequency point is determined, calculation is carried out according to the howling threshold and the auditory masking threshold of each frequency point, so that the howling and the masking of each frequency point can be avoided when the numerical value of each frequency point is adjusted.

And processing the audio information based on the upper limit value of the energy which can be distributed to each frequency point to obtain the external audio after the energy is redistributed.

In one possible embodiment, obtaining the auditory masking threshold for the ambient noise comprises:

and performing time-frequency transformation processing on the time-frequency characteristics of the environmental noise to obtain an auditory masking threshold of the environmental noise. In a possible implementation manner, in the process of calculating the howling threshold, firstly, the singing voice and the sound feedback loop characteristics are obtained, and the energy of each frequency point of the singing voice is divided point by point with the frequency response in the sound feedback loop characteristics to obtain the energy estimation value of each frequency point of the singing voice in the space. And respectively adding the energy estimation values of the frequency points to obtain a total energy estimation value E1 of the singing voice in the space. And then obtaining an expected energy estimation E2 after sound amplification, determining a coefficient according to different ranges of E2/E1, and multiplying the coefficient by the energy estimation of each frequency point of the singing voice in the space to obtain the howling threshold of each frequency point.

In one possible embodiment, the calculating an upper limit value of allocable energy of each frequency point based on the howling threshold and the auditory masking threshold of the plurality of frequency points includes:

acquiring a howling threshold and an auditory masking threshold of each frequency point;

and if the howling threshold of the frequency point is lower than the masking threshold, setting the upper limit value of the allocable energy of the frequency point to be close to zero. When the energy of the frequency point is higher than the howling threshold, the frequency point may cause howling in subsequent frames, but the sound of the frequency point is covered by other sounds and cannot be heard. It can be understood that this frequency point has already started to accumulate howling, but howling is not yet obvious. Therefore, since the sound of the frequency point is covered and cannot be heard, the invention directly sets the frequency point to be 0, not only can distribute the energy of the frequency point to other frequency points, but also can effectively avoid the howling generation at the subsequent time point caused by the accumulated howling.

And if the howling threshold is higher than the masking threshold, setting the upper limit value of the allocable energy of the frequency point as the howling threshold. At this time, a corresponding howling threshold is set to prevent the situation that the howling threshold is exceeded in the later period to generate howling.

Through the above judging steps, the energy upper limit value can be allocated according to the difference of the howling threshold and the auditory masking threshold of different frequency points.

Acquiring any adjacent preset frame number in audio information, and adjusting the energy value of the adjacent preset frame number to the howling threshold. In one possible scenario, the energy of the sound may be interpreted as a two-dimensional image, with frame numbers on the horizontal axis and frequency bin numbers on the vertical axis. The energy redistribution can be performed independently within each frame or between adjacent frames. The benefit of energy redistribution in adjacent frames is: the energy of some frames may be zeroed out, thereby allocating the saved energy to other frames. Through the mode, the energy of the preset frame number can be rapidly adjusted, and the howling condition can be avoided while the energy of the frame is ensured to be increased.

In a possible implementation manner, the processing the audio information based on the upper limit value of the allocable energy of each frequency point to obtain the played audio after energy reallocation includes:

adjusting the value of the allocable energy of each frequency point in the audio information to be the upper limit value;

performing energy redistribution on the audio information based on the adjusted upper limit value of the frequency point;

and performing time-frequency inverse transformation on the audio information after the energy redistribution to obtain the play-out audio which can be played through a loudspeaker.

In one possible implementation, as shown in fig. 4, when the speaker/karaoke is not being performed, the mobile terminal needs to be configured first, and the speaker of the mobile terminal does not play singing voice or music. Firstly, a mobile terminal loudspeaker is used for actively playing various sound feedback detection signals, a mobile terminal microphone is used for recording the signals, and echo power, frequency response and environment sound mixing impulse response are obtained through analysis and calculation. The obtained calculation result is saved as an acoustic feedback loop characteristic.

In a possible implementation manner, as shown in fig. 5, during the process of loudspeaking/singing, the environment of the mobile terminal may change, the present invention can further change the characteristics of the acoustic feedback loop according to the change of the environment of the mobile terminal, so that the mobile terminal can automatically adapt to the change of the environment and change the characteristics of the acoustic feedback loop, that is, when the environment information and the position information of the mobile terminal change, wherein the environment information and the position information include the attitude, the position and the moving speed of the mobile terminal, the echo power, the frequency response and the impulse response of the environment mixing sound are changed based on the environment information and the position information.

The technical solution of the present invention also provides a digital volume amplification device suitable for a mobile terminal, as shown in fig. 6, including:

the system comprises an acquisition module, a feedback module and a feedback module, wherein the acquisition module is used for acquiring the characteristics of an acoustic feedback loop of the mobile terminal and generating a howling prevention strategy based on the characteristics of the acoustic feedback loop;

the mixing module is used for acquiring singing voice information based on a microphone and mixing the singing voice information and the accompaniment information to obtain audio information;

the obtaining module is used for obtaining the environmental noise based on the microphone to obtain noise information and obtain the time-frequency characteristics of the environmental noise;

and the processing module is used for processing the audio information according to the howling prevention strategy and the time-frequency characteristics of the environmental noise to obtain the external audio with redistributed energy.

The readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, a readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Additionally, the ASIC may reside in user equipment. Of course, the processor and the readable storage medium may also reside as discrete components in a communication device. The readable storage medium may be a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The present invention also provides a program product comprising execution instructions stored in a readable storage medium. The at least one processor of the device may read the execution instructions from the readable storage medium, and the execution of the execution instructions by the at least one processor causes the device to implement the methods provided by the various embodiments described above.

In the above embodiments of the terminal or the server, it should be understood that the Processor may be a Central Processing Unit (CPU), other general-purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.