阅读说明：本技术 一种音频处理方法及电子设备 (Audio processing method and electronic equipment ) 是由 胡吉祥 于 2020-03-11 设计创作，主要内容包括：本发明实施例提供了一种音频处理方法及电子设备,该方法会先获取待处理音频对应的文本信息,其中,文本信息包括待处理文本及待处理文本中各个字段对应的播放时段,再接收针对待处理文本的第一输入,响应于该第一输入,将待处理文本中第一输入指示的字段确定为待处理字段,接着,接收针对待处理字段的第二输入,响应于该第二输入,获取目标音频段,最后,根据目标音频段,对待处理字段对应的播放时段处的音频段进行修改,得到目标音频。这样,无需手动调整进度条,即可实现对音频的修改,因此可以提高音频处理效率。(The embodiment of the invention provides an audio processing method and electronic equipment, the method comprises the steps of firstly obtaining text information corresponding to audio to be processed, wherein the text information comprises the text to be processed and playing time periods corresponding to all fields in the text to be processed, then receiving first input aiming at the text to be processed, determining a field indicated by the first input in the text to be processed as a field to be processed in response to the first input, then receiving second input aiming at the field to be processed, obtaining a target audio segment in response to the second input, and finally modifying the audio segment at the playing time period corresponding to the field to be processed according to the target audio segment to obtain the target audio. Therefore, the audio can be modified without manually adjusting the progress bar, and the audio processing efficiency can be improved.)

1. An audio processing method applied to an electronic device, the method comprising:

acquiring text information corresponding to audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed;

receiving a first input aiming at the text to be processed;

responding to the first input, and determining a field to be processed in the text to be processed according to the field indicated by the first input;

receiving a second input for the field to be processed;

acquiring a target audio segment according to the second input;

and modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain the target audio.

2. The method of claim 1, wherein obtaining a target audio segment in response to the second input comprises:

editing the field to be processed according to the second input to obtain a target field; determining the audio corresponding to the target field as the target audio segment; alternatively, the first and second electrodes may be,

extracting an audio segment carried in the second input; determining the audio segment as the target audio segment.

3. The method of claim 2, wherein editing the field to be processed according to the second input to obtain a target field comprises:

if the second input is deletion input, deleting the field to be processed, and determining a blank field obtained after deletion as the target field;

if the second input is the replacement input, acquiring a field to be replaced corresponding to the second input; deleting the field to be processed, and adding the field to be replaced at the position of the field to be processed to obtain the target field;

if the second input is an increase input, acquiring a field to be increased corresponding to the second input; and adding the field to be added at the position of the field to be processed to obtain the target field.

4. The method according to claim 3, wherein the audio to be processed is audio contained in video to be processed; prior to the receiving the first input for the text to be processed, the method further comprises:

displaying a preset picture, and displaying all the texts to be processed in the preset picture; or displaying each video picture of the video to be processed; displaying a text to be processed corresponding to the video picture in the video picture;

the receiving a first input for the text to be processed comprises:

a selection input of the displayed text to be processed is received.

5. The method according to any one of claims 1 to 4, wherein the modifying, according to the target audio segment, the audio segment at the playing period corresponding to the field to be processed to obtain the target audio comprises:

acquiring the playing time interval corresponding to the field to be processed from the playing time interval corresponding to each field;

acquiring an audio waveform diagram corresponding to the audio to be processed;

and modifying the corresponding wave band of the playing time period corresponding to the field to be processed in the audio waveform diagram into the audio wave band corresponding to the target audio band to obtain the target audio.

6. The method according to claim 1, wherein after determining the field to be processed in the text to be processed according to the field indicated by the first input, the method further comprises:

receiving a third input for the text to be processed;

responding to the third input, and adjusting the font size of the field to be adjusted indicated by the third input to obtain the adjusted field to be adjusted;

adjusting the volume of the audio corresponding to the field to be adjusted according to the adjusted font size of the field to be adjusted; and the larger the font of the field to be adjusted is, the larger the volume of the audio corresponding to the field to be adjusted is.

7. An electronic device, characterized in that the electronic device comprises:

the first acquisition module is used for acquiring text information corresponding to the audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed;

the first receiving module is used for receiving a first input aiming at the text to be processed;

the first determination module is used for responding to the first input and determining a field to be processed in the text to be processed according to the field indicated by the first input;

a second receiving module, configured to receive a second input for the field to be processed;

the second acquisition module is used for acquiring a target audio segment according to the second input;

and the second determining module is used for modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain the target audio.

8. The electronic device of claim 7, wherein the second obtaining module is configured to:

editing the field to be processed according to the second input to obtain a target field; determining the audio corresponding to the target field as the target audio segment; alternatively, the first and second electrodes may be,

extracting an audio segment carried in the second input; determining the audio segment as the target audio segment.

9. The electronic device of claim 8, wherein the second obtaining module is further configured to:

if the second input is deletion input, deleting the field to be processed, and determining a blank field obtained after deletion as the target field;

if the second input is the replacement input, acquiring a field to be replaced corresponding to the second input; deleting the field to be processed, and adding the field to be replaced at the position of the field to be processed to obtain the target field;

if the second input is an increase input, acquiring a field to be increased corresponding to the second input; and adding the field to be added at the position of the field to be processed to obtain the target field.

10. The electronic device of claim 9, further comprising:

the first display module is used for displaying a preset picture and displaying all the texts to be processed in the preset picture; or displaying each video picture of the video to be processed; displaying a text to be processed corresponding to the video picture in the video picture;

the first receiving module is further configured to:

a selection input of the displayed text to be processed is received.

11. The electronic device of any of claims 7-10, wherein the second determining module is configured to:

acquiring the playing time interval corresponding to the field to be processed from the playing time interval corresponding to each field;

acquiring an audio waveform diagram corresponding to the audio to be processed;

and modifying the corresponding wave band of the playing time period corresponding to the field to be processed in the audio waveform diagram into the audio wave band corresponding to the target audio band to obtain the target audio.

12. The electronic device of claim 7, further comprising:

a third receiving module, configured to receive a third input for the text to be processed;

the first adjusting module is used for responding to the third input, adjusting the font size of the field to be adjusted indicated by the third input, and obtaining the adjusted field to be adjusted;

the second adjusting module is used for adjusting the volume of the audio corresponding to the field to be adjusted according to the adjusted font size of the field to be adjusted; and the larger the font of the field to be adjusted is, the larger the volume of the audio corresponding to the field to be adjusted is.

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an audio processing method and an electronic device.

Background

People often record audio in life, but in the recording process, the problems of misspeaking, multiple times of speaking and meditation and the like often occur, so that the audio content needs to be modified, and segments which are not wanted by users are processed.

In the conventional technology, a user often manually adjusts a progress bar of audio to find a playing period in which an audio segment needing to be modified is located, and then modifies the audio segment at the playing period. In the operation process, the user often needs to repeatedly adjust the progress bar to accurately position the playing time interval where the audio clip needing to be modified is located, the whole operation process is complicated, and the audio processing efficiency is low.

Disclosure of Invention

The embodiment of the invention provides an audio processing method and electronic equipment, and aims to solve the problems that the operation process is complicated and the audio processing efficiency is low when audio content is modified.

In order to solve the technical problem, the invention is realized as follows:

in a first aspect, an embodiment of the present invention provides an audio processing method applied to an electronic device, where the method includes:

acquiring text information corresponding to audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed;

receiving a first input aiming at the text to be processed;

responding to the first input, and determining a field to be processed in the text to be processed according to the field indicated by the first input;

receiving a second input for the field to be processed;

acquiring a target audio segment according to the second input;

and modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain the target audio.

In a second aspect, an embodiment of the present invention further provides an electronic device, including:

the first acquisition module is used for acquiring text information corresponding to the audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed;

the first receiving module is used for receiving a first input aiming at the text to be processed;

the first determination module is used for responding to the first input and determining a field to be processed in the text to be processed according to the field indicated by the first input;

a second receiving module, configured to receive a second input for the field to be processed;

the second acquisition module is used for acquiring a target audio segment according to the second input;

and the second determining module is used for modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain the target audio.

In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and an audio processing program stored on the memory and executable on the processor, where the audio processing program, when executed by the processor, implements the steps of the audio processing method according to the first aspect.

In a fourth aspect, the embodiment of the present invention provides a computer-readable storage medium, where an audio processing program is stored on the computer-readable storage medium, and when executed by a processor, the audio processing program implements the steps of the audio processing method according to the first aspect.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is first obtained, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, then a first input for the to-be-processed text is received, in response to the first input, a field indicated by the first input in the to-be-processed text is determined as the to-be-processed field, then a second input for the to-be-processed field is received, in response to the second input, a target audio segment is obtained, and finally, according to the target audio segment, an audio segment at the playing period corresponding to the to-be-processed field is modified, so as to obtain the target audio. Therefore, the audio can be modified without manually adjusting the progress bar, and the audio processing efficiency can be improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a flow chart illustrating the steps of an audio processing method according to an embodiment of the present invention;

FIG. 2-1 shows a flow chart of steps of another audio processing method of an embodiment of the invention;

2-2 is a schematic diagram for displaying a text to be processed according to an embodiment of the present invention;

2-3 illustrate another exemplary view for displaying a text to be processed according to an embodiment of the present invention;

2-4 illustrate a schematic diagram for editing a text to be processed according to an embodiment of the present invention;

2-5 illustrate another exemplary view for editing a text to be processed according to an embodiment of the present invention;

2-6 illustrate another exemplary diagram for editing a text to be processed according to an embodiment of the present invention;

FIG. 3 is a flow chart illustrating steps of another audio processing method according to an embodiment of the invention;

fig. 4 is a block diagram of an electronic device according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1 is a flowchart of steps of an audio processing method provided in an embodiment of the present invention, where the method may be applied to an electronic device, and as shown in fig. 1, the method may include:

step 101, acquiring text information corresponding to audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed.

In the embodiment of the invention, the audio to be processed may be stored locally or may be an audio to be modified obtained by downloading from the internet, and the audio to be processed may be directly obtained by recording the audio or recorded during recording the video, that is, the audio to be processed may be an audio extracted from the video. Further, the text to be processed may be a text corresponding to the audio to be processed, and the corresponding text may be obtained by converting the audio to be processed according to an audio-to-text method. The playing time period corresponding to each field in the text to be processed may be a playing time period corresponding to the audio corresponding to the field in the audio to be processed. For example, assuming that the playing period of the audio corresponding to the field "good mood" in the text to be processed is from 5.1 th second to 5.9 th second in the audio to be processed, the playing period from "5.1 th second to 5.9 th second" may be determined as the playing period corresponding to the field "good mood".

Step 102, receiving a first input aiming at the text to be processed.

In the embodiment of the present invention, the first input for the text to be processed may be an operation of selecting a field to be modified in the text to be processed on an interface for displaying the text to be processed. The operation may be a single click, a double click, or the like.

Step 103, responding to the first input, and determining a field to be processed in the text to be processed according to the field indicated by the first input.

In the embodiment of the present invention, the field indicated by the first input refers to a field selected by the user through the first input, that is, a field corresponding to the audio that the user needs to modify, and therefore, the field to be processed may be determined according to the field indicated by the first input. When determining the field to be processed in the text to be processed according to the field indicated by the first input, the field indicated by the first input in the text to be processed may be used as the field to be processed.

Step 104, receiving a second input aiming at the field to be processed.

In the embodiment of the present invention, the second input for the field to be processed may be performed on an interface displaying the text to be processed, and the second input may be performed by the user according to a modification requirement of the audio segment corresponding to the field to be processed. For example, the second input may be a deletion operation for the field to be processed, or an input operation for replacing the field to be processed, or an input operation for a field to be added, or an input operation for replacing an audio segment of an audio segment corresponding to the field to be processed.

Step 105, in response to the second input, obtaining a target audio segment.

In the embodiment of the invention, the target audio segment can be an audio segment which is finally desired by a user. The target audio segment can be directly input by a user or obtained by editing a field to be processed by the electronic equipment. The specific manner of editing the field to be processed may be determined according to the second input. For example, a new field may be added to the field to be processed when the second input is an operation to input a field that needs to be added. When the second input is a delete operation for the pending field, the pending field is deleted, and so on. Because the second input is executed by the user according to the modification requirement of the audio segment corresponding to the field to be processed, the obtained target audio segment can be ensured to be the field corresponding to the audio which is finally desired by the user by editing the field to be processed.

And 106, modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain the target audio.

In the embodiment of the invention, when the target audio segment is modified, the playing time interval corresponding to the field to be processed can be read in the playing time interval corresponding to each field contained in the text information, and then the audio segment at the playing time interval corresponding to the field to be processed is modified into the target audio segment, thereby realizing the modification of the audio to be processed.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is first obtained, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, then a first input for the to-be-processed text is received, in response to the first input, a to-be-processed field in the to-be-processed text is determined according to a field indicated by the first input, then a second input for the to-be-processed field is received, in response to the second input, a target audio segment is obtained, and finally, according to the target audio segment, an audio segment at the playing period corresponding to the to-be-processed field is modified, so as to obtain the target audio. Therefore, the audio can be modified without manually adjusting the progress bar, and the audio processing efficiency can be improved.

Fig. 2-1 is a flowchart of steps of another audio processing method provided by an embodiment of the present invention, which may be applied to an electronic device, as shown in fig. 2-1, and the method may include:

step 201, acquiring text information corresponding to audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed.

In the embodiment of the present invention, the electronic device may obtain text information corresponding to the audio to be processed through the following steps 2011 to 2013:

step 2011, detecting whether a subtitle file matched with the audio to be processed exists; the subtitle file comprises a subtitle text and a playing time interval corresponding to each field in the subtitle text.

In the embodiment of the invention, the audio to be processed can be the audio in the video, and correspondingly, the subtitle file can be the subtitle file matched with the video. The audio to be processed may also be independent audio, such as a song, etc., and correspondingly, the subtitle file may be a lyric file matching the song. Whether the subtitle file matched with the audio to be processed exists or not is detected, whether the subtitle file matched with the audio to be processed exists or not can be searched on the internet or whether the subtitle file matched with the audio to be processed exists or not can be searched locally.

Step 2012, if a subtitle file matching the audio to be processed exists, using the subtitle file as text information corresponding to the audio to be processed.

In the embodiment of the present invention, the subtitle file is used as the text information corresponding to the audio to be processed, and may be a subtitle text included in the subtitle file is used as a text to be processed corresponding to the audio to be processed, and the playing time period corresponding to each field in the subtitle text is used as the playing time period of the field in the audio to be processed. By detecting whether the matched caption file exists or not, and taking the caption file as the text information corresponding to the audio to be processed under the condition that the caption file exists, the step of generating the text according to the audio can be omitted, and the time for processing the audio is further saved to a certain extent.

Step 2013, if the subtitle file matched with the audio to be processed does not exist, converting the audio contained in the audio to be processed into a text, and generating a playing time period corresponding to each field in the text according to the time information of playing the audio segment in the audio to be processed; and taking the text and the playing time interval corresponding to each field in the text as text information corresponding to the audio to be processed.

In the embodiment of the invention, the audio to be processed is converted into the text by a method of converting voice into characters. Specifically, the audio frequency may be processed first to remove noise in the audio frequency and avoid interference to the conversion process, then the feature values in the audio frequency are extracted, and the audio frequency is divided into smaller audio frequency segments, so that the audio frequency segments include one or more feature values, matching is performed according to the feature values of the audio frequency segments and the model feature values in the audio frequency model library, and the text corresponding to the matched model feature values is determined as the text corresponding to the audio frequency segments. The generation of the playing time period corresponding to each field in the text may be reading the playing time period corresponding to the audio segment to be divided in the process of converting the audio into the text, and then taking the playing time period corresponding to the divided audio segment as the playing time period corresponding to the field. Therefore, when the subtitle file does not exist, the corresponding text is generated through the audio, the text content matched with the audio to be processed can be obtained, and accurate text information can be provided for follow-up.

Step 202, receiving a first input aiming at the text to be processed.

In the embodiment of the present invention, before receiving a first input for a text to be processed, displaying the text to be processed may be implemented by:

displaying a preset picture, and displaying all the texts to be processed in the preset picture; or displaying each video picture of the video to be processed; and displaying the text to be processed corresponding to the video picture in the video picture.

Specifically, the preset frame may be preset according to actual conditions, for example, the preset frame may be a frame associated with the audio to be processed, for example, a video cover of a video to which the audio to be processed belongs, a cover of an audio album to which the audio to be processed belongs, a photo of a singer of the audio to be processed, and the like, which is not limited in this embodiment of the present invention. Furthermore, all the texts to be processed are displayed in the preset pictures, so that a user can visually see the complete texts to be processed conveniently, and meanwhile, the preset pictures related to the texts to be processed are used, so that the watching experience of the user can be improved. For example, fig. 2-2 is a schematic diagram illustrating a text to be processed according to an embodiment of the present invention, and as shown in fig. 2-2, all the text to be processed is displayed in a related screen of a singer who sings the audio to be processed. It should be noted that, in an actual application scenario, the number of texts to be processed may be large, and due to the limitation of the screen size of the electronic device, a complete text to be processed may not be displayed at one time, so that the text to be processed may be scrolled and displayed to ensure complete display.

Further, a video picture can also be displayed, and a corresponding text to be processed is displayed in the video picture. The text to be processed corresponding to the video picture may be a text with a playing time period the same as the playing time period of the video picture. Because the content of the video picture and the text to be processed corresponding to the video picture are often strongly associated, the content of the video picture and the text content can be conveniently observed by a user in a mode of respectively displaying in the video picture, and the user can conveniently select the content. Specifically, during display, a text display box may be generated on a video picture, and a text to be processed is displayed in the text display box, and the specific form of the display box may be preset according to the actual situation. By way of example, fig. 2-3 are schematic diagrams of another example of displaying text to be processed according to an embodiment of the present invention, and as shown in fig. 2-3, corresponding text to be processed, i.e., "let i remove more than yesternight's wine that tears.

Accordingly, the electronic device may enable receiving the first input by receiving a selection input of the displayed text to be processed. Therefore, the text to be processed is displayed in the preset picture or the video picture, visual selection scenes and rich information can be provided for a user, the user can conveniently select the text to be processed, and the selection efficiency is improved.

Step 203, responding to the first input, and determining a field to be processed in the text to be processed according to the field indicated by the first input.

Specifically, when the field of the first input instruction in the text to be processed is determined as the field to be processed, all fields of the first input instruction included in all the texts to be processed may be searched, and then the searched field is determined as the field to be processed; wherein the field indicated by the first input may be a field selected by a user for a selection input of the displayed text to be processed. Alternatively, the first input may be performed through a preset search area, and the field indicated by the first input may be input through the search area. Accordingly, the electronic device may display the search area prior to this step; a first input performed by a user through the search area is then received. Therefore, the user only needs to select once, and the electronic equipment can be controlled to modify all the same fields, so that the selection efficiency can be improved.

Further, after step 203 is executed, the audio volume can be adjusted through the following steps a to C.

And step A, receiving a third input aiming at the text to be processed.

In the embodiment of the present invention, the third input for the text to be processed may be performed on an interface displaying the text to be processed, and the third input may be an adjustment operation of a font of the text to be processed. The user may perform a third input when the font of the text to be processed needs to be adjusted, and accordingly, the electronic device may receive the third input.

And B, responding to the third input, and adjusting the font size of the field to be adjusted indicated by the third input to obtain the adjusted field to be adjusted.

In the embodiment of the present invention, the font size of the field to be adjusted indicated by the third input is adjusted, which may be that the font size of the field to be adjusted is enlarged or reduced according to the adjustment operation indicated by the third input, so as to obtain the adjusted field to be adjusted.

Step C, adjusting the volume of the audio corresponding to the field to be adjusted according to the adjusted font size of the field to be adjusted; and the larger the font of the field to be adjusted is, the larger the volume of the audio corresponding to the field to be adjusted is.

In the embodiment of the present invention, when the volume of the audio corresponding to the field to be adjusted is adjusted according to the adjusted font size of the field to be adjusted, the font size of the field to be adjusted after adjustment may be determined first, then the volume corresponding to the font size of the field to be adjusted after adjustment is determined according to the preset corresponding relationship between the font size and the volume, and finally the volume of the audio corresponding to the field to be adjusted is set to the volume of the audio corresponding to the field to be adjusted, so as to adjust the volume. And in the corresponding relation between the preset font size and the volume size, the larger the font is, the larger the volume is.

For example, assuming that the font size of the field to be adjusted is number four, and the volume corresponding to the number four font is 60 db, the volume of the audio corresponding to the field to be adjusted may be set to the 60 db accordingly. Therefore, the user only needs to adjust the font size of the text, and can correspondingly control and adjust the volume of the corresponding audio, so that the process of adjusting the audio volume is simpler and more convenient, and the adjustment efficiency can be improved.

Further, in the embodiment of the present invention, a curve for adjusting the font size may be preset. Accordingly, the user can select a field to be adjusted, the font size of which needs to be adjusted, from the text to be processed, and then adjust the shape of the curve, thereby realizing the input of the second input. Further, when the font size is adjusted, the sizes of the characters contained in the field to be adjusted can be adjusted in sequence according to the heights of the segments of the adjusted curve; wherein the height of the segment may be proportional or inversely proportional to the size of the word. Therefore, the user can realize the volume of the corresponding audio segment only by adjusting the curve shape. Meanwhile, due to the diversity of the curve shapes, the volume of the audio segment corresponding to the field to be processed has multiple possibilities, for example, a user can control the volume corresponding to the field to be adjusted to be small and large by adjusting the curve to be wave-shaped, and then the interestingness of the audio can be improved.

And step 204, receiving a second input aiming at the field to be processed.

Specifically, the step 104 may be referred to in the implementation manner of this step, which is not limited in this embodiment of the present invention.

And step 205, editing the field to be processed according to the second input to obtain a target field.

In the embodiment of the present invention, if the second input is a delete input, it may be considered that the user needs to delete the field to be processed, and therefore, the field to be processed may be deleted, and a blank field obtained after deletion may be determined as the target field.

Further, if the second input is a replacement input, it may be considered that the user needs to replace the field to be processed, and therefore, the field to be replaced corresponding to the second input may be obtained; and deleting the field to be processed, and adding the field to be replaced at the position of the field to be processed to obtain the target field. The field to be replaced corresponding to the second input is obtained by extracting a field included in the second input and using the field as the field to be replaced, or extracting voice included in the second input, and characters corresponding to the voice are obtained according to a method of converting the voice into the characters, and the obtained characters are used as the field to be replaced.

Further, if the second input is an increase input, it may be considered that the user needs to add a new field to the field to be processed, and therefore, the field to be increased corresponding to the second input may be obtained; and adding the field to be added at the position of the field to be processed to obtain the target field. In the embodiment of the present invention, the field to be added corresponding to the second input is obtained, which may be extracting a field included in the second input, and using the field as the field to be added, or extracting a voice included in the second input, and obtaining a character corresponding to the voice according to a method of converting the voice into the character, and using the obtained character as the field to be added. In the embodiment of the invention, corresponding editing operation can be executed according to different second inputs, so that various modification requirements of a user can be met, and the audio modification effect is improved.

It should be noted that preset marks may be added to the displayed field to be processed, and the field to be replaced or the field to be added may be displayed according to the display position corresponding to the field to be processed. Specifically, the preset flag may be a flag reflecting a specific editing operation performed on the field to be processed, and the preset flags corresponding to different editing operations are different. For example, if the editing operation is to delete a field to be processed, the preset mark may be a deletion line added to the field to be processed, or may be a text mark added to the field to be processed to indicate that the field is deleted. If the editing operation is to replace the field to be processed, the preset mark may be an underline added to the field to be processed, or may be a text mark added to the field to be processed to indicate that the field is replaced, and the field to be replaced is displayed beside the field to be processed, where a specific display position may be set according to an actual situation. If the editing operation is to add a field at a position of the field to be processed, the preset flag may be to add a field flag, such as an arrow, at a position corresponding to the field to be processed to indicate that the field is added at the position. Meanwhile, the added fields to be added can be displayed, so that a user can know what fields are specifically added. The specific marking manner may be various, and the embodiment of the present invention is not limited thereto. By adding the preset mark on the field to be processed, the user can more clearly know the position of the modified field to be processed and the specific editing operation performed on the modified field to be processed.

Further, the display position may be preset according to actual requirements, for example, the display position may be below the field to be deleted. Therefore, the fields to be replaced or the fields to be added are displayed in the display positions corresponding to the fields to be deleted, so that a user can conveniently and quickly know the specifically modified contents, and the user can conveniently check the contents later.

2-4 are diagrams of editing a to-be-processed text according to an embodiment of the present invention, as shown in fig. 2-4, the to-be-processed field is "let me drop tear", and the second input is a delete input, the to-be-processed field is deleted, that is, a strikethrough is added on "let me drop tear" and deleted.

Fig. 2-5 are schematic diagrams of another editing of a to-be-processed text according to an embodiment of the present invention, as shown in fig. 2-5, when the to-be-processed field is "tear", and the second input is a replacement input, the to-be-processed field is deleted and the to-be-replaced field is displayed, that is, a deletion line is added on the "tear", and "saliva" below the to-be-processed field is the to-be-replaced field.

Fig. 2-6 are schematic diagrams of another editing pending text according to an embodiment of the present invention, where, as shown in fig. 2-6, the location indicated by the pending field is between "me" and "away", and the second input is the add input, the location of the pending field is indicated by an arrow, and the "today" below the arrow is the pending add field.

Step 206, determining the audio corresponding to the target field as the target audio segment.

Specifically, the linguistic analysis may be performed on the text to segment the target field into words, and then, according to the words obtained by the segmentation, the audio waveform segments corresponding to the matched fields are extracted from the speech synthesis library, and the audio waveform segments corresponding to the words are synthesized to obtain the audio segments corresponding to the text. Or searching whether a field same as the target field exists in the audio to be processed, if so, extracting the audio segment corresponding to the same field to serve as the audio corresponding to the target field, and further obtaining the target audio segment.

And step 207, modifying the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment to obtain a target audio.

Specifically, in this step, a playing time period corresponding to the field to be processed may be obtained from the playing time period corresponding to each field, then an audio waveform diagram corresponding to the audio to be processed is obtained, and finally, a corresponding wave band of the playing time period corresponding to the field to be processed in the audio waveform diagram is modified into an audio wave band corresponding to the target audio band, so as to obtain the target audio.

When the playing time period corresponding to the field to be processed is obtained, the field to be processed can be searched from each field, and then the playing time period corresponding to the field to be processed is read. When the audio waveform diagram corresponding to the audio to be processed is obtained, the waveform diagram displaying the audio features according to the playing time may be obtained by extracting features, such as vibration frequency, included in the audio, and processing the features, such as normalization processing.

Further, when the corresponding band of the playing time period corresponding to the field to be processed in the audio waveform diagram is modified into a blank band corresponding to the target audio band, the blank band may be used to replace the corresponding band, so as to implement the modification. Alternatively, the corresponding band may be directly deleted to implement the modification. In addition, when deleting, the waveform display of the corresponding band may be removed, and changed into a straight line, so as to indicate that the sound is deleted.

If the target field is a field to be replaced, the corresponding band can be directly replaced by using the audio band corresponding to the target audio band, or the corresponding band can be deleted first, and then the audio band corresponding to the field to be replaced in the audio band corresponding to the target audio band is added at the deleted position. If the target field is a field to be added, the corresponding band can be replaced by directly using the audio band corresponding to the target audio band, or the audio band corresponding to the field to be added in the audio band corresponding to the target audio band can be added according to the position of the playing time period corresponding to the field to be processed in the corresponding band in the audio waveform diagram, and the synthesized audio band is taken as the target audio. Therefore, the modification of the audio to be processed is realized by correspondingly modifying the wave band of the audio to be processed in the audio oscillogram, so that the modification process is more accurate, and the modification accuracy can be improved.

It should be noted that, after acquiring the audio waveform map, the electronic device may further perform the following operations:

displaying an audio waveform diagram corresponding to the audio to be processed; and marking the corresponding wave band of the playing time interval corresponding to the field to be processed in the audio waveform diagram. The mark may be filled with different colors in the corresponding wavelength band, or may be a mark added at a position of the corresponding wavelength band, and the specific mark form is not limited in the embodiment of the present invention. Therefore, the audio waveform diagram corresponding to the audio to be processed is displayed, and the wave band corresponding to the field to be processed is marked in the audio waveform diagram, so that a user can conveniently check the modified audio wave band.

It should be noted that, before modifying the audio frequency band, the audio frequency to be processed may also be processed, the human voice in the audio frequency to be processed is separated from the background sound, then the human voice in the audio frequency to be processed is extracted, the audio frequency band corresponding to the human voice is correspondingly modified, and finally, the modified human voice and the background sound are synthesized to obtain the target audio frequency. Therefore, the modification degree of the audio can be greatly reduced by only aiming at the modification of the human voice and reserving the background sound in the audio, so that the modified audio is more natural and coherent.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is obtained first, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, a first input for the to-be-processed text is received, in response to the first input, a to-be-processed field in the to-be-processed text is determined according to a field indicated by the first input, a second input for the to-be-processed field is received, the to-be-processed field is edited according to the second input, a target field is obtained, an audio corresponding to the target field is determined as a target audio segment, and finally, an audio segment at the playing period corresponding to the to-be-processed field is modified according to the target audio segment, so as to obtain the target audio. Therefore, corresponding editing operation can be executed according to different second inputs, so that various modification requirements of users can be met, and the audio modification effect is improved. Meanwhile, the user can modify the audio without manually adjusting the progress bar, so that the audio processing efficiency can be improved.

Fig. 3 is a flowchart illustrating steps of another audio processing method according to an embodiment of the present invention, where the method may be applied to an electronic device, and as shown in fig. 3, the method may include:

301, acquiring text information corresponding to audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed.

Specifically, the step 201 may be referred to in an implementation manner of this step, and this is not limited in this embodiment of the present invention.

Step 302, receiving a first input for the text to be processed.

Specifically, reference may be made to step 202 in this step, which is not limited in this embodiment of the present invention.

Step 303, responding to the first input, and determining a field to be processed in the text to be processed according to the field indicated by the first input.

Specifically, the step 203 may be referred to in an implementation manner of this step, which is not limited in this embodiment of the present invention.

Step 304, receiving a second input for the field to be processed.

Specifically, the step 104 may be referred to in the implementation manner of this step, which is not limited in this embodiment of the present invention.

Step 305, extracting the audio segment carried in the second input.

In this embodiment of the present invention, the second input may be an audio recording operation, and accordingly, the audio segment carried in the second input may be a voice segment recorded by the user. The second input may also be an audio upload operation, and accordingly, the audio segment carried in the second input may also be an audio segment selected by the user to be uploaded.

Step 306, determining the audio segment as the target audio segment.

In the embodiment of the present invention, the second input is often executed according to the modification requirement of the user on the audio segment corresponding to the field to be processed, that is, the audio segment carried in the second input is the audio segment that the user finally wants. Thus, the audio segment may be directly determined as the target audio segment.

It should be noted that, in the embodiment of the present invention, before determining the input audio segment as the target audio segment, the user may be prompted whether to process the input audio segment, if so, the input audio segment is intercepted according to the user operation, and the intercepted audio segment is used as the target audio segment. In this way, the quality of the target audio segment can be further improved by prompting the user whether to process the input audio segment.

And 307, modifying the audio segment at the playing period corresponding to the field to be processed according to the target audio segment to obtain the target audio.

Specifically, the step 207 may be referred to in an implementation manner of this step, which is not limited in this embodiment of the present invention.

In summary, the audio processing method provided in the embodiment of the present invention may first obtain text information corresponding to a to-be-processed audio, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, then receive a first input for the to-be-processed text, determine, in response to the first input, a to-be-processed field in the to-be-processed text according to a field indicated by the first input, then receive a second input for the to-be-processed field, extract an audio segment carried in the second input, determine the audio segment as a target audio segment, and finally modify, according to the target audio segment, the audio segment at the playing period corresponding to the to-be-processed field, so as to obtain the target audio. Therefore, the target audio segment can be conveniently and rapidly obtained by directly extracting the audio segment carried in the second input, and therefore, the processing efficiency can be improved. Meanwhile, the user can modify the audio without manually adjusting the progress bar, so that the audio processing efficiency can be further improved.

With the above description of the audio processing method according to the embodiment of the present invention, an electronic device according to the embodiment of the present invention will be described with reference to the accompanying drawings.

Referring to fig. 4, an embodiment of the present invention further provides a block diagram of an electronic device, and as shown in fig. 4, the electronic device 40 may include:

a first obtaining module 401, configured to obtain text information corresponding to an audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed.

A first receiving module 402, configured to receive a first input for the text to be processed.

A first determining module 403, configured to determine, in response to the first input, a field to be processed in the text to be processed according to the field indicated by the first input.

A second receiving module 404, configured to receive a second input for the to-be-processed field.

A second obtaining module 405, configured to obtain the target audio segment according to the second input.

And a second determining module 406, configured to modify, according to the target audio segment, the audio segment at the playing time segment corresponding to the field to be processed, so as to obtain a target audio.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is first obtained, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, then a first input for the to-be-processed text is received, in response to the first input, a to-be-processed field in the to-be-processed text is determined according to a field indicated by the first input, then a second input for the to-be-processed field is received, in response to the second input, a target audio segment is obtained, and finally, according to the target audio segment, an audio segment at the playing period corresponding to the to-be-processed field is modified, so as to obtain the target audio. Therefore, the audio can be modified without manually adjusting the progress bar, and the audio processing efficiency can be improved.

Optionally, the second obtaining module 405 is configured to:

editing the field to be processed according to the second input to obtain a target field; determining the audio corresponding to the target field as the target audio segment; alternatively, the first and second electrodes may be,

extracting an audio segment carried in the second input; determining the audio segment as the target audio segment.

Optionally, the second obtaining module 405 is further configured to:

if the second input is deletion input, deleting the field to be processed, and determining a blank field obtained after deletion as the target field;

if the second input is the replacement input, acquiring a field to be replaced corresponding to the second input; deleting the field to be processed, and adding the field to be replaced at the position of the field to be processed to obtain the target field;

if the second input is an increase input, acquiring a field to be increased corresponding to the second input; and adding the field to be added at the position of the field to be processed to obtain the target field.

Optionally, the electronic device 40 further includes:

the first display module is used for displaying a preset picture and displaying all the texts to be processed in the preset picture; or displaying each video picture of the video to be processed; and displaying the text to be processed corresponding to the video picture in the video picture.

The first receiving module 402 is further configured to:

a selection input of the displayed text to be processed is received.

Optionally, the electronic device 40 further includes:

and the second display module is used for adding a preset mark to the displayed field to be processed and displaying the field to be replaced or the field to be added according to the display position corresponding to the field to be processed.

Optionally, the second determining module 406 is configured to:

acquiring the playing time interval corresponding to the field to be processed from the playing time interval corresponding to each field;

acquiring an audio waveform diagram corresponding to the audio to be processed;

and modifying the corresponding wave band of the playing time period corresponding to the field to be processed in the audio waveform diagram into the audio wave band corresponding to the target audio band to obtain the target audio.

Optionally, the electronic device 40 further includes:

a third receiving module, configured to receive a third input for the text to be processed.

And the first adjusting module is used for responding to the third input, adjusting the font size of the field to be adjusted indicated by the third input, and obtaining the adjusted field to be adjusted.

The second adjusting module is used for adjusting the volume of the audio corresponding to the field to be adjusted according to the adjusted font size of the field to be adjusted; and the larger the font of the field to be adjusted is, the larger the volume of the audio corresponding to the field to be adjusted is.

Optionally, the first obtaining module 401 is configured to:

detecting whether a subtitle file matched with the audio to be processed exists or not; the subtitle file comprises a subtitle text and a playing time interval corresponding to each field in the subtitle text;

if the subtitle file matched with the audio to be processed exists, taking the subtitle file as text information corresponding to the audio to be processed;

if the subtitle file matched with the audio to be processed does not exist, converting the audio contained in the audio to be processed into a text, and generating a playing time period corresponding to each field in the text according to the playing time information of the audio segment in the audio to be processed; and taking the text and the playing time interval corresponding to each field in the text as text information corresponding to the audio to be processed.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is obtained first, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, a first input for the to-be-processed text is received, in response to the first input, a to-be-processed field in the to-be-processed text is determined according to a field indicated by the first input, a second input for the to-be-processed field is received, the to-be-processed field is edited according to the second input, a target field is obtained, an audio corresponding to the target field is determined as a target audio segment, and finally, an audio segment at the playing period corresponding to the to-be-processed field is modified according to the target audio segment, so as to obtain the target audio. Therefore, corresponding editing operation can be executed according to different second inputs, so that various modification requirements of users can be met, and the audio modification effect is improved. Meanwhile, the user can modify the audio without manually adjusting the progress bar, so that the audio processing efficiency can be improved.

FIG. 5 is a diagram illustrating a hardware configuration of an electronic device implementing various embodiments of the invention;

the electronic device 500 includes, but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 5 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The processor 510 is configured to obtain text information corresponding to an audio to be processed; the text information comprises a text to be processed and a playing time period corresponding to each field in the text to be processed.

A processor 510 for receiving a first input for the text to be processed.

A processor 510, configured to determine, in response to the first input, a field to be processed in the text to be processed according to the field indicated by the first input.

A processor 510 for receiving a second input for the field to be processed.

A processor 510 for obtaining a target audio segment in response to the second input.

And the processor 510 is configured to modify the audio segment at the playing time segment corresponding to the field to be processed according to the target audio segment, so as to obtain a target audio.

To sum up, in the audio processing method provided in the embodiment of the present invention, text information corresponding to a to-be-processed audio is first obtained, where the text information includes the to-be-processed text and a playing period corresponding to each field in the to-be-processed text, then a first input for the to-be-processed text is received, in response to the first input, a to-be-processed field in the to-be-processed text is determined according to a field indicated by the first input, then a second input for the to-be-processed field is received, in response to the second input, a target audio segment is obtained, and finally, according to the target audio segment, an audio segment at the playing period corresponding to the to-be-processed field is modified, so as to obtain the target audio. Therefore, the audio can be modified without manually adjusting the progress bar, and the audio processing efficiency can be improved.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 501 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 510; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 502, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the electronic apparatus 500 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used to receive an audio or video signal. The input Unit 504 may include a Graphics Processing Unit (GPU) 5041 and a microphone 5042, and the Graphics processor 5041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphic processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 501 in case of the phone call mode.

The electronic device 500 also includes at least one sensor 505, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 5061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 5061 and/or a backlight when the electronic device 500 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 505 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The Display unit 606 may include a Display panel 5061, and the Display panel 5061 may be configured in the form of a liquid Crystal Display (L acquired Crystal Display, L CD), an Organic light-Emitting Diode (O L ED), or the like.

The user input unit 507 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 5071 using a finger, stylus, or any suitable object or attachment). The touch panel 5071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 510, and receives and executes commands sent by the processor 510. In addition, the touch panel 5071 may be implemented in various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may include other input devices 5072. In particular, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 5071 may be overlaid on the display panel 5061, and when the touch panel 6071 detects a touch operation on or near the touch panel, the touch operation is transmitted to the processor 510 to determine the type of the touch event, and then the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Although in fig. 5, the touch panel 5071 and the display panel 5061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated to implement the input and output functions of the electronic device, and is not limited herein.

The interface unit 508 is an interface for connecting an external device to the electronic apparatus 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic apparatus 500 or may be used to transmit data between the electronic apparatus 500 and external devices.

The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The processor 510 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 509 and calling data stored in the memory 509, thereby performing overall monitoring of the electronic device. Processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 510.

The electronic device 500 may further include a power supply 511 (e.g., a battery) for supplying power to various components, and preferably, the power supply 611 may be logically connected to the processor 510 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

In addition, the electronic device 500 includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 510, a memory 509, and an audio processing program that is stored in the memory 509 and can be run on the processor 510, and when the audio processing program is executed by the processor 510, the audio processing program implements each process of the above-mentioned embodiment of the audio processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

An embodiment of the present invention further provides a computer-readable storage medium, where an audio processing program is stored on the computer-readable storage medium, and when the audio processing program is executed by a processor, the audio processing program implements each process of the above-mentioned audio processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.