Audio and video processing method and device, electronic equipment and readable storage medium

文档序号：1925644 发布日期：2021-12-03 浏览：13次中文

阅读说明：本技术 音视频处理方法、装置、电子设备及可读存储介质 (Audio and video processing method and device, electronic equipment and readable storage medium ) 是由蒋作函于 2021-08-30 设计创作，主要内容包括：本申请公开了一种音视频处理方法和装置,属于音视频处理技术领域。该方法包括：接收对目标音视频的第一输入,第一输入包括分段参数；响应于第一输入,显示目标音视频的预设进度条,并在预设进度条上显示节点,其中,节点用于按照分段参数对目标音视频进行分段,以及用于对所述目标音视频的分段结果进行编辑,以及用于在所述预设进度条中划分至少两个音视频片段中不同音视频片段的子进度条；接收对子进度条的第二输入,所述第二输入包括权重参数；响应于所述第二输入,对所述子进度条对应的音视频片段设置所述权重参数；按照所述至少两个音视频片段的排序,依次播放所述至少两个音视频片段,其中,所述排序与所述权重参数相关。(The application discloses an audio and video processing method and device, and belongs to the technical field of audio and video processing. The method comprises the following steps: receiving a first input of a target audio and video, wherein the first input comprises a segmentation parameter; responding to a first input, displaying a preset progress bar of a target audio and video, and displaying a node on the preset progress bar, wherein the node is used for segmenting the target audio and video according to a segmentation parameter, editing a segmentation result of the target audio and video, and dividing a sub-progress bar of different audio and video segments in at least two audio and video segments in the preset progress bar; receiving a second input to the child progress bar, the second input comprising a weight parameter; responding to the second input, and setting the weight parameters for the audio and video clips corresponding to the sub-progress bars; and sequentially playing the at least two audio and video clips according to the sequence of the at least two audio and video clips, wherein the sequence is related to the weight parameter.)

1. An audio-video processing method, characterized in that the method comprises:

receiving a first input to a target audio and video, wherein the first input comprises a segmentation parameter;

responding to the first input, displaying a preset progress bar of the target audio and video, and displaying nodes on the preset progress bar, wherein the nodes are used for segmenting the target audio and video according to the segmentation parameters, editing the segmentation result of the target audio and video, and dividing sub-progress bars of different audio and video fragments in at least two audio and video fragments in the preset progress bar;

receiving a second input to the sub-progress bar, the second input comprising a weight parameter;

responding to the second input, and setting the weight parameters for the audio and video clips corresponding to the sub-progress bars;

and sequentially playing the at least two audio and video clips according to the sequence of the at least two audio and video clips, wherein the sequence is related to the weight parameter.

2. The method of claim 1, wherein prior to receiving the second input to the sub-progress bar, the method further comprises:

receiving a third input of a target node in the nodes corresponding to the sub progress bar;

responding to the third input, and adjusting the corresponding time point and duration of a first audio and video segment in the target audio and video, wherein the first audio and video segment is an audio and video segment of which the sub progress bar comprises the target node in the at least two audio and video segments.

3. The method according to claim 1, wherein the playing the at least two audio/video clips in sequence according to the ordering of the at least two audio/video clips comprises:

sequencing the at least two audio and video clips based on preset parameters, wherein the preset parameters comprise the weight parameters or the ratio of the weight parameters to the duration of the audio and video clips;

and sequentially playing the at least two audio and video clips according to the sequence.

4. The method according to claim 3, wherein said sorting said at least two audio-video clips based on preset parameters comprises:

filtering the audio and video clips with the weight parameters as target values and the audio and video clips without the weight parameters in the at least two audio and video clips;

and sequencing the at least two filtered audio and video clips based on the preset parameters.

5. The method according to claim 3, wherein in the case that the preset parameter includes the weight parameter, the sorting of the at least two audio-video segments based on the preset parameter includes:

and sequencing the at least two audio and video clips according to the sequence of the values of the weight parameters from high to low.

6. The method according to claim 3, wherein in a case where the preset parameter includes a ratio of a weight parameter to a duration of the audio/video clips, the sorting the at least two audio/video clips based on the preset parameter includes:

and sequencing the at least two audio and video clips from large to small according to the ratio of the value of the weight parameter of the audio and video clips to the duration.

7. The method according to claim 1, wherein the playing the at least two audio/video clips in sequence according to the ordering of the at least two audio/video clips comprises:

receiving a fourth input to the preset progress bar;

and responding to the fourth input, and displaying the sequencing result of the at least two audio and video clips.

8. The method of claim 7, wherein after displaying the results of the ranking of the at least two audio-visual segments in response to the fourth input, the method further comprises:

receiving a fifth input of a second audio and video clip in the sequencing result, wherein the at least two audio and video clips comprise the second audio and video clip;

and responding to the fifth input, and sequentially playing the audio and video clips from the second audio and video clip according to the sequence.

9. An audio-video processing apparatus, characterized in that the apparatus comprises:

the first receiving module is used for receiving a first input of a target audio/video, wherein the first input comprises a segmentation parameter;

the first response module is used for responding to the first input, displaying a preset progress bar of the target audio and video and displaying a node on the preset progress bar, wherein the node is used for segmenting the target audio and video according to the segmentation parameters, editing the segmentation result of the target audio and video and dividing sub progress bars of different audio and video fragments in at least two audio and video fragments in the preset progress bar;

a second receiving module, configured to receive a second input to the sub-progress bar, where the second input includes a weight parameter;

the second response module is used for responding to the second input and setting the weight parameter for the audio and video clip corresponding to the sub progress bar;

and the playing module is used for sequentially playing the at least two audio and video clips according to the sequence of the at least two audio and video clips, wherein the sequence is related to the weight parameter.

10. An electronic device, characterized in that it comprises a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor implement the steps of the audio-video processing method as claimed in any one of claims 1 to 8.

11. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the audio-video processing method according to any one of claims 1 to 8.

Technical Field

The application belongs to the technical field of audio and video processing, and particularly relates to an audio and video processing method and device, electronic equipment and a readable storage medium.

Background

With the development of mobile internet, channels for people to acquire information are becoming more abundant. Wherein audio-video learning becomes an effective way for users to draw information on a daily basis. Compared with a text information mode of simply reading a book, the information browsing in an audio and video mode is more convenient for users.

Currently, when browsing audio and video information, in order to browse key information in the audio and video information, a user mainly processes the key information by triggering fast forward play, pause play, dragging a progress bar, screenshot, text note, and the like. However, these processing methods need to consume a long time to screen the important audio/video information, and the important information in the audio/video information cannot be quickly determined, which affects the browsing efficiency of the important information in the audio/video information.

Disclosure of Invention

The embodiment of the application aims to provide an audio and video processing method, an audio and video processing device, an electronic device and a readable storage medium, and can solve the problems that the audio and video processing method in the related art needs to consume a long time to screen important audio and video information, the important information in the audio and video information cannot be quickly determined, and the browsing efficiency of the important information in the audio and video information is influenced.

In a first aspect, an embodiment of the present application provides an audio and video processing method, where the method includes:

receiving a first input to a target audio and video, wherein the first input comprises a segmentation parameter;

receiving a second input to the sub-progress bar, the second input comprising a weight parameter;

responding to the second input, and setting the weight parameters for the audio and video clips corresponding to the sub-progress bars;

and sequentially playing the at least two audio and video clips according to the sequence of the at least two audio and video clips, wherein the sequence is related to the weight parameter.

In a second aspect, an embodiment of the present application provides an audio and video processing apparatus, where the apparatus includes:

the first receiving module is used for receiving a first input of a target audio/video, wherein the first input comprises a segmentation parameter;

a second receiving module, configured to receive a second input to the sub-progress bar, where the second input includes a weight parameter;

the second response module is used for responding to the second input and setting the weight parameter for the audio and video clip corresponding to the sub progress bar;

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, a preset progress bar of a target audio and video can be displayed by means of a segmentation parameter of the target audio and video input by a user, and a node is displayed on the preset progress bar, wherein the node is used for segmenting the target audio and video according to the segmentation parameter and is used for dividing sub-progress bars of different audio and video fragments in at least two audio and video fragments in the preset progress bar, and setting a weight parameter for the audio and video fragments corresponding to the sub-progress bars in response to the second input to the sub-progress bars, so that the segmentation parameter input by the user can be used for dividing the fragments of the target audio and video in a node mode on the preset progress bar, and when the user sets the weight parameter of the audio and video, key audio and video information required to be browsed is searched and screened without consuming a long time from the complete target audio and video, whether key audio and video information exists or not and the importance degree of the key audio and video information only need to be screened from audio and video fragments associated with each sub-progress bar after being divided by nodes, so that weight parameters are set for the audio and video fragments corresponding to the sub-progress bars, the key audio and video information is screened from long video key audio and video information to short video fragments, the screening efficiency of key audio and video information can be greatly improved, and the key information in the audio and video information can be quickly and clearly determined; moreover, when the audio and video clips with the weight parameters are played, the audio and video clips can be played in sequence according to the sequencing mode related to the weight parameters, so that more important audio and video information can be browsed in a limited time, the browsing time of key information in a target audio and video is effectively shortened, and the browsing efficiency is improved. In addition, the browsing of the target audio and video in the form of the long video occupies more time cost for the user, and the key audio and video information cannot be quickly identified to facilitate the targeted information browsing of the user; in addition, the preset progress bar is used for segmenting the target audio and video in a node dividing mode, so that a user can intuitively know the segmented result of the target audio and video after being divided based on the segmented condition of the progress bar in the preset progress bar, wherein the node in the preset progress bar can be used for editing the segmented result of the target audio and video, and therefore, the user can conveniently fine-tune the segmented effect of the target audio and video through the node; the weight is set for the audio and video clips corresponding to the sub-progress bar in the preset progress bar, so that the audio and video clips comprising important information can be effectively marked in the audio and video browsing process.

Drawings

Fig. 1 is a flowchart of an audio-video processing method according to an embodiment of the present application;

fig. 2A is one of schematic interface diagrams of an audio/video processing method according to an embodiment of the present application;

fig. 2B is a second schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 2C is a third schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 2D is a fourth schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 2E is a fifth schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 2F is a sixth schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 2G is a seventh schematic interface diagram of an audio/video processing method according to an embodiment of the present application;

fig. 3 is a block diagram of an audio-video processing device according to an embodiment of the present application;

FIG. 4 is a diagram of a hardware configuration of an electronic device according to an embodiment of the present application;

fig. 5 is a schematic hardware configuration diagram of an electronic device according to another embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The audio and video processing method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Referring to fig. 1, a flowchart of an audio and video processing method according to an embodiment of the present application is shown, where the method may specifically include the following steps:

101, receiving a first input of a target audio and video, wherein the first input comprises a segmentation parameter;

the processing object in each embodiment of the present application may be a video or an audio, and hereinafter, a target video is taken as an example for description, but the processing method described with a video as a processing object is also applicable to processing an audio, and the principle is similar, so that details are not repeated.

The first input can be triggered on a video playing interface or on a thumbnail interface of a video in a mobile phone.

Wherein the segmentation parameters are used for equally dividing the target video.

The parameter type of the segmentation parameter may include a value of a segment number parameter and a value of a duration parameter, where the value of the segment number parameter is used to indicate that the target video is divided into (for example, 5) video segments, and the value of the duration parameter is used to indicate that the target video is divided into (for example, 15 minutes) video segments, and certainly, considering that the duration of the whole video of the target video is not necessarily an integral multiple of the value of the set duration parameter, there may be a value of at least one video segment in the segmented video segments, where the duration of the at least one video segment is smaller than the set duration parameter.

Furthermore, in one embodiment, the segmentation parameter may include a value of a segment number parameter;

in another embodiment, the segmentation parameter may include a value of the duration parameter;

in yet another embodiment, the segmentation parameter may further include a plurality of values of a segment number parameter for equally dividing the target video a plurality of times.

For example, if the segment number parameters sequentially include 2 and 3, the target video may be equally divided into 2 video segments, and the 2 video segments may be further refined and equally divided into 3 video segments, so as to generate 6 video segments with the same duration.

Illustratively, as shown in fig. 2A, a playing interface 10 of a video is shown, and a user may trigger a playing progress bar 11 and a preset icon 12 for displaying the video in the playing interface 10 by clicking any position of the playing interface 10. Wherein the video duration is 1.5 hours, and the playing progress is the first 30 minutes. Wherein, the preset icon 12 can be a segment editing entry of the video. By clicking the preset icon 12 with the user's finger, a text box 13 may be displayed on the playing interface, and the user is prompted to input the segmentation amount for segmenting the video, that is, the segmentation parameters described above, for example, the user may input 6 segments in the text box 13, which means that the target video is divided into 6 video segments according to the playing sequence.

Step 102, responding to the first input, displaying a preset progress bar of the target audio and video, and displaying nodes on the preset progress bar;

the node is used for segmenting the target audio and video according to the segmentation parameters, editing the segmentation result of the target audio and video, and dividing a sub progress bar of different audio and video segments in at least two audio and video segments in the preset progress bar.

In the step, nodes can be distributed on the preset progress bar according to the segmentation parameters, so that the preset progress bar is divided in a mode of different sub-progress bars formed by the nodes; because the preset progress bar completely corresponds to the playing time of the target audio and video, the division of different audio and video fragments of the target audio and video can be realized in a mode of dividing the preset progress bar into different sub-progress bars by nodes.

Certainly, in this step, the time position displayed by the node in the preset progress bar is mainly used to represent the division mode of the first input on the audio/video clip of the target audio/video, but this step does not necessarily divide the audio/video clip of the target audio/video according to the division mode, and the division of the audio/video clip can be flexibly performed at a proper time as required, so that the target audio/video is divided into at least two audio/video clips.

For example, the audio and video segments of the target audio and video may be divided in this step, taking the video as an example, the segmentation processing in this step is performed by equally dividing the video, so that the durations of most of the generated at least two video segments are the same; moreover, when the video is segmented, the segmentation is sequentially performed according to the playing time sequence, so that at least two generated video segments are video segments with continuous playing time, in other words, at least two video segments are sequentially connected according to the playing time, and the original target video can still be restored.

For another example, after the step 105, that is, after the weight parameter is set for the audio/video segment corresponding to the sub-progress bar, the audio/video segment of the target audio/video may be divided, because after the weight parameter is set, it may be clear that the user has determined the segmentation result of each node displayed in the preset progress bar corresponding to the target audio/video, and before the weight parameter is set, the user may flexibly adjust the segmentation result of the target audio/video segmented according to the segmentation parameter as needed.

Taking a video as an example, in order to visualize the segmentation result of the target audio/video, the segmentation result of the video may be embodied in a manner of segmentation of a progress bar, and then the progress bar for displaying the video segmentation result, or for performing segmentation editing on the video, may be referred to as a preset progress bar. The preset progress bar can be the playing progress bar 11 in fig. 2B, and the purpose is achieved by adding some additional functions of video editing set by the present application to the playing progress bar 11; alternatively, the preset progress bar may be a separately arranged progress bar that can be used for segmenting the video, such as the paragraph progress bar 20 shown in fig. 2B.

It should be noted that the length of the paragraph progress bar 20 and the length of the video displayed, and the playing time range are the same as those of the playing progress bar 11, in fig. 2B, the paragraph progress bar 20 is displayed in parallel above the playing progress bar 11, and the start position and the end position of the two progress bars are aligned, that is, the paragraph progress bar 20 also shows the playing sequence of the video frames from the beginning of the progress bar to the end of the progress bar, except that the paragraph progress bar 20 does not display the playing progress. In other embodiments, the application does not limit the position of the paragraph progress bar 20 relative to the playing progress bar 11, for example, on the basis of fig. 2B, the paragraph progress bar 20 may be translated to the left in the direction of the camera of the mobile phone.

The preset progress bar is used as the paragraph progress bar 20 for illustration, but this is not used to limit the present application.

Optionally, based on a node in the preset progress bar, after the target audio/video is segmented, the time point of one of the generated at least two audio/video segments may include each playing time point of the audio/video segment, or the playing time range of the audio/video segment, or the starting playing time point and the ending playing time point of the audio/video segment.

Exemplarily, after the segmentation amount of fig. 2A is input and confirmed, it may turn to display fig. 2B, in fig. 2B, when the paragraph progress bar 20 indicates, by different shades, that such segmentation amount is used for the segmentation of the target audio/video, the sub-progress bars corresponding to different video segments are generated, and in other embodiments, the sub-progress bars corresponding to different video segments in the paragraph progress bar may be marked with different colors.

In addition, node a, node B, node C, node D, node E, and node F may be displayed in the paragraph progress bar 20, and the sub-progress bars of the respective video segments are divided by these nodes. Different nodes are identified herein with different letters, and in other embodiments, different nodes may be represented by other indicia of the user.

In addition, the 6 nodes are generated at corresponding positions on the paragraph progress bar according to the end time points of the respective video segments. In other embodiments, each node may be generated on the paragraph progress bar 20 according to the starting time point of each video segment, each node may be generated on the paragraph progress bar 20 according to the starting time point and the ending time point of each video segment, or node division may be performed in a manner of being able to distinguish sub-progress bars of different video segments (for example, node F in fig. 2B may be omitted).

In fig. 2B, the target video may be divided into 6 segments, a video segment of 0 to 15 minutes of the target video corresponds to the sub-progress bar 21, a video segment of 15 to 30 minutes corresponds to the sub-progress bar AB, a video segment of 30 to 45 minutes corresponds to the sub-progress bar BC, a video segment of 45 to 60 minutes corresponds to the sub-progress bar CD, a video segment of 60 to 75 minutes corresponds to the sub-progress bar DE, and a video segment of 75 to 90 minutes corresponds to the sub-progress bar EF. The different video clips do not include the same frame of video image, and for example, only one video between the 15 th to 30 th minute video clip and the 30 th to 15 th minute video clip determines that the 30 th minute frame of video image exists.

In this way, the user can input the segmentation amount to indicate that the video is divided into a plurality of equal parts to form a plurality of video segments, and mark the segment end node, wherein the end node of the upper segment is the start node of the lower segment.

Step 104, receiving a second input to the sub-progress bar, wherein the second input comprises a weight parameter;

as described above, in consideration of various ways of generating nodes in the sub-progress bar, the sub-progress bar may include at least one of the start node and the end node. Then the second input may be an input to a paragraph of the sub-progress bar, for example, the finger clicks a paragraph of the sub-progress bar CD in fig. 2D; the second input may also be an input to any one of the nodes of the sub-progress bar, for example, the finger clicks the node a of the sub-progress bar 21 in fig. 2D.

As shown in fig. 2D, after clicking the node a of the sub-progress bar 21, a text box 31 with transparency may be displayed on the play interface to prompt the user to set a weight value of the video clip of 0 to 15 minutes corresponding to the sub-progress bar 21, and optionally, a title may also be set for the video clip of 0 to 15 minutes; similarly, after clicking the sub-progress bar 22 (i.e. the sub-progress bar CD), the text box 32 may also be displayed to prompt the user to set the weight value of the video clip of the 60 th to 75 th minutes corresponding to the sub-progress bar 22, and optionally, a title may also be set.

In addition, in step 104, a second input may be triggered to the sub-progress bar corresponding to the video clip to which the weight needs to be set, so as to set the weight value for the video clip corresponding to the sub-progress bar, for example, the value range of the weight value is 0 to 10, and the higher the value is, the higher the importance degree of the key information included in the video clip is represented.

When the weight value set for a video clip is 0, it indicates that the information in the video clip is not important, and the effect is equivalent to not setting the weight value for the video clip, and then for the video clip in this case, the video clip may not only participate in the sorting of the video clips, but also participate in the playing of the video clips.

Therefore, when the user considers that some video segments are not important, the user can set the weight of the video segment to 0 or directly set no weight to the video segment, so as to achieve the effect of subsequently filtering the video segment.

Step 105, responding to the second input, and setting the weight parameters for the audio and video clips corresponding to the sub progress bars;

and 106, sequentially playing the at least two audio and video clips according to the sequence of the at least two audio and video clips, wherein the sequence is related to the weight parameter.

In this step, each video segment may be automatically played according to the sequence, or the playing step may be triggered after receiving an input from a user.

Optionally, when step 106 is executed, the at least two audio/video clips may be sorted based on a preset parameter, where the preset parameter includes the weight parameter, or a ratio of the weight parameter to a duration of the audio/video clip; and then, sequentially playing the at least two audio and video clips according to the sequence.

For example, the video may be played in sequence according to the sorting of the weight values, or the video clips may be played in sequence according to the sorting of the ratio of the weight values to the duration values.

In the embodiment of the application, at least two audio and video clips can be sequenced according to the weight parameters, and output and play are performed according to the sequencing, so that a user can browse audio and video information with higher importance degree quickly; and at least two audio/video clips can be output and played according to the sequencing of the ratio of the weight parameter to the duration, so that a user can browse more audio/video information with higher importance degree in a shorter time.

Optionally, after step 102 and before step 104, the method according to the embodiment of the present application may further include: receiving a third input of a target node in the nodes corresponding to the sub progress bar; responding to the third input, and adjusting the corresponding time point and duration of a first audio and video segment in the target audio and video, wherein the first audio and video segment is an audio and video segment of which the sub progress bar comprises the target node in the at least two audio and video segments.

When the user is unsatisfied with the effect of dividing the audio and video clips directly according to the segmentation parameters, the third input can be triggered by the node of the sub progress bar, so that the fine adjustment of the division mode of the audio and video clips is realized.

The target node may be a start node, and/or an end node of the child progress bar. Referring to fig. 2B and 2C, the user drags the node B along the arrow direction in fig. 2C, so that the time point and the duration of the video segment corresponding to the sub-progress bar AB and the time point and the duration of the video segment corresponding to the sub-progress bar BC are both adjusted, wherein the video playing range of the video segment corresponding to the sub-progress bar AB is lengthened, the duration is lengthened, and specifically, the ending position is lengthened; and the video playing range of the video segment corresponding to the sub-progress bar BC is shortened, the duration is also shortened, specifically, from the starting position.

For example, if the node B drags the video duration of 5 minutes along the arrow direction, the video segment corresponding to the sub-progress bar AB is adjusted from the video segment of 15 to 30 minutes to the video segment of 15 to 35 minutes; the video clip corresponding to the sub-progress bar BC is adjusted from the video clip of 30-45 minutes to the video clip of 35-45 minutes.

It should be noted that, the third input is triggered to the target node of the sub-progress bar in the preset progress bar, and the playing progress of the target audio and video is not changed, even though the playing progress bar 11 in fig. 2A is used as the preset progress bar, the current playing progress of the video is not changed for the movement of the node.

In the embodiment of the application, when the segmentation parameters are used for dividing the audio and video segments of the target audio and video, the time lengths of the audio and video segments generated by the segmentation are substantially consistent, so that a user can divide the audio and video segments based on the actual layout condition of each interested information point in the target audio and video, and the user can flexibly adjust the time point and the time length of each audio and video segment generated by the segmentation of the segmentation parameters by triggering the input mode of the target node in the sub progress bar, so that each adjusted audio and video segment meets the browsing requirement of the user on important information (namely the interested information).

Optionally, after step 105, before step 106, the method according to the embodiment of the present application may further display the weight parameter set for each audio/video segment on the sub-progress bar corresponding to each audio/video segment, where the specific display position may be a middle position of the sub-progress bar.

Optionally, if the user does not set a title for each audio/video clip, the method of the embodiment of the present application may use the end node of each sub-progress bar as the title of the audio/video clip of the sub-progress bar.

For example, in the paragraph progress bar 20 in fig. 2E, the middle position in each sub-progress bar shows the value of the weight parameter, the sub-progress bar 21 shows that the weight value of the video clip (title a) at 0-15 minutes is 3, the sub-progress bar AB shows that the weight value of the video clip (title B) at 15-35 minutes is 8, the sub-progress bar BC shows that the weight value of the video clip (title C) at 35-45 minutes is 2, the sub-progress bar CD shows that the weight value of the video clip (title D) at 45-60 minutes is 0, the sub-progress bar DE shows that the weight value of the video clip (title E) at 60-75 minutes is 2, and the sub-progress bar EF shows that the weight value of the video clip (title F) at 75-90 minutes is 5.

Optionally, when the at least two audio/video segments are sequenced based on preset parameters, the audio/video segments with the value of the weight parameter being the target value and the audio/video segments without the weight parameter being set in the at least two audio/video segments may be filtered; and then, sequencing the at least two filtered audio and video clips based on the preset parameters.

For example, referring to the above example of the weight value, a weight value of 0 indicates that the video segment is not important, and therefore, the target value here is 0, and in other embodiments, the target value may be other values than 0 in consideration of the difference of the value range of the weight value, which is not limited in this application, so in fig. 2E, the video segment corresponding to the sub-progress bar CD may be filtered out and does not participate in the sorting and the sequential playing.

In the embodiment of the application, when the target audio and video is segmented according to the segmentation parameters (such as the time length or the segmentation amount), the time among the generated audio and video segments can be continuous, therefore, a complete target audio/video is formed, and in consideration of browsing some audio/video segments in the target audio/video without special attention of a user, therefore, the user can set the weighted value of the audio/video segments as a target value, or the weighted value is not set, so as to achieve the purpose of discarding some audio and video clips after segmentation, these discarded audiovisual segments need not participate in the sequencing between audiovisual segments and in the video playback according to the audiovisual segments, therefore, the browsing time of the user on the video is saved, and the browsing efficiency on points of interest in the audio and video are improved.

Optionally, under the condition that the preset parameter includes the weight parameter, when the at least two audio/video clips are sorted based on the preset parameter, the at least two audio/video clips may be sorted in an order from high to low according to the value of the weight parameter.

When the audio and video clips are ordered, if two or more than two audio and video clips have the same weight value, the audio and video clips with the same weight value can be ordered according to the playing time sequence in the target audio and video or the arrangement sequence of the sub progress bars in the preset progress bar.

Accordingly, as shown in fig. 2G, the video clip of the sub-progress bar BC, i.e., the video clip titled C, has a weight value of 2, but is arranged in front of the video clip titled E, which also has a weight value of 2.

In the embodiment of the application, when at least two segmented audio and video segments are sequenced, the audio and video segments can be sequenced and played in a descending order according to the value of the weight parameter of each audio and video segment, so that the audio and video segments with higher weight can be played preferentially, a user can be ensured to browse audio and video contents with higher importance preferentially under the condition of limited audio and video browsing time, the user can browse the most important or most interested information preferentially by browsing the audio and video segments conveniently, the user can be helped to summarize and sort the audio and video information rapidly, and the user can browse and review the important information effectively from the user.

Optionally, under the condition that the preset parameter includes a ratio of a weight parameter to a duration of the audio/video clips, when the at least two audio/video clips are sorted based on the preset parameter, the at least two audio/video clips may be sorted in descending order according to the ratio of the value of the weight parameter to the duration of the audio/video clips.

When sorting, if the ratio of the weighted value to the duration of two or more audio/video clips is the same, the audio/video clips with the same ratio can be sorted according to the playing time sequence in the target audio/video or the arrangement sequence of the sub-progress bars in the preset progress bar.

After the weighted values are set for the audio/video clips, the audio/video clips can be automatically sorted, that is, the audio/video clips are automatically added to the video path diagram (i.e., the sorting result frame 41 in fig. 2F and the sorting result frame 42 in fig. 2G) of the user.

In the embodiment of the application, when at least two segmented audio/video segments are sequenced, sequencing and playing can be performed according to the sequence from large to small of the ratio of the value of the weight parameter of each audio/video segment to the duration, so that a user can be ensured to browse more important or more interesting audio/video contents through the playing of the audio/video segments in the shortest time, the browsing efficiency of the interesting and important audio/video contents is improved, and the browsing time is shortened.

Optionally, when step 106 is executed, the display may be automatically played, or played after receiving an input operation, or played after being triggered by a user after displaying a sorting result, as described in the following embodiments.

Optionally, in executing step 106, a fourth input to the preset progress bar may be received; and responding to the fourth input, and displaying the sequencing result of the at least two audio and video clips.

The fourth input may be triggered by inputting any one of the sub-progress bars in the preset progress bar, or triggered by inputting a start node or an end node of any one of the sub-progress bars, where the input may be a double-click input, a long-press input, or the like, and the application does not limit this.

As shown in fig. 2F, the finger double-clicks the sub-progress bar AB, thereby displaying a sorting result frame 41, and the sorting result frame 41 displays a sorting result according to a ratio of the weight value to the duration; as shown in fig. 2G, the finger double-clicks the sub-progress bar AB, thereby displaying a sorting result frame 42, and the sorting result frame 42 displays the results sorted by the weight value.

Optionally, the sorting result frame 41 and the sorting result frame 42 may be displayed on the playing interface 10 in a certain transparency, or the sorting result may be displayed on the playing interface 10 in a subtitle manner, which is not limited in this application.

In the embodiment of the application, the sequencing result of the at least two audio and video clips can be displayed by a mode that the user triggers the fourth input to the preset progress bar, so that the user can conveniently search the audio and video clips needing to be browsed by browsing the sequencing result.

Optionally, after the displaying the sequencing result of the at least two audio/video clips in response to the fourth input, the method according to the embodiment of the present application may further include: receiving a fifth input of a second audio and video clip in the sequencing result, wherein the at least two audio and video clips comprise the second audio and video clip; and responding to the fifth input, and sequentially playing the audio and video clips from the second audio and video clip according to the sequence.

As shown in fig. 2F, if the user needs to select a video segment to be browsed and learned first from the sorting result box, the user may trigger playing of the video segments in the sorting order from the selected video segment by clicking the titles of the corresponding video segments in the sorting result box 41 or the sorting result box 42.

For example, if the user selects the title F in the sorting result frame 41, the video clips corresponding to the title F are played, and the video clips corresponding to the titles C, a, and E are sequentially played.

The manner of selecting the video segment to be played first in the sorting result frame 42 is the same, and is not described in detail.

In the embodiment of the application, after the sequencing results of the audio and video clips are displayed, a user can select an interested option of one audio and video clip from the sequencing results to trigger the audio and video clips to be played in sequence according to the sequencing, so that the user can browse the interested audio and video clips more quickly.

It should be noted that in the audio/video processing method provided in the embodiment of the present application, the execution main body may be an audio/video processing device, or a control module used for executing the audio/video processing method in the audio/video processing device. In the embodiment of the present application, an audio/video processing device is taken as an example to execute an audio/video processing method, and the audio/video processing device provided in the embodiment of the present application is described.

Referring to fig. 3, a block diagram of an audio video processing device according to an embodiment of the present application is shown. The audio and video processing device comprises:

a first receiving module 201, configured to receive a first input of a target audio/video, where the first input includes a segmentation parameter;

a first response module 202, configured to, in response to the first input, display a preset progress bar of the target audio/video, and display a node on the preset progress bar, where the node is configured to segment the target audio/video according to the segmentation parameter, edit a segmentation result of the target audio/video, and divide a sub-progress bar of different audio/video segments of at least two audio/video segments in the preset progress bar;

a second receiving module 203, configured to receive a second input to the sub-progress bar, where the second input includes a weight parameter;

a second response module 204, configured to respond to the second input, and set the weight parameter for the audio/video segment corresponding to the sub-progress bar;

the playing module 205 is configured to sequentially play the at least two audio/video clips according to the sequence of the at least two audio/video clips, where the sequence is related to the weight parameter.

Optionally, the apparatus further comprises:

a third receiving module, configured to receive a third input to a target node in the nodes corresponding to the sub-progress bar;

and the third response module is used for responding to the third input and adjusting the corresponding time point and duration of a first audio and video clip in the target audio and video, wherein the first audio and video clip is an audio and video clip of which the sub progress bars of the at least two audio and video clips comprise the target node.

Optionally, the playing module 205 includes:

the sequencing submodule is used for sequencing the at least two audio and video clips based on preset parameters, wherein the preset parameters comprise the weight parameters or the ratio of the weight parameters of the audio and video clips to the duration;

and the playing submodule is used for sequentially playing the at least two audio and video clips according to the sequence.

Optionally, the sorting sub-module includes:

the filtering unit is used for filtering the audio and video clips of which the weight parameters are target values and the audio and video clips of which the weight parameters are not set in the at least two audio and video clips;

and the sequencing unit is used for sequencing the at least two filtered audio and video clips based on the preset parameters.

Optionally, the sorting sub-module is further configured to, when the preset parameter includes the weight parameter, sort the at least two audio/video clips in an order from high to low according to a value of the weight parameter.

Optionally, the sorting sub-module is further configured to, when the preset parameter includes a ratio of a weight parameter of the audio/video clip to a duration, sort the at least two audio/video clips in order from large to small according to the ratio of a value of the weight parameter of the audio/video clip to the duration.

Optionally, the playing module 205 includes:

the receiving submodule is used for receiving a fourth input of the preset progress bar;

and the display sub-module is used for responding to the fourth input and displaying the sequencing result of the at least two audio and video clips.

Optionally, the apparatus further comprises:

the fourth receiving module is used for receiving a fifth input of a second audio and video clip in the sequencing result, wherein the at least two audio and video clips comprise the second audio and video clip;

and the fourth response module is used for responding to the fifth input and sequentially playing the audio and video clips from the second audio and video clip according to the sequence.

The audio/video processing device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The audio/video processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.

The audio and video processing device provided by the embodiment of the application can implement each process implemented by the above method embodiment, and is not described here again to avoid repetition.

Optionally, as shown in fig. 4, an electronic device 2000 is further provided in this embodiment of the present application, and includes a processor 2002, a memory 2001, and a program or an instruction stored in the memory 2001 and executable on the processor 2002, where the program or the instruction is executed by the processor 2002 to implement each process of the above-mentioned audio/video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Fig. 5 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 5 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The device comprises a user input unit 1007, a display unit and a display unit, wherein the user input unit is used for receiving a first input of a target audio and video, and the first input comprises a segmentation parameter; receiving a second input to the sub-progress bar, the second input comprising a weight parameter;

the processor 1010 is configured to respond to the first input, display a preset progress bar of the target audio/video, and display a node on the preset progress bar, where the node is configured to segment the target audio/video according to the segmentation parameter, edit a segmentation result of the target audio/video, and divide a sub-progress bar of different audio/video segments of at least two audio/video segments in the preset progress bar; setting the weight parameters for the audio and video clips corresponding to the sub-progress bars;

and an audio output unit 1003, configured to sequentially play the at least two audio/video clips according to the sequence of the at least two audio/video clips, where the sequence is related to the weight parameter.

Optionally, the user input unit 1007 is configured to receive a third input to a target node in the nodes corresponding to the sub-progress bar;

and the processor 1010 is configured to adjust the corresponding time point and duration of a first audio/video segment in the target audio/video in response to the third input, where the first audio/video segment is an audio/video segment of which a child progress bar includes the target node in the at least two audio/video segments.

Optionally, the processor 1010 is configured to sort the at least two audio/video clips based on a preset parameter, where the preset parameter includes the weight parameter, or a ratio of the weight parameter to a duration of the audio/video clip;

and the display unit 1006 is configured to sequentially play the at least two audio/video clips according to the sequence.

Optionally, the processor 1010 is configured to filter audio and video segments of which the weight parameter is a target value and audio and video segments of which the weight parameter is not set, among the at least two audio and video segments; and sequencing the at least two filtered audio and video clips based on the preset parameters.

Optionally, the processor 1010 is configured to, when the preset parameter includes the weight parameter, sort the at least two audio/video clips in an order from high to low according to a value of the weight parameter.

Optionally, the processor 1010 is configured to, when the preset parameter includes a ratio of a weight parameter of the audio/video segment to a duration, sort the at least two audio/video segments in order from large to small according to a ratio of a value of the weight parameter of the audio/video segment to the duration.

Optionally, the user input unit 1007 is configured to receive a fourth input to the preset progress bar;

a processor 1010, configured to display a result of the ranking of the at least two audio/video clips in response to the fourth input.

Optionally, the user input unit 1007 is configured to receive a fifth input to a second audio/video segment in the sorting result, where the at least two audio/video segments include the second audio/video segment;

and the processor 1010 is configured to respond to the fifth input, and sequentially play the audio/video clips from the second audio/video clip according to the sequence.

It should be understood that in the embodiment of the present application, the input Unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, and the Graphics Processing Unit 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned audio/video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions, so that the processes of the embodiment of the audio and video processing method are realized, the same technical effects can be achieved, and the repeated description is omitted here for avoiding repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

26页详细技术资料下载

上一篇：一种医用注射器针头装配设备

下一篇：一种智能投放视频播放方法及系统

Audio and video processing method and device, electronic equipment and readable storage medium

相关技术

网友询问留言