阅读说明：本技术 视频文件处理方法、装置、设备及存储介质 (Video file processing method, device, equipment and storage medium ) 是由 户龙辉 于 2021-11-02 设计创作，主要内容包括：本发明涉及数据处理技术领域,公开了一种视频文件处理方法、装置、设备及存储介质,所述方法包括：在检测到当前用户观看待处理视频文件时,获取当前用户的操作行为信息；根据操作行为信息确定当前用户的视频文件需求信息；根据视频文件需求信息和操作行为信息对待处理视频文件进行处理。相较于现有技术中需要人工一一查看多个视频文件才可处理观看视频文件,使得处理观看视频文件的过程较为繁琐,而本发明中直接根据视频文件需求信息和操作行为信息对待处理视频文件进行对应的处理,从而提高了视频文件的处理效率,进而提高了用户观看视频文件的体验感。(The invention relates to the technical field of data processing, and discloses a video file processing method, a device, equipment and a storage medium, wherein the method comprises the following steps: when detecting that a current user watches a video file to be processed, acquiring operation behavior information of the current user; determining video file demand information of a current user according to the operation behavior information; and processing the video file to be processed according to the video file demand information and the operation behavior information. Compared with the prior art that the video files can be processed and watched only by manually checking the plurality of video files one by one, the process of processing and watching the video files is relatively complex, and the video files to be processed are directly processed correspondingly according to the video file demand information and the operation behavior information, so that the processing efficiency of the video files is improved, and the experience of users watching the video files is further improved.)

1. A video file processing method is characterized by comprising the following steps:

when detecting that a current user watches a video file to be processed, acquiring operation behavior information of the current user;

determining video file demand information of the current user according to the operation behavior information;

and processing the video file to be processed according to the video file demand information and the operation behavior information.

2. The method according to claim 1, wherein the step of obtaining the operation behavior information of the current user when the current user is detected to watch the video file to be processed further comprises:

acquiring an ambient environment image based on a front camera;

carrying out face detection on the surrounding environment image to obtain a face detection result;

determining at least one face image and corresponding face azimuth information according to the face detection result;

judging whether the face orientation information meets a preset orientation condition;

when the face orientation information meets the preset orientation condition, selecting a target face image from at least one face image according to the face orientation information;

determining the face proportion value of the current user according to the target face image;

and when the face proportion score is larger than or equal to a preset threshold value, judging that the current user watches the video file to be processed.

3. The method of claim 2, wherein the step of determining whether the face orientation information satisfies a predetermined orientation condition comprises:

and converting the state information of the video file to be processed into a video file pause state when the face orientation information does not meet the preset orientation condition.

4. The method according to any one of claims 1 to 3, wherein the step of processing the video file to be processed according to the video file requirement information and the operation behavior information comprises:

and when the video file demand information is video file image screenshot, acquiring a pause frame image in the video file to be processed according to the operation behavior information, and adding the pause frame image into an interest image collection so that the current user can view the interest image collection.

5. The method according to claim 4, wherein the step of obtaining the pause frame image in the video file to be processed according to the operation behavior information comprises:

determining a picture to be intercepted according to the operation behavior information;

carrying out frame extraction on the video file to be processed to obtain a plurality of frame images;

respectively determining the weight values between the picture to be intercepted and the multi-frame images;

and determining a pause frame image from the multi-frame images according to the weight value.

6. The method according to any one of claims 1 to 3, wherein the step of processing the video file to be processed according to the video file requirement information and the operation behavior information further comprises:

when the video file demand information is to view an uploaded video, acquiring a video file integration set, wherein the video file to be processed is one video file in the video file integration set;

generating a video positioning link according to the video file to be processed;

and when the current user clicks the video positioning link, carrying out top setting processing on the video to be processed according to the video positioning link.

7. The method of claim 6, wherein the step of obtaining the integrated set of video files is further followed by:

selecting a plurality of frames of target images from a plurality of frames of images of the video file to be processed according to a preset frame selection rule;

determining a plurality of target video files from the video file integration set according to the multi-frame target images, and putting the plurality of target video files into a target video file set;

generating a video continuous playing link according to the target video file set and the video file to be processed;

and when the current user clicks the video continuous playing link, carrying out top setting processing on the video to be processed in the target video file set according to the video continuous playing link.

8. A video file processing apparatus, characterized in that the video file processing apparatus comprises:

the acquisition module is used for acquiring the operation behavior information of the current user when the current user is detected to watch the video file to be processed;

the determining module is used for determining the video file demand information of the current user according to the operation behavior information;

and the processing module is used for processing the video file to be processed according to the video file demand information and the operation behavior information.

9. A video file processing apparatus, characterized in that the apparatus comprises: a memory, a processor and a video file processing program stored on the memory and executable on the processor, the video file processing program being configured to implement the steps of the video file processing method according to any one of claims 1 to 7.

10. A storage medium having stored thereon a video file processing program which, when executed by a processor, implements the steps of the video file processing method according to any one of claims 1 to 7.

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for processing a video file.

Background

With the rapid development and maturity of computer networks, more and more video software is provided for users to select, and a plurality of video files which are interested by the users exist in the video software.

The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.

Disclosure of Invention

The invention mainly aims to provide a video file processing method, a video file processing device, video file processing equipment and a storage medium, and aims to solve the technical problem of how to improve the processing efficiency of video files.

In order to achieve the above object, the present invention provides a video file processing method, including:

when detecting that a current user watches a video file to be processed, acquiring operation behavior information of the current user;

determining video file demand information of the current user according to the operation behavior information;

and processing the video file to be processed according to the video file demand information and the operation behavior information.

Optionally, before the step of obtaining the operation behavior information of the current user when it is detected that the current user views the video file to be processed, the method further includes:

acquiring an ambient environment image based on a front camera;

carrying out face detection on the surrounding environment image to obtain a face detection result;

determining at least one face image and corresponding face azimuth information according to the face detection result;

judging whether the face orientation information meets a preset orientation condition;

when the face orientation information meets the preset orientation condition, selecting a target face image from at least one face image according to the face orientation information;

determining the face proportion value of the current user according to the target face image;

and when the face proportion score is larger than or equal to a preset threshold value, judging that the current user watches the video file to be processed.

Optionally, after the step of determining whether the face orientation information meets a preset orientation condition, the method includes:

and converting the state information of the video file to be processed into a video file pause state when the face orientation information does not meet the preset orientation condition.

Optionally, the step of processing the video file to be processed according to the video file demand information and the operation behavior information includes:

and when the video file demand information is video file image screenshot, acquiring a pause frame image in the video file to be processed according to the operation behavior information, and adding the pause frame image into an interest image collection so that the current user can view the interest image collection.

Optionally, the step of obtaining a pause frame image in the video file to be processed according to the operation behavior information includes:

determining a picture to be intercepted according to the operation behavior information;

carrying out frame extraction on the video file to be processed to obtain a plurality of frame images;

respectively determining the weight values between the picture to be intercepted and the multi-frame images;

and determining a pause frame image from the multi-frame images according to the weight value.

Optionally, the step of processing the video file to be processed according to the video file demand information and the operation behavior information further includes:

when the video file demand information is to view an uploaded video, acquiring a video file integration set, wherein the video file to be processed is one video file in the video file integration set;

generating a video positioning link according to the video file to be processed;

and when the current user clicks the video positioning link, carrying out top setting processing on the video to be processed according to the video positioning link.

Optionally, after the step of obtaining the integrated set of video files, the method further includes:

selecting a plurality of frames of target images from a plurality of frames of images of the video file to be processed according to a preset frame selection rule;

determining a plurality of target video files from the video file integration set according to the multi-frame target images, and putting the plurality of target video files into a target video file set;

generating a video continuous playing link according to the target video file set and the video file to be processed;

and when the current user clicks the video continuous playing link, carrying out top setting processing on the video to be processed in the target video file set according to the video continuous playing link.

Further, to achieve the above object, the present invention also proposes a video file processing apparatus comprising:

the acquisition module is used for acquiring the operation behavior information of the current user when the current user is detected to watch the video file to be processed;

the determining module is used for determining the video file demand information of the current user according to the operation behavior information;

and the processing module is used for processing the video file to be processed according to the video file demand information and the operation behavior information.

Further, to achieve the above object, the present invention also proposes a video file processing apparatus, comprising: a memory, a processor and a video file processing program stored on the memory and executable on the processor, the video file processing program being configured to implement the steps of the video file processing method as described above.

Furthermore, to achieve the above object, the present invention further provides a storage medium having a video file processing program stored thereon, which when executed by a processor implements the steps of the video file processing method as described above.

When detecting that the current user watches the video file to be processed, the method firstly obtains the operation behavior information of the current user, then determines the video file demand information of the current user according to the operation behavior information, and then processes the video file to be processed according to the video file demand information and the operation behavior information. Compared with the prior art that the video files can be confirmed only by manually checking the video files one by one and then the video files are processed, the process of processing the video files is relatively complicated, and the video files to be processed are directly processed correspondingly according to the video file demand information and the operation behavior information, so that the processing efficiency of the video files is improved, and the experience of users for watching the video files is further improved.

Drawings

Fig. 1 is a schematic structural diagram of a video file processing device in a hardware operating environment according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating a video file processing method according to a first embodiment of the present invention;

FIG. 3 is a schematic view of an operation interface of a video file processing method according to a first embodiment of the present invention;

FIG. 4 is a flowchart illustrating a video file processing method according to a second embodiment of the present invention;

FIG. 5 is a schematic view of a to-be-processed video file positioning according to a second embodiment of the video file processing method of the present invention;

FIG. 6 is a schematic diagram illustrating positioning of an associated video file according to a second embodiment of the video file processing method of the present invention;

FIG. 7 is a block diagram of a video file processing apparatus according to a first embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a video file processing device in a hardware operating environment according to an embodiment of the present invention.

As shown in fig. 1, the video file processing apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a keyboard (K board), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed Random Access Memory (RAM) or a Non-volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.

Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the video file processing apparatus and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a video file processing program.

In the video file processing apparatus shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 of the video file processing apparatus of the present invention may be provided in the video file processing apparatus, which calls the video file processing program stored in the memory 1005 through the processor 1001 and executes the video file processing method provided by the embodiment of the present invention.

An embodiment of the present invention provides a video file processing method, and referring to fig. 2, fig. 2 is a schematic flowchart of a first embodiment of the video file processing method according to the present invention.

In this embodiment, the video file processing method includes the following steps:

step S10: and when detecting that the current user watches the video file to be processed, acquiring the operation behavior information of the current user.

It is easy to understand that the execution subject of this embodiment may be a communication device having functions of image processing, data processing, network communication, program execution, and the like, the device may further determine the video file requirement information of the current user according to the operation behavior information, and process the video file according to the video file requirement information and the operation behavior information, and may also be other computer devices having similar functions, and the present embodiment is not limited thereto.

The video file to be processed may be understood as a video file uploaded by a certain user in the video software, the video state information of the video file to be processed may be a pause state, a play state, or the like, and the current user may be understood as a user watching or operating the video file to be processed, or the like.

In order to accurately determine that the current user views the video file to be processed, a front-facing camera or an external camera of the mobile terminal needs to acquire an ambient image in real time, in this embodiment, face detection is performed on the ambient image to obtain a face detection result, then at least one face image and corresponding face orientation information are determined according to the face detection result, whether the face orientation information meets a preset orientation condition is determined, when the face orientation information meets the preset orientation condition, a target face image is selected from the at least one face image according to the face orientation information, finally a face proportion score of the current user is determined according to the target face image, and when the face proportion score is greater than or equal to a preset threshold value, it is determined that the current user views the video file to be processed.

It should be noted that the surrounding image may include one or more user face images or may not include a user face avatar, and the like, at least one face image, face orientation information corresponding to each face image, and a face proportion score that is a proportion score of each face image in the surrounding image exist in the face detection result, and the face orientation information may be understood as orientation information of the face image in the surrounding image, and the orientation information may be left upper, left middle, left lower, lower middle, right lower, right middle, upper middle, right upper or center, and the like.

The preset orientation condition is that the face orientation information of the current user is in a lower-middle position and the like. The preset threshold may be set by a user, and if the surrounding image is divided into nine parts, the preset threshold may be one ninth, and the like.

In the concrete implementation, it is assumed that the front camera of the mobile terminal is used for acquiring the image of the surrounding environment in real time, the face detection needs to be carried out on the image of the surrounding environment, to obtain a face detection result, if 3 face images exist in the face detection result, the face images are respectively a face image A, a face image B and a face image C, the face orientation information of the face image A in the surrounding environment image is upper left, the face orientation information of the face image B in the surrounding environment image is upper right, the face orientation information of the face image C in the surrounding environment image is middle left, the preset orientation condition is that the face orientation information is in the middle lower position, and if the current video file to be processed is viewed in a playing state, the state information of the video file to be processed needs to be converted into a pause state and the like.

If 2 face images exist in the face detection result, namely a face image D and a face image E, face azimuth information corresponding to the face image D is the upper middle right, face azimuth information corresponding to the face image E is the middle lower, and the preset azimuth condition is that the face azimuth information is at the middle lower position, the face image E is taken as a face image of a current user, namely a target face image, if the surrounding environment image is divided into nine parts, a preset threshold value is one ninth, and the face proportion score of the current user is one ninth, the current user is judged to see a video file to be processed; if the face percentage value of the current user is zero five of nine, it is determined that the current user does not watch the video to be processed, and if the video file to be processed is in a playing state, the state information of the video file to be processed needs to be converted into a pause state and the like.

Step S20: and determining the video file demand information of the current user according to the operation behavior information.

The operation behavior information is operation behavior information of a current user on a current interface of the mobile terminal, for example, position information of a user clicking the current interface.

It should be noted that, if the position information of the user clicking the current interface is different, the video file demand information of the current user for the video to be processed is reflected, and the video file demand information may be intercepted for the video file image, or may be for viewing the uploaded video, and the like.

It should be understood that the information of the user click interface area is determined according to the operation behavior information, and then the video file demand information and the like are determined according to the information of the user click interface area.

In the specific implementation, referring to fig. 3, fig. 3 is a schematic view of an operation interface of the first embodiment of the video file processing method of the present invention, where d is a video file playing interface and a user operation interface, a, b, and c are operation behavior regions of the user operation interface, a click in the operation behavior region a can pause or play a video file to be processed, the operation behavior region b is a head portrait position of a video uploader, the operation behavior region b can be clicked to view all video files uploaded by the uploader, the operation behavior region c is an interest image aggregation region, a plurality of frame images of the video to be processed are stored in the operation behavior region c, the operation behavior region c can be clicked to view all interest images in the interest image aggregation, it should be noted that when the video file to be processed is in a playing state in the video file playing interface d, a current user can click the operation behavior region a, and then, the pause frame image is placed in the operation behavior area c, so that the user can conveniently click the operation behavior area c to check all the interest images in the interest image collection, and the like.

Step S30: and processing the video file to be processed according to the video file demand information and the operation behavior information.

The method for processing the video file to be processed according to the video file demand information and the operation behavior information may be that when the video file demand information is a video file image screenshot, a pause frame image in the video file to be processed is obtained according to the operation behavior information, and the pause frame image is added to the interest image collection so that the current user views the interest image collection, whereas in the prior art, the user needs to manually intercept an interest image in the video file to be processed by using screenshot software of the mobile terminal, so that not only the intercepted interest image is unclear, but also the intercepted interest image is shaded, and since the intercepted interest image is directly stored in a gallery of the mobile terminal, the user is not convenient to view and sort, in the embodiment, the pause frame image in the video file to be processed can be directly obtained, and the pause frame image is a frame image in the video file to be processed, and then, directly storing the pause frame image into the interest image set corresponding to the video to be processed, so that the current user can conveniently and clearly view and store a plurality of interest images in the interest image set aiming at the video to be processed.

It should also be understood that the user may select a plurality of interest images in the interest image collection to generate a dynamic image, etc., and the embodiment is not limited thereto.

It should be noted that, the processing manner of obtaining the pause frame image in the video file to be processed according to the operation behavior information may be to determine the picture to be captured according to the operation behavior information, then perform frame extraction on the video file to be processed, obtain multiple frames of images, respectively determine weight values between the picture to be captured and the multiple frames of images, and determine the pause frame image from the multiple frames of images according to the weight values.

The to-be-intercepted picture is a video pause picture when the current user pauses the to-be-processed video file, and it should be further noted that the to-be-processed video file is composed of multiple frames of images, and a weight value between the to-be-intercepted picture and the multiple frames of images, that is, a similarity between the to-be-intercepted picture and the multiple frames of images, may be represented by a character or a numerical value, for example, 80%, 90%, or 100%.

In order to accurately obtain an interest image of a current user, if a picture to be intercepted is h, 5 frame images exist in a video file to be processed, namely a frame image w, a frame image r, a frame image t, a frame image u and a frame image y, wherein the frame image w is consistent with the frame image r, 60% of a weight value between the frame image w and the frame image h is obtained as the picture to be intercepted, 60% of a weight value between the frame image r and the frame image h is obtained as the picture to be intercepted, 70% of a weight value between the frame image t and the frame image h is obtained as the picture to be intercepted, 80% of a weight value between the frame image u and the frame image y is obtained as the result of sorting is that the frame image y, the frame image r, the frame image t, the frame image u and the frame image y are sorted, and the sorting result is that the frame image y-the frame image u-frame image t-frame image r, The frame image w is a pause frame image or the like.

Supposing that a picture to be intercepted is q, 3 frame images exist in a video file to be processed, namely a frame image i, a frame image o and a frame image p, wherein the frame image i is consistent with the frame image o, the weight value of the picture to be intercepted between q and the frame image i is 95%, the weight value of the picture to be intercepted between q and the frame image o is 95%, the weight value of the picture to be intercepted between q and the frame image p is 60%, then the frame image i, the frame image o and the frame image p are sequenced according to the weight values, the sequencing result is the image i, the frame image o-the frame image p, and finally one of the image i and the frame image o is selected as a pause frame image and the like.

In this embodiment, the manner of processing the to-be-processed video file according to the video file demand information and the operation behavior information may also be that when the video file demand information is to view an uploaded video, an integrated set of video files is obtained, where the to-be-processed video file is one video file in the integrated set of video files, a video positioning link is generated according to the to-be-processed video file, and when it is detected that the current user clicks the video positioning link, a top-setting process is performed on the to-be-processed video according to the video positioning link.

In the specific implementation, in order to facilitate that a current user can continuously watch the associated video file of the video file to be processed, a plurality of frame target images can be selected from the plurality of frame images of the video file to be processed according to a preset frame selection rule, a plurality of target video files associated with the video file to be processed are screened out from the video file integration set according to the plurality of frame target images, the plurality of target video files are put into the target video file set, then a video continuous playing link is generated according to the target video file set and the video file to be processed, and finally when the video continuous playing link clicked by the current user is detected, the video to be processed is set in the target video file set according to the video continuous playing link.

In this embodiment, when it is detected that the current user views the video file to be processed, operation behavior information of the current user is first obtained, then video file demand information of the current user is determined according to the operation behavior information, and then the video file to be processed is processed according to the video file demand information and the operation behavior information. Compared with the prior art that the video files can be confirmed only by manually checking the video files one by one and then processing the video files, the process of processing the video files is relatively complicated, and the video files to be processed are directly processed correspondingly according to the video file demand information and the operation behavior information, so that the processing efficiency of the video files is improved, and the experience of users for watching the video files is improved.

Referring to fig. 4, fig. 4 is a flowchart illustrating a video file processing method according to a second embodiment of the present invention.

Based on the first embodiment, in this embodiment, the step S30 includes:

step S301: and when the video file demand information is to view the uploaded video, acquiring a video file integration set, wherein the to-be-processed video file is one video file in the video file integration set.

The video file integration set is all video files of the uploader corresponding to the video files to be processed.

When the video file demand information is that an uploaded video is viewed, a video file integration set is obtained, wherein a video file to be processed is one video file in the video file integration set, a video positioning link is generated according to the video file to be processed, and when the fact that a current user clicks the video positioning link is detected, the video to be processed is set on the top according to the video positioning link.

In the prior art, a user needs to actively slide pages to check videos one by one to determine a video file to be processed, corresponding video file address information is acquired according to the video file to be processed in the implementation, then a video positioning link is generated according to the video file address information, the current user can click the video positioning link to perform top setting processing and the like on the video to be processed, so that the video file to be processed is quickly searched, and the user experience is improved.

Referring to fig. 5, fig. 5 is a schematic view of positioning a to-be-processed video file according to a second embodiment of the video file processing method of the present invention, where an operation behavior area b in fig. 5 is a video uploader head portrait position, an operation behavior area b is clicked to view all video files uploaded by the uploader, that is, an e interface, where multiple video files exist, a user may slide the e interface up and down, f is a video continuous playing link, g is a video positioning link, and when the user clicks the video positioning link, the user may perform top-up processing on the to-be-processed video When the video file to be processed is the video file 10, the current user can slide an E interface up and down, for example, from the 1 st page to the 2 nd page, or from the 1 st page to the 3 rd page, and the like, and the current user can also click the g video positioning link, and then automatically jump to the 3 rd page in the value chart 5, and it can be known that the video file to be processed 10 is at the top position, and the like.

Step S302: and selecting a plurality of frames of target images from the plurality of frames of images of the video file to be processed according to a preset frame selection rule.

The preset frame selection rule is set by a user in a self-defined mode, three frames of images can be selected from the middle position of the video file to be processed at will, and one frame of image can be selected from the head position, the middle position and the tail position of the video file to be processed to serve as a target image. The present embodiment is not limited.

Step S303: and determining a plurality of target video files from the video file integration set according to the multi-frame target images, and putting the plurality of target video files into a target video file set.

The target video file is a file corresponding to the video file to be processed or similar, the processing mode of determining the multiple target video files from the video file integration set according to the multiple frame target images can be to acquire the multiple video files from the video file integration set, then select a plurality of frame images from the multiple video files respectively, compare the multiple frame target images with the plurality of frame images corresponding to the video files to obtain video similarity values between the video file to be processed and the video files corresponding to the multiple frame images, and when the video similarity values are larger than or equal to a preset similarity threshold value, take the video files corresponding to the multiple frame images as the target video files and the like.

The preset video similarity value is set by a user in a self-defined manner, and can be 8, 9 and the like, it should be noted that the maximum value is 10, the files are consistent, and the video is more irrelevant when the value is smaller.

Assuming that a plurality of video files in a video file integration set are respectively a video file A, a video file B and a video file C, respectively selecting three frames of images from the video file A, the video file B and the video file C, respectively matching a plurality of frames of target images in a video file to be processed with the three frames of images selected from the video file A, the video file B and the video file C, respectively, wherein the video similarity value of the video file to be processed and the video file A is 9, the video similarity value of the video file to be processed and the video file B is 10, the video similarity value of the video file to be processed and the video file C is 5, the preset similarity threshold value is 8, the video file A and the video file B are target video files, wherein the video similarity value of the video file to be processed and the video file B is 10, and the video file B is a video file to be processed, and the like.

Step S304: and generating a video continuous playing link according to the target video file set and the video file to be processed.

The current user can click the video continuous playing link and jump to the video file to be processed.

Step S305: and when the current user clicks the video continuous playing link, carrying out top setting processing on the video to be processed in the target video file set according to the video continuous playing link.

Referring to fig. 6, fig. 6 is a schematic diagram illustrating positioning of associated video files according to a second embodiment of the video file processing method of the present invention, where an operation behavior region b is a head portrait position of a video uploader, an operation behavior region b is clicked to view all video files uploaded by the uploader, that is, an e interface, where multiple video files exist, a user can slide the e interface up and down, f is a video continuous playing link, g is a video positioning link, and when the user clicks the video continuous playing link, the video to be processed can be set top, in this embodiment, when the user clicks the head portrait position of the video uploader when viewing the video to be processed, the user can enter the e interface, where multiple video files exist, that is, the e interface includes video file 1, video file 2, video file 3, video file 4, video file a, video file 6, video file 7, video file 8, and the like, When the video file to be processed is the video file 10, the current user can slide an E interface up and down, for example, slide from page 1 to page 2, jump from page 1 to page 3 through a video continuous playing link, and the like, and can click f a video positioning link to enter a target video file set, wherein the target video file set comprises the video file 1, the video file 2, the video file 3, the video file 4, the video file 6, the video file 7, the video file 8, the video file 9, the video file 10, the video file 11 and the video file 12, and the page 3 of the value graph 6 is automatically jumped in the target video file set, such that the pending video file 10 is in a set-top position, etc.

In this embodiment, when the video file demand information is to view an uploaded video, an integrated set of video files is obtained, where a video file to be processed is one of the integrated set of video files, a multi-frame target image is selected from multi-frame images of the video file to be processed according to a preset frame selection rule, a plurality of target video files associated with the video file to be processed are selected from the integrated set of video files according to the multi-frame target image, the plurality of target video files are placed into the target video file set, a video continuous play link is generated according to the target video file set and the video file to be processed, and finally, when it is detected that a user clicks the video continuous play link, a video to be processed is set in the target video file set according to the video continuous play link, and compared with the prior art, the associated video files cannot be sorted, and positioning the video file to be processed in the plurality of associated video files, but in this embodiment, the plurality of target video files may be put into the target video file set, then a video continuous playing link is generated according to the target video file set and the video file to be processed, and finally, when it is detected that the current user clicks the video continuous playing link, the top setting processing is performed on the video to be processed in the target video file set, so that the current user can quickly search the corresponding video file to be processed in the associated video file, thereby facilitating the user to continuously watch the plurality of associated video files.

Furthermore, an embodiment of the present invention further provides a storage medium, where a video file processing program is stored, and the video file processing program, when executed by a processor, implements the steps of the video file processing method as described above.

Referring to fig. 7, fig. 7 is a block diagram of a video file processing apparatus according to a first embodiment of the present invention.

As shown in fig. 7, the video file processing apparatus according to the embodiment of the present invention includes:

an obtaining module 7001, configured to obtain operation behavior information of a current user when it is detected that the current user views a video file to be processed.

The video file to be processed may be understood as a video file uploaded by a certain user in the video software, the video state information of the video file to be processed may be a pause state, a play state, or the like, and the current user may be understood as a user watching or operating the video file to be processed, or the like.

In order to accurately determine that the current user views the video file to be processed, a front-facing camera or an external camera of the mobile terminal needs to acquire an ambient image in real time, in this embodiment, face detection is performed on the ambient image to obtain a face detection result, then at least one face image and corresponding face orientation information are determined according to the face detection result, whether the face orientation information meets a preset orientation condition is determined, when the face orientation information meets the preset orientation condition, a target face image is selected from the at least one face image according to the face orientation information, finally a face proportion score of the current user is determined according to the target face image, and when the face proportion score is greater than or equal to a preset threshold value, it is determined that the current user views the video file to be processed.

It should be noted that the surrounding image may include one or more user face images or may not include a user face avatar, and the like, at least one face image, face orientation information corresponding to each face image, and a face proportion score that is a proportion score of each face image in the surrounding image exist in the face detection result, and the face orientation information may be understood as orientation information of the face image in the surrounding image, and the orientation information may be left upper, left middle, left lower, lower middle, right lower, right middle, upper middle, right upper or center, and the like.

The preset orientation condition is that the face orientation information of the current user is in a lower-middle position and the like. The preset threshold may be set by a user, and if the surrounding image is divided into nine parts, the preset threshold may be one ninth, and the like.

In the concrete implementation, it is assumed that the front camera of the mobile terminal is used for acquiring the image of the surrounding environment in real time, the face detection needs to be carried out on the image of the surrounding environment, to obtain a face detection result, if 3 face images exist in the face detection result, the face images are respectively a face image A, a face image B and a face image C, the face orientation information of the face image A in the surrounding environment image is upper left, the face orientation information of the face image B in the surrounding environment image is upper right, the face orientation information of the face image C in the surrounding environment image is middle left, the preset orientation condition is that the face orientation information is in the middle lower position, and if the current video file to be processed is viewed in a playing state, the state information of the video file to be processed needs to be converted into a pause state and the like.

If 2 face images exist in the face detection result, namely a face image D and a face image E, face azimuth information corresponding to the face image D is the upper middle right, face azimuth information corresponding to the face image E is the middle lower, and the preset azimuth condition is that the face azimuth information is at the middle lower position, the face image E is taken as a face image of a current user, namely a target face image, if the surrounding environment image is divided into nine parts, a preset threshold value is one ninth, and the face proportion score of the current user is one ninth, the current user is judged to see a video file to be processed; if the face percentage value of the current user is zero five of nine, it is determined that the current user does not watch the video to be processed, and if the video file to be processed is in a playing state, the state information of the video file to be processed needs to be converted into a pause state and the like.

A determining module 7002, configured to determine the video file requirement information of the current user according to the operation behavior information.

The operation behavior information is operation behavior information of a current user on a current interface of the mobile terminal, for example, position information of a user clicking the current interface.

It should be noted that, if the position information of the user clicking the current interface is different, the video file demand information of the current user for the video to be processed is reflected, and the video file demand information may be intercepted for the video file image, or may be for viewing the uploaded video, and the like.

It should be understood that the information of the user click interface area is determined according to the operation behavior information, and then the video file demand information and the like are determined according to the information of the user click interface area.

In the specific implementation, referring to fig. 3, fig. 3 is a schematic view of an operation interface of the first embodiment of the video file processing method of the present invention, where d is a video file playing interface and a user operation interface, a, b, and c are operation behavior regions of the user operation interface, a click in the operation behavior region a can pause or play a video file to be processed, the operation behavior region b is a head portrait position of a video uploader, the operation behavior region b can be clicked to view all video files uploaded by the uploader, the operation behavior region c is an interest image aggregation region, a plurality of frame images of the video to be processed are stored in the operation behavior region c, the operation behavior region c can be clicked to view all interest images in the interest image aggregation, it should be noted that when the video file to be processed is in a playing state in the video file playing interface d, a current user can click the operation behavior region a, and then, the pause frame image is placed in the operation behavior area c, so that the user can conveniently click the operation behavior area c to check all the interest images in the interest image collection, and the like.

And the processing module 7003 is configured to process the video file to be processed according to the video file demand information and the operation behavior information.

The method for processing the video file to be processed according to the video file demand information and the operation behavior information may be that when the video file demand information is a video file image screenshot, a pause frame image in the video file to be processed is obtained according to the operation behavior information, and the pause frame image is added to the interest image collection so that the current user views the interest image collection, whereas in the prior art, the user needs to manually intercept an interest image in the video file to be processed by using screenshot software of the mobile terminal, so that not only the intercepted interest image is unclear, but also the intercepted interest image is shaded, and since the intercepted interest image is directly stored in a gallery of the mobile terminal, the user is not convenient to view and sort, in the embodiment, the pause frame image in the video file to be processed can be directly obtained, and the pause frame image is a frame image in the video file to be processed, and then, directly storing the pause frame image into the interest image set corresponding to the video to be processed, so that the current user can conveniently and clearly view and store a plurality of interest images in the interest image set aiming at the video to be processed.

It should also be understood that the user may select a plurality of interest images in the interest image collection to generate a dynamic image, etc., and the embodiment is not limited thereto.

It should be noted that, the processing manner of obtaining the pause frame image in the video file to be processed according to the operation behavior information may be to determine the picture to be captured according to the operation behavior information, then perform frame extraction on the video file to be processed, obtain multiple frames of images, respectively determine weight values between the picture to be captured and the multiple frames of images, and determine the pause frame image from the multiple frames of images according to the weight values.

The to-be-intercepted picture is a video pause picture when the current user pauses the to-be-processed video file, and it should be further noted that the to-be-processed video file is composed of multiple frames of images, and a weight value between the to-be-intercepted picture and the multiple frames of images, that is, a similarity between the to-be-intercepted picture and the multiple frames of images, may be represented by a character or a numerical value, for example, 80%, 90%, or 100%.

In order to accurately obtain an interest image of a current user, if a picture to be intercepted is h, 5 frame images exist in a video file to be processed, namely a frame image w, a frame image r, a frame image t, a frame image u and a frame image y, wherein the frame image w is consistent with the frame image r, 60% of a weight value between the frame image w and the frame image h is obtained as the picture to be intercepted, 60% of a weight value between the frame image r and the frame image h is obtained as the picture to be intercepted, 70% of a weight value between the frame image t and the frame image h is obtained as the picture to be intercepted, 80% of a weight value between the frame image u and the frame image y is obtained as the result of sorting is that the frame image y, the frame image r, the frame image t, the frame image u and the frame image y are sorted, and the sorting result is that the frame image y-the frame image u-frame image t-frame image r, The frame image w is a pause frame image or the like.

Supposing that a picture to be intercepted is q, 3 frame images exist in a video file to be processed, namely a frame image i, a frame image o and a frame image p, wherein the frame image i is consistent with the frame image o, the weight value of the picture to be intercepted between q and the frame image i is 95%, the weight value of the picture to be intercepted between q and the frame image o is 95%, the weight value of the picture to be intercepted between q and the frame image p is 60%, then the frame image i, the frame image o and the frame image p are sequenced according to the weight values, the sequencing result is the image i, the frame image o-the frame image p, and finally one of the image i and the frame image o is selected as a pause frame image and the like.

In this embodiment, the manner of processing the to-be-processed video file according to the video file demand information and the operation behavior information may also be that when the video file demand information is to view an uploaded video, an integrated set of video files is obtained, where the to-be-processed video file is one video file in the integrated set of video files, a video positioning link is generated according to the to-be-processed video file, and when it is detected that the current user clicks the video positioning link, a top-setting process is performed on the to-be-processed video according to the video positioning link.

In the specific implementation, in order to facilitate that a current user can continuously watch the associated video file of the video file to be processed, a plurality of frame target images can be selected from the plurality of frame images of the video file to be processed according to a preset frame selection rule, a plurality of target video files associated with the video file to be processed are screened out from the video file integration set according to the plurality of frame target images, the plurality of target video files are put into the target video file set, then a video continuous playing link is generated according to the target video file set and the video file to be processed, and finally when the video continuous playing link clicked by the current user is detected, the video to be processed is set in the target video file set according to the video continuous playing link.

Referring to fig. 5, fig. 5 is a schematic view of positioning a to-be-processed video file according to a second embodiment of the video file processing method of the present invention, where an operation behavior area b in fig. 5 is a video uploader head portrait position, an operation behavior area b is clicked to view all video files uploaded by the uploader, that is, an e interface, where multiple video files exist, a user may slide the e interface up and down, f is a video continuous playing link, g is a video positioning link, and when the user clicks the video positioning link, the user may perform top-up processing on the to-be-processed video When the video file to be processed is the video file 10, the current user can slide an E interface up and down, for example, from the 1 st page to the 2 nd page, or from the 1 st page to the 3 rd page, and the like, and the current user can also click the g video positioning link, and then automatically jump to the 3 rd page in the value chart 5, and it can be known that the video file to be processed 10 is at the top position, and the like.

Referring to fig. 6, fig. 6 is a schematic diagram illustrating positioning of associated video files according to a second embodiment of the video file processing method of the present invention, where an operation behavior region b is a head portrait position of a video uploader, an operation behavior region b is clicked to view all video files uploaded by the uploader, that is, an e interface, where multiple video files exist, a user can slide the e interface up and down, f is a video continuous playing link, g is a video positioning link, and when the user clicks the video continuous playing link, the video to be processed can be set top, in this embodiment, when the user clicks the head portrait position of the video uploader when viewing the video to be processed, the user can enter the e interface, where multiple video files exist, that is, the e interface includes video file 1, video file 2, video file 3, video file 4, video file a, video file 6, video file 7, video file 8, and the like, When the video file to be processed is the video file 10, the current user can slide an E interface up and down, for example, slide from page 1 to page 2, jump from page 1 to page 3 through a video continuous playing link, and the like, and can click f a video positioning link to enter a target video file set, wherein the target video file set comprises the video file 1, the video file 2, the video file 3, the video file 4, the video file 6, the video file 7, the video file 8, the video file 9, the video file 10, the video file 11 and the video file 12, and the page 3 of the value graph 6 is automatically jumped in the target video file set, such that the pending video file 10 is in a set-top position, etc.

In this embodiment, when it is detected that the current user views the video file to be processed, operation behavior information of the current user is first obtained, then video file demand information of the current user is determined according to the operation behavior information, and then the video file to be processed is processed according to the video file demand information and the operation behavior information. Compared with the prior art that the video files can be confirmed only by manually checking the video files one by one and then processing the video files, the process of processing the video files is relatively complicated, and the video files to be processed are directly processed correspondingly according to the video file demand information and the operation behavior information, so that the processing efficiency of the video files is improved, and the experience of users for watching the video files is improved.

Other embodiments or specific implementations of the video file processing apparatus of the present invention may refer to the above method embodiments, and are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., a rom/ram, a magnetic disk, an optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.