阅读说明：本技术 建立视频图谱的方法、装置、电子设备、存储介质 (Method and device for establishing video map, electronic equipment and storage medium ) 是由 郑勇平 蔡世光 于 2020-05-06 设计创作，主要内容包括：本发明提供一种建立视频图谱的方法、装置、电子设备、存储介质。建立视频图谱的方法包括：至少按一特征类型,在待处理视频中提取视频帧作为图谱图片；以及建立各所述图谱图片与所述视频帧在所述待处理视频中的位置索引,且各所述图谱图片关联所述特征类型的特征信息,以建立所述待处理视频的视频图谱,所述特征信息用于检索所述图谱图片。本发明可以在提高视频检索信息的构建效率的同时,便于用户通过多维度特征查找视频及视频中的片段。(The invention provides a method and a device for establishing a video map, electronic equipment and a storage medium. The method for establishing the video map comprises the following steps: extracting a video frame from a video to be processed as an atlas picture according to at least one characteristic type; and establishing position indexes of the map pictures and the video frames in the video to be processed, wherein the map pictures are associated with feature information of the feature types to establish a video map of the video to be processed, and the feature information is used for retrieving the map pictures. The invention can improve the construction efficiency of the video retrieval information and is convenient for a user to search videos and segments in the videos through multi-dimensional characteristics.)

1. A method for creating a video map, comprising:

extracting a video frame from a video to be processed as an atlas picture according to at least one characteristic type; and

and establishing position indexes of the map pictures and the video frames in the video to be processed, associating the feature information of the feature types with the map pictures to establish a video map of the video to be processed, wherein the feature information is used for retrieving the map pictures.

2. The method of creating a video atlas of claim 1, wherein when extracting a video frame as an atlas picture in each of the sub-video segments in multiple feature types, for each feature type:

and establishing position indexes of the map pictures extracted according to the feature types and the video frames in the video to be processed, and associating feature information of the feature types with the map pictures extracted according to the feature types so as to establish a video map of the video to be processed, wherein the video map corresponds to the feature types.

3. The method for creating a video atlas of claim 1, wherein the extracting video frames as atlas pictures in the video to be processed according to at least one feature type comprises:

dividing the video to be processed into a plurality of sub-video segments;

determining the number of video frames extracted from each sub-video segment;

and for each sub-video segment, extracting a video frame as an atlas picture according to the characteristic type and the parameters of the video frame.

4. The method of creating a video map as claimed in claim 3 wherein said determining the number of video frames extracted from each sub-video segment comprises:

screening the sub-video segments to be extracted from the plurality of sub-video segments according to the characteristic types;

and determining the number of the video frames extracted from each sub-video segment to be extracted according to the ratio of the time length of the sub-video segment to be extracted to the total time length of the sub-video segment to be extracted.

5. The method for creating a video map according to claim 1, wherein creating the video map of the video to be processed further comprises:

and displaying the video map of the video to be processed.

6. The method for creating a video map according to claim 5, wherein said presenting the video map of the video to be processed comprises:

and sequencing the map pictures according to the time length occupied by the feature information of the feature type associated with each map picture in the video to be processed.

7. The method for creating a video map according to claim 5, wherein said presenting the video map of the video to be processed comprises:

and sequencing the map pictures according to the time sequence of the feature information of the feature type associated with each map picture in the video to be processed.

8. A method of establishing a video atlas as claimed in any of claims 1 to 7 wherein the feature types comprise one or more of the following feature types: a scene characteristic; an object feature; character features; and a feature of interest.

9. The method of establishing a video map according to any of claims 1 to 7, further comprising:

and constructing associated content for one or more items in the video to be processed and the atlas picture as objects to be associated, wherein the associated content is associated with the objects to be associated according to at least one attribute characteristic, and the associated content comprises one or more items in the video, the video segment and the atlas picture.

10. A method of establishing a video atlas as in claim 9 wherein the attribute features comprise one or more of the following attribute features: an object attribute; a gesture attribute; an expression attribute; a scene attribute; a text attribute; an interest attribute; and predetermined behavioral attributes.

11. A method of video retrieval, comprising:

receiving retrieval information, and matching feature information from a video map library according to the retrieval information, wherein the video map library comprises a plurality of video maps established according to the method for establishing the video maps in any one of claims 1 to 10; and

and outputting the atlas picture corresponding to the matched characteristic information.

12. The method for video retrieval of claim 11, further comprising:

and providing associated content of the selected map picture and/or video in response to the selected map picture and/or video, wherein the associated content is associated with the map picture and/or video according to at least one attribute characteristic, and the associated content comprises one or more of a video, a video segment and a map picture.

13. An apparatus for creating a video map, comprising:

the extraction module is used for extracting a video frame from a video to be processed as an atlas picture according to at least one characteristic type; and

the establishing module is used for establishing position indexes of the map pictures and the video frames in the video to be processed, and the map pictures are associated with the feature information of the feature types to establish a video map of the video to be processed, wherein the feature information is used for retrieving the map pictures.

14. An apparatus for video retrieval, comprising:

a receiving module, configured to receive retrieval information, and match feature information from a video atlas database according to the retrieval information, where the video atlas database includes a plurality of video atlases established by the apparatus for establishing a video atlas according to claim 13; and

and the output module is used for outputting the atlas picture corresponding to the matched characteristic information.

15. An electronic device, characterized in that the electronic device comprises:

a processor;

storage medium having stored thereon a computer program which, when being executed by the processor, performs the method of establishing a video map according to any of claims 1 to 10 and/or performs the method of video retrieval according to claim 11 or 12.

16. A storage medium having stored thereon a computer program which, when executed by a processor, performs a method of establishing a video atlas according to any one of claims 1 to 10 and/or performs a method of video retrieval according to claim 11 or 12.