阅读说明：本技术 基于视频内容消费的反馈信息标识方法、系统及存储介质 (Feedback information identification method, system and storage medium based on video content consumption ) 是由 张文军 徐异凌 黄倩 谢绍伟 孙军 于 2018-07-11 设计创作，主要内容包括：本发明提供了一种基于视频内容消费的反馈信息标识方法,包含以下步骤：视频获取步骤：获取视频；类型信息读取步骤：读取视频类型信息；属性判断步骤：对视频类型信息进行解析,获得视频属性；反馈指令生成步骤：根据视频属性,生成反馈信息获取指令。相应地,本发明还提供了一种基于视频内容消费的反馈信息标识系统与计算机可读存储介质。本发明对视频媒体的6DoF内容进行信息标识,标识信息指示了该部分视频是否为6DoF以及用户基于6DoF的移动与交互,在具体的应用中,比如VR自然游戏和自由视角现场直播等,本发明提供的标识信息可进一步用于客户端应用或服务的处理和呈现。(The invention provides a feedback information identification method based on video content consumption, which comprises the following steps: a video acquisition step: acquiring a video; type information reading step: reading video type information; and an attribute judgment step: analyzing the video type information to obtain video attributes; a feedback instruction generating step: and generating a feedback information acquisition instruction according to the video attribute. Correspondingly, the invention also provides a feedback information identification system based on video content consumption and a computer readable storage medium. The method and the device perform information identification on the 6DoF content of the video media, the identification information indicates whether the part of video is 6DoF or not and the movement and interaction of the user based on the 6DoF, and in specific applications, such as VR natural games, free-view live broadcast and the like, the identification information provided by the method and the device can be further used for processing and presenting client application or service.)

1. A method for identifying feedback information based on video content consumption, comprising the steps of:

a video acquisition step: acquiring a video;

type information reading step: reading video type information;

and an attribute judgment step: analyzing the video type information to obtain video attributes;

a feedback instruction generating step: and generating a feedback information acquisition instruction according to the video attribute.

2. The method of claim 1, wherein the video attributes comprise the following:

-a common attribute;

-3DoF attributes;

-3DoF + attribute;

-6DoF attributes;

in the feedback instruction generating step:

generating a holding instruction according to the common attribute;

generating an acquisition instruction of first feedback information according to the 3DoF attribute;

generating an acquisition instruction of second feedback information according to the 3DoF + attribute;

and generating an acquisition instruction of the third feedback information according to the 6DoF attribute.

3. The method of claim 2, wherein the first feedback information comprises head Yaw rotation information, head Roll rotation information, and head Pitch rotation information;

the second feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, head forward and backward movement information, head left and right movement information, and head up and down movement information;

the third feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, user forward and backward movement coordinates, user left and right movement coordinates, and user up and down movement coordinates.

4. The method of claim 1, further comprising the step of feeding back: and enabling the client to send feedback information to the server, wherein the feedback information comprises first feedback information, second feedback information and third feedback information.

5. A system for identifying feedback information based on consumption of video content, comprising:

a video acquisition module: acquiring a video;

a type information reading module: reading video type information;

an attribute judgment module: analyzing the video type information to obtain video attributes;

a feedback instruction generation module: and generating a feedback information acquisition instruction according to the video attribute.

6. The video content consumption-based feedback information identification system according to claim 5, wherein said video attributes comprise the following:

-a common attribute;

-3DoF attributes;

-3DoF + attribute;

-6DoF attributes;

the feedback instruction generation module comprises:

generating a holding instruction according to the common attribute;

generating an acquisition instruction of first feedback information according to the 3DoF attribute;

generating an acquisition instruction of second feedback information according to the 3DoF + attribute;

and generating an acquisition instruction of the third feedback information according to the 6DoF attribute.

7. The video content consumption-based feedback information identification system according to claim 6, wherein the first feedback information comprises head Yaw rotation information, head Roll rotation information, and head Pitch rotation information;

the second feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, head forward and backward movement information, head left and right movement information, and head up and down movement information;

the third feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, user forward and backward movement coordinates, user left and right movement coordinates, and user up and down movement coordinates.

8. The video content consumption-based feedback information identification system of claim 5, further comprising a feedback module to: and enabling the client to send feedback information to the server, wherein the feedback information comprises first feedback information, second feedback information and third feedback information.

9. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the video content consumption-based feedback information identification method of any of claims 1 to 4.

Technical Field

The invention relates to the technical field of virtual reality, in particular to a feedback information identification method based on six-degree-of-freedom video content consumption, and particularly relates to a feedback information identification method based on six degrees of freedom and used for a specific application scene during video presentation and consumption.

Background

With the rapid development of Virtual Reality (VR) technology, the demand of VR systems increases, and technically, the development from three degrees of Freedom (3Degree of Freedom, 3DoF) to three degrees of Freedom plus (3Degree of Freedom +, 3DoF +) to six degrees of Freedom (6Degree of Freedom, 6DoF) is being realized, and VR videos should have a head tracking function of six degrees of Freedom (6Degree of Freedom, 6DoF), and depth information is visually increased, so that the interior of an object can be explored, and a user is allowed to move in a VR space, so as to create an experience of being personally on the scene. Compared with the traditional three-degree-of-freedom VR, the 6DoF video scene changes correspondingly with the walking of a person, namely, when a user wears a VR head display and moves towards any direction, the VR reacts correspondingly, and looks like something in the real world. Now, the detection and identification of 3DoF + and 6DoF video contents are important indexes for judging the immersion experience of users, and in order to meet the requirements of different application scenes, additional identification needs to be performed on 3DoF + and 6DoF information of the video contents to meet the further indication of specific information.

Disclosure of Invention

In view of the defects in the prior art, the present invention aims to provide a feedback information identification method, system and storage medium based on video content consumption.

The feedback information identification method based on video content consumption provided by the invention comprises the following steps:

a video acquisition step: acquiring a video;

type information reading step: reading video type information;

and an attribute judgment step: analyzing the video type information to obtain video attributes;

a feedback instruction generating step: and generating a feedback information acquisition instruction according to the video attribute.

Preferably, the video attributes comprise the following:

-a common attribute;

-3DoF attributes;

-3DoF + attribute;

-6DoF attributes;

in the feedback instruction generating step:

generating a holding instruction according to the common attribute;

generating an acquisition instruction of first feedback information according to the 3DoF attribute;

generating an acquisition instruction of second feedback information according to the 3DoF + attribute;

and generating an acquisition instruction of the third feedback information according to the 6DoF attribute.

Preferably, the first feedback information includes head Yaw rotation information, head Roll rotation information, and head Pitch rotation information;

the second feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, head forward and backward movement information, head left and right movement information, and head up and down movement information;

the third feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, user forward and backward movement coordinates, user left and right movement coordinates, and user up and down movement coordinates.

Preferably, the method further comprises the feedback step of: and enabling the client to send feedback information to the server, wherein the feedback information comprises first feedback information, second feedback information and third feedback information.

The invention also provides a feedback information identification system based on video content consumption, which comprises the following modules:

a video acquisition module: acquiring a video;

a type information reading module: reading video type information;

an attribute judgment module: analyzing the video type information to obtain video attributes;

a feedback instruction generation module: and generating a feedback information acquisition instruction according to the video attribute.

Preferably, the video attributes comprise the following:

-a common attribute;

-3DoF attributes;

-3DoF + attribute;

-6DoF attributes;

the feedback instruction generation module comprises:

generating a holding instruction according to the common attribute;

generating an acquisition instruction of first feedback information according to the 3DoF attribute;

generating an acquisition instruction of second feedback information according to the 3DoF + attribute;

and generating an acquisition instruction of the third feedback information according to the 6DoF attribute.

Preferably, the first feedback information includes head Yaw rotation information, head Roll rotation information, and head Pitch rotation information;

the second feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, head forward and backward movement information, head left and right movement information, and head up and down movement information;

the third feedback information includes: head Yaw rotation information, head Roll rotation information, head Pitch rotation information, user forward and backward movement coordinates, user left and right movement coordinates, and user up and down movement coordinates.

Preferably, the method further comprises the following step: and enabling the client to send feedback information to the server, wherein the feedback information comprises first feedback information, second feedback information and third feedback information.

The present invention also provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the above-described method for identifying feedback information based on video content consumption.

Compared with the prior art, the invention has the following beneficial effects:

1. the invention carries out information identification on the 6DoF content of the video media, and the identification information indicates whether the part of video is 6DoF or not and the movement and interaction of the user based on the 6 DoF.

2. In specific applications, such as VR natural games, free-view live broadcasts, and the like, the identification information provided by the present invention can be further used for processing and presenting client applications or services.

Drawings

Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:

FIG. 1 is a diagram of an embodiment of the present invention relating to free-view live broadcasting;

FIG. 2 is a logic flow diagram of a feedback information identification method based on six degrees of freedom video content consumption;

FIG. 3 is an organization of VR information in a preferred embodiment;

FIG. 4 is a diagram showing the degrees of freedom corresponding to X, Y, Z, Yaw, Roll, and Pitch.

Detailed Description

The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.

In the description of the present invention, it is to be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present invention.

The invention provides a feedback information identification method based on video content consumption, which comprises the following steps: a video acquisition step: acquiring a video; type information reading step: reading video type information; and an attribute judgment step: analyzing the video type information to obtain video attributes; a feedback instruction generating step: and generating a feedback information acquisition instruction according to the video attribute. Preferably, the above steps are all performed in the client. In practical application, the video acquired in the video acquiring step is identified by the indication information in advance, and specifically, the following steps are performed: video storage step: storing the video on a server side; analyzing and shaping: analyzing the video, and setting a video parent type according to an analysis result; and an attribute setting step: and setting video attributes according to the video parent type.