Video distribution system

文档序号：118984 发布日期：2021-10-19 浏览：41次中文

阅读说明：本技术 视频分发系统 (Video distribution system ) 是由佐藤祐大熊野淳于 2019-12-26 设计创作，主要内容包括：本公开实施例公开了一种视频分发系统,包括：视频库,存储复数个视频数据,视频分发单元,分发所述视频数据,反应获取单元,至少在播放第一所述视频数据期间中获取表示复数的视听者的反应的反应信息,切换决策单元,根据所述反应信息,将决定所述第一视频数据后分发的第二所述视频数据,从而提供能够配合视听者的反应来分发视频内容。(The embodiment of the present disclosure discloses a video distribution system, including: the video distribution unit distributes the video data, the response acquisition unit acquires response information indicating responses of a plurality of viewers at least during a period of playing a first video data, and the switching decision unit determines a second video data to be distributed after the first video data according to the response information, thereby providing video content capable of being distributed in accordance with the responses of the viewers.)

1. A video distribution system comprising:

a video library storing a plurality of video data;

a video distribution unit that distributes the video data;

a response acquisition unit that acquires response information indicating responses of a plurality of viewers at least during a period of playing the first video data;

and the switching decision unit is used for deciding the second video data distributed after the first video data according to the response information.

2. The video distribution system according to claim 1, comprising:

the video distribution unit sends the first video data to a video distribution server which distributes the video data to the user terminal of each viewer;

the plurality of user terminals send the comments input by the viewers to the video distribution server;

the response acquisition unit acquires the comment from the video distribution server as the response information;

the switching decision unit decides to distribute the second video data based on the number of specific words contained in the comment or/and the number of the viewers who have published the comment containing the specific words.

3. The video distribution system according to claim 1, further comprising:

a scene storage unit that stores information of the video data to be distributed after each of the video data;

a condition storage unit that stores a condition of the response information and information that the video data is to be distributed at the next step;

when the response information meets the condition, the switching decision unit determines the video data distributed after the first video data corresponding to the condition met by the response information is the second video data, and when the response information does not meet the condition, the switching decision unit determines the video data distributed after the first video data is the second video data from the scene storage unit.

4. A video distribution system comprising:

a material library for storing material data for generating a video;

a video distribution unit that transmits the video according to the material data;

a response acquisition unit that acquires response information showing responses of the plurality of viewers during playback of the video data;

and the behavior processing unit is used for operating the material data corresponding to the reaction information.

5. The video distribution system according to claim 4, comprising:

the reaction acquisition unit acquires activities occurring in the video distribution system;

the action processing unit is used for operating the material data corresponding to the activity.

6. The video distribution system of claim 4, wherein the viewer's response is at least one of:

the method comprises the following steps of operating a terminal by a viewer, inputting voice and characters by the viewer, shooting an image of the viewer, analyzing the posture, or/and the eyesight and the gesture of the viewer in the image, and measuring measurement data of the body reaction time of the viewer.

7. The video distribution system of claim 4, wherein the action comprises at least one of:

appearance, movement and disappearance of objects, start and stop of animation, play and stop of video, play and stop of audio, and replacement of the material data.

8. A music library storing a plurality of music data, comprising:

a music distribution unit that distributes the music data;

a response acquisition unit that acquires response information indicating responses of a plurality of viewers at least during a period of playing the first music data;

and the switching decision unit is used for deciding second music data distributed after the first music data according to the response information.

9. The music distribution system according to claim 8, comprising:

the music distribution unit that transmits the first music data to a music distribution server that distributes the music data to the user terminal of each viewer;

the plurality of user terminals send comments input by the viewers to the music distribution server;

the reaction acquisition unit acquires the comment from the music distribution server as the reaction information;

the switching decision unit decides to distribute the second video data according to the number of the specific words contained in the comment.

10. The music distribution system according to claim 8, further comprising:

a scene storage unit that stores information of the music data distributed after each of the music data;

a condition storage unit that stores a condition of the reaction information and information that the music data is to be distributed at the next step;

when the response information satisfies the condition, the switching decision unit may determine the music data distributed after the first music data corresponding to the condition satisfied by the response information is the second music data, and when the response information does not satisfy the condition, the switching decision unit may determine the music data distributed after the first music data is determined from the scene storage unit as the second music data.

11. A video library storing a plurality of video data, comprising:

a video response acquisition unit for acquiring response information of responses of one or a plurality of viewers according to a priority order at least during the period of playing the first video data;

and the switching decision unit is used for deciding the second video data distributed after the first video data according to the response information.

12. The video distribution system according to claim 11, comprising:

the video distribution unit sends the first video data to a video distribution server which distributes the video data to the user terminal of each viewer;

one or a plurality of user terminals, which transmit the comments input by the viewers to the video distribution server;

the response acquisition unit acquires the comment from the video distribution server as the response information;

the switching decision unit decides the second video data according to the comment.

13. The video distribution system according to claim 11, further comprising:

a scene storage unit that stores information of the video data to be distributed after each of the video data;

a condition storage unit that stores a condition of the response information and information that the video data is to be distributed at the next step;

14. The video distribution system according to claim 11, comprising:

the priority order is based on the amount of payment to the viewer.

15. The video distribution system according to claim 11, comprising:

the priority order is determined according to the state information of the viewer.

Technical Field

The present disclosure relates to a video distribution system.

Background

In recent years, video distribution systems have become widespread. The video is distributed in a streaming media mode in which the video is passively and continuously played, and an on-demand mode in which the video is actively and intentionally played. The on-demand system is a system in which a viewer sets a playback order (for example, patent document 1)

< prior art document >

< patent document 1 > Japanese patent No. 5350728

However, in the video distribution method of streaming media, in the case of live video, it is possible to change the progress of live performance by observing the response of the viewer, but in the case of using recorded video, the progress of video is fixed, so it is difficult to progress video in accordance with the response of the viewer.

Disclosure of Invention

The present invention has been made in view of the above circumstances, and an object thereof is to provide a technique capable of distributing video content in accordance with the response of a viewer.

The present invention is a video distribution system to solve the above-described problems, including:

a video library storing a plurality of video data;

a video distribution unit that distributes the video data;

a response acquisition unit that acquires response information indicating responses of a plurality of viewers at least during a period of playing the first video data;

and the switching decision unit is used for deciding the second video data distributed after the first video data according to the response information.

Other problems of the present application and solutions thereof will be shown by the following invention embodiments and drawings.

Drawings

Other features, objects, and advantages of the present disclosure will become more apparent from the following detailed description of non-limiting embodiments when taken in conjunction with the accompanying drawings. In the drawings:

fig. 1 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

FIG. 2 shows a block diagram of the hardware structure of the distributor device 3

Fig. 3 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 4 shows a block diagram of the structure of the video library 331.

Fig. 5 shows a block diagram of the structure of the scene storage unit 332.

Fig. 6 shows a block diagram of the conditional storage unit 333.

Fig. 7 shows a block diagram of the structure of the comment storage unit 334.

Fig. 8 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

Fig. 9 is an explanatory diagram showing an example of a screen displayed by the user terminal.

Fig. 10 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

FIG. 11 is a block diagram showing the hardware configuration of the distributor device 3

Fig. 12 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 13 shows a block diagram of the material library 331.

Fig. 14 shows a block diagram of the structure of the behavior storage unit 333.

Fig. 15 shows a block diagram of the structure of the active memory unit 334.

Fig. 16 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

Fig. 17 shows a configuration diagram of the music distribution system of the present embodiment.

Fig. 18 shows a block diagram of the hardware of the distributor apparatus 3.

Fig. 19 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 20 shows a block diagram of the structure of the music library.

Fig. 21 shows a block diagram of the structure of the playlist storage unit 332.

Fig. 22 shows a block diagram of the conditional storage unit 333.

Fig. 23 shows a block diagram of the structure of the comment storage unit 334.

Fig. 24 shows a flowchart of processing executed by the music distribution system of the present embodiment.

Fig. 25 is an explanatory diagram showing an example of a screen displayed by the user terminal.

Fig. 26 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

FIG. 27 is a block diagram showing a hardware configuration of the distributor apparatus 3

Fig. 28 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 29 shows a block diagram of the structure of the video library 331.

Fig. 30 shows a block diagram of the structure of the scene storage unit 332.

Fig. 31 shows a block diagram of the condition storage unit 333.

Fig. 32 shows a block diagram of the structure of the comment storage unit 334.

Fig. 33 shows a block diagram of the structure of the user information storage unit 335.

Fig. 34 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

Fig. 35 is an explanatory view showing an example of a screen displayed by the user terminal.

Fig. 36 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

Fig. 37 is a block diagram showing a hardware configuration of the user terminal 1.

Fig. 38 shows a block diagram of the hardware of the distributor apparatus 3.

Fig. 39 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 40 shows a block diagram of the material library 331.

Fig. 41 shows a block diagram of the structure of the behavior storage unit 333.

Fig. 42 shows a block diagram of the structure of the active memory unit 334.

Fig. 43 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

Fig. 44 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

FIG. 45 is a block diagram showing a hardware configuration of the distributor apparatus 3

Fig. 46 is a block diagram showing the configuration of software of the distributor apparatus 3

Fig. 47 shows a block diagram of the material library 331.

Fig. 48 shows a block diagram of the configuration of the behavior storage unit 333.

Fig. 49 shows a block diagram of the structure of the active memory unit 334.

Fig. 50 shows a block diagram of the structure of the group condition storage unit 335.

Fig. 51 shows a block diagram of the structure of the group memory unit 336.

Fig. 52 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

Fig. 53 is an explanatory diagram illustrating grouping processing performed on a viewer according to the present embodiment.

Fig. 54 shows an exemplary view of the viewing screen 50 of the video distribution system according to the present embodiment.

Fig. 55 shows a block diagram of a video distribution system of an embodiment of the present disclosure.

Fig. 56 shows a block diagram of the hardware of the distributor apparatus 3.

Fig. 57 shows a block diagram of the software of the distributor apparatus 3

Fig. 58 shows a block diagram of the material library 331.

Fig. 59 shows a block diagram of the configuration of the behavior storage unit 333.

Fig. 60 shows a block diagram of the structure of the active memory unit 334.

Fig. 61 shows a block diagram of the structure of the group condition storage unit 335.

Fig. 62 shows a block diagram of the structure of the group memory unit 336.

Fig. 63 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

FIG. 64 is a flowchart showing an execution process of action behavior

Fig. 65 is an explanatory diagram illustrating grouping processing performed for a viewer in the present embodiment.

Fig. 66 shows an exemplary view of the viewing screen 50.

Detailed Description

< embodiment 1 >

The video distribution system according to embodiment 1 may have the following configuration.

[ item 1]

A video distribution system comprising:

a video library storing a plurality of video data;

a video distribution unit that distributes the video data;

a response acquisition unit that acquires response information showing responses of a plurality of viewers at least during a period of playing the first video data;

and the switching decision unit is used for deciding the second video data distributed after the first video data according to the response information.

[ item 2]

The video distribution system according to item 1, characterized by comprising:

the video distribution unit sends the first video data to a video distribution server which distributes the video data to the user terminal of each viewer;

the plurality of user terminals send the comments input by the viewers to the video distribution server;

the response acquisition unit acquires the comment from the video distribution server as the response information;

[ item 3]

The video distribution system according to item 1, characterized by further comprising:

a scene storage unit that stores information of the video data to be distributed after each of the video data;

a condition storage unit that stores a condition of the response information and information that the video data is to be distributed at the next step;

Hereinafter, the video distribution system of embodiment 1 will be described. The video distribution system of embodiment 1 is a system that dynamically changes the development of video (story, etc.) according to the response of a viewer watching a streaming video. In embodiment 1, the video response is a comment made by a viewer watching a video. That is, the video may change the playback of the video due to the content of the comments by the viewer. For example, in the case of a 2-place character (character) in a video, the story may branch to the story that delivers the most commented character as the main story. Hereinafter, the detailed description will be given.

Fig. 1 shows a configuration diagram of a video distribution system according to embodiment 1. The video distribution system of embodiment 1 includes a distributor apparatus 3, wherein the distributor apparatus 3 and the streaming server 2 are connected to each other through a network, and the streaming server 2 and the user terminal 1 are connected to each other through a network.

The distributor device 3 is a computer, such as a personal computer, a tablet computer, a smart phone, etc., having a function of distributing video.

The distributor device 3 may be, for example, a home computer used by an ordinary user who wants to distribute video. Streaming may be used to send video data out of the distributor device 3 to the streaming server 2.

The streaming server 2 can distribute video data to a plurality of user terminals 1 at the same time.

The user terminal 1 is a computer operated by a viewer, such as a personal computer, a tablet computer, a smart phone, and the like.

The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play video data distributed from the streaming server 2.

Further, the viewer can operate the user terminal 1 to distribute the comment of the video to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can play the video and display the comment of the video.

The following description describes video distributed through streaming media and linear play as "distributed video". The format of the distributed video can be that images and sound acquired by a camera and a microphone are encoded into video data in real time and transmitted. However, in the first embodiment, video data as components (hereinafter referred to simply as "component video data") is prepared in advance for distribution video, and at the same time, scenes in which the component video data are arranged are also prepared. That is, assuming that component video data is transmitted according to scenes, the entire set of distribution video will be transmitted.

Fig. 2 shows a block diagram of the hardware of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

The communication interface 304 is an interface for connecting to the communication network 30, and includes, for example, an adapter for connecting to ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a usb (universal Serial bus) connector or an RS232C connector for Serial communication, or the like.

The input device 305 is a device that inputs data, and includes, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, and the like. The output device 306 is a device that outputs data, including, for example, a display, a printer, a speaker, and the like.

Fig. 3 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has a video distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a video library 331, a scene storage unit 332, a condition storage unit 333, and a comment storage unit 334. The video distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303. The video library 331, the scene storage unit 332, the condition storage unit 333, and the comment storage unit 334 are implemented by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor device 3.

The video library 331 stores component video data. The component video data may be saved as encoded files in any format, e.g., MPEG4, MPEG2, AVI, MOV, etc. Fig. 4 shows a block diagram of the structure of the video library 331. As shown in the figure, the video library 331 makes correspondence of component video data and information (video ID) for identifying the component video data, and stores the component video data.

The scene storage unit 332 stores scenes of the distributed video. Fig. 5 shows a block diagram of the structure of the scene storage unit 332. As shown, the scene storage unit 332 stores scene information and sequence information.

The scene information is information about a scene. In the example of fig. 5, the scene information includes, for example, information (scene ID) for identifying a scene, a scene name (title), information (start video ID) indicating component video data to be played first in the scene, and the like.

The sequence information is information indicating the sequence in which component videos are played by default in a scene. The sequence information contains information corresponding to a scene ID, a video ID indicating component video data contained in a scene of the scene ID, and a secondary video ID indicating component video data played after the component video data of the video ID.

As described above, in the video distribution system of the first embodiment, component video data to be played next is changed in accordance with the response (comment) of the viewer. However, if the viewer's response does not satisfy the set conditions, the next component video data to be played is determined according to the default scene of the sequence information.

The condition storage unit 333 stores information of conditions (hereinafter referred to as "condition information") for branching according to responses (comments) of viewers. Fig. 6 shows a block diagram of the conditional storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 includes, a scene ID, a judgment period, a condition, and a secondary video ID.

The scene ID refers to information of a scene.

The determination period is a period during which it is determined whether or not the viewer response (comment) satisfies the condition. The term of judgment can be a period of relative interest, such as from now to 5 minutes ago. The determination period may be an absolute period, for example, from 00:00 to 00:10 on 25 days of 12 months.

The distributor apparatus 3 judges the viewer response in a predetermined period within the judgment period, that is, judges whether or not the comment made by the viewer in the predetermined period meets the condition.

The condition is a response to the viewer (comment to be distributed by the viewer), and may be, for example, the number of specified keywords included in the comment to be distributed in the period, the regional total comments or the number of viewers in the comment to be distributed, or, for example, the total value (average value, median value, maximum value, minimum value, etc.) of the amount of money to be put into the video when the viewer inquires about the question.

The video distribution unit 311 distributes videos. When the video distribution unit 311 receives a designation or the like from the user, the video distribution unit 311 reads scene information of a predetermined scene from the scene storage unit 332.

Then, the video distribution unit 311 can read the component video data corresponding to the start video ID in the video library 331 (can encode, if necessary, or convert the format of the video) from the start video ID contained in the scene information. Then, the video distribution unit 311 may send the read component video data to the streaming server 2 to distribute the video.

When the video distribution unit 311 finishes transmitting the read component video data, the video distribution unit 311 acquires a secondary video ID corresponding to the scene ID and the video ID of the component video data from the sequence information of the scene storage unit 332. Then, the video distribution unit 311 may read component video data corresponding to the acquired secondary video ID from the video library 331 and distribute the component video data to the streaming server 2 in the same manner. When the secondary video ID does not exist, the video distribution unit 311 may terminate distributing the video.

When the switching decision unit 313 decides the secondary video ID, the video distribution unit 311 may interrupt distribution of the component video data being executed, and then the video distribution unit 311 reads the component video data according to the secondary video ID decided by the switching decision unit 313 and sends out to the streaming server 2. In this way, the story can be changed.

The comment storage unit 334 stores comments distributed by the viewer.

Fig. 7 shows a block diagram of the structure of the comment storage unit 334. The comment storage unit 334 associates comments with information (comment ID) identifying the comments. Then, the comment storage unit 334 may store the above-described comment, the viewer ID of the comment distributed, the date and time of the comment distributed, the content of the comment, and the like.

The comment acquisition unit 312 acquires a comment distributed by the viewer operating the user terminal 1. For example, when the streaming server 2 provides an API for acquiring the distributed comment, the comment acquisition unit 312 may acquire the distributed comment via the API. The comment acquisition unit 312 may register the acquired comment in the comment storage unit 334.

The switching decision unit 313 decides whether to switch videos. The switching decision section 313 reads and sums the comments corresponding to the time periods in the comment storage unit 334 on the basis of the respective pieces of condition information stored in the condition storage unit described above. Also, the switching decision unit 313 determines whether or not the condition is satisfied, and if the condition is satisfied, the switching decision unit 313 instructs the video distribution unit 311 to send out component video data corresponding to the secondary video ID of the condition information.

Fig. 8 shows a flowchart of processing performed by the video distribution system of the first embodiment of the present disclosure.

Video distribution section 311 accepts designation of a scene (S421), and sets the start video ID included in the scene information of the designated scene as the play ID (S422).

The video distribution unit 311 reads the component video data corresponding to the play ID from the video library 331 (S423), and transmits the read component video to the streaming server 2 (S424). This will enable the streaming server 2 to distribute the video to the various user terminals 1 in a manner that is used for streaming.

The comment acquisition unit 312 acquires a comment distributed by the viewer using the user terminal 1 from the streaming server 2 (S425). Regarding the retrieval of comments, for example, it may be realized via an API provided by the streaming server 2.

The switching decision section 313 reads out the comment distributed during the judgment period from the comment storage unit 334 according to each condition information in the condition storage unit 333 (S426), and determines whether or not the read comment has a condition satisfying the condition information (S427).

Determining whether the comment satisfies a condition may be determined by calculating the number of each keyword contained in the comment and whether the number exceeds a predetermined threshold.

When the comment satisfies the condition (YES in S428), the switching decision unit 313 sets the secondary video ID included in the condition information as the play ID (S429), returns to step S423, and the video distribution unit 311 distributes the component video data corresponding to the play ID. In this way, the flow of component video data can be changed according to the comment.

When the comment does not satisfy the conditions of all the condition information, when the video being played ends (S430: YES), the switching decision unit 313 sets the secondary video ID of the sequence information as the play ID (S431).

When the set sub-video ID is present in the sequence information (S432: YES), the video distribution unit 311 returns to step S423 to send out the component video data corresponding to the play ID. When the secondary video ID is not set in the sequence information (S432: NO), the processing flow is terminated.

Fig. 9 is an explanatory diagram showing an example of a screen displayed by the user terminal. As shown in fig. 9(a), the video data distributed from the streaming server 2 causes the user terminal 1 to display a video 511 and also a comment 512 distributed by the user terminal 1 or by another user terminal 1.

In the example of FIG. 9(a), there are two-digit fielders (Ai-chan, and Megu-chan, respectively) displayed. For the person on the venue, posted comments 512 include, for example, "o! Is Ai-chan! "," Megu-chan refuel! "review of like"

Here, if the condition storage 333 contains condition information in which the word "call Ai-chan" is a condition, a video 513 as shown in fig. 9(b) will be displayed. Since the word is posted in fig. 9(a), a video 513 is displayed thereafter.

If the phrase "call Ai-chan" is not contained in the comment of fig. 9(b), a video 514 of the secondary video ID of the sequence information is displayed as in fig. 9 (c).

As described above, the video distribution system of the first embodiment can provide linear video to the user terminal 1 because the streaming server 2 continuously transmits component video data.

Meanwhile, in playing component video data, component video data to be played next may be decided according to comments of a viewer.

Therefore, linear videos of different developments can be provided to the viewer according to the viewer's response.

Therefore, even if recorded component video data is used, video can be distributed in a linear manner without losing the sense of live broadcasting.

The video distribution system according to the first embodiment has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

For example, in the present embodiment, the video transmitted from the distributor apparatus 3 is distributed to the user terminals 1 via the streaming server 2, but the video may be directly distributed from the distributor apparatus 3 to each user terminal 1.

In the present embodiment, the video library 331 stores a video file encoded in a format such as MPEG4, however, the video library 331 may store a 3D model, a scene file, or the like, and may send dynamic rendering video according to the 3D model, the scene file, or the like.

In the present embodiment, even in the middle of playing component video data, when the condition is satisfied for a comment, transition is made to the next component video data (step S428 → S429 → S423 in fig. 8), however, not only can the component video data be played to the end, but it can be transitioned to the next component video data.

In this case, a step of confirming whether or not the playback of the component video data has been completed may be provided before or after step S429 in fig. 8.

In the present embodiment, the component video data is switched according to the comment (or the keyword included in the comment) distributed by the viewer, but the component video may be switched according to the response of any viewer obtained from the user terminal 1.

For example, when a viewer clicks or touches a particular area of a video distribution screen displayed by the user terminal 1, the comment acquisition unit 312 acquires the Event as information. Then, the switching decision unit 313 may calculate the number of activities (i.e., the number of viewers who clicked or touched in a specific area on the distribution video) and decide whether to switch the component video data by determining whether the number exceeds a threshold.

In this case, a threshold value of the number of viewers clicked or touched on a predetermined area on the distribution video, and the video ID of the component video data switched according to the area may be registered as the condition information.

When a viewer views a distributed video through a web browser of the user terminal 1, a click action by the web browser is transmitted to the streaming server 2 or the distributor apparatus 3.

Then, the comment acquisition unit 312 may acquire a Click action (Click event) directly or through the streaming server 2, and the Click action may be stored in the comment storage unit 334.

In this case, the comment acquisition unit 312 may not only acquire only comments but also be an activity acquisition unit having the ability to acquire various activities. In this case, the comment storage unit 334 may be an activity storage unit that stores not only comments but also various activities.

The activity acquisition unit receives sound data acquired from the user terminal, analyzes the received sound data, and acquires a specific utterance as an activity when the sound data contains the utterance. At this time, the switching decision unit 313 switches the video according to the activity.

In this case, on the premise that a specific utterance is a condition, it may be registered that various types of utterances set different secondary video IDs as condition information in the condition storage unit 333.

Furthermore, it is also possible to perform parsing of the sound at the user terminal 1, and then the activity acquisition unit may receive the parsed result.

The motion acquisition means may receive image data captured by the user terminal 1, analyze the received image data, recognize the posture, gaze, gesture, and the like of the viewer, and set them as motions. The switching decision unit 313 may then switch the video according to these activities.

In this case, on the premise that a specific gesture, line of sight, gesture are conditions, various types of gestures, and positions of line of sight may be registered as condition information in the condition storage unit 333 with different secondary video IDs set. Furthermore, it is also possible to perform parsing of the image at the user terminal 1, and then the activity acquisition unit may receive the parsed result.

Moreover, the activity acquisition unit does not need to acquire an activity from the user terminal 1, and may acquire an activity on the system, for example.

The activities that can be acquired on the system include, for example, elapsed time when the animation is distributed, current time, object conflicts that occur in the distribution of the animation, locations of the viewer or distributor, weather conditions in a preset area, and the like

The switching decision unit 313 may also perform a switching animation depending on these activities.

< embodiment 2 >

The video distribution system according to embodiment 2 may have the following configuration.

[ item 1]

A video distribution system comprising:

a material library for storing material data for generating a video;

a video distribution unit that transmits the video according to the material data;

a response acquisition unit that acquires response information showing a response of the plurality of viewers during playback of the video data;

and the behavior processing unit is used for operating the material data corresponding to the reaction information.

[ item 2]

The video distribution system according to item 1, characterized by comprising:

the reaction acquisition unit acquires activities occurring in the video distribution system;

the behavior processing unit is used for operating the material data corresponding to the activities.

[ item 3]

The video distribution system of item 1, wherein the viewer's response is at least one of:

[ item 4]

The video distribution system of item 1, wherein the action behavior comprises at least one of:

appearance, movement and disappearance of objects, start and stop of animation, play and stop of video, play and stop of audio, and replacement of the material data.

Hereinafter, the video distribution system of the second embodiment will be described. The video distribution system of the second embodiment is a system that dynamically changes streaming distributed video according to various activities.

The activities include information on the viewer (hereinafter, referred to as user activity information) such as a gesture, a line of sight, or a gesture analyzed from a photographed image, and measurement data for measuring a physical reaction of the viewer, which are input by the viewer operating a device.

The event may include information obtained by the system, for example, the number of viewers watching the event, weather, time, contact situation of an object in the video, and the like (hereinafter, referred to as system event information).

The distributed video is generated from material data of the video. The material data is, for example, a 3D model, video data, audio data, or the like. Each material data may be set according to the action behavior of the activity.

Action behavior refers to operations on material data. The action may include the appearance, movement, or destruction of an object represented by the 3D model, the action further including the start and termination of animation, the playing and stopping of video, the playing and stopping of sound, the replacement (substitution) of material data, and the like.

In embodiment 2, the distributed video may be generated by synthesizing images or images output as a result of the action.

In the video distribution system of the second embodiment, the distribution video can be dynamically changed by activating the action behavior of the activity. Details are as follows.

Fig. 10 shows a configuration diagram of the video distribution system of embodiment 2.

The video distribution system according to embodiment 2 further includes a distributor apparatus 3. Wherein the distributor device 3 is communicatively connected to the streaming server 2 and the streaming server 2 is communicatively connected to the user terminal 1. A plurality of user terminals 1 can be communicatively connected.

The streaming server 2 may distribute video data to one or more user terminals 1 simultaneously.

The user terminal 1 is a computer operated by a viewer, such as a personal computer, a tablet computer, a smart phone, and the like. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play video data distributed from the streaming server 2. The user terminal 1 may also collect various activity information, such as taking a picture of the viewer, recording the sound of the viewer, and accepting comments input by the viewer.

The streaming server 2 acquires the activity of one or a plurality of viewers. The distributor apparatus 3 may implement the acquisition of the viewer's activities via, for example, an API provided by the streaming server 2.

FIG. 11 is a block diagram showing a hardware configuration of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 12 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a material library 331, a behavior storage unit 333, and an activity storage unit 334. Further, the video distribution unit 311, the activity acquisition unit 312, and the behavior processing unit 313 are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303.

The material library 331, the scenario storage unit 334, and the behavior storage unit 333 are realized by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor device 3. The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, a 3D model, a still image, animation, sound data, MIDI data, character data, and the like. Fig. 13 shows a block diagram of the material library 331. As shown in the figure, the material library 331 gives information (material ID) identifying a material and stores various material data.

The behavior storage unit 333 stores operation (action behavior) information (hereinafter, simply referred to as behavior information) on material data. Fig. 14 shows an example of behavior information stored in the behavior storage unit 333.

As shown in the figure, the behavior information includes a behavior ID indicating a behavior of an action, a judgment period, a condition, a behavior of an action, and the like

The condition may be activity-specific, e.g., whether activity is present, or whether the aggregate value of activities from a plurality of viewers exceeds a threshold, etc.

The user activity information may be, for example, whether or not the viewer presses a specific button in the video to be played, whether or not the viewer clicks a predetermined region on the screen, whether or not the number of viewers clicked or touched on the video exceeds a threshold, or the like.

Further, according to the material data for generating the distribution video, it is also possible to make a condition as to whether or not the object displayed in the distribution video is clicked or touched, and whether or not the number of viewers clicking or touching the object exceeds a threshold.

Further, whether or not the viewer inputs a predetermined character (keyword) at the user terminal 1 may be a condition, for example, whether or not a predetermined keyword is included in a comment for distributing a video, or whether or not the number of viewers who input a keyword exceeds a threshold value may be a condition.

In addition, the comments or the number of viewers added by area among viewers who distribute comments, for example, the total value (average value, median value, maximum value, minimum value, etc.) of the amount of money that the viewers throw in when asking questions in the video, and when analyzing the happiness, anger, sadness, and sadness of the viewers in the video, the comments including the specified keyword are not posted, and the like can be used as conditions.

It is also possible to analyze the atmosphere or emotion of the viewer obtained by performing speech recognition as a condition. For example, whether the viewer has uttered a specific sound, whether the viewer has uttered a sound such as clapping, whistling, stepping on, or whether the number of viewers who uttered the sound exceeds a threshold.

In this case, voice recognition may be performed by the user terminal 1, and then, the result of the recognition may be transmitted to the streaming server 2 or the distributor apparatus 3. Or voice data captured via the user terminal 1 to the distributor apparatus 3 via the streaming server 2, or voice data is directly transmitted from the user terminal 1 to the distributor apparatus 3, and then the distributor apparatus 3 is caused to perform voice recognition.

Also, according to the ambience of the viewer in the user terminal 1 from the image or the viewer in the image, whether such an image is distributed to the streaming server 2 or not, and whether the number of viewers distributing the image exceeds a threshold value may be used as conditions.

Further, it is also possible to make a condition that whether or not an image of a predetermined object (for example, a specific signboard or a leaflet image around a viewer) is posted, or whether or not the number of viewers posting an image exceeds a threshold value, by image analysis.

Further, information recognized by analyzing the image (the posture or line of sight of the viewer, gesture) may be used as the condition. For example, whether or not the number of viewers who have a specific posture exceeds a threshold value, such as whether or not the viewers have a specific posture, cast a predetermined line of sight, make a specific gesture, or make the above-described posture, may be a condition.

In this case, parsing the image may be performed by the user terminal 1, and then, the result of the recognition may be transmitted to the streaming server 2 or the distributor apparatus 3. Or image data captured via the user terminal 1 to the distributor apparatus 3 via the streaming server 2, or image data is directly transmitted from the user terminal 1 to the distributor apparatus 3, and then the distributor apparatus 3 is caused to perform analysis of the image.

The system activity information may be, for example, whether or not the number of viewers watching the distribution image exceeds a threshold.

The playback time of the distribution image may be a condition. Such as the elapsed time from the start of playback to the stop of playback, etc.

In addition, when the weather of the area where the viewer or distributor is located is acquired as the system activity information, the weather may be used as the condition, for example, a clear day, a rainy day, a snowy day, a predetermined intensity of wind, a predetermined temperature, or the like.

Also, when the material data is a 3D model, a conflict of the items in the distribution video may be also a condition.

The action behaviors are various operations on the above-described material data. The action behavior may contain parameters so that the material data can be set in detail for specific operations.

In embodiment 2, the operation behavior may be not only the operation of the material data, but also the execution of another operation behavior may be performed and stopped, or the execution of another operation behavior may be waited for. The action behavior is, for example, a program written in a script language which can also be saved.

The video distribution unit 311 distributes videos. A single action may also perform multiple actions. The video distribution unit 311 can produce a distribution video that is subjected to a composite action (which can be encoded if necessary) by the action processing unit 313 described later.

Also, the video delivery unit 311 may deliver the video to the user terminal 1 by transmitting the generated delivery video to the streaming server 2.

The activity storage unit 334 stores various activities that have occurred. Fig. 15 shows a block diagram of the structure of the active memory unit 334.

As described above, the activity storage unit 334 stores user activity information and system activity information.

Hereinafter, the user activity information and the system activity information are collectively referred to as activity information. The user activity information includes an activity ID indicating an activity, a viewer ID indicating a viewer associated with the activity, a time point at which the activity occurs, and an activity content. The system activity information includes an activity ID, a time point at which the activity occurs, and activity content.

Further, information indicating the line of sight or the gesture of the viewer obtained by analyzing the viewer image captured by the user terminal 1, the line of sight of the viewer, and the gesture of the viewer may be set as the active content. In the case of the system activity information, the number of viewers, weather, time point, and the like may be set as the activity content.

The activity acquisition unit 312 acquires an activity and registers the acquired content of the activity as activity information in the activity storage unit 334.

What kind of activity is to be acquired may be set by the user. The setting information indicating the kind of the activity to be acquired may be stored in, for example, the memory 302 or the storage device 303.

The activity acquisition unit 312 may register, for example, a button, touch, or click input by the viewer as the user activity information.

For example, in the case where the viewer views the distributed video using a web browser, a script that transmits the click activity occurring on the web browser to the streaming server 2 or the distributor apparatus 3 is set in advance, so that the activity acquisition unit 312 can acquire the click activity via the streaming server 2 or directly acquire the click activity.

Also, the activity acquisition unit 312 may, for example, when the streaming server 2 provides an API for acquiring the distributed comment, acquire the comment distributed by the viewer via a call API. In addition, the activity acquisition unit 312 may parse the comment and register a comment containing a specified keyword as the user activity information.

Further, the activity acquisition unit 312 may, for example, receive acquired sound data from the user terminal 1, and parse the received sound data, registering a specific utterance as user activity information.

The sound may be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register the analysis result as user activity information.

Activity acquisition section 312 may periodically count the number of viewers and register the number in the system activity information. The image may be analyzed in the user terminal 1, and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register the analysis result as the user activity information.

For example, it is previously set that the timeout activity can be acquired from the clock, and at this time, the activity acquisition unit 312 may register the lapse of a predetermined time from the start of playing the distribution video as the system activity information. Also, the activity acquisition unit 312 may register a predetermined time point (for example, a time point immediately after the date is changed, or immediately after 3 pm, or the like) as the system activity information.

Also, the event acquisition unit 312 may also acquire weather information from, for example, a server of a weather company, and register weather elements of a specific area (for example, the location of each viewer or distributor, or an area determined in advance) as system event information.

Also, for example, in the case where the material data is a 3D model, the activity acquisition unit may register system activity information having determined a conflict of the items in the distribution video as information.

The action processing unit 313 performs action actions on the material data. The action processing unit 313 accepts action to be executed first, and executes it. Since there is a possibility that other action behaviors are also activated, in this case, the action processing unit 313 may continue to perform the action behaviors in order. Also, the action behavior may be branched and executed in parallel.

Also, the action processing unit 313 executes action actions corresponding to the activities. The behavior processing unit 313 sums the activity information of the corresponding period in the activity storage unit 334 with respect to the behavior information stored in the behavior storage unit 333, and determines whether or not a condition is satisfied, and if the condition is satisfied, the behavior processing unit 313 executes the action behavior set in the behavior information. Thus, the development of video may change dynamically according to the activity.

Fig. 16 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

The action processing unit 313 accepts an instruction of an action to be executed first (S421), and executes the designated action (S422). As a result of performing the action, the output image and sound are synthesized into video data. Then, the video distribution unit 311 sends out the video data to the streaming server 2.

The activity acquisition unit 312 periodically acquires an activity (S423). For example, the activity acquisition unit 312 may acquire a comment on a distributed video by calling an API provided by the streaming server 2. In addition, the activity acquisition unit 312 may acquire comments distributed after a prescribed time using a timer function.

For each piece of activity information stored by the activity storage unit 333, the activity processing unit 313 reads the activity information including the time point of the determination period from the activity storage unit 334 (S424). Then, the behavior processing unit 313 determines whether the activity content of the activity information that has been read has a condition that satisfies the behavior information (S425).

If the activity satisfies the condition (S426: YES), the action processing unit 313 executes the action included in the action information (S427).

Here, the activity processing unit 313 may stop the action behavior previously executed, may execute the action behavior in parallel with the previous action behavior and the new action behavior, or may specify the action behaviors in the new action behavior.

If the action of the action information does not terminate the distribution of the video (S428), the process returns to step S423.

As described above, the video distribution system of embodiment 2 distributes a video to the user terminal 1 via the streaming server 2, and can change the distribution video in play in response to various activities during the distribution video play.

Therefore, while using the recorded video, various distributed videos can be developed according to the reaction of the viewer, and the distributed video does not lose the sense of live in the streaming mode.

The video distribution system according to embodiment 2 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

Also, in the embodiment of the present invention, it is described that even if a video is being played, as long as the condition is satisfied for the comment, the transition is made to the next component video data (step S427 in fig. 16). However, the present invention is not limited to this, and the next action may be executed after the execution of the executing action is completed.

< embodiment 3 >

The music distribution system according to embodiment 3 has the following configuration.

[ item 1]

A music library storing a plurality of music data, comprising:

a music distribution unit that distributes the music data;

a response acquisition unit that acquires response information showing responses of a plurality of viewers at least during a period of playing the first music data;

and the switching decision unit is used for deciding second music data distributed after the first music data according to the response information.

[ item 2]

The music distribution system according to item 1, characterized by comprising:

the music distribution unit that transmits the first music data to a music distribution server that distributes the music data to the user terminal of each viewer;

the plurality of user terminals send comments input by the viewers to the music distribution server;

the reaction acquisition unit acquires the comment from the music distribution server as the reaction information;

the switching decision unit decides to distribute the second video data according to the number of the specific words contained in the comment.

[ item 3]

The music distribution system according to item 1, characterized by further comprising:

a scene storage unit that stores information of the music data to be distributed after each of the music data;

a condition storage unit that stores a condition of the reaction information and information that the music data is to be distributed at the next step;

Hereinafter, the video distribution system of embodiment 3 will be described. The music distribution system of embodiment 3 is a system that dynamically changes the next musical performance in accordance with the reaction of the viewer who views the streaming music. In embodiment 3, the response to music is a comment made by a viewer when listening to music. That is, in playing music, the next played music may be changed according to the viewer's comment. The change can be music only or video combined by music and animation. Hereinafter, the detailed description will be given.

Fig. 17 shows a configuration diagram of the music distribution system of embodiment 3.

The music distribution system of embodiment 3 includes a distributor apparatus 3, in which the distributor apparatus 3 and the streaming server 2 are connected to each other via a network, and the streaming server 2 and the user terminal 1 are connected to each other via a network.

The distributor device 3 is a computer, such as a personal computer, a tablet computer, a smart phone, etc., having a function of transmitting music. The distributor device 3 may be, for example, a home computer used by an ordinary user who wants to distribute music. The music data may be streamed out from the distributor apparatus 3 to the streaming server 2.

The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming server 2 distributes the music data received from the distributor apparatus 3 to the user terminal 1. The streaming server 2 can distribute music data to a plurality of user terminals 1 at the same time.

The user terminal 1 is a computer operated by a viewer, such as a personal computer, a tablet computer, a smart phone, and the like. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play music data distributed from the streaming server 2. Also, the viewer can operate the user terminal 1 to distribute the review of the video to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can play the video and display the comment of the video.

The following description describes video distributed through streaming media and played linearly is referred to as "distributing music".

The format of the distributed music may be that sound (or animation including music, etc.) captured by a camera and a microphone is encoded into music data in real time and transmitted. However, in embodiment 3, the distribution music is prepared in advance by preparing music data as components (hereinafter referred to as "component music data"). Distributed music is considered to be transmitted as a whole, music data is prepared in advance as components (hereinafter referred to as "component music data"), a play list is prepared in which the component music data is arranged, and the component music data is transmitted according to the play list.

Fig. 18 shows a block diagram of the hardware of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 19 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has, a music distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a music library 331, a play list storage unit 332, a condition storage unit 333, and a comment storage unit 334.

Further, the music distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303. The music library 331, the playlist storage unit 332, the condition storage unit 333, and the comment storage unit 334 are implemented by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor apparatus 3.

The music library stores component music data. The component music data may be saved as an encoded file in any format, for example, MP3, MP4, AAC, or the like. Fig. 20 shows a block diagram of the structure of the music library. As shown in the figure, the music library 331 makes correspondence of component music data and information (music ID) for identifying the component music data, and stores the component music data. The music ID may be a file name or an arbitrary value assigned thereto.

The play list storage unit 332 stores the distribution order (distribution list) of the distributed music.

Fig. 21 shows a block diagram of the structure of the playlist storage unit 332. As shown, the playlist storage unit 332 stores playlist information, list information.

The playlist information is information on a playlist. Taking fig. 21 as an example, the playlist information is information in which the distributor ID of a specific distributor corresponds to information (scene ID) of a specific playlist. The playlist information contains a playlist name, information (start music ID) indicating component music data to be played first, and the like.

The list information is information indicating the order in which music is played when the playlist is in default. The list information contains information corresponding to a playlist ID, a music ID indicating component music data contained in the playlist of the playlist ID, and a sub-music ID indicating component music data played after the component music data of the music ID.

As described above, in the music distribution system of embodiment 3, the component music data to be played next will be changed in accordance with the response (comment) of the viewer. However, if the viewer's response does not satisfy the set conditions, the next played component music data is decided according to the default playing order of the list information.

The condition storage unit 333 stores information of conditions (hereinafter referred to as "condition information") for branching according to responses (comments) of viewers. Fig. 22 shows a block diagram of the conditional storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 contains a playlist ID, a judgment period, a condition, and a sub-music ID. The playlist ID is information indicating a playlist.

The condition is a response to the viewer (comment to be distributed by the viewer), for example, the number of specified keywords included in the comment to be distributed in the above-described period, the regional total comments or the number of viewers in the comment-distributing viewer, or the total value (average value, median value, maximum value, minimum value, etc.) of the amount of money to be put in by the viewer when asking questions in the music, and may be a condition when the viewer analyzes the sadness of the viewer from the comment, when the viewer having a sadness feeling exceeds a specified threshold value, when the comment including the specified keyword is not posted, or the like.

The music distribution unit 311 is capable of distributing music. The music distribution unit 311 can read the playlist information in the playlist storage unit 332 corresponding to the playlist specified by the user.

Then, the music distribution unit 311 may read the component music data corresponding to the start music ID in the music library 331 (may encode, or convert the format of video, if necessary) from the start music ID contained in the playlist information. Then, the music distribution unit 311 may send the read component music data to the streaming server 2 to distribute music.

When the music distribution unit 311 finishes transmitting the read-out component music data, the music distribution unit 311 acquires the sub-music ID corresponding to the playlist ID and the music ID of the component music data from the list information of the playlist storage unit 332. Then, the music distribution unit 311 may read the component music data corresponding to the obtained sub-music ID from the music library 331 and distribute the component music data to the streaming server 2 in the same manner.

When the sub-music ID does not exist, the music distribution unit 311 may terminate distributing music. Since the sub music ID is decided by the switching decision unit 313 described later, music to be distributed next may be changed.

The comment storage unit 334 stores comments distributed by the viewer. Fig. 23 shows a block diagram of the structure of the comment storage unit 334. The comment storage unit 334 associates comments with information (comment ID) identifying the comments. Then, the comment storage unit 334 may store the above-described comment, the viewer ID of the comment distributed, the date and time of the comment distributed, the content of the comment, and the like.

The user terminal 1 may directly send the comment to the distributor apparatus 3.

The comment acquisition unit 312 may register the acquired comment in the comment storage unit 334.

The switching decision unit 313 can decide to switch music. The switching decision section 313 reads and sums the comments corresponding to the time periods in the comment storage unit 334 on the basis of the respective pieces of condition information stored in the condition storage unit described above. Then, the switching decision unit 313 determines whether or not the condition is satisfied, and if the condition is satisfied, the switching decision unit 313 instructs the music distribution unit 311 to send out the component music data corresponding to the secondary music ID of the condition information.

Fig. 24 shows a flowchart of processing executed by the music distribution system of embodiment 3 of the present disclosure.

The music distribution unit 311 accepts designation of a playlist (S421), and sets the start music ID contained in the playlist information of the designated playlist as a play ID (S422).

The music distribution unit 311 reads component music data corresponding to the play ID from the music library 331 (S423). The play ID is then set to the sub-music ID of the list information (S424).

The music distribution unit 311 sends the read component music data to the streaming server 2 (S425). In this way, music can be distributed in streaming media from the streaming server 2.

The comment acquisition unit 312 acquires a comment distributed by the viewer using the user terminal 1 from the streaming server 2 (S426). Regarding the retrieval of comments, for example, it may be realized via an API provided by the streaming server 2.

The switching decision section 313 reads out the comment distributed during the judgment period from the comment storage unit 334 according to each condition information in the condition storage unit 333 (S427), and judges whether or not the read comment has a condition satisfying the condition information (S428).

Whether or not the comment satisfies the condition may be determined by, for example, calculating keywords in the comment, and determining whether or not the number of the keywords exceeds a predetermined value.

When the condition is satisfied for the comment (S429: YES), the switching decision unit 313 can set the sub music ID contained in the condition information as the play ID (S430).

For processing the condition information in the above processing manner, the sub-music ID of the condition information that finally satisfies the condition will be set as the play ID.

If the music data under distribution has not been sent out (S431: NO), the process returns to step S425 and repeats.

When the music data under distribution is finished being sent out (S431: YES), if the music distribution unit 311 has set the music ID to the play ID (S423: YES), the processing from step S423 will be repeated, and if the music distribution unit 311 has not set the music ID to the play ID (or to a NULL value) (S431: NO), the music distribution unit 311 will finish playing the playlist, and the processing is finished.

Fig. 25 is an explanatory diagram showing an example of a screen displayed by the user terminal.

Fig. 25(a) shows an example of a video 511 displayed based on music data distributed by the streaming server 2.

When the music data is sound data, the video 511 may be replaced with a still image. Video 511 may also be displayed from images received from different sources.

Further, the comment 512 distributed by the user terminal 1 or distributed by another user terminal 1 is displayed on the screen.

Here, if the music such as "demon empire" stored in the condition storage unit 333 and the condition information include a condition that the most number of the postings are provided among a certain number of postings of the music, as shown in fig. 25(a), the music such as "demon empire" shown in fig. 26(b) is distributed when the keyword of "demon empire" included in the comment is the most number.

Also, if the predetermined music name is not included in the posted comment or the posted comment does not meet the predetermined criterion, the music set by the secondary music ID in the list information will be distributed as in fig. 25 (c).

As described above, the music distribution system according to embodiment 3 continuously distributes linear video to the user terminal 1 via the streaming server 2. And, the music to be distributed next is dynamically changed according to the comments of the viewers.

Therefore, linear videos of different developments can be provided to the viewer according to the viewer's response.

Therefore, even if the recorded component music data is used, music can be distributed in a linear manner without losing the sense of live broadcasting.

The video distribution system according to embodiment 3 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

For example, in the present embodiment, the music transmitted from the distributor apparatus 3 is distributed to the user terminals 1 via the streaming server 2, but the music may be directly distributed from the distributor apparatus 3 to each of the user terminals 1.

In the present embodiment, the music library 331 stores video files encoded in the format of MP3 or the like, however, the music library 331 may store video files encoded in the format of MP3 or the like

Music information synthesized from MIDI data or a plurality of pieces of music is transmitted as dynamic audio or video based on the information.

< embodiment 4 >

The video distribution system according to embodiment 4 has the following configuration.

[ item 1]

A video library storing a plurality of video data, comprising:

and the switching decision unit is used for deciding the second video data distributed after the first video data according to the response information.

[ item 2]

The video distribution system according to item 1, characterized by comprising:

the video distribution unit sends the first video data to a video distribution server which distributes the video data to the user terminal of each viewer;

one or a plurality of user terminals, which transmit the comments input by the viewers to the video distribution server;

the response acquisition unit acquires the comment from the video distribution server as the response information;

the switching decision unit decides the second video data according to the comment.

[ item 3]

The video distribution system according to item 1, characterized by further comprising:

a scene storage unit that stores information of the video data to be distributed after each of the video data;

a condition storage unit that stores a condition of the response information and information that the video data is to be distributed at the next step;

[ item 4]

The video distribution system according to claim 1, comprising:

the priority order is based on the amount of payment to the viewer.

[ item 5]

The video distribution system according to item 1, characterized by comprising:

the priority order is determined according to the state information of the viewer.

Hereinafter, the video distribution system of embodiment 4 will be described. The video distribution system of embodiment 4 is a system that dynamically changes the development of video (story, etc.) according to the responses of viewers watching streaming video.

In embodiment 4, the video response is a comment made by a viewer watching a video. That is, the video may change the playback of the video due to the content of the comments by the viewer. For example, in the case of a 2-place character in a video, the story may branch to the story that delivers the most commented character as the main story. Hereinafter, the detailed description will be given.

Fig. 26 is a block diagram showing a video distribution system of embodiment 4.

The video distribution system according to embodiment 4 includes a distributor apparatus 3, wherein the distributor apparatus 3 and the streaming server 2 are connected to each other via a network, and the streaming server 2 and the user terminal 1 are connected to each other via a network.

The distributor device 3 is a computer, such as a personal computer, a tablet computer, a smart phone, etc., having a function of distributing video. The distributor device 3 may be, for example, a home computer used by an ordinary user who wants to distribute video. Streaming may be used to send video data out of the distributor device 3 to the streaming server 2.

The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming server 2 distributes the video data received from the distributor apparatus 3 to the user terminal 1. The streaming server 2 can distribute video data to a plurality of user terminals 1 at the same time. The user terminal 1 is a computer operated by a viewer, such as a personal computer, a tablet computer, a smart phone, and the like.

The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play video data distributed from the streaming server 2. Also, the viewer can operate the user terminal 1 to distribute the review of the video to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can play the video and display the comment of the video.

The following description describes video distributed through streaming media and linear play as "distributed video".

The format of the distributed video can be that images and sound acquired by a camera and a microphone are encoded into video data in real time and transmitted. However, in embodiment 2, the distribution video may be video data generated by combining and synthesizing material data.

In embodiment 4, distribution video is prepared in advance as video data of a component (hereinafter referred to simply as "component video data"), and at the same time, a scene in which the component video data is arranged is also prepared. That is, assuming that component video data is transmitted according to scenes, the entire set of distribution video will be transmitted.

FIG. 27 is a block diagram showing a hardware configuration of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 28 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has a video distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a video library 331, a scene storage unit 332, a condition storage unit 333, a comment storage unit 334, and a user information storage unit 335.

Also, the video distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303. The video library 331, the scene storage unit 332, the condition storage unit 333, and the comment storage unit 334 are implemented by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor device 3.

The video library 331 stores component video data.

The component video data may be saved as encoded files in any format, e.g., MPEG4, MPEG2, AVI, MOV, etc.

Fig. 29 shows a block diagram of the structure of the video library 331. As shown in the figure, the video library 331 makes correspondence of component video data and information (video ID) for identifying the component video data, and stores the component video data.

The scene storage unit 332 stores scenes of the distributed video. Fig. 30 shows a block diagram of the structure of the scene storage unit 332. As shown, the scene storage unit 332 stores scene information and sequence information.

The scene information is information about a scene. In fig. 30, the scene information includes, for example, information for identifying a scene (scene ID), a scene name (title), information indicating component video data to be played first in the scene (start video ID), and the like.

The sequence information is information indicating a play sequence of component videos regarding a scene by default.

The sequence information contains information corresponding to a scene ID, a video ID indicating component video data contained in a scene of the scene ID, and a secondary video ID indicating component video data played after the component video data of the video ID.

As described above, in the video distribution system of embodiment 4, component video data to be played next is changed in accordance with the response (comment) of the viewer. However, if the viewer's response does not satisfy the set conditions, the next component video data to be played is determined according to the scene of the sequence information (at the time of default).

The condition storage unit 333 stores information of conditions (hereinafter referred to as "condition information") for branching according to responses (comments) of viewers. Fig. 31 shows a block diagram of the condition storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 includes, a scene ID, a judgment period, a condition, and a secondary video ID.

The scene ID refers to information of a scene.

The condition is a response to the viewer (a comment distributed by the viewer), and for example, whether or not a comment including a predetermined keyword is included in the posted comments during the above period, the number of comments including the predetermined keyword, regional comments in the viewer who distributes the comment, the number of viewers, and the like.

For example, in the case where the total value (average value, median value, maximum value, minimum value, etc.) of the amounts of money put in by the viewer when asking questions in the video is analyzed from the comments, when the viewer having sadness exceeds a predetermined threshold value, when the comments including a predetermined keyword are not posted, or the like, the condition can be satisfied.

The video distribution unit 311 distributes videos. When the video distribution unit 311 receives a designation or the like from the viewer, the video distribution unit 311 reads scene information of a predetermined scene from the scene storage unit 332. Then, the video distribution unit 311 can read the component video data corresponding to the start video ID in the video library 331 (can encode, if necessary, or convert the format of the video) from the start video ID contained in the scene information. Then, the video distribution unit 311 may send the read component video data to the streaming server 2 to distribute the video.

When the secondary video ID does not exist, the video distribution unit 311 may terminate distributing the video.

The comment storage unit 334 stores comments distributed by the viewer. Fig. 32 shows a block diagram of the structure of the comment storage unit 334. The comment storage unit 334 associates the comment with information (comment ID) identifying the comment. Then, the comment storage unit 334 may store the above-described comment, the viewer ID of the comment to be distributed, the date and time of the comment to be distributed, the content of the comment, whether the viewer has paid, the payment amount of the viewer, and the like.

The user information storage unit 335 stores information about the viewer. Fig. 33 shows a block diagram of the structure of the user information storage unit 335. The user information storage unit 335 gives the viewer an ID and stores the viewer's status information. The status information is, for example, information such as a service scheme (e.g., super-android service, basic service, free service, etc.) of video distribution added by the viewer, whether the viewer pays a fee, a payment amount of the viewer, a shopping name of the viewer, and comments posted by the viewer.

The comment acquisition unit 312 acquires a comment distributed by the viewer operating the user terminal 1.

For example, when the streaming server 2 provides an API for acquiring the distributed comment, the comment acquisition unit 312 may acquire the distributed comment via the API.

The comment acquisition unit 312 may register the acquired comment in the comment storage unit 334.

The switching decision unit 313 decides whether to switch videos. The switching decision section 313 reads and sums the comments corresponding to the time periods in the comment storage unit 334 on the basis of the respective pieces of condition information stored in the condition storage unit described above. Then, switching decision section 313 determines whether or not the condition is satisfied, and if the condition is satisfied, video distribution section 311 transmits and causes component video data of the secondary video ID in the condition information.

Here, the switching decision unit 313 reads the comment with high priority from the information stored in the comment storage unit 334 or the information stored in the user information storage unit 335.

Fig. 34 shows a flowchart of processing performed by the video distribution system of embodiment 4 of the present disclosure.

Video distribution section 311 accepts designation of a scene (S421), and sets the start video ID included in the scene information of the designated scene as the play ID (S422).

The comment acquisition unit 312 acquires, from the streaming server 2, a comment distributed by the viewer using the user terminal 1 (S425). Regarding the retrieval of comments, for example, it may be realized via an API provided by the streaming server 2.

The switching decision unit 313 reads out the comment with high priority from the comment storage unit 334 based on each piece of condition information stored in the condition storage unit 333 (S426).

Here, the switching decision unit 313 may decide a service scheme (for example, a service scheme of a video distribution service) that the viewer joins, based on the comment having a high priority. For example, when the viewer has joined a hypertext service (e.g., a service that is higher-ranked than a basic service), the switching decision unit 313 may extract a comment with a high priority from the comment storage unit 334.

Alternatively, when switching determining section 313 determines a comment with a high priority, for example, it may be determined whether or not the paid amount exceeds the reference amount when the posted viewer pays for the posted comment, or it may be determined from the viewer who paid the highest priority. For example, when the viewer pays 500 m for a certain comment, the switching decision unit 313 extracts a comment with a high priority because the paid amount exceeds a reference amount (e.g., 300 m). Also, when the video distribution unit 311 is to distribute a video, the reference amount for the comment may be shown in advance.

Alternatively, switching determining section 313 may determine the comment with the high priority based on, for example, whether the viewer holds the given product in posting the comment, or before or after purchasing the given product, or whether the right to exercise the given product has been issued, or the like. For example, the goods may correspond to particular reviews, or the effectiveness in terms of a specified quantity and duration may occur without regard to a particular good.

Next, the switching decision unit 313 determines whether or not the read comment has a condition that satisfies the condition information (S427). Regarding determining whether the comment has the satisfaction condition, it can be determined by calculating the number of each keyword contained in the comment and whether the number exceeds a predetermined threshold.

Alternatively, in step S426, when the switching decision unit 313 reads a comment with the highest priority (for example, the highest paid amount, or the viewer who paid the highest fee), it may be determined whether or not the comment satisfies the condition.

Fig. 35 is an explanatory view showing an example of a screen displayed by the user terminal.

As shown in fig. 35(a), the video data distributed from the streaming server 2 causes the user terminal 1 to display a video 511, and also displays a comment 512 distributed by the user terminal 1 or distributed by another user terminal 1.

In the example of FIG. 35(a), there are two-digit fielders (Ai-chan, and Megu-chan, respectively) displayed. For a character, posted comments 512 include, for example, "," Ai-chan! "," Ai-chan refuel! "review of like"

Here, if the condition storage 333 contains condition information in which the word "call Ai-chan" is a condition, a video 513 as shown in fig. 35(b) will be displayed. Since the word is posted in fig. 35(a), a video 513 is displayed thereafter.

If the phrase "call Ai-chan" is not contained in the comment of fig. 35(b), a video 514 of the secondary video ID of the sequence information is displayed as in fig. 35 (c).

As described above, in the video distribution system according to embodiment 4, since the streaming server 2 continuously transmits component video data, linear video can be provided to the user terminal 1. Meanwhile, in playing component video data, component video data to be played next may be decided according to comments of a viewer.

Therefore, linear videos of different developments can be provided to the viewer according to the viewer's response.

Therefore, even if recorded component video data is used, video can be distributed in a linear manner without losing the sense of live broadcasting.

The video distribution system according to embodiment 4 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

In the present embodiment, even in the middle of playing component video data, when the condition is satisfied for a comment, transition is made to the next component video data (step S428 → S429 → S423 in fig. 8), however, not only can the component video data be played to the end, but the transition is made to the next component video data.

In this case, a step of confirming whether or not the playback of the component video data has been completed may be provided before or after step S429 in fig. 33.

For example, when a viewer clicks or touches a specific area of a video distribution screen displayed by the user terminal 1, the comment acquisition unit 312 acquires the action as information. Then, the switching decision unit 313 may calculate the number of activities (i.e., the number of viewers who clicked or touched in a specific area on the distribution video) and decide whether to switch the component video data by determining whether the number exceeds a threshold.

When a viewer views a distributed video through a web browser of the user terminal 1, a click action by the web browser is transmitted to the streaming server 2 or the distributor apparatus 3. Then, the comment acquisition unit 312 may acquire a Click action (Click event) directly or through the streaming server 2, and the Click action may be stored in the comment storage unit 334.

The activity acquisition unit 312 may receive voice data acquired from the user terminal, analyze the received voice data, and acquire a specific utterance as an activity by the activity acquisition unit 312 when the voice data contains the utterance. At this time, the switching decision unit 313 switches the video according to the activity.

Furthermore, it is also possible to perform parsing of the sound at the user terminal 1, and then the activity acquisition unit may receive the parsed result.

Furthermore, the activity acquisition unit 312 does not need to acquire activity from the user terminal 1, and may acquire activity on the system, for example.

The activities that can be acquired on the system include, for example, the time elapsed since the start of the distribution of the animation, the current time, the object collision occurring in the distribution of the animation, the location of the viewer or distributor, the weather conditions in the area set in advance, and the like

The switching decision unit 313 may also perform a switching animation depending on these activities.

< embodiment 5 >

The video distribution system according to embodiment 5 has the following configuration.

[ item 1]

A video distribution system comprising:

a material library for storing material data for generating a video;

a video distribution unit that transmits the video according to the material data;

and an activity acquisition unit that acquires activity information on a line of sight from a viewer of the video during playback of the video.

And the behavior processing unit is used for operating material data according to the activity information.

[ item 2]

The video distribution system according to item 1, characterized by further comprising:

the activity acquisition unit acquires the activity generated by the video distribution system;

the behavior processing unit operates the material data according to the activity.

[ item 3]

The video distribution system according to item 1, characterized by further comprising:

the information on the movement of the viewer's gaze includes information on the gaze projected by the viewer to a predetermined area in the broadcast video.

[ item 4]

The video distribution system according to item 1, characterized by further comprising:

the action behavior contains at least one of the following;

the appearance, movement and disappearance of the object, the start and stop of the animation, the start or stop of the video, the start or stop of the sound, and the alteration of the material data.

Hereinafter, the video distribution system of embodiment 5 will be described. The video distribution system of embodiment 5 is a system that dynamically changes streaming distributed video according to various activities.

The distributed video is generated from material data of the video. The material data is, for example, a 3D model, video data, sound data, or the like. Each material data may be set according to the action behavior of the activity.

In embodiment 5, the distributed video may be generated by synthesizing images or images output as a result of the action.

In the video distribution system of embodiment 5, the distribution video can be dynamically changed by starting the action behavior according to the activity. Details are as follows.

Fig. 36 shows a configuration diagram of the video distribution system of embodiment 5.

The video distribution system according to embodiment 5 further includes a distributor apparatus 3. Wherein the distributor device 3 is communicatively connected to the streaming server 2 and the streaming server 2 is communicatively connected to the user terminal 1.

A plurality of user terminals 1 can be communicatively connected.

The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming server 2 distributes the video data received from the distributor apparatus 3 to the user terminal 1. The streaming server 2 may distribute video data to one or more user terminals 1 simultaneously.

The user terminal 1 may be a computer operated by a viewer, such as a Head Mounted Display (HMD), a personal computer, a tablet computer, a smart phone, etc., however, the user terminal 1 in the 5 th embodiment is exemplified by the HMD. The viewer operates the user terminal 1 and an attached controller (not shown) to access the streaming server 2, and the user terminal 1 can receive and play video data sent from the streaming server 2.

The user terminal 1 may collect various kinds of activity information, such as photographing a viewer, recording a sound of the viewer, and receiving a comment input by the viewer.

The streaming server 2 acquires the activity of one or a plurality of viewers. The distributor apparatus 3 may acquire the activities of the viewers via, for example, an api (application Programming interface) provided by the streaming server 2.

Fig. 37 shows a block diagram of a Head Mounted Display (HMD). As shown in fig. 37, HMD1 includes at least a control unit 101, a memory 102, a storage device 103, a display control unit 104, a display unit 105, a transmission/reception unit 106, an input/output unit 107, and the like. Which are electrically connected to each other via a bus. The control unit 101 is an application program that can control the overall operation of the HMD1, control data transfer between elements, and execute a game process, and is an arithmetic device that performs an information process for an authentication process.

For example, the control unit 101 is a cpu (central Processing unit), and the control unit 101 executes a program stored in the storage device 103 and expanded in the storage 102 to process each piece of information.

The memory 102 includes a main memory unit including a volatile memory device such as a dram (dynamic Random Access memory) and a supplementary memory device including a non-volatile memory device such as a flash memory or an hdd (hard disk drive). The memory 102 is used as a work area of the CPU101, and also used for storing various setting information, a BIOS (Basic Input/Output System) executed when the streaming server 2 or the distributor device 3 is started up.

The storage device 103 stores various programs such as application programs. A database housing various data for processing may also be established in the storage device 103.

The display control unit 104 is, for example, a gpu (graphics Processing unit) and mainly performs arithmetic Processing such as video Processing. Display control section 104 synthesizes the work data such as characters generated by CPU101

The display unit 105 displays a virtual space image based on the image signal input from the display control unit 104.

The display unit 105 is, for example, a display such as an LCD or an organic EL. The display unit 105 displays a left-eye video and a right-eye video for parallax between both eyes to provide a stereoscopic video to a viewer. The display unit 105 may be configured by a display for the left eye and a display for the right eye, respectively, or may be an integrated display for the left and right eyes.

The transceiving unit 106 enables the HMD1 to connect to the network. The transceiver unit 106 may also include a short-range communication interface such as Bluetooth (registered trademark) and ble (Bluetooth Low energy). The transceiver 106 receives an instruction signal from a controller (not shown) via a network.

The input/output unit 107 is an interface for inputting/outputting video signals, audio signals, and the like if the video generating device, the display device, and the like are provided outside.

Also, HMD1 may be equipped with sensor 108. The sensor is capable of detecting the orientation or tilt of the viewer's head, for example, one or more combinations of magnetic sensors, accelerometer, or gyroscopic sensors. The accelerator can detect acceleration (change in speed per unit time).

Here, the accelerator may detect acceleration in a 3-axis direction (X, Y, Z axis). For example, if the front-back direction of HMD1 is the X axis, the left-right direction is the Y axis, the up-down direction is the Z axis, the front of HMD1 is the positive direction of the X axis, the left is the positive direction of the Y axis, and the down direction is the positive direction of the Z axis, the accelerator 30 can detect the acceleration in the individual direction, and can detect the rotation angle (roll angle) around the X axis, the rotation angle (pitch angle) around the Y axis, and the rotation angle (yaw angle) around the Y axis.

Instead of the sensor 108, the HMD1 may be provided with a plurality of light sources (e.g., infrared LEDs, visible LEDs, etc.). Then, a camera (e.g., an infrared camera, a visible light camera, etc.) may be installed outside the HMD1 to detect the light sources, so that the position, direction, and inclination of the HMD1 in a specific space can be known. The HMD1 may also be equipped with a camera that can detect the light source for the same purpose.

Also, HMD1 may provide an eye tracking sensor. The eye tracking sensor is used to detect the direction of the line of sight of the left and right eyes of the viewer and the place of gaze.

There are various types of eye tracking sensors, for example, a position of reflected light generated by irradiating the left and right eyes with weak infrared light is a reference point. Then, the gaze direction is detected from the position of the reflected light and the position of the pupil, and the gaze point or the like can be detected from the intersection of the gaze directions of the left and right eyes.

The speaker 109 outputs a sound signal such as music data input from the sound generation unit.

The HMD1 may execute an application program together with a network in conjunction with an external processing device such as a server or an image processing device to transmit and receive various data, or may execute a built-in program as an independent machine itself without depending on the external processing device or the like.

Fig. 38 shows a block diagram of the hardware of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 39 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a material library 331, a behavior storage unit 333, and an activity storage unit 334.

The video distribution unit 311, the activity acquisition unit 312, and the behavior processing unit 313 are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303. The material library 331, the scene storage unit 334, and the behavior storage unit 333 are realized by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor device 3.

The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, a 3D model, a still image, animation, sound data, MIDI data, character data, and the like. Fig. 40 shows a block diagram of the material library 331. As shown in the figure, the material library 331 gives information (material ID) identifying a material and stores various material data.

The behavior storage unit 333 stores operation (action behavior) information (hereinafter, simply referred to as behavior information) on material data. Fig. 41 shows an example of behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information includes a behavior ID indicating an action behavior, a judgment period, a condition, an action behavior, and the like.

The determination period is information for determining whether or not the activity satisfies the condition. The term of judgment can be a period of relative interest, such as from now to 5 minutes ago. The determination period may be an absolute period, for example, from 00:00 to 00:10 on 25 days of 12 months.

The condition may be for activity, e.g., whether activity is present, or whether the aggregate value of activities from multiple viewers exceeds a threshold, etc.

For example, in distributed video playback, conditions such as whether or not the viewer has watched a specific area, whether or not the number of viewers watching a specific area on the screen exceeds a threshold value, and the like may be used as the viewer activity information.

Based on the material data for generating the distributed video, it is possible to use conditions such as whether the viewer has viewed the object that is displayed again, whether the number of viewers viewing the object exceeds a threshold value, and the like.

Whether the viewer looks at a specific area or object can be determined by detecting the posture, direction, and gazing place of the viewer's head using an eye tracking sensor or various sensors provided in the HMD. In this case, the determination may be performed by using a single sensor or by combining a plurality of sensors.

However, instead of the HMD, the posture, line of sight, gesture, and the like of the viewer may be recognized using video analysis. In this case, the condition may be whether the viewer has a specific posture, whether the viewer has a specific direction of view (specific line of sight), whether the viewer has a specific gesture, or whether the viewer has a specific posture, a specific direction of view, or a specific gesture exceeding a threshold.

The system activity information may be, for example, whether or not the number of viewers watching the distribution image exceeds a threshold. The playback time of the distribution image may be a condition. Such as the elapsed time from the start of playback to the stop of playback, etc. In addition, when the weather of the area where the viewer or distributor is located is acquired as the system activity information, the weather may be used as the condition, for example, a clear day, a rainy day, a snowy day, a predetermined intensity of wind, a predetermined temperature, or the like. Also, when the material data is a 3D model, a conflict of the items in the distribution video may be also a condition.

The action behaviors are various operations on the above-described material data. The action behavior may contain parameters so that the material data can be set in detail for specific operations.

In embodiment 5, the operation may be performed or stopped not only by operating the material data, but also by waiting for the other operation to complete its execution. The action behavior is, for example, a program written in a script language which can also be saved.

The video distribution unit 311 distributes videos. A single action may also perform multiple actions. The video distribution unit 311 can produce a distribution video in which a composite operation behavior is performed by a behavior processing unit 313 described later.

Further, the video delivery unit 311 may deliver the video to the user terminal 1 by transmitting the generated delivery video to the streaming server 2.

The activity storage unit 334 stores various activities that have occurred. Fig. 42 shows a block diagram of the structure of the active memory unit 334. As described above, the activity storage unit 334 stores user activity information and system activity information.

Hereinafter, the user activity information and the system activity information are collectively referred to as activity information.

The user activity information includes an activity ID indicating an activity, a viewer ID indicating a viewer associated with the activity, a time point at which the activity occurs, and an activity content.

The system activity information includes an activity ID, a time point at which the activity occurs, and activity content.

The activity content varies from activity to activity. For example, when the viewer looks at a specific area of a video during video playback, there is a possibility that the user activity information is set as active content. The specific region may be a single region or a plurality of regions.

The activity acquisition unit 312 acquires an activity and stores the acquired content of the activity as activity information in the activity storage unit 334.

What kind of activity the activity acquisition unit 312 is to acquire may be set by the user. The setting information indicating the kind of the activity to be acquired may be stored in, for example, the memory 302 or the storage device 303.

The activity acquisition unit 312 may register information associated with the position of the line of sight of the viewer in video playback as user activity information. For example, when viewing and distributing video via the HMD, one item of information or a plurality of pieces of combined information among the information such as the head posture, inclination, and gazing place of the viewer acquired via the sensor of the HMD is sent to the streaming server 2 or the distributor apparatus 3. The activity acquisition unit 312 analyzes the received information, determines whether or not the viewer has a specific area of the screen on which the viewer is looking, and determines to register an activity. Alternatively, the user terminal 1(HMD) performs the above analysis, receives information on the line-of-sight position of the video being played by the viewer, and registers the information as an event. Also, the activity acquisition unit 312 may also receive a captured image of the viewer from the user terminal 1, and analyze the received image to acquire the posture, line of sight, and gesture of the viewer. Alternatively, the image may be analyzed in the user terminal 1, and then the analysis result may be received by the activity acquisition unit 312.

Activity acquisition section 312 may periodically count the number of viewers who view the program and register system activity information.

Also, the video analysis process may be executed by the user terminal 1(HMD), and then the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register it as the user activity information.

For example, it is previously set that the timeout activity can be acquired from the clock, and at this time, the event acquisition unit 312 may register the lapse of a predetermined time from the start of playing the distribution video as the system activity information. Also, the activity acquisition unit 312 may register a predetermined time point (for example, a time point just before the date is changed, just 3 pm, or the like) as the system activity information.

Also, for example, in the case where the material data is a 3D model, the activity acquisition unit 312 may register system activity information having determined a conflict of items in the distribution video as information.

Fig. 43 shows a flowchart of processing performed by the video distribution system of the embodiment of the present disclosure.

The activity acquisition unit 312 may periodically acquire information related to the viewer' S gaze position (S423). For example, the activity acquisition unit 312 may acquire a parameter via an API provided by the streaming server 2, and the parameter may be one of or a combination of head pose, inclination, and gaze point acquired via a sensor of the HMD.

The activity acquisition unit 312 determines whether the viewer has a specific area of the video that is being played to which the viewer is looking based on the received parameter, and can register as an activity.

In addition, the activity acquisition unit 312 may acquire comments distributed after a prescribed time using a timer function.

For each piece of activity information stored by the activity storage unit 333, the activity processing unit 313 reads the activity information including the time point of the determination period from the activity storage unit 334. Then, the behavior processing unit 313 determines whether or not the activity content of the activity information that has been read has a condition that satisfies the behavior information.

If the activity satisfies the condition (S426: YES), the behavior processing unit 313 performs the action included in the behavior information (S427).

For example, when the line of sight of the viewer is a specific area where a video is played, or when the number of viewers in the specific area exceeds a specific number, the corresponding scene can be distributed if the material data (for example, a specific scene of the video) of the video corresponding to the area is connected and stored, that is, if the action condition is satisfied in the event.

For example, when a plurality of characters are included in a distributed video, when it is detected that the line of sight of the viewer is projected to a specific character, the scene of the character can be diversely focused and the video of the scene can be distributed.

If the action of the action information does not terminate the distribution of the video (S428), the process returns to step S423.

As described above, the video distribution system of embodiment 5 distributes a video to the user terminal 1 via the streaming server 2, and can change playback distribution video in accordance with the line of sight of the viewer. Therefore, while using the recorded video, various distributed videos can be developed according to the reaction of the viewer, and the distributed video does not lose the sense of live in the streaming mode.

In particular, since a viewer usually projects a line of sight to a person or an object of interest when viewing a video, the viewer can naturally diverge and develop and distribute the video without any special operation.

The video distribution system according to embodiment 5 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

Also, in the embodiment of the present invention, it is described that even if a video is being played, as long as the condition is satisfied for the comment, the transition is made to the next component video data (step S427 in fig. 42). However, the present invention is not limited to this, and the next action may be executed after the execution of the executing action is completed.

< embodiment 6 >

The video distribution system according to embodiment 6 has the following configuration.

[ item 1]

A video distribution system comprising:

a material library for storing material data for generating a video;

a video distribution unit that transmits the video according to the material data;

a response acquisition unit that acquires response information on a viewer's response from a viewer of the video during playback of the video;

the behavior processing unit is used for operating the material data according to the reaction information;

a group setting unit that groups the viewer into 2 or more groups based on the response information;

and the behavior processing unit is used for performing different operations on each group after the viewers are grouped.

[ item 2]

The video distribution system according to item 1, characterized by further comprising:

and the group storage unit is used for corresponding the information of the viewers corresponding to the acquired response information and the group to which the viewers belong and executing storage.

[ item 3]

The video distribution system according to item 1 or item 2, characterized by further comprising:

a reaction history storage unit that associates the viewer with specific information and manages information indicating the reaction of the viewer;

the video containing a depicting character, and the video being in relation to a stone scissors game, and;

the reaction refers to the hands of the viewer playing the scissors stone cloth game, and;

the group setting unit groups the viewers as follows; dividing viewers with winning roles into a 1 st group, and viewers with losing roles into a 2 nd group;

the behavior processing unit reflects only the reaction information of the viewer to which the 1 st group belongs, and performs the operation.

[ item 4]

The video distribution system according to item 3, characterized by further comprising:

the behavior processing unit operates the material data having the function of outputting the image of the stone scissors game when the number of viewers belonging to the group 1 is less than or equal to a predetermined number.

[ item 5]

The video distribution system according to item 4, characterized by further comprising:

and the reward processing unit is used for rewarding the audience belonging to the 1 st group when playing the image of which the stone scissors game is ended.

Hereinafter, the video distribution system of embodiment 6 will be described. The video distribution system of embodiment 6 is a system that dynamically changes streaming distributed video according to various activities.

In embodiment 6, the distributed video may be generated by synthesizing images or images output as a result of the action. In the video distribution system of embodiment 6, the distribution video can be dynamically changed by activating the action behavior of the activity. Details are as follows.

Fig. 44 shows a configuration diagram of the video distribution system of embodiment 6.

The video distribution system according to embodiment 6 includes a distributor apparatus 3, and the distributor apparatus 3 is connected to the streaming server 2 in a communication manner, and the streaming server 2 is connected to the user terminal 1 in a communication manner. A plurality of user terminals 1 can be communicatively connected.

The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming server 2 distributes the video data received from the distributor apparatus 3 to the user terminal 1. The streaming server 2 may distribute video data to one or more user terminals 1 simultaneously.

The following description describes video distributed through streaming media and linear play as "distributed video".

The format of the distributed video can be that images and sound acquired by a camera and a microphone are encoded into video data in real time and transmitted. However, in embodiment 6, the distribution video may be video data generated by combining and synthesizing material data.

In the video distribution system according to embodiment 6, as an example, a stone scissors game is assumed to be played.

In embodiment 6, a character appears in the distributed video, and the character and a large number of viewers play a stone scissors game. The final winner of the stone scissors game will be rewarded.

The award may be set arbitrarily, for example, a point, electronic money, a gift certificate, virtual money, a usage right of a copyright, a usage right of an object such as a game service, or the like.

FIG. 45 is a block diagram showing a hardware configuration of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 46 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 has various processing units such as a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a group setting unit 314, a total output unit 315, a bonus processing unit 316, and various storage units such as a material library 331, a behavior storage unit 333, an activity storage unit 334, a group condition storage unit 335, and a group storage unit 336.

The various processing units are realized by the CPU 301 in the distributor apparatus 3 causing the memory 302 to read and execute a program in the storage apparatus 303. The various storage means are realized by providing a partial storage area in at least one of the memory 302 and the storage device 303 of the distributor device 3.

The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, a 3D model, a still image, animation, sound data, MIDI data, character data, and the like. Fig. 47 shows a block diagram of the material library 331. As shown in the figure, the material library 331 gives information (material ID) identifying a material and stores various material data.

In embodiment 6, it is assumed that a character plays a stone scissors game with a large number of viewers.

The material library registers material data of various drawing scenes, for example, material data of scenes such as a scene in which a drawing character explains the play and progress of the stone scissors game and a prize for a winner, material data of a scene in which a viewer instructs a time point when the viewer makes a fist, material data of a scene in which a result of the stone scissors game is displayed, material data of a scene in which the stone scissors game is to be continued, material data of a scene in which the stone scissors game is to be ended, and the like.

The behavior storage unit 333 stores operation (action behavior) information (hereinafter, simply referred to as behavior information) on material data. Fig. 48 shows an example of behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information contains a behavior ID indicating the behavior of the action, a judgment period, a group, a condition, and the behavior of the action.

The determination period is period information for determining whether or not the activity satisfies a condition. The term of judgment can be a period of relative interest, such as from now to 5 minutes ago. The determination period may be an absolute period, for example, from 00:00 to 00:10 on 25 days of 12 months. The determination period may be a predetermined action and a time during which the action is executed (for example, 10 seconds from the start of the action and 10 seconds after the end of the action). The length of the judgment period may be set arbitrarily, for example, 1 second, 1 minute, 1 hour, 1 day, or the like.

The group is a group to which the viewer belongs.

When the behavior information includes a setting group, the activity information of the viewer belonging to the set group is determined whether or not the condition described later is satisfied. For example, when a character in a distribution video performs a stone scissors game with a viewer, it is possible to add a user activity of the viewer belonging to a winning group to the trial run of the 2 nd and subsequent trials. The group may be omitted, and the condition that the viewer belongs to a specific group may be specified in the condition described later.

The condition may be for activity, e.g., whether activity is present, or whether the aggregate value of activities from multiple viewers exceeds a threshold, etc.

The user activity information may be, for example, whether or not the viewer presses a specific button in the reproduced video, whether or not the viewer clicks a predetermined region on the screen, whether or not the number of viewers clicked or touched on the video exceeds a threshold, or the like.

Also, whether or not such images are distributed to the streaming server 2 and whether or not the number of viewers distributing images exceeds a threshold may be made conditional on whether the viewers are self-timer images or the ambience of the viewers in the images.

The system activity information may be, for example, whether or not the number of viewers watching the distribution image exceeds a threshold.

The playback time of the distribution image may be a condition. Such as the elapsed time from the start of playback to the stop of playback, etc.

Also, when the material data is a 3D model, a conflict of the items in the distribution video may be also a condition.

The action behaviors are various operations on the above-described material data. The action behavior may contain parameters so that the material data can be set in detail for specific operations. In embodiment 6, the operation behavior may be not only the operation of the material data, but may be performed or stopped, or may wait for the other operation behavior to complete its execution. The action behavior is, for example, a program written in a script language which can also be saved.

The activity storage unit 334 stores various activities that have occurred. Fig. 49 shows a block diagram of the structure of the active memory unit 334.

As described above, the activity storage unit 334 stores user activity information and system activity information.

The system activity information includes an activity ID, a time point at which the activity occurs, and activity content.

The active content may differ depending on the activity, and for example, in the case of user activity information, when a viewer issues a comment for distributing a video, the issued comment will likely be set as the active content. Further, information indicating the line of sight or the gesture of the viewer obtained by analyzing the viewer image captured by the user terminal 1, the line of sight of the viewer, and the gesture of the viewer may be set as the active content. In the case of the system activity information, the number of viewers, weather, time point, and the like may be set as the activity content.

The group condition storage unit 335 stores grouping conditions (hereinafter, referred to as group condition information) of the viewer. Fig. 50 shows a block diagram of the structure of the group condition storage unit 335.

The group condition information may include, for example, a judgment period, a condition, and a group.

The determination period indicates a period during which the grouping job is performed. The determination period may be the same as the determination period of the behavior information described above, and may be, for example, a specified action and a time during which the action is performed (for example, 10 seconds from the start of the action, and 10 seconds later, the action is completed). The length of the judgment period may be set arbitrarily, for example, 1 second, 1 minute, 1 hour, 1 day, or the like.

The condition may be a condition concerning a specific viewer, for example, the latest user activity, the past user activity, a group to which the viewer belongs, and the like may be all the conditions. For example, when a stone scissors cloth game is initially executed, the player's hand (for example, when the player plays the cloth) may be conditioned, and then, the 2 nd and subsequent games may be set to belong to the winner group and the hand to be played is a specific hand (stone, scissors, or cloth).

The group condition information may set a plurality of conditions. The group is a group to which the viewer who satisfies the above conditions will belong. For example, the condition may be that the condition is specified, the condition belongs to a winner group, and the hand is a stone, and the group condition information specifies that the group is a winner group, which indicates that the winner has been to the previous (or, may be a flat-handed) viewer, and that the viewer who has got a stone during the judgment period is to be attached to the winner group.

In embodiment 6, it is assumed that all modes that a viewer can adopt are set in the group condition information. For example, assume that group condition information specifying a default (no viewer matching other conditions) condition is included.

The group storage unit 336 can manage a group to which a viewer who distributes video belongs. Fig. 51 shows a block diagram of the structure of the group memory unit 336. The group storage unit 336 stores group information containing a viewer ID indicating a viewer and a group to which the viewer belongs.

The video distribution unit 311 distributes videos. Video distribution section 311 synthesizes operation behaviors (or may execute a plurality of operation behaviors) executed by behavior processing section 313 described later, and generates (if necessary, may execute encoding) a distribution video. Further, the video delivery unit 311 may deliver the video to the user terminal 1 by transmitting the generated delivery video to the streaming server 2.

The activity acquisition unit 312 acquires an activity and stores the acquired content of the activity as activity information in the activity storage unit 334. What kind of activity the activity acquisition unit 312 is to acquire may be set by the user. The setting information indicating the kind of the activity to be acquired may be stored in, for example, the memory 302 or the storage device 303.

The activity acquisition unit 312 may register, for example, a button, touch, or click input by the viewer as the user activity information. For example, in the case where the viewer views the distributed video using a web browser, a script that transmits the click activity occurring on the web browser to the streaming server 2 or the distributor apparatus 3 is set in advance, so that the activity acquisition unit 312 can acquire the click activity via the streaming server 2 or directly acquire the click activity.

The activity acquisition unit 312 may also receive a captured image of the viewer from the user terminal 1, and analyze the received image to acquire the posture, line of sight, and gesture of the viewer. Alternatively, the image may be analyzed in the user terminal 1, and then the analysis result may be received by the activity acquisition unit 312. The activity acquisition unit 312 may periodically count the number of viewers and register the number in the system activity information. However, the image may be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register the analysis result as the user activity information.

In the stone scissors game according to embodiment 6, for example, the motion acquisition section 312 may register a hand of the viewer as the user acquisition information.

The hands of the stone scissors cloth game can be provided with buttons for allowing a viewer to click stones, scissors and cloth on a network browser.

In addition, the hands of the stone scissors cloth are displayed in the distribution video, and the fields corresponding to the respective outgoing hands are set. Then, the position information clicked on in the distribution video is sent to the distributor apparatus 3 via the streaming service period 2, or directly to the distributor apparatus 3. Then, the activity acquisition unit 312 will determine whether there is a corresponding outgoing hand according to the clicked position, and can determine the outgoing hand of the viewer.

The determination may be performed in the user terminal 1 or the streaming server 2. Note that activity acquisition section 312 may determine the hand that the viewer has uttered by, for example, representing a sentence of extracting the hand of the stone scissors cloth in the posted comment of the viewer.

The behavior processing unit 313 may also refer to a group to which the viewer belongs. That is, when there is a set group in the behavior information, behavior processing section 313 executes an action behavior corresponding to the activity information corresponding to the viewer belonging to the group.

For example, in the case of a stone-scissors-cloth game, the action is performed only for the action from the viewer belonging to the winner group. Therefore, the game can be played correctly without considering the activity from the loser when the stone scissors cloth game is played.

Group setting section 314 groups viewers. In embodiment 6, each time behavior processing section 313 performs an action behavior, group setting section 314 performs a grouping operation for viewers. Not only this, the group setting unit 314 may perform the grouping operation at an arbitrary timing.

For example, activity acquisition section 312 can perform a grouping operation when an activity that has been set in advance (for example, a response of a viewer such as a comment made by the viewer) is acquired or every time a predetermined time elapses.

Group setting section 314 searches for group condition information satisfying the condition among the group condition information registered in group condition storage section 335 for each viewer. Then, group setting section 312 determines that the viewer belongs to the group set in the searched group condition information.

The group setting unit 314 generates group information corresponding to the determined viewer, and registers the group information in the group storage unit 336. When the group information corresponding to the viewer is previously registered in the group storage unit 336, the group setting unit 314 updates the information.

In embodiment 6, the group condition information sets both a condition for hands to be thrown by the stone scissors (and, in the 2 nd and later games, the viewer must belong to the winner group), and a viewer who satisfies the condition will be set as the winner group.

Other viewers may be set as a loser group. Therefore, group setting section 314 reduces the number of viewers belonging to the winner group by repeating the stone scissors game.

The aggregate output unit 315 may output various aggregates. The total output unit 315 may total, for example, the number of viewers calculated from the user activity information registered in the past, or the number of viewers who have posted comments including a specific character for each specific character. The total output unit 315 may sum up, for example, the number of viewers belonging to each group from the group storage unit 336. The totalization output unit 315 may output the totalized number. The number outputted from the total output unit 315 is transmitted to the user terminal 1 separately from the distribution video. The number may then be displayed on the user terminal 1 or may be overlaid on the distribution video.

The bonus processing unit 316 performs processing to reward the viewer according to the group. The bonus processing unit 316 may, for example, only award viewers belonging to a specific group, or may give different awards according to the group. The reward processing unit 316 may perform a reward process in general, such as adding points, moving the amount of money of virtual money, and giving a reward to a product. Explanation is omitted here.

In the 6 th embodiment, the bonus processing unit 316 awards a bonus to a winner of the stone scissor-cloth game, that is, performs bonus to each viewer belonging to a winner group.

Fig. 52 shows a flowchart of processing performed by the video distribution system of embodiment 6 of the present disclosure.

Regarding each piece of behavior information stored in the behavior storage unit 333, if there is a set group of behavior information (S424: YES), the behavior processing unit 313 corresponds to the group and reads the activity information of the time and date within the judgment period from the activity storage unit 334 (S425). If the behavior information does not set a group (S424: NO), the activity information of all the times and dates within the judgment period is read from the activity storage unit 334 (S426).

The action processing unit 313 determines whether the action content of the read action information satisfies the action information (S427).

When the behavior information includes information other than the event information and the group information and is a condition corresponding to information managed by the distributor apparatus 3 or a condition corresponding to information that can be acquired from another information processing apparatus, the behavior processing unit 313 acquires the information and determines whether or not the condition is satisfied.

If the condition is satisfied by the activity (YES in S428), the action processing unit 313 executes the action contained in the action information (S429).

Group setting section 314 performs a grouping operation for the viewer (S430). Fig. 53 is a diagram illustrating grouping processing performed on a viewer according to embodiment 6.

Group setting section 314 performs the following processing for each viewer of the event information.

The group setting unit 314 reads the group condition information from the group condition storage unit 335 (S441). Then, the activity information of the date and time within the judgment period corresponding to the viewer is read from the activity storage section 334 based on the read group condition information (S442). When the read campaign information has information satisfying the group condition information (S443: YES), the group information is registered in the group storage unit 336 (S444). The group information includes a group in which a viewer ID indicating a viewer and group condition information are set.

In the above manner, the viewers are grouped.

Returning to fig. 52, if the information of the behavior information does not terminate the distributed video (S431: NO), the process returns to step S423 to repeat the process. For example, in a stone scissors game, if the number of viewers belonging to the winner group is less than a predetermined number, behavior information for executing the action of terminating the video distribution can be registered.

When the action of terminating the distribution of the video is performed (S431), the bonus processing unit 316 rewards the viewers corresponding to the group (S432), and terminates the processing.

For example, the bonus processing unit 316 may only award viewers belonging to the winner group to the stone scissors game.

Fig. 54 is a diagram showing an example of the viewing screen 50 for distributing video. The viewing screen 50 is displayed on the user terminal 1. On the viewing screen 50, a distribution video 51 is played, and an instant comment 52 (which may be displayed in a list type) of the distribution video 51 by the viewer is displayed.

Taking fig. 54 as an example, the character in the distribution video 51 says (utters) that the stone scissors game 53 is being accepted. The viewer will then have the input text as his or her own provenance.

Then, the behavior processing section 313 draws and represents the hand that the viewer has come out in the distribution video in accordance with the hand that the stone scissors cloth included in the comment 52 has come out.

Although not shown in fig. 54, the material data rendered as the distribution video 51 may also be operated on by the behavior processing unit 313 according to the comment 52. For example, when a stone scissors game is played and the majority of the hands are played, the distribution video 51 may be added with speech information like "many people play".

The viewing screen 50 also displays the result of the aggregation by the aggregation output unit 315. For example, the number of viewers in the winner group 55, and the ratio of the payouts 56.

The viewer can refer to the above-described total result to determine the player's hand.

As described above, the video distribution system of embodiment 6 distributes video to the user terminal 1 via the streaming server 2, and can change the distributed video in play in response to various activities in the course of distributed video play.

The video distribution system according to embodiment 6 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

Also, in the embodiment of the present invention, it is described that even if the video is being played, as long as the condition is satisfied for the comment, the transition is made to the next component video data (step S428 of fig. 52). However, the present invention is not limited to this, and the next action may be executed after the execution of the executing action is completed.

The present embodiment describes that the grouping job is performed every time the action is executed, but the present invention is not limited to this, and whether or not the grouping job is performed may be determined according to the content of the material data or the action. For example, only when a character is a video image, the grouping operation of the viewers can be performed.

The present embodiment is an example of a stone scissors game, but the present invention is not limited thereto, and the present invention can be applied to entertainment games such as a digital game, a character game, a bingo game, a game for looking at the game, a psychological test game, a puzzle guessing, and a back-out stone scissors game.

< 7 th embodiment >

The video distribution system according to embodiment 7 has the following configuration.

[ item 1]

A video distribution system comprising:

a material library for storing material data for generating a video;

a video generation unit that generates a 1 st or 2 nd component video from the material data of 1 st or 2 nd, and simultaneously generates the generated 1 st or 2 nd component video as the video in a display division state;

a response acquisition unit that acquires response information on a viewer's response from a viewer of the video during playback of the video;

a behavior processing unit that performs the operation on the 1 st material data in response to only a response of the viewer belonging to the 1 st group, and performs the operation on the 2 nd material data in response to only a response of the viewer belonging to the 2 nd group.

[ item 2]

The video distribution system according to item 1, characterized by further comprising:

the video generation unit terminates displaying the divided state when the 1 st or 2 nd material data is the same material data, and generates the video from the 1 st or 2 nd material data.

[ item 3]

The video distribution system according to item 1 or item 2, characterized by further comprising:

the material data is associated with at least one of a plurality of characters;

each of the groups being associated with the role;

the video generation unit terminates the display of the divided state when all of the 1 st or 2 nd material data associated with the character corresponding to the plural groups are used, and generates the video from the 1 st or 2 nd material data.

[ item 4]

The video distribution system of at least 1 of items 1 to 3, further comprising:

and a group setting unit for grouping the viewers according to the response information.

[ item 5]

The video distribution system according to item 4, characterized by further comprising:

a group storage unit that associates the viewer's information corresponding to the acquired response information with the group to which the viewer belongs, and executes a storage job.

Hereinafter, the video distribution system of embodiment 7 will be described. The video distribution system of embodiment 7 is a system that dynamically changes streaming distributed video according to various activities.

Action behavior (Action) refers to operations on material data. The action may include the appearance, movement, or destruction of an object represented by the 3D model, the action further including the start and termination of animation, the playing and stopping of video, the playing and stopping of sound, the replacement (substitution) of material data, and the like.

In embodiment 7, the distributed video may be generated by synthesizing images or images output as a result of the action.

In the video distribution system of embodiment 7, the distribution video can be dynamically changed by activating the action behavior of the activity. Details are as follows.

Fig. 55 shows a configuration diagram of the video distribution system of embodiment 7.

The video distribution system according to embodiment 7 includes a distributor apparatus 3, and the distributor apparatus 3 is connected to the streaming server 2 in communication, and the streaming server 2 is connected to the user terminal 1 in communication. A plurality of user terminals 1 can be communicatively connected.

The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming server 2 distributes the video data received from the distributor apparatus 3 to the user terminal 1. The streaming server 2 may distribute video data to one or more user terminals 1 simultaneously.

When the streaming media server 2 acquires the activities of one or more viewers. The distributor apparatus 3 may acquire the activities of the viewers via, for example, an api (application Programming interface) provided by the streaming server 2.

The following description describes video distributed through streaming media and linear play as "distributed video".

The format of the distributed video can be that images and sound acquired by a camera and a microphone are encoded into video data in real time and transmitted. However, in embodiment 7, the distribution video may be video data generated by combining and synthesizing material data.

Fig. 56 shows a block diagram of the hardware of the distributor apparatus 3. The distributor apparatus 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

The storage device 303 is a device that stores various data and programs, and includes, for example, a hard disk drive, a state hard disk, a flash memory, and the like.

Fig. 57 shows a block diagram of the software of the distributor apparatus 3. As shown in the figure, the distributor apparatus 3 is provided with processing units such as a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a group setting unit, and storage units such as a material library 331, a behavior storage unit 333, an activity storage unit 334, a group condition storage unit 335, and a group storage unit 336.

The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, a 3D model, a still image, animation, sound data, MIDI data, character data, and the like. Fig. 58 shows a block diagram of the material library 331. As shown in the figure, the material library 331 gives information (material ID) for identifying a material, and stores various material data and a role corresponding to the material data.

The character corresponds to a video based on the material data, for example, a character that appears in a video based on the material data.

The behavior storage unit 333 stores operation (action behavior) information (hereinafter, simply referred to as behavior information) on material data.

Fig. 59 shows an example of behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information contains a behavior ID indicating the behavior of the action, a judgment period, a group, a condition, and the behavior of the action.

The group is a group to which the viewer belongs. If the behavior information has a setting group, only the activity information associated with the viewer belonging to the setting group is determined whether or not the condition described later is satisfied.

The condition may be activity-specific, e.g., whether activity is present, or whether the aggregate value of activities from a plurality of viewers exceeds a threshold, etc.

In this case, the analysis of the image may be performed by the user terminal 1, and then, the result of the recognition may be transmitted to the streaming server 2 or the distributor apparatus 3, or the image data captured via the user terminal 1 may be transmitted to the distributor apparatus 3 via the streaming server 2, or the image data may be directly transmitted from the user terminal 1 to the distributor apparatus 3, and then, the distributor apparatus 3 is caused to perform the analysis of the image.

The system activity information may be, for example, whether or not the number of viewers watching the distribution image exceeds a threshold.

The playback time of the distribution image may be a condition. Such as the elapsed time from the start of playback to the stop of playback, etc.

Also, when the material data is a 3D model, a conflict of the items in the distribution video may be also a condition.

The action behaviors are various operations on the above-described material data. The action behavior may contain parameters so that the material data can be set in detail for specific operations.

In embodiment 7, the operation may be performed or stopped not only by operating the material data, but also by waiting for the other operation to complete its execution. The action behavior is, for example, a program written in a script language which can also be saved.

The activity storage unit 334 stores various activities that have occurred. Fig. 60 shows a block diagram of the structure of the active memory unit 334.

As described above, the activity storage unit 334 stores user activity information and system activity information.

The system activity information includes an activity ID, a time point at which the activity occurs, and activity content.

The group condition storage unit 335 stores grouping conditions (hereinafter, referred to as group condition information) of the viewer. Fig. 61 shows a block diagram of the structure of the group condition storage unit 335. The group condition information includes, a judgment period, a condition, and a group. The determination period is a period indicating a grouping job.

The determination period may be the same as the determination period of the behavior information described above, and may be, for example, a start time and an end time, or may be a predetermined action and a time during which the action is executed (for example, 10 seconds from the start of the action and 10 seconds after the end of the action). The length of the judgment period may be set arbitrarily, for example, 1 second, 1 minute, 1 hour, 1 day, or the like.

In embodiment 7, it is assumed that all modes that a viewer can adopt are set in the group condition information. For example, assume that group condition information specifying default (no viewer matching other conditions) conditions is contained.

The group storage unit 336 can manage a group to which a viewer who distributes video belongs. Fig. 62 shows a block diagram of the structure of the group memory unit 336. The group storage unit 336 stores group information containing a viewer ID indicating a viewer, a group to which the viewer belongs, and a role relating to the viewer.

The role may be, for example, a role selected by the viewer, or a role automatically assigned to the viewer. For example, when a viewer decides to follow a character on a distribution video, the viewer may receive input of the character and register the character as group information.

The activity acquisition unit 312 acquires an activity and stores the acquired content of the activity as activity information in the activity storage unit 334. Then, what kind of activity is to be acquired may be set by the user. The setting information indicating the kind of the activity to be acquired may be stored in, for example, the memory 302 or the storage device 303. The activity acquisition unit 312 may register, for example, a button, touch, or click input by the viewer as the user activity information. For example, in the case where the viewer views the distributed video using a web browser, a script that transmits the click activity occurring on the web browser to the streaming server 2 or the distributor apparatus 3 is set in advance, so that the activity acquisition unit 312 can acquire the click activity via the streaming server 2 or directly acquire the click activity.

The activity acquisition unit 312 may periodically count the number of viewers and register the number in the system activity information. However, the image may be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register the analysis result as the user activity information.

Group setting section 314 performs a grouping operation for a viewer.

In embodiment 7, each time behavior processing section 313 performs an action behavior, group setting section 314 performs a grouping operation for viewers. Not only this, the group setting unit 314 may perform the grouping operation at an arbitrary timing.

For example, the activity acquisition unit 312 may perform a grouping job when an activity that has been set in advance (for example, a viewer has a response to a posted comment) or every time a predetermined time elapses.

Group setting section 312 searches for group condition information satisfying the condition among the group condition information registered in group condition storage section 335 for each viewer. Then, group setting section 312 determines that the viewer belongs to the group set in the searched group condition information.

The group setting unit 314 generates group information corresponding to the determined viewer, and registers the group information in the group storage unit 336.

When the group information corresponding to the viewer is previously registered in the group storage unit 336, the group setting unit 314 updates the information.

The totalization output unit 315 may output the totalized number. The number outputted from the total output unit 315 is transmitted to the user terminal 1 separately from the distribution video. The number may then be displayed on the user terminal 1 or may be overlaid on the distribution video.

The bonus processing unit 316 performs processing to award the viewer according to the group. The bonus processing unit 316 may, for example, only award viewers belonging to a specific group, or may give different awards according to the group. The reward processing unit 316 may perform a reward process in general, such as adding points, moving the amount of money of virtual money, and giving a reward to a product. Explanation is omitted here.

In the 7 th embodiment, the bonus processing unit 316 awards a bonus to a winner of the stone scissor-cloth game, that is, performs bonus to each viewer belonging to a winner group.

Fig. 63 shows a flowchart of processing performed by the video distribution system of embodiment 7 of the present disclosure.

Video distribution section 311 divides the screen within the distributed video (S401). In embodiment 7, video distribution section 311 displays a plurality of moving pictures and synthesizes the moving pictures to realize a divided screen. The number of divided pictures may be divided according to the number of groups.

The action processing unit 313 receives the first action to be executed by each group (S402), and executes the action (S403)

Video and sound outputted as a result of performing the action are synthesized and video data is generated.

The action processing unit 313 connects the screen to the group and the role corresponding to the material data used when the action is performed (S404).

The video distribution unit 311 synthesizes the video data generated by each group into a distribution video of a divided presentation screen, and sends to the streaming server 2(S405)

The action processing unit 313 performs the action shown in fig. 64 for each group (S406).

The activity acquisition unit 312 periodically acquires the activity (S421)

For example, the activity acquisition unit 312 may acquire a comment on a distributed video by calling an API provided by the streaming server 2.

In addition, the activity acquisition unit 312 may acquire comments distributed after a prescribed time using a timer function.

The action processing unit 313 reads, for each action activity of the group, the action information corresponding to the group and belonging to the time and date during the judgment period from the action storage unit 334 (S423). The action processing unit 313 determines whether or not there is a condition satisfying the action information in the action content of the read action information (S424).

If the activity satisfies the condition (S425: YES), the behavior processing unit 313 executes the action contained in the behavior information (S426).

The group setting section 314 performs the grouping operation of the viewers in response to the execution of the action (S427).

Fig. 65 is a diagram illustrating grouping processing performed on a viewer in the embodiment 7.

Group setting section 314 performs the following processing for each viewer of the event information.

The group setting unit 314 reads the group condition information from the group condition storage unit 335 (S441). Then, based on the read group condition information, the activity information of the date and time corresponding to the viewer and within the judgment period is read from the activity storage unit 334 (S442)

When the read campaign information has information satisfying the group condition information (S443: YES), the group information is registered in the group storage unit 336 (S444). The group information includes a group in which a viewer ID indicating a viewer and group condition information are set. In the above manner, the viewers are grouped.

Returning to fig. 64, the action processing unit 313 acquires, from the material library 331, a role corresponding to material data used when performing an action, and associates the role with the group.

The respective action behaviors are processed by the above-described method. Returning to fig. 63, if the roles associated with the respective groups are the same role, video distribution section 311 performs the division of the release screen. That is, thereafter, the video distribution unit 311 and the behavior processing unit 313 create an image based on the material data for 1 screen (or a screen having a part integrated), and execute the operation material data.

If the roles of the respective pictures do not match (S407: NO), the picture is divided (S409). If the information of the behavior information does not terminate the distribution video (S431: NO), the process returns to step S402 to repeat the process.

As described above, the video distribution system of embodiment 7 distributes video to the user terminal 1 via the streaming server 2, and can change the distributed video in play in response to various activities during the distributed video play.

The video distribution system according to embodiment 7 divides the screens, and each screen changes the video in accordance with the response of the viewer belonging to the corresponding group.

Since the development of video is varied according to different groups of individual pictures, an unexpected story can be brought about.

Fig. 66 shows an example of displaying the distributed video screen 50. In the example of the screen 50, the distribution video is divided into 2 partial videos, which are a partial video 52 and a partial video 53, respectively.

As shown in the comment presentation column 54, the viewer will be able to post comments in the comment presentation column 54. The viewers may be associated with the screens by group. Then, based on the comments of the viewers, the action is applied to the data material in the video data displayed on the screen corresponding to the group to which the viewer belongs.

From this, the partial video 52 and the partial video are independent, and the development of the video is changed according to the comments of the viewers to which the corresponding group belongs.

The storyline development of the partial video 52 and the partial video 53 is independent and parallel, so that a new kind of distributed video can be experienced to the viewer.

As described above, if the roles of the partial video 52 and the partial video 53 are overlapped, the divided state of the distribution video 51 is released and the video is displayed as a single video. That is, if the scenarios developed independently for the partial videos are repeated, the frames will be merged, and if the scenarios are independent, the frames will be divided.

In this way, the behavior (intertwining) of the characters changes according to the response of the viewer, and therefore, a less predictable story line can be created.

The video distribution system according to embodiment 7 has been described above, but the above-described embodiments are merely for facilitating understanding of the present invention and are not limited to the technical solutions of the above-described specific combinations of the technical features. The present invention may be modified and improved without departing from the intention thereof, and the invention includes equivalents thereof.

Also, in the embodiment of the present invention, it is described that even if a video is being played, as long as the condition is satisfied for the comment, migration to the next component video data is performed (step S426 of fig. 64). However, the present invention is not limited to this, and the next action may be executed after the execution of the executing action is completed.

Also, in the present embodiment, the video distribution unit 311 combines a plurality of videos and displays them simultaneously to realize screen division. However, without being limited thereto, for example, it is also possible to divide the screen on the user terminal 1 and then send a plurality of videos to the user terminal 1 by the video distribution unit 311 to realize screen division.

Description of the symbols

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 comment acquisition unit

313 switching decision unit

331 video library

332 scene storage unit

333 conditional storage unit

334 comment storage unit

Embodiment 2 is also described

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 Activity acquisition Unit

313 action processing unit

331 materials library

333 behavior storage portion

334 active memory cell

Embodiment 3 ═ th ═

1 user terminal

2 streaming media server

3 distributor device

311 music distribution unit

312 comment acquisition unit

313 switching decision unit

331 video library

332 scene storage unit

333 conditional storage unit

334 comment storage unit

Embodiment 4 ═ th ═ embodiment

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 comment acquisition unit

313 switching decision unit

331 video library

332 scene storage unit

333 conditional storage unit

334 comment storage unit

335 user information storage unit

Embodiment 5 ═ th ═

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 Activity acquisition Unit

313 action processing unit

331 materials library

333 behavior storage portion

334 active memory cell

Embodiment 6 ═ th ═

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 Activity acquisition Unit

313 action processing unit

314 group setting unit

315 total output unit

316 reward processing unit

331 materials library

333 behavior storage portion

334 active memory cell

335 group condition storage unit

336 groups of memory cells

Embodiment 7 is also described

1 user terminal

2 streaming media server

3 distributor device

311 video distribution unit

312 Activity acquisition Unit

313 action processing unit

314 group setting unit

315 total output unit

316 reward processing unit

331 materials library

333 behavior storage portion

334 active memory cell

335 group condition storage unit

336 groups of memory cells

95页详细技术资料下载

上一篇：一种医用注射器针头装配设备

下一篇：用于数据中心中的灵活光互连的系统和方法

Video distribution system

相关技术

网友询问留言