阅读说明：本技术 内容发布服务器、内容发布系统、内容发布方法及程序 (Content distribution server, content distribution system, content distribution method, and program ) 是由 川上量生 松井健太郎 岩城进之介 小岛尚 山口直树 于 2019-07-23 设计创作，主要内容包括：本发明提供可提升共享虚拟空间之形态的便利性的内容发布服务器等。内容发布服务器(100),具备以下部分：受理他人为参与发布者发布时所用虚拟空间而发参与申请的参与申请受理部(144)；关于发布者及凭借参与申请参与发布的参与者,获取表示其各自动作的动作信息和各自虚拟角色之信息的信息获取部(141)；将信息获取部(141)取得的动作信息合成为虚拟角色动作的虚拟空间内视频后,发布其相应直播内容的发布部(143)。(The present invention provides a content distribution server and the like capable of improving the convenience of sharing the form of virtual space. A content distribution server (100) is provided with the following: a participating application accepting unit (144) for accepting the participating application issued by the user in the virtual space used by the participating publisher; an information acquisition unit (141) for acquiring, with respect to the publisher and the participants who participate in the publication by applying for the publication, action information indicating their respective actions and information indicating their respective virtual characters; and a distribution unit (143) that synthesizes the motion information acquired by the information acquisition unit (141) into a virtual space video in which the virtual character moves, and then distributes the corresponding live content.)

1. A content distribution server is provided with the following:

a participation application accepting unit that accepts a participation application issued by a user as a virtual space used when the participation issuer issues the participation application;

an information acquisition unit that acquires, with respect to the publisher and the participants who participate in the publication application, action information indicating their actions and information indicating their virtual characters;

and a distribution unit configured to distribute the live content corresponding to the action information acquired by the information acquisition unit after synthesizing the action information into the video in the virtual space in which the virtual character acts.

2. The content distribution server according to claim 1,

transmitting the motion information and the virtual character information acquired by the information acquisition unit to a publisher terminal used by the publisher to cause the publisher terminal to generate data representing a video in the virtual space,

the distribution unit distributes the live content based on the video information received from the distributor terminal.

3. The content distribution server according to claim 1 or 2,

the participant is a viewer watching the publication or other publisher performing other publications different from the publication;

if the participant is the other publisher who is performing other publication in a virtual space, the publication unit causes the communication terminal of the viewer to display a synthesized video in which both the publisher and the other publisher appear on a screen.

4. The content distribution server according to any one of claims 1 to 3,

the communication terminal of the publisher displays a reception operation screen on which the participation application reception unit will permit or reject participation of the application and which is capturing an image of a photographer who is being published by another person using a virtual camera.

5. The content distribution server according to claim 4,

and if the photographer has permission to participate, moving the virtual camera of the photographer to the virtual space of the release, wherein the release and the other releases share the virtual camera of the photographer.

6. The content distribution server according to any one of claims 1 to 5,

if the participant is another publisher who performs another distribution different from the distribution, the distribution unit distributes the live content as a single distribution video in which the virtual roles of the publisher and the participant are moved to the virtual space.

7. The content distribution server according to any one of claims 1 to 5,

if the participant is another publisher that performs another publication different from the publication, the publication unit moves the virtual character of the publisher or the participant to a video in the virtual space used for the publication or the other publication, and the publication and the other publication are merged into one publication video to be published as the live content.

8. A content distribution system is provided with the following parts:

a content distribution server for receiving a participation application issued by a user in a virtual space used by a participant publisher, synthesizing motion information indicating respective motions of the publisher and the participant participating in the distribution by the participation application into a video in the virtual space of the motion of a respective virtual character, and distributing corresponding live content;

a publisher terminal used by the publisher;

and the audience terminal is used by the audience watching the live content.

9. A content distribution method, comprising the steps of:

a participating application accepting step of accepting a participating application issued by a human as a virtual space used when the participating publisher issues the participating application;

an information acquisition step of acquiring, with respect to the publisher and the participants who participate in the application and participate in the publication, action information indicating their respective actions and information of their respective virtual roles;

and a publishing step of publishing the corresponding live broadcast content after synthesizing the action information acquired in the information acquiring step into the video in the virtual space of the virtual role action.

10. A program for causing a computer to function as:

accepting a participating application accepting means for accepting a participating application issued by a user in a virtual space used by a participating publisher;

information acquisition means for acquiring, with respect to the publisher and the participants who participate in the application and participate in the publication, action information indicating their respective actions and information on their respective virtual roles;

and a distribution means for distributing the corresponding live broadcast content after synthesizing the action information acquired by the information acquisition means into the video in the virtual space of the virtual character action.

Technical Field

The present disclosure relates to a content distribution server, a content distribution system, a content distribution method, and a program.

Background

In recent years, live broadcast, i.e., a service for distributing live content via a network, has become popular. There has been proposed a technique in which a publisher places a live broadcast in the network with a virtual character (avatar) in a virtual space, and distributes the video as live broadcast content. The live content is distributed by synthesizing publisher actions into videos of virtual character actions through an action capturing technology.

For example, patent document 1 discloses a system in which a performer or audience wearing an HMD (Head Mounted Display) participates in a game or a movie or the like in virtual characters, and distributes videos taken at a plurality of viewing angles on a plurality of channels.

Documents of the prior art

Patent document

Patent document 1: japanese laid-open patent publication No. 2002-271693

Disclosure of Invention

Problems to be solved by the invention

Patent document 1 discloses a structure in which performers or a plurality of viewers gathered in the same place participate in the same virtual space in respective virtual characters. However, in the above-described configuration, only performers or a plurality of viewers gathered in the same place can participate in the same virtual space in the virtual character, and thus, the user has a low convenience in sharing the virtual space.

For example, in a live broadcast, a plurality of publishers may collectively produce live content and publish a video that appears on a screen together with the plurality of publishers. A plurality of publishers can gather at the same place and shoot videos by using one camera for publishing, and also can shoot videos at different places in real space respectively and publish respective publishing pictures in a side-by-side mode or an overlapping mode. However, when the publishers are located in different places in the real space, their respective videos are in a separated state, and it is impossible to publish the videos as if the publishers share the same place.

Therefore, even if a plurality of publishers are located at different locations in the real space, it is desirable to realize that a video of the same location is distributed as if the plurality of publishers shared through the network. The publisher also has a need to implement such a distribution function in live webcasting where the publisher enters the virtual space with a virtual character. In addition to the publisher, the viewer watching the publication may also preferably participate in the publication in a virtual role. If the above-described structure is adopted, the publisher and other publishers, or the publisher and the viewer can communicate in the same virtual space, and there is a need for a system that can distribute the state as live content.

If the convenience of sharing the virtual space can be improved, not only the video composition can be realized, but also the composition of a plurality of distributed programs, the user's entering and exiting from a studio, i.e., a virtual space, the movement from a certain studio, i.e., a virtual space, to another studio, i.e., a virtual space, and the like can be realized.

In view of the above, it is an object of the present invention to provide a content delivery server and the like that can improve the convenience of the form of sharing a virtual space.

Means for solving the problems

To achieve the above object, the present invention discloses in claim 1 a content distribution server comprising: a participatory application accepting part for accepting the participatory application issued by the user in the virtual space used by the participatory publisher; an information acquisition unit for acquiring, with respect to the publisher and the participants who participate in the publication by applying for the publication, action information indicating their respective actions and information on their respective virtual characters; and a distribution unit for distributing the corresponding live content after synthesizing the motion information acquired by the information acquisition unit into a video in a virtual space in which the virtual character moves.

To achieve the above object, the present invention discloses a content distribution system according to claim 2, comprising: the content distribution server accepts the participation application sent by the user in the virtual space used by the participated publisher, synthesizes the action information of the publisher and the participated participant participating in the distribution by the participation application into the virtual space video of the action of the respective virtual role, and then distributes the corresponding live broadcast content; a publisher terminal for a publisher; a viewer terminal for a viewer viewing live content.

To achieve the above object, the invention discloses a content distribution method according to the 3 rd aspect, comprising the steps of: a participating application accepting step of accepting a participating application issued by a user in a virtual space used by a participating publisher; an information acquisition step of acquiring, with respect to the publisher and the participants who participate in the publication by applying for the publication, action information indicating their respective actions and information of their respective virtual roles; and a distribution step of distributing the corresponding live broadcast content after synthesizing the action information acquired in the information acquisition step into the video in the virtual space of the action of the virtual character.

To achieve the above object, the present invention discloses a4 th aspect of a program for causing a computer to function as: accepting a participating application accepting means for accepting a participating application issued by a user in a virtual space used by a participating publisher; information acquisition means for acquiring, with respect to the publisher and the participants who participate in the application and participate in the publication, action information indicating their respective actions and information on their respective virtual characters; and a distribution means for distributing the corresponding live broadcast content after synthesizing the action information acquired by the information acquisition means into the video in the virtual space of the action of the virtual character.

Effects of the invention

The present invention provides a content delivery server and the like that can improve the convenience of sharing virtual space.

Drawings

Fig. 1 is a diagram showing an example of the structure of a content distribution system according to embodiment 1.

Fig. 2 is a block diagram showing an example of the structure of a content distribution server according to embodiment 1.

Fig. 3 is a block diagram showing an example of the structure of a publisher terminal according to embodiment 1.

Fig. 4 is a block diagram showing an example of the structure of a viewer terminal according to embodiment 1.

Fig. 5 is a block diagram showing an example of the structure of a viewer terminal according to embodiment 1.

Fig. 6 is a diagram showing an example of a distribution screen displayed on the viewer terminal according to embodiment 1, where (a) shows the distribution screen before viewer participation and (B) shows the distribution screen after viewer participation.

Fig. 7 is a flowchart showing an example of the flow of control processing of the content distribution server according to embodiment 1.

Fig. 8 is a diagram showing an example of the structure of a content distribution system according to embodiment 2.

Fig. 9 is a block diagram showing an example of the structure of a content distribution server according to embodiment 2.

Fig. 10 is a block diagram showing an example of the structure of a publisher terminal according to embodiment 2.

Fig. 11 is a diagram showing an example of a distribution screen displayed on the viewer terminal according to embodiment 2, where (a) shows a distribution screen executed by a publisher before participation of another publisher, (B) shows a distribution screen executed by another publisher before participation of another publisher, and (C) shows a distribution screen after participation of another publisher.

Fig. 12 is a diagram showing an example of a shot screen of a virtual camera according to embodiment 2, where (a) shows a shot screen before participation of another publisher, and (B) shows a shot screen after participation of another publisher.

Fig. 13 is a flowchart showing an example of the flow of control processing of the content distribution server according to embodiment 2.

Description of the symbols

1. 2 … content distribution system; 100. 500 … content distribution server; 200. 600, 700 … publisher terminals; 300. 400, 800 … audience terminals; 900 … photographer terminal

Detailed Description

The embodiments disclosed in the present invention are explained below with reference to the drawings. In addition, the embodiments described below do not unduly limit the disclosure of the invention set forth in the patent claims. The constituent elements shown in the embodiments are not necessarily essential to the disclosure of the present invention. In addition, an example in which the viewer participates in the distribution is described in embodiment 1, and an example in which other publishers participate in the distribution is described in embodiment 2.

(embodiment 1)

As shown in fig. 1, the content distribution system 1 according to the present embodiment includes a content distribution server 100, one or more distributor terminals 200, one or more viewer terminals 300, and one or more viewer terminals 400. The content distribution server 100, the distributor terminal 200, the viewer terminal 300, and the viewer terminal 400 are connected to each other via a network NW, and communicate with each other. The Network NW may be a WAN (wide Area Network).

The content distribution server 100 provides a distribution service through the network NW. The content distribution server 100 distributes live content to the viewer terminals 300 and 400 based on a video in a virtual space in which distributor actions are synthesized to virtual character actions.

The video in the virtual space includes a background, an operation object representing a virtual object, and the like in addition to the virtual character. The virtual space is basically a three-dimensional space generated by CG (Computer Graphics), but may be a two-dimensional space. In addition, if there are other participants participating in the publishing besides the publisher, the participants 'actions are synthesized into the participants' virtual character actions when synthesizing the video in the virtual space.

The publisher terminal 200 is used by a publisher who publishes live content. The publisher terminal 200 is a communication terminal provided with an HMD, and has a communication function and a motion capture function. The publisher terminal 200 acquires motion information such as a publisher motion (gesture) or a line of sight by the motion capture function. The motion information is reflected on the virtual character motion corresponding to the publisher and the perspective (i.e., perspective) of the video in the virtual space. The action information may also include data representing the expression of the publisher.

The viewer terminal 300 is a device having a communication function such as a personal computer, a tablet terminal, and a smartphone. The viewer terminal 300 is a communication terminal that does not have a function for participating in distribution in a virtual character. The viewer terminal 300 is used by a viewer watching live content.

The viewer terminal 400 is a communication terminal provided with an HMD, and has a communication function and a motion capture function. The viewer terminal 400 acquires motion information such as viewer motion (gesture) or sight line by the motion capture function. The motion information is reflected on the virtual character motion of the corresponding viewer and the view angle (i.e., perspective) of the video in the virtual space. The action information may also include data representing the expression of the viewer.

Therefore, the viewer terminal 400 has a structure for the viewer to participate in the distribution in a virtual role, unlike the viewer terminal 300. In other words, in the present embodiment, any one or more of the one or more spectator terminals 400 will become the communication terminal for the participant.

< Structure of content distribution Server >

Next, the configuration of the content distribution server 100 will be described in detail. As shown in fig. 2, the content distribution server 100 includes: a communication unit 110 for performing communication with another device, a storage unit 120 for storing various data, a timer unit 130 for calculating time, and a control unit 140 for controlling the entire device. The above components are all connected to each other by a bus BL.

The communication unit 110 is a communication Interface including an NIC (Network Interface Card controller) for performing wired communication or wireless communication. The communication unit 110 performs communication with the publisher terminal 200 and the viewer terminals 300 and 400 via the network NW.

The Memory unit 120 includes a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The storage unit 120 stores programs for executing various control processes, various data, and the like.

The timer unit 130 includes an electronic oscillator and a variable PLL (Phase Locked Loop) for generating a clock signal, a clock circuit for counting the number of pulses of the clock signal, and the like. The timer section 130 calculates time based on the calculated number of pulses.

The control Unit 140 is constituted by a CPU (Central Processing Unit) or the like. The control unit 140 controls the overall operation of the content distribution server 100 by executing the program stored in the storage unit 120. The control section 140 performs various controls based on the time obtained by the number of pulses counted by the timer section 130. The control unit 140 also calculates the time elapsed since the start of the live content based on the time counted by the timer unit 130, or determines whether or not a predetermined time (e.g., an expected delivery time) has elapsed.

Next, a functional configuration of the control unit 140 will be described. The control unit 140 functions as follows: an information acquisition unit 141, a video generation unit 142, a delivery unit 143, a participation application reception unit 144, and a list information delivery unit 145.

The information acquisition unit 141 acquires information on the virtual character used by the publisher and operation information indicating the operation or line of sight of the publisher from the publisher terminal 200 via the communication unit 110. The information acquisition unit 141 also acquires information on the virtual character used by the participant and action information indicating the action or line of sight of the participant from the audience terminal 400 used by the audience (participant) participating in the distribution via the communication unit 110. The information acquisition section 141 acquires audio information from the publisher terminal 200 and the viewer terminal 400 through the communication section 110.

The user can download information of the virtual character used from the external device. The user uploads the information of the virtual character to be used to the content distribution server 100, and the virtual character can be used in distribution. In addition, information of the virtual character may also be provided by the content distribution server 100. For example, the user can use any one of the virtual characters selected from the information of the virtual characters stored in the content distribution server 100 in advance.

The video generation unit 142 generates a video in a virtual space in which the motions of both the publisher and the participant are synthesized into a virtual character motion. The synthesis can be achieved by: the video in the virtual space specified in advance is used as the background, the video of the virtual character as if the virtual character exists in the virtual space is generated, and the video of the publisher or the participant using the virtual character reflected on the virtual character is generated.

The distribution unit 143 distributes live content based on the video generated by the video generation unit 142. The live content based on the generated video is information indicating that the generated video data is to be displayed in a perspective manner from each view angle. Specifically, the live content includes a video when the generated video is seen from the virtual character view of the publisher, a generated video when the generated video is seen from the virtual character view of the participant, and a video (distribution screen) when the generated video is seen from the virtual camera view for distribution.

The live content distributed by the distribution section 143 includes audio information in addition to information representing a video. The distribution unit 143 stores the audio information acquired by the information acquisition unit 141 in the storage unit 120 in advance, and distributes the audio information used in the broadcast as live content.

The participation application receiving unit 144 receives the participation application receiving information from the publisher terminal 200 via the communication unit 110. When the participating application accepting unit 144 has acquired the participating application accepting information, it accepts a participating application issued by another person to participate in the virtual space used when the publisher issues the participating application. The "other person" in this embodiment is the viewer. The participating application accepting unit 144 may accept the participating application while the publisher is issuing, or may accept the participating application before the start of the issuing.

The participation application receiving unit 144 acquires information of the other person who participates in the application, and displays the information on the publisher terminal 200 that is executing the publication of the participation application. The information of the other person may be information representing a user name, a virtual character, or the like. The participation application accepting unit 144 causes the publisher terminal 200, which is executing the publication of the participation application, to display an acceptance operation screen for allowing or rejecting the other person who participates in the application. If the publisher has allowed, then the other person may participate in the publication as a participant.

At this time, the participation URL for participation in the distribution may be transmitted to the viewer terminal 400 permitted to participate. The participation application receiving unit 144 may further display an operation screen for the publisher terminal 200 to transmit the participation URL to the communication terminal of the other person who applies for participation. In this case, the URL operation for transmission participation performed by the publisher may replace the participation permission operation (the transmission permission information operation to be mentioned later) performed by the publisher.

The list information issuing unit 145 issues list information for accepting the issue of a participating application based on the participating application accepting information acquired by the participating application accepting unit 144 from one or more publisher terminals 200. Specifically, the list information issuing unit 145 causes the communication terminal of another person to display list information indicating that the issuance of a participating application is being accepted, via the communication unit 110. In this embodiment, the communication terminals of the other people refer to the viewer terminals 300 and 400. However, the list information distribution unit 145 may display only the viewer terminal 400 having a configuration for participating in the distribution.

< Structure of publisher terminal >

Next, the configuration of the publisher terminal 200 will be described in detail. As shown in fig. 3, the publisher terminal 200 includes: a communication unit 210 for communicating with another device, an operation unit 220 for receiving user operations, a storage unit 230 for storing various data, a display unit 240 for displaying various images, a voice input unit 250 for receiving voice input, a motion input unit 260 for inputting motion information, a voice output unit 270 for outputting various voices, and a control unit 280 for controlling the entire device. The above components are all connected to each other by a bus BL.

The communication unit 210 is a communication interface and includes a NIC for performing wired communication or wireless communication. The communication unit 210 performs communication with the content distribution server 100 via the network NW.

The operation unit 220 is an interface for a user to input instructions, and is composed of operation buttons, a keyboard, a pointing device, and the like.

The storage unit 230 is constituted by a RAM, a ROM, and the like. The storage unit 230 stores programs for executing various control processes, input data, and the like.

The Display unit 240 may be formed of an LCD (Liquid Crystal Display), an EL (Electro Luminescence) Display, or the like. The display unit 240 displays text, images, and the like based on input data from the control unit 280.

The sound input unit 250 is constituted by a microphone or the like. The sound input unit 250 receives externally input sound acquisition audio information.

The motion input unit 260 receives a motion input by the user and acquires motion information of the user. The motion input unit 260 may include a camera, a sensor, and the like for acquiring motion information by a motion capture technique. The motion information may be detected by a sensor that detects the user's line of sight, motion (gesture). In addition, the motion information may also be acquired by button operations for expressing the expression of the virtual character, specifying a performance motion, or the like.

The process of converting the user's motion information into a virtual character motion, a line of sight, or the like may be executed on the publisher terminal 200, may be executed on the content distribution server 100, or may be executed by the content distribution server 100 and the publisher terminal 200 in cooperation.

The sound output unit 270 may be constituted by a speaker, an amplifier, or the like. The audio output unit 270 outputs audio based on input data from the control unit 280.

The control unit 280 is constituted by a CPU or the like. The control unit 280 controls the overall operation of the publisher terminal 200 by executing the program stored in the storage unit 230.

Next, a functional configuration of the control unit 280 will be described. The control unit 280 functions as follows: the content acquisition unit 281, the display control unit 282, the audio output control unit 283, the input information transmission unit 284, the participation application acceptance information transmission unit 285, and the license information transmission unit 286.

The content acquisition unit 281 acquires data indicating live content from the content distribution server 100 via the communication unit 210. The display control unit 282 causes the display unit 240 to display the video in the virtual space based on the data indicating the live content acquired by the content acquisition unit 281. The audio output control unit 283 causes the audio output unit 270 to output audio based on the data indicating the live content acquired by the content acquisition unit 281.

The input information transmitting unit 284 transmits the audio information acquired by the audio input unit 250 and the operation information acquired by the operation input unit 260 to the content distribution server 100. The input information transmitter 284 may transmit information in which the action information is reflected on the virtual character to the content distribution server 100.

The participation application acceptance information transmitting unit 285 transmits the participation application acceptance information set by the user to the content distribution server 100 through the communication unit 210. The participation application acceptance information is information indicating that the posting participant is solicited, and includes information such as posting plan time, number of solicited persons, posting contents, and the like.

The license information transmitting unit 286 transmits the license information to the content distribution server 100 through the communication unit 210 according to the transmission license information operation of the user. The license information is information indicating that the user permits or rejects another person to apply for participation.

< Structure of viewer's terminal >

Next, the structure of the viewer terminal 300 will be described in detail. As shown in fig. 4, the viewer terminal 300 includes: a communication unit 310 for communicating with another device, an operation unit 320 for receiving an input operation by a user, a storage unit 330 for storing various data, a display unit 340 for displaying various images, a sound output unit 350 for outputting sound, and a control unit 360 for controlling the entire device. The above components are all connected to each other by a bus BL.

The communication unit 310 is a communication interface and includes a NIC for performing wired communication or wireless communication. The communication unit 310 performs communication with the content distribution server 100 via the network NW.

The operation unit 320 is an interface configured by operation buttons, a keyboard, a pointing device, and the like, and used for a user to input instructions.

The memory section 330 is constituted by a RAM, a ROM, and the like. The storage unit 330 stores programs for executing various control processes, input data, and the like.

The display part 340 may be constituted by an LCD, an LED display screen, or the like. The display unit 340 displays text, images, and the like based on input data from the control unit 360.

The audio output unit 350 is constituted by a speaker, an amplifier, and the like. The audio output unit 350 outputs audio based on input data from the control unit 360.

The control unit 360 is constituted by a CPU or the like. The control unit 360 controls the overall operation of the viewer terminal 300 by executing the program stored in the storage unit 330.

Next, a functional configuration of the control unit 360 will be described. The control unit 360 functions as follows: a content acquisition unit 361, a display control unit 362, and an audio output control unit 363.

The content acquisition unit 361 acquires data indicating live content from the content distribution server 100 via the communication unit 310. The display controller 362 causes the display unit 340 to display the video in the virtual space as a moving image based on the data indicating the live content acquired by the content acquirer 361. The audio output control unit 363 causes the audio output unit 350 to output audio based on the data indicating the live content acquired by the content acquisition unit 361.

Next, the structure of the viewer terminal 400 will be described in detail. As shown in fig. 5, the viewer terminal 400 includes: a communication unit 410 for performing communication with another device, an operation unit 420 for receiving an input operation by a user, a storage unit 430 for storing various data, a display unit 440 for displaying various images, a voice input unit 450 for receiving a voice input, a motion input unit 460 for inputting motion information, a voice output unit 470 for outputting various voices, and a control unit 480 for controlling the entire device. The above components are all connected to each other by a bus BL.

The structure of the viewer terminal 400 is substantially the same as that of the publisher terminal 200. For example, the viewer terminal 400 has the following functions: information necessary for the viewer to participate in the distribution, such as the viewer's motion information, is acquired and transmitted to the content distribution server 100 so as to be reflected on the motion of the viewer's virtual character.

However, unlike the publisher terminal 200, the control unit 480 of the viewer terminal 400 includes the participation application information transmitting unit 485, and does not include the participation application acceptance information transmitting unit 285 or the license information transmitting unit 286. Specifically, the control unit 480 of the viewer terminal 400 functions as follows: a content acquisition unit 481, a display control unit 482, a sound output control unit 483, an input information transmission unit 484, and a participation application information transmission unit 485.

The functions of the content acquisition unit 481, the display control unit 482, the sound output control unit 483, and the input information transmission unit 484 are basically the same as those of the content acquisition unit 281, the display control unit 282, the sound output control unit 283, and the input information transmission unit 284 of the control unit 280 of the publisher terminal 200. Further, the display control unit 482 acquires the list information to be distributed from the content distribution server 100 via the communication unit 410, and causes the display unit 440 to display the list information indicating that the distribution of the participating application is being accepted.

The participation application information transmitting unit 485 transmits participation application information indicating that participation in distribution is desired to the content distribution server 100 through the operation unit 410. Specifically, if the user has applied for participation, the participation application information transmitting unit 485 transmits the participation application information to the release list information screen indicating acceptance of the participation application.

< specific example of posting Screen >

Next, a specific example of the distribution screen displayed will be described with reference to information indicating the distributed live content.

Fig. 6 is a diagram showing an example of a distribution screen displayed on the viewer terminal 300. Fig. 6(a) shows a distribution screen before viewer participation, and fig. 6(B) shows a distribution screen after viewer participation. In the area a1, an image of the video in the virtual space viewed from the virtual camera (not shown) is displayed as an animation. In the area a2, an input field in which viewers post comments is displayed, and a post execution button B1 is displayed on the right side thereof.

In fig. 6(a), the virtual character 10 indicating the publisher a is displayed in the video indicating the area a 1. The publisher a is a publisher who performs the publication using the publisher terminal 200. In addition, an operation object 20 representing a virtual object, i.e., a table, may be displayed in the video.

Here, if the viewer a who has permitted the use of one or more viewer terminals 400 by the publisher a participates in the distribution, the viewer terminal 400 transmits information indicating the virtual character used by the viewer a and the action information of the viewer a to the content distribution server 100.

Finally, as shown in fig. 6(B), the virtual character 30 indicating the viewer a is displayed in the area a1, and the state of entering the posting screen appears. If the participant, namely the virtual character 30 of the audience A, is authorized to participate in the publication, the participant enters the virtual space used by the publisher A for publication. However, if the virtual character 30 is not within the shooting area of the virtual camera, it does not appear in the area a1 of the distribution screen.

The distribution section 143 of the content distribution server 100 displays the audience a and the distributor a, which are participants, on the audience terminal 300 so as to be distinguishable from each other. For example, in an area a1 of the distribution screen in fig. 6(B), a text column indicating a user name, such as "distributor a", is displayed above the avatar 10 of distributor a, and a text column indicating a user name, such as "viewer a", is displayed above the avatar 30 of viewer a.

In addition, the method of distinguishing the virtual character appearing on the distribution screen is not limited to this. For example, the publishing portion 143 may distinguish between the publisher and the participant by adding a border or coloring to the virtual character of either or both of the publisher and the participant. The distribution unit 143 can distinguish between the publisher and the participant by adding an identification mark near the virtual character of either or both of the publisher and the participant.

The publication screen is shown in fig. 6 as being substantially displayed on the audience terminal 300, but the same publication screen may be displayed on the audience terminal 400 for non-participant audiences, and the audience terminal 400 for non-participant audiences may also display only the video of the area a 1. Displayed on the publisher terminal 200 and the spectator terminal 400 for the participant are the video within the virtual space from the perspective of the respective virtual character (i.e., the virtual character 10 or the virtual character 30), instead of the publication screen shown in fig. 6.

< treatment Process >

Next, an example in which the content distribution server 100 executes control processing is explained with reference to fig. 7. This process is executed when the content distribution server 100 acquires the participation request acceptance information from one or more publisher terminals 200.

First, the list information issuing unit 145 of the control unit 140 displays a screen indicating that the issue list information of the participation application is being accepted on the viewer terminal 300 or 400 based on the participation application acceptance information acquired from one or more publisher terminals 200 (step S101). When the participation request acceptance information is acquired from the plurality of publisher terminals 200, the list information issuing unit 145 issues list information in which the information can be listed to the viewer terminals 300 and 400 via the communication unit 110.

The participation application receiving unit 144 of the control unit 140 receives a participation application issued in a virtual space used when the user is a participant publisher (step S102). Specifically, the participation application receiving unit 144 acquires the participation application information transmitted by the participation application information transmitting unit 485 of the viewer terminal 400 via the communication unit 110.

The participation application accepting unit 144 of the control unit 140 acquires information of the other person who participates in the application (i.e., the application participant), and displays the information on the publisher terminal 200 that is executing the publication of the participation application (step S103). The participation application receiving unit 144 further displays a reception operation screen of the other person who permits or rejects the participation of the application on the publisher terminal 200, and receives permission or rejection of the participation (step S104).

Here, the control unit 140 determines whether or not the publisher permits participation (step S105). Specifically, the control unit 140 determines whether or not participation of the publisher is permitted based on the license information acquired from the license information transmitting unit 286 of the publisher terminal 200.

If the participation request is rejected (step S105; N), the information acquisition section 141 of the control section 140 acquires various kinds of information of the publisher from the publisher terminal 200 that is performing the publication (step S107). In other words, the content distribution server 100 acquires only the avatar information and the action information of the distributor when there is no participant, and executes the processing in the subsequent steps S108 and S109.

However, if participation is permitted (step S105; Y), the information acquisition section 141 of the control section 140 acquires various information of the publisher and various information of the audience participating in the publication from the publisher terminal 200 that is performing the publication (step S106). In other words, the content distribution server 100 acquires the virtual character information and the action information of each of the distributor and the participant, and executes the processing in the subsequent steps S108 and S109.

The video generation unit 142 of the control unit 140 generates a virtual space video in which the motion information acquired by the information acquisition unit 141 is synthesized into a virtual character motion (step S108).

The distribution unit 143 of the control unit 140 distributes live content based on the video generated by the video generation unit 142 (step S109). Thus, the publisher terminal 200 displays the video of the virtual character view of the publisher, the viewer terminals 400 of the viewers participating in the distribution display the video of the virtual character view of the viewers, and the viewer terminals 300, 400 of the viewers not participating in the distribution display the distribution screen.

One example of the control processing performed by the content distribution server 100 is explained above. In addition, the flow of processing is not limited to the above-described flow. For example, when the publisher accepts the participation application during the delivery, the process of delivering only the publisher may be executed as in steps S107, S108, and S109 before step S101; instead of performing the process of reflecting the intention of the publisher to decide to permit participation, step S104, a process of automatically permitting participation of a prescribed number of application participants in the first come order may also be performed.

< description of Effect >

In the content distribution system 1 according to the present embodiment, the content distribution server 100 receives a participation distribution application issued by a viewer via a network. In this case, even if the publisher and the viewer are located in different places in the real space, the publisher and the viewer can share the virtual space with each other and perform distribution. Therefore, the content distribution system 1 according to the present embodiment can improve the convenience of the form of sharing the virtual space.

(embodiment 2)

In this embodiment, a content distribution system 2 according to embodiment 2 will be described. In the following description, the components common to the content distribution system 1 according to embodiment 1 will be described with the same reference numerals. The structure of the content distribution system 2 and the structure of the content distribution system 1 can be combined and matched reasonably as long as no technical contradiction occurs.

For example, the content distribution system 1 is a structure in which viewers participate in distribution, and the content distribution system 2 is a structure in which other distributors participate in distribution. Therefore, the combination of the above-described structures can realize a structure that enables both the audience and other publishers to participate in the distribution.

As shown in fig. 8, the content distribution system 2 according to the present embodiment includes a content distribution server 500, a distributor terminal 600 for a distributor, a distributor terminal 700 for another distributor, one or more viewer terminals 300, one or more viewer terminals 800, and one or more photographer terminals 900. The above devices are connected to each other via a network NW, respectively, to realize communication. The network NW may be a WAN.

The content distribution server 500 provides a distribution service through the network NW. The content distribution server 100 distributes live content to the viewer terminals 300 and 800 based on the video in the virtual space in which the publisher actions are synthesized to the virtual character actions. In addition, if there are other participants participating in the distribution in addition to the publisher, the participant action also synthesizes the virtual character action as the participant in the video in the virtual space.

The publisher terminals 600 and 700 are used by publishers who publish live content. The publisher terminals 600 and 700 are communication terminals provided with HMDs, and have a communication function and a motion capture function. The publisher terminals 600 and 700 acquire motion information such as a publisher motion (gesture) and a line of sight by a motion capture function. The motion information is reflected on the virtual character motion corresponding to the publisher and the perspective (i.e., perspective) of the video in the virtual space. The action information may also include data representing the expression of the publisher.

The viewer terminals 300 and 800 are devices having a communication function such as a personal computer, a tablet terminal, and a smart phone. The viewer terminals 300 and 800 are communication terminals that do not have a function for participating in distribution in a virtual role. The viewer terminal 300, 800 is used by a viewer watching live content. The structure of the viewer terminal 800 is the same as that of the viewer terminal 300.

The photographer terminal 900 is a communication terminal having a function of controlling the position, the shooting angle, the shooting conditions, and the like of a virtual camera for shooting in a virtual space. The virtual camera video controlled by the photographer terminal 900 is a video from a different view angle from the normal fixed distribution screen, and is distributed to the viewer terminals 300 and 800 as a distribution screen on which the video from the different view angle is distributed.

The following description is made with the preconditions as follows: the viewer of the viewer terminal 300 is watching the distribution performed by the distributor using the distributor terminal 600; the viewer of the viewer terminal 800 is viewing a publication performed by a publisher (other publisher) using the publisher terminal 700, which is a publication (other publication) other than the publication by the publisher terminal 600; video taken by a virtual camera controlled by the photographer terminal 900 is distributed, the virtual camera being disposed in a virtual space for other distribution executed by the publisher terminal 700.

It is assumed that a publisher using the publisher terminal 700 participates in the distribution performed by the publisher terminal 600. In other words, in the present embodiment, the publisher terminal 700 is a communication terminal to be used as a participant.

The content distribution system 2 includes one distributor terminal 600 and one distributor terminal 700. However, the publisher terminal 600 that performs the distribution and the publisher terminal 700 that participates in the distribution may be a plurality of terminals.

In addition, the photographer terminal 900 may be disposed in the virtual space of the distribution of the publisher terminal 600 in addition to the virtual space of the distribution of the publisher terminal 700. In the content distribution system 2, the distributor terminals 600 and 700 each perform distribution using one content distribution server 500, but the distributor terminals 600 and 700 each perform distribution using two or more content distribution servers 500 that provide different distribution platforms.

< Structure of content distribution Server >

Next, the configuration of the content distribution server 500 will be described in detail. As shown in fig. 9, the content distribution server 500 includes: a communication unit 110 for performing communication with another device, a storage unit 120 for storing various data, a timer unit 130 for calculating time, and a control unit 540 for controlling the entire device. The above components are all connected to each other by a bus BL.

The control unit 540 is constituted by a CPU or the like. The control unit 540 controls the overall operation of the content distribution server 500 by executing the program stored in the storage unit 120. The control unit 540 performs various controls based on the time obtained by counting the number of pulses by the timer unit 130. The control unit 540 also calculates the time elapsed since the start of the live content based on the time counted by the timer unit 130, or determines whether or not a predetermined time (e.g., an expected delivery time) has elapsed.

Next, a functional configuration of the control unit 540 will be described. The control unit 540 functions as follows: an information acquisition unit 541, a video generation unit 542, a distribution unit 543, a participation application reception unit 544, a list information distribution unit 545, and a link notification unit 546.

The information acquisition unit 541 acquires, from the publisher terminal 600, information relating to the virtual character used by the publisher and operation information indicating the operation or line of sight of the publisher via the communication unit 110. The information acquisition unit 541 also acquires, from the distributor terminal 700 for another distributor (participant) participating in the distribution, information on the virtual character used by the participant and action information indicating the action or line of sight of the participant via the communication unit 110. The information acquisition unit 541 acquires audio information from the publisher terminals 600, 700 via the communication unit 110.

The video generation unit 542 generates a virtual space video in which the actions of both the publisher and the participant are combined into the action of the virtual character.

The distribution unit 543 distributes live content based on the video generated by the video generation unit 542. The live content based on the generated video is information indicating that the generated video data is to be displayed in a perspective manner from each view angle. Specifically, the live content includes a video when the generated video is seen from the virtual character view of the publisher, a generated video when the generated video is seen from the virtual character view of the participant, a video (distribution screen) when the generated video is seen from the virtual camera view for distribution, and a video (other distribution screen) when the generated video is seen from the virtual camera view for distribution controlled by the photographer terminal 900.

The video generation unit 542 generates a video in which the virtual character of the publisher or the participant is moved to a virtual space for distribution by the publisher or other distribution in which the participant participates, and the distribution unit 543 merges the distribution and the other distribution into one distribution video and distributes the distribution as live content. The video generation unit 542 and the distribution unit 543 may distribute two videos in parallel, instead of distributing the videos together.

Further, if another publisher participates in the distribution performed by the publisher terminal 600, the distribution section 543 may cause the viewer terminals 300 and 800 to display a synthesized video in which both the publisher and the other publisher appear on the screen.

If another publisher participates in the distribution performed by the publisher, the video generation unit 542 generates a video in which the virtual characters of the publisher and the participants move to another virtual space, and the distribution unit 543 combines the distribution and the other distributions into one distribution video and distributes the distribution as live content. The other virtual spaces refer to virtual spaces other than the virtual space for publication performed by the publisher and the virtual space for other publications participated in by the participant.

The live content distributed by the distribution section 543 includes audio information in addition to information representing a video. The distribution unit 543 stores the audio information acquired by the information acquisition unit 541 in the storage unit 120 in advance, and distributes the audio information used in the broadcast as live content.

If a plurality of virtual cameras are arranged in the virtual space, the distribution unit 543 may switch any one or more of the videos captured by the plurality of virtual cameras according to a predetermined condition, and distribute the captured video as live content. The prescribed conditions include any one or more of conditions that the publisher or the viewer performs a video switching operation, that a time designated in advance (i.e., a time of progress setting) is reached, that a virtual character is moved, that the participant has participated in the distribution, and the like. At this time, the viewer can make a selective switching from the following distribution channels by performing a video switching operation on the viewer terminal 300, 800: issuing the video shot by the photographer of the virtual camera; a distribution screen of a distributor who has accepted participation in the application; a picture of the participant; the video is composed of the publication of the publisher and the publication of the participant.

The participation application receiving unit 544 receives the participation application receiving information from the publisher terminal 600 via the communication unit 110. When the participation application reception unit 544 has acquired the participation application reception information, it receives a participation application issued by another person in the virtual space used when participating in the issue by the issuer. The "others" in this embodiment are other publishers who use the publisher terminal 700. The participating application reception unit 544 may receive the participating application while the publisher is issuing the application, or may receive the participating application before the issue is started.

The participation application reception unit 544 acquires information of the other person who requests participation and displays the information on the publisher terminal 600 that is executing the publication of the participation application. The information of the other person may be information representing a user name, a virtual character, or the like. The participation application reception unit 544 causes the publisher terminal 600, which is executing the publication of the participation application, to display a reception operation screen for allowing or rejecting the other person who participates in the application. If the publisher has allowed, then the other person may participate in the publication as a participant.

The information of the other people also includes information about viewers watching other releases (viewers using the viewer terminal 800) and photographers who photograph other releases (photographers using the photographer terminal 900) using a virtual camera.

The participation application acceptance unit 544 displays an acceptance operation screen on the publisher terminal 600, which permits or denies participation of the application and which is shooting a photographer (photographer using the photographer terminal 900) who is published by another person using the virtual camera. If the photographer has been permitted to participate, the video generation section 542 moves the virtual camera of the photographer into a virtual space in which distribution is performed by the publisher terminal, the distribution sharing the virtual camera of the photographer with other distributions. The principle of sharing a virtual camera will be explained in detail below.

The participation URL used when participating in the distribution may be transmitted to the viewer terminal 700 permitted to participate. The participation application reception unit 544 may also display an operation screen for the publisher terminal 600 to transmit the participation URL to the communication terminal of the other person who applies for participation. In this case, the URL operation for transmission participation performed by the publisher may replace the participation permission operation (the transmission permission information operation to be mentioned later) performed by the publisher.

However, if the participation application of the photographer has been rejected, the photographer terminal 900 enters a state in which the virtual camera is not available and only the same functions as the viewer terminals 300, 800 are available.

The list information issuing unit 545 issues list information for accepting the issue of a participating application based on the participating application acceptance information acquired from the issuer terminal 600 by the participating application acceptance unit 544. Specifically, the list information issuing unit 545 causes the communication terminal of another person to display list information indicating that the issuance of a participating application is being accepted, via the communication unit 110. In this embodiment, the communication terminal of another person refers to the publisher terminal 700 that performs another publication. In the present embodiment, only one publisher terminal 600 accepts the participation application, and if a plurality of publisher terminals 600 accept the participation application, the published list information is information in which the plurality of participation applications can be listed.

The link notification unit 546 displays a link for viewing the distribution executed by the photographer terminal 900 of the other distribution or the other distribution on the viewer terminals 300 and 800 viewing either the distribution or the other distribution. Thus, the viewer can grasp the existence of other publications. For example, the link notification unit 546 notifies the viewer terminal 300 of the URLs of the other publications executed by the publisher terminal 700 and the publication of the photographer terminal 900. The link notification unit 546 notifies the viewer terminal 800 of the URL of the distribution performed by the distributor terminal 600.

< Structure of publisher terminal >

Next, the configuration of the publisher terminal 600 will be described in detail. The structure of the publisher terminal 700 is the same as that of the publisher terminal 600.

As shown in fig. 10, the publisher terminal 600 includes: a communication unit 210 for communicating with another device, an operation unit 220 for receiving user operations, a storage unit 230 for storing various data, a display unit 240 for displaying various images, a voice input unit 250 for receiving voice inputs, a motion input unit 260 for inputting motion information, a voice output unit 270 for outputting various voices, and a control unit 680 for controlling the entire device. The above components are all connected to each other by a bus BL.

The control unit 680 is constituted by a CPU or the like. The control unit 680 controls the overall operation of the publisher terminal 600 by executing the program stored in the storage unit 230.

Next, a functional configuration of the control unit 680 will be described. The controller 680 functions as follows: the content acquiring unit 281, the display control unit 282, the audio output control unit 283, the input information transmitting unit 284, the participation application reception information transmitting unit 285, the license information transmitting unit 286, and the participation application information transmitting unit 687.

The participation application information transmitter 687 transmits participation application information indicating that participation in distribution is desired to the content distribution server 500 through the operation unit 210. Specifically, the participation application information transmitter 687 transmits the participation application information to the issue list information screen indicating the acceptance of the participation application, if the user has applied for participation.

The publisher terminals 600 and 700 according to the present embodiment are configured to accept a participation application issued by another user for participating in a virtual space used when a certain user is published, and to participate in a virtual space used when another user is published; however, the publisher terminals 600 and 700 are not limited to the above-described structure. For example, either the publisher terminal 600 or 700 (e.g., the publisher terminal 600) may be configured to accept a participation application issued in a virtual space used for participation in the distribution, and the other (e.g., the publisher terminal 700) may be configured to participate in a virtual space used for the distribution of the other publisher.

< specific examples of posting screens and shooting screens >

Next, a specific example of the distribution screen displayed and the shooting screen shot by the photographer with the virtual camera will be described with reference to information indicating the distributed live content.

Fig. 11 is a diagram showing an example of a distribution screen displayed on the viewer terminal 300 or the viewer terminal 800. Fig. 11(a) shows a distribution screen of a distributor before participation of other distributors, in other words, fig. 11(a) is a distribution screen displayed on the viewer terminal 300 viewing the distribution of the distributor terminal 600.

Fig. 11(B) shows a distribution screen on which other distributors perform distribution before the other distributors participate, in other words, fig. 11(B) is a distribution screen displayed on the viewer terminal 800 viewing the distribution of the distributor terminal 700.

Fig. 11(C) shows a distribution screen after participation of another distributor, in other words, fig. 11(C) is a distribution screen displayed on the viewer terminal 300, 800 viewing the distribution of the distributor terminal 600, 700. In this example, it is illustrated that the other publisher B using the publisher terminal 700 participates in the publication of the publisher a using the publisher terminal 600, and the publications of the publisher B and the publisher a are integrated.

In the area a3 in fig. 11(a), 11(B), and 11(C), an image seen from the virtual camera (not shown) in the virtual space is displayed as a moving image. In the area a4, an input field in which viewers post comments is displayed, and a post execution button B1 is displayed on the right side thereof.

In fig. 11(a), the virtual character 40 indicating the publisher a is displayed in the video indicating the area a 3. The publisher a is a publisher who performs the distribution using the publisher terminal 600. In addition, an operation object 20 representing a virtual object, i.e., a table, may be displayed in the video.

In fig. 11(B), the virtual character 50 representing the publisher B is displayed in the video representing the area a 3. The publisher B is a publisher who performs the publication using the publisher terminal 700. In addition, an operation object 60 representing a virtual camera may be displayed in the video. The operation target 60 representing a virtual camera is a virtual camera controlled by the photographer terminal 900.

Here, if the publisher a allows the publisher B using the publisher terminal 700 to participate in the publication, the publisher terminal 700 transmits information indicating the virtual character used by the publisher B and the action information of the publisher B to the content distribution server 500. In addition, if the publisher a has permitted the participation of the photographer who photographs the publication of the publisher B with the virtual camera using the photographer terminal 900, the operation object 60 representing the virtual camera will also move into the virtual space in which the publisher a is publishing.

Finally, as shown in fig. 11(C), the virtual character 40 indicating the distributor a, the virtual character 50 indicating the distributor B, and the operation object 60 indicating the virtual camera are all displayed in the area a3, and the state of entering the distribution screen appears. In fig. 11(C), the virtual character 50 of the publisher B and the operation object 60 indicating the virtual camera enter the virtual space used by the publisher a at the time of distribution. However, if the virtual character 50 and the operation object 60 representing the virtual camera are not within the shooting area of the virtual camera (not shown in the figure), they do not appear in the area a3 of the distribution screen.

The distribution unit 543 of the content distribution server 500 displays the audience terminals 300 and 800 as the participants, i.e., the distributor a and the distributor B, so that they can be distinguished from each other. For example, in an area a3 of the delivery screen in fig. 11(C), a text column indicating a user name such as "delivery person a" is displayed above the avatar 40 of the delivery person a, and a text column indicating a user name such as "delivery person B" is displayed above the avatar 50 of the delivery person B.

The text column is not displayed in fig. 11(a) and 11(B), in other words, the text column is displayed only when a plurality of publishers share a virtual space. However, the delivery unit 543 may display the text string even when one publisher uses the virtual space alone as shown in fig. 11(a) and 11 (B).

In addition, the publisher terminals 600 and 700 display videos in the virtual space viewed from the perspective of the respective virtual character (i.e., the virtual character 40 or the virtual character 50), instead of the publication screen shown in fig. 11.

Fig. 12 is a diagram showing an example of a shooting screen shot by a virtual camera (an operation target 60 showing the virtual camera). Fig. 12(a) shows a distribution screen before participation of another distributor, in other words, fig. 12(a) shows a shooting screen shot from the viewpoint of the operation target 60 showing the virtual camera in the virtual space distributed by the distributor B, corresponding to the distribution screen shown in fig. 11 (B). The photographed screen is available for distribution of channels other than two distributions performed by the distributor a and the distributor B.

Fig. 12(B) shows a distribution screen in which another distributor participates, in other words, fig. 12(B) shows a shooting screen shot from the viewpoint of the operation target 60 showing the virtual camera after moving into the virtual space distributed by the distributor a, corresponding to the distribution screen shown in fig. 11 (C).

Unlike the shooting screen shown in fig. 12(a), the virtual character 40 representing the publisher a and the operation subject 20 representing the desk both enter the shooting screen shown in fig. 12 (B).

< treatment Process >

Next, an example in which the content distribution server 500 executes the control process is explained with reference to fig. 13. This process is executed when the content distribution server 500 acquires the participation request acceptance information from the distributor terminal 600.

First, the list information issuing unit 545 of the control unit 540 causes the other publisher terminal 700 to display a screen indicating that the published list information of the participating application is being accepted, based on the participating application acceptance information acquired by the publisher terminal 600 (step S201).

The participation application receiving unit 544 of the control unit 540 receives a participation application issued from a virtual space used when another publisher is a participant publisher (step S202). Specifically, the participation application receiving unit 544 acquires the participation application information transmitted by the participation application information transmitting unit 687 of the other publisher terminal 700 via the communication unit 110.

The participation application reception unit 544 of the control unit 540 acquires information of the other person who requests participation (i.e., the other publisher) and the photographer who photographs the publication by the other person, and displays the information on the publisher terminal 600 who is executing the publication for which the request participation is performed (step S203). The participation application reception unit 544 also displays an operation screen for accepting or rejecting the acceptance of the other person and the photographer who have made the application on the publisher terminal 600, and receives permission or rejection of the participation (step S204).

Here, the control unit 540 determines whether or not the publisher allows another publisher to participate (step S205). Specifically, the control unit 540 determines whether or not participation of the publisher is permitted based on the license information acquired from the license information transmitting unit 286 of the publisher terminal 600.

If the participation in the application is rejected (step S205; N), the information acquisition section 541 of the control section 540 acquires various information of the publisher from the publisher terminal 600 that is performing the publication (step S207). In other words, if there is no participant, the content distribution server 500 acquires only the avatar information and the action information of the distributor, and executes the processing of the subsequent steps S208, S209.

However, if the other publisher has been permitted to participate (step S205; Y), the information acquisition unit 541 of the control unit 540 acquires various information of the publisher and various information of the other publisher participating in the publication from the publisher terminal 600 that is performing the publication (step S206). In other words, the content distribution server 500 acquires the virtual character information and the action information of the distributor and the participant, and executes the processing in the subsequent steps S211 and S212.

The control unit 540 determines whether the publisher allows the participant of the photographer who performs shooting in the virtual space for other distribution (step S208). Specifically, the control unit 540 determines whether or not participation of the publisher is permitted based on the license information acquired from the license information transmitting unit 286 of the publisher terminal 600.

If the participation of the photographer in the application is rejected (step S208; N), the control section 540 controls the distribution state, and the terminal 900 of the photographer enters a state where the virtual camera is not available and only the same function as that of the viewer terminal 300, 800 is available (step S210).

However, if the photographer has been permitted to participate (step S208; Y), the information acquisition section 541 of the control section 540 acquires the virtual camera information of the photographer who is using the terminal 900 of the photographer (step S209). The content distribution server 500 reflects the acquired virtual camera information in the virtual space for distribution of the distributor terminal 600. Thus, shooting can be continuously performed in the moved virtual space using the virtual camera of the photographer.

The video generation unit 542 of the control unit 540 generates a virtual space video in which the motion information acquired by the information acquisition unit 541 is synthesized into a virtual character motion (step S211). If the photographer is permitted to participate, the video generation unit 542 also moves the virtual camera of the photographer into a virtual space for distribution, which shares the virtual camera of the photographer with other distributions.

The delivery unit 543 of the control unit 540 delivers the live content based on the video generated by the video generation unit 542 (step S212). For example, the publisher terminal 600 displays a video of the virtual character view of the publisher, the other publisher terminals 700 participating in the publication display a video of the virtual character view of the other publisher, and the audience terminals 300, 800 of the audience not participating in the publication display a publication screen; the photographer terminal 900, which has been permitted to participate, displays a video shot by the virtual camera in the moved virtual space, which is also used for other distribution. If the avatar or the virtual camera of another publisher moves, the link notification unit 546 of the control unit 540 may cause the viewer terminal 300 or 800 to display a link for viewing the publication performed by the photographer terminal 900 of another publication or another publication, and may also notify the viewer terminal 300 or 800 of the link for viewing the post-movement publication.

One example of the control process performed by the content distribution server 500 is explained above. In addition, the flow of processing is not limited to the above-described flow.

For example, when the publisher accepts the participation application during the delivery, the process of delivering only the publisher may be executed as in steps S207, S211, and S212 before step S201; instead of performing the process of reflecting the intention of the publisher to decide to permit participation, step S204, a process of automatically permitting participation of a prescribed number of application participants in the first come order may also be performed.

< description of Effect >

In the content distribution system 2 according to the present embodiment, the content distribution server 500 receives a participation distribution application issued by another distributor via a network. In this case, even if the publisher and the other publisher are located in different places in the real space, the publisher can execute the distribution by sharing the virtual space with the respective virtual characters. Further, according to the content distribution system 2, it is possible to realize not only the video composition but also the composition of a plurality of distributed programs, the entrance and exit of other distributors to and from a virtual space that is a studio, and the movement from a virtual space that is a studio to a virtual space that is another studio. Therefore, the content distribution system 2 according to the present embodiment can improve the convenience of the form of sharing the virtual space.

The above description of the embodiment ends, but the above embodiment is only an example. Therefore, the specific structure, the processing content, and the like of the content distribution systems 1, 2 are not limited to those explained in the above embodiments. Next, a modified example of the above embodiment is explained. The components common to the content distribution systems 1 and 2 according to the embodiments will be described with the same reference numerals.

(modified embodiment)

The order in which the content distribution server 100 or 500 executes the control processing is not limited to the examples shown in fig. 7 and 13. In addition, the content of the control processing executed by the content distribution server 100 or 500 is not limited to the example shown in fig. 7 or 13, and a part of the processing may be omitted.

In the above embodiment, the content delivered by the content delivery server 100 or 500 is modified depending on the participation situation. In other words, the content is morphed during the distribution phase. However, the contents of the distributed contents may be identical, and display control may be performed on the contents at the stage when the recipient displays the video. When the viewer terminal 300, 800 or the like executes the program to display the content, the display control may be executed in accordance with the participation in the application acceptance. For example, the viewer terminal 300, 800 may implement the above-described variation by receiving the participation permission information of the publisher and performing a corresponding action.

In example 2, an example in which the ratio of the issuance of the received participating application to the issuance of the other participating applications is 1 to 1 is described. However, the structure of the content distribution system 2 is not limited to this participation method, and the virtual roles of a certain distributor terminal may participate in the virtual space in which the other distributor terminals execute distribution at the same time, or the virtual roles of other distributors may participate in the virtual space used by the certain distributor terminal at the time of distribution; the content distribution system 2 may be configured to be capable of realizing many-to-many distribution of the received participating applications and other distribution ratios, that is, capable of integrating a plurality of distributed programs.

In embodiment 2, an example in which a screen published by a participant (other publisher) of a moving source is integrated into a post-moving publication is described. However, the following structure may be adopted: the screen of the distribution by the participant of the source of movement does not change depending on whether or not the participant participates, and the distribution unit 543 of the content distribution server 500 continues the distribution in a state where only the virtual characters of the other distributors are displayed. The viewer terminal 300 or 800 may perform control display, and automatically display the integrated distribution screen without notifying the link of the post-movement distribution.

In the above-described embodiments, the content distribution server 100 or 500 includes the participation application receiving unit 144 or 544 and receives only participation by a participation application. However, the content distribution server 100 or 500 may further include a logout acceptance unit that accepts logout after a participant (i.e., a viewer or another distributor) participates. The withdrawal may be implemented by allowing the participating publisher to send an eviction instruction for the participant to the content publication server 100, 500, or by the participant sending withdrawal application information to the content publication server 100, 500. According to the above structure, the participant can go in and out of the virtual space used by the publisher at the time of publication.

In the above-described embodiment, the content delivery server 100 or 500 is not limited to the configuration of accepting participation in the participation application, and may be configured to accept an invitation issued by a publisher. For example, a publisher using the publisher terminal 200, 600 transmits invitation information for inviting a viewer or other publisher to the content distribution server 100, 500, and the content distribution server 100, 500 notifies a communication terminal used by the viewer or publisher who received the invitation. Thereby, participation by invitation can be realized.

In the content distribution system 1 according to the above-described embodiment, the video generation units 142 and 542 of the content distribution servers 100 and 500 generate the video in the virtual space in which the publisher actions are synthesized as the avatar actions. However, the content distribution server 100 or 500 may be configured without the video generation unit 142 or 542.

For example, the publisher terminal 200, 600, 700 or the viewer terminal 400 participating in the distribution may generate the above-described video, transmit the video data to the content distribution server 100, 500, and distribute live content based on the video data acquired by the content distribution server 100, 500 from the publisher terminal 200, 600, 700 or the viewer terminal 400 participating in the distribution. This processing is substantially the same as the processing performed by the video generation units 142 and 542, and may be performed by the content distribution servers 100 and 500 in cooperation with the distributor terminals 200, 600, and 700 or the viewer terminals 400 participating in the distribution. According to the above configuration, the processing load of the content distribution server 100, 500 can be reduced more than the generation of the video in the virtual space by the content distribution server 100, 500.

When the publisher terminals 200 and 600 perform video distribution, a participant terminal (e.g., the publisher terminal 700 used by the publisher or the viewer terminal 400 used by a viewer participating in the distribution) participating in the distribution acquires the action information and the character information of the participant, generates a video in which the action of the participant is reflected on a virtual character, and transmits the video to the content distribution server 100 or 500. The content distribution server 100, 500 transmits the video data to the publisher apparatus 200, 600 for the main publisher in which the participant participates in distribution. The publisher terminals 200 and 600 for the main publisher acquire the action information and role information of the main publisher, generate a video in the virtual space, and combine the video with the participant video data acquired from the content distribution server 100 or 500. Thus, video data on the screen of both the participant and the main distributor can be generated. The publisher terminal 200, 600 of the main publisher transmits the synthesized video data to the content distribution server 100, 500, and the content distribution server distributes live content based on the video data.

Thus, the content distribution server 100 or 500 does not necessarily have to include the video generation unit 142 or 542 that generates the video in the virtual space in the device itself, and can acquire the video in the virtual space in which the motion of the distributor (or participant) is synthesized as the motion of the virtual character, and distribute the live content corresponding to the video.

Further, the content distribution server 100 or 500 may receive the role information and the action information of the distributor and the participant from the respective terminals, and then transmit the action information of the participant from the content distribution server 100 or 500 to the distributor side and the action information of the distributor to the participant side. The content distribution server 100 or 500 transmits information from the terminal, and each terminal can generate a video in a virtual space in which the virtual character of the distributor and the virtual character of the participant coexist. The terminal that generates the video may be one or more of the publisher terminals 200 and 600 and the participant terminals, or may be another terminal other than the publisher terminals that receives the generated video data, that is, the live content, and then displays the live content.

In the content distribution systems 1 and 2 according to the above embodiments, the distributor terminals 200, 600, and 700, the viewer terminals 300 and 800, and the photographer terminal 900 are different in structure and can be distinguished from each other. However, the above-described respective device constituent elements may be combined to provide a structure having any one or two or more functions.

The content distribution server 100, 500 may not have the video data itself as the distribution content at the time of distribution. The distribution units 143 and 543 of the content distribution servers 100 and 500 can distribute live content for synthesizing an in-virtual-space video in which distributor information is designated as virtual character information. At this time, information necessary for synthesizing the video will be distributed, and the viewer terminal 300, 800 and the participant terminal 200, 600, and the photographer terminal 900, etc. which have received the information will perform processing of synthesizing the video (see-through) and displaying the video according to the received data settings, respectively.

When the content distribution server 100 or 500 distributes video data as live content, the data representing the video viewed from the receiving and distributing side is distributed, and the corresponding live content can be distributed to the receiving and distributing side. At this time, the viewer terminal 300, 800 and the publisher terminal 200, 600, and the photographer terminal 900, etc., which receive the live content, display video based on the received data only. In other words, distribution is performed in a state where video data has been generated at this time. However, when the content distribution server 100, 500 distributes live content for synthesizing a video, the viewer terminal 300, 800 and the distributor terminal 200, 600, the photographer terminal 900, and the like that receive the live content perform synthesis processing based on the received data. In other words, at this time, the content distribution server 100 or 500 distributes only the same live content, and executes processing for generating a video to be displayed on the terminal that receives the live content.

In addition, the content distribution system according to the present disclosure can realize the above-described functions by executing a program on a computer in addition to the above-described apparatuses. The program for realizing the functions of the content distribution system 1 may be stored in a computer-readable recording medium such as a USB (Universal Serial Bus) Memory, a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), an HDD (Hard disk Drive), or the like, or may be downloaded to a computer via a network.

While the present disclosure has been described with reference to preferred embodiments, it is to be understood that the present disclosure is not limited to the precise embodiments disclosed, and that the scope of the present disclosure is intended to include all equivalents of the inventions set forth in the claims. The device configurations described in the above embodiments and modifications can be appropriately combined without technical contradiction.