阅读说明：本技术 一种网络电视直播系统及方法 (Network television live broadcasting system and method ) 是由 陈明 管毅鸿 周玲 于 2020-10-28 设计创作，主要内容包括：本发明涉及网络电视直播技术领域,具体地说,涉及一种网络电视直播系统及方法,系统中的视频采集模块分别与图像拼接模块、音频处理模块连接,图像拼接模块与图像融合模块连接,图像融合模块与图像平滑模块连接,图像平滑模块、音频处理模块均与网络直播流编码模块连接,网络直播流编码模块与流媒体收录服务器连接,流媒体收录服务器与流媒体传输服务器连接,流媒体传输服务器与接收终端连接；本发明能够对采集的视频和音频进行优化处理,直播质量高,而且实现直播地点360°全景网络电视直播,使人们获得更佳的直播观看体验。(The invention relates to the technical field of network television live broadcasting, in particular to a network television live broadcasting system and a network television live broadcasting method.A video acquisition module in the system is respectively connected with an image splicing module and an audio processing module, the image splicing module is connected with an image fusion module, the image fusion module is connected with an image smoothing module, the image smoothing module and the audio processing module are both connected with a network live broadcasting stream coding module, the network live broadcasting stream coding module is connected with a stream media recording server, the stream media recording server is connected with a stream media transmission server, and the stream media transmission server is connected with a receiving terminal; the invention can optimize the collected video and audio, has high live broadcast quality, realizes live broadcast of the 360-degree panoramic network television at the live broadcast site, and ensures that people obtain better live broadcast viewing experience.)

1. A network television live broadcast system is characterized in that: the method comprises the following steps:

the number of the video acquisition modules is 6, and the video acquisition modules are used for acquiring 360-degree panoramic videos and audios of live broadcast places;

the image splicing module is used for carrying out image splicing on the panoramic video;

the image fusion module is used for performing cylindrical surface mapping on the spliced video images to obtain a viewpoint image and then fusing the viewpoint image;

the image smoothing module is used for performing smooth transition on the edge area;

the audio processing module is used for carrying out noise reduction processing on the audio;

the network live broadcast stream coding module is used for compressing video and audio, coding the video and the audio and generating a streaming media live broadcast file;

the streaming media recording server is used for carrying out streaming slice caching on the streaming media live broadcast file;

the streaming media transmission server is used for transmitting the streaming media live broadcast file in real time;

the receiving terminal is used for receiving the streaming media live broadcast file, separating and decoding the streaming media live broadcast file and eliminating redundant pixels of the image edge frame number in the decoded video;

the video acquisition module is respectively connected with the image splicing module and the audio processing module, the image splicing module is connected with the image fusion module, the image fusion module is connected with the image smoothing module, the image smoothing module and the audio processing module are both connected with the live webcast stream coding module, the live webcast stream coding module is connected with the streaming media recording server, the streaming media recording server is connected with the streaming media transmission server, and the streaming media transmission server is connected with the receiving terminal.

2. The live webtv system of claim 1, wherein: the video acquisition module is a camera.

3. The live webtv system of claim 2, wherein: the 6 video acquisition modules are distributed in a hexagon shape, and the shooting angle of the camera is 100-120 degrees.

4. The network television direct broadcasting system as claimed in claim 3, characterized in that: the network live stream coding module comprises a video stream coding module and an audio stream coding module.

5. A network television live broadcast method is characterized in that: the method comprises the following steps:

the 6 video acquisition modules acquire 360-degree panoramic video and audio of a shooting place;

secondly, carrying out image splicing on the panoramic video;

thirdly, carrying out image fusion on the spliced images;

fourthly, smoothly transitioning the fused image piece;

fifthly, processing the audio;

sixthly, compressing and coding the processed video and audio and generating a streaming media live broadcast file;

seventhly, performing streaming slice caching on the streaming media live broadcast file;

eighthly, transmitting the streaming media live broadcast file to a receiving terminal in real time;

and ninthly, the receiving terminal separates and decodes the streaming media live broadcast file, eliminates redundant pixels of image edge frame numbers in the decoded video and plays the video through the player.

6. The live broadcasting method of the network television as claimed in claim 5, wherein: in the second step, the splicing process is as follows: and performing feature matching on the first frame image of the video, and completing image splicing work of subsequent video frames through a transformation matrix obtained by matching.

7. The live broadcasting method of the network television as claimed in claim 6, characterized in that: in the sixth step, in the coding process, corresponding video and audio data are extracted, then corresponding FFMpeg components are registered, formats are set to realize the initialization of coding, coding is carried out by using coding functions and data structural members in an FFMpeg library, and finally the coded video and audio are put into an output stream of live broadcast of a network.

Technical Field

The invention relates to the technical field of network television live broadcast, in particular to a network television live broadcast system and a network television live broadcast method.

Background

The broadcast and television industry in China is undergoing the conversion from analog television to digital television, and enters the network era along with the rapid development of the Internet. Through decades of development, television stations in all provinces and cities accumulate rich content resources, including videos, audios, pictures, characters and the like. The content consumption of the public also starts to actively acquire the most interesting content messages related to the public by using a network from the initial passive receiving mode of listening to radio, watching newspaper, watching television and the like. Meanwhile, carriers for information transmission are also expanded from paper, radios, televisions to more channels such as computers, mobile phones and mobile televisions. Consumers have more and more autonomy, which means that the media industry must grasp historical opportunities, and the advantages of the media industry are fully utilized in the revolution, a new operation mode is selected, and market first opportunity is preempted.

At present, the streaming Media video common technologies are mainly two major camps of Windows Media player of microsoft corporation and Media Server of Adobe corporation, and the player is respectively based on Windows Media player and flash player. Although the technology is mature, the current network television live broadcast can only live broadcast a single scene, and the requirements of people are difficult to meet.

Moreover, with the wide application of high definition video formats, network videos also put higher demands on the quality, definition and watching fluency of video contents.

Disclosure of Invention

The present invention is directed to a system and method for live webtv broadcast that overcomes some or all of the disadvantages of the prior art.

The invention relates to a network television live broadcast system, which comprises:

the number of the video acquisition modules is 6, and the video acquisition modules are used for acquiring 360-degree panoramic videos and audios of live broadcast places;

the image splicing module is used for carrying out image splicing on the panoramic video;

the image fusion module is used for performing cylindrical surface mapping on the spliced video images to obtain a viewpoint image and then fusing the viewpoint image;

the image smoothing module is used for performing smooth transition on the edge area;

the audio processing module is used for carrying out noise reduction processing on the audio;

the network live broadcast stream coding module is used for compressing video and audio, coding the video and the audio and generating a streaming media live broadcast file;

the streaming media recording server is used for carrying out streaming slice caching on the streaming media live broadcast file;

the streaming media transmission server is used for transmitting the streaming media live broadcast file in real time;

the receiving terminal is used for receiving the streaming media live broadcast file, separating and decoding the streaming media live broadcast file and eliminating redundant pixels of the image edge frame number in the decoded video;

the video acquisition module is respectively connected with the image splicing module and the audio processing module, the image splicing module is connected with the image fusion module, the image fusion module is connected with the image smoothing module, the image smoothing module and the audio processing module are both connected with the live webcast stream coding module, the live webcast stream coding module is connected with the streaming media recording server, the streaming media recording server is connected with the streaming media transmission server, and the streaming media transmission server is connected with the receiving terminal.

Preferably, the video capture module is a video camera.

Preferably, the 6 video acquisition modules are distributed in a hexagonal shape, and the shooting angle of the camera is 100-120 degrees.

Preferably, the webcast stream encoding module includes a video stream encoding module and an audio stream encoding module.

The invention also provides a live broadcast method of the network television, which comprises the following steps:

the 6 video acquisition modules acquire 360-degree panoramic video and audio of a shooting place;

secondly, carrying out image splicing on the panoramic video;

thirdly, carrying out image fusion on the spliced images;

fourthly, smoothly transitioning the fused image piece;

fifthly, processing the audio;

sixthly, compressing and coding the processed video and audio and generating a streaming media live broadcast file;

seventhly, performing streaming slice caching on the streaming media live broadcast file;

eighthly, transmitting the streaming media live broadcast file to a receiving terminal in real time;

and ninthly, the receiving terminal separates and decodes the streaming media live broadcast file, eliminates redundant pixels of image edge frame numbers in the decoded video and plays the video through the player.

Preferably, in the second step, the splicing process is as follows: and performing feature matching on the first frame image of the video, and completing image splicing work of subsequent video frames through a transformation matrix obtained by matching.

Preferably, in the sixth step, corresponding video and audio data are extracted in the encoding process, then corresponding FFMpeg parts are registered and formats are set to realize the initialization of encoding, then encoding is carried out by using encoding functions and data structural members in an FFMpeg library, and finally the encoded video and audio are put into the output stream of live network.

The invention can optimize the collected video and audio, has high live broadcast quality, realizes live broadcast of the 360-degree panoramic network television at the live broadcast site, and ensures that people obtain better live broadcast viewing experience.

Drawings

Fig. 1 is a block diagram of a live webtv system in embodiment 1.

Detailed Description

For a further understanding of the invention, reference should be made to the following detailed description taken in conjunction with the accompanying drawings and examples. It is to be understood that the examples are illustrative of the invention and not limiting.

Example 1

As shown in fig. 1, the present embodiment provides a network television live broadcasting system, which includes:

the number of the video acquisition modules is 6, and the video acquisition modules are used for acquiring 360-degree panoramic videos and audios of live broadcast places;

the image splicing module is used for carrying out image splicing on the panoramic video;

the image fusion module is used for performing cylindrical surface mapping on the spliced video images to obtain a viewpoint image and then fusing the viewpoint image;

the image smoothing module is used for performing smooth transition on the edge area; therefore, the finally obtained panoramic video image is more real;

the audio processing module is used for carrying out noise reduction processing on the audio;

the network live broadcast stream coding module is used for compressing video and audio, coding the video and the audio and generating a streaming media live broadcast file;

the streaming media recording server is used for carrying out streaming slice caching on the streaming media live broadcast file;

the streaming media transmission server is used for transmitting the streaming media live broadcast file in real time;

the receiving terminal is used for receiving the streaming media live broadcast file, separating and decoding the streaming media live broadcast file and eliminating redundant pixels of the image edge frame number in the decoded video;

the video acquisition module is respectively connected with the image splicing module and the audio processing module, the image splicing module is connected with the image fusion module, the image fusion module is connected with the image smoothing module, the image smoothing module and the audio processing module are both connected with the live webcast stream coding module, the live webcast stream coding module is connected with the streaming media recording server, the streaming media recording server is connected with the streaming media transmission server, and the streaming media transmission server is connected with the receiving terminal.

In this embodiment, the video capture module is a camera.

In this embodiment, the 6 video capture modules are distributed in a hexagonal shape, and the shooting angle of the camera is 100-120 °.

In this embodiment, the webcast stream encoding module includes a video stream encoding module and an audio stream encoding module.

The embodiment also provides a live broadcast method of the network television, which comprises the following steps:

the 6 video acquisition modules acquire 360-degree panoramic video and audio of a shooting place;

secondly, carrying out image splicing on the panoramic video;

thirdly, carrying out image fusion on the spliced images;

fourthly, smoothly transitioning the fused image piece;

fifthly, processing the audio;

sixthly, compressing and coding the processed video and audio and generating a streaming media live broadcast file;

seventhly, performing streaming slice caching on the streaming media live broadcast file;

eighthly, transmitting the streaming media live broadcast file to a receiving terminal in real time;

and ninthly, the receiving terminal separates and decodes the streaming media live broadcast file, eliminates redundant pixels of image edge frame numbers in the decoded video and plays the video through the player.

In the second step, the splicing process is as follows: and performing feature matching on the first frame image of the video, and completing image splicing work of subsequent video frames through a transformation matrix obtained by matching. This reduces the splicing time.

In the sixth step, in the coding process, corresponding video and audio data are extracted, then corresponding FFMpeg components are registered, formats are set to realize the initialization of coding, coding is carried out by using coding functions and data structural members in an FFMpeg library, and finally the coded video and audio are put into an output stream of live broadcast of a network.

The embodiment can optimize the collected video and audio, the live broadcast quality is high, and the live broadcast of 360-degree panoramic network television in a live broadcast place is realized, so that people can obtain better live broadcast watching experience.

The present invention and its embodiments have been described above schematically, without limitation, and what is shown in the drawings is only one of the embodiments of the present invention, and the actual structure is not limited thereto. Therefore, if the person skilled in the art receives the teaching, without departing from the spirit of the invention, the person skilled in the art shall not inventively design the similar structural modes and embodiments to the technical solution, but shall fall within the scope of the invention.