Transmission control method, device, storage medium and equipment for 8K recorded and played video

文档序号:73233 发布日期:2021-10-01 浏览:20次 中文

阅读说明:本技术 8k录播视频的传输控制方法、装置、存储介质及设备 (Transmission control method, device, storage medium and equipment for 8K recorded and played video ) 是由 刘纹高 谢金元 廖海 晏瑞龙 张秋 于 2021-06-11 设计创作,主要内容包括:本发明实施例公开一种8K录播视频的传输控制方法,方法应用于录播主机,方法包括:利用获取的原始视频流及预设多码率编码机制,确定原始视频流对应的多种码率的编码数据,第一码率为8K;将第一码率对应的第一编码数据及按照预设时间间隔发送的询问指令发送至云端分发服务器;根据接收到当前收流速率及第一编码数据的当前编码速率,确定是否需要对发送的编码数据进行调整;若需要调整,则从第一编码数据中提取关键帧得到第二编码数据;并将第二编码数据及第二码率对应的第三编码数据,或者第二编码数据及第三码率对应的第四编码数据发送至服务器。通过上述方法使得根据收流速率及编码速率调整实时发送的编码数据至服务器,以提高视频播放的流畅性。(The embodiment of the invention discloses a transmission control method of an 8K recorded broadcast video, which is applied to a recorded broadcast host and comprises the following steps: determining coded data with multiple code rates corresponding to the original video stream by using the obtained original video stream and a preset multi-code-rate coding mechanism, wherein the first code rate is 8K; sending first coded data corresponding to the first code rate and an inquiry instruction sent according to a preset time interval to a cloud distribution server; determining whether the transmitted coded data needs to be adjusted or not according to the received current receiving flow rate and the current coding rate of the first coded data; if the key frame needs to be adjusted, extracting the key frame from the first coded data to obtain second coded data; and sending the second coded data and the third coded data corresponding to the second code rate, or sending the second coded data and the fourth coded data corresponding to the third code rate to the server. By the method, the coded data sent in real time is adjusted to the server according to the stream receiving rate and the coding rate, so that the fluency of video playing is improved.)

1. A transmission control method for 8K recorded and played video is characterized in that the method is applied to a recorded and played host, and the method comprises the following steps:

acquiring an original video stream shot in real time;

determining coded data of multiple code rates corresponding to the original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

the first coded data corresponding to the first code rate are sent to a cloud distribution server in real time, and an inquiry instruction is sent to the cloud distribution server according to a preset time interval, wherein the inquiry instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server;

determining whether the coded data transmitted in real time needs to be adjusted according to the received current receiving flow rate and the current coding rate of the first coded data;

if the coded data transmitted in real time need to be adjusted, extracting a key frame from the first coded data to obtain second coded data; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

2. The method of claim 1, wherein determining whether an adjustment to the encoded data transmitted in real time is required based on the received current receive stream rate and the current encoding rate of the first encoded data comprises:

if the current coding rate is larger than or equal to a first multiple and a first product of the current receiving flow rate, determining that the coded data transmitted in real time needs to be adjusted;

and if the current coding rate is less than the first product, determining that the coded data transmitted in real time does not need to be adjusted.

3. The method of claim 1, wherein the sending the second encoded data and the third encoded data corresponding to the second code rate to the cloud server in real time, or sending the second encoded data and the fourth encoded data corresponding to the third code rate to the cloud server in real time, comprises:

if the current coding rate is smaller than a second product of a second multiple and the current receiving flow rate, the second coding data and third coding data corresponding to the second coding rate are sent to the cloud server in real time; the second multiple is greater than the first multiple;

and if the current coding rate is greater than or equal to the second product, sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

4. The method of claim 1, wherein determining whether the encoded data to be transmitted in real time needs to be adjusted according to the received current receiving flow rate and the current encoding rate of the first encoded data further comprises:

acquiring an inquiry time point included in the inquiry instruction;

determining a target statistical time period corresponding to the coding rate by using the inquiry time point and a preset statistical duration;

and determining the current coding rate corresponding to the first code rate by using the first coded data corresponding to the first code rate output in the target statistical time period.

5. A transmission control method for an 8K recorded and played video is applied to a cloud distribution server, and comprises the following steps:

receiving first coded data with a first code rate and an inquiry instruction which are sent by a recording and broadcasting host in real time, wherein the first code rate is 8K;

determining the current flow receiving rate of the cloud server according to the query instruction, and returning the current flow receiving rate to the recording and broadcasting host computer, wherein the recording and broadcasting host computer is used for determining whether the coded data needs to be adjusted according to the current flow receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

and receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

6. The method of claim 5, wherein determining the current flow rate of the cloud server according to the query instruction comprises:

acquiring an inquiry time point included in the inquiry instruction;

determining a target statistical time period corresponding to the flow receiving rate by using the inquiry time point and preset statistical duration;

and determining the current receiving flow rate by using the target statistical time period, the total byte number corresponding to the coded data received in the target statistical time period and a preset receiving flow rate algorithm.

7. The transmission control device of 8K recorded broadcast video is characterized in that the device is applied to a recorded broadcast host, and the device comprises:

a data acquisition module: the system comprises a video acquisition module, a video processing module and a video processing module, wherein the video acquisition module is used for acquiring an original video stream shot in real time;

a data encoding module: the method comprises the steps of determining coded data of multiple code rates corresponding to an original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

a data sending module: the system comprises a cloud distribution server and a query instruction, wherein the cloud distribution server is used for sending first coded data corresponding to the first code rate to the cloud distribution server in real time and sending the query instruction to the cloud distribution server according to a preset time interval, the query instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server;

an adjustment judgment module: the receiving module is used for receiving the current receiving flow rate and the current coding rate of the first coded data, and determining whether the coded data sent in real time needs to be adjusted or not;

a data adjusting module: the key frame is extracted from the first coded data to obtain second coded data if the coded data transmitted in real time need to be adjusted; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

8. The utility model provides a transmission controlling means of 8K recorded broadcast video, its characterized in that, the device is applied to high in the clouds distribution server, the device includes:

a first receiving module: the system comprises a recording and broadcasting host, a query command and a code rate control module, wherein the query command and the code rate control module are used for receiving first coded data of a first code rate and are sent by the recording and broadcasting host in real time, and the first code rate is 8K;

a rate determination module: the recording and broadcasting host is used for determining the current streaming receiving rate of the cloud server according to the query instruction and returning the current streaming receiving rate to the recording and broadcasting host, and the recording and broadcasting host is used for determining whether the coded data needs to be adjusted according to the current streaming receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

a second receiving module: the cloud distribution server is used for receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 6.

10. A computer device comprising a memory and a processor, characterized in that the memory stores a computer program which, when executed by the processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 6.

Technical Field

The invention relates to the technical field of teaching video image processing in the education industry, in particular to a transmission control method, a transmission control device, a storage medium and transmission control equipment for 8K recorded and played videos.

Background

Video coding and transmission refers to a technology of using a computer to code and transmit images through a network so as to play and store network videos, and is also called as video network coding.

The video coding mode is a mode of converting a file in an original video format into a file in another video format by a compression technology, the most important coding and decoding standards in video stream transmission include h.261, h.263, h.264 and h.265 of the international telecommunication union, M-JPEG of the motion still picture experts group and MPEG series standards of the motion picture experts group of the international organization for standardization, and the common resolution of coded images includes 720P, 1080P, 4K, 8K and the like.

Common mobile network video transmission adopts 4G and 5G mobile communication networks to transmit coded video data to a user mobile terminal through the mobile network, so as to realize practical application of video playing, video recording, recorded broadcasting and the like.

At present, when video coding data are transmitted to a network in real time for playing, the video coding data are often jammed when the terminal watches the video due to network fluctuation, and the effect of real-time transmission cannot be guaranteed, so that how to guarantee the real-time watching experience of the video when the network fluctuation occurs is a technical problem to be solved.

Disclosure of Invention

The invention mainly aims to provide a transmission control method and device for 8K recorded and played videos, computer equipment and a storage medium, which can solve the problem that the effect of real-time transmission of the videos cannot be guaranteed when network fluctuation occurs in the prior art, and then the videos at a watching end are jammed.

In order to achieve the above object, a first aspect of the present invention provides a transmission control method for an 8K recorded broadcast video, where the method is applied to a recorded broadcast host, and the method includes:

acquiring an original video stream shot in real time;

determining coded data of multiple code rates corresponding to the original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

the first coded data corresponding to the first code rate are sent to a cloud end distribution server in real time, and an inquiry instruction is sent to the cloud end distribution server according to a preset time interval, wherein the inquiry instruction is used for acquiring the current flow receiving rate of the cloud end distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud end distribution server;

determining whether the coded data transmitted in real time needs to be adjusted according to the received current receiving flow rate and the current coding rate of the first coded data;

if the coded data transmitted in real time need to be adjusted, extracting a key frame from the first coded data to obtain second coded data; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

In a possible implementation manner, the determining whether an adjustment to the encoded data transmitted in real time is required according to the received current receiving flow rate and the current encoding rate of the first encoded data includes:

if the current coding rate is larger than or equal to a first multiple and a first product of the current receiving flow rate, determining that the coded data transmitted in real time needs to be adjusted;

and if the current coding rate is less than the first product, determining that the coding data transmitted in real time does not need to be adjusted.

In a feasible implementation manner, the sending the second encoded data and the third encoded data corresponding to the second code rate to the cloud server in real time, or sending the second encoded data and the fourth encoded data corresponding to the third code rate to the cloud server in real time includes:

if the current coding rate is smaller than a second product of a second multiple and the current receiving flow rate, the second coded data and third coded data corresponding to the second code rate are sent to the cloud server in real time; the second multiple is less than the first multiple;

and if the current coding rate is greater than or equal to the second product, sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

In a possible implementation manner, the determining whether to adjust the encoded data transmitted in real time according to the received current receiving flow rate and the current encoding rate of the first encoded data further includes:

acquiring an inquiry time point included in the inquiry instruction;

determining a target statistic time interval corresponding to the coding rate by using the inquiry time point and preset statistic time length;

and determining the current coding rate corresponding to the first code rate by using the first coded data corresponding to the first code rate output in the target statistical time period.

In order to achieve the above object, a second aspect of the present invention provides a transmission control method for an 8K recorded and broadcast video, where the method is applied to a cloud distribution server, and the method includes:

receiving first coded data with a first code rate and an inquiry instruction which are sent by a recording and broadcasting host in real time, wherein the first code rate is 8K;

determining the current flow receiving rate of the cloud server according to the query instruction, and returning the current flow receiving rate to the recording and broadcasting host computer, wherein the recording and broadcasting host computer is used for determining whether the coded data needs to be adjusted according to the current flow receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

and receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

In one possible implementation manner, the determining, according to the query instruction, a current flow receiving rate of the cloud server includes:

acquiring an inquiry time point included in the inquiry instruction;

determining a target statistic time period corresponding to the flow receiving rate by using the inquiry time point and preset statistic time length;

and determining the current receiving flow rate by using the target statistical time period, the total byte number corresponding to the coded data received in the target statistical time period and a preset receiving flow rate algorithm.

In order to achieve the above object, a third aspect of the present invention provides a transmission control apparatus for recorded and broadcast video, the apparatus being applied to a recorded and broadcast host, the apparatus including:

a data acquisition module: the system comprises a video acquisition module, a video processing module and a video processing module, wherein the video acquisition module is used for acquiring an original video stream shot in real time;

a data encoding module: the method comprises the steps of determining coded data of multiple code rates corresponding to an original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

a data sending module: the system comprises a cloud distribution server and a query instruction, wherein the cloud distribution server is used for sending first coded data corresponding to the first code rate to the cloud distribution server in real time and sending the query instruction to the cloud distribution server according to a preset time interval, the query instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server;

an adjustment judgment module: the receiving module is used for receiving the current receiving flow rate and the current coding rate of the first coded data, and determining whether the coded data sent in real time needs to be adjusted or not;

a data adjusting module: the key frame is extracted from the first coded data to obtain second coded data if the coded data transmitted in real time need to be adjusted; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

In order to achieve the above object, a fourth aspect of the present invention provides a transmission control apparatus for recorded and played video, where the apparatus is applied to a cloud distribution server, and the apparatus includes:

a first receiving module: the system comprises a recording and broadcasting host, a query command and a code rate control module, wherein the query command and the code rate control module are used for receiving first coded data of a first code rate and are sent by the recording and broadcasting host in real time, and the first code rate is 8K;

a rate determination module: the recording and broadcasting host is used for determining the current flow receiving rate of the cloud server according to the query instruction and returning the current flow receiving rate to the recording and broadcasting host, and the recording and broadcasting host is used for determining whether the coded data needs to be adjusted according to the current flow receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

a second receiving module: the cloud end distribution server is used for receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud end distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

To achieve the above object, a fifth aspect of the present invention provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the steps as shown in the first aspect, the second aspect and any possible implementation manner.

To achieve the above object, a sixth aspect of the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the steps as shown in the first aspect, the second aspect and any feasible implementation manner.

The embodiment of the invention has the following beneficial effects:

the invention provides a control method for stable transmission of real-time recorded and broadcast video, which is applied to a recorded and broadcast host terminal and comprises the following steps: acquiring an original video stream shot in real time; determining coded data of multiple code rates corresponding to an original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K; the method comprises the steps of sending first coded data corresponding to a first code rate to a cloud distribution server in real time, and sending an inquiry instruction to the cloud distribution server according to a preset time interval, wherein the inquiry instruction is used for obtaining the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server; determining whether the coded data transmitted in real time needs to be adjusted according to the received current receiving flow rate and the current coding rate of the first coded data; if the coded data transmitted in real time need to be adjusted, extracting a key frame from the first coded data to obtain second coded data; and the second coded data and the third coded data corresponding to the second code rate are sent to the cloud server in real time, or the second coded data and the fourth coded data corresponding to the third code rate are sent to the cloud server in real time. The method comprises the steps of carrying out multi-rate coding on an original video stream, firstly sending first coded data corresponding to 8K code rate, and sending an inquiry instruction to determine the current receiving flow rate, so that whether the real-time sent coded data needs to be adjusted can be determined according to the current receiving flow rate and the current coding rate of the first coded data when the coded data are sent in real time, and the coded data with low code rate and key frames in the first coded data are sent when the real-time sent coded data need to be adjusted, so that stable transmission of the coded data when the network is unstable is realized, and the smoothness and the real-time performance of video playing are further ensured.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Wherein:

fig. 1 is a schematic diagram of an application environment of a transmission control method for 8K recorded and broadcasted video according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a transmission control method for 8K recorded and broadcast video according to an embodiment of the present invention;

fig. 3 is another schematic flow chart of a transmission control method for 8K recorded and played video according to an embodiment of the present invention;

fig. 4 is a schematic flowchart of a transmission control method for an 8K recorded broadcast video according to an embodiment of the present invention;

fig. 5 is a block diagram of a transmission control apparatus for 8K recorded and played video according to an embodiment of the present invention;

fig. 6 is a block diagram of a transmission control apparatus for 8K recorded and played video according to an embodiment of the present invention;

fig. 7 is a block diagram of a computer device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without any inventive step, shall fall within the scope of the present invention.

Fig. 1 is a schematic application environment diagram of a transmission control method for an 8K recorded and played video according to an embodiment of the present invention. Referring to fig. 1, the transmission control method of 8K recorded and broadcast video is applied to a transmission control system of recorded and broadcast video. The transmission control system of the recorded and broadcast video comprises a recorded and broadcast host 110 and a cloud distribution server 120. The recording and broadcasting host 110 and the cloud distribution server 120 are connected via a 5G network, and the recording and broadcasting host includes but is not limited to a device having video recording, video recording and the like and having image and sound acquisition functions, for example, the recording and broadcasting host may be a desktop terminal or a mobile terminal, wherein the mobile terminal may be any one of a smart phone, a tablet computer, a notebook computer and the like. The cloud distribution server 120 may be implemented by an independent server or a server cluster formed by a plurality of servers.

Referring to fig. 2, fig. 2 is a flowchart illustrating a transmission control method for an 8K recorded video according to an embodiment of the present invention. The method is applied to a recorded broadcast host, and the transmission control method of the 8K recorded broadcast video specifically comprises the following steps:

201. acquiring an original video stream shot in real time;

the original video stream refers to a file in an original video format shot by a recording and playing host, and may also be called a file in a standard video format. Illustratively, the recording host may be an acquisition device with a shooting 8K resolution.

Further, the recording and broadcasting host encodes, transmits and stores the original video stream in real time.

202. Determining coded data of multiple code rates corresponding to the original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

the common codec standards include h.261, h.263, h.264, and h.265 of the international telecommunications union, M-JPEG of the moving still picture experts group, and MPEG series standards of the MPEG group of the international organization for standardization. It is to be understood that the preset multi-rate coding mechanism includes, but is not limited to, coding or decoding with multiple rates by using the coding/decoding standard, and therefore the above description is only by way of example and not by way of limitation, and one or more of the above may be selected according to actual situations to perform multi-rate coding of the original video stream.

Further, the code rate refers to the number of data bits transmitted per unit time during data transmission, and is also called a bit rate. The code rate can be expressed as how many bits are needed to express the audio/video coding data after compression coding per second, that is, the data volume after compressing the image or sound displayed per second, and the unit adopted is generally kbps, that is, kilobits per second. The sampling rate is higher in unit time, the precision is higher, and the processed file is closer to the original file, that is, the details of the picture are richer and closer to the real picture viewed by naked eyes. The common code rates are 720P, 1080P, 4K, 8K, etc., and the sampling rates are increased in sequence.

In a feasible implementation manner, the preset multi-rate coding mechanism refers to that the original video stream is synchronously subjected to multi-path coding, and each path of coding adopts one code rate, so that coding data with multiple code rates corresponding to the original video stream are obtained. For example, the multiple code rates need to satisfy that the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate, where the first code rate may be 8K, the second code rate may be 1080P, and the third code rate may be 720P. The coding and decoding standard of each path may select an optimal standard according to different code rates, or all the coding and decoding standards corresponding to the first code rate may be adopted, which is not limited in this example.

203. The first coded data corresponding to the first code rate are sent to a cloud distribution server in real time, and an inquiry instruction is sent to the cloud distribution server according to a preset time interval, wherein the inquiry instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server;

the preset time interval may be 1s, 2s or less, and the smaller the preset time interval is, the current flow rate back can reflect the real-time network state of the cloud distribution server, for example, an inquiry command is sent to the cloud distribution server every 1s to obtain the current flow rate of the cloud distribution server. The current receiving flow rate refers to the instantaneous rate of the cloud distribution server receiving the coded data, and can be obtained by counting the coded data received in a period of time.

Illustratively, the first encoded data is sent to the server through the 5G network, that is, the recording and broadcasting host and the cloud distribution server perform data interaction through the 5G network, where the first encoded data is encoded data corresponding to a first code rate of 8K.

In the embodiment of the present invention, as shown in step 203, to ensure the viewing experience of the preset viewing terminal for real-time recording and broadcasting, the first encoded data with the highest code rate, that is, the first code rate, is sent to the cloud distribution server by default, and meanwhile, the query instruction is continuously sent according to the preset time interval to obtain the receiving flow rate, so that the determination of step 204 is performed by using the receiving flow rate.

204. Determining whether the coded data transmitted in real time needs to be adjusted according to the received current receiving flow rate and the current coding rate of the first coded data;

it should be noted that, when the current encoding rate is an instantaneous rate corresponding to the first encoded data output by the recording and broadcasting host encoding the 8K video, the current encoding rate can be determined by counting the first encoded data output within a period of time. Further, both the rate of the data being received and the rate of the data being encoded may vary over time and the amount of data contained in each image frame. The real-time output of the encoded data output by the recording and broadcasting host and the real-time received encoded data by the cloud distribution server should be the same in an ideal state, that is, the data volume or the number of bytes is the same, so that the original video stream can be smoothly rebroadcast in real time, the data volume received and sent by the recording and broadcasting host is possibly unequal due to the influence of a network environment in the actual transmission process, so that play delay or pause is caused, and in order to reduce the play delay or pause, whether the real-time sent encoded data needs to be adjusted or not can be determined by outputting the current encoding rate of the encoded data in real time and the current receiving flow rate of the encoded data in real time, so that the real-time sent encoded data can be adaptively adjusted according to the current encoding rate and the current receiving flow rate.

205. If the coded data transmitted in real time need to be adjusted, extracting a key frame from the first coded data to obtain second coded data; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

For example, the current encoding rate and the current streaming receiving rate should be the same, so that it can be ensured that the currently transmitted first encoded data can be completely received by the cloud distribution server in real time, and the relayed video picture is real-time and continuous; if the current coding rate is different from the current receiving rate, the output coded data cannot be received by the cloud distribution server in time, and further the picture retransmission is not real-time and is blocked due to overlong time. Therefore, the encoded data transmitted in real time needs to be adjusted.

It should be noted that each frame in the original video stream represents a still image, some identical pixel blocks exist in adjacent frames, and when a video file is transmitted, the video file is compressed before data transmission in order to reduce the data transmission amount, and specifically, the same part is compressed, i.e., encoded, where IPB is the most common encoding method.

The I frame is defined as a key frame, belonging to intraframe compression, wherein the key frame refers to that the frame picture in the original video stream is completely reserved, namely, is comprehensively coded, so that the frame image in the original video stream can be restored by decoding only the I frame data during decoding.

P is the meaning of forward search, and a P frame refers to the difference between the frame and the previous I frame or P frame, that is, the P frame has no complete picture data, and only the difference data from the picture of the previous frame, when decoding, it needs to decode the related frame before the P frame to obtain the buffered picture, and then superimpose the difference defined by the frame, and the final picture corresponding to the P frame can be obtained.

B is bi-directional search, P, B is encoded data obtained based on I-frames, and B-frames are bi-directional difference frames, that is, B-frames record the difference between the current frame and the previous and subsequent frames, when decoding B-frames, not only the previous buffered pictures but also the decoded pictures are obtained, and the final picture is obtained by superimposing the difference data between the previous and subsequent pictures and the current B-frame.

For example, during encoding, a data sequence corresponding to the first encoded data may be IPBBBPIBP, and therefore, when adjustment is needed, an I frame, that is, a key frame, in the first encoded data is extracted to obtain second encoded data corresponding to the I frame, and the second encoded data is sent to the cloud distribution server. And only sending the second encoded data would result in discontinuous video frames, and playing would form a one-by-one viewing state, but cause a pause, so the second encoded data and the third encoded data corresponding to the second code rate, or the second encoded data and the fourth encoded data corresponding to the third code rate, need to be sent to the cloud distribution server at the same time, so as to compensate for other lost non-critical frames, and ensure the full-frame playing. The second code rate and the third code rate are both smaller than the first code rate, and therefore, the coded data corresponding to the second code rate and the third code rate are both smaller than the first coded data, so that the video card segment of the watching terminal cannot be caused by additionally sending the coded data corresponding to one of the second code rate and the coded data corresponding to the first code rate, transmission of the second coded data of the key frame corresponding to the first code rate can be reserved, the resolution quality of the video picture is reduced less than that when only the first coded data corresponding to the first code rate is sent, and the picture definition quality is ensured.

The invention provides a control method for stable transmission of real-time recorded and broadcast videos. The method comprises the steps of carrying out multi-code-rate coding on an original video stream, firstly sending first coded data corresponding to the maximum code rate, and sending an inquiry instruction to determine the current receiving flow rate, so that whether the real-time coded data needs to be adjusted can be determined according to the current receiving flow rate and the current coding rate of the first coded data when the coded data are sent in real time, and the coded data with low code rate and key frames in the first coded data are sent when the adjustment is needed, so that the stable transmission of the coded data when the network is unstable is realized, and the smoothness and the real-time performance of video playing are further ensured.

Fig. 3 is another schematic flow chart of a transmission control method for an 8K recorded broadcast video according to an embodiment of the present invention, where the method shown in fig. 3 is applied to a recorded broadcast host, and the transmission control method for the 8K recorded broadcast video specifically includes the following steps:

301. acquiring an original video stream shot in real time;

302. determining coded data of multiple code rates corresponding to the original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

303. the first coded data corresponding to the first code rate are sent to a cloud distribution server in real time, and an inquiry instruction is sent to the cloud distribution server according to a preset time interval, wherein the inquiry instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server;

it should be noted that the contents shown in steps 301, 302, and 303 are similar to those shown in steps 201, 202, and 203 of fig. 2, and for avoiding repetition, detailed description is omitted here, and the contents shown in fig. 2 may be referred to specifically.

304. If the current coding rate is larger than or equal to a first multiple of the current receiving flow rate, determining that the coded data transmitted in real time needs to be adjusted;

305. if the current coding rate is less than the first product, determining that the coded data transmitted in real time does not need to be adjusted;

illustratively, step 304 and step 305 may be represented by the following expressions:

in the formula, A represents whether the coded data transmitted in real time needs to be adjusted, 1 represents that the coded data transmitted in real time needs to be adjusted, and 0 represents that the coded data transmitted in real time does not need to be adjusted; k1Representing a first multiple, SRate of flow receiving*K1Representing the first product. Exemplary, K1The value is 2.

It can be understood that, according to steps 304 and 305, it may be determined whether to adjust the encoded data sent in real time, and when the condition shown in step 304 is satisfied, the key frame data is extracted, so as to implement frame reduction processing on the first code rate, and transmit the second encoded data less than the first encoded data to the cloud distribution server.

Wherein, step 304 or 305 further includes:

a. acquiring an inquiry time point included in the inquiry instruction;

it should be noted that the query instruction includes a query time point, which may be understood as a time stamp corresponding to the time when the query instruction is issued and the time stamp is related to a preset time interval, and the time stamps corresponding to the query instructions sent adjacently each time differ by a preset time interval.

b. Determining a target statistic time interval corresponding to the coding rate by using the inquiry time point and preset statistic time length;

it should be noted that the preset statistical time duration corresponding to the flow receiving rate and the coding rate should be the same statistical time duration. The preset statistical time period may be any time period from 1 second to 60 seconds. And then, the calculation is carried out in the same target statistical time period.

For example, if the query time point is 1 pm and the preset statistical time period is 10S, the target statistical time period is a time period from 10S before 1 pm to 1 pm, i.e., from 12 pm to 59 minutes and 50 seconds to 1 pm.

c. And determining the current coding rate corresponding to the first code rate by using the first coded data corresponding to the first code rate output in the target statistical time period.

It can be understood that the current coding rate can be obtained by calculating the coding rate of the first coded data corresponding to the first code rate output in the target statistical time period. The coding rate calculation may be to divide the preset statistical duration by the first coded data corresponding to the first code rate output within the target statistical time period, so as to obtain the current coding rate.

306. If the coded data transmitted in real time need to be adjusted, extracting a key frame from the first coded data to obtain second coded data; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

It should be noted that the content shown in step 306 is similar to that of step 205 shown in fig. 2, and for avoiding repetition, details are not described herein, and refer to the content shown in fig. 2 specifically.

Further, step 306 includes:

316. if the current coding rate is smaller than a second product of a second multiple and the current receiving flow rate, the second coding data and third coding data corresponding to the second code rate are sent to the cloud end server in real time; the second multiple is greater than the first multiple;

326. and if the current coding rate is greater than or equal to the second product, sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

For example, the second bitrate is 1080p, and the third bitrate is 720p, then step 316 and step 317 can be represented by the following expression:

wherein, F () represents selectively sending the third coded data corresponding to the second code rate or the fourth coded data corresponding to the third code rate, K1Is a first multiple, K2Is a second multiple, K1<K2,SRate of flow receiving×K1Represents the first product, SRate of flow receiving×K2Representing the second product. Exemplary, K1May be 2, K1May be 4.

The invention provides a transmission control method of an 8K recorded broadcast video, which is applied to a recorded broadcast host, and the method comprises the steps of coding received original video stream at multiple code rates, preferably sending first coded data corresponding to the first code rate to a cloud distribution server for a user to watch, simultaneously sending an inquiry command according to a preset time interval to obtain a flow receiving rate of the cloud distribution server in the process of sending coded data in real time, and judging whether the real-time sent coded data needs to be adjusted according to the current flow receiving rate and the current coding rate; when the adjustment is needed, the key frame of the first coded data is extracted to obtain second coded data, and the second coded data and third coded data corresponding to the second code rate or fourth coded data corresponding to the second coded data and the third code rate are selectively sent to the cloud distribution server, so that the frame reduction processing of the first code rate is realized, meanwhile, the data supplement can be performed on the lost non-key frame corresponding to the first code rate by utilizing the coded data corresponding to other code rates lower than the first code rate, the definition is reduced as little as possible, and meanwhile, the frame blockage of video playing can be reduced, so that the stable transmission of the coded data in the unstable network is realized, and the smoothness and the real-time performance of video playing are further ensured.

Fig. 4 is a schematic flowchart of another process of a transmission control method for an 8K recorded and broadcast video according to an embodiment of the present invention, where as shown in fig. 4, the method is applied to a cloud distribution server, and the transmission control method for the 8K recorded and broadcast video specifically includes the following steps:

401. receiving first coded data with a first code rate and an inquiry instruction which are sent by a recording and broadcasting host in real time, wherein the first code rate is 8K;

402. determining the current flow receiving rate of the cloud server according to the query instruction, and returning the current flow receiving rate to the recording and broadcasting host computer, wherein the recording and broadcasting host computer is used for determining whether the coded data needs to be adjusted according to the current flow receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

wherein step 402 comprises:

i. acquiring an inquiry time point included in the inquiry instruction;

ii. Determining a target statistic time period corresponding to the flow receiving rate by using the inquiry time point and preset statistic time length;

and iii, determining the current receiving flow rate by using the target statistical time period, the total byte number corresponding to the coding data received in the target statistical time period and a preset receiving flow rate algorithm.

For example, the flow receiving rate may be determined according to the following formula:

in the formula, SRate of flow receivingFor the current rate of flow, DStatistics byteFor counting the total number of bytes, T, of coded data received in timeCounting timeThe range is set for the target statistical time period from 1 second to 60 seconds.

It should be noted that the query time point, the preset statistical duration, and the target statistical time period in the contents shown in steps i, ii, and iii are all similar to the query time point, the preset statistical duration, and the target statistical time period in steps a, b, and c, so that reference may be made to the description of steps a, b, and c.

403. And receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

It should be noted that the contents shown in the above steps 401, 402, and 403 are similar to the contents shown in fig. 2 and 3, and for avoiding repetition, no further description is provided herein, and the contents shown in the above fig. 2 and 3 may be referred to specifically.

In a feasible implementation manner, the cloud distribution server may decode the received encoded data, the decoding manner may refer to the encoding and decoding standard shown in step 202, which is not described herein any more, and after the encoded data is decoded, the video file is sent to a preset viewing terminal to be viewed in real time, so as to implement real-time rebroadcast of the recorded and broadcast picture.

The invention provides a transmission control method of an 8K recorded and played video, which is applied to a cloud distribution server and comprises the following steps: receiving first coded data with a first code rate and an inquiry instruction which are sent by a recording and broadcasting host in real time, wherein the first code rate is 8K; determining the current flow receiving rate of the cloud server according to the query instruction, and returning the current flow receiving rate to the recording and broadcasting host computer, wherein the recording and broadcasting host computer is used for determining whether the coded data needs to be adjusted according to the current flow receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data; and receiving the second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate. The method comprises the steps of receiving coded data and an inquiry command sent by a recording and broadcasting host in real time, sending the coded data to a preset viewing terminal, and returning a receiving flow rate to the recording and broadcasting host according to the inquiry command, so that the recording and broadcasting host can determine whether the real-time sent coded data needs to be adjusted according to the current receiving flow rate and the current coding rate of first coded data when the coded data are sent in real time, and sending the coded data with low code rate and key frames in the first coded data to a cloud-end distribution server when the coded data need to be adjusted, so that the stable transmission of the coded data when the network is unstable is realized, and the smoothness and the real-time performance of video playing are further ensured.

Fig. 5 is a block diagram of a transmission control apparatus for 8K recorded and played video according to an embodiment of the present invention, where the apparatus shown in fig. 5 is applied to a recording and playing host, and the apparatus includes:

the data acquisition module 501: the system comprises a video acquisition module, a video processing module and a video processing module, wherein the video acquisition module is used for acquiring an original video stream shot in real time;

the data encoding module 502: the method comprises the steps of determining coded data of multiple code rates corresponding to an original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K;

the data transmission module 503: the system comprises a cloud end distribution server, a query instruction and a current receiving flow rate, wherein the cloud end distribution server is used for sending first coded data corresponding to a first code rate to the cloud end distribution server in real time, and sending the query instruction to the cloud end distribution server according to a preset time interval, the query instruction is used for obtaining the current receiving flow rate of the cloud end distribution server, and the current receiving flow rate is used for reflecting the network state of the cloud end distribution server;

the adjustment judgment module 504: the data receiving device is used for receiving the current receiving flow rate and the current coding rate of the first coding data, and determining whether the coding data sent in real time needs to be adjusted or not;

the data adjustment module 505: the key frame is extracted from the first coded data to obtain second coded data if the coded data transmitted in real time need to be adjusted; and sending the second coded data and third coded data corresponding to the second code rate to the cloud server in real time, or sending the second coded data and fourth coded data corresponding to the third code rate to the cloud server in real time.

It should be noted that the functions shown in each block in fig. 5 are similar to those shown in fig. 2, and for avoiding repetition, detailed descriptions are omitted here, and specific reference may be made to the contents shown in fig. 2.

The invention provides a transmission control device of 8K recorded broadcast video, which is applied to a recorded broadcast host, and comprises: a data acquisition module: the system comprises a video acquisition module, a video processing module and a video processing module, wherein the video acquisition module is used for acquiring an original video stream shot in real time; a data encoding module: the method comprises the steps of determining coded data of multiple code rates corresponding to an original video stream by using the original video stream and a preset multi-code-rate coding mechanism, wherein the multiple code rates comprise a first code rate, a second code rate and a third code rate, the first code rate is greater than the second code rate, the second code rate is greater than the third code rate, and the first code rate is 8K; a data sending module: the system comprises a cloud distribution server, a query instruction and a first code rate, wherein the cloud distribution server is used for sending first coded data corresponding to the first code rate to the cloud distribution server in real time and sending the query instruction to the cloud distribution server according to a preset time interval, the query instruction is used for acquiring the current flow receiving rate of the cloud distribution server, and the current flow receiving rate is used for reflecting the network state of the cloud distribution server; an adjustment judgment module: the receiving module is used for receiving the current receiving flow rate and the current coding rate of the first coded data, and determining whether the coded data transmitted in real time needs to be adjusted or not; a data adjusting module: the key frame is extracted from the first coded data to obtain second coded data if the coded data transmitted in real time need to be adjusted; and the second coded data and the third coded data corresponding to the second code rate are sent to a cloud server in real time, or the second coded data and the fourth coded data corresponding to the third code rate are sent to the cloud server in real time. The method comprises the steps of carrying out multi-code-rate coding on an original video stream, firstly sending first coded data corresponding to the maximum code rate, and sending an inquiry instruction to determine the current receiving flow rate, so that whether the real-time sent coded data needs to be adjusted can be determined according to the current receiving flow rate and the current coding rate of the first coded data when the coded data are sent in real time, and the coded data with low code rate and key frames in the first coded data are sent when the real-time sent coded data need to be adjusted, so that stable transmission of the coded data when the network is unstable is realized, and the smoothness and the real-time performance of video playing are further ensured.

Fig. 6 is a block diagram of a structure of a transmission control device for 8K recorded and broadcast video according to an embodiment of the present invention, where the device shown in fig. 6 is applied to a cloud distribution server, and the device includes:

the first receiving module 601: the system comprises a recording and broadcasting host, a query command and a code rate control module, wherein the query command and the code rate control module are used for receiving first coded data of a first code rate and are sent by the recording and broadcasting host in real time, and the first code rate is 8K;

rate determination module 602: the recording and broadcasting host is used for determining the current streaming receiving rate of the cloud server according to the query instruction and returning the current streaming receiving rate to the recording and broadcasting host, and the recording and broadcasting host is used for determining whether the coded data needs to be adjusted or not according to the current streaming receiving rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data;

the second receiving module 603: the cloud distribution server is used for receiving second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate, and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate.

It should be noted that the functions shown in each module in fig. 6 are similar to those shown in fig. 4, and for avoiding repetition, details are not described herein, and refer to the contents shown in fig. 4 specifically.

The invention provides a transmission control device of 8K recorded and played videos, which is applied to a cloud distribution server and comprises the following components: a first receiving module: the system comprises a recording and broadcasting host, a query command and a code rate control module, wherein the query command and the code rate control module are used for receiving first coded data of a first code rate and are sent by the recording and broadcasting host in real time, and the first code rate is 8K; a rate determination module: the recording and broadcasting host is used for determining whether the coded data needs to be adjusted or not according to the current receiving flow rate and the current coding rate of the first coded data; when the adjustment is determined, extracting a key frame from the first coded data to obtain second coded data; a second receiving module: the cloud distribution server is used for receiving the second coded data and third coded data corresponding to the second code rate, or receiving the second coded data and fourth coded data corresponding to the third code rate and sending the second coded data and the fourth coded data to the cloud distribution server, wherein the first code rate is greater than the second code rate, and the second code rate is greater than the third code rate. The method comprises the steps that coded data and an inquiry instruction sent by a recording and broadcasting host are received in real time, the coded data are sent to a preset viewing terminal, a receiving flow rate is returned to the recording and broadcasting host according to the inquiry instruction, so that the recording and broadcasting host can determine whether the real-time coded data are required to be adjusted according to the current receiving flow rate and the current coding rate of first coded data when the coded data are sent in real time, and the coded data with low code rate and key frames in the first coded data are sent to a cloud distribution server only when the adjustment is required, so that the stable transmission of the coded data when the network is unstable is realized, and the smoothness and the real-time performance of video playing are further ensured.

Fig. 7 shows an internal structure diagram of a computer device in an embodiment of the present invention. The computer device may be a terminal or a server. As shown in fig. 7, the computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by the processor, causes the processor to implement the age identification method. The memory may also have a computer program stored therein, which, when executed by the processor, causes the processor to perform the above-described method. Those skilled in the art will appreciate that the architecture shown in fig. 7 is a block diagram of only a portion of the architecture associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In an embodiment, a computer device is proposed, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps as shown in any of fig. 2 or fig. 4.

In an embodiment, a computer-readable storage medium is proposed, in which a computer program is stored which, when executed by a processor, causes the processor to carry out the steps as shown in any of fig. 2 or fig. 4.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

20页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:一种动态调节丢帧阈值的方法及相关设备

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!

技术分类