阅读说明：本技术 一种非压缩数据无缝输出方法及装置 (Seamless output method and device for uncompressed data ) 是由 李文森 邹伟华 汤志敏 李伟 于 2021-08-10 设计创作，主要内容包括：本发明涉及音视频数据传输的技术领域,尤其涉及一种非压缩数据无缝输出方法及装置。该方法应用于非压缩数据无缝输出装置,所述装置内设置至少两个缓冲区,所述缓冲区均设置接收存储相同序列且连续递增序列的IP流数据包；所述方法包括：上级设备向下级设备发送主缓冲区中的IP流数据包；下级设备接收IP流数据包的同时对数据包进行序列检测；若序列存在丢包或异常情况,切换接收备用缓冲区的对应数据包。本发明通过设置备用缓冲区,并在备用缓冲区中设置与主缓冲区相同连续序列的数据包,从而在传输过程中序列检测异常时能够进行无缝切换,一定程度上解决了当前传输容易出现丢包的问题,有效提高了数据流的传输精度。(The invention relates to the technical field of audio and video data transmission, in particular to a seamless output method and device for uncompressed data. The method is applied to a non-compressed data seamless output device, at least two buffer areas are arranged in the device, and the buffer areas are used for receiving and storing IP stream data packets with the same sequence and continuously increasing the sequence; the method comprises the following steps: the superior equipment sends an IP stream data packet in the main buffer area to the inferior equipment; the lower-level equipment receives the IP stream data packet and simultaneously performs sequence detection on the data packet; and if the sequence has packet loss or abnormal conditions, switching to receive the corresponding data packet of the standby buffer area. The invention sets the standby buffer area and sets the data packet with the same continuous sequence as the main buffer area in the standby buffer area, thereby being capable of carrying out seamless switching when the sequence detection is abnormal in the transmission process, solving the problem that the packet loss is easy to occur in the current transmission to a certain extent and effectively improving the transmission precision of the data stream.)

1. A seamless output method of non-compressed data is characterized in that the method is applied to a seamless output device of the non-compressed data, at least two buffer areas are arranged in the device, and the buffer areas are respectively provided with IP stream data packets which store the same sequence and continuously increase the sequence; the method comprises the following steps:

the superior equipment sends an IP stream data packet in the main buffer area to the inferior equipment;

the lower-level equipment receives the IP stream data packet and simultaneously performs sequence detection on the data packet;

and if the sequence has packet loss or abnormal conditions, switching to receive the corresponding data packet of the standby buffer area.

2. The seamless output method of uncompressed data according to claim 1, wherein when an abnormality is detected, the lower device switches to a next sequence of data packets corresponding to the data packet when a packet loss or an abnormality is detected.

3. The seamless output method of uncompressed data according to claim 1, wherein the method further comprises:

and continuously carrying out sequence detection in the data packet receiving process, and switching to receive the corresponding data packet of the other buffer area if the sequence has packet loss or abnormal conditions.

4. The seamless output method of uncompressed data according to claim 1, wherein there are two buffers.

5. The seamless output method of uncompressed data according to claim 1, wherein the method for acquiring the IP stream packets comprises:

demodulating and demodulating the input stream according to a ROUTE protocol to obtain compressed data;

the compressed data is decoded by the decoding module and is respectively sent to the plurality of buffer areas for outputting subsequent data packets.

6. The device for seamless output of the uncompressed data is characterized by comprising a receiving module, a decoding module and a seamless output module; the output end of the receiving module is connected with the input end of the decoding module, and the input end of the seamless output module is connected with the output end of the decoding module; the seamless output module comprises an IP assembly and a plurality of buffer areas, and the IP assembly receives decoded data, adds a serial number in a single packaging or mixed packaging mode, and then sends the decoded data to the plurality of buffer areas.

7. The seamless output device of claim 6, wherein the receiving module performs demodulation and de-protocol operations based on a ROUTE protocol.

8. The seamless output device of uncompressed data according to claim 7, wherein the receiving module comprises a demodulation component and a deprotocolation component, and an output end of the demodulation component is connected with an input end of the deprotocolation component; the demodulation component is used for receiving data conforming to set frequency and bandwidth and demodulating the modulated data into binary data; the de-protocol component is used for de-tabulating the demodulation data and acquiring audio and video and subtitle data from the data encapsulated by the self-adaptive streaming media transmission.

9. The seamless output device of claim 8, wherein the demodulation component comprises a PLP interface, and the de-protocol component comprises an SLT interface and a ROUTE interface.

10. The uncompressed data seamless output apparatus of claim 6, wherein the decoding module comprises a video decoding component, an audio decoding component, and an audio pass-through component; the video decoding component 21 is configured to decode the video compressed data subjected to the protocol decoding, the audio decoding component is configured to decode the audio compressed data subjected to the protocol decoding, and the audio pass-through component encapsulates the audio compressed data subjected to the protocol decoding.

Technical Field

The invention relates to the technical field of audio and video data transmission, in particular to a seamless output method and device for uncompressed data.

Background

With the improvement of the social living standard, users have higher requirements on the precision of audios and videos such as televisions and broadcasting. At present, in the transmission process of a remote IP stream, the phenomenon of accuracy shortage easily occurs due to the existence of a certain network environment reason in the transmission between the upper and lower devices, for example, when in a severe network environment transmission or when the network environment of a certain operator is abnormal, the lower platform easily generates a packet loss phenomenon in receiving, which affects the transmission accuracy of the IP stream and the experience of the user.

In addition, if the existing device adopts ATSC1.0/2.0 for receiving and decoding, it is difficult to support the new functions of 4K, HDR and AC-4, and the requirements of higher quality and secure transmission required by the current users cannot be met.

Disclosure of Invention

The invention provides a method and a device for seamless output of uncompressed data, which aim to solve the technical problems that packet loss is easy to occur in the current network IP stream transmission and the transmission precision is low.

In order to solve the technical problems, the technical scheme of the invention is as follows:

a non-compressed data seamless output method is applied to a non-compressed data seamless output device, at least two buffer areas are arranged in the device, and the buffer areas are respectively provided with IP stream data packets which store the same sequence and continuously increase the sequence; the method comprises the following steps:

the superior equipment sends an IP stream data packet in the main buffer area to the inferior equipment;

the lower-level equipment receives the IP stream data packet and simultaneously performs sequence detection on the data packet;

and if the sequence has packet loss or abnormal conditions, switching to receive the corresponding data packet of the standby buffer area.

Further, when an abnormality is detected, the lower device switches to the next sequence of data packets corresponding to the data packet when a packet loss or an abnormal condition is detected.

Further, the method further comprises:

and continuously carrying out sequence detection in the data packet receiving process, and switching to receive the corresponding data packet of the other buffer area if the sequence has packet loss or abnormal conditions.

Further, the number of the buffer areas is two.

Further, the method for acquiring the IP stream packet comprises:

demodulating and demodulating the input stream according to a ROUTE protocol to obtain compressed data;

the compressed data is decoded by the decoding module and is respectively sent to the plurality of buffer areas for outputting subsequent data packets.

The embodiment also provides a seamless output device of uncompressed data, which comprises a receiving module, a decoding module and a seamless output module; the output end of the receiving module is connected with the input end of the decoding module, and the input end of the seamless output module is connected with the output end of the decoding module; the seamless output module comprises an IP assembly and a plurality of buffer areas, and the IP assembly receives decoded data, adds a serial number in a single packaging or mixed packaging mode, and then sends the decoded data to the plurality of buffer areas.

Further, the receiving module performs demodulation and protocol demodulation operations based on a ROUTE (Real-time Object Delivery over universal Transport, an application layer protocol) protocol.

Further, the receiving module comprises a demodulation component and a protocol decoding component, and an output end of the demodulation component is connected with an input end of the protocol decoding component; the demodulation component is used for receiving data conforming to set frequency and bandwidth and demodulating the modulated data into binary data; the de-protocol component is used for de-tabulating the demodulation data and acquiring audio and video and subtitle data from the data encapsulated by the self-adaptive streaming media transmission.

Further, the demodulation component includes a PLP (Physical Layer Pipe) interface, and the demodulation protocol component includes an SLT (Service List Table) interface and a ROUTE interface.

Further, the decoding module comprises a video decoding component, an audio decoding component and an audio pass-through component; the video decoding component 21 is configured to decode the video compressed data subjected to the protocol decoding, the audio decoding component is configured to decode the audio compressed data subjected to the protocol decoding, and the audio pass-through component encapsulates the audio compressed data subjected to the protocol decoding.

The invention sets the standby buffer area and sets the data packet with the same continuous sequence as the main buffer area in the standby buffer area, thereby being capable of carrying out seamless switching when the sequence detection is abnormal in the transmission process, solving the problem that the packet loss is easy to occur in the current transmission to a certain extent and effectively improving the transmission precision of the data stream.

Drawings

Fig. 1 is a flow chart illustrating a structure of a seamless output method of uncompressed data according to an embodiment of the present invention.

Fig. 2 is a schematic diagram of buffer IP flow arrangement according to an embodiment of the present invention.

Fig. 3 is a schematic diagram of a handover procedure in an embodiment of the present invention.

FIG. 4 is a block diagram of an uncompressed data seamless output apparatus according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The same or similar reference numerals in the drawings of the embodiments of the present application correspond to the same or similar components; in the description of the present application, it is to be understood that the terms "upper", "lower", "left", "right", "top", "bottom", "inner", "outer", and the like, if any, are used in the orientations and positional relationships indicated in the drawings only for the convenience of describing the present application and for simplicity of description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and therefore the terms describing the positional relationships in the drawings are for illustrative purposes only and are not to be construed as limiting the present patent.

Furthermore, if the terms "first," "second," and the like are used for descriptive purposes only, they are used for mainly distinguishing different devices, elements or components (the specific types and configurations may be the same or different), and they are not used for indicating or implying relative importance or quantity among the devices, elements or components, but are not to be construed as indicating or implying relative importance.

Fig. 1 shows a flow chart of the structure of the seamless output method of uncompressed data in the present embodiment.

As shown in fig. 1, the present embodiment provides a seamless output method for uncompressed data, which is applied to a seamless output device for uncompressed data, wherein at least two buffers are disposed in the output device, and a plurality of buffers are each configured to receive IP stream packets storing the same sequence and continuously increasing the sequence.

In the seamless output method of this embodiment, by performing seamless handover in the plurality of buffers, the problem of packet loss occurring when IP stream data is transmitted between the upper device and the lower device is avoided or reduced, and specifically, the seamless output method specifically includes:

101. and the upper-level equipment sends the IP stream data packet in the main buffer area to the lower-level equipment.

102. And the lower-level equipment receives the IP stream data packet and simultaneously performs sequence detection on the data packet.

103. And if the sequence has packet loss or abnormal conditions, switching to receive the corresponding data packet of the standby buffer area.

Before data transmission, the primary and secondary buffers are provided with data packets having the same and continuously increasing sequence, the same sequence means that the primary and secondary buffers have data packets including the same sequence, and the continuously increasing sequence means that every two packets in the primary and secondary buffers are continuously increasing. For example, please refer to fig. 2, wherein IP stream a in the main buffer has an increasing sequence of packets a 1-a 4, and IP stream B in the reserve buffer has the same sequence of packets B1-B4 as a, wherein the data in packets a 1-a 4 and packets B1-B4 are correspondingly the same.

Because the user can output transmission to different network operators in one device, when the transmission is in a severe network environment or when the network environment of a certain operator is abnormal, the packet loss phenomenon is easy to occur, and the next-stage device can be switched according to the seamless IP flow in the standby buffer area. The specific implementation mode is that in the transmission process, the lower-level device receives the seamless stream at the same time, performs sequence detection on the data packets while receiving the IP stream data packets, judges whether a packet loss situation exists or not, and if so, seamlessly switches to the position where the data packets are missing in the standby buffer area, namely switches to the position corresponding to the seamless stream for subsequent transmission, thereby avoiding the packet loss phenomenon.

In the aspect of sequence detection, in the transmission process, the lower level device buffers a certain number of data packets and performs sequence detection, when the data packets received by the buffer area are found to be discontinuous, the lower level device can switch to another buffer area to receive the data packets, specifically, when an abnormality is detected, the lower level device switches to the next sequence data packet corresponding to the data packet when packet loss or the abnormality is detected, so that real seamless switching is achieved.

In some embodiments, the sequence detection is continuously performed in the packet receiving process, and if the sequence has a packet loss or an abnormal condition, the sequence is switched to receive a corresponding packet in another buffer, so that the packet receiving process may be switched more than once, and the lower device can perform continuous switching in the main buffer and the standby buffer according to the packet loss condition.

In the following, an embodiment of sequence detection is provided, and referring to fig. 3, when the next device first obtains a packet a1 from the main buffer, when obtaining the next packet, it finds that it is A3, ideally a2, and detects a sequence discontinuity, so it switches to the backup buffer, obtains a packet B2 having the same sequence as the missing packet, and when obtaining a packet B6, it starts to obtain the next packet, it finds that it is B10, ideally B7, and at this time, it detects a sequence discontinuity again, so it switches to the main buffer again, and obtains a packet a7 having the same sequence.

It should be noted that in this embodiment, two buffer areas are provided, namely, a main buffer area and a reserve buffer area, and of course, in order to ensure the accuracy of data transmission, a plurality of reserve buffer areas may be additionally provided.

In some embodiments, before seamless handover, it is necessary to acquire a packet of an IP flow, where the acquiring method includes:

demodulating and demodulating the input stream according to a ROUTE protocol to obtain compressed data;

the compressed data is decoded by the decoding module and is respectively sent to the plurality of buffer areas for outputting subsequent data packets.

Specifically, after the uncompressed data seamless output device receives an input stream, demodulation and protocol decoding are performed through a ROUTE protocol, an IP stream packet transmitted to a lower device is obtained and sent to a plurality of buffers, and pre-preparation of subsequent seamless output is completed.

The seamless output method of uncompressed data in this embodiment has the advantages that by setting the reserve buffer area and setting the data packets with the same continuous sequence as the main buffer area in the reserve buffer area, seamless switching can be performed when sequence detection is abnormal in the transmission process, the problem that packet loss is likely to occur in current transmission is solved to a certain extent, and the transmission precision of a data stream is effectively improved.

Fig. 4 shows a block diagram of the structure of the uncompressed data seamless output apparatus in the present embodiment.

As shown in fig. 4, this embodiment further provides a seamless output device for uncompressed data, where the output device includes a receiving module, a decoding module, and a seamless output module, where an output end of the receiving module is connected to an input end of the decoding module, an input end of the seamless output module is connected to an output end of the decoding module, and in terms of action, the receiving module is mainly used to demodulate and deprotote an input stream to obtain input audio/video and subtitle data; the decoding module is used for decoding the input audio and video and caption data and outputting the decoded data to the seamless output module. The seamless output module comprises an IP component and a plurality of buffers, wherein the IP component receives decoded data, adds a serial number into the decoded data in a single packaging or mixed packaging mode, and sends the decoded data to the plurality of buffers, and the lower-level device receives seamless streams in the plurality of buffers, performs seamless switching according to sequence detection during receiving, and finally improves receiving precision.

It should be noted that, when receiving the data packet in the uncompressed data seamless output device, the lower device may receive the data packet by the uncompressed data seamless output method described above in this embodiment.

In some embodiments, the receiving module performs demodulation and demodulation protocol operations based on the ROUTE protocol. Preferably, the receiving module includes a demodulating component and a de-protocol component, an output end of the demodulating component is connected with an input end of the de-protocol component, wherein the demodulating component is configured to receive data conforming to a set frequency and a set bandwidth and demodulate the modulated data into binary data, and the de-protocol component is configured to de-table the demodulated data and obtain audio, video and subtitle data from data encapsulated in the adaptive streaming media transmission. More specifically, the demodulation component includes a PLP (Physical Layer Pipe) interface, and the demodulation protocol component includes an SLT (Service List Table) interface and a ROUTE (Real-time Object Delivery over universal Transport) interface.

The specific operation of demodulating and demodulating the protocol includes that the demodulation component receives data which conforms to the set frequency and bandwidth through the PLP interface, and demodulates the modulated data into binary data by using a demodulation LDM (layer division multiplexing) technology. In addition, the deprotocol component deplexes the demodulated data through the SLT interface to obtain the existing program information, protocol type, and destination address, for example, a quadruple consisting of a service ID, a ROUTE protocol type, an IP address, and a port may be obtained, which may be used to guide the next ROUTE protocol. The ROUTE interface analyzes the demodulated data, acquires a Service Layer Signaling (SLS) as a guide, and then acquires audio/video and subtitle data from data encapsulated by DASH (Dynamic Adaptive Streaming over HTTP). For example, (1) the apparatus may list a plurality of programs to the user by the service ID acquired by the SLT, and when the user selects a certain program, that is, selects the service ID, the apparatus may receive data using the IP address and port corresponding to the service ID; (2) the received data is demultiplexed according to the type, and audio/video and subtitle data can be separated from the DASH data.

In some embodiments, the decoding module includes a video decoding component, an audio decoding component, and an audio pass-through component; the video decoding component 21 is configured to decode the video compressed data subjected to the protocol decoding, the audio decoding component is configured to decode the audio compressed data subjected to the protocol decoding, and the audio pass-through component encapsulates the audio compressed data subjected to the protocol decoding. Specifically, the video decoding component can decode the video compressed data of the protocol to obtain YUV (a color coding method) data. The audio decoding component is capable of decoding the deprototed audio compressed data to obtain PCM data. The audio pass-through component can encapsulate the deprototed audio compressed data according to the SMPTE337 standard.

The non-compressed data seamless output device in the application can demodulate, de-list and de-protocol input data through the receiving module to obtain compressed data, then decode or encapsulate through the decoding module to obtain YUV and PCM/SMPTE337 data, and finally process through the seamless output module and then carry out flexible seamless output through IP, thereby solving the problem that packet loss easily occurs in the current upper and lower level data transmission process and improving the transmission precision of data streams. In addition, the device demodulates, de-lists and de-protocols the input stream through the receiving module based on the ROUTE protocol, supports new functions of 4K, HDR (High-Dynamic Range, High-Dynamic illumination rendering) and AC-4 (a surround sound broadcasting system), is widely applied and can support seamless transmission, and can greatly meet the requirements of higher quality and safe transmission.

It should be understood that the above-described embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the claims of the present invention.