Data processing method and device
阅读说明：本技术 数据处理方法和装置 (Data processing method and device ) 是由 卢燕青 安君超 韩杰 王艳辉 于 2018-06-29 设计创作，主要内容包括：本发明实施例提供了一种数据处理方法及装置,应用于视联网中。其中方法包括：第一视联网终端对采集的视频信号进行编码得到视频数据,并将所述视频数据保存至预设的发送缓冲区；第一视联网终端获取编码参数,依据所述编码参数及预设数据量确定发送时间间隔；第一视联网终端按照所述发送时间间隔从所述发送缓冲区中读取所述预设数据量的视频数据；第一视联网终端将读取的视频数据通过视联网,经由所述视联网服务器发送至所述第二视联网终端。本发明实施例能够保证发送的视频数据的均匀性和稳定性,避免了由于带宽限制导致的网络丢包现象,进而避免第二视联网终端出现视频播放卡顿、图像花屏等现象。(The embodiment of the invention provides a data processing method and device, which are applied to a video network. The method comprises the following steps: the first video network terminal encodes the collected video signal to obtain video data and stores the video data to a preset sending buffer area; a first video network terminal acquires coding parameters and determines a sending time interval according to the coding parameters and a preset data volume; the first video network terminal reads the video data with the preset data volume from the sending buffer area according to the sending time interval; and the first video network terminal sends the read video data to the second video network terminal through the video network via the video network server. The embodiment of the invention can ensure the uniformity and stability of the transmitted video data, and avoid the phenomenon of network packet loss caused by bandwidth limitation, thereby avoiding the phenomena of video playing blockage, image screen splash and the like of the second video network terminal.)
1. A data processing method is applied to a video network, wherein the video network comprises a video network terminal and a video network server, the video network terminal comprises a first video network terminal and a second video network terminal, and the method comprises the following steps:
the first video network terminal encodes the collected video signal to obtain video data and stores the video data to a preset sending buffer area;
the first video network terminal acquires coding parameters and determines a sending time interval according to the coding parameters and a preset data volume;
the first video network terminal reads the video data with the preset data volume from the sending buffer area according to the sending time interval;
and the first video network terminal sends the read video data to the second video network terminal through the video network via the video network server.
2. The method according to claim 1, wherein the encoding parameter includes a frame rate, the first video network terminal acquires the encoding parameter, and the step of determining the transmission time interval according to the encoding parameter and a preset data amount includes:
calculating a first acquisition time interval of each frame of video data according to the frame rate;
and calculating a first product of the first acquisition time interval and the preset data volume, and taking the first product as the sending time interval.
3. The method according to claim 1, wherein the encoding parameters include a code rate, the first video network terminal acquires the encoding parameters, and the step of determining the transmission time interval according to the encoding parameters and a preset data amount comprises:
calculating a second acquisition time interval of each bit of video data according to the code rate;
and calculating a second product of the second acquisition time interval and the preset data volume, and taking the second product as the sending time interval.
4. The method of claim 1, further comprising:
the second video network terminal stores the received video data to a preset receiving buffer area;
and the second video network terminal reads the video data from the receiving buffer area for decoding and playing according to the current data volume of the video data in the receiving buffer area.
5. The method according to claim 4, wherein the step of the second video network terminal reading the video data from the receiving buffer for decoding and playing according to the current data amount of the video data in the receiving buffer comprises:
the second video network terminal determines the current decoding time interval according to the current data volume of the video data in the receiving buffer area;
and the second video network terminal reads the video data from the receiving buffer area according to the current decoding time interval to decode and play.
6. The method of claim 5, wherein the step of determining, by the second video network terminal, the current decoding time interval according to the current data amount of the video data in the receiving buffer comprises:
and if the current data volume of the video data in the receiving buffer area is larger than the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a set numerical value as the current decoding time interval.
7. The method of claim 5, wherein the step of determining, by the second video network terminal, the current decoding time interval according to the current data amount of the video data in the receiving buffer comprises:
if the current data volume of the video data in the receiving buffer area is larger than the preset standard data volume and smaller than or equal to two times of the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a first set value as the current decoding time interval;
if the current data volume of the video data in the receiving buffer area is more than twice of the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a second set value as the current decoding time interval; wherein the first set value is less than the second set value.
8. The data processing device is applied to the video network, the video network comprises a video network terminal and a video network server, the video network terminal comprises a first video network terminal and a second video network terminal, and the first video network terminal comprises:
the sending buffer module is used for coding the collected video signals to obtain video data and storing the video data to a preset sending buffer area;
the determining module is used for acquiring coding parameters and determining a sending time interval according to the coding parameters and a preset data volume;
a reading module, configured to read the video data with the preset data amount from the sending buffer according to the sending time interval;
and the sending module is used for sending the read video data to the second video network terminal through the video network server through the video network.
9. The apparatus of claim 8, wherein the second video networking terminal comprises:
the receiving cache module is used for storing the received video data to a preset receiving buffer area;
and the receiving processing module is used for reading the video data from the receiving buffer area to decode and play according to the current data volume of the video data in the receiving buffer area.
10. The apparatus of claim 9, wherein the receive processing module comprises:
a decoding determining unit, configured to determine a current decoding time interval according to a current data amount of the video data in the receiving buffer;
and the processing unit is used for reading the video data from the receiving buffer zone according to the current decoding time interval to decode and play.
Technical Field
The present invention relates to the field of video networking technologies, and in particular, to a data processing method and a data processing apparatus.
Background
With the rapid development of network technologies, bidirectional video communication such as video conferences and video teaching is widely popularized in the aspects of life, work, learning and the like of users. In the video communication process, a terminal of a video sender collects videos and encodes the videos to obtain video data, and the video data is sent out, and a terminal of a video receiver receives the encoded video data, decodes the encoded video data and plays the decoded video data.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a data processing method and a corresponding data processing apparatus that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a data processing method, where the method is applied to a video network, the video network includes a video network terminal and a video network server, the video network terminal includes a first video network terminal and a second video network terminal, and the method includes:
the first video network terminal encodes the collected video signal to obtain video data and stores the video data to a preset sending buffer area;
the first video network terminal acquires coding parameters and determines a sending time interval according to the coding parameters and a preset data volume;
the first video network terminal reads the video data with the preset data volume from the sending buffer area according to the sending time interval;
and the first video network terminal sends the read video data to the second video network terminal through the video network via the video network server.
Preferably, the encoding parameter includes a frame rate, and the step of determining the transmission time interval according to the encoding parameter and a preset data amount, where the step of determining the transmission time interval includes: calculating a first acquisition time interval of each frame of video data according to the frame rate; and calculating a first product of the first acquisition time interval and the preset data volume, and taking the first product as the sending time interval.
Preferably, the encoding parameter includes a code rate, and the step of determining the transmission time interval according to the encoding parameter and a preset data amount, where the step of determining the transmission time interval includes: calculating a second acquisition time interval of each bit of video data according to the code rate; and calculating a second product of the second acquisition time interval and the preset data volume, and taking the second product as the sending time interval.
Preferably, the method further comprises: the second video network terminal stores the received video data to a preset receiving buffer area; and the second video network terminal reads the video data from the receiving buffer area for decoding and playing according to the current data volume of the video data in the receiving buffer area.
Preferably, the step of reading the video data from the receiving buffer for decoding and playing by the second video network terminal according to the current data volume of the video data in the receiving buffer comprises: the second video network terminal determines the current decoding time interval according to the current data volume of the video data in the receiving buffer area; and the second video network terminal reads the video data from the receiving buffer area according to the current decoding time interval to decode and play.
Preferably, the step of determining, by the second video network terminal, a current decoding time interval according to the current data amount of the video data in the receiving buffer includes: and if the current data volume of the video data in the receiving buffer area is larger than the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a set numerical value as the current decoding time interval.
Preferably, the step of determining, by the second video network terminal, a current decoding time interval according to the current data amount of the video data in the receiving buffer includes: if the current data volume of the video data in the receiving buffer area is larger than the preset standard data volume and smaller than or equal to two times of the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a first set value as the current decoding time interval; if the current data volume of the video data in the receiving buffer area is more than twice of the preset standard data volume, taking the value obtained by reducing the preset standard decoding time interval by a second set value as the current decoding time interval; wherein the first set value is less than the second set value.
On the other hand, the embodiment of the invention also discloses a data processing device, which is applied to the video network, wherein the video network comprises a video network terminal and a video network server, the video network terminal comprises a first video network terminal and a second video network terminal, and the first video network terminal comprises:
the sending buffer module is used for coding the collected video signals to obtain video data and storing the video data to a preset sending buffer area;
the determining module is used for acquiring coding parameters and determining a sending time interval according to the coding parameters and a preset data volume;
a reading module, configured to read the video data with the preset data amount from the sending buffer according to the sending time interval;
and the sending module is used for sending the read video data to the second video network terminal through the video network server through the video network.
Preferably, the second video network terminal includes: the receiving cache module is used for storing the received video data to a preset receiving buffer area; and the receiving processing module is used for reading the video data from the receiving buffer area to decode and play according to the current data volume of the video data in the receiving buffer area.
Preferably, the reception processing module includes: a decoding determining unit, configured to determine a current decoding time interval according to a current data amount of the video data in the receiving buffer; and the processing unit is used for reading the video data from the receiving buffer zone according to the current decoding time interval to decode and play.
In the embodiment of the invention, after a first video networking terminal codes a collected video signal to obtain video data, the video data is not directly sent out, but the video data is stored in a preset sending buffer area; then, acquiring coding parameters, and determining a sending time interval according to the coding parameters and a preset data volume; and then reading the video data with the preset data volume from the sending buffer area according to the sending time interval, and sending the read video data to a second video network terminal through a video network server. Therefore, in the embodiment of the invention, the sending buffer area is set, and the video data with the preset data volume is read from the sending buffer area every time according to the calculated sending time interval for sending, so that the uniformity and the stability of the sent video data can be ensured, the phenomenon of network packet loss caused by bandwidth limitation is avoided, and the phenomena of video playing blockage, image screen splash and the like of the second video networking terminal are further avoided.
Drawings
FIG. 1 is a schematic networking diagram of a video network of the present invention;
FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;
fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;
fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;
FIG. 5 is a flow chart of steps of a data processing method according to a first embodiment of the present invention;
FIG. 6 is a flowchart illustrating steps of a data processing method according to a second embodiment of the present invention;
fig. 7 is a block diagram of a data processing apparatus according to a third embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.
The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.
To better understand the embodiments of the present invention, the following description refers to the internet of view:
some of the technologies applied in the video networking are as follows:
network Technology (Network Technology)
Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network circuit Switching (circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.
Switching Technology (Switching Technology)
The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.
Server Technology (Server Technology)
The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.
Storage Technology (Storage Technology)
The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.
Network Security Technology (Network Security Technology)
The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.
Service Innovation Technology (Service Innovation Technology)
The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.
Networking of the video network is as follows:
the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.
As shown in fig. 1, the video network is divided into an access network and a metropolitan network.
The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.
The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.
Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.
The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.
The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.
Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.
The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.
Video networking device classification
1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.
1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).
The specific hardware structure of each access network device is as follows:
a node server:
as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;
the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.
The access switch:
as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink
wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.
The switching
if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;
if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.
The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.
The
Ethernet protocol conversion gateway：
As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink
Wherein, the data packet coming from the downlink
the downlink
The other modules in the ethernet protocol gateway function similarly to the access switch.
A terminal:
the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.
1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.
2. Video networking packet definition
2.1 Access network packet definition
The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.
As shown in the following table, the data packet of the access network mainly includes the following parts:
DA
SA
Reserved
Payload
CRC
wherein:
the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;
the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);
the reserved byte consists of 2 bytes;
the payload part has different lengths according to different types of data packets, and is 64 bytes if the data packet is a variety of protocol packets, and is 32+1024 or 1056 bytes if the data packet is a unicast data packet, of course, the length is not limited to the above 2 types;
the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.
2.2 metropolitan area network packet definition
The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.
In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.
As shown in the following table, the data packet of the metro network mainly includes the following parts:
DA
SA
Reserved
label (R)
Payload
CRC
Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.
Based on the characteristics of the video network, the data processing scheme provided by the embodiment of the invention follows the protocol of the video network, controls the transmission process of the video data in the video network and ensures the uniformity and stability of video data transmission.
- 上一篇：一种医用注射器针头装配设备
- 下一篇：一种视频显示内容的处理方法及终端设备