阅读说明：本技术 一种超高清视频分布式实时处理系统、方法、设备及介质 (Ultra-high-definition video distributed real-time processing system, method, equipment and medium ) 是由 郭廓 刘泽响 杨登科 王骁 周星 张晓琳 贺兆 于 2021-10-19 设计创作，主要内容包括：本发明提供了一种超高清视频分布式实时处理系统、方法、设备及介质,显示单元内设有若干触屏显示器,每个触屏显示器对应设有处理器,将处理器模块灵活配置到显示单元中的每个触屏显示器内,并减少处理单元中的处理器模块,在同等条件下,处理单元整体功耗得到下降,全链路视频处理延迟得到缩减；同时,解决了处理单元内多处理模块集中重复部署造成的散热问题和显示单元定制使用不灵活问题,与现有技术相比,本发明中内部插拔板卡数量减少,提及缩小,机箱工作温度降低,风冷噪声减小。(The invention provides a distributed real-time processing system, a distributed real-time processing method, distributed real-time processing equipment and a distributed real-time processing medium for ultra-high-definition videos, wherein a plurality of touch screen displays are arranged in a display unit, each touch screen display is correspondingly provided with a processor, a processor module is flexibly configured in each touch screen display in the display unit, the processor modules in the processing unit are reduced, the overall power consumption of the processing unit is reduced under the same condition, and the processing delay of full-link videos is reduced; meanwhile, the problems of heat dissipation and inflexible customization and use of the display unit caused by centralized and repeated deployment of the multi-processing modules in the processing unit are solved.)

1. The distributed real-time processing system for the ultra-high-definition video is characterized by comprising a display unit and a processing unit; the display unit is connected with the processing unit through a power supply; a plurality of touch screen displays are arranged in the display unit, wherein each touch screen display is correspondingly provided with a processor; a display control computer is arranged in the processing unit, and a processor is arranged in the display control computer.

2. The ultra high definition video distributed real-time processing system according to claim 1, wherein processors of a plurality of touch screen displays in the display unit are interconnected through a rear network interface.

3. The ultra high definition video distributed real-time processing system according to claim 1, wherein a central processing unit CPU, a graphics processing unit GPU, a field programmable gate array FPGA and a video processing SOC are further disposed in the processing unit.

4. The ultra-high-definition video distributed real-time processing system according to claim 1, wherein the field programmable gate array FPGA comprises a primary data preprocessing module, a secondary data preprocessing module, a tertiary data preprocessing module, a quaternary data preprocessing module and a character superimposing module;

the input end of the primary data preprocessing module is connected with the source video data output end, and the output end of the primary data preprocessing module is connected to the secondary data preprocessing module; the output end of the secondary data preprocessing module is connected to the tertiary data preprocessing module; the output end of the third-level data preprocessing module is connected to the fourth-level data preprocessing module; the output end of the four-level data preprocessing module is connected to the character superposition module; the output end of the character superposition module is connected to a touch screen display in the display unit.

5. An ultra high definition video distributed real-time processing method is realized by the ultra high definition video distributed real-time processing system of any one of claims 1 to 3, and is characterized by comprising the following specific steps:

acquiring primary video data and secondary video data;

the first-level video data are input into a display unit, and are displayed in a touch screen display after being processed by a plurality of processors in the display unit;

the secondary video data are input into the processing unit, the secondary video data are subjected to video data preprocessing in the processing unit to obtain video data, the video data are input into the display unit, and the video data are displayed in the touch screen display after being processed by the processors in the display unit.

6. The ultra high definition video distributed real-time processing method according to claim 5, wherein the primary video data comprises a conference video and a remote computer graphic image video; the secondary video data includes radar video and photo-electric video.

7. The distributed real-time processing method for ultra-high-definition videos according to claim 5, wherein the secondary video data is preprocessed in the processing unit through a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA) and a video processing System On Chip (SOC).

8. The distributed real-time processing method for the ultra-high definition video according to claim 7, wherein the field programmable gate array FPGA comprises a primary data preprocessing module, a secondary data preprocessing module, a tertiary data preprocessing module, a quaternary data preprocessing module and a character superposition module;

the primary data preprocessing module is used for cutting and preprocessing source video data;

the secondary data preprocessing module is used for channel configuration and double-rate synchronous dynamic random access memory DDR write control;

the third-level data preprocessing module is used for DDR read control and blocking cache of a double-rate synchronous dynamic random access memory;

the four-level data preprocessing module is used for preprocessing a K value;

the character superposition module is used for realizing video data through character superposition.

9. A display control computer apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the ultra high definition video distributed real-time processing method according to any one of claims 5 to 8 when executing the computer program.

10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the ultra high definition video distributed real-time processing method according to any one of claims 5 to 8.

Technical Field

The invention relates to the technical field of human-computer interaction video processing, in particular to an ultrahigh-definition video distributed real-time processing system, method, equipment and medium.

Background

The existing display control equipment is used for realizing transmission, processing and display of high-definition videos (with the resolution of 1600x1200) such as radar videos, photoelectric videos and computer network videos, can be divided into a processing unit and a display unit according to functions, and is a human-computer interaction platform comprising a display control computer and a plurality of touch displays. The video link content is displayed by the display unit after being processed by the processing unit in a centralized way. The conversion between a rectangular coordinate system and a polar coordinate system in PPI requirements is processed through a DSP chip which is imported from a processing unit, a plurality of video sources are gated through digital and analog switches, and video processing functions such as coding, decoding, overlapping, splicing and the like are realized through digital processing software. The display and control device is composed of a schematic diagram as shown in fig. 1.

With the rapid iteration of the electronic information technology, computer display gradually develops to ultra-high-definition display (resolution 3840x2160), the data volume increases in a geometric series manner, the number of display terminals is more, the pixel clock frequency of original video data is greatly improved, the ultra-high-definition video data is processed by using the original video processing mode, and the processing delay is obviously increased.

Disclosure of Invention

Aiming at the problems of heat dissipation and inflexible customization and use of a display unit in the centralized and repeated arrangement of a plurality of processing modules in a processing unit of display control equipment in the prior art, the invention provides an ultrahigh-definition video distributed real-time processing system, method, equipment and medium.

The invention is realized by the following technical scheme:

a distributed real-time processing system for ultra-high-definition videos comprises a display unit and a processing unit; the display unit is connected with the processing unit through a power supply; a plurality of touch screen displays are arranged in the display unit, wherein each touch screen display is correspondingly provided with a processor; a display control computer is arranged in the processing unit, and a processor is arranged in the display control computer.

Preferably, the processors of the touch screen displays in the display unit are interconnected through a rear network interface.

Preferably, the processing unit is also internally provided with a central processing unit CPU, a graphic processing unit GPU, a field programmable gate array FPGA and a video processing SOC.

Preferably, the field programmable gate array FPGA comprises a first-level data preprocessing module, a second-level data preprocessing module, a third-level data preprocessing module, a fourth-level data preprocessing module and a character superposition module;

the input end of the primary data preprocessing module is connected with the source video data output end, and the output end of the primary data preprocessing module is connected to the secondary data preprocessing module; the output end of the secondary data preprocessing module is connected to the tertiary data preprocessing module; the output end of the third-level data preprocessing module is connected to the fourth-level data preprocessing module; the output end of the four-level data preprocessing module is connected to the character superposition module; the output end of the character superposition module is connected to a touch screen display in the display unit.

A distributed real-time processing method for ultra-high-definition videos is realized by the ultra-high-definition video distributed real-time processing system, and comprises the following specific steps:

acquiring primary video data and secondary video data;

the first-level video data are input into a display unit, and are displayed in a touch screen display after being processed by a plurality of processors in the display unit;

the secondary video data are input into the processing unit, the secondary video data are subjected to video data preprocessing in the processing unit to obtain video data, the video data are input into the display unit, and the video data are displayed in the touch screen display after being processed by the processors in the display unit.

Preferably, the primary video data comprises conference video and remote computer graphic image video; the secondary video data includes radar video and photo-electric video.

Preferably, the secondary video data is preprocessed in the processing unit through a central processing unit CPU, a graphics processing unit GPU, a field programmable gate array FPGA, and a video processing SOC.

Furthermore, the field programmable gate array FPGA comprises a primary data preprocessing module, a secondary data preprocessing module, a tertiary data preprocessing module, a quaternary data preprocessing module and a character superposition module;

the primary data preprocessing module is used for cutting and preprocessing source video data;

the secondary data preprocessing module is used for channel configuration and DDR (double data rate) write control of the DDR;

the third-level data preprocessing module is used for DDR read control and blocking cache of the double-rate synchronous dynamic random access memory;

the four-level data preprocessing module is used for preprocessing a K value;

the character superposition module is used for realizing video data by character superposition.

A display control computer device comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor executes the computer program to realize the steps of the ultra-high definition video distributed real-time processing method.

A computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the ultra high definition video distributed real-time processing method as described above.

Compared with the prior art, the invention has the following beneficial technical effects:

the invention provides an ultra-high-definition video distributed real-time processing system.A plurality of touch screen displays are arranged in a display unit, each touch screen display is correspondingly provided with a processor, a processor module is flexibly configured in each touch screen display in the display unit, the processor modules in the processing unit are reduced, the overall power consumption of the processing unit is reduced under the same condition, and the processing delay of a full-link video is reduced; meanwhile, the problems of heat dissipation and inflexible customization and use of the display unit caused by centralized and repeated deployment of the multi-processing modules in the processing unit are solved.

Furthermore, the high-speed concurrent programmable processing characteristic of the field programmable gate array FPGA is fully utilized, and an external high-speed network interface is combined, so that the effects of flexible online configuration of the FPGA and real-time processing of the ultra-high-definition video according to the requirement are achieved;

the invention provides a distributed real-time processing method for ultra-high-definition videos, which comprises the steps of obtaining primary video data and secondary video data, inputting the primary video data into a display unit for displaying after video data processing, inputting the secondary video data into a processing unit for video data preprocessing, generating video data, inputting the video data into the display unit for processing and displaying; the invention realizes software and hardware adaptation and engineering application verification based on nationwide productization basic software and hardware, and realizes distributed real-time processing and comprehensive display of the ultra-high-definition video supporting software definition multi-source rapid switching.

Drawings

FIG. 1 is a schematic diagram of centralized video processing of a display control device in the prior art

FIG. 2 is a schematic diagram of an ultra high definition video distributed real-time processing system according to the present invention;

fig. 3 is a schematic view of the field programmable gate array FPGA video preprocessing in the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The invention is described in further detail below with reference to the accompanying drawings:

referring to fig. 2, the present invention provides an ultra high definition video distributed real-time processing system, in which the system structure effectively allocates processors, solves the problem of heat dissipation, effectively reduces the overall power consumption of the processing unit, and effectively reduces the delay of full link video processing.

Specifically, the ultrahigh-definition video distributed real-time processing system comprises a display unit and a processing unit; the display unit is connected with the processing unit through a power supply; a plurality of touch screen displays are arranged in the display unit, wherein each touch screen display is correspondingly provided with a processor; a display control computer is arranged in the processing unit, and a processor is arranged in the display control computer.

Specifically, processors of a plurality of touch screen displays in the display unit are interconnected through a rear network interface.

Specifically, the processing unit is also internally provided with a central processing unit CPU, a graphic processing unit GPU, a field programmable gate array FPGA and a video processing SOC.

Specifically, the field programmable gate array FPGA comprises a primary data preprocessing module, a secondary data preprocessing module, a tertiary data preprocessing module, a quaternary data preprocessing module and a character superposition module;

as shown in fig. 3, the input end of the primary data preprocessing module is connected to the source video data output end, and the output end of the primary data preprocessing module is connected to the secondary data preprocessing module; the output end of the secondary data preprocessing module is connected to the tertiary data preprocessing module; the output end of the third-level data preprocessing module is connected to the fourth-level data preprocessing module; the output end of the four-level data preprocessing module is connected to the character superposition module; the output end of the character superposition module is connected to a touch screen display in the display unit.

In summary, the present invention provides an ultra-high-definition video distributed real-time processing system, wherein a display unit is internally provided with a plurality of touch screen displays, each touch screen display is correspondingly provided with a processor, a processor module is flexibly configured in each touch screen display in the display unit, and the processor modules in the processing unit are reduced, under the same condition, the overall power consumption of the processing unit is reduced, and the full-link video processing delay is reduced; meanwhile, the problems of heat dissipation and inflexible customization and use of the display unit caused by centralized and repeated deployment of the multiprocessing modules in the processing unit are solved.

The following is an embodiment of the method, which is implemented by the ultra high definition video distributed real-time processing system, and includes the following specific steps:

acquiring primary video data and secondary video data;

the first-level video data are input into a display unit, and are displayed in a touch screen display after being processed by a plurality of processors in the display unit;

the secondary video data are input into the processing unit, the secondary video data are subjected to video data preprocessing in the processing unit to obtain video data, the video data are input into the display unit, and the video data are displayed in the touch screen display after being processed by the processors in the display unit.

The first-level video data comprises a conference video and a far-end computer graphic image video; the secondary video data includes radar video and photo-electric video.

Specifically, the secondary video data is preprocessed in the processing unit through the central processing unit CPU, the graphics processing unit GPU, the field programmable gate array FPGA, and the video processing SOC.

According to fig. 3, the FPGA includes a first-level data preprocessing module, a second-level data preprocessing module, a third-level data preprocessing module, a fourth-level data preprocessing module, and a character superimposing module;

the primary data preprocessing module is used for cutting and preprocessing source video data;

the secondary data preprocessing module is used for channel configuration and DDR (double data rate) write control of the DDR;

the third-level data preprocessing module is used for DDR read control and blocking cache of the double-rate synchronous dynamic random access memory;

the four-level data preprocessing module is used for preprocessing a K value;

the character superposition module is used for realizing video data by character superposition.

The processing unit operates on the basis of national basic software and hardware platforms, and adopts a heterogeneous main processor and auxiliary processor dual-mode cooperative PPI display optimization method; the processing unit carries out multi-level data preprocessing based on the FPGA, selects pixel point assignment conforming to a specified preprocessing K value algorithm, and improves the operation efficiency by adopting a method of defining a dynamic sector area; the display switching can be rapidly carried out on multiple ultrahigh-definition video sources in the display unit.

The method comprises the steps of classifying video data signals when video data are obtained, and selecting a video processor with a proper designated part for video processing, wherein the video data are classified into primary video data and secondary video data according to inherent characteristics of ultra-high-definition video signals, and the primary video data comprise a conference video and a far-end computer graphic image video; the secondary video data includes radar video and photo-electric video.

The method for fast switching the buffer multi-element ultrahigh-definition video based on the high-capacity dynamic memory externally hung on the video processor in the display unit stably and quickly selects the data processing channel of the display unit and the processing unit according to the requirement of a user to display the ultrahigh-definition video.

In the processing unit, the parallel processing capability of a GPU (graphics processing Unit) is utilized, dual-mode PPI (Radar radial annular display) is realized in a fragment shader through OpenG1 color mixing, point-by-point blanking and ultra-high definition display are realized, the load of a CPU (Central processing Unit) end is reasonably lightened, and the long-term reliable operation of the whole system is ensured.

In yet another embodiment of the present invention, a display control computer apparatus is provided, the computer apparatus comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program comprising program instructions, the processor being configured to execute the program instructions stored by the computer storage medium. The Processor may be a Central Processing Unit (CPU), or may be other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable gate array (FPGA) or other Programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc., which is a computing core and a control core of the terminal, and is adapted to implement one or more instructions, and is specifically adapted to load and execute one or more instructions to implement a corresponding method flow or a corresponding function; the processor provided by the embodiment of the invention can be used for the operation of the ultra-high-definition video distributed real-time processing method.

In yet another embodiment of the present invention, the present invention further provides a storage medium, specifically a computer-readable storage medium (Memory), which is a Memory device in a computer device and is used for storing programs and data. It is understood that the computer readable storage medium herein can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space storing an operating system of the terminal. Also, one or more instructions, which may be one or more computer programs (including program code), are stored in the memory space and are adapted to be loaded and executed by the processor. It should be noted that the computer-readable storage medium may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), such as at least one disk memory. One or more instructions stored in the computer-readable storage medium may be loaded and executed by the processor to implement the corresponding steps of the distributed real-time processing method for ultra-high-definition video in the above embodiments.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting the same, and although the present invention is described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.