阅读说明：本技术 视频数据处理方法及装置 (Video data processing method and device ) 是由 彭鹏 于 2021-09-16 设计创作，主要内容包括：本发明提供一种视频数据处理装置,其包括一处理器及一叠加电路。处理器根据一第一通道识别信号提供一第一组参数,并根据一第二通道识别信号提供一第二组参数。叠加电路根据该第一组参数于一第一时间点将一第一图像叠加于一第一视频资料中,且根据该第二组参数于一第二时间点将一第二图像叠加于一第二视频资料中。该第一时间点与该第二时间点间的时间差小于该第一视频数据的一帧间隔。本发明的视频数据处理方法及装置,可透过软件分时复用硬件以在多个视频数据中叠加不同的图像,以提升图像叠加的效率及硬件的使用率。(The invention provides a video data processing device which comprises a processor and a superposition circuit. The processor provides a first set of parameters according to a first channel identification signal and a second set of parameters according to a second channel identification signal. The superimposing circuit superimposes a first image on a first video data at a first time point according to the first set of parameters, and superimposes a second image on a second video data at a second time point according to the second set of parameters. The time difference between the first time point and the second time point is smaller than one frame interval of the first video data. The video data processing method and the device can superpose different images in a plurality of video data through software time division multiplexing hardware so as to improve the efficiency of image superposition and the utilization rate of the hardware.)

1. A method of processing video data, comprising:

providing a lookup table, wherein the lookup table comprises a corresponding relation between a first channel identification signal and a first group of parameters and a corresponding relation between a second channel identification signal and a second group of parameters;

querying the lookup table according to the first channel identification signal to write the first set of parameters into a register of a superposition circuit;

superimposing, by using the superimposing circuit, a first image on a first video data at a first time point according to the first set of parameters;

querying the lookup table according to the second channel identification signal to write the second set of parameters to a register of the overlay circuit; and

superimposing, by using the superimposing circuit, a second image on a second video material at a second time point according to the second set of parameters;

wherein a time difference between the first time point and the second time point is smaller than a one-frame interval of the first video data.

2. The method of claim 1, wherein the superimposing circuit takes a first processing time to superimpose the first image on the first video data and a second processing time to superimpose the second image on the second video data, wherein a sum of the first processing time and the second processing time is less than the frame interval.

3. The method of claim 1, wherein the second set of parameters is written to a register of the overlay circuit in an operation of the overlay circuit that is overlaying the first image on the first video data.

4. The method of claim 1, wherein the lookup table further comprises a correspondence between the first channel identification signal and a first frame buffer interface in the Linux system.

5. The method of claim 1, wherein the lookup table is disposed in a virtual channel layer of a software, and the virtual channel layer is disposed between a service logic layer and a hardware driver layer of the software.

6. The method of claim 1, wherein the first set of parameters comprises a location of the first image in a memory, a size of the first image, and a starting location where the first image is superimposed on the first video data.

7. The video data processing apparatus of claim 1, wherein the first time point corresponds to a first frame synchronization signal and the second time point corresponds to a second frame synchronization signal.

8. A video data processing apparatus, characterized in that it comprises:

a processor for providing a first set of parameters according to a first channel identification signal and a second set of parameters according to a second channel identification signal; and

an overlay circuit for overlaying a first image on a first video data at a first time point according to the first set of parameters, and overlaying a second image on a second video data at a second time point according to the second set of parameters;

wherein a time difference between the first time point and the second time point is smaller than a one-frame interval of the first video data.

9. The video data processing apparatus of claim 8, wherein the overlay circuit takes a first processing time to overlay the first image on the first video data, and the overlay circuit takes a second processing time to overlay the second image on the second video data, wherein a sum of the first processing time and the second processing time is less than the frame interval.

10. The video data processing apparatus of claim 8, wherein the processor writes the second set of parameters to a register used to control the overlay circuit prior to the second point in time.

11. The video data processing apparatus according to claim 8, wherein the first channel identification signal corresponds to a first frame buffer interface in the Linux system, and the second channel identification signal corresponds to a second frame buffer interface in the Linux system.

12. The video data processing apparatus of claim 11, wherein the processor queries a look-up table for the first set of parameters based on the first channel identification signal.

13. The apparatus according to claim 12, wherein the look-up table comprises a correspondence between the first channel identification signal and the first frame buffer interface and the first set of parameters.

14. The device of claim 13, wherein the first set of parameters comprises a location of the first image in a memory, a size of the first image, and a starting location where the first image is superimposed on the first video data.

15. The apparatus of claim 8, wherein the first channel identification signal corresponds to a frame buffer interface in a Linux system, and the second channel identification signal corresponds to a local module interface.

16. The video data processing apparatus of claim 8, wherein the first time point corresponds to a first frame synchronization signal and the second time point corresponds to a second frame synchronization signal.

17. The video data processing apparatus of claim 8, further comprising:

the zooming circuit is used for zooming the first video data so as to output the processed first video data to the superposition circuit;

wherein the first set of parameters includes parameters that control the scaling circuit.

Technical Field

The invention relates to the field of video data processing, in particular to a processing method and a processing device for overlaying images on video data.

Background

A Frame buffer (Frame buffer) interface is an interface provided by the Linux system for the display device, through which a user can directly read and write the display buffer and display the display buffer on the display device. In an embedded Linux product, the bottom layers of graphical interfaces such as QT, Minigui, Android surface flag, DirectFb, etc. are all connected to a Frame buffer interface, and related hardware driving layers can be controlled through the Frame buffer interface, so as to realize functions such as display or image superposition.

In a Linux system, a frame buffer interface corresponds to hardware through a hardware driver layer, for example, when image superposition processing is performed through the frame buffer interface, one frame buffer interface corresponds to one superposition circuit, under the condition, one superposition circuit can only process one path of video data, and when a plurality of video data are to be processed at the same time, the processing can be realized by a plurality of sets of superposition circuits, so that considerable hardware cost is consumed.

Disclosure of Invention

The invention provides a video data processing method and device, which can superpose different images in a plurality of video data through software time division multiplexing hardware so as to improve the efficiency of image superposition and the utilization rate of the hardware.

An embodiment of the present invention provides a video data processing method, including: providing a lookup table, wherein the lookup table comprises a corresponding relation between a first channel identification signal and a first group of parameters and a corresponding relation between a second channel identification signal and a second group of parameters; querying the lookup table according to the first channel identification signal to write the first set of parameters into a register of a superposition circuit; superimposing a first image on a first video data at a first time point according to the first set of parameters by using the superimposing circuit; querying the lookup table according to the second channel identification signal to write the second set of parameters into a register of the overlay circuit; and superimposing a second image on a second video data at a second time point according to the second set of parameters by using the superimposing circuit; wherein a time difference between the first time point and the second time point is smaller than a frame interval of the first video data.

Another embodiment of the present invention provides a video data processing apparatus, which includes a processor and a superimposing circuit. The processor provides a first set of parameters according to a first channel identification signal and a second set of parameters according to a second channel identification signal. The superimposing circuit superimposes a first image on a first video data at a first time point according to the first set of parameters, and superimposes a second image on a second video data at a second time point according to the second set of parameters. The time difference between the first time point and the second time point is smaller than one frame interval of the first video data.

The software system architecture and the video data processing device of the invention realize that different buffer interfaces and/or contents corresponding to area module interfaces are superposed on multi-path video data through the software time-sharing multiplexing hardware circuit by arranging the virtual channel layer in the software architecture, thereby greatly improving the utilization rate of hardware.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained according to the drawings without inventive labor.

FIG. 1 is a diagram of a software system architecture according to an embodiment of the present invention;

FIG. 2 is a block diagram of a video data processing apparatus according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of an application scenario according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a software configuration for implementing the application scenario of FIG. 3;

fig. 5 is a block diagram of a video data processing apparatus according to another embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The invention provides a software system architecture, which controls a hardware circuit by software to achieve time division multiplexing of the hardware circuit and achieve the purpose of processing a plurality of video data by a set of hardware circuit. Referring to fig. 1, fig. 1 is a schematic diagram of a software system architecture according to an embodiment of the present invention. As shown in fig. 1, the software system architecture 100 includes a hardware driver layer 10, a virtual channel layer 20, a business logic layer 30, and a user layer 40. The software architecture 100 may be implemented in a video data processing apparatus. Referring to fig. 2, fig. 2 is a block diagram illustrating a video data processing apparatus according to an embodiment of the present invention. The video data processing apparatus 200 includes a processor 21, an image processing circuit 22, a graphics engine 23, a superimposing circuit 24, a memory interface 25, and a memory 26. The following description will take the scenario where the software system architecture 100 is applied to the video data processing apparatus 200 as an example to illustrate the operation of each layer.

The hardware driver layer 10 is used for setting configuration parameters of hardware components, such as the image processing circuit 22 and the overlay circuit 24, to control operations of the hardware components. In one embodiment, the hardware driver layer 10 sets the configuration parameters of each hardware component in the register corresponding to each hardware component. Taking the overlay circuit 24 as an example, the configuration parameters include the physical address of the image data in the memory 26, the size, format, display position, transparency, etc. these parameters can be used by an Application Programming Interface (API) to the upper layer.

The virtual channel layer 20 may utilize virtual channels to set and manage configuration parameters of the hardware, each channel may correspond to a set of configuration parameters, and multiple channels may be utilized to provide multiple different sets of configuration parameters for the same hardware, for example, multiple channels may be utilized to provide multiple different sets of configuration parameters to the overlay circuit 24. In one embodiment, the virtual channel layer 20 includes a lookup table, which includes a correspondence between a channel number of each channel and a corresponding configuration parameter and parameter data, for example, the lookup table includes a physical address of the image data corresponding to each channel in the memory 26, a size, a format, a display position, a transparency, and a video data source. In one embodiment, the lookup table further comprises a correspondence relationship between each channel and a frame buffer interface and/or a region (region) module interface of an upper layer. The software system of the video data processing apparatus 200 may use the channel number as the channel identification signal, so as to query the lookup table by using the channel number of each channel to obtain the corresponding configuration parameters and the related data.

The processing principle of multi-channel video data is based on the fact that video frames on a plurality of different channels can be processed simultaneously within a period of time (e.g., one frame interval or frame period) if the hardware processing speed is sufficiently fast. Taking 30fps (frames per second) video data as an example, as long as the time for processing one frame of data by hardware is less than 16 milliseconds, the hardware has the capability of processing two frames of video in 33 milliseconds, and the faster the processing speed, the more video data paths can be processed. In the software system of the prior art, the upper application software directly utilizes the application programming interface of the hardware driver layer 10 to control the overlay circuit 24 to overlay an image in one path of video data, but when multiple paths of video data are processed simultaneously, the overlay circuit 24 cannot distinguish which video data need to be overlaid or not overlaid with the image. Therefore, the invention introduces the concept of channel management, which manages the memory data and related settings for the images to be overlaid in units of channels by means of virtual channels, and virtualizes them as a special application programming interface for the upper layer. By setting the virtual channel layer, the video data processing apparatus 200 performs image overlay processing on multiple paths of video data within a frame interval or a time interval of a frame period by using an overlay circuit 24. In one embodiment, the virtual channel layer 10 receives the synchronization signal V each time_SYNCThen, it will be determined which channel is to be overlapped next according to the mark of the channel in the next video frame data, then the lookup table is queried by the channel number to obtain the configuration parameter related to the channel, and the next synchronization signal V is generated_SYNCThe queried configuration parameters are previously written to registers of overlay circuit 24.

The service logic layer 30 includes two parts, one part is a service logic of a Frame buffer (Frame buffer) interface of a standard Linux system, and this part sets a corresponding relationship between each Frame buffer interface and each channel in the virtual channel layer 20. The other part is service logic related to a local (region) module interface of the video data processing apparatus 200, which sets a corresponding relationship between each local module interface and each channel in the virtual channel layer 20. For example, frame buffer interface 1(/ dev/fb1) may correspond to lane 1, frame buffer interface 2(/ dev/fb2) corresponds to lane 2, and zone module interface 1(region 1) corresponds to lane 3. In an embodiment, the lookup table in the virtual channel layer 20 may include a frame buffer interface of each channel and a hardware driver layer 10 related setting corresponding to each local module interface, and a user may set a default initialization state of the virtual channel layer 20 channel corresponding to the frame buffer interface through a specific configuration file, and during an initialization process of a software system of the video data processing apparatus 200, the corresponding relationship and the related setting between each frame buffer interface and each local module interface and the channel may be set through an application programming interface of the virtual channel layer 20.

User layer 40 is used to let a user invoke software functions and/or hardware components in video data processing device 200 to achieve a particular application scenario. In an embodiment, the User layer 40 may overlay a User Interface (UI) On the video data through the frame buffer Interface, and the User layer 40 may overlay an image On the video data through the region module Interface to realize an On-Screen Display (OSD) function. The software architecture 100 allows the user layer 40 to time-multiplex multiple channels in a software overlay image of multiple video data for display through the local module interface by configuring the virtual channel layer 20. Similarly, the user layer 40 may time multiplex the channels in software via the frame buffer interface to display different content on different channels.

Referring to fig. 3, fig. 3 is a schematic view of an application scenario according to an embodiment of the invention. How the application scenario shown in fig. 3 is implemented with the video data processing apparatus 200 having the software system architecture 100 will be described below.

Referring to fig. 4, fig. 4 is a schematic diagram of a software configuration for implementing the application scenario of fig. 3. As shown in FIG. 4, the software configuration of the system includes the configuration parameters of channel 1 and channel 2, the frame buffer interface 1(/ dev/fb1) corresponds to channel 1, the frame buffer interface 2(/ dev/fb2) corresponds to channel 2, and the configuration parameters of the channel 1 and channel 2 and the corresponding relationship between the frame buffer interface 1 and the frame buffer interface 2 are recorded in the lookup table of the virtual channel layer 20. The image UI _1 in the user layer 40 is superimposed using the frame buffer interface 1, and the figureLike UI _2 uses the frame buffer interface 2 for superposition. In this example, channel 1 is used to overlay image UI _1 onto video data V_{in_1}Channel 2 is used to overlay image UI _2 to video data V_{in_2}In (1), the configuration parameters of channel 1 include video data V_{in_1}Memory address and video size of (1), memory address of image UI _1, image size and format, and overlay position (e.g. overlay of image UI _1 on video data V)_{in_1}Start position of) transparency, etc. The configuration parameters of channel 2 comprise video data V_{in_2}Memory address and video size of image UI _2, memory address of image UI _2, image size and format, etc. The configuration parameters and the corresponding relationships can be configured through the configuration profile during the initialization process of the software system. In operation, channel 1 is processed before channel 2, when the overlay driver receives the synchronization signal V_{SYNC 1}The configuration parameters for channel 1 are written to registers in overlay circuit 24. In the presence of a synchronization signal V_{SYNC 1}Then, when the overlay circuit driving software receives the synchronous signal V_{SYNC 2}At this time, the configuration parameters corresponding to the channel 2 are written into the register of the overlay circuit 24, and the overlay circuit 24 completes the overlay operation. In one embodiment, the synchronization signal V_{SYNC 1}And a synchronization signal V_{SYNC 2}May be video data V_{in_1}And/or video data V_{in_2}The frame synchronization signal is used to instruct the overlay circuit to complete the overlay of a frame of image. In one embodiment, the synchronization signal V_{SYNC 1}And a synchronization signal V_{SYNC 2}For instructing the video data processing apparatus 200 to complete displaying a frame of image.

In one embodiment, processor 21 executes program code to run a software system having software system architecture 100. In operation O10, an image sensor (not shown) is used to perform image sensing to obtain sensed data S, in this embodiment, the image sensor is disposed outside the video data processing apparatus 200 and electrically connected to the video data processing apparatus 200 through the connection interface, and the sensed data S is 30 images per second with a resolution of 1920 × 1080. In operation O20, the image processing circuit 22 receives the sensing data S and maps the sensing data SImage processing to output video data V_{in_1}And video data V_{in_2}. In an embodiment, the image processing performed by the image processing circuit 22 on the sensing data S may include: denoising processing, brightness adjustment, color adjustment, image size scaling and the like. In this embodiment, video data V_{in_1}Has a resolution of 320 x 240, and video data V_{in_2}Has a resolution of 1920 x 1080, and the image processing circuit 22 configures the video data V according to a software configuration_{in_1}The memory address of (A) stores the video data V_{in_1}Stores it in the memory 26 and assigns the video data V according to the configuration_{in_2}The memory address of (A) stores the video data V_{in_2}Stored to the memory 26.

In operation O30, the processor 21 controls the overlay circuit 24 via overlay circuit driver software in the hardware driver layer 10, and receives the synchronization signal V when the overlay circuit 24 or the overlay circuit driver software receives the synchronization signal V at the time point T0_{SYNC 1}The processor 21 confirms that the channel 1 is to be subjected to the overlay processing next according to the lookup table of the virtual channel layer 20, and the overlay circuit driving software sets the configuration parameters corresponding to the channel 1 into the register of the overlay circuit 24 according to the lookup table. As described above, channel 1 is used to overlay image UI _1 onto video data V_{in_1}In the above embodiment, the overlay circuit 24 reads the video data V from the memory 26 according to the setting values in the registers_{in_1}And an image UI _1 and performs an overlay process 1 to generate video data V_{out_1}. In one embodiment, when the overlay circuit 24 or overlay circuit driver software receives the synchronization signal V_{SYNC 2}The superimposing circuit 24 performs the superimposing of the image UI _1 to the video data V_{in_1}While the superimposing circuit 24 takes the processing time TP1 to complete the superimposing process 1. In an embodiment, before the overlay circuit 24 performs the overlay process 1, the graphic engine 23 performs drawing of the image UI _1, and stores the drawn image UI _1 in the memory 26, where the image UI _1 is used to display information such as time and power parameters, and a storage address of the image UI _1 in the memory 26 corresponds to a memory address of the image UI _1 in the lookup table. In operation O40, the video data processing apparatus 200 processes the video data V_{out_1}Output to a display (not shown) for displayShown in the figure.

In operation O50, when the overlay circuit 24 or the overlay circuit driver software receives the synchronization signal V at time T1_{SYNC 2}The processor 21 confirms that the channel 2 is to be subjected to the overlay processing 2 next according to the lookup table of the virtual channel layer 20, and the overlay circuit driving software sets the configuration parameters of the corresponding channel 2 into the register of the overlay circuit 24 according to the lookup table. As described above, channel 2 is used to overlay image UI _2 onto video data V_{in_2}In the above embodiment, the overlay circuit 24 reads the video data V from the memory 26 according to the setting values in the registers_{in_2}And an image UI _2 and performs an overlay process 2 to generate video data V_{out_2}. In an embodiment, before the overlay circuit 24 performs the overlay process 2, the graphic engine 23 performs a rendering process on the image UI _2, and stores the rendered image UI _2 into the memory 26, where the image UI _2 is used to display information such as time and date, and a storage address of the image UI _2 in the memory 26 corresponds to a memory address of the image UI _2 in the lookup table. In one embodiment, the synchronization signal V_{SYNC 2}For triggering the superimposing circuit 24 to perform superimposing the image UI _1 on the video data V at the time point T1_{in_1}In the overlay process 1, the overlay circuit 24 or the overlay circuit driver software receives the synchronization signal V at the time point T2_{SYNC 3}Synchronous signal V_{SYNC 3}For triggering the superimposing circuit 24 to perform superimposing the image UI _2 on the video data V at the time point T2_{in_2}The superimposing circuit 24 takes the processing time TP2 to complete the superimposing process 2, that is, the superimposing circuit driving software sets the configuration parameters of the corresponding channel 2 into the register of the superimposing circuit 24 while the superimposing circuit 24 is performing the superimposing process 1. By such a mechanism, when the superimposing circuit 24 completes superimposing the image UI _1 on the video data V_{in_1}The superimposition processing 1 of (2) can be immediately followed by the superimposition of the image UI _2 on the video data V_{in_2}The superimposition processing 2 of (2) does not need to wait for the time for setting the configuration parameters of the channel 2 in the register of the superimposition circuit 24.

In one embodiment, video data V_{in_1}And video data V_{in_2}30 images per second (30 FPS), video data V_{in_1}Is displayed in a frameThe period or interval between two adjacent frames is 33 milliseconds (ms), and likewise, the video data V_{in_2}Is also 33 milliseconds or the interval between two adjacent frames. The performance of the overlay circuit 24 is required to satisfy the requirement that the processing time TP1 plus the total processing time TP2 is less than 33 ms, and the time difference between the time point T2 and the time point T1 is also less than 33 ms, and in a preferred embodiment, the time difference between the time point T2 and the time point T1 is less than 16.5 ms (i.e., half the interval between two adjacent frames). The invention realizes that two paths of video data (such as video data V in the embodiment) are processed by the same superposition circuit by arranging the virtual channel layer 20 in the software system, respectively corresponding the channel 1 and the channel 2 to two groups of different configuration parameters, utilizing the superposition circuit 24 with better processing efficiency and utilizing the software time-sharing multiplexing superposition circuit 24_{in_1}And video data V_{in_2}) The use of (1).

In operation O60, the video data processing apparatus 200 utilizes an encoder (not shown) to encode the video data V_{out_2}Performing an encoding process to generate encoded data V_ed. The encoding process is, for example, an image encoding process according to video encoding standard h.264 or h.265. In operation O70, the video data processing apparatus 200 utilizes a transmission interface (not shown) to encode data V_edAnd (5) transmitting the data. In one embodiment, the transport interface encodes the data V according to a Real Time Streaming Protocol (RTSP)_edAnd (5) transmitting the data.

Referring to fig. 5, fig. 5 is a block diagram illustrating a video data processing apparatus according to another embodiment of the present invention. Compared to the video data processing apparatus 200 of fig. 2, the video data processing apparatus 500 further includes a scaling circuit 57. The scaling circuit is disposed before the superimposing circuit 24. When the software architecture 100 is applied to the scene of the video data processing apparatus 500, the virtual channel layer 20 further utilizes the channels to provide different sets of configuration parameters to the scaler 57, in addition to utilizing the channels to provide different sets of configuration parameters to the overlay circuit 24 by the virtual channel layer 20. In one embodiment, the lookup table in the virtual channel layer 20 includes the corresponding relationship between the channel number of each channel and the configuration parameter corresponding to the scaling circuit 57 and the number of parametersAnd the corresponding relationship between the channel number of each channel and the configuration parameter corresponding to the superimposing circuit 24, and the parameter data. For example, the lookup table in the software configuration of FIG. 4 may further include configuration parameters of the scaler 57 corresponding to channel 1 for controlling the scaler 57 to apply the video data V_{in_1}Performing scaling, the lookup table also includes configuration parameters of the scaling circuit 57 corresponding to channel 2 for controlling the scaling circuit 57 to apply the video data V_{in_2}And carrying out scaling processing. In operation, when the hardware driving layer 10 receives the synchronization signal V_{SYNC 1}At this time, the configuration parameters corresponding to channel 1 are written into the respective registers of scaler 57 and overlay circuit 24. The scaling circuit 57 accordingly scales the video data V_{in_1}The video data after scaling processing is output to the superimposing circuit 24 for superimposing processing. In the presence of a synchronization signal V_{SYNC 1}Then, when the hardware driving layer 10 receives the synchronization signal V_{SYNC 2}At this time, the configuration parameters corresponding to channel 2 are written into the respective registers of scaler 57 and overlay circuit 24. The scaling circuit 57 accordingly scales the video data V_{in_2}The video data after scaling processing is output to the superimposing circuit 24 for superimposing processing. The performance of the scaling circuit 57 is required to complete the video data V in the interval between two adjacent frames_{in_1}And video data V_{in_2}And (4) scaling processing. In a preferred embodiment, scaler 57 completes the video data V_{in_1}And video data V_{in_2}The time required for the scaling process of (1) and the time required for the superimposing circuit 24 to complete the superimposing process 1 and the superimposing process 2 are shorter than the interval time (33 msec in this example) between two adjacent frames.

In the embodiments of fig. 3 and 4, the software system architecture and the video data processing apparatus of the present invention can process two video data through the same overlay circuit by software time-division multiplexing, and under the permission of hardware performance condition, the software system architecture and the video data processing apparatus of the present invention can process more than two video data through the same hardware circuit by software time-division multiplexing. In the embodiments of fig. 3 and 4, the channel 1 and the channel 2 are both corresponding to the frame buffer interface, and in practice, each channel may select the corresponding frame buffer interface or the local module interface.

In summary, the software system architecture and the video data processing apparatus of the present invention implement the purpose of superimposing the content corresponding to the different buffer interfaces and/or the area module interfaces on the multi-channel video data through the software time division multiplexing hardware circuit by setting the virtual channel layer in the software architecture, thereby greatly increasing the utilization rate of the hardware and achieving the effect of displaying OSD/UI through multiple windows.

Although the embodiments of the present invention have been described above, these embodiments are not intended to limit the present invention, and those skilled in the art can apply variations to the technical features of the present invention according to the explicit or implicit contents of the present invention, and all such variations may fall within the scope of the patent protection sought by the present invention.

Description of the symbols

100 software system architecture

200. 500 video data processing apparatus

10 hardware driver layer

20 virtual channel layer

21 processor

22 image processing circuit

23 graphic engine

24 superposition circuit

25 memory interface

26 internal memory

30 business logic layer

40 user layer

57 scaling circuit

O10, O20, O30, O40, O50, O60, O70.