阅读说明：本技术 一种多窗口调整方法、系统、可读存储介质和电子设备 (Multi-window adjusting method and system, readable storage medium and electronic equipment ) 是由 谭登峰 其他发明人请求不公开姓名 于 2021-08-13 设计创作，主要内容包括：本发明公开了一种多窗口调整方法、可读存储介质和电子设备。本发明实施例的多窗口调整方法包括根据指挥屏显示的内容生成一个总窗口；以及在总窗口上对各窗口进行绘制；以及获取滚动条的位置数据,以及根据所述滚动条的位置数据移动总窗口,以使得所述总窗口的局部被显示。从而解决了窗口数量较多,每个窗口的显示尺寸过小,不利于使用者对窗口进行监控的问题。(The invention discloses a multi-window adjusting method, a readable storage medium and electronic equipment. The multi-window adjusting method comprises the steps of generating a total window according to the content displayed by a command screen; drawing each window on the total window; and acquiring position data of a scroll bar, and moving a main window according to the position data of the scroll bar so that a part of the main window is displayed. Therefore, the problems that the number of windows is large, the display size of each window is too small, and the monitoring of a user on the windows is not facilitated are solved.)

1. A multi-window adjusting method is characterized in that the multi-window adjusting method comprises the following steps:

generating a general window according to the content displayed by the command screen;

drawing each window on the total window; and

acquiring position data of a scroll bar, and moving a main window according to the position data of the scroll bar so that a part of the main window is displayed.

2. The multi-window adjustment method of claim 1, wherein the generating a summary window according to the content displayed by the command screen comprises:

acquiring each window through a server in communication connection with the command screen;

and generating the total window according to the windows.

3. The multi-window adjusting method according to claim 1, wherein the obtaining of the position data of the scroll bar and the moving of the main window according to the position data of the scroll bar so that the part of the main window is displayed comprises:

creating a viewport, a size of the viewport being smaller than a size of the total window; and

moving a global window in accordance with the positional data of the scrollbar such that a portion of the global window is displayed in the viewport.

4. The multi-window adjustment method according to claim 2, further comprising:

creating a first preview window of the main window according to the main window; and

creating a second preview window of the viewport in accordance with the viewport;

wherein the second preview window changes relative to the first preview window following a change in the positional data of the scrollbar.

5. The multi-window adjustment method according to claim 1, wherein said drawing each window on the total window comprises:

acquiring window information of a window and pre-associated signal source information in the window;

drawing the appearance of each window according to the window information of each window; and

and drawing the video stream in each window according to the signal source information in each window.

6. The multi-window adjustment method according to claim 5, wherein the window information includes coordinates of top-left vertex of the window, a width of the window, and a height of the window, and the drawing the appearance of the window according to the window information includes:

and drawing the appearance of the window according to the coordinates of the top left vertex of the window, the width of the window and the height of the window.

7. The multi-window adjustment method of claim 5, wherein the rendering the video stream in the window according to the signal source information in the window comprises:

acquiring an image frame of a signal source according to the signal source information; and

rendering the image frame as a video stream within a window.

8. The multi-window adjustment method according to claim 1, wherein said obtaining position data of the scroll bar comprises:

acquiring position data of the scroll bar in the horizontal direction; and/or

And acquiring position data of the scroll bar in the vertical direction.

9. The multi-window adjustment method of claim 1, wherein said generating an overall window comprises generating an overall window according to a predetermined aspect ratio.

10. A multi-window adjustment system, comprising:

a command screen configured to display a video stream of a target signal source;

the splicing controller is in communication connection with the command screen and is configured to receive a video stream of a signal source through a video input interface, adjust the video stream of a target signal source according to a control instruction and target signal source information and output the video stream to the command screen through a video output interface, wherein the splicing controller receives the control instruction and the target signal source information through a network interface;

a server configured to be in communication connection with a splice controller, the server sending the control instruction and the target signal source information to the network interface of the splice controller; the server is also configured to be in communication connection with a signal source and is used for acquiring a network video stream of the signal source, wherein the network video stream is acquired after the video stream of the signal source is encoded;

a terminal configured to be in communication connection with the server, receive the target signal source information of the server, and receive the network video stream corresponding to the target signal source information, so as to perform the multi-window adjustment method according to any one of the preceding claims 1 to 8.

11. The multi-window adjustment system of claim 10, further comprising:

the distributor comprises a video input interface and a plurality of video output interfaces, and is configured to receive the video stream of the signal source through the video input interface and output the video stream of the signal source through the plurality of video output interfaces; and/or

The video encoder comprises a video input interface and a network output interface, and is configured to convert the video stream of the signal source into a network video stream after receiving the video stream of the signal source through the video input interface, and output the network video stream through the network output interface.

12. A computer readable storage medium storing computer program instructions which, when executed by a processor, implement a multi-window adjustment method as claimed in any one of claims 1-9.

13. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the multi-window adjustment method of any one of claims 1-9.

Technical Field

The invention relates to the technical field of computers, in particular to a multi-window adjusting method, a multi-window adjusting system, a readable storage medium and electronic equipment.

Background

In the prior art, the size of the command screen is usually large, so that multiple signal sources can be concentrated on the command screen for display. In the prior art, the size of the display device of the terminal is often smaller, and in order to display the content synchronized with the content on the command screen on the terminal, when the number of signal sources is large, the window occupied by each signal source is very small, which is not beneficial to the monitoring of the user on the terminal.

Disclosure of Invention

In view of the foregoing prior art, an object of the embodiments of the present invention is to provide a multi-window adjusting method, a readable storage medium, and an electronic device.

In a first aspect, an embodiment of the present invention provides a multi-window adjustment method, including

Generating a general window according to the content displayed by the command screen;

drawing each window on the total window; and

acquiring position data of a scroll bar, and moving a main window according to the position data of the scroll bar so that a part of the main window is displayed.

According to some embodiments of the invention, generating a summary window according to the content displayed by the command screen comprises:

acquiring each window through a server in communication connection with the command screen;

and generating the total window according to the windows.

According to some embodiments of the present invention, the obtaining of the position data of the scroll bar and the moving of the general window according to the position data of the scroll bar so that the part of the general window is displayed includes:

creating a viewport, a size of the viewport being smaller than a size of the total window; and

moving a global window in accordance with the positional data of the scrollbar such that a portion of the global window is displayed in the viewport.

According to some embodiments of the invention, the multi-window adjustment method further comprises:

creating a first preview window of the main window according to the main window; and

creating a second preview window of the viewport in accordance with the viewport;

wherein the second preview window changes relative to the first preview window following a change in the positional data of the scrollbar.

According to some embodiments of the invention, the drawing the windows on the total window comprises:

acquiring window information of a window and pre-associated signal source information in the window;

drawing the appearance of each window according to the window information of each window; and

and drawing the video stream in each window according to the signal source information in each window.

According to some embodiments of the invention, the window information comprises coordinates of an upper left vertex of the window, a width of the window, and a height of the window, and the rendering the appearance of the window according to the window information comprises:

and drawing the appearance of the window according to the coordinates of the top left vertex of the window, the width of the window and the height of the window.

According to some embodiments of the invention, the rendering the video stream within the window according to the signal source information within the window comprises:

acquiring an image frame of a signal source according to the signal source information; and

rendering the image frame as a video stream within a window.

According to some embodiments of the invention, the obtaining of the position data of the scroll bar comprises:

acquiring position data of the scroll bar in the horizontal direction; and/or

And acquiring position data of the scroll bar in the vertical direction.

According to some embodiments of the invention, the generating an overall window comprises generating an overall window according to a predetermined aspect ratio.

In a second aspect, an embodiment of the present invention provides a multi-window adjustment system, where the multi-window adjustment system includes:

a command screen configured to display a video stream of a target signal source;

the splicing controller is in communication connection with the command screen and is configured to receive a video stream of a signal source through a video input interface, adjust the video stream of a target signal source according to a control instruction and target signal source information and output the video stream to the command screen through a video output interface, wherein the splicing controller receives the control instruction and the target signal source information through a network interface;

a server configured to be in communication connection with a splice controller, the server sending the control instruction and the target signal source information to the network interface of the splice controller; the server is also configured to be in communication connection with a signal source and is used for acquiring a network video stream of the signal source, wherein the network video stream is acquired after the video stream of the signal source is encoded;

a terminal configured to be in communication connection with the server, receive the target signal source information of the server, and receive the network video stream corresponding to the target signal source information, so as to perform the multi-window adjustment method according to any one of the preceding claims 1 to 8.

According to some embodiments of the invention, the multi-window adjustment system further comprises:

the distributor comprises a video input interface and a plurality of video output interfaces, and is configured to receive the video stream of the signal source through the video input interface and output the video stream of the signal source through the plurality of video output interfaces; and/or

The video encoder comprises a video input interface and a network output interface, and is configured to convert the video stream of the signal source into a network video stream after receiving the video stream of the signal source through the video input interface, and output the network video stream through the network output interface.

In a third aspect, an embodiment of the present invention provides a readable storage medium for storing computer program instructions, including: the computer program instructions, when executed by a processor, implement a multi-window adjustment method as described in one of the above.

In a fourth aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, including: the one or more computer program instructions are executable by the processor to implement a multi-window adjustment method as claimed in any one of the above.

The technical scheme of the embodiment of the invention generates a general window according to the content displayed by the command screen; drawing each window on the total window; and acquiring position data of a scroll bar, and moving a main window according to the position data of the scroll bar so that a part of the main window is displayed. Therefore, the problems that the number of windows is large, the display size of each window is too small, and the monitoring of a user on the windows is not facilitated are solved.

Drawings

The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram of a multiple window adjustment system according to some embodiments of the invention;

FIG. 2 is a schematic diagram of a signal source and server connection according to some embodiments of the invention;

FIG. 3 is a flow diagram of a multi-window adjustment method according to some embodiments of the invention;

FIG. 4 is a schematic diagram of a network topology for a terminal to obtain window information for each window and pre-associated signal source information within the window according to some embodiments of the invention;

FIG. 5 is a schematic illustration of a summary window according to some embodiments of the inventions;

FIG. 6 is a schematic diagram of a viewport in accordance with some embodiments of the invention;

FIG. 7 is a schematic illustration of a scrollbar according to some embodiments of the invention;

FIG. 8 is a schematic diagram of a scrollbar according to some embodiments of the invention;

FIG. 9 is a schematic illustration of a scrollbar according to some embodiments of the invention;

FIG. 10 is a schematic illustration of a preview window according to some embodiments of the present invention;

FIG. 11 is a schematic diagram of a multi-window adjustment apparatus according to some embodiments of the invention;

fig. 12 is a schematic diagram of an electronic device of an embodiment of the invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.

Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.

Unless the context clearly requires otherwise, throughout the description, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including, but not limited to".

In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

FIG. 1 is a schematic diagram of a multiple window adjustment system according to some embodiments of the invention.

Referring to fig. 1, a multi-window adjustment system 60 according to an embodiment of the present invention is communicatively connected to at least one signal source for controlling a target signal source. According to some embodiments of the present invention, the multi-window adjustment system 60 includes a splicing processor 21, a switch 50, a terminal 40, and a server 20; according to some embodiments of the invention, the system may further comprise a command screen 10. According to some embodiments of the invention, the signal source comprises: desktop, camera, notebook computer, tablet computer, network camera, cell-phone etc..

In the practice of the present invention, the command screen 10 is used to display a video stream of a target signal source. The conductor screen 10 can include one display device or a plurality of display devices. For example, the command screen 10 of some embodiments of the present invention includes a display or a projector; other embodiments of the present invention include a command screen 10 that includes multiple displays, multiple projectors, or a combination of multiple displays and projectors.

The stitching processor 21 of the present embodiment includes at least one video input interface, at least one video output interface, and at least one network interface.

The splicing processor 21 of the embodiment of the present invention is in communication connection with the command screen 10 through a video output interface.

The splicing processor 21 of the embodiment of the present invention is configured to receive the video stream of the signal source through the video input interface, adjust the video stream of the target signal source according to the control instruction and the target signal source information, and output the adjusted video stream to the command screen 10 through the video output interface. Specifically, the stitching processor 21 of the embodiment of the present invention receives the video streams of the signal source 210, the signal source 220, and the signal source 230 through the video input interface. It should be understood that the number of signal sources that can be received by the embodiments of the present invention is not limited to three, and in practice, a corresponding number of signal sources may be accessed as needed. Taking the signal source as a desktop computer as an example, the display output device interface of the desktop computer may be connected to the video input interface of the stitching processor 21 through a video cable. For example, if the interface of the display output device of the desktop computer is HDMI, and the video input interface of the stitching processor 21 is HDMI, the two are connected by an HDMI video line. It should be understood that the embodiment of the present invention does not limit the type of the video output interface of the signal source, and in practice, the video output interface of the signal source includes HDMI, DVI, VGA, and the like.

The splicing processor 21 of the embodiment of the present invention receives a control instruction and target signal source information of the server 20 through a network interface.

A server 20 configured to be communicatively connected to the splicing processor 21, wherein the server 20 transmits the control instruction and the target signal source information to the network interface of the splicing processor 21. The server 20 may be one server, a server cluster, or a cloud server.

The server 20 is further configured to be connected in communication with a signal source, and configured to obtain a network video stream of the signal source, where the network video stream is obtained by encoding the video stream of the signal source.

Fig. 2 is a schematic diagram of a server acquiring a network video stream of a signal source according to some embodiments of the invention.

Referring to fig. 2, the multi-window processing system according to some embodiments of the present invention further includes a distributor 220 and a video encoder 230. The distributor 220 divides the video output interface of the signal source into multiple paths, specifically, one path of video stream of the signal source is output to a local display device (not necessary), the other path of video stream of the signal source is output to the splicing processor 21, and the other path of video stream of the signal source is output to the video encoder 230.

The video encoder 230 of the embodiment of the present invention can encode the video stream of the signal source into a network video stream. Therefore, the server of the embodiment of the invention can obtain the network video stream of the signal source. Specifically, the network video stream of the embodiment of the present invention may be a network video stream of h.265. It should be understood that the network video stream may be in other formats as required.

The specific implementation manner of the communication connection between the signal source and the server 20 in the multi-window adjustment system according to some embodiments of the present invention is that the signal source outputs a video stream through a video output interface. The video stream output by the signal source is input into the distributor 220, the distributor 220 inputs one of the video streams into the video encoder 230, the video encoder 230 encodes the video stream and outputs the network video stream of the signal source, the network video stream is accessed into the switch 50, and the server 20 is accessed into the switch 50, so that the server 20 can obtain the network video stream of the signal source.

And the terminal 40 is configured to be in communication connection with the server 20, receive the target signal source information of the server 20, and receive the network video stream corresponding to the target signal source information, so as to execute the multi-window adjusting method according to the embodiment of the invention. The terminal may include, for example, a desktop computer, a notebook computer, a tablet computer, a mobile phone, and the like

The target signal source of the embodiment of the present invention refers to a signal source that needs to be displayed on the command screen 10. For example, the signal source actually accessed in the embodiment of the present invention includes: signal source 210, signal source 220, signal source 230, signal source 240, and signal source 250. Specifically, which signal sources are displayed on the command screen 10 is determined by the control commands sent by the user and the target signal source information sent by the user. For example, the control command and the target signal source information sent by the user are to display the signal source 210, the signal source 220, the signal source 230, and the signal source 240 on the command screen 10, and the target signal source is the signal source 210, the signal source 220, the signal source 230, and the signal source 240. The control instructions include displaying the signal sources on the command screen 10. The target signal source information includes a channel number of the signal source. The control instructions and target signal source information are received by the server 20. As mentioned above, the server 20 sends the control command and the target signal source information to the network interface of the splicing processor 21, and the splicing processor 21 adjusts the video stream of the target signal source according to the received control command and the target signal source information and outputs the adjusted video stream to the command screen 10 through the video output interface.

The prior art command screen 10 is typically large in size and is capable of displaying hundreds of video streams from a source. In the context of intelligent interactive applications, it is desirable to synchronize the display of the content of the conductor screen 10 on the terminal 40. However, the terminal 40 usually adopts a general-purpose electronic device, and the size of the physical display device is limited, so that when the terminal 40 simultaneously displays multiple signal sources, the window corresponding to each signal source is very small, which is not easy for the user to view. Therefore, the embodiment of the invention provides a multi-window adjusting method.

In the multi-window adjusting method of the embodiment of the invention, the terminal 40 firstly generates a total window according to the content displayed by the command screen 10, and draws each window on the total window, wherein each window is used for playing a network video stream of a signal source; setting a scroll bar, associating the scroll bar with the main window, dragging the scroll bar to obtain the position data of the scroll bar, and moving the main window according to the position data of the scroll bar so as to display the local part of the main window. A viewport is created on the terminal 40, wherein the size of the viewport is set according to the size of the physical display device of the terminal 40 (the size of the viewport is not necessarily the same as the size of the physical display device and may be smaller than or equal to the size of the physical display device). And binding the viewport and the master window, wherein the size of the master window is larger than that of the viewport, and displaying part of the master window in the viewport, so that the size of each window in the master window is not required to be set to be too small, thereby monitoring multiple signal sources on the terminal 40, and ensuring that the window corresponding to each signal source is not too small.

FIG. 3 is a flow diagram of a multi-window adjustment method according to some embodiments of the invention.

Referring to fig. 3, a flowchart of a multi-window adjustment method according to an embodiment of the present invention includes steps 100, 200, and 300.

In step 100, a general window is generated according to the content displayed by the command screen 10.

In an embodiment of the present invention, the summary window is the entire content available for display. Specifically, each window is acquired by the server 20 connected in communication with the command screen 10, and the total window is generated according to each window. Because the terminal 40 of the embodiment of the present invention is not directly connected to the command screen 10 in a communication manner, and the window displayed on the command screen 10 of the embodiment of the present invention is controlled by the server 20, the terminal 40 of the embodiment of the present invention can obtain each window displayed on the command screen 10 only by communicating with the server 20. Specifically, the terminal 40 according to the embodiment of the present invention generates a total window according to each window after acquiring each window through the server 20.

Since the physical display device size is fixed, when there are many windows on the total window, each window is very small in order to monitor multiple windows simultaneously. According to some embodiments of the invention, the size of the total window is larger than the size of the physical display device. Such that when there are many windows in an embodiment of the present invention, a portion of the total window is displayed such that each window can be presented on the physical display device in a user-friendly size.

According to some embodiments of the present invention, an overall window may be generated according to a predetermined aspect ratio. According to some embodiments of the present invention, the predetermined aspect ratio may be determined according to the aspect ratio of the conductor screen 10 as shown in FIG. 1. Correspondingly, the generated total window can be a total window with a height larger than a width according to the difference of the aspect ratio of the command screen; or, the generated total window is a total window with a width larger than a height; alternatively, the total window generated is one of equal height and width. In an embodiment of the present invention, the height may represent a dimension of the overall window in a vertical direction, and the width may represent a dimension of the overall window in a horizontal direction.

According to some embodiments of the present invention, the shape of the overall window is not limited to a rectangle, and the shape of the overall window may be other shapes, for example, a regular shape or an irregular shape.

And 200, drawing each window on the total window.

According to some embodiments of the present invention, said drawing each window on the total window comprises three sub-steps, step 220, step 221 and step 222.

Step 220, acquiring window information of each window and signal source information pre-associated in the window.

According to some embodiments of the invention, the window information includes an upper left vertex coordinate of the window, a width of the window, and a height of the window.

The position of the window and the size of the window can be determined on the total window according to the window information. For example, the window is first positioned on the overall window based on the top left vertex coordinates, and the size of the window is determined based on the width of the window and the height of the window. When the total window includes a plurality of windows, the window information further includes a window map layer value. Therefore, when the shielding condition exists between the windows, the stacking sequence or the shielding condition of the windows is determined according to the window map layer value.

In the multi-window adjusting method of the embodiment of the invention, pre-associated signal source information in the window is obtained. In some embodiments of the invention, the signal source information comprises a signal source identification. In some embodiments of the present invention, the signal source information further includes a signal source address, a port number, or a signal source type. The signal source Address in the embodiment of the present invention may be an IP Address (Internet Protocol Address).

Step 221, drawing the appearance of each window according to the window information of each window.

Specifically, the appearance of each window is drawn on the total window according to the window information. According to some embodiments of the present invention, the window information of each window may be obtained by receiving data input by a user, that is, the window information of each window is specified by the user, for example, the coordinates of the top left vertex of each window, the width of each window, and the height of each window are specified by the user, and then the appearance of each window is drawn on the total window according to the window information specified by the user.

According to some embodiments of the invention, the window information for each window may also be obtained over a network. That is, the window information of each window is obtained through the network, and the appearance of each window is drawn on the total window according to the obtained window information of each window. The network may be a local area network or a wide area network.

According to some embodiments of the present invention, window information for each window is obtained in real time over a network.

Step 222, drawing the video stream in each window according to the signal source information in each window.

Step 222 includes two substeps, step 2221 and step 2222, respectively.

Step 2221, obtaining an image frame of the signal source according to the signal source information.

Specifically, in each window, an image frame of the signal source is acquired according to the signal source information of the window.

Step 2222, draw the image frame into a video stream within a window.

Specifically, the image frames of the signal source are rendered as a video stream within a window.

Fig. 4 is a schematic diagram of a network topology in which a terminal obtains window information of each window and pre-associated signal source information in the window according to some embodiments of the present invention.

Referring to fig. 4, the server 20 receives a control command and target signal source information transmitted from a user. The server 20 parses the control command and the target signal source information into window information of a window and signal source information associated in advance in the window. The terminal 40 is communicatively connected to the server 20. The terminal 40 acquires window information of each window in the server 20 and signal source information previously associated within the window. When the terminal 40 needs to execute step 2221, the server 20 establishes a communication connection with the video encoder 230, the server 20 obtains the network video stream of the signal source, the server 20 sends the network video stream of the signal source to the terminal 40 in the form of image frames in response to the request of the terminal 40, and the terminal 40 draws the image frames of the signal source into a video stream in a window through a drawing event after receiving the image frames of the signal source.

According to some embodiments of the invention, the rendering of the appearance of each window in step 221 and the rendering of the video stream within each window in step 222 may be real-time rendering. That is, in each update period, the appearance of each window is redrawn according to the window information, and the video stream in each window is redrawn according to the signal source information in each window.

According to some embodiments of the invention, drawing the appearance of each window in step 221 may redraw the window appearance only when the window information changes. That is, when the window position is changed, the window size is adjusted, and the layer value of the window is changed, the window appearance is redrawn. At this point, the rendering of the video stream within the window by step 222 remains in real-time.

Step 300, obtaining position data of a scroll bar, and moving a main window according to the position data of the scroll bar, so that a part of the main window is displayed.

According to some embodiments of the invention, the scrollbar comprises a slider. The slider of the embodiment of the invention can respond to the dragging of the user, so that the position data of the scroll bar of the embodiment of the invention is changed.

According to some embodiments of the invention, the position data of the scroll bar may also come from voice input, somatosensory sensors, and the like.

Step 300 includes two substeps, step 310 and step 320, respectively.

Step 310, creating a viewport, wherein the size of the viewport is smaller than the size of the total window.

According to some embodiments of the invention, the size of the viewport may be determined according to the size of the physical display device. Those skilled in the art will appreciate that the manner in which the viewport is created can be determined in conjunction with the development environment. Creating a viewport may be creating an entity as a viewport. The embodiment of the present invention may also refer to creating the viewport to determine a display area as the viewport without creating any entity, for example, obtaining the size of the physical display device, and using all or part of the physical display device as the viewport. For the case where a part of the physical display device is used as the viewport, an area smaller than the size of the physical display device may be set as the viewport.

According to some embodiments of the invention, the viewport is bound (or associated) with the global window. Since the size of the viewport is smaller than that of the porthole, the viewport is a visible region, and a region outside the viewport is an invisible region, and correspondingly, a part of the porthole inside the viewport is visible, and a part of the porthole outside the viewport is invisible. In order to determine the portion of the user that needs to pay special attention to the user, the embodiment of the present invention sets the scroll bar, and changes the relative position of the viewport and the main window according to the position data generated by dragging the scroll bar by the user, thereby adjusting the content displayed in the viewport (i.e. the content displayed in the viewport is a part of the main window) according to the user's needs, as described in step 320 below.

Step 320, moving a main window according to the position data of the scroll bar, so that a part of the main window is displayed in the viewport.

According to some embodiments of the invention, the viewport location is fixed. That is, the view port of the embodiment of the present invention is located in a fixed area of the physical display device. The moving direction of the sliding block of the embodiment of the invention can be opposite to the moving direction of the main window; in other embodiments the direction of movement of the slider may be the same as the direction of movement of the overall window. That is, in some embodiments of the present invention, the position data of the scroll bar is obtained by dragging the slider, and the position data of the scroll bar is linked with the moving direction of the main window and the displacement of the main window. In some embodiments of the invention, in order to have a part of the porthole window displayed, the visible area may be set as a portion where the viewport overlaps with the porthole window.

According to some embodiments of the invention, the total window position is fixed. The moving direction of the slider is the same as the moving direction of the viewport; or the direction of slider movement is opposite to the viewport movement direction. That is, in some embodiments of the present invention, the scroll bar position data is obtained by dragging the slider, and the scroll bar position data is linked with the moving direction of the viewport and the displacement of the viewport. Meanwhile, the moving range of the viewport is limited within the boundary of the main window, and the visible area is set as the part of the viewport which is overlapped with the main window, so that the part of the main window can be displayed.

According to some embodiments of the invention, a slider is used to control the movement of the global window or viewport in the horizontal direction.

According to some embodiments of the invention, a slider is used to control movement of the global window or viewport in a vertical direction.

There are at least two situations for the updating of the viewport of embodiments of the present invention.

In case one, the scroll bar data changes, the viewport is updated. That is, the user in case one drags the slider on the scroll bar, resulting in a change in the scroll bar data, and the viewport is updated.

In case two, the viewport is updated when the scroll bar data has not changed but each window is updated. The updating of each window comprises updating of a signal source in the window and updating of window information. That is, the user in case two does not drag the slider on the scroll bar, but the viewport of the embodiment of the present invention is still updated, thereby facilitating the user's monitoring of the window that needs attention.

FIG. 5 is a schematic illustration of a summary window according to some embodiments of the inventions.

As shown in FIG. 5, the summary window 100 is the entire content available for display. One or more windows may be created on the overall window 100. For example, window 101, window 102, window 103, and window 104 are created on top of the overall window 100. It should be understood that the number of windows in the embodiment of the present invention is not limited to 4, and in practice, a corresponding number of windows may be created on the terminal 40 according to the number of windows displayed on the command screen 10. Because the terminal 40 of the embodiment of the present invention is not directly connected to the command screen in a communication manner, and the windows displayed on the command screen of the embodiment of the present invention are controlled by the server 20, the terminal 40 of the embodiment of the present invention can obtain the number of windows displayed on the command screen only by communicating with the server 20.

According to some embodiments of the present invention, the windows may be arranged in a tiled arrangement, in a stacked arrangement, in a spaced arrangement, and in an irregular arrangement. The positions of the windows and the positional relationship between the windows can be obtained in step 221, and are not described herein again.

According to some embodiments of the invention, the size of the windows may be the same or may be completely different. The size of the window can also be obtained in step 221, which is not described herein again.

Fig. 6a and 6b are schematic diagrams of a viewport in accordance with some embodiments of the invention.

The size of the viewport is smaller than the total window. The viewport is used to display a portion of the global window. The viewport 200 is presented on a physical display device 41.

Referring to fig. 6a, fig. 6a shows the content currently displayed by the viewport. That is, only window 101 and window 102 are currently displayed in viewport 200. In an embodiment of the invention, the content displayed by the viewport is specified by a user. For example, in some embodiments of the present invention, a user dragging a slider can change the position data of the scrollbar such that the position of the overview window changes, and thus, the content displayed by the viewport correspondingly changes. For the specific operation, reference may be made to step 320, which is not described herein again.

According to some embodiments of the invention, the size of the viewport 200 and the visible display area 410 of the physical display device of the terminal 40 are not exactly the same, but may, as shown in fig. 6b, only occupy a portion of the visible display area 410 of the physical display device of the terminal 40.

FIG. 7 is a schematic illustration of a scrollbar according to some embodiments of the invention.

Referring to fig. 7, a scroll bar 300 of an embodiment of the present invention includes a slider 301. Referring to fig. 6a and 6b, according to some embodiments of the present invention, the scroll bar 300 may be disposed at any position of the view port 200, for example, the scroll bar 300 is disposed at the bottom, the upper portion, the left portion and the right portion of the view port 200, which is not limited by the present invention.

The user drags the slider 301 and the position data of the scroll bar 300 is correspondingly changed.

In the embodiment of the invention, the position data of the scroll bar can be set to be linked with the moving direction of the main window and the displacement of the main window; the scrollbar position data can also be set in linkage with the direction of movement of the viewport and the displacement of the viewport. For the specific operation, reference may be made to step 320, which is not described herein again.

FIG. 8 is a schematic diagram of a scrollbar according to some embodiments of the invention.

Referring to fig. 8, the scroll bar 310 of the embodiment of the present invention may also be arranged in the direction shown in fig. 8, which includes a slider 311. In connection with fig. 4, the horizontal direction of the global window or viewport can be controlled by the scroll bar 300 shown in fig. 7. The vertical orientation of the global window or viewport is controlled by a scroll bar 310 shown in fig. 8.

FIG. 9 is a schematic illustration of a scrollbar according to some embodiments of the invention.

Referring to fig. 9, the scroll bar 320 of the embodiment of the present invention includes a slider 321 capable of controlling both the horizontal direction and the vertical direction.

FIG. 10 is a schematic illustration of a preview window according to some embodiments of the present invention.

The preview window of the present embodiment includes a first preview window 110 and a second preview window 210.

Specifically, the preview window may be obtained by step 400 and step 500.

Step 400, creating a first preview window of the main window according to the main window.

Specifically, the first preview window 110 is a thumbnail of the overview window 100 shown in fig. 5.

Step 500, a second preview window of the viewport is created from the viewport.

In particular, the second preview window 210 is a thumbnail of the viewport 200 as shown in FIG. 6. Wherein the second preview window 210 changes with respect to the first preview window 110 following the change of the position data of the scroll bar. The specific implementation method can link the position of the first preview window 110 with the position of the main window 100; similarly, the position of the second preview window 210 is linked with the position of the viewport 200.

According to some embodiments of the present invention, the scroll bar and the preview window shown in fig. 9 may be combined into one control, thereby reducing the space usage. For example, the scroll bar 320 and the first preview window 110 are merged; at the same time, the slider 321 and the second preview window 210 are merged. The reference numerals of fig. 10 of the embodiment of the present invention are followed by the incorporated reference numerals. That is, dragging the second preview window 210 changes the position data of the scroll bar, and accordingly, the display content of the viewport changes, and the second preview window 210 is updated.

FIG. 11 is a schematic diagram of a multi-window adjustment apparatus according to some embodiments of the invention.

The multi-window adjusting apparatus of the embodiment of the present invention includes a generating device 10, a drawing device 20, and a calculating device 30.

The generating device 10 is used for generating a general window according to the content displayed by the command screen 10;

the drawing device 20 is used for drawing each window on the main window; and

the computing means 30 is arranged to obtain position data of the scroll bar and to move the main window in dependence of the position data of the scroll bar such that a part of the main window is displayed.

Fig. 12 is a schematic diagram of an electronic device of an embodiment of the invention.

The multi-window adjusting method according to the embodiment of the present invention can be executed by the general electronic device 12, and when the multi-window adjusting method according to the embodiment of the present invention is executed by the general electronic device 12, the electronic device 12 includes a general hardware structure that includes at least the processor 121 and the memory 122. The processor 121 and the memory 122 are connected by a bus 123. The memory 122 is adapted to store instructions or programs of the multi-window adjustment method executable by the processor 121. Processor 121 may be a stand-alone microprocessor or a collection of one or more microprocessors. Thus, the processor 121 executes the multi-window method as an embodiment of the present invention by executing the instructions of the multi-window adjustment method stored in the memory 122 to implement the processing of windows and the control of a physical display control device (e.g., the display controller 124). The bus 123 connects the above components together, and also connects the above components to the display controller 124 and the IO controller 126. IO devices 125 may be a mouse, keyboard, modem, network interface, touch input device, motion sensing input device, printer, and other devices known in the art. Typically, IO devices 125 are connected to the system through IO controller 126.

It will be apparent to those skilled in the art that embodiments of the present application may provide a multi-window adjustment method, apparatus (device) or computer program product. Thus, the multi-window adjustment of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may employ one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein to implement the multi-window adjustment method.

The present application is described with reference to flowchart illustrations of multi-window adjustment methods, apparatus (devices) and computer program products according to embodiments of the application. It will be understood that each flow in the flow diagrams can be implemented by computer program instructions.

The electronic device of the embodiment of the present invention may include a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing device, and the processor of the general purpose computer, the special purpose computer, the embedded processor, or other programmable data processing device may execute the multi-window adjusting method of the embodiment of the present invention.

Another embodiment of the invention relates to a non-transitory readable storage medium storing a computer-readable program for causing a computer to perform an embodiment of some or all of the above methods.

That is, as will be understood by those skilled in the art, all or part of the steps in the method for implementing the embodiments described above may be accomplished by specifying the relevant hardware through a program, where the program is stored in a readable storage medium and includes several instructions to enable a device (which may be a single chip, a chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned readable storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.