阅读说明：本技术 一种无线传屏显示系统与显示方法 (Wireless screen transmission display system and display method ) 是由 王天宝 王连耀 于 2020-04-21 设计创作，主要内容包括：本发明公开了一种无线传屏显示系统与显示方法,无线传屏显示系统包括传屏源端,发送端,接收端。所述传屏源端主要完成对投屏数据进行采集与编码工作；所述发送端通过USB接口与传屏源端进行连接,利用HID协议与传屏源端进行通信,通过无线通信的方式与接收端进行通信。所述的接收端为投屏显示终端,所述接收端将无线通信传输得到的投屏数据进行解码和显示。无线传屏显示方案主要包括悬浮显示,分屏显示,重叠显示和扩展显示等,接收端可以根据当前所连接的传屏源端设备的数量进行自动分屏显示。本发明实现了传屏显示形式多样化,提高了屏幕的利用率,使得用户在多屏投屏时操作更高效和快捷。(The invention discloses a wireless screen transmission display system and a display method. The screen transmission source end mainly completes the collection and coding of screen projection data; the sending end is connected with the screen transmitting source end through the USB interface, communicates with the screen transmitting source end through the HID protocol, and communicates with the receiving end through a wireless communication mode. The receiving terminal is a screen projection display terminal and decodes and displays screen projection data obtained through wireless communication transmission. The wireless transmission screen display scheme mainly comprises suspension display, split screen display, overlapping display, expansion display and the like, and the receiving end can perform automatic split screen display according to the number of transmission screen source end equipment connected currently. The invention realizes the diversification of the screen transmission display forms, improves the utilization rate of the screen, and enables the user to operate more efficiently and quickly during multi-screen projection.)

1. A wireless screen-display system, comprising: a screen transmitting source end, a transmitting end and a receiving end;

the screen transmitting source end comprises a screen projection data acquisition module, a screen projection data coding module and a first HID communication module, the screen projection data acquisition module is used for acquiring screen data to be projected, the screen projection data coding module is used for coding the screen projection data, and the first HID communication module is used for transmitting the coded screen projection data to the transmitting end.

The sending end mainly comprises a pairing module, a second HID communication module and a first wireless communication module, wherein the pairing module is used for completing pairing of wireless screen transmission equipment, the second HID communication module is used for receiving screen projection data from a screen transmission source end, and the first wireless communication module is used for sending the screen projection data to a receiving end;

the receiving end mainly comprises: the display control module, the second wireless communication module, the split screen operation module, the screen projection data decoding module, the touch screen monitoring module and the audio and video playing module; the receiving end completes the decoding and display tasks of the screen projection data through the display control module; the display control module is used as a control center for displaying screen projection data at a receiving end and is responsible for coordinating and controlling each module to finish the display work of the screen projection data; the second wireless communication module receives screen projection data forwarded by the sending end; the screen projection data decoding module decodes the screen projection data; the audio and video playing module is a final executor for displaying by the display control module and can realize external connection of a display by reserving an HDMI interface; the touch screen monitoring module monitors whether a user touches or clicks a mouse, and when the touch screen monitoring module detects that the mouse of the user clicks or touches a designated operation button, the touch screen monitoring module generates a corresponding operation instruction and sends the operation instruction to the display control module, and then the display control module controls the audio and video playing module to execute corresponding display operation; and the split screen operation module calculates the split screen display proportion through a split screen algorithm.

2. The wireless screen-transfer display system of claim 1, wherein the pairing method of the wireless screen-transfer devices is as follows:

the method comprises the following steps: a user inserts a sending end into a receiving end through a USB interface;

step two: the receiving terminal transmits the wireless hotspot information to the transmitting terminal through a USB interface;

step three: the sending end forwards the screen projection data to a corresponding receiving end according to the no-hot-spot information;

the wireless hotspot information includes a hotspot name, a hotspot password, an IP address, a port number and the like of the receiving end.

3. The wireless screen-transmission display system according to claim 1, wherein the screen-splitting algorithm in the screen-splitting operation module calculates a resolution value occupied by each screen-casting display window and a screen-casting display window to be generated according to a screen-casting number variable and a resolution value of a display device connected to the receiving-end audio/video playing module.

4. A wireless screen transmission display method is characterized by comprising the following steps:

the method comprises the following steps: the screen projection source end collects screen projection data and encodes the screen projection data;

step two: the screen transmitting source end transmits the encoded screen projection data to the transmitting end through the USB interface;

step three: the sending end sends the received screen projection data to the receiving end through the first wireless communication module according to the wireless hotspot information obtained during pairing;

step four: the receiving end receives screen projection data forwarded by the sending end through a second wireless communication module, and a screen division operation module is used for accumulating the screen projection number variable by 1;

step five: a split screen operation module at the receiving end judges the value of a variable of the number of projected screens, if the value is not more than the maximum number of projected screens, a screen projection display window is generated, and the number of the required split screens and the split screen display proportion are calculated through the split screen operation module;

step six: and the display control module at the receiving end controls the audio and video playing module to perform proportional split screen display.

5. The wireless screen-transmission display method according to claim 4, wherein the screen-projection display window of the receiving end includes a display operation area and a data display area, and the display operation area includes a minimize, split screen, float, full screen, close screen-projection button and screen-projection number display area; the screen projection number display area displays that the current screen projection display window is the number of the screen projection equipment, namely, the number variable of the currently projected screen is displayed, and the screen projection number display area not only can display serial numbers according to the screen projection time sequence, but also can display user name information of the transmission screen source end according to local computer system information acquired by the screen source end.

6. The wireless screen-transfer display method of claim 4, wherein the wireless screen-transfer display method supports: split screen display, suspension display, overlapping display and expansion display;

the split screen display function comprises automatic split screen display and manual split screen display; when a screen transmitting source end is connected to a receiving end for screen projection display, firstly, a screen splitting operation module of the receiving end firstly accumulates a current screen projection number variable by one; then, the split screen operation module automatically calculates the display proportion of a screen projection display window according to the projected screen number and the resolution of an audio and video display module at the current receiving end; finally, the split-screen display is completed through the display control module;

when the receiving end split screen operation module detects that the number of the projected screens is larger than the maximum number of the projected screens, the receiving end calls an error display window through a display control module to display: the maximum screen projection number is full, and screen projection cannot be finished. And prompting the user that the maximum screen projection quantity is reached and the screen projection cannot be performed.

The manual split-screen display is that when the display state of the receiving end is not split-screen display, a mouse clicks or touches a split-screen display button of any screen projection display window to complete the manual split-screen display function of the receiving end;

the floating display function includes: a user clicks a suspension display button of a display operation area of a screen projection display window, the screen projection display window is reduced to an icon, the icon is suspended and stopped at the right side of a display screen of a receiving end, and the user can drag the suspended icon to change the stopping position; when a user needs to call a display window for displaying the transmission screen source end, the display state can be recovered by double clicking the suspension icon, so that when a plurality of devices perform screen projection display, different transmission screen source ends are switched to display more conveniently and quickly;

the functions of the overlay display include: the screen projection display window is used as an independent application window, the window can realize operations such as dragging, amplifying, reducing and the like similar to a normal program window, and different display windows can realize overlapping and covering display;

the functions of the extended display include: when the receiving end needs to be expanded, the reserved interface of the audio and video playing module of the receiving end is connected with the plurality of expanded display screens through the HDMI line, and the expanded display function of the wireless screen transmission display system is achieved.

7. The wireless screen-transmitting display method according to claim 4, wherein the screen-splitting algorithm of the screen-splitting operation module comprises the following steps:

the method comprises the following steps: judging the value of the projected screen number variable and the total number of the display screens;

step two: if the variable value m of the number of the projected screens is equal to the total number n of the display screens, each display displays one screen projection display window; if the variable value m of the number of the projected screens is smaller than the total number n of the display screens, each display screen displays a screen projection display window, and the rest display screens do not display screen projection data; if the variable value m of the number of the projected screens is larger than the total number n of the display screens, calculating the value of m/n, and obtaining a quotient a and a remainder b;

step three: if the remainder b is 0, displaying a screen projection windows on each display screen, if the remainder is not 0, displaying a screen projection display windows on each display screen, distributing the screen projection display windows on the remainder b to b display screens, distributing one screen projection display window on each display screen, and normally displaying a screen projection display windows on the rest n-b display screens.

8. The method according to claim 4, wherein in the screen-casting mode, when a user clicks a full-screen button of a screen-casting display window, the window enters a full-screen display state, the user wants to exit the full-screen state of the current screen-casting display window, and can perform a five-finger screen-grabbing operation, the touch screen monitoring module at the receiving end detects and processes the five-finger screen-grabbing operation of the user by using a touch algorithm, and then exits the full-screen display state of the current screen-casting display window;

the processing flow of the touch algorithm of the touch screen monitoring module for the five-finger screen grabbing operation is as follows:

the method comprises the following steps: initializing a touch screen algorithm;

step two: the touch screen scans user input;

step three: judging the distance between adjacent finger contacts, and if the distance is greater than a set threshold value, abandoning the five-finger screen grabbing operation;

step four: judging whether the shaking distance of each finger exceeds a given threshold value;

step five: if the condition of the fourth step is met, storing the touch data for generating a full screen command for exiting the current screen projection display window once, and transmitting the full screen command to the display control module for controlling display.

9. The wireless screen-projection display method of claim 4, wherein the number-of-projected-screen variable represents the number of screen-projection sources currently connected to the receiving end;

the screen transmission source end can be a tablet computer, a desktop computer and a personal notebook computer;

the receiving end can be an android intelligent interactive all-in-one machine, an android interactive large screen and a screen transmission box.

Technical Field

The invention relates to the field of display application, in particular to a wireless screen transmission display system and a display method.

Background

With the progress of wireless communication technology, wireless transmission screens are paid more and more attention and favored by people. The wireless screen transmission technology enables a user to project contents to be displayed of equipment such as a notebook computer, a smart phone and a tablet personal computer to an interactive large screen for demonstration, and compared with wired connection, the method can avoid a complicated process of physical connection.

The wireless screen transmission technology has wide application occasions, for example, in conference rooms of many large enterprises, conference personnel need to display conference contents on a computer to a conference screen; in teaching, a teacher needs to project courseware on a computer to a large screen, so that students can watch the courseware conveniently.

With the increasingly wide application of wireless screen transmission in scenes such as conferences and education, the requirements for interactive experience are also higher and higher. Most of the display schemes of the wireless screen projection only support basic display modes such as two screens and the like, and the display mode of the projection screen is single, so that the display effect of the projection screen is poor; and when the conference needs a plurality of devices to transmit screens, the switching of a plurality of screen projection interfaces is unfriendly, so that the demonstration efficiency is low.

Disclosure of Invention

In order to solve the problem that the existing wireless screen transmission equipment does not support rich display styles and friendly interactive display, the invention aims to solve the technical problem of providing a wireless screen transmission display system and a display method, so that the wireless screen transmission equipment supports the functions of suspension display, split screen display, overlapped display, extended display and the like, the display is more diversified, the screen projection display effect of the wireless screen transmission equipment is enhanced, the utilization rate of a screen is improved for multi-screen transmission, and the interactivity and the demonstration efficiency are improved.

In order to solve the technical problems and achieve the technical effects, the invention provides a wireless screen transmission display system and a display method. The wireless screen transmission display system comprises a screen transmission source end, a sending end and a receiving end.

The screen transmitting source end comprises a screen projection data acquisition module, a screen projection data coding module and a first HID communication module, the screen projection data acquisition module is used for acquiring screen data to be projected, the screen projection data coding module is used for coding the screen projection data, and the first HID communication module is used for transmitting the coded screen projection data to the transmitting end.

The sending end mainly comprises a pairing module, a second HID communication module and a first wireless communication module, wherein the pairing module is used for completing pairing of wireless screen transmission equipment, the second HID communication module is used for receiving screen projection data from a screen transmission source end, and the first wireless communication module is used for sending the screen projection data to a receiving end; the wireless screen transmission equipment needs to be paired before screen projection display, and the pairing steps are as follows:

the method comprises the following steps: a user inserts a sending end into a receiving end through a USB interface;

step two: the receiving terminal transmits the wireless hotspot information to the transmitting terminal through a USB interface;

step three: and the sending end forwards the screen projection data to the corresponding receiving end according to the no-hot-spot information.

The wireless hotspot information comprises a hotspot name, a hotspot password, an IP address, a port number and the like of a receiving end.

The receiving end display related module mainly comprises: the receiving end mainly completes the task of decoding and displaying the screen projection data through the display control module. The display control module is used as a control center for displaying screen projection data at a receiving end and is responsible for coordinating and controlling each module to finish the display work of the screen projection data; the second wireless communication module receives screen projection data forwarded by the sending end; the screen projection data decoding module decodes the screen projection data; the audio and video playing module is a final executor for displaying by the display control module and can realize external connection of a display by reserving an HDMI interface; the touch screen monitoring module monitors whether a user touches or clicks a mouse, and when the touch screen monitoring module detects that the mouse of the user clicks or touches a designated operation button, the touch screen monitoring module generates a corresponding operation instruction and sends the operation instruction to the display control module, and then the display control module controls the audio and video playing module to execute corresponding display operation; and the split screen operation module calculates the split screen display proportion through a split screen algorithm.

The screen splitting algorithm calculates the occupied resolution value of each screen projecting display window and the screen projecting display window which needs to be generated according to the resolution value of the display equipment connected with the screen projecting number variable and the receiving end audio and video playing module.

According to the system, the screen projection display steps of the wireless screen transmission display method are as follows:

the method comprises the following steps: the screen projection source end collects screen projection data and encodes the screen projection data;

step two: the screen transmitting source end transmits the encoded screen projection data to the transmitting end through the USB interface;

step three: the sending end sends the received screen projection data to the receiving end through the first wireless communication module according to the wireless hotspot information obtained during pairing;

step four: the receiving end receives screen projection data forwarded by the sending end through a second wireless communication module, and a screen division operation module accumulates 1 screen projection number variable;

step five: the receiving end split screen operation module judges the value of the variable of the number of the screen projected, if the value is not more than the maximum number of the screen projected, a screen projected display window is generated, and the number of the screen required to be split is calculated through the split screen operation module, and the ratio of the number of the screen required to be split to the split screen display is calculated;

step six: and the receiving end display control module controls the audio and video playing module to display in a screen-divided mode according to the proportion.

The screen projection data comprises audio, video, system information and the like of a screen transmission source end.

And the projected screen number variable represents the number of the screen transmitting source ends currently connected to the receiving end.

The screen transmitting source end is a tablet computer, a desktop computer, a personal notebook computer and the like.

The receiving end can be an android intelligent interactive all-in-one machine, an android interactive large screen, a screen transmission box and the like.

When the receiving end is a screen transmission box, the audio and video display module of the receiving end needs to be externally connected with the touch screen display through the reserved HDMI transmission line.

The wireless communication mode comprises transmission modes such as Bluetooth, wifi and the like.

The screen projection display window of the receiving end comprises a display operation area and a data display area, and the data display area mainly completes display of video data in the screen projection data. The display operation area comprises a minimization display area, a split screen display area, a suspension display area, a full screen display area, a screen projection button closing area and a screen projection number display area. And the screen projection number display area displays that the current screen projection display window is the first screen projection equipment, namely, the current screen projection number variable is displayed.

As a preferred scheme, the screen projection number display area can display numbers according to the screen projection time sequence, and can display user name information of the screen source end according to local computer system information acquired by the screen source end.

The wireless screen transmission display method supports: split screen display, suspension display, overlapping display and expansion display.

The receiving end split screen display comprises automatic split screen display and manual split screen display, and when one transmission screen source end is connected to the receiving end to perform screen projection display, firstly, a split screen operation module of the receiving end firstly accumulates a current projected screen number variable by one; then, the split screen operation module automatically calculates the display proportion of a screen projection display window according to the projected screen number and the resolution of an audio and video display module at the current receiving end; and finally, completing split screen display through the display control module, and when the receiving end split screen operation module detects that the number of the projected screens is greater than the maximum number of the projected screens, calling an error display window through the display control module by the receiving end for display: the maximum screen projection number is full, and screen projection cannot be finished. And prompting the user that the maximum screen projection quantity is reached and the screen projection cannot be performed. And the manual split-screen display is that when the display state of the receiving end is not split-screen display, a mouse clicks or touches a split-screen display button of any screen projection display window to complete the manual split-screen display function of the receiving end.

The screen splitting operation algorithm of the screen splitting operation module comprises the following steps:

the method comprises the following steps: judging the value of the projected screen number variable and the total number of the display screens;

step two: if the variable value m of the number of the projected screens is equal to the total number n of the display screens, each display displays one screen projection display window; if the variable value m of the number of the projected screens is smaller than the total number n of the display screens, each display screen displays a screen projection display window, and the rest display screens do not display screen projection data; if the variable value m of the number of the projected screens is larger than the total number n of the display screens, calculating the value of m/n, and obtaining a quotient a and a remainder b;

step three: if the remainder b is 0, displaying a screen projection windows on each display screen, if the remainder is not 0, displaying a screen projection display windows on each display screen, distributing the screen projection display windows on the remainder b to b display screens, distributing one screen projection display window on each display screen, and normally displaying a screen projection display windows on the rest n-b display screens.

The split-screen display method comprises the following steps of single-screen display layout: each display screen only displays 3 projection screen display windows per line.

When only one screen transmitting source end of the receiving end projects the screen, the full-screen operation is executed by default when the screen splitting operation is carried out.

The receiving terminal display supports the suspension display function, a user clicks a suspension display button of a display operation area of a projection screen display window, the projection screen display window is reduced to be an icon, the icon is suspended and stopped at the right side of the receiving terminal display screen, and the user can drag the suspension icon to change the stopping position. When the user needs to call the display window for displaying the source end of the transmission screen, the display state can be recovered by double clicking the floating icon. When a plurality of devices are subjected to screen projection display, different screen transmission source ends are switched to display more conveniently and quickly.

The screen projection display window is used as an independent application window, so that operations such as dragging, zooming, shrinking and the like can be realized by a program window similar to a normal program window, and different display windows can be displayed in an overlapping and covering mode.

When the receiving end needs to be expanded, the reserved interface of the audio and video playing module of the receiving end can be connected with the plurality of expanded display screens through the HDMI line, so that the expanded display function of the wireless screen transmission display system can be realized.

As a preferred technical solution, in the screen-projecting mode, when a user clicks a full-screen button of a screen-projecting display window, the window enters a full-screen display state, and the user wants to exit the full-screen state of the current screen-projecting display window, a five-finger screen-grabbing operation may be performed, and the touch screen monitoring module at the receiving end detects and processes the five-finger screen-grabbing operation of the user by using a touch algorithm, and then exits the full-screen display state of the current screen-projecting display window.

The processing flow of the touch algorithm of the touch screen monitoring module for the five-finger screen grabbing operation is as follows:

the method comprises the following steps: initializing a touch screen algorithm;

step two: the touch screen scans user input;

step three: judging the distance between adjacent finger contacts, and if the distance is greater than a set threshold value, abandoning the five-finger screen grabbing operation;

step four: judging whether the shaking distance of each finger exceeds a given threshold value;

step five: if the condition of the fourth step is met, storing the touch data for generating a full screen command for exiting the current screen projection display window once, and transmitting the full screen command to the display control module for controlling display.

The invention has the beneficial effects that:

1. the invention solves the problem that the display mode of the existing wireless screen transmission equipment is single, and particularly the problem that friendly and convenient interactive display is not supported when a plurality of pieces of equipment simultaneously project screens.

2. The split screen display proportion and the layout are calculated through the split screen algorithm of the split screen operation module, so that a good display layout effect is achieved during multi-screen display, and the utilization rate of the screen is improved.

3. The expansion of a plurality of displays can be completed through the reserved HDMI interface of the audio and video playing module, and the expansion of screen projection display is more convenient and faster under some application scenes needing temporary expansion display.

4. The operation buttons which can be realized by the user are displayed in the display operation area of the screen projection display window, and when the user realizes screen transmission of multiple devices, the operation buttons have better identification degree and operation effect. And the system information in the screen projection data is displayed in the display operation area, so that the identification efficiency of the user to the screen source end is improved, and the effect is better especially when the screen projection quantity is large.

5. By the aid of the suspension display method, the current screen-projecting display window which does not need to be displayed is zoomed into a small icon which is suspended in the data display area, the screen-projecting serial number is displayed in the small icon, and when multi-screen switching display is carried out, the recognition and switching speed can be remarkably improved, so that the screen-projecting display effect is improved.

6. When the screen-projecting display window is displayed in a full screen mode, the five-finger operation of a user is detected through the touch algorithm of the touch screen monitoring module, the efficiency of exiting the full screen mode is improved, and the screen-projecting display is smoother.

7. The wireless display system stores the wireless hotspot information of the common receiving end through the introduced pairing module, so that repeated pairing operation is avoided, and screen projection efficiency is improved.

Drawings

Fig. 1 is a screen projection display flow chart of the wireless screen transmission device of the invention;

FIG. 2 is a diagram of the components of the wireless screen display system of the present invention;

FIG. 3 is a composition diagram of a screen projection display window of the wireless screen transmission system according to the present invention;

fig. 4 is a diagram of a system for performing extended display when a receiving end is an android intelligent interactive all-in-one machine according to an embodiment of the present invention.

Fig. 5 is a diagram of a multi-screen expansion display system performed when the receiving end is a screen transmission box according to a second embodiment of the present invention.

FIG. 6 is a functional block diagram of a wireless transmission screen display system according to the present invention

Detailed Description

The invention provides a wireless screen transmission display system and a display method. The screen transmission source end mainly completes the collection and coding of screen projection data; the sending end is connected with the screen transmitting source end through the USB interface, communicates with the screen transmitting source end through the HID protocol, and communicates with the receiving end through a wireless communication mode. The receiving terminal is a screen projection display terminal and decodes and displays screen projection data obtained through wireless communication transmission. The wireless transmission screen display scheme mainly comprises suspension display, split screen display, overlapping display, expansion display and the like, and the receiving end can perform automatic split screen display according to the number of transmission screen source end equipment connected currently. The invention realizes the diversification of the screen transmission display forms, improves the utilization rate of the screen, and enables the user to operate more efficiently and quickly during multi-screen projection.

The invention is further illustrated by the following figures and examples.