阅读说明：本技术 文档展示方法、装置、电子设备以及存储介质 (Document display method and device, electronic equipment and storage medium ) 是由 朱禹宏 王乾 晏家红 孙炜 苏政豪 马仪生 于 2020-07-17 设计创作，主要内容包括：本申请公开了一种文档展示方法、装置、电子设备以及存储介质,包括：下载目标文档对应的文档数据,并显示与所述文档数据对应的文档页面；在分享设备直播目标文档的过程中,当接收到所述分享设备针对所述目标文档的编辑指令时,则基于所述编辑指令对所述文档页面进行更新,以展示所述分享设备针对所述目标文档的编辑结果,该方案可以减少流量损耗。(The application discloses a document display method, a document display device, an electronic device and a storage medium, wherein the document display method comprises the following steps: downloading document data corresponding to a target document and displaying a document page corresponding to the document data; in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received, the document page is updated based on the editing instruction so as to show an editing result of the sharing equipment for the target document.)

1. A document presentation method, comprising:

downloading document data corresponding to a target document and displaying a document page corresponding to the document data;

in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received, updating the document page based on the editing instruction so as to display an editing result of the sharing equipment for the target document.

2. The method according to claim 1, wherein in the process of live broadcasting the target document, when an editing instruction of a sharing device for the target document is received, updating the document page based on the editing instruction to show an editing result of the sharing device for the target document includes:

in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received through a signaling transmission channel, analyzing the editing instruction;

and updating the document page based on the analysis result so as to show the editing result of the sharing equipment for the target document.

3. The method according to claim 2, wherein the updating the document page based on the parsing result to show the editing result of the sharing device for the target document comprises:

extracting the editing type and the operation information of the editing instruction from the analysis result;

and updating the document page based on the editing type and the operation information so as to show the editing result of the sharing equipment for the target document.

4. The method according to claim 3, wherein the updating the document page based on the edit type and the operation information to show the edit result of the sharing device for the target document comprises:

detecting whether the editing type is a page switching type or not;

when the editing type is a page switching type, determining a touch point corresponding to an editing instruction of the sharing device for the target document according to the operation information, and updating the document page based on the touch point to show an editing result of the sharing device for the target document;

and when the editing type is not a page switching type, determining an editing point set corresponding to the editing instruction of the sharing device for the target document according to the operation information and the operation information, and updating the document page based on the editing point set to show the editing result of the sharing device for the target document.

5. The method according to claim 4, wherein the updating the document page based on the touch point to show the editing result of the sharing device for the target document comprises:

determining an area corresponding to the touch point in the document page to obtain a touch area;

calling a page switching control corresponding to the touch area;

updating the document page based on the called page switching control so as to show the editing result of the sharing equipment for the target document.

6. The method according to claim 4, wherein the updating the document page based on the set of editing points to show the editing result of the sharing device for the target document comprises:

based on the editing point set, an editing track corresponding to an editing instruction of the sharing device for the target document is established;

and displaying the editing track in the document page to show the editing result of the sharing equipment for the target document.

7. The method according to claim 6, wherein constructing, based on the set of editing points, an editing track corresponding to an editing instruction of the sharing device for the target document includes:

acquiring the position information of each editing point in the editing point set in the sharing equipment interface to obtain first position information of each editing point;

determining the position information of each editing point in the document page based on the size of the current equipment, the size of the sharing equipment and the first position information of each editing point to obtain second position information of each editing point;

and constructing an editing track corresponding to the editing instruction of the sharing equipment for the target document based on the second position information of each editing point and the editing point set.

8. The method according to claim 2, wherein in the process of live broadcasting the target document, when an editing instruction of the sharing device for the target document is received through a signaling transmission channel, parsing the editing instruction includes:

in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received through a signaling transmission channel, extracting a timestamp and an instruction identifier of the editing instruction;

and analyzing the editing instruction based on the timestamp and the instruction identification of the editing instruction.

9. The method according to any one of claims 1 to 8, wherein the downloading document data corresponding to the target document and displaying a document page corresponding to the document data includes:

downloading document data corresponding to the target document from the server through a data transmission channel;

and when the completion of the downloading is detected, cutting off the transmission of the document data between the data transmission channel and the data transmission channel, and displaying the document page corresponding to the target document according to the downloaded document data.

10. The method of any one of claims 1 to 8, further comprising:

detecting the data integrity of the downloaded document data;

and when the detection result indicates that the downloaded document data is missing, resuming the transmission of the document data with the data transmission channel.

11. A document presentation apparatus, comprising:

the downloading module is used for downloading the document data corresponding to the target document and displaying the document page corresponding to the document data;

the display module is used for updating the document page based on an editing instruction when the editing instruction of the sharing device for the target document is received in the process of live broadcasting of the target document by the sharing device so as to display the editing result of the sharing device for the target document.

12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the document presentation method according to any one of claims 1-10 are implemented when the program is executed by the processor.

13. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when being executed by a processor, carries out the steps of the document presentation method according to any one of claims 1 to 10.

Technical Field

The invention relates to the technical field of computers, in particular to a document display method and device, electronic equipment and a storage medium.

Background

With the development of internet technology, a network architecture capable of realizing direct communication between people, between people and machines, between people and objects, and even between objects is gradually formed, and is widely applied to various fields such as education and the like. The concept of an online classroom has been proposed, and various online classroom applications for transmitting contents of lectures given by teachers to students through a network have been gradually developed.

When the teacher gives lessons on line, the video stream can be collected through the camera of the terminal equipment, then the live lessons are realized through the network transmission mode, however, the mode can cause great flow loss, and the buffer is easy to appear for many times.

Disclosure of Invention

The application provides a document display method, a document display device, an electronic device and a storage medium, which can reduce flow loss and avoid the situation of multiple buffering.

The application provides a document display method, which comprises the following steps:

downloading document data corresponding to a target document and displaying a document page corresponding to the document data;

in the process of live broadcasting the target document, when an editing instruction of the sharing device for the target document is received, updating the document page based on the editing instruction so as to show an editing result of the sharing device for the target document.

Correspondingly, this application still provides a document display device, includes:

the downloading module is used for downloading the document data corresponding to the target document and displaying the document page corresponding to the document data;

the display module is used for updating the document page based on an editing instruction when the editing instruction of the sharing device for the target document is received in the process of live broadcasting of the target document by the sharing device so as to display the editing result of the sharing device for the target document.

Optionally, in some embodiments of the present application, the display module includes:

the analysis submodule is used for analyzing an editing instruction of the sharing equipment aiming at the target document when the editing instruction of the sharing equipment aiming at the target document is received through a signaling transmission channel in the process of live broadcasting the target document by the sharing equipment;

and the display sub-module is used for updating the document page based on the analysis result so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments of the present application, the display sub-module includes:

the extracting unit is used for extracting the editing type and the operation information of the editing instruction from the analysis result;

and the display unit is used for updating the document page based on the editing type and the operation information so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments of the present application, the display unit includes:

the detection unit is used for detecting whether the editing type is a page switching type or not;

the first determining unit is used for determining a touch point corresponding to an editing instruction of the target document by the sharing device according to the operation information when the editing type is a page switching type;

the first display unit is used for updating the document page based on the touch point so as to display an editing result of the sharing equipment for the target document;

a second determining unit, configured to determine, according to the operation information and according to the operation information, an edit point set corresponding to an edit instruction of the target document by the sharing device when the edit type is not a page switching type;

and the second display unit is used for updating the document page based on the editing point set so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments of the present application, the first display unit is specifically configured to:

determining an area corresponding to the touch point in the document page to obtain a touch area;

calling a page switching control corresponding to the touch area;

updating the document page based on the called page switching control so as to show the editing result of the sharing equipment for the target document.

Optionally, in some embodiments of the present application, the second display unit includes:

the building subunit is configured to build, based on the edit point set, an edit trajectory corresponding to an edit instruction of the sharing device for the target document;

and the display subunit is configured to display the editing track in the document page so as to display an editing result of the sharing device for the target document.

Optionally, in some embodiments of the present application, the display subunit is specifically configured to:

obtaining the position information of each editing point in the editing point set in the sharing equipment interface to obtain the first position information of each editing point

Determining the position information of each editing point in the document editing page based on the size of the current equipment, the size of the sharing equipment and the first position information of each editing point to obtain second position information of each editing point;

and constructing an editing track corresponding to the editing instruction of the sharing equipment for the target document based on the second position information of each editing point and the editing point set.

Optionally, in some embodiments of the present application, the parsing module is specifically configured to:

when an editing instruction of the sharing equipment for the target document is received through a signaling transmission channel in the process of live broadcasting the target document, extracting a timestamp and an instruction identifier of the editing instruction;

and analyzing the editing instruction based on the timestamp and the instruction identification of the editing instruction.

Optionally, in some embodiments of the present application, the downloading module is specifically configured to:

downloading document data corresponding to the target document from a server through a data transmission channel;

and when the completion of the downloading is detected, cutting off the transmission of the document data between the data transmission channel and the data transmission channel, and displaying the document page corresponding to the target document according to the downloaded document data.

Optionally, in some embodiments of the present application, the apparatus further includes a detection module, where the detection module is specifically configured to:

detecting the data integrity of the downloaded document data;

and when the detection result indicates that the downloaded document data is missing, resuming the transmission of the document data with the data transmission channel.

According to the method and the device, the document data corresponding to the target document are downloaded firstly, the document page corresponding to the document data is displayed, and in the process of live broadcasting of the target document, when an editing instruction of sharing equipment for the target document is received, the document page is updated based on the editing instruction so as to show the editing result of the sharing equipment for the target document. Therefore, the scheme can improve and reduce the flow loss, the situation of multiple buffering can not occur, in addition, because the sharing equipment can compress the target document and then upload the target document to the server, when the document display is carried out by adopting real-time network transmission, the picture quality can have certain distortion due to image compression transmission, the definition can be reduced, and in the scheme of the application, the picture in the sharing equipment can be restored without distortion by receiving the editing instruction of the sharing equipment for the target document and updating the document page based on the received instruction, and the display effect of the document display is further improved.

Drawings

In order to more clearly illustrate the technical solutions in the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1a is a schematic view of a document presentation method provided in the present application;

FIG. 1b is a schematic flow chart of a document presentation method provided by the present application;

FIG. 1c is a diagram illustrating a document page being updated according to the document display method provided by the present application;

FIG. 1d is another schematic diagram illustrating a document page being updated according to the document display method provided in the present application;

FIG. 2a is another schematic flow chart of a document presentation method provided by the present application;

FIG. 2b is a flow chart of a document presentation system provided herein;

FIG. 2c is a schematic diagram of another scenario of a document presentation method provided in the present application;

FIG. 3a is a schematic structural diagram of a document presentation apparatus provided herein;

FIG. 3b is a schematic diagram of the structure of a document presentation apparatus provided herein;

fig. 4 is a schematic structural diagram of an electronic device provided in the present application.

Detailed Description

The technical solutions in the present application will be described clearly and completely with reference to the accompanying drawings in the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The application provides a document display method, a document display device, electronic equipment and a storage medium.

The document display device can be specifically integrated in a server, the server can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and the document display device can also be a cloud server for providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, network service, cloud communication, middleware service, domain name service, security service, CDN (content delivery network), big data and artificial intelligence platforms and the like. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.

For example, referring to fig. 1a, the present application provides a document display system, which includes a sharing device 10, a shared device 20 and a server 30, wherein the document display apparatus is integrated on the shared device 20, when a user a shares a target document with a user B of the shared device 20 through the sharing device 10, the shared device 20 may download document data corresponding to the target document from the server 30 through a data transmission channel, that is, when the sharing device 10 broadcasts the target document directly, the shared device 20 may download document data corresponding to the target document from the server 30 through the data transmission channel, when the shared device 20 detects that the downloading is completed, the transmission between the shared device and the data transmission channel is cut off, and a document page corresponding to the target document is displayed according to the downloaded document data, if the user a triggers an editing operation on the target document through the sharing device 10, the sharing device 10 may trigger an editing operation to generate a corresponding editing instruction according to the target document, and upload the generated editing instruction to the server 30, so that the server 30 sends the generated editing instruction to the shared device 20 through the signaling transmission channel, that is, when the shared device 20 receives the editing instruction of the sharing device 10 for the target document through the signaling transmission channel, the editing instruction is parsed, and finally, the shared device 20 updates the document page based on the parsing result to show the editing result of the sharing device for the target document.

According to the document display method, after the document data corresponding to the target document is downloaded from the server, when the completion of downloading is detected, the transmission of the document data between the server and the data transmission channel is cut off, the flow loss is reduced, the situation of multiple buffering is avoided, meanwhile, the connection between the server and the signaling transmission channel is maintained, and the editing result of the sharing equipment for the target document can be displayed in the live broadcast process of the target document.

The following are detailed below. It should be noted that the description sequence of the following embodiments is not intended to limit the priority sequence of the embodiments.

A document presentation method comprising: downloading document data corresponding to a target document, displaying a document page corresponding to the document data, and updating the document page based on an editing instruction when the sharing device receives the editing instruction of the sharing device for the target document in the process of live broadcasting the target document by the sharing device so as to display the editing result of the sharing device for the target document.

Referring to fig. 1b, fig. 1b is a schematic flow chart of a document display method provided in the present application. The specific flow of the document display method can be as follows:

101. and downloading document data corresponding to the target document, and displaying document pages corresponding to the document data.

For example, the data transmission channel may be directly or indirectly connected to the server through a data transmission channel by using a wired or wireless communication manner, and it should be noted that, in this application, the data transmission channel may only transmit document data corresponding to a target document, where the number and type of the data transmission channel are not limited in this application, and the number of the data transmission channel may be determined according to the number of communication channels that can be supported by the server, and may include any number of WiFi channels, third Generation mobile communication technology (3G) channels, 4G channels, fifth Generation mobile communication technology (5G) channels, bluetooth channels, wired channels, and the like, for example.

For example, after the sharing device uploads the document data of the target document to the server, or the server has stored the document data of the target document, the sharing device may download the document data corresponding to the target document from the server through the data transmission channel, and in order to increase the transmission rate, the sharing device may compress the target document, so that, during the downloading process, the document data may be decompressed and verified, after the downloading is completed, the transmission of the document data with the data transmission channel is cut off, and the document page corresponding to the target document is displayed according to the downloaded document data.

After the downloading is completed, the document page corresponding to the target document may be displayed according to the downloaded document data, and at this time, the transmission of the document data with the data transmission channel is cut off, that is, optionally, the step "downloading the document data corresponding to the target document and displaying the document page corresponding to the document data" may specifically include: and downloading the document data corresponding to the target document from the server through the data transmission channel, cutting off the transmission of the document data between the server and the data transmission channel when the completion of the downloading is detected, and displaying the document page corresponding to the target document according to the downloaded document data.

In addition, for some scenes, when the transmission of the document data between the audio data channel and the data transmission channel is cut off, the transmission between the audio data channel and the audio data channel can be maintained, so that the audio stream data can be obtained in real time to ensure the sound transmission, for example, in the scene of live lecture, when the document data downloading is detected to be completed, the transmission of the document data between the audio data channel and the data transmission channel can be cut off, at the moment, the transmission between the audio data channel and the data transmission channel is kept, so that the sound of a user corresponding to the sharing equipment can be obtained in real time, and the lecture quality of the live lecture.

It should be noted that, after the document data is downloaded, the downloaded document data may be incomplete due to problems such as adaptability of different devices or abnormal loading of the target document, and when the downloaded document data is incomplete, a downgrading operation may be performed, that is, communication between the downloaded document data and the data transmission channel is recovered, that is, in some embodiments, the method may specifically include:

(11) detecting the data integrity of the downloaded document data;

(12) when the detection result indicates that there is a missing of the downloaded document data, the transmission of the document data with the data transmission channel is resumed.

102. In the process of live broadcasting of the target document by the sharing equipment, when an editing instruction of the sharing equipment for the target document is received, the document page is updated based on the editing instruction so as to show an editing result of the sharing equipment for the target document.

In some embodiments, the step "in the process of live broadcasting the target document by the sharing device, when the sharing device receives the edit instruction for the target document, update the document page based on the edit instruction to show the edit result of the sharing device for the target document" may specifically include: in the process of live broadcasting of the target document by the sharing equipment, when an editing instruction of the sharing equipment for the target document is received through the signaling transmission channel, the editing instruction is analyzed, and the document page is updated based on the analysis result so as to show the editing result of the sharing equipment for the target document.

For example, specifically, in a teaching scene, the sharing device may collect editing operations performed by a teaching user for a target document, then create a signaling transmission channel with the server, and transmit the editing operations to the server through the signaling transmission channel, so that all the editing operations of the teaching user may be converted into an editing instruction, where the type of the editing instruction may include: open, close, flip, open brush, and stylus coordinates, etc. Each editing instruction is provided with a timestamp and a sequence number and is used for sequencing verification and packet loss verification, and the steps of "in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received through a signaling transmission channel, analyzing the editing instruction" specifically include:

(21) in the process of live broadcasting of a target document by sharing equipment, when an editing instruction of the sharing equipment for the target document is received through a signaling transmission channel, extracting a timestamp and an instruction identifier of the editing instruction;

(22) and analyzing the editing instruction based on the timestamp and the instruction identification of the editing instruction.

The time stamp and the instruction identification of the editing instruction are used for correcting sound-picture synchronization, pulling the editing instruction, retransmitting overtime, re-pulling packet loss and the like. The sharing device is ensured to perform synchronous display for each editing operation of the target document, for example, when receiving an editing instruction a and an editing instruction B, a timestamp bit 20 of the editing instruction a: 00, instruction identification of edit instruction a is 3012, time stamp bit 20 of edit instruction B: 02, the instruction identifier of the editing instruction B is 3015, it is known that there are two editing instructions between the editing instruction a and the editing instruction B, and the identifiers corresponding to the two editing instructions are 3013 and 3014, at this time, the editing instruction needs to be pulled to the server again, so that the identifiers of the pulled editing instructions are continuous, and the editing result of the sharing device for the target document is displayed.

Further, parameters corresponding to the editing operation, such as an editing type and operation information, may be extracted from the parsing result, and then the document page is updated based on the extracted parameters to show the editing result of the sharing device for the target document, that is, optionally, in some embodiments, the step "updating the document page based on the parsing result to show the editing result of the sharing device for the target document" may specifically include:

(31) extracting the editing type and the operation information of the editing instruction from the analysis result;

(32) and updating the document page based on the editing type and the operation information so as to show the editing result of the sharing equipment for the target document.

The editing operation may include opening, closing, turning pages, opening a painting brush, marking, and the like, and it is understood that in the present application, the editing operation may be divided into two categories, one category is a page switching type, such as page switching operations of opening, closing, turning pages, and the like, and the other category is not a page switching type, such as opening a painting brush, marking, and the like, and further, the document page may be updated according to whether the editing type is a page switching type, so as to show an editing result of the sharing device for the target document, that is, optionally, in some embodiments, the step "updating the document page based on the editing type and the operation information, so as to show an editing result of the sharing device for the target document" may specifically include:

(41) detecting whether the editing type is a page switching type or not;

(42) when the editing type is a page switching type, determining a touch point corresponding to the editing operation of the sharing equipment for the target document according to the operation information, and updating the document page based on the touch point to show the editing result of the sharing equipment for the target document;

(43) and when the editing type is not the page switching type, determining an editing point set corresponding to the editing operation of the sharing equipment for the target document according to the operation information, and updating the document page based on the editing point set so as to show the editing result of the sharing equipment for the target document.

When the editing type is a page switching type, a region of a touch point in a document page may be determined, and then a corresponding space is called based on the determined region to update the document page, that is, optionally, in some embodiments, the step "updating the document page based on the touch point to show an editing result of the sharing device for the target document" may specifically include:

(51) determining an area corresponding to the touch point in the document page to obtain a touch area;

(52) calling a page switching control corresponding to the touch area;

(53) and updating the document page based on the called page switching control so as to show the editing result of the sharing equipment for the target document.

For example, referring to fig. 1c, an area of the touch point a in the document page is an area L (i.e., a touch area), and a page switching control corresponding to the area L is a page-down control b, at this time, the current page of the target document may be switched to a next page or a previous page of the current page according to the page-down control, that is, the document page is updated based on the called page switching control.

When the edit type is not a page switching type, an edit operation triggered by the sharing device for the target document may be determined according to the edit point set, such as marking a certain position of the target document, or invoking a corresponding control to edit a document page, that is, optionally, in some embodiments, the step "updating the document page based on the edit point set to show an edit result of the sharing device for the target document" may specifically include:

(61) based on the editing point set, establishing an editing track corresponding to the editing operation of the sharing equipment for the target document;

(62) and displaying an editing track in the document page to show an editing result of the sharing equipment for the target document.

For example, in a teaching scene, a user of the sharing device (hereinafter referred to as a sharing user) marks one text of a target document, and as shown in fig. 1d, the sharing user marks "X +3Y ═ 8", so that an editing track of the sharing user for the target document can be constructed according to an editing point set, and then the editing track is displayed in a document page of the local device to show an editing result of the sharing device for the target document; for another example, in some embodiments, if the sharing user invokes a page editing control, such as a brush control, the editing result of the sharing device for the target document may be displayed in the document page according to the timestamp of the editing point.

It should be noted that, because the sharing device may have a size different from that of the current device, the position of each edit point in the document page may be determined according to the size of the current device and the size of the sharing device, that is, optionally, in some embodiments, the step "construct an edit trajectory corresponding to an edit operation of the sharing device on the target document based on the edit point set" specifically may include:

(71) acquiring the position information of each editing point in the editing point set in a sharing equipment interface to obtain the first position information of each editing point

(72) Determining the position information of each editing point in the document page based on the size of the current equipment, the size of the sharing equipment and the first position information of each editing point to obtain second position information of each editing point;

(73) and constructing an editing track corresponding to the editing operation of the sharing equipment for the target document based on the second position information of each editing point and the editing point set.

Specifically, the ratio between the size of the current device and the size of the sharing device may be calculated to obtain ratio information between the size of the current device and the size of the sharing device, and then, based on the first position information of each editing point and the calculated ratio information, an editing track corresponding to the editing operation of the sharing device for the target document is constructed.

The method comprises the steps of firstly downloading document data corresponding to a target document, displaying a document page corresponding to the document data, updating the document page based on an editing instruction when the editing instruction of a sharing device for the target document is received in the process of live broadcasting of the target document by the sharing device, so as to display the editing result of the sharing device for the target document, wherein the document display method provided by the application can improve and reduce flow loss, and avoids the situation of multiple buffering, in addition, because the sharing device compresses the target document and then uploads the target document to a server, when the document display is carried out by adopting real-time network transmission, the image quality can have certain distortion due to image compression transmission, and the definition can be reduced, and in the scheme of the application, the document page is updated based on the received instruction by receiving the editing instruction of the sharing device for the target document, the picture in the sharing equipment can be restored without distortion, and the display effect of document display is further improved.

The method according to the examples is further described in detail below by way of example.

In the present embodiment, the document presentation apparatus is specifically integrated in a terminal as an example.

Referring to fig. 2a, a document display method may include the following specific processes:

201. and the terminal downloads the document data corresponding to the target document from the server through the data transmission channel in the process of live broadcasting the target document by the sharing equipment.

For example, the terminal may be directly or indirectly connected to the server through a data transmission channel by using a wired or wireless communication manner, it should be noted that, in the present application, the data transmission channel can only transmit the document data corresponding to the target document, the number and type of the data transmission channels are not limited in the present application, and the number of the data transmission channels may be determined according to the number of communication channels that can be supported with the server, for example, any of a WiFi channel, a third Generation mobile communication technology (3G) channel, a fourth Generation mobile communication technology (4G) 4G channel, a fifth Generation mobile communication technology (5G) channel, a bluetooth channel, a wired channel, and The like may be included.

After the sharing device uploads the document data of the target document to the server, or the server already stores the document data of the target document, the terminal can download the document data corresponding to the target document from the server through the data transmission channel, and in order to improve the transmission rate, the sharing device can compress the target document, so that the terminal can decompress and check the document data in the downloading process.

202. And when the terminal detects that the downloading is finished, cutting off the transmission of the document data between the terminal and the data transmission channel, and displaying the document page corresponding to the target document according to the downloaded document data.

For example, in a live lecture scene, when detecting that document data is downloaded, the terminal may cut off transmission of the document data between the terminal and the data transmission channel, at this time, the terminal retains transmission between the terminal and the audio data channel to obtain sound of a user corresponding to the sharing device in real time, thereby ensuring lecture quality of the live lecture.

203. When the terminal receives an editing instruction of the sharing device for the target document through the signaling transmission channel, the editing instruction is analyzed.

For example, in a teaching scene, the sharing device may collect editing operations performed by a teaching user for a target document, then create a signaling transmission channel with the server, transmit the editing operations to the server through the signaling transmission channel, convert all editing operations of the teaching user into editing instructions, extract a timestamp and an instruction identifier of the editing instructions when the terminal receives the editing instructions for the target document through the signaling transmission channel, and finally, analyze the editing instructions based on the timestamp and the instruction identifier of the editing instructions.

204. And the terminal updates the document page based on the analysis result so as to display the editing result of the sharing equipment for the target document.

For example, specifically, the terminal may extract parameters corresponding to the editing operation, such as an editing type and operation information, from the parsing result, and then update the document page based on the extracted parameters, so as to show the editing result of the sharing device for the target document.

In the application, the editing operation can be divided into two major categories, one is a page switching type, such as page switching operations of opening, closing, page turning and the like, and the other is not a page switching type, such as a painting brush and a mark, and further, whether the editing type is the page switching type or not can be determined according to the fact that the editing type is the page switching type or not, namely, the terminal can detect whether the editing type is the page switching type or not, when the editing type is the page switching type, the terminal determines a touch point corresponding to the editing operation of the sharing device for the target document according to the operation information, and updates the document page based on the touch point so as to display the editing result of the sharing device for the target document; and when the editing type is not the page switching type, the terminal determines an editing point set corresponding to the editing operation of the sharing equipment for the target document according to the operation information, and updates the document page based on the editing point set so as to show the editing result of the sharing equipment for the target document.

To facilitate further understanding of the document display scheme of the present application, please refer to fig. 2b, which is a flowchart of a document display system, wherein the document display system includes a teacher end (i.e., a sharing device), a student end (i.e., a shared device), and a server, the teacher end provides operations such as Portable Document Format (PDF) import, document presentation, document selection, brush selection, page turning, and revocation, and further includes three teaching modes: the device comprises a camera mode, a screen sharing mode and a pdf mode, when a teacher (namely a user of the sharing device) selects the pdf mode, guidance is displayed to guide the teacher to import the pdf, and the pdf mode is composed of three layers of views. From top to bottom are the brush layout, pdf layout and screen layout, as shown in fig. 2 c. When a teacher opens a pdf mode teaching, video stream push streaming operation is carried out, a pdf file picture opened by the teacher in an embedded pdf layout and a comment operation picture carried out by the teacher on a painting brush layout are obtained, two layers of pictures are spliced, and picture interception, transcoding and push streaming are carried out to carry out video stream push streaming live broadcasting.

Meanwhile, the teacher end uploads and encrypts the pdf file and stores the pdf file of the teacher in the server. And simultaneously, the teacher records and uploads the operation instructions (page turning, opening, closing, painting and canceling, and the like). When the pdf file of the teacher is uploaded successfully or when the server stores the pdf file of the teacher when the student (i.e. the user of the shared device) enters the classroom, the server notifies the student terminal to download the pdf file and carry the downloaded uniform resource locator. The student end can download, decompress and check the files. And when the downloading is finished, the student end opens the pdf layout to load and display the pdf file. At this time, the video stream data transmission of the student end is cut off, and only the data transmission of the audio stream is maintained, so that the sound transmission is ensured. Therefore, the teacher end and the student end complete the document picture synchronization independent of the video stream

In order to achieve the real-time effect of live class, after the student end opens the document of the teacher, various operations of the teacher need to be synchronized in real time. The teacher end records various operations of the teacher as a data set. The data types are as follows: open, close, page, open brush, stylus coordinates, and brush path. Each piece of data is provided with a timestamp and a sequence number for sequencing check and packet loss check.

The teacher end packs the data to be uploaded and transmitted in real time, the server end transmits the data after transferring, and the data packets are transmitted through a transmission protocol. The student receives the data packets, unpacks and analyzes the data packets, obtains a real-time instruction of the teacher end, synchronizes real-time operations on pdf layout of the student end, performs painting brush operations on a data set in which teacher stylus coordinates and painting brush paths are recorded, has a layer of painting brush layout on the upper layer of a live broadcast picture of the student end, draws through canvas, synchronizes relative coordinate conversion of the teacher painting brush, draws and presents the same painting brush effect. At the moment, the definition of the picture is low, the consumption of network bandwidth flow is high, when the pdf loading of the student end is finished and the data packet analysis is finished, the pdf layout is covered on the original video stream picture, and meanwhile, the video stream data transmission is stopped, and the live broadcast mode is switched.

When the student end has problems such as model adaptation reasons or abnormal loading of pdf files, degradation operations can be performed, such as closing pdf layout, opening video stream transmission, and watching video stream live broadcast.

The terminal downloads the document data corresponding to the target document from the server through the data transmission channel in the process of live broadcasting the target document by the sharing equipment, cuts off the transmission of the document data between the terminal and the data transmission channel when detecting that the downloading is finished, displays the document page corresponding to the target document according to the downloaded document data, analyzes the editing instruction when receiving the editing instruction of the sharing equipment for the target document through the signaling transmission channel, and finally updates the document page based on the analysis result to show the editing result of the sharing equipment for the target document. Meanwhile, the connection between the sharing device and the signaling transmission channel is kept, and the editing result of the sharing device for the target document can be displayed in the live broadcast process of the target document.

In order to better implement the document display method of the present application, the present application further provides a document display device (display device for short) based on the above document display method. Wherein the meanings of the nouns are the same as those in the document showing method, and the specific implementation details can refer to the description in the method embodiment.

Referring to fig. 3a, fig. 3a is a schematic structural diagram of a document display apparatus provided in the present application, wherein the distribution apparatus may include a downloading module 301 and a display module 302, which may specifically be as follows:

a downloading module 301, configured to download the document data corresponding to the target document, and display the document page corresponding to the document data.

For example, specifically, the downloading module 301 may be directly or indirectly connected to the server through a data transmission channel by using a wired or wireless communication manner, and it should be noted that, in this application, the data transmission channel may only transmit document data corresponding to a target document, where the number and type of the data transmission channel are not limited in this application, and the number of the data transmission channel may be determined according to the number of communication channels that can be supported by the server, and may include any multiple of a WiFi channel, a third Generation mobile communication technology (3G) channel, a 4G channel, a fifth Generation mobile communication technology (5G) channel, a bluetooth channel, a wired channel, and the like. It should be noted that, in a live scene, the document data may be downloaded during a live process, or may be downloaded in advance (that is, before the live scene), for example, a student downloads a courseware (document data) uploaded by a teacher in advance before a lesson is performed, and after the download is completed, a document page corresponding to a target document may be displayed according to the downloaded document data, at this time, transmission of the document data between the student and the data transmission channel is cut off, that is, optionally, the downloading module 301 may be specifically configured to: and downloading the document data corresponding to the target document from the server through the data transmission channel, cutting off the transmission of the document data between the server and the data transmission channel when the completion of the downloading is detected, and displaying the document page corresponding to the target document according to the downloaded document data.

In addition, for some scenarios, when the transmission of the document data with the data transmission channel is cut off, the transmission with the audio data channel may be maintained, so that audio stream data may be obtained in real time to ensure sound transmission, after the document data is downloaded, due to problems such as adaptability of different devices or abnormal loading of a target document, the downloaded document data may be incomplete, and when the downloaded document data is incomplete, a degradation operation may be performed, that is, optionally, in some embodiments, referring to fig. 3b, the presentation apparatus may further include a detection module 303, where the detection module 303 may be specifically configured to: and detecting the data integrity of the downloaded document data, and when the detection result indicates that the downloaded document data is missing, resuming the transmission of the document data with the data transmission channel.

The displaying module 302 is configured to, in a process of live broadcasting a target document by a sharing device, update a document page based on an editing instruction when the sharing device receives the editing instruction for the target document, so as to display an editing result of the sharing device for the target document.

The editing instruction may be parsed, and the document page may be updated based on the parsing result, so as to display the editing result of the sharing device for the target document, that is, optionally, the display module 302 may specifically include:

the analysis submodule is used for analyzing an editing instruction of the sharing equipment aiming at the target document when the editing instruction of the sharing equipment aiming at the target document is received through the signaling transmission channel in the process of live broadcasting the target document by the sharing equipment;

and the display sub-module is used for updating the document page based on the analysis result so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments, the display sub-module may specifically include

The extraction unit is used for extracting the editing type and the operation information of the editing instruction from the analysis result;

and the display unit is used for updating the document page based on the editing type and the operation information so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments, the display unit may specifically include:

the detection unit is used for detecting whether the editing type is a page switching type or not;

the first determining unit is used for determining a touch point corresponding to the editing operation of the sharing equipment for the target document according to the operation information when the editing type is the page switching type;

the first display unit is used for updating the document page based on the touch point so as to display the editing result of the sharing equipment for the target document;

the second determining unit is used for determining an editing point set corresponding to the editing instruction of the sharing equipment for the target document according to the operation information and the operation information when the editing type is not the page switching type;

and the second display unit is used for updating the document page based on the editing point set so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments, the first display unit may be specifically configured to: determining an area corresponding to the touch point in the document page to obtain a touch area, calling a page switching control corresponding to the touch area, and updating the document page based on the called page switching control so as to show an editing result of the sharing device for the target document.

Optionally, in some embodiments, the second display unit may specifically include:

the construction subunit is used for constructing an editing track corresponding to the editing instruction of the sharing device for the target document based on the editing point set;

and the display subunit is used for displaying the editing track in the document page so as to display the editing result of the sharing equipment for the target document.

Optionally, in some embodiments, the display subunit may be specifically configured to: the method comprises the steps of obtaining position information of all editing points in an editing point set in a sharing device interface, obtaining first position information of all editing points, determining the position information of all editing points in a document editing page based on the size of current equipment, the size of sharing equipment and the first position information of all editing points, obtaining second position information of all editing points, and constructing an editing track corresponding to an editing instruction of the sharing equipment for a target document based on the second position information of all editing points and the editing point set.

In the present application, the downloading module 301 downloads the document data corresponding to the target document and displays the document page corresponding to the document data, and the displaying module 302 updates the document page based on the editing instruction to display the editing result of the sharing device for the target document when receiving the editing instruction of the sharing device for the target document in the process of live broadcasting the target document by the sharing device, the document displaying apparatus provided in the present application can reduce the flow loss and avoid the situation of multiple buffering, furthermore, because the sharing device compresses the target document and then uploads the target document to the server, when the document is displayed by real-time network transmission, the picture quality will have a certain distortion due to image compression transmission, and the definition will be reduced, and in the solution of the present application, the document page is updated based on the received instruction by the receiving device for the editing instruction of the target document, the picture in the sharing equipment can be restored without distortion, and the display effect of document display is further improved.

In addition, the present application also provides an electronic device, as shown in fig. 4, which shows a schematic structural diagram of the electronic device related to the present application, specifically:

the electronic device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 4 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the processor 401 is a control center of the electronic device, connects various parts of the whole electronic device by various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.

The electronic device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

The electronic device may further include an input unit 404, and the input unit 404 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the electronic device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application program stored in the memory 402, thereby implementing various functions as follows:

downloading document data corresponding to a target document, displaying a document page corresponding to the document data, and updating the document page based on an editing instruction when the sharing device receives the editing instruction of the sharing device for the target document in the process of live broadcasting the target document by the sharing device so as to display the editing result of the sharing device for the target document.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

The method comprises the steps of firstly downloading document data corresponding to a target document, displaying a document page corresponding to the document data, updating the document page based on an editing instruction when the editing instruction of a sharing device for the target document is received in the process of live broadcasting of the target document by the sharing device, so as to display the editing result of the sharing device for the target document, wherein the document display method provided by the application can improve and reduce flow loss, and avoids the situation of multiple buffering, in addition, because the sharing device compresses the target document and then uploads the target document to a server, when the document display is carried out by adopting real-time network transmission, the image quality can have certain distortion due to image compression transmission, and the definition can be reduced, and in the scheme of the application, the document page is updated based on the received instruction by receiving the editing instruction of the sharing device for the target document, the picture in the sharing equipment can be restored without distortion, and the display effect of document display is further improved.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium having stored therein a plurality of instructions that can be loaded by a processor to perform the steps of any of the document presentation methods provided herein. For example, the instructions may perform the steps of:

downloading document data corresponding to a target document, displaying a document page corresponding to the document data, and updating the document page based on an editing instruction when the sharing device receives the editing instruction of the sharing device for the target document in the process of live broadcasting the target document by the sharing device so as to display the editing result of the sharing device for the target document.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium can execute the steps in any document presentation method provided by the present application, the beneficial effects that any document presentation method provided by the present application can achieve can be achieved, see the foregoing embodiments for details, and are not described herein again.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations described above.

The document display method, the document display apparatus, the electronic device, and the storage medium provided by the present application are described in detail above, and a specific example is applied in the present application to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.