阅读说明：本技术 一种直播教学中辅助用户进行信息录入的方法及装置 (Method and device for assisting user in information input in live broadcast teaching ) 是由 魏超男 于 2020-04-08 设计创作，主要内容包括：本申请实施例公开了一种直播教学中辅助用户进行信息录入的方法、装置、电子设备及存储介质。本申请实施例提供的技术方案,通过在直播教学过程中,不断记录用户的输入操作,并将事件输入操作与直播视频进行关联,进而实现在同步的直播视频上进行标记。使得学生回看直播时能够观看对应的操作记录,起到提示的作用,也便于学生对直播内容进行复习回顾。(The embodiment of the application discloses a method and a device for assisting a user in information input in live broadcast teaching, electronic equipment and a storage medium. According to the technical scheme, the input operation of the user is continuously recorded in the live broadcast teaching process, the event input operation is associated with the live broadcast video, and then the live broadcast video is synchronously marked. The student can watch the corresponding operation record when reviewing the live broadcast, thereby playing the role of prompting and being convenient for the student to review the live broadcast content.)

1. A method for assisting a user in information input in live broadcast teaching is characterized by comprising the following steps:

when the note recording module is detected to be triggered, generating a note recording layer;

receiving event input operation associated with a user, and recording the event input operation through the note recording layer;

and performing associated storage on the recorded event input operation and the live video to obtain a note live video.

2. The method for assisting a user in information entry in live education as claimed in claim 1 wherein associating the recorded event input action with a live video comprises:

respectively recording video frame information when an event input operation starts and video frame information when the event input operation ends;

and acquiring all event input operations from the video frame information at the beginning to the video frame information at the end, and recording all event input operations in a note recording layer.

3. The method of claim 2, wherein the video frame information includes a teacher frame and a courseware frame, and the event input operation is triggered when the courseware frame is played.

4. The method for assisting a user in information entry in live teaching according to claim 3, wherein when the courseware picture is played, an operation key is displayed on a playing interface, and when the operation key is triggered, the current time is determined as the start time corresponding to the event input operation.

5. The method for assisting a user in information entry in live education as claimed in claim 3 wherein the event input operation includes at least one of:

performing operation of inputting character information through the character input box;

performing stroke information input operation through a touch display screen;

and carrying out content marking operation through a marking tool.

6. The method of assisting a user in information entry in live education as claimed in claim 3, wherein the event input operation further comprises:

and converting the voice information input by the user to obtain corresponding character information and performing recording operation.

7. The method for assisting the user in information entry in live teaching according to any one of claims 1 to 6, wherein the live note video is stored in a tablet terminal or a background server of the user, and the live note video is associated with a corresponding student account;

after the recorded event input operation and the live video are stored in an associated manner to obtain a note live video, the method further comprises the following steps:

playing the note live video according to the received playing instruction;

and deleting the live note video according to the received deletion instruction.

8. The utility model provides a supplementary user carries out information input's device in live teaching which characterized in that includes:

a triggering module: the note recording module is used for generating a note recording layer when the note recording module is detected to be triggered;

a detection module: the note recording layer is used for receiving event input operation associated with a user and recording the event input operation;

a storage module: and the event input operation and the live video are recorded and stored in an associated manner to obtain the note live video.

9. An electronic device, comprising:

a memory and one or more processors;

the memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method for assisting a user in information entry in live instruction as recited in any of claims 1-7.

10. A storage medium containing computer-executable instructions for performing a method of assisting a user in information entry in live education as claimed in any one of claims 1-7 when executed by a computer processor.

Technical Field

The embodiment of the application relates to the technical field of electronic equipment, in particular to a method and a device for assisting a user in information input in live broadcast teaching.

Background

At present, in the live broadcasting teaching process, students generally need to additionally find a notebook to perform note recording or directly open word documents at a computer end to perform note recording. However, when the note is recorded by the above method, knowledge points in the course of listening are easy to miss, and the idea of the user cannot be recorded in time. When playing back live video, it is easy to miss the important point of the content to be recorded at that time because it is not recorded in time, so there is a defect that needs to be improved.

Disclosure of Invention

The embodiment of the application provides a method and a device for assisting a user in information input in live broadcast teaching, which can associate notes with a live broadcast video page and further assist the user in lecture attending marking.

In a first aspect, an embodiment of the present application provides a method for assisting a user in information entry in live broadcast teaching, including:

when the note recording module is detected to be triggered, generating a note recording layer;

receiving event input operation associated with a user, and recording the event input operation through a note recording layer;

and performing associated storage on the recorded event input operation and the live video to obtain the note live video.

Further, associating the recorded event input operation with the live video includes:

respectively recording video frame information when an event input operation starts and video frame information when the event input operation ends;

and acquiring all event input operations from the video frame information at the beginning to the video frame information at the end, and recording all event input operations in the note recording layer.

Further, the video frame information includes a teacher screen and a courseware screen, and the event input operation is triggered when the courseware screen is played.

Furthermore, when the courseware picture is played, an operation key is displayed on the playing interface, and when the operation key is triggered, the current time is determined as the starting time corresponding to the event input operation.

Further, the event input operation includes at least one of:

performing operation of inputting character information through the character input box;

performing stroke information input operation through a touch display screen;

and carrying out content marking operation through a marking tool.

Further, the event input operation further includes:

and converting the voice information input by the user to obtain corresponding character information and performing recording operation.

Further, the note live broadcast video is stored in a flat board end or a background server of the user, and the note live broadcast video is associated with the corresponding student account;

after the recorded event input operation and the live video are stored in an associated manner to obtain the note live video, the method further comprises the following steps:

playing a note live video according to the received playing instruction;

and deleting the note live video according to the received deletion instruction.

In a second aspect, an embodiment of the present application provides an apparatus for assisting a user in information entry in live broadcast teaching, including:

a triggering module: the note recording module is used for generating a note recording layer when the note recording module is detected to be triggered;

a detection module: the event recording layer is used for receiving event input operation associated with a user and recording the event input operation;

a storage module: and the event input operation and the live video are correlated and stored to obtain the note live video.

In a third aspect, an embodiment of the present application provides an electronic device, including:

a memory and one or more processors;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method of assisting a user in information entry in live tutoring as in the first aspect.

In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing a method of assisting a user in information entry in live education as in the first aspect when executed by a computer processor.

According to the embodiment of the application, the input operation of the user is continuously recorded in the live broadcast teaching process, and the event input operation is associated with the live broadcast video, so that the marking on the synchronous live broadcast video is realized. The student can watch the corresponding operation record when reviewing the live broadcast, thereby playing the role of prompting and being convenient for the student to review the live broadcast content.

Drawings

Fig. 1 is a flowchart of a method for assisting a user in information entry in live broadcast teaching according to an embodiment of the present application;

FIG. 2 is a schematic diagram illustrating a display of video frame information with a note taking module according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating a display of one embodiment of an event input operation provided by an embodiment of the present application;

FIG. 4 is a schematic illustration of a display of another implementation of an event input operation provided by an embodiment of the present application;

FIG. 5 is a schematic illustration of a display of yet another implementation of an event input operation provided by an embodiment of the present application;

FIG. 6 is a flow chart of associating a recorded event input operation with a live video according to an embodiment of the present application;

FIG. 7 is a schematic diagram illustrating a display of video frame information provided by an embodiment of the present application;

fig. 8 is a schematic diagram illustrating a principle of associating a recorded event input operation with a live video according to an embodiment of the present application;

FIG. 9 is a schematic diagram illustrating a display of a correlation result provided by an embodiment of the present application;

fig. 10 is a flowchart of live video playback and deletion of note provided by an embodiment of the present application;

fig. 11 is a schematic structural diagram of a method for assisting a user in information entry in live broadcast teaching according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

The application provides in live teaching process, constantly record user's input operation to with incident input operation and live video carry out the relevance, and then realize marking on synchronous live video. The student can watch the corresponding operation record when reviewing the live broadcast, thereby playing the role of prompting and being convenient for the student to review the live broadcast content. In order to record notes, most of the current practice of students is to record words through word documents or through notebooks or through a photographing mode, which is poor in timeliness and not beneficial to the students to concentrate on the attention in live broadcasting, for example, when taking a photo, when the students take out a mobile phone to take a photo, the students need to open the mobile phone first, then look for a camera function in the mobile phone, and finally aim the mobile phone camera at a screen to take a photo. The whole process is time-consuming, and when a flash vanishing picture is encountered, effective recording is often unavailable, so that students do not refer to the picture in the follow-up review process, and the marking and recording of the students in live broadcast learning are not facilitated. Based on this, provide the method that the auxiliary user carries out information input in the live teaching of this application embodiment through letting the student directly mark on the video picture for the student can know when follow-up review, and the key of explanation at that time helps the student consolidate the study knowledge, has effectively promoted the effect of live teaching.

Fig. 1 is a flowchart of a method for assisting a user in information entry in live broadcast teaching provided in an embodiment of the present application, where the method for assisting the user in information entry in live broadcast teaching provided in this embodiment may be executed by an apparatus for assisting the user in information entry in live broadcast teaching, the apparatus for assisting the user in information entry in live broadcast teaching may be implemented in a software and/or hardware manner, and the apparatus for assisting the user in information entry in live broadcast teaching may be formed by two or more physical entities or may be formed by one physical entity. Generally speaking, the device for assisting the user in information entry in the live broadcast teaching can be a computer, a mobile phone, a tablet and the like.

The following description will be given by taking a tablet as an example of a device for executing a method for assisting a user in information entry in live broadcast teaching. Referring to fig. 1, the method for assisting a user in information entry in live broadcast teaching specifically includes:

s101: and when the note recording module is detected to be triggered, generating a note recording layer.

The note recording module in this embodiment may be shown in the form of virtual keys or in the form of physical keys. As shown in fig. 2, fig. 2 is a schematic display diagram of video frame information with a note-taking module provided in the embodiment of the present application, which exists in the form of virtual keys; when a user needs to perform note recording, the note recording function can be called to perform note recording on the live video picture by directly clicking the note recording module in fig. 2. Specifically, when the detected note recording module is triggered, a note recording layer is generated, the note recording layer is equivalent to a transparent layer and is superposed on a live video picture, scribbling and labeling can be performed on the note recording layer through various set tools, and then the scribbled and labeled note recording layer is stored.

S102: and receiving an event input operation associated with a user, and recording the event input operation through the note recording layer.

In this embodiment, the note recording layer is configured to record all input operations triggered by a user, and the event input operation includes at least one of:

fig. 3 is a display schematic diagram of an embodiment of an event input operation provided in an embodiment of the present application, specifically, an operation of entering text information through a text input box; the usage scenario of the above operation is as follows: when the user has different insights on the PPT content displayed by the teacher, the text information is input by calling the text input box of the note recording module, the self-thought recording can be completed in time through the operation, the information input through the text input box is mainly used for inputting active information, and the information input is not only used for marking the content displayed by the teacher, but also can be used for inputting own insights and ideas on a certain knowledge point.

FIG. 4 is a schematic display diagram of another embodiment of an event input operation provided in an embodiment of the present application, in particular, an operation of entering stroke information through a touch display screen; the operation is more convenient for the user to type and mark various information, for example, when the user needs to write in a formula or carry out drawing identification or key information marking, because if in the use process, if the formula is typed out in a text box input mode, the whole process is more time-consuming, because each character in the formula is not necessarily available in a corresponding input method, the time is also needed to be spent for searching the corresponding character, and therefore, the setting of stroke information input through a touch display screen can improve the marking efficiency.

Fig. 5 is a schematic display diagram of still another embodiment of an event input operation provided in an embodiment of the present application, specifically, an operation of performing content annotation by using an annotation tool, in this embodiment, the annotation tool is a ruler or a box line tool, and performs a straight line marking operation by using a ruler, or performs an operation of drawing a rectangular box by using a box line tool. The operation is to make the mark more regular and beautiful in the using process of the user, and the whole marked content is not disordered, so that the user can watch the mark conveniently in the following process.

In addition to the event input operations described above, the event input operations include: and converting the voice information input by the user to obtain corresponding character information and performing recording operation. All received voice information can be quickly converted into character information for recording through a voice recognition technology. The reason why the voice information is not stored in the present embodiment is: the conflict between the voice information recorded by the user and the voice information in the live video during playing is avoided, and further the information transmission is not clear, so that a better effect is not achieved, and the information labeling effect is not achieved.

S103: and performing associated storage on the recorded event input operation and the live video to obtain the note live video.

There are various implementation manners for associating the event input operation with the live video, and two manners are mainly listed in the present embodiment for description. One implementation manner, as shown in fig. 6, fig. 6 is a flowchart for associating a recorded event input operation with a live video according to an embodiment of the present application, and in particular, associating a recorded event input operation with a live video includes:

s1031: video frame information at the start of the event input operation and video frame information at the end of the event input operation are recorded separately.

The video frame information includes a teacher picture and a courseware picture, and the event input operation is triggered when the courseware picture is played. FIG. 7 is a schematic diagram illustrating a display of video frame information provided by an embodiment of the present application; when the marking operation is performed, the video frame information is generally directed to a courseware picture, not a teacher picture, and therefore, the note recording module is also arranged at the courseware picture, so that all note annotations are performed on the courseware picture. Step S1031 is mainly to obtain the marked start-stop node, and use the video frame information as the start-stop node of information acquisition, mainly because the user usually marks the courseware video frame information when marking; for example, when a certain knowledge point displayed on the PPT by a teacher is considered to be important, the corresponding picture is directly marked by a marking tool, that is, the marking information is directly associated with the picture, so that the marking result is more accurate.

S1032: and acquiring all event input operations from the video frame information at the beginning to the video frame information at the end, and recording all event input operations in the note recording layer.

In this embodiment, there are two existing forms of the note recording layer, one is to directly cover a transparent layer on the video picture, but all operations on the transparent layer can be displayed, for example, drawing a black line on the transparent layer, so when recording, it is equivalent to performing information recording operation on the transparent layer, and also can record text information, and also can directly draw figures in various shapes. However, if only one transparent layer is covered, a situation may occur that when the PPT page is replaced and other page information needs to be marked, because the PPT page is switched but the note transparent layer is not switched, when the switched page is marked, the note transparent layer is marked, which is easily collided with the content recorded last time; thereby causing label confusion. Therefore, in this embodiment, a transparent layer generation operation is further required to be set, and when a PPT page replacement is detected, a corresponding new note recording transparent layer is correspondingly generated, so that a user can perform new note recording, and content marking is realized by continuously adding new note recording transparent layers.

And the note recording layer also adopts a mode of image frame superposition. Specifically, as shown in fig. 8, fig. 8 is a schematic diagram of a principle that a recorded event input operation is associated with a live video according to an embodiment of the present application, that is, when the event input operation is triggered, a picture of a note recording layer in fig. 8 corresponds to video frame information one to one, all event input operations between the video frame information at the beginning and the video frame information at the end are acquired, and all event input operations are recorded in the note recording layer, that is, all operations are recorded in a frame image of a corresponding recording layer. Because the note recording layer is also displayed frame by frame and corresponds to each frame picture in the video frame information one by one, when playing, each picture of the note recording layer is synchronously played, and then the information annotation of the video picture is completed. When all event input operations are recorded in the note recording layer, that is, all event input operations are recorded in the corresponding image frame, the display interface obtained by final playing and displaying is as shown in fig. 9, and fig. 9 is a display schematic diagram of the correlation result provided by the embodiment of the present application.

In addition to the above-mentioned way of associating according to the video frame information, another implementation way is that when the courseware picture is played, an operation key is displayed on the playing interface, and when the operation key is triggered, the current time is determined as the start time corresponding to the event input operation. The note recording layer is associated with a time point on a time axis, because video frame information also needs to be associated with time in the video playing process, and a triggered event input operation is associated with time. For example, when a line drawing operation is performed on one page of PPT, the corresponding time axis is 8 minutes and 5 seconds, and when the line drawing is completed, the corresponding time axis is 8 minutes and 25 seconds; then it can be known that the scribing operation is performed between 8 minutes and 5 seconds and 8 minutes and 25 seconds, and the specific orientation of the scribing operation in the display interface is recorded; this enables a way of associating event input operations with time. When the video picture is played again, when the time reaches 8 minutes and 5 seconds, the content of the scribing operation is displayed in the corresponding direction of the display interface.

In the embodiment, the note live video is stored in a flat board terminal or a background server of a user, and the note live video is associated with a corresponding student account; therefore, the note has corresponding privacy and humanity, and only a specific user can read the live note video.

As shown in fig. 10, fig. 10 is a flowchart of playing and deleting a note live video provided in an embodiment of the present application, and after a recorded event input operation is stored in association with a live video to obtain a note live video, the method further includes:

s104: playing a note live video according to the received playing instruction;

s105: and deleting the note live video according to the received deletion instruction. When a user needs to watch the note video, the user can directly search the corresponding storage folder and click to play the note-recorded live video picture. When the user watches the corresponding live video, the video content can be edited and modified again, the understanding of the user on the knowledge points is further deepened, and the note content recorded by the user is perfected. In addition to the above manner of deleting the live note videos, another manner of deleting the live note videos also exists, because the above manner of note recording is immediate, when the live note videos are watched for the second time and any note content is not modified, the corresponding live note videos can be deleted, and the storage space of the tablet or the storage space of the background server is further released.

According to the embodiment of the application, the input operation of the user is continuously recorded in the live broadcast teaching process, and the event input operation is associated with the live broadcast video, so that the marking on the synchronous live broadcast video is realized. The student can watch the corresponding operation record when reviewing the live broadcast, thereby playing the role of prompting and being convenient for the student to review the live broadcast content.

On the basis of the foregoing embodiment, fig. 11 is a schematic structural diagram of a device for assisting a user in information entry in live broadcast teaching according to an embodiment of the present application. Referring to fig. 11, the apparatus for assisting a user in information entry in live broadcast teaching provided in this embodiment specifically includes:

the trigger module 21: the note recording module is used for generating a note recording layer when the note recording module is detected to be triggered;

the detection module 22: the event recording layer is used for receiving event input operation associated with a user and recording the event input operation;

the storage module 23: and the event input operation and the live video are correlated and stored to obtain the note live video.

Further, associating the recorded event input operation with the live video includes:

a recording module: the video frame information recording device is used for respectively recording the video frame information when the event input operation starts and the video frame information when the event input operation ends;

an acquisition module: and acquiring all event input operations from the video frame information at the beginning to the video frame information at the end, and recording all event input operations in the note recording layer.

Further, the following is included after the storage module 23:

a playing module: the system is used for playing the note live video according to the received playing instruction;

a deletion module: and deleting the note live video according to the received deletion instruction.

According to the embodiment of the application, the input operation of the user is continuously recorded in the live broadcast teaching process, and the event input operation is associated with the live broadcast video, so that the marking on the synchronous live broadcast video is realized. The student can watch the corresponding operation record when reviewing the live broadcast, thereby playing the role of prompting and being convenient for the student to review the live broadcast content.

The device for assisting the user in information entry in the live broadcast teaching provided by the embodiment of the application can be used for executing the method for assisting the user in information entry in the live broadcast teaching provided by the embodiment one, and has corresponding functions and beneficial effects.

An embodiment of the present application provides a schematic structural diagram of an electronic device, and referring to fig. 12, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors 31 in the electronic device may be one or more, and the number of memories 32 in the electronic device may be one or more. The processor 31, the memory 32, the communication module 33, the input device 34 and the output device 35 of the electronic apparatus may be connected by a bus or other means.

The memory 32 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the method for assisting a user in information entry in live education according to any embodiment of the present application (for example, the triggering module 21, the detecting module 22, and the storage module 23 in the device for assisting a user in information entry in live education). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 32 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The communication module 33 is used for data transmission.

The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 32, that is, the method for assisting the user in information entry in live teaching is realized.

The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.

The electronic equipment can be used for executing the method for assisting the user in information entry in the live broadcast teaching provided by the embodiment, and has corresponding functions and beneficial effects.

The embodiment of the present application further provides a storage medium containing computer executable instructions, where the computer executable instructions, when executed by a computer processor 31, are configured to execute a method for assisting a user in information entry in live broadcast teaching, where the method for assisting the user in information entry in live broadcast teaching includes:

when the note recording module is detected to be triggered, generating a note recording layer;

receiving event input operation associated with a user, and recording the event input operation through a note recording layer;

and performing associated storage on the recorded event input operation and the live video to obtain the note live video.

Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors 31.

Certainly, the storage medium containing the computer-executable instructions provided in the embodiments of the present application is not limited to the above method for assisting the user in information entry in live broadcast teaching, and may also perform related operations in the method for assisting the user in information entry in live broadcast teaching provided in any embodiments of the present application.

The device, the storage medium, and the electronic device for assisting a user in information entry in live broadcast teaching provided in the above embodiments may execute the method for assisting a user in information entry in live broadcast teaching provided in any embodiment of the present application, and reference may be made to the method for assisting a user in information entry in live broadcast teaching provided in any embodiment of the present application without detailed technical details in the above embodiments.

The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, and various obvious changes, adaptations and substitutions may be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.