阅读说明：本技术 一种多设备录音同步方法、系统及会议系统 (Multi-device recording synchronization method and system and conference system ) 是由 何伟伟 张联昌 冯万健 于 2019-08-16 设计创作，主要内容包括：本发明公开了一种多设备录音同步方法、系统及会议系统,属于录音标记领域。针对现有技术中存在的支持录音标记功能的设备只支持在单设备上生成及使用的问题,本发明提供了一种多设备录音同步系统,包括一个主机和多个从机,主机与多个从机连接,从机向主机发送指令,主机根据从机发送的指令进行操作并全局广播状态信息。通过主机和从机的网络连接,主机将从机发送的录音和标记数据保存在主机端,并在设备间进行同步,实现多设备的同步录音以及多设备的同步播放,将多设备录音标记同步系统应用在会议系统中,实现多设备在同一会议下进行录音及标记,使用非常方便,运行逻辑简单,系统成本低。(The invention discloses a multi-device recording synchronization method, a multi-device recording synchronization system and a conference system, and belongs to the field of recording marks. The invention provides a multi-equipment recording synchronization system, aiming at the problem that equipment supporting a recording marking function only supports generation and use on single equipment in the prior art. Through the network connection of the host and the slave, the host stores the recording and marking data sent by the slave at the host end and synchronizes among the devices, so that the synchronous recording of multiple devices and the synchronous playing of the multiple devices are realized, the multi-device recording and marking synchronization system is applied to a conference system, the recording and marking of the multiple devices in the same conference are realized, the use is very convenient, the operation logic is simple, and the system cost is low.)

1. A multi-device recording synchronization method comprises the following steps,

the method comprises the following steps: the host is respectively connected with the external network and the slave machines through network ports, and at least one slave machine is connected;

step two: the method comprises the following steps that a host and a slave establish a file sharing service, and the host allows the slave to read a recording data file and a marking data file of the host;

step three: the master computer communicates with the slave computers, executes recording related operations according to the received slave computer instructions, and broadcasts states among the slave computers.

2. The method of claim 1, wherein the master and the slave communicate with each other using a remote procedure call.

3. The method for synchronizing the sound recordings of multiple devices as claimed in claim 1, wherein after the master device is started and the slave devices are connected in the step, the slave devices send heartbeat packets to the master device at regular intervals to confirm the survival of the slave devices.

4. The method for synchronizing the sound recordings of multiple devices according to claim 1, wherein the step three of sending the operation request from the slave computer to the master computer includes starting recording, stopping recording, marking and obtaining a mark.

5. The multi-device recording synchronization method of claim 4, wherein the broadcast status of the slave devices after the host receives the command in step three is recording or idle, and all slave devices synchronously enter the corresponding recording or idle status after the broadcast status of the host.

6. The method of claim 5, wherein any slave device in idle state of the master device can send a command to the master device requesting to start recording or to obtain a flag.

7. The method as claimed in claim 4, wherein any slave computer in the recording state of the master computer can send a command to the master computer to request to stop recording or to mark recording.

8.A multi-device sound recording synchronization system, characterized in that the system uses any of the methods of claims 1-7.

9. A conference system comprising the multi-device recording synchronization system of claim 8, further comprising a camera, a display and an audio playing device, wherein the camera, the display and the audio playing device are all connected to the host, the camera captures video information in the conference and sends the video information to the host, the display plays video information sent to the host by the camera, and the audio playing device plays audio information in the conference.

10. The conferencing system of claim 9, wherein the camera, the display and the audio player are connected to the host via wireless connections.

Technical Field

The invention relates to the field of recording marks, in particular to a multi-device recording synchronization method, a multi-device recording synchronization system and a multi-device recording conference system.

Background

Recording is a process of recording sound signals on a medium, and with the continuous development of digital technology, the recording function is changed from the first analog recording modes such as mechanical recording, optical recording, magnetic recording and the like into the current digital recording, and the recording is widely applied to various scenes. The recording mark marks important information when being recorded in the recording process, and a user can quickly find the position of the important information in the recording according to the recording mark and play back the important information in time, so that the method is very practical especially when a lot of recording contents exist.

In a video conferencing system, people in multiple locations are connected via a network to carry out a face-to-face conversation. Through the video conference system, the participant can see the action and the expression of other meeting personnel, has a sensation of being personally on the scene, nevertheless with regard to most meetings, image data is mostly invalid information, and audio information is most important, to such as training study be the video conference of giving first place to, it is one of the main means of saving the meeting to carry out the recording to the meeting, important part user still can carry out corresponding mark to the meeting in the meeting during the recording, makes things convenient for the quick key part of finding in later stage. The equipment with the recording and marking functions supported in the market only supports generation on single equipment and use on the single equipment, and a plurality of equipment terminals cannot perform recording and marking in the same meeting.

Chinese patent application recording marking method, device, terminal, server and system, patent number 201310617076.4, publication date 2014 3, 19, discloses a recording marking method, device, terminal, server and system, and belongs to the technical field of computers. The method comprises the following steps: detecting whether a marking data structure in the terminal is different from a marking data structure in the server or not, wherein the marking data structure is used for recording a marking event of audio data in an audio file in a recording process; and if the detection result is that the marking data structure in the terminal is different from the marking data structure in the server, triggering the synchronization of the marking data structure in the terminal and the marking data structure in the server. The problem of a plurality of terminals possibly miss marks of certain key contents in the recording process, so that the terminals need to search the missed key contents in the audio data through repeated audition when playing the audio data recorded by the terminals, the information acquisition efficiency is reduced, and the effect of improving the information acquisition efficiency is achieved. According to the method, the data structures need to be compared firstly during synchronization, synchronization is triggered when the marking data structure is different from the server data structure, the operation is complex, the information obtaining efficiency is improved, a large amount of data are redundant at a host computer end, time loss is generated in the comparison process, and certain time delay is caused.

Disclosure of Invention

1. Technical problem to be solved

Aiming at the problems that the equipment with the recording marking function supported on the market only supports the generation on single equipment and the use on the single equipment in the prior art, the invention provides a multi-equipment recording synchronization method, a multi-equipment recording synchronization system and a conference system, which can realize the synchronous recording marking among a plurality of equipment, realize the recording control, have small network bandwidth use and high precision, allow a master machine and a slave machine to operate in different systems and use different development languages; the conference system realizes the functions of multi-equipment recording, marking and synchronizing, and has the advantages of very convenient use, simple operation logic and low system cost.

2. Technical scheme

The purpose of the invention is realized by the following technical scheme.

A multi-device recording synchronization method comprises the following steps,

the method comprises the following steps: the host is respectively connected with the external network and the slave machines through network ports, and at least one slave machine is connected; the host computer passes through the net gape and is connected with outer net and follow the computer respectively, and the IP of host computer is fixed IP, and the host computer contains two net gapes: the device comprises a Wan port and a Phone port, wherein the Wan is used for connecting an external network, a network connected with the Phone port is used for accessing a slave, the slave periodically sends a request to the host, and if a reply is received, the slave is considered to be connected with the host.

Step two: the method comprises the steps that a host and a slave establish a file sharing service, the host allows the slave to read a recording data file and a marking data file of the host, and the host uses a samba service to allow the slave to read the file on the host; and the slave computer starts to request the relevant data after being connected with the host computer. After the host receives the request, the slave is considered to be connected with the host, and the IP of the slave is maintained in the slave list. The Samba service is software based on the SMB protocol, and enables sharing files on a local area network and allows running in different systems.

Step three: the host computer communicates with the slave computers, executes recording related operation according to the received slave computer instruction, and broadcasts the state among the slave computers; the master machine is connected with a plurality of slave machines simultaneously, the master machine receives the instruction sent by the slave machines and then executes the operation and broadcasts the recording state to all the slave machines, and all the slave machines synchronously enter the corresponding states; when a plurality of slave machines send instructions to the host machine, the instructions received first are executed according to the instruction sequence received by the host machine, and the problem that the accuracy of generated marks is deviated due to inconsistent local time of a plurality of devices is solved through the timestamp execution operation of the host machine; the invention has the advantages of small bandwidth usage, simple operation logic, convenient use and low cost.

Furthermore, the host and the slave are communicated by using a remote procedure call mode. An RPC, i.e., a remote procedure call, is a protocol that requests services from remote computer programs over a network without knowledge of underlying network technology, and is based on the open source RPC framework of the socket protocol, allowing applications deployed on different servers to invoke each other. The invention allows the host and the slave to mutually send instructions to complete data interaction through the RPC framework. The RPC framework can improve the development efficiency, improve the expandability of the system and allow the master machine and the slave machine to use different systems and different development languages. By using the scheme of generating and storing the marked data by the host, the data asynchronism among different devices can be effectively reduced, the problem that timestamps are inconsistent when the slave machine is marked independently is solved, and the use of network bandwidth can be reduced.

Furthermore, after the host is started and connected with the slave, the slave sends a heartbeat packet to the host according to a certain time interval to confirm the survival of the slave, wherein the heartbeat packet is a self-defined command word which regularly informs the self state of the opposite side between the host and the slave, and is sent according to a certain time interval and similar to heartbeat, so the heartbeat packet is called a heartbeat packet; after the host machine is connected with the slave machine, the slave machine sends heartbeat packets to the host machine according to a certain time interval to confirm the survival of the slave machine, and if the slave machine is disconnected with the host machine, the slave machine sends a connection request to the host machine again.

Furthermore, step three, the slave computer sends a request to the master computer, wherein the request comprises recording starting, recording stopping, marking and marking obtaining. And the master machine receives the request command sent by the slave machine to carry out corresponding operation. The instruction sending flow is defined as follows: if the device B needs to send an instruction with X and Y parameters to the device a, the device a defines a method X (a) with X and a parameter a, and the device B calls the method X (a) of the device a through the RPC framework and enters the parameter Y, that is, the device B is considered to send the instruction X ═ Y to the device a.

The relevant instructions in the recording process are defined as follows: the Start Record is used for requesting to Start recording, the Stop Record is used for requesting to Stop recording, the Mark is used for requesting to Mark the recording, the Get Mark is used for requesting to obtain Mark data of a certain file, and the Record State is used for sending the recording State of the current conference system.

Furthermore, in the third step, the broadcast state of the slave machines is recording or idle after the host machine receives the instruction, all the slave machines synchronously enter the corresponding recording or idle state after the broadcast state of the host machine, the host machine broadcasts after receiving the instruction sent by the slave machines, all the slave machines do not record according to the broadcast content synchronization state, the slave machines transmit data to the host machine for storage after recording, due to the particularity of the conference system, the multiple slave machines do not have the condition of receiving sound simultaneously, the time stamps of the host machine are uniformly used for sequencing, and the data repetition and disorder are avoided.

Furthermore, any slave in the idle state of the master can send a command to the master to request to start recording or to obtain a flag. The slave computer sends a Start Record instruction to the host computer, the host computer starts recording, and a recording State Record is broadcast to the slave computer. All slaves in the system enter the recording state synchronously. At the moment, the host broadcasts the recording state to the slave without recording, and the recording operation is finished by the slave; the slave machine sends the recording data to the host machine end in the recording process, and when the host machine end executes the recording operation, the host machine carries out integration operation such as echo elimination and the like on the voice data according to the voice data received in the conference system in the process, and then stores the data stream with other data to the locally stored recording file.

When a user needs to obtain a Mark playing record in an idle state of the host, the slave acquires a file list through the host, the user selects a file name needing to be played in the file list acquired by the slave, the slave inquires Mark data of the recorded file name from the host database through the file name, sends an instruction Get Mark to the host, and inquires Mark data of the recorded file name from the host database through the file name. And the slave machine directly accesses the file of the host machine through the samba service, acquires the marking data, displays the marking data on the progress bar according to the time progress and displays the marking data to the user. When the user clicks a certain time mark, the player directly jumps to the corresponding time point.

Furthermore, any slave computer can send an instruction to the host computer when the host computer is in the recording state to request to stop recording or carry out recording marking. Any slave can send a Stop Record command to the master to request the master to Stop recording. And after receiving the Stop Record command, the host stops recording and broadcasts the recording State, wherein Record State is idle. And informing the slave machine to update the recording state. In the recording process, any slave computer can send a Mark instruction to the host computer, after the host computer receives the Mark instruction, the marked recording point, namely the current recording progress is stored in the database, the Key is the file name when the recording progress is stored, and the Value is the recording progress. The recorded marking information and the recorded file information are stored separately, and the marking information is stored in the database of the host computer. The recording information is saved in a locally stored recording file. When multiple slave machines simultaneously request mark, the master machine firstly receives the command.

The invention receives the request of each slave machine through the host machine, generates and stores the recording data and the marking information at the host machine end according to the recording data and the marking data transmitted by the slave machines, and each slave machine needs to acquire the data from the host machine if the data is required to be acquired, so that the data consistency can be ensured by using the mode. In addition, all the time stamps are generated locally by the master according to the sequence of the received slave requests. Because the same local time is used for generation, compared with the situation that the slave machines generate marks, the mark information is synchronized to the master machine, the precision is higher, and the deviation of the mark generation precision caused by the inconsistency of the local time of each device can be avoided. When a new device accesses the system, the data is synchronized to the host once. Compared with the technical scheme that the slave machine locally generates the mark and locally stores the mark and simultaneously synchronizes the data to other equipment, the method and the system only need to send the mark to the master machine for one time, have small network bandwidth use and can not face the condition that the marked data of the slave machine is inconsistent with the data of other equipment due to network abnormity and the like. Due to the particularity of the conference system, when the master computer is abnormal, other functions of the slave computer cannot be used, and the condition of data inconsistency caused by the fact that the master computer is not in a state and the slave computer continues to record sound does not exist.

A multi-equipment recording synchronization system uses the multi-equipment recording synchronization method; the system comprises a host and a plurality of slave machines, wherein the host and the slave machines are connected through network ports to form an internal network, RPC is used in the internal network, a remote procedure call framework is used for communication, the host collects the requests of the slave machines, a mark is generated and stored at the host end, and if the slave machines want to acquire data, the slave machines need to acquire the data from the host, so that the consistency of the data is ensured. The host computer is also connected with an external network, and the host computer realizes information interaction with other equipment through connection with the external network to generate more applicable scenes, such as use in a conference system.

The conference system comprises a multi-device recording synchronization system, and further comprises a camera, a display and an audio playing device, wherein the camera, the display and the audio playing device are all connected with a host, the camera captures video information in a conference and sends the video information to the host, the display plays video information sent to the host by a camera, and the audio playing device plays audio information in the conference.

Furthermore, the camera, the display and the audio playing device are connected with the host in a wireless connection mode, conference deployment is simplified in the wireless connection mode, and operation is convenient; the multi-equipment recording and marking synchronous system is applied to a conference system, so that the multi-equipment recording and marking under the same conference is realized, important parts in the conference system are marked, the important parts can be found quickly in the later period conveniently, the recording and marking synchronous function can be realized among the multi-equipment, the multi-equipment recording and marking synchronous system is not limited to the radio function of single equipment, the consistency of the recording and marking data among the multi-equipment can be ensured, the use is very convenient, the operation logic is simple, and the system cost is low.

3. Advantageous effects

Compared with the prior art, the invention has the advantages that:

the invention receives the request of each slave machine through the host machine, generates and stores the recording data and the marking information at the host machine end according to the recording data and the marking data transmitted by the slave machines, and each slave machine needs to acquire the data from the host machine if the data is required to be acquired, so that the data consistency can be ensured by using the mode. In addition, all the time stamps are generated locally by the master according to the sequence of the received slave requests. The system is particularly suitable for a conference system, when multiple devices are connected in the conference system, a user can perform recording control and recording marking on any device, the consistency of recording data can be ensured, the system is low in cost, the operation logic is simple, and the system is very convenient to use.

Drawings

FIG. 1 is a schematic diagram of a slave recording process according to the present invention;

FIG. 2 is a schematic view of a slave playback process according to the present invention;

FIG. 3 is a schematic diagram of the interaction between a master and a slave according to the present invention;

fig. 4 is a schematic diagram of network connection between a master and a slave according to the present invention.

Detailed Description

The invention is described in detail below with reference to the drawings and specific examples.