阅读说明：本技术 一种数据同步方法、装置、设备及计算机可读存储介质 (Data synchronization method, device, equipment and computer readable storage medium ) 是由 王巍 于 2021-09-16 设计创作，主要内容包括：本发明公开了一种数据同步方法,应用于目标节点,该方法包括以下步骤：接收源节点发送的日志项；将日志项分块缓存至预创建的各用户空间；调用各派发进程从各用户空间中读取缓存的日志块,并将各日志块发送至应用进程；其中,预先划分有各派发进程与各用户空间之间的对应关系；利用应用进程根据各日志块进行数据同步操作。应用本发明所提供的数据同步方法,较大地降低了对源节点CPU资源的占用,降低了对源节点业务的影响,提升了数据同步效率。本发明还公开了一种数据同步装置、设备及存储介质,具有相应技术效果。(The invention discloses a data synchronization method, which is applied to a target node and comprises the following steps: receiving a log item sent by a source node; caching the log items to each pre-established user space in a blocking mode; calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance; and performing data synchronization operation according to each log block by using the application process. The data synchronization method provided by the invention greatly reduces the occupation of the CPU resource of the source node, reduces the influence on the service of the source node and improves the data synchronization efficiency. The invention also discloses a data synchronization device, equipment and a storage medium, and has corresponding technical effects.)

1. A data synchronization method is applied to a target node and comprises the following steps:

receiving a log item sent by a source node;

caching the log items to each pre-established user space in a blocking mode;

calling each dispatching process to read cached log blocks from each user space and sending each log block to an application process; wherein, the corresponding relation between each dispatch process and each user space is divided in advance;

and performing data synchronization operation by utilizing the application process according to each log block.

2. The data synchronization method according to claim 1, wherein performing data synchronization operations according to the log blocks by using the application process comprises:

acquiring log serial numbers corresponding to the log blocks respectively;

sequencing the log serial numbers in sequence to obtain a sequencing result;

and performing data synchronization operation by using the application process according to each log block corresponding to the sequencing result.

3. The data synchronization method according to claim 1, wherein performing data synchronization operations according to the log blocks by using the application process comprises:

acquiring a preset object synchronization list;

screening target log contents from each log block according to the object synchronization list;

and performing data synchronization operation by utilizing the application process according to the target log content.

4. The data synchronization method according to claim 1, wherein performing data synchronization operations according to the log blocks by using the application process comprises:

acquiring a preset object synchronization level; wherein the object synchronization level comprises a data level and a defined scope level;

and performing data synchronization operation according to the log blocks by utilizing the application process according to the object synchronization level.

5. The data synchronization method according to claim 1, further comprising, after invoking each dispatching process to read the cached log block from each user space:

and deleting each user space.

6. The data synchronization method of claim 1, wherein receiving the log entry sent by the source node comprises:

and receiving the log items sent by the source node through a remote log service.

7. The data synchronization method according to any one of claims 1 to 6, further comprising, after performing a data synchronization operation according to each log block by using the application process:

and when the source node is abnormal, taking over the source node for service processing.

8. A data synchronization device applied to a target node comprises:

the log item receiving module is used for receiving the log items sent by the source node;

the log item caching module is used for caching the log items to each pre-established user space in a blocking mode;

the log block reading and sending module is used for calling each dispatching process to read cached log blocks from each user space and sending each log block to an application process; wherein, the corresponding relation between each dispatch process and each user space is divided in advance;

and the data synchronization module is used for performing data synchronization operation according to the log blocks by utilizing the application process.

9. A data synchronization apparatus, comprising:

a memory for storing a computer program;

a processor for implementing the steps of the data synchronization method according to any one of claims 1 to 7 when executing said computer program.

10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the data synchronization method according to any one of claims 1 to 7.

Technical Field

The present invention relates to the field of computer application technologies, and in particular, to a data synchronization method, apparatus, device, and computer-readable storage medium.

Background

In order to ensure the security of node data, it is usually necessary to perform a synchronous copy operation on the node data, so that when a source node generating data is abnormal, complete data can be obtained from a target node synchronizing the data generated by the source node.

The existing data synchronization scheme is a storage replication scheme, that is, data synchronization at a storage level is realized by using a synchronous replication function or an asynchronous replication function of a storage device. In the storage replication scheme, when the data volume needing synchronization is large, a large amount of source node CPU resources are occupied, normal operation of source node services is influenced, and the data synchronization efficiency is low.

In summary, how to effectively solve the problems that the storage replication scheme occupies a large amount of source node CPU resources, affects the normal operation of source node services, and has low data synchronization efficiency, and the like, is a problem that needs to be solved by those skilled in the art at present.

Disclosure of Invention

The invention aims to provide a data synchronization method, which greatly reduces the occupation of source node CPU resources, reduces the influence on source node services and improves the data synchronization efficiency; another object of the present invention is to provide a data synchronization apparatus, a device and a computer-readable storage medium.

In order to solve the technical problems, the invention provides the following technical scheme:

a data synchronization method is applied to a target node and comprises the following steps:

receiving a log item sent by a source node;

caching the log items to each pre-established user space in a blocking mode;

calling each dispatching process to read cached log blocks from each user space and sending each log block to an application process; wherein, the corresponding relation between each dispatch process and each user space is divided in advance;

and performing data synchronization operation by utilizing the application process according to each log block.

In a specific embodiment of the present invention, performing, by using the application process, data synchronization operation according to each log block includes:

acquiring log serial numbers corresponding to the log blocks respectively;

sequencing the log serial numbers in sequence to obtain a sequencing result;

and performing data synchronization operation by using the application process according to each log block corresponding to the sequencing result.

In a specific embodiment of the present invention, performing, by using the application process, data synchronization operation according to each log block includes:

acquiring a preset object synchronization list;

screening target log contents from each log block according to the object synchronization list;

and performing data synchronization operation by utilizing the application process according to the target log content.

In a specific embodiment of the present invention, performing, by using the application process, data synchronization operation according to each log block includes:

acquiring a preset object synchronization level; wherein the object synchronization level comprises a data level and a defined scope level;

and performing data synchronization operation according to the log blocks by utilizing the application process according to the object synchronization level.

In an embodiment of the present invention, after invoking each dispatching process to read a cached log block from each user space, the method further includes:

and deleting each user space.

In a specific embodiment of the present invention, receiving a log entry sent by a source node includes:

and receiving the log items sent by the source node through a remote log service.

In a specific embodiment of the present invention, after performing a data synchronization operation according to each log block by using the application process, the method further includes:

and when the source node is abnormal, taking over the source node for service processing.

A data synchronization device applied to a target node comprises:

the log item receiving module is used for receiving the log items sent by the source node;

the log item caching module is used for caching the log items to each pre-established user space in a blocking mode;

the log block reading and sending module is used for calling each dispatching process to read cached log blocks from each user space and sending each log block to an application process; wherein, the corresponding relation between each dispatch process and each user space is divided in advance;

and the data synchronization module is used for performing data synchronization operation according to the log blocks by utilizing the application process.

A data synchronization apparatus comprising:

a memory for storing a computer program;

a processor for implementing the steps of the data synchronization method as described above when executing the computer program.

A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the data synchronization method as set forth above.

The data synchronization method provided by the invention is applied to a target node and comprises the following steps: receiving a log item sent by a source node; caching the log items to each pre-established user space in a blocking mode; calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance; and performing data synchronization operation according to each log block by using the application process. Compared with the existing storage replication scheme, the method has the advantages that the data transmission amount is greatly reduced, the occupation of the CPU resource of the source node is reduced, the influence on the service of the source node is reduced, and the data synchronization efficiency is improved.

Correspondingly, the invention also provides a data synchronization device, equipment and a computer readable storage medium corresponding to the data synchronization method, which have the technical effects and are not described herein again.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a flow chart of an implementation of a data synchronization method according to an embodiment of the present invention;

FIG. 2 is a block diagram of a local data synchronization system according to an embodiment of the present invention;

FIG. 3 is a block diagram of a remote data synchronization system according to an embodiment of the present invention;

FIG. 4 is a block diagram of a data synchronization apparatus according to an embodiment of the present invention;

FIG. 5 is a block diagram of a data synchronization apparatus according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a data synchronization apparatus provided in this embodiment.

Detailed Description

In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, fig. 1 is a flowchart of an implementation of a data synchronization method in an embodiment of the present invention, applied to a target node, where the method may include the following steps:

s101: and receiving the log entry sent by the source node.

Referring to fig. 2 and fig. 3, fig. 2 is a block diagram of a local data synchronization system in an embodiment of the present invention, and fig. 3 is a block diagram of a remote data synchronization system in an embodiment of the present invention. The source node records the data in the log when performing any operation on the data existing in the source node. When data generated by a source node needs to be synchronized to a target node, an application program finds the initial position of a Journal entry (Journal entry) through an offset, reads the complete content of the Journal entry through recording the length of bytes, and sends the Journal entry to the target node, as shown in fig. 2, in the local data synchronization process, the source node sends the Journal entry to the target node through a Socket program, as shown in fig. 3, in the remote data synchronization process, the source node sends the Journal entry to the target node through a remote Journal service. The target node receives the log item sent by the source node. All object operations and data operations are recorded in the log entry.

Operations supporting record to log include operations of inserting new records, modifying old records, deleting old records, generating new database tables, generating new database indexes, deleting existing database tables, deleting existing database indexes, starting transactions, stopping transactions, submitting transactions, rolling back transactions, reforming database tables and the like for objects such as data queues, data domains, database tables, stream files and the like.

The insertion operation has two options, one is to insert directly into the tail of the file, that is, the insertion operation is performed in an adding mode, and the corresponding insertion function is _ Rwrite (); the other is inserted in the middle of the file, covering the so-called deleted records, with the corresponding insertion function _ Rwritten ().

The processing of the update and delete operations is a Record location using a _ rlocation () function, and a delete operation of an update or a Record using a _ Rupdate () function or a _ rdellete () function, by RRN (Relative Record Number).

The processing of the reforming operation can release the space occupied by the deleted record through a reforming table command of the RGZPFM command, the RGZPFM records the FRZ in the log, reads the log item at the target end, and repeats the action to perform the RGZPFM action on the table at the target end.

And recording corresponding log items in a database log for the generation, deletion, renaming and movement positions of the file objects, reading the log items at the target node, and performing corresponding file object processing at the target node according to marks of the log items.

Encapsulation of operations is usually done using transactions, but in a highly available solution, since there is no urgent requirement for the use of transactions, two different algorithms can be designed, namely that the same transaction is encapsulated at the standby, and commit or rollback is done at the standby when commit (commit) or rollback (rollback) is read. And the transaction encapsulation is not applicable to the standby machine, and the submission or rollback of the transaction action is realized through program logic.

In a scenario supporting a single instance or multiple instances, the support for the independent storage pool needs to be reflected in that the membership of an object needs to pay attention to the instance to which the object belongs, that is, the corresponding independent storage pool. The program execution environment must extend the database namespace to the independent storage pool, typically using process descriptions to identify the independent storage pool name that the current process needs to access. The independent storage pool names must be explicitly used when the logical replication solution defines the replication list in order to accurately commit database changes to the correct objects at the target.

A metadata data synchronization mechanism is designed between a source node and a target node, data can be recorded into a metadata database in all key steps of logic replication, and theoretically, only a node which performs the action can access the key data. In order to facilitate the effective management of the synchronous replication process and the monitoring of the synchronous replication process on both a source node and a target node, a socket program is designed to synchronize metadata data between the two nodes, an asynchronous mode is adopted for synchronization, synchronous processing can be set to be performed every 10 seconds, an incremental mode is adopted for synchronization, and only new changes are transmitted so as to rapidly update the data.

S102: and caching the log items to each pre-created user space in a blocking mode.

The method comprises the steps that a plurality of user spaces (user spaces) are created in advance at a target node, and after the target node receives log items sent by a source node, the log items are cached to the pre-created user spaces in a blocking mode due to the fact that the storage capacity of each user space is limited.

As shown in fig. 2 and 3, the read (Reader) process caches data to user space by reading log entries. The log reading modes mainly include three modes, namely, using an RTVJRNE command to read logs, using an API (Application Programming Interface) to read logs one by one, using an RCVJRNE command to match a breakpoint program to read a group of logs in a block mode, considering the efficiency of reading logs, using the RTVJRNE command to read logs one by one in a scene with low load efficiency requirement and low load requirement can meet the requirement of medium and low load, and using the RCVJRNE command to read logs in an enterprise-level load scene.

The user space is typically 16MB at the maximum, and the data is stored in the user space in the form of a continuous string. A plurality of user spaces are created in advance as standby, and after one user space is full, the next user space is switched. The user space command adopts two-segment naming, the first five bits are fixed as character string identifiers, such as USSPC, the last five bits are numbers, such as 12345, and 1 is added in the number part every time a new user space is generated.

S103: and calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process.

Wherein, the corresponding relation between each dispatching process and each user space is divided in advance.

And a plurality of dispatching (Dispatch) processes are arranged in the target node, after the log items are cached to each pre-created user space in a blocking mode, each user space stores the partitioned log blocks respectively, each dispatching process is called to read the cached log blocks from each user space, and each log block is sent to the application process.

S104: and performing data synchronization operation according to each log block by using the application process.

And an application process is arranged in the target node, and after each distribution process is called to send each log block to the application process, the application process is utilized to carry out data synchronization operation according to each log block.

It should be noted that the number of the application processes may be set and adjusted according to the size of the current log load, which is not limited in the embodiment of the present invention, and for example, the application processes may be set to correspond to the dispatch processes one to one, data transmission is performed between the dispatch processes and the application processes through data queues (data queues), and the dispatch processes are responsible for sending the log items to different queues by reading the log items, and then sending the log contents in each queue to the application processes.

According to the logic synchronization scheme for synchronizing the data in the source node according to the log items, only the log items recorded in the source node are required to be sent to the target node during data synchronization, if the source node sends the log items to the target node in an asynchronous mode, the influence on the service processing of the source node is avoided in an asynchronous transmission mode. The method and the device achieve the purpose of copying the production action of the source node by processing the action of the log item repeated at the target node, and compared with the existing storage copying scheme, the method and the device greatly reduce the data transmission quantity, reduce the occupation of the CPU resource of the source node, reduce the influence on the service of the source node and improve the data synchronization efficiency.

The data synchronization method provided by the invention is applied to a target node and comprises the following steps: receiving a log item sent by a source node; caching the log items to each pre-established user space in a blocking mode; calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance; and performing data synchronization operation according to each log block by using the application process. Compared with the existing storage replication scheme, the method has the advantages that the data transmission amount is greatly reduced, the occupation of the CPU resource of the source node is reduced, the influence on the service of the source node is reduced, and the data synchronization efficiency is improved.

It should be noted that, based on the above embodiments, the embodiments of the present invention also provide corresponding improvements. In the following embodiments, steps that are the same as or correspond to those in the above embodiments may be referred to one another, and corresponding advantageous effects may also be referred to one another, which is not described in detail in the following modified embodiments.

In one embodiment of the present invention, step S104 may include the following steps:

the method comprises the following steps: acquiring log serial numbers corresponding to the log blocks respectively;

step two: sequencing the log serial numbers in sequence to obtain a sequencing result;

step three: and performing data synchronization operation by using the application process according to the log blocks corresponding to the sequencing result.

For convenience of description, the above three steps may be combined for illustration.

And each log block obtained by blocking the log items respectively comprises a log serial number corresponding to the log block, the log serial numbers corresponding to the log blocks are obtained, the log serial numbers are sequenced in sequence to obtain a sequencing result, and an application process is utilized to perform data synchronization operation according to the log blocks corresponding to the sequencing result. The log blocks are sequenced by taking the log serial number as a main key, the front and back orders of different log blocks are distinguished, and the consistency of data obtained by synchronization at a target node and the data of a source node is ensured.

In addition, each log block also comprises an object for identifying the object and the position of the log function; the method also comprises a relative record number, wherein the relative record number is provided for each record, and for a table allowing repeated key values, the relative record number can be used as a primary key to identify the position of each record; the system also comprises log codes, and each object has a unique log code; the transaction code and the transaction identifier are also included, all log items corresponding to each complete transaction can identify the same transaction code, and the operation belonging to the same transaction needs to be submitted together or rolled back together theoretically; and also contains a timestamp, a system timestamp of each log at the time the source node was logged.

In addition, the embodiment of the invention can also provide a monitoring interface for monitoring the monitoring data in the database copying process in real time, the latest data of the source node database logs, the state of each key process of data synchronization, the reading, dispatching and application process key processing data, the object state refreshing, the number of objects which have stopped normal synchronization, the reason for stopping and the log serial number of the last processing. The processing speed of each current step, the data of the backup machine lagging the production machine, the amount of lagging log items, lagging time and the like. Through providing the monitoring function to the data synchronization process for can in time discover when synchronous unusual appearing, promote data synchronization's reliability.

In one embodiment of the present invention, step S104 may include the following steps:

the method comprises the following steps: acquiring a preset object synchronization list;

step two: screening target log contents from each log block according to the object synchronization list;

step three: and performing data synchronization operation by using the application process according to the target log content.

For convenience of description, the above three steps may be combined for illustration.

An object synchronization list is preset, the range of a copy object is limited by including and ignoring the object which needs to perform data synchronization in the object synchronization list, a specific group of object names are generally indicated by keywords such as wildcards and ALL, and if data in which database needs to be synchronized. And the target node acquires a preset object synchronization list, screens target log contents from each log block according to the object synchronization list, and performs data synchronization operation according to the target log contents by using an application process, so that corresponding data synchronization is performed on the objects in a specified range.

In one embodiment of the present invention, step S104 may include the following steps:

the method comprises the following steps: acquiring a preset object synchronization level; wherein the object synchronization level comprises a data level and a definition range level;

step two: and performing data synchronization operation according to the object synchronization level and each log block by using the application process.

For convenience of description, the above two steps may be combined for illustration.

Presetting an object synchronization level, wherein the object synchronization level comprises a data level and a defined range level, and performing data synchronization operation according to each log block by using an application process according to the object synchronization level. The data level copy or the range-only copy is realized through the definition setting, if the range copy is required to be defined, the record is not subjected to assignment operation, and actions such as object generation, object deletion, renaming, movement and the like can be reproduced at a target node. By setting two object synchronization level options of a data level and a defined range level, the data synchronization range can be freely selected according to an actual application scene.

In an embodiment of the present invention, after invoking each dispatching process to read a cached log block from each user space, the method may further include the following steps:

and deleting each user space.

Since a large amount of user space occupies a large amount of server resources, after calling each distribution process to read the cached log block from each user space, each user space is deleted.

The generation and deletion of the user space are high-load actions, and the user space maintenance can be designed in an asynchronous mode, the user space maintenance program is run at regular time, and the user space with processed data is deleted.

In one embodiment of the present invention, step S101 may include the following steps:

and receiving the log items sent by the source node through the remote log service.

As shown in fig. 3, the source node may send the log entry to the target node through the remote log service, and perform log synchronization through the remote log service, so that the reliability of data synchronization is high, and the remote log service itself adopts block operation, so that the replication speed is fast.

In an embodiment of the present invention, after step S104, the method may further include the steps of:

and when the source node is abnormal, taking over the source node for service processing.

After the data in the source node is synchronized to the target node, when the source node is abnormal, such as when the source node is in a scheduled maintenance and abnormal downtime scene, the method takes over the service processing of the source node, thereby ensuring the normal operation of the service. The target node can take over the service processing of the source node by switching roles between the source node and the target node, and the direction for adjusting synchronization is provided by switching roles.

Corresponding to the above method embodiment, the present invention further provides a data synchronization apparatus, which is applied to a target node, and the data synchronization apparatus described below and the data synchronization method described above may be referred to in correspondence.

Referring to fig. 4, fig. 4 is a block diagram of a data synchronization apparatus according to an embodiment of the present invention, where the data synchronization apparatus may include:

a log item receiving module 41, configured to receive a log item sent by a source node;

a log entry caching module 42, configured to cache log entries in blocks to each pre-created user space;

a log block reading and sending module 43, configured to call each dispatch process to read cached log blocks from each user space, and send each log block to an application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance;

and the data synchronization module 44 is configured to perform data synchronization operation according to each log block by using the application process.

The data synchronization device provided by the invention is applied to a target node and comprises the following components: receiving a log item sent by a source node; caching the log items to each pre-established user space in a blocking mode; calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance; and performing data synchronization operation according to each log block by using the application process. Compared with the existing storage replication scheme, the method has the advantages that the data transmission amount is greatly reduced, the occupation of the CPU resource of the source node is reduced, the influence on the service of the source node is reduced, and the data synchronization efficiency is improved.

In one embodiment of the present invention, the data synchronization module 44 includes:

the log serial number obtaining submodule is used for obtaining the log serial numbers corresponding to the log blocks respectively;

the sequence number sequencing submodule is used for sequencing the sequence numbers of the logs to obtain a sequencing result;

and the first data synchronization submodule is used for performing data synchronization operation by utilizing the application process according to each log block corresponding to the sequencing result.

In one embodiment of the present invention, the data synchronization module 44 includes:

the list acquisition submodule is used for acquiring a preset object synchronization list;

the log content screening submodule is used for screening target log contents from all log blocks according to the object synchronization list;

and the second data synchronization submodule is used for performing data synchronization operation according to the target log content by utilizing the application process.

In one embodiment of the present invention, the data synchronization module 44 includes:

the synchronization level acquisition submodule is used for acquiring a preset object synchronization level; wherein the object synchronization level comprises a data level and a definition range level;

and the third data synchronization submodule is used for performing data synchronization operation according to the object synchronization level and each log block by using the application process.

In one embodiment of the present invention, the apparatus may further include:

and the user space deleting module is used for deleting each user space after calling each dispatching process to read the cached log blocks from each user space.

In an embodiment of the present invention, the log entry receiving module 41 is a module that receives a log entry sent by a source node through a remote log service.

In one embodiment of the present invention, the apparatus may further include:

and the service taking-over module is used for taking over the service processing of the source node when the source node is abnormal after the application process is used for carrying out data synchronization operation according to each log block.

Corresponding to the above method embodiment, referring to fig. 5, fig. 5 is a schematic diagram of a data synchronization apparatus provided in the present invention, where the apparatus may include:

a memory 332 for storing a computer program;

a processor 322 for implementing the steps of the data synchronization method of the above-described method embodiments when executing the computer program.

Specifically, referring to fig. 6, fig. 6 is a schematic diagram of a specific structure of a data synchronization apparatus provided in this embodiment, the data synchronization apparatus may generate a relatively large difference due to different configurations or performances, and may include a processor (CPU) 322 (for example, one or more processors) and a memory 332, where the memory 332 stores one or more computer applications 342 or data 344. Memory 332 may be, among other things, transient or persistent storage. The program stored in memory 332 may include one or more modules (not shown), each of which may include a sequence of instructions operating on a data processing device. Still further, the processor 322 may be configured to communicate with the memory 332 to execute a series of instruction operations in the memory 332 on the data synchronization device 301.

The data synchronization apparatus 301 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input-output interfaces 358, and/or one or more operating systems 341.

The steps in the data synchronization method described above may be implemented by the structure of the data synchronization apparatus.

Corresponding to the above method embodiment, the present invention further provides a computer-readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the steps of:

receiving a log item sent by a source node; caching the log items to each pre-established user space in a blocking mode; calling each dispatching process to read the cached log blocks from each user space and sending each log block to the application process; wherein, the corresponding relation between each dispatching process and each user space is divided in advance; and performing data synchronization operation according to each log block by using the application process.

The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

For the introduction of the computer-readable storage medium provided by the present invention, please refer to the above method embodiments, which are not described herein again.

The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device, the apparatus and the computer-readable storage medium disclosed in the embodiments correspond to the method disclosed in the embodiments, so that the description is simple, and the relevant points can be referred to the description of the method.

The principle and the implementation of the present invention are explained in the present application by using specific examples, and the above description of the embodiments is only used to help understanding the technical solution and the core idea of the present invention. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.