阅读说明：本技术 一种基于主机仲裁的双活存储系统及存储方法 (Double-active storage system and method based on host arbitration ) 是由 谭方剑 于 2019-08-23 设计创作，主要内容包括：本发明实施例公开了一种基于主机仲裁的双活存储系统及存储方法,双活存储系统,包括主机端和双活存储端,存储端的每个存储器包括一个仲裁卷,所述仲裁卷映射到所述主机端；所述主机端上包括仲裁驱动模块,所述仲裁模块探测主机端与存储端的通信,根据仲裁卷内的信息,配置仲裁策略,并将所述仲裁策略写入所述仲裁卷。本发明通过在存储端穿件仲裁卷并映射到主机端,主机端配置仲裁策略,一仲裁卷作为媒介,实现存储系统的自主仲裁。在不需要第三方站点和不增加设备的情况下,提升双活等容灾环境下存储仲裁的稳定性,降低实现架构和成本。(The embodiment of the invention discloses a double-active storage system and a storage method based on host arbitration, wherein the double-active storage system comprises a host end and a double-active storage end, each storage of the storage end comprises an arbitration volume, and the arbitration volume is mapped to the host end; the host end comprises an arbitration driving module, the arbitration driving module detects the communication between the host end and the storage end, configures an arbitration strategy according to the information in the arbitration volume, and writes the arbitration strategy into the arbitration volume. The invention realizes the autonomous arbitration of the storage system by penetrating the arbitration volume at the storage end and mapping the arbitration volume to the host end, configuring the arbitration strategy at the host end and taking an arbitration volume as a medium. Under the condition of not needing a third-party site and not increasing equipment, the stability of storage arbitration in disaster tolerance environments such as double-activity disaster tolerance and the like is improved, and the implementation architecture and the cost are reduced.)

1. A double-active storage system based on host arbitration comprises a host end and a double-active storage end, and is characterized in that each storage of the storage end comprises an arbitration volume, and the arbitration volume is mapped to the host end; the host end comprises an arbitration driving module, the arbitration driving module detects the communication between the host end and the storage end, configures an arbitration strategy according to the information in the arbitration volume, and writes the arbitration strategy into the arbitration volume.

2. The host arbitration based live memory system of claim 1, wherein the arbitration driver module further comprises:

the communication unit is used for carrying out heartbeat communication between the host end and the storage end through an FCSAN or IPSAN link;

the arbitration unit is used for providing an arbitration strategy by combining information in an arbitration volume in a priority setting or voting mode according to the communication conditions between the host end and the storage end and between the memories;

and the interface unit is used for configuring an arbitration strategy from the host side to the storage side.

3. The host arbitration based live storage system of claim 2, wherein the arbitration volume comprises configuration information, site attributes, and priorities of the storage; the arbitration driving module further comprises a configuration synchronization unit for storing the configuration information.

4. The dual active memory system based on host arbitration of claim 3, wherein the arbitration driving module further comprises a data reading configuration unit, and the data reading configuration unit selects an optimal path of the current host for data near reading according to the configuration information and the multi-path information.

5. A dual-active storage method based on host arbitration, based on the dual-active storage system of any one of claims 1-4, wherein the method comprises the following steps:

s1, creating an arbitration volume on each memory, and mapping the arbitration volume to a host end;

s2, configuring an arbitration policy on the host side;

s3, according to the communication condition of the storage system, the host end selects the optimal data read-write path according to the configured strategy, and writes the selected optimal path into the arbitration volume;

and S4, the storage system reads and writes data according to the optimal path.

6. The dual active storage method based on host arbitration of claim 5, wherein the arbitration policy is used for a multi-path selection policy when the communication of the host group or the consistency group is normal, and a voting policy of the host group or the consistency group when the communication is abnormal.

7. The host arbitration-based live storage method according to claim 6, wherein the specific procedures of the steps S3 and S4 are as follows:

s31, judging whether the communication condition of the storage system is normal:

s32, if yes, each host at the host end arbitrates;

s33, if not, judging whether the abnormal communication occurs in the consistency group or the host group:

s331, if not, each host selects an optimal path, and the step goes to S38;

s332, if yes, go to step S32;

s34, judging whether the arbitration results of the hosts are consistent;

s35, if yes, selecting the optimal path according to the arbitration result;

s36, if not, selecting the optimal path according to a minority obeying majority principle;

s37, judging whether the optimal path selected in the steps S35 and S36 is the optimal reading path of each host;

s38, if yes, using the path to read and write data;

and S39, if not, writing data by using the optimal path in the step S37, and reading data by using the respective optimal path of the host.

8. The method of claim 7, wherein the optimal path for each of the hosts is determined according to priority, bandwidth, transmission quality, and latency.

Technical Field

The invention relates to the technical field of storage, in particular to a double-active storage system and a storage method based on host arbitration.

Background

The data disaster tolerance storage system is an environment which can deal with various disasters and is provided for a computer information system. When a computer system suffers from irresistible natural disasters such as fire, flood, earthquake, war and the like, and human disasters such as computer crimes, computer viruses, power failure, network/communication failure, hardware/software errors, human operation errors and the like, the disaster recovery system can ensure uninterrupted service of user data or data safety.

The data disaster tolerance storage system adopts two or more sets of storage to form a cluster, if the internal heartbeat is abnormal in the cluster, the problem that the memories cannot communicate with each other, so that the memories compete for resources mutually to cause data damage or service interruption is caused.

The conventional arbitration service is provided by a FC (Fibre Channel) memory of the third site or an IP (Internet Protocol) arbitration system of the third site. The third-party FC memory arbitration adopts an extra memory which is arranged at a third site different from the site where the two memories are positioned, and provides a plurality of storage volumes with a plurality of sizes for arbitration and configuration backup for an arbitration disk in a mode of FCSAN or IPSAN and the like; the IP arbitration of the third site adopts a physical machine or a virtual machine which is arranged on the third site different from the site where the two memories are arranged to run a specific arbitration program, and provides arbitration service for the two memories through an IP network.

The above two types of arbitration need to add a third-party site on the basis of the existing storage system, and add additional configuration and link design, so that the cost is high, and service interruption is easily caused.

Disclosure of Invention

The embodiment of the invention provides a double-active storage system and a storage method based on host arbitration, which aim to solve the problems of high cost and low reliability of arbitration by adopting a third-party site in the prior art.

In order to solve the technical problem, the embodiment of the invention discloses the following technical scheme:

the invention provides a double-active storage system based on host arbitration, which comprises a host end and a double-active storage end, wherein each storage of the storage end comprises an arbitration volume, and the arbitration volume is mapped to the host end; the host end comprises an arbitration driving module, the arbitration driving module detects the communication between the host end and the storage end, configures an arbitration strategy according to the information in the arbitration volume, and writes the arbitration strategy into the arbitration volume.

Further, the arbitration driving module further comprises:

the communication unit is used for carrying out heartbeat communication between the host end and the storage end through an FCSAN or IPSAN link;

the arbitration unit is used for providing an arbitration strategy by combining information in an arbitration volume in a priority setting or voting mode according to the communication conditions between the host end and the storage end and between the memories;

and the interface unit is used for configuring an arbitration strategy from the host side to the storage side.

Further, the arbitration volume comprises configuration information of a memory; the arbitration driving module further comprises a configuration synchronization unit for storing the configuration information.

Furthermore, the arbitration driving module further comprises a data reading configuration unit, and the data reading configuration unit selects the optimal path of the current host to perform data nearby reading according to the configuration information and by combining the multi-path information.

The second aspect of the present invention provides a double-active storage method based on host arbitration, based on the double-active storage system, the method includes the following steps:

s1, creating an arbitration volume on each memory, and mapping the arbitration volume to a host end;

s2, configuring an arbitration policy on the host side;

s3, according to the communication condition of the storage system, the host end selects the optimal data read-write path according to the configured strategy, and writes the selected optimal path into the arbitration volume;

and S4, the storage system reads and writes data according to the optimal path.

Further, the arbitration policy is used for a multi-path selection policy when the communication of the host group or the consistency group is normal, and a voting policy of the host group or the consistency group when the communication is abnormal.

Further, the specific processes of steps S3 and S4 are:

s31, judging whether the communication condition of the storage system is normal:

s32, if yes, each host at the host end arbitrates;

s33, if not, judging whether the abnormal communication occurs in the consistency group or the host group:

s331, if not, each host selects an optimal path, and the step goes to S38;

s332, if yes, go to step S32,

s34, judging whether the arbitration results of the hosts are consistent;

s35, if yes, selecting the optimal path according to the arbitration result;

s36, if not, selecting the optimal path according to a minority obeying majority principle;

s37, judging whether the optimal path selected in the steps S35 and S36 is the optimal reading path of each host;

s38, if yes, using the path to read and write data;

and S39, if not, writing data by using the optimal path in the step S37, and reading data by using the respective optimal path of the host.

Further, the respective optimal paths of the hosts are determined according to priority, bandwidth, transmission quality and delay.

Drawings

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a dual-active storage system according to the present invention;

FIG. 2 is a topological structure diagram of the dual active storage system of the present invention;

FIG. 3 is a schematic flow diagram of the method of the present invention;

FIG. 4 is a schematic arbitration flow chart of the method of the present invention.

Detailed Description

In order to clearly explain the technical features of the present invention, the following detailed description of the present invention is provided with reference to the accompanying drawings. The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. To simplify the disclosure of the present invention, the components and arrangements of specific examples are described below. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. It should be noted that the components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and procedures are omitted so as to not unnecessarily limit the invention.

As shown in fig. 1 and 2, the dual active storage system based on host arbitration of the present invention includes a host end 1 and a dual active storage end 2, each storage 21 of the storage end 2 includes an arbitration volume 211, and the arbitration volume 211 is mapped to the host end 1; the host 1 includes an arbitration driving module 11, and the arbitration module 11 detects communication between the host 1 and the storage 2, configures an arbitration policy according to information in the arbitration volume 211, and writes the arbitration policy into the arbitration volume 211.

The arbitration driving module 11 integrates arbitration related functions into a host-side multipath program, and pre-sets the arbitration function to the host-side 1, and provides functions of heartbeat communication, API interaction interface, configuration synchronization, proximity reading, arbitration policy and the like with the storage-side 2, and specifically includes a communication unit 111, an arbitration unit 112, an interface unit 113, a configuration synchronization unit 114, and a data reading configuration unit 115.

The communication unit 111 maintains heartbeat communication with each storage 21 through an FCSAN or an IPSAN link according to the topology of the link between the host end 1 and the storage end 2, and ensures that each other can detect the other, thereby preventing split brain.

The arbitration unit 112 provides an arbitration policy by priority setting or voting according to the communication conditions between the host 1, the storage 2, and the memory 21, in combination with the information in the arbitration volume 211.

The arbitration strategy comprises consistency group arbitration, when a certain host or some hosts need to access the same volume or volumes to provide the same service, the corresponding host and the volumes are added into a consistency group, and the hosts in the consistency group uniformly arbitrate the storage of the required service in a priority setting or voting mode to keep the consistency of data. For example, if a host runs a database that uses two storage volumes, then the two storage volumes must be in the same consistency group, otherwise the database is unusable under abnormal conditions; in the consistency group, when a plurality of volumes correspond to the same service, the volumes need to keep the updated timestamps consistent. The priority setting includes storage priority, path priority, host priority, and the like.

Under the condition that heartbeat communication between storages is abnormal, each front-end host selects priority storage to perform service according to a preset strategy and priority, each storage can provide service simultaneously under the condition that a storage access path from the host or a host group is not changed, the influence of the heartbeat communication abnormity is avoided, and the host or the host group which storage providing service is required by the host or the host group carries out arbitration by the host or the host group, so that the problem of long-chain path access caused by storage arbitration under the traditional condition is solved. In the above process, the policy preset by each front-end host includes a path priority, a storage priority, a host priority, and the like. A host group refers to a host that needs to access the same volume.

When the priority storage set by the host fails, the host or the host group automatically arbitrates the storage needing to be served according to the preset priority or by a voting mode; the voting process is decided by the host or the interior of the host group, and the voting reference factors comprise: link bandwidth, delay, jitter, etc., with a few subject to majority decision elections. A priority storage failure is one in which the storage set to priority storage fails, is powered off, is a disk bad, is a fiber link down, etc., resulting in the storage not being serviced; the failure is not necessarily the entire memory, but may be a path, and assuming that a host has 4 paths, where path 1 is a priority path, when path 1 is due to a configuration problem or a physical interruption, path 234 must be determined by priority or voting, and path 234 may be different paths on two memories.

The interface unit 113 adopts API interface interaction, configures configuration work such as site attribute and storage priority corresponding to the current host at the storage end 1, avoids independent operation and configuration of each host, and configures an arbitration policy to the storage end 2.

The arbitration volume 211 is the same as the volume type used by the service host, is a general volume, and only needs 1GB in space size, and does not need to be formatted because the arbitration volume is a data volume used by the service host and does not provide space for the host. The arbitration data is RAW format data, when the memory allocates the arbitration volume, the attribute information is written at the head of the arbitration volume, the host driver confirms that the arbitration volume is the arbitration volume by scanning the attribute information of the volume, and then the drive layer shields the arbitration volume to prevent the volume from being damaged due to other misoperation of the operating system. And recording the configuration information of the memory in the arbitration volume. Site attributes and storage priority, etc. Each memory corresponds to an arbitration volume, and the same information is stored in the two arbitration volumes.

The configuration synchronization unit 114 stores the configuration information in each arbitration volume, and when a catastrophic failure occurs, data information and configuration information can be recovered from the configuration synchronization unit, so that the cluster recovery is prevented from being influenced by configuration loss caused by hardware failure.

The data reading configuration unit 115 selects the optimal path of each host to read data according to the information recorded by the arbitration volume and in combination with the multipath condition, so that the data reading configuration unit is not limited by the voting result, the problem of long link reading is avoided, and the overall reading performance is improved.

As shown in fig. 3, the method for dual active storage based on host arbitration according to the present invention includes the following steps:

s1, creating an arbitration volume on each memory, and mapping the arbitration volume to the host end;

s2, configuring an arbitration policy on the host side;

s3, according to the communication condition of the storage system, the host end selects the optimal data read-write path according to the configured strategy, and writes the selected optimal path into the arbitration volume;

and S4, the storage system reads and writes data according to the optimal path.

The arbitration policy in step S2 is used for the multipath selection policy when the host group or consistency group is in normal communication, and the voting policy of the host group or consistency group when the communication is abnormal.

As shown in fig. 4, according to the communication situation of the stored information, the specific process of performing arbitration according to the configured policy is as follows:

s31, judging whether the communication condition of the storage system is normal:

s32, if yes, each host at the host end arbitrates;

s33, if not, judging whether the abnormal communication occurs in the consistency group or the host group:

s331, if not, each host selects an optimal path, and the step goes to S38;

s332, if yes, go to step S32;

s34, judging whether the arbitration results of the hosts are consistent;

s35, if yes, selecting the optimal path according to the arbitration result;

s36, if not, selecting the optimal path according to a minority obeying majority principle;

s37, judging whether the optimal path selected in the steps S35 and S36 is the optimal reading path of each host;

s38, if yes, using the path to read and write data;

and S39, if not, writing data by using the optimal path in the step S37, and reading data by using the respective optimal path of the host.

Based on the above steps, the storage method of the present embodiment can implement arbitration in the following cases.

Under normal conditions, data is written in by the overall optimal path uniformly according to the priority setting condition of each host or host group, and the overall optimal path with the optimal overall writing performance is ensured to be determined by the set priority, the link bandwidth and the data transmission quality; when data is read, each host only needs to read the data according to the own optimal path, so that the reading performance of all the hosts is optimal, and the own optimal path is determined by the set priority, the link quality and the bandwidth. The difference between the overall optimal path and the path with the best path is that the overall optimal path is determined by whether the optimal paths of all the hosts in the host group or the consistency group are consistent, and if the optimal paths are not consistent, the overall optimal path is determined by voting and few obeying majority principles.

When heartbeat communication between the storages is abnormal, the back-end storages cannot be synchronized at the moment, but all storage information can be obtained from the host end through the arbitration volume, and all storages can still continue to operate according to the preset condition without being influenced; when one storage is interrupted from communicating with part of the hosts, the affected host continues writing in the other storage, and the volumes and hosts of the same host group or consistency group keep the whole writing consistent. At this time, a long link reading condition occurs in part of the hosts, but the service continuity is not affected.

When one of the memories is interrupted in communication with part of the host and also interrupted in communication with the other memory, reading and writing are carried out on the other memory by the affected host or host group, and the condition of long-link reading and writing of part of the hosts occurs at the moment, but the service continuity is not affected.

When one part of the host and the memory are interrupted and the other part of the host and the memory are interrupted in the same host group or consistency group, the host group elects the best memory to write in by voting, and the reading still keeps the latest reading. In the voting process, the host selects the optimal one by comparing preset priority, link bandwidth, quality, delay and the like one by one; for example, the host a has a path 1 and a path 2, and if the priority of the path 1 is greater than that of the path 2, the host a selects the path 1; if the priority of the path 1 is the same as that of the path 2, the bandwidth of the path 1 is larger than that of the path 2, and the path 1 is selected; if the bandwidth is also uniform, path 1 is delayed less than path 2, path 1 is selected, and so on.

When one part of the host and the first memory are interrupted, one part of the host and the second memory are interrupted, and the communication between the first memory and the second memory is also interrupted, the host group elects the best memory to read and write by voting, and at this time, the situation that the long-link reading of part of the hosts exists.

The master write volume between the memories is determined by the front-end host access status, by dynamically determining which memory the master write volume is located in according to the host write status on each memory. In the double-active memory, one volume seen by the host computer actually has one volume corresponding to each of the two memories, and when the host computer writes data, the host computer writes one of the memories first and then synchronizes the other memory, wherein the volume which writes the memory first is the main write volume.

The foregoing is only a preferred embodiment of the present invention, and it will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the principle of the invention, and such modifications and improvements are also considered to be within the scope of the invention.