阅读说明：本技术 一种存储系统的分层方法、装置、设备及介质 (Layering method, device, equipment and medium of storage system ) 是由 郭平加 于 2019-09-06 设计创作，主要内容包括：本发明公开了一种存储系统的分层方法,包括：获取新添加的外接存储设备的性能信息；根据性能信息,生成与外接存储设备对应的目标存储层；确定需要迁移的热点数据,将热点数据从原存储层迁移至目标存储层。由此可知,本发明通过将新添加的存储设备外接入存储系统中,并将热点数据迁移至外接存储设备对应的目标存储层中,为热点数据提供更好的运行条件。同时,又避免了将原存储设备中的全部数据进行迁移的复杂过程,节省了大量的时间。此外,本发明所提供的一种存储系统的分层装置、设备及介质,具有同样的有益效果。(The invention discloses a layering method of a storage system, which comprises the following steps: acquiring performance information of newly added external storage equipment; generating a target storage layer corresponding to the external storage equipment according to the performance information; determining hot spot data needing to be migrated, and migrating the hot spot data from the original storage layer to the target storage layer. Therefore, the newly added storage equipment is externally connected into the storage system, and the hot spot data is migrated to the target storage layer corresponding to the externally connected storage equipment, so that better operating conditions are provided for the hot spot data. Meanwhile, the complex process of migrating all the data in the original storage equipment is avoided, and a large amount of time is saved. In addition, the layering device, the equipment and the medium of the storage system have the same beneficial effects.)

1. A method of tiering a storage system, comprising:

acquiring performance information of newly added external storage equipment;

generating a target storage layer corresponding to the external storage equipment according to the performance information;

determining hot spot data needing to be migrated, and migrating the hot spot data from the original storage layer to the target storage layer.

2. The layering method for a storage system according to claim 1, wherein the acquiring performance information of the newly added external storage device specifically includes:

reading the device type of the external storage device;

and determining the performance information of the external storage equipment according to the corresponding relation between the equipment type and the performance information in the preset layered model.

3. The layering method of the storage system according to claim 1, wherein the generating of the target storage tier corresponding to the external storage device specifically includes:

and adding the volume created on the external storage device into a storage pool as a management disk to form the target storage layer corresponding to the external storage device.

4. The layering method of the storage system according to claim 1, wherein the adding the volume created on the external storage device as a management disk to the storage pool specifically includes:

and taking the different volumes created on the external device as different management disks, and respectively adding the different management disks into different storage pools.

5. The hierarchical method of the storage system according to claim 1, wherein the determining the hotspot data to be migrated specifically includes:

counting the read-write times of all data in the original storage layer;

judging whether all the read-write times reach a preset limit value or not;

and if so, determining the data corresponding to the preset limit value as the hot spot data.

6. The method for tiering a storage system according to claim 1, further comprising:

and updating the hot spot data, and migrating the updated hot spot data from the original storage layer to the target storage layer.

7. The method of layering a storage system according to claim 2, further comprising:

and generating a log for recording the hotspot data.

8. A tiering apparatus for a storage system, comprising:

the acquisition module is used for acquiring the performance information of the newly added external storage equipment;

the generating module is used for generating a target storage layer corresponding to the external storage device according to the performance information;

and the migration module is used for determining the hot spot data needing to be migrated and migrating the hot spot data from the original storage layer to the target storage layer.

9. A tiering apparatus for a storage system, comprising a memory for storing a computer program;

a processor for implementing the steps of the hierarchical method of the storage system according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the hierarchical method of the storage system according to one of claims 1 to 7.

Technical Field

The present invention relates to the field of data storage, and in particular, to a method, an apparatus, a device, and a medium for layering a storage system.

Background

With the rapid development of electronic information technology and the increasing demand of information industry for high-speed and large-capacity data storage systems, the performance of storage devices used in the storage systems is rapidly developed and remarkably improved, so that the storage devices widely applied to various industries are updated more and more rapidly. In practical applications, the number of times of reading and writing some data in the storage device reaches the limit of the storage device, and this part of data may be referred to as hot-point data. Because the read-write times reach the limit of the storage device, the current storage device cannot meet the operation requirement of the hot spot data, and the storage device with higher performance needs to be replaced. In the prior art, in order to meet the operation requirement of hot spot data, an original storage device is replaced, and all data in the original storage device is migrated to a new device, so that a new storage device with higher performance is provided for the hot spot data, and the operation requirement of the new storage device is met.

However, when a large amount of data is stored in the original storage device, the migration of all data is easy to cause data loss and other problems; due to the large workload, the migration is time-consuming, and the wide application of the high-performance storage equipment is inconvenient; for non-hotspot data, the original storage equipment can still meet the operation requirement, the original storage equipment is directly replaced to migrate all the data to the new storage equipment, and meanwhile, resource waste is caused.

Disclosure of Invention

The invention aims to provide a layering method, a layering device and a layering medium of a storage system, wherein determined hot spot data in an original storage layer are migrated to a target storage layer corresponding to newly added external storage equipment, so that better operating conditions are provided for the hot spot data, and resource waste is avoided.

In order to solve the above technical problem, the present invention provides a storage system layering method, including:

acquiring performance information of newly added external storage equipment;

generating a target storage layer corresponding to the external storage equipment according to the performance information;

determining hot spot data needing to be migrated, and migrating the hot spot data from the original storage layer to the target storage layer.

Preferably, the acquiring performance information of the newly added external storage device specifically includes:

reading the device type of the external storage device;

and determining the performance information of the external storage equipment according to the corresponding relation between the equipment type and the performance information in the preset layered model.

Preferably, the generating of the target storage layer corresponding to the external storage device specifically includes:

and adding the volume created on the external storage device into a storage pool as a management disk to form the target storage layer corresponding to the external storage device.

Preferably, the adding the volume created on the external storage device as a management disk to the storage pool specifically includes:

and taking the different volumes created on the external device as different management disks, and respectively adding the different management disks into different storage pools.

Preferably, the determining the hotspot data needing to be migrated specifically includes:

counting the read-write times of all data in the original storage layer;

judging whether all the read-write times reach a preset limit value or not;

and if so, determining the data corresponding to the preset limit value as the hot spot data.

Preferably, the method further comprises the following steps:

and updating the hot spot data, and migrating the updated hot spot data from the original storage layer to the target storage layer.

Preferably, the method further comprises the following steps:

and generating a log for recording the hotspot data.

In order to solve the above technical problem, the present invention further provides a storage system layering device, including:

the acquisition module is used for acquiring the performance information of the newly added external storage equipment;

the generating module is used for generating a target storage layer corresponding to the external storage device according to the performance information;

and the migration module is used for determining the hot spot data needing to be migrated and migrating the hot spot data from the original storage layer to the target storage layer.

In order to solve the above technical problem, the present invention further provides a hierarchical device of a storage system, including a memory for storing a computer program;

a processor for implementing the steps of the hierarchical method of the storage system as defined in any one of the above when executing the computer program.

To solve the above technical problem, the present invention further provides a computer-readable storage medium, having a computer program stored thereon, where the computer program, when executed by a processor, implements the steps of the hierarchical method of the storage system according to any one of the above.

The invention provides a layering method of a storage system, which correspondingly generates a target storage layer corresponding to an external storage device by acquiring performance information of a newly added external storage device, thereby dividing the original storage device and the newly added external storage device into different storage layers in the storage system; and determining the hot spot data needing to be transferred in the original storage layer, and transferring the hot spot data with higher requirements on the performance of the storage device to a target storage layer corresponding to the newly added external storage device. Therefore, the newly added storage equipment is externally connected into the storage system, and the hot spot data is migrated to the target storage layer corresponding to the externally connected storage equipment, so that the hot spot data is stored in the externally connected storage equipment with higher performance, and better operating conditions are provided for the hot spot data. Meanwhile, the complex process of migrating all the data in the original storage equipment is avoided, a large amount of time is saved, and resource waste is avoided.

In addition, the layering device, the equipment and the medium of the storage system correspond to the method, and have the same beneficial effects.

Drawings

In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained by those skilled in the art without inventive effort.

Fig. 1 is a flowchart of a hierarchical method of a storage system according to an embodiment of the present invention;

fig. 2 is a flowchart of a layering method of a storage system in an application scenario according to an embodiment of the present invention;

FIG. 3 is a block diagram of a storage system hierarchy according to an embodiment of the present invention;

fig. 4 is a structural diagram of a hierarchical device of a storage system according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any creative work belong to the protection scope of the present invention.

The core of the invention is to provide a layering method, a device, equipment and a medium of a storage system, which are used for transferring the determined hot spot data in the original storage layer to a target storage layer corresponding to newly added external storage equipment, thereby providing better operating conditions for the hot spot data and avoiding resource waste.

In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments.

Fig. 1 is a flowchart of a hierarchical method of a storage system according to an embodiment of the present invention; as shown in fig. 1, the layering method for a storage system according to an embodiment of the present invention includes steps S101 to S103:

step S101: and acquiring the performance information of the newly added external storage equipment.

It should be noted that, in the present invention, a new storage device is externally connected to the storage system without replacing the original storage device. The method for externally connecting the storage device can be referred to the prior art, and the invention is not described in detail. The performance information provided in this embodiment refers to high-level and low-level information of the performance of the external storage device. It will be appreciated that the newly added storage devices typically have higher performance than the original storage devices.

In a specific implementation, the performance information of the external storage device needs to be acquired. As can be appreciated. The performance information of the storage equipment can be directly recorded in a configuration file of the external storage equipment and directly obtained by reading the content in the configuration file; the performance information of the external storage device can be obtained in other manners, and those skilled in the art can determine the manner of obtaining the performance information of the external storage device according to the actual application situation, which is not limited in this embodiment.

In one embodiment, the obtaining of the performance information of the newly added external storage device specifically includes:

reading the device type of the external storage device;

and determining the performance information of the external storage equipment according to the corresponding relation between the equipment type and the performance information in the preset layered model.

Specifically, the preset hierarchical model includes a corresponding relationship between the device type and the performance information, and the read device type of the external storage device corresponds to determine the performance information corresponding to the external storage device in the hierarchical model. In one embodiment, the hierarchical model includes device types of three storage devices, namely NVME, SSD and HDD, where the corresponding NVME type corresponds to high performance, the SSD type corresponds to medium performance, and the HDD type corresponds to low performance. And when the read device type of the external storage device is the SSD type, determining the performance information of the external storage device to be the middle performance according to the corresponding relation in the layered model. It should be noted that, persons skilled in the art may set the corresponding relationship in the hierarchical model and the number of the types of the devices included according to actual situations, and the embodiment of the present invention is not limited.

Step S102: generating a target storage layer corresponding to the external storage equipment according to the performance information;

in one embodiment, the corresponding target storage layer is generated according to the performance information of the external storage device. For example, if the performance information of the external storage device is high performance, the storage layer is designated as a high performance storage layer when the corresponding target storage layer is generated.

In one embodiment, the generating of the target storage layer corresponding to the external storage device specifically includes:

and adding the volume created on the external storage device into the storage pool as a management disk to form a target storage layer corresponding to the external storage device.

Specifically, all volumes created on the external storage device are mapped to the original storage device; and taking the mapped volume as a management disk, and adding the management disk into the storage pool to form a target storage layer corresponding to the external storage device. The methods of creating volumes, mapping, and adding to storage pools are well known in the art and will not be described in detail herein. Because the performance of the newly added external storage device is different from that of the original storage device, a layered system consisting of a storage layer corresponding to the original storage device and a target storage layer is formed. It should be noted that the target storage tier here refers to a storage tier corresponding to the external storage device, and only plays a role in name distinction.

In specific implementation, the added external storage device may create a plurality of different volumes, and the volumes are correspondingly regarded as a plurality of different management disks, and each management disk is added to a different storage pool, so that a target storage tier with higher performance is formed for different storage pools, hot-spot data in different storage pools can be migrated to different target storage tiers corresponding to the external storage device with higher performance, and the operation requirement of the hot-spot data is met.

Step S103: determining hot spot data needing to be migrated, and migrating the hot spot data from the original storage layer to the target storage layer.

In one embodiment, determining hotspot data to be migrated specifically includes:

counting the read-write times of all data in the original storage layer;

judging whether all the read-write times reach a preset limit value or not;

if so, data corresponding to the preset limit value is determined as hot spot data.

Specifically, the read-write times of all data in the original storage layer within a period of time can be obtained from the history, and the limit read-write values of the storage device corresponding to the original storage layer are obtained for comparison, and the limit read-write values of the storage device can be obtained from the record content of the configuration file. And judging whether the read-write times reach the limit read-write value in all the data in the original storage layer, and if so, determining the data reaching the limit read-write value as hot point data. It can be understood that, when the number of times of reading and writing data reaches the limit reading and writing value of the storage device, reading and writing and other operations of the hot data stored in the storage device are greatly affected. Therefore, a person skilled in the art can appropriately set the preset limit value provided in this embodiment according to actual requirements, and can migrate the hot spot data before the number of times of reading and writing the hot spot data reaches the limit read and write value of the storage device, so as to ensure normal operation of the hot spot data.

In a specific embodiment, the determined hot spot data is migrated to a target storage layer with higher performance, it should be noted that the data migration method may refer to the prior art, and the details of the present invention are not repeated.

The invention provides a layering method of a storage system, which correspondingly generates a target storage layer corresponding to an external storage device by acquiring performance information of a newly added external storage device, thereby dividing the original storage device and the newly added external storage device into different storage layers in the storage system; and determining the hot spot data needing to be transferred in the original storage layer, and transferring the hot spot data with higher requirements on the performance of the storage device to a target storage layer corresponding to the newly added external storage device. Therefore, the newly added storage equipment is externally connected into the storage system, and the hot spot data is migrated to the target storage layer corresponding to the externally connected storage equipment, so that the hot spot data is stored in the externally connected storage equipment with higher performance, and better operating conditions are provided for the hot spot data. Meanwhile, the complex process of migrating all the data in the original storage equipment is avoided, a large amount of time is saved, and resource waste is avoided.

In one embodiment, the present invention provides a storage system layering method, further comprising:

and updating the hot spot data, and transferring the updated hot spot data from the original storage layer to the target storage layer.

Specifically, the number of times of reading and writing data in the storage device in different time periods is different, that is, different hot spot data will be generated in different time periods. Therefore, the read-write times of all the data are counted again in another time period, so that new hot spot data are determined, the previous hot spot data are updated, and the hot spot data are migrated to the target storage layer, so that the operation requirement of the hot spot data is better met. It can be understood that, those skilled in the art can set the periodic update of the hot spot data according to the actual needs, and ensure that all data in the storage system can operate normally.

Furthermore, the number of times of reading and writing of data stored in the target storage layer within a period of time can be counted, whether the number of times of reading and writing of the data reaches the limit reading and writing value of the storage device corresponding to the original storage layer or not is judged, and if the number of times of reading and writing of the data does not reach the limit reading and writing value, the data reaching the limit reading and writing value can be migrated back to the original storage layer again, so that the data with low requirements on the performance of the storage device in the target storage layer is stored in the original storage device with lower performance again, and the storage space of the high-.

In one embodiment, the present invention provides a storage system layering method, further comprising:

a log is generated for recording the hotspot data.

Specifically, the log can record the hotspot data, migration time, migration destination and co-migration times of each migration, so that the staff can conveniently check or record the data subsequently.

The above embodiment corresponding to the layering method of the storage system is described in detail, and in order to make the technical solution of the method further clear to those skilled in the art, a specific application scenario is given below. In the application scenario, the original storage device type of data storage is HDD, and the newly added external storage device is SSD. Fig. 2 is a flowchart of a layering method of a storage system in an application scenario according to an embodiment of the present invention, and as shown in fig. 2, the method specifically includes the following steps:

step S201: and reading the device type of the newly added external storage device.

Step S202: and determining the performance information of the external storage equipment as the middle performance according to the corresponding relation between the SSD type and the performance information in the preset layered model.

Step S203: respectively adding 3 volumes created on an external storage device as management disks into 3 different storage pools; the respectively generated storage layers are designated as neutral-performance storage layers.

Step S204: counting the read-write times of all data in the original storage layer within preset time;

step S205: judging whether all the read-write times reach the limit value of the read-write times of the HDD; if so, data corresponding to the preset limit value is determined as hot spot data.

Step S206: and migrating the hot spot data to a newly generated neutral energy storage layer.

It should be noted that different types of storage devices correspond to different performance information. If the external storage equipment is added continuously, the corresponding storage layer can be generated again according to the equipment type and the setting of the layering model, and a plurality of different storage layers form a layering system. The hotspot data stored in the low-performance storage device can be migrated to the medium-performance storage device or the high-performance storage device. For example, hot spot data in the HDD type storage device in the application scenario may be migrated to the SSD type storage device, or may be stored in the NVME type storage device. And moreover, the hot spot data can be determined again at regular time and then corresponding migration is carried out, so that the hot spot data generated in different periods can be ensured to normally run in the storage equipment with higher performance.

The invention also provides a storage system layering device and a storage system layering device corresponding embodiment. It should be noted that the storage system hierarchy apparatus is based on the functional module perspective, and the storage system hierarchy device is based on the hardware perspective.

Fig. 3 is a structural diagram of a storage system layered device according to an embodiment of the present invention, and as shown in fig. 3, the storage system layered device according to the embodiment of the present invention includes:

and the obtaining module 10 is configured to obtain performance information of the newly added external storage device.

And the generating module 11 is configured to generate a target storage layer corresponding to the external storage device according to the performance information.

The migration module 12 is configured to determine hot spot data that needs to be migrated, and migrate the hot spot data from the original storage tier to the target storage tier.

In an embodiment, a hierarchical apparatus of a storage system according to an embodiment of the present invention further includes:

and the updating module is used for updating the hot spot data and transferring the updated hot spot data from the original storage layer to the target storage layer.

And the recording module is used for generating a log for recording the hot spot data.

Since the embodiments of this section correspond to the embodiments of the method section, reference is made to the description of the embodiments of the method section for the embodiments of this section, and details are not repeated here.

According to the layering device of the storage system, the performance information of the newly added external storage equipment is obtained, and the target storage layer corresponding to the external storage equipment is correspondingly generated, so that the original storage equipment and the newly added external storage equipment are divided into different storage layers in the storage system; and determining the hot spot data needing to be transferred in the original storage layer, and transferring the hot spot data with higher requirements on the performance of the storage device to a target storage layer corresponding to the newly added external storage device. Therefore, the newly added storage equipment is externally connected into the storage system, and the hot spot data is migrated to the target storage layer corresponding to the externally connected storage equipment, so that the hot spot data is stored in the externally connected storage equipment with higher performance, and better operating conditions are provided for the hot spot data. Meanwhile, the complex process of migrating all the data in the original storage equipment is avoided, a large amount of time is saved, and resource waste is avoided.

Fig. 4 is a structural diagram of a hierarchical device of a storage system according to an embodiment of the present invention, and as shown in fig. 4, the hierarchical device of the storage system according to an embodiment of the present invention includes a memory 20 for storing a computer program;

a processor 21 for implementing the steps of the hierarchical method of the storage system of any one of the above when executing the computer program.

The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 21 may further include an AI (Artificial Intelligence) processor for processing a calculation operation related to machine learning.

The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement relevant steps in the hierarchical method of the storage system disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among others, Windows, Unix, Linux, and the like.

In some embodiments, the server may also include an input output interface 22, a communication interface 23, a power supply 24, and a communication bus 25.

Those skilled in the art will appreciate that the architecture shown in FIG. 4 does not constitute a limitation of the hierarchy of storage systems and may include more or fewer components than those shown.

Since the embodiment of the device portion and the embodiment of the method portion correspond to each other, please refer to the description of the embodiment of the method portion for the embodiment of the device portion, which is not repeated here. In some embodiments of the invention, the processor and memory may be connected by a bus or other means.

The invention provides a layering device of a storage system, which can realize the following method: the method comprises the steps that a target storage layer corresponding to an external storage device is correspondingly generated by acquiring performance information of the newly added external storage device, so that the original storage device and the newly added external storage device are divided into different storage layers in a storage system; and determining the hot spot data needing to be transferred in the original storage layer, and transferring the hot spot data with higher requirements on the performance of the storage device to a target storage layer corresponding to the newly added external storage device. Therefore, the newly added storage equipment is externally connected into the storage system, and the hot spot data is migrated to the target storage layer corresponding to the externally connected storage equipment, so that the hot spot data is stored in the externally connected storage equipment with higher performance, and better operating conditions are provided for the hot spot data. Meanwhile, the complex process of migrating all the data in the original storage equipment is avoided, a large amount of time is saved, and resource waste is avoided.

Finally, the invention also provides a corresponding embodiment of the computer readable storage medium. The computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps as set forth in the above-mentioned method embodiments.

It is to be understood that if the method in the above embodiments is implemented in the form of software functional units and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and performs all or part of the steps of the methods according to the embodiments of the present invention, or all or part of the technical solution. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The foregoing describes a layering method, apparatus, device, and medium for a storage system provided by the present invention in detail. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.