Data processing method, data processing device, SMR storage system and storage medium

文档序号:1296031 发布日期:2020-08-07 浏览:11次 中文

阅读说明:本技术 数据处理方法、装置、smr存储系统及存储介质 (Data processing method, data processing device, SMR storage system and storage medium ) 是由 叶敏 林鹏 林起芊 王伟 于 2019-01-30 设计创作,主要内容包括:本申请实施例提供了数据处理方法、装置、SMR存储系统及存储介质,获取数据写入指令;按照数据写入指令,在目标SMR磁盘的SMR区域中确定待写入目标数据的目标对象块;生成针对目标数据及目标对象块的目标主索引信息及目标备索引信息;将目标数据及目标备索引信息写入的目标对象块中;将目标主索引信息写入到CMR区域或其他存储介质中;在其他存储介质中写入目标数据的数据库索引信息,目标数据的数据库索引信息包括目标Unit key及目标对象块的标识。通过数据库索引信息、主索引信息及备索引信息,可以实现SMR区域中各数据块之间的数据写入顺序不受限制,增加了SMR磁盘数据存储的可操作性,数据存储效率高。(The embodiment of the application provides a data processing method, a data processing device, an SMR storage system and a storage medium, and obtains a data write-in instruction; determining a target object block to be written with target data in an SMR area of a target SMR disk according to a data writing instruction; generating target main index information and target standby index information aiming at target data and target object blocks; writing the target data and the target standby index information into a target object block; writing the target main index information into a CMR area or other storage media; and writing database index information of the target data in other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block. By the aid of the database index information, the main index information and the standby index information, the data writing sequence among the data blocks in the SMR area is not limited, operability of data storage of the SMR disk is improved, and data storage efficiency is high.)

1. A data processing method applied to a Shingled Magnetic Recording (SMR) storage system, the SMR storage system including an SMR disk and other storage media, the SMR disk including a CMR area and an SMR area, the SMR area being logically divided into a plurality of blocks ZONE, the blocks including object blocks, the method comprising:

acquiring a data writing instruction, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key;

determining a target object block to be written with the target data in an SMR area of the target SMR disk according to the data writing instruction;

generating target main index information and target standby index information aiming at the target data and the target object block;

writing the target data and the target standby index information into the target object block;

writing the target primary index information into the CMR area or the other storage medium;

and writing database index information of the target data in the other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block.

2. The method of claim 1, wherein the determining, in accordance with the data write instruction, a target object block to write the target data in an SMR area of the target SMR disk comprises:

and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.

3. The method of claim 1, wherein the determining, in accordance with the data write instruction, a target object block to write the target data in an SMR area of the target SMR disk comprises:

according to the target Unit key, reading database index information of the target Unit key from the other storage media;

and determining a target object block to be written in the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.

4. The method of claim 1, further comprising:

acquiring a data reading instruction, wherein the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;

according to the data reading instruction, database index information of the data to be read is obtained from the other storage media;

determining an object block where the data to be read is located according to database index information of the data to be read;

and reading the data to be read in the object block where the data to be read is located.

5. The method of claim 1, further comprising:

acquiring a data deletion instruction, wherein the data deletion instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;

according to the data deleting instruction, database index information of the data to be deleted is obtained from the other storage media;

determining the identifier of the object block where the data to be deleted is located according to the database index information of the data to be deleted;

deleting the main index information of the object block where the data to be deleted is located according to the identifier of the object block where the data to be deleted is located;

and deleting the database index information of the data to be deleted.

6. The method of claim 1, further comprising:

acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;

acquiring each main index information of the SMR disk to be recovered according to the disk recovery information;

and according to the main index information of the SMR disk to be restored, restoring the database index information of the SMR disk to be restored in the other storage media.

7. A data processing apparatus applied to an SMR storage system, the SMR storage system including an SMR disk and other storage media, the SMR disk including a CMR area and an SMR area, the SMR area being logically divided into a plurality of blocks ZONE, the blocks including object blocks, the apparatus comprising:

the data writing instruction comprises target data to be written, an identifier of a target SMR disk to be written with the target data and a target Unit key;

a target object block determination module, configured to determine, according to the data write instruction, a target object block to which the target data is to be written in an SMR area of the target SMR disk;

the index information generation module is used for generating target main index information and target standby index information aiming at the target data and the target object block;

a first index information writing module, configured to write the target data and the target standby index information into the target object block;

a second index information writing module, configured to write the target primary index information into the CMR area or the other storage medium;

and a third index information writing module, configured to write database index information of the target data in the other storage media, where the database index information of the target data includes the target Unit key and the identifier of the target object block.

8. The apparatus of claim 7, wherein the target object block determination module is specifically configured to:

and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.

9. The apparatus of claim 7, wherein the target object block determination module comprises:

a database index information acquisition submodule, configured to read database index information of the target Unit key from the other storage media according to the target Unit key;

and the target object block determining submodule is used for determining a target object block to be written with the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.

10. The apparatus of claim 7, further comprising:

the device comprises a reading instruction acquisition module, a data reading instruction processing module and a data processing module, wherein the reading instruction acquisition module is used for acquiring a data reading instruction, and the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;

the first index information acquisition module is used for acquiring database index information of the data to be read from the other storage media according to the data reading instruction;

the reading position determining module is used for determining an object block where the data to be read is located according to the database index information of the data to be read;

and the data reading module is used for reading the data to be read in the object block where the data to be read is located.

11. The apparatus of claim 7, further comprising:

the data deleting method comprises a deleting instruction obtaining module, a deleting instruction obtaining module and a deleting module, wherein the deleting instruction obtaining module is used for obtaining a data deleting instruction, and the data deleting instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;

a second index information obtaining module, configured to obtain, according to the data deletion instruction, database index information of the data to be deleted from the other storage media;

the object block identification determining module is used for determining the identification of the object block where the data to be deleted is located according to the database index information of the data to be deleted;

a main index information deleting module, configured to delete the main index information of the object block in which the data to be deleted is located according to the identifier of the object block in which the data to be deleted is located;

and the database index information deleting module is used for deleting the database index information of the data to be deleted.

12. The apparatus of claim 7, further comprising:

the recovery information acquisition module is used for acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;

a main index information obtaining module, configured to obtain, according to the disk recovery information, each main index information of the SMR disk to be recovered;

and the database index information recovery module is used for recovering the database index information of the SMR disk to be recovered in the other storage media according to the main index information of the SMR disk to be recovered.

13. An SMR storage system, comprising: the SMR disk comprises a CMR area and an SMR area, and the SMR area comprises a plurality of object blocks;

the object block is used for storing object data and index information;

the CMR area is used for storing main index information;

the other storage media are used for storing database index information;

the processor is adapted to perform the data processing method of any of the preceding claims 1-6 when executed.

14. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 6.

23页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:快取存储器及快取存储器的管理方法

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!

技术分类