阅读说明：本技术 一种多客户端定制卷QoS的方法、装置、设备及可读介质 (Method, device and equipment for customizing volume QoS (quality of service) by multiple clients and readable medium ) 是由 彭泽 胡永刚 于 2021-08-20 设计创作，主要内容包括：本发明提供了一种多客户端定制卷QoS的方法、装置、设备及可读介质,该方法包括：响应于接收到客户端设置QoS的指令,将设置的QoS策略和对应客户端的IP存储到卷的元数据中；响应于客户端启动工作线程,读取客户端的IP信息；基于读取到的IP信息获取卷的元数据中存储的QoS策略并执行获取的QoS策略。通过使用本发明的方案,能够根据客户端不同的需求执行不同的QoS策略,能够在业务执行过程中根据QoS策略控制业务请求负载,能够避免业务执行过程中的卡顿,提高了用户体验,兼顾了性能与稳定性,也符合当前高效、安全存储的要求和理念。(The invention provides a method, a device, equipment and a readable medium for customizing volume QoS by multiple clients, wherein the method comprises the following steps: in response to receiving an instruction for a client to set QoS, storing the set QoS policy and an IP of the corresponding client in metadata of a volume; responding to a client to start a working thread, and reading IP information of the client; and acquiring the QoS policy stored in the metadata of the volume based on the read IP information and executing the acquired QoS policy. By using the scheme of the invention, different QoS strategies can be executed according to different requirements of the client, the service request load can be controlled according to the QoS strategies in the service execution process, the blockage in the service execution process can be avoided, the user experience is improved, the performance and the stability are considered, and the requirements and the concepts of high-efficiency and safe storage at present are met.)

1. A method for multi-client customized volume QoS, characterized by comprising the following steps:

in response to receiving an instruction for a client to set QoS, storing the set QoS policy and an IP of the corresponding client in metadata of a volume;

responding to a client to start a working thread, and reading IP information of the client;

and acquiring the QoS policy stored in the metadata of the volume based on the read IP information and executing the acquired QoS policy.

2. The method of claim 1, wherein the QoS policy comprises a total bandwidth cap and a number of IOs per second that can pass through the volume.

3. The method of claim 1, wherein the worker thread comprises a librbd worker thread.

4. The method of claim 1, wherein storing the set QoS policy and the IP of the corresponding client in the metadata of the volume in response to receiving an instruction for the client to set QoS comprises:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode.

5. The method of claim 1, further comprising:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume.

6. An apparatus for multi-client customized volume QoS, the apparatus comprising:

a storage module configured to store the set QoS policy and IP of the corresponding client in metadata of a volume in response to receiving an instruction for the client to set QoS;

the reading module is configured to respond to the starting of a working thread of the client and read the IP information of the client;

an enforcement module configured to acquire the QoS policy stored in the metadata of the volume based on the read IP information and enforce the acquired QoS policy.

7. The apparatus of claim 6, wherein the QoS policy comprises a total bandwidth cap and a number of IOs per second that can pass through a volume.

8. The apparatus of claim 6, wherein the worker thread comprises a librbd worker thread.

9. A computer device, comprising:

at least one processor; and

a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of claims 1 to 5.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.

Technical Field

The field relates to the field of computers, and more particularly, to a method, apparatus, device and readable medium for multi-client customized volume QoS.

Background

For a client, an arbitrary file system can be formatted and established to use block storage like using a physical hard disk, so that the block storage is suitable for data storage in most general service scenarios and is more and more widely applied. In a block storage scenario, the volume assumes the main functional implementation and business output. In a cloud and virtual scene, a volume is often accessed in a multi-path mode to improve service stability and performance. Because each volume bears different services, a resource competition phenomenon generally exists, and in a severe case, a volume with extremely high throughput may cause severe blocking of other services, which seriously affects user experience. Therefore, the resource control of the volume is essential, and the resource division can effectively avoid the above situation by configuring the maximum QoS (Quality of Service) on the logical volume, which is equivalent to setting the upper limit of the Service. However, under the condition of multipath, a plurality of clients simultaneously access the same volume, and a single QoS policy obviously cannot adapt to the service requirements of different clients.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a device, and a readable medium for customizing a volume QoS for multiple clients, and by using the technical solution of the present invention, different QoS policies can be executed according to different requirements of a client, a service request load can be controlled according to the QoS policies during a service execution process, a jam during the service execution process can be avoided, user experience is improved, performance and stability are both considered, and a current concept of efficient and secure storage is complied with.

In view of the above object, an aspect of the embodiments of the present invention provides a method for multi-client customized volume QoS, including the following steps:

in response to receiving an instruction for a client to set QoS, storing the set QoS policy and an IP of the corresponding client in metadata of a volume;

responding to a client to start a working thread, and reading IP information of the client;

and acquiring the QoS policy stored in the metadata of the volume based on the read IP information and executing the acquired QoS policy.

According to one embodiment of the invention, the QoS policy includes the number of IOs that can pass through a volume per second and the total bandwidth cap.

According to one embodiment of the invention, the worker threads comprise librbd (block storage interface provided externally by ceph) worker threads.

According to an embodiment of the present invention, in response to receiving an instruction for a client to set QoS, storing the set QoS policy and an IP of a corresponding client in metadata of a volume includes:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode.

According to an embodiment of the present invention, further comprising:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume.

In another aspect of the embodiments of the present invention, there is also provided an apparatus for multi-client customized volume QoS, the apparatus including:

a storage module configured to store the set QoS policy and IP of the corresponding client in metadata of a volume in response to receiving an instruction for the client to set QoS;

the reading module is configured to respond to the starting of a working thread of the client and read the IP information of the client;

and an enforcement module configured to acquire the QoS policy stored in the metadata of the volume based on the read IP information and enforce the acquired QoS policy.

According to one embodiment of the invention, the QoS policy includes the number of IOs that can pass through a volume per second and the total bandwidth cap.

According to one embodiment of the invention, the worker threads comprise librbd worker threads.

According to one embodiment of the invention, the storage module is further configured to:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode.

According to an embodiment of the present invention, the system further comprises a deletion module configured to:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume.

In another aspect of an embodiment of the present invention, there is also provided a computer apparatus including:

at least one processor; and

a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of any of the methods described above.

In another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium storing a computer program, which when executed by a processor implements the steps of any one of the above-mentioned methods.

The invention has the following beneficial technical effects: in the method for customizing the volume QoS by the multiple clients provided by the embodiment of the invention, the set QoS strategy and the IP of the corresponding client are stored in the metadata of the volume by responding to the received instruction for setting the QoS by the client; responding to a client to start a working thread, and reading IP information of the client; the technical scheme of acquiring the QoS strategy stored in the metadata of the volume based on the read IP information and executing the acquired QoS strategy can execute different QoS strategies according to different requirements of the client, control the service request load according to the QoS strategy in the service execution process, avoid the blockage in the service execution process, improve the user experience, give consideration to the performance and the stability, and cater to the current high-efficiency and safe storage concept.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.

FIG. 1 is a schematic flow chart diagram of a method for multi-client customized volume QoS in accordance with one embodiment of the present invention;

fig. 2 is a schematic diagram of an apparatus for multi-client customized volume QoS according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a computer device according to one embodiment of the present invention;

fig. 4 is a schematic diagram of a computer-readable storage medium according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.

In view of the above objects, a first aspect of embodiments of the present invention proposes an embodiment of a method for multi-client customized volume QoS. Fig. 1 shows a schematic flow diagram of the method.

As shown in fig. 1, the method may include the steps of:

s1 stores the set QoS policy and the IP of the corresponding client in the metadata of the volume in response to receiving the instruction for the client to set QoS.

The RBD layer (distributed object storage block device) receives an instruction of setting QoS by a client, wherein the instruction comprises IP information of the client needing to set QoS and a policy of the same or different QoS executed by each client, the QoS policy comprises IOPS (input output per second) and bandwidth, namely the number of IO capable of being passed through a volume per second and the total bandwidth upper limit are limited, then each QoS policy set by the client and the IP information of each client are obtained, the set QoS policy and the IP information of the client needing to execute the QoS policy are saved into metadata of the volume in the form of key value pairs, wherein the key is the IP information of the client, and the corresponding value is the QoS policy.

S2 responds to the client starting the working thread, and reads the IP information of the client.

When a client starts a librbd (a user mode interface library belonging to librados) working thread, the IP information of the client is read.

S3 obtains the QoS policy stored in the metadata of the volume based on the read IP information and executes the obtained QoS policy.

Inquiring a corresponding key value pair in metadata of a volume according to the read IP information, then obtaining a corresponding QoS strategy, if the QoS strategy is obtained according to the IP information, updating the number of tokens regularly put in a timer according to a bucket token algorithm, if the number of the tokens in a token bucket is insufficient, blocking IO (input/output) issuing until the number of the tokens is sufficient, and if the number of the tokens in the token bucket is sufficient, directly issuing IO, thereby achieving the effect of changing the QoS setting. If the QoS strategy is not obtained according to the IP information, the volume or the client is considered to be not provided with the QoS strategy, namely the maximum IO number and bandwidth are not limited, the working logic of the librbd working thread is cancelled, whether the token in the token bucket algorithm is sufficient for IO passing is not judged, and IO is directly issued.

According to the technical scheme, different QoS strategies can be executed according to different requirements of the client, the service request load can be controlled according to the QoS strategies in the service execution process, the blockage in the service execution process can be avoided, the user experience is improved, the performance and the stability are considered, and the current high-efficiency and safe storage concept is met.

In a preferred embodiment of the present invention, the QoS policy includes the number of IOs per second that can pass through the volume and the total bandwidth cap.

In a preferred embodiment of the invention, the worker threads comprise librbd worker threads.

In a preferred embodiment of the present invention, in response to receiving an instruction for a client to set QoS, storing the set QoS policy and the IP of the corresponding client in the metadata of the volume includes:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode. Where the key is the client's IP information and the corresponding value is the QoS policy.

In a preferred embodiment of the present invention, the method further comprises:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume. And after the QoS strategy is deleted, the QoS configuration in the memory is updated to be unlimited, namely the maximum IO number and the bandwidth are not limited.

According to the technical scheme, different QoS strategies can be executed according to different requirements of the client, the service request load can be controlled according to the QoS strategies in the service execution process, the blockage in the service execution process can be avoided, the user experience is improved, the performance and the stability are considered, and the current high-efficiency and safe storage concept is met.

It should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by instructing relevant hardware through a computer program, and the above programs may be stored in a computer-readable storage medium, and when executed, the programs may include the processes of the embodiments of the methods as described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.

Furthermore, the method disclosed according to an embodiment of the present invention may also be implemented as a computer program executed by a CPU, and the computer program may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method disclosed in the embodiments of the present invention.

In view of the above object, according to a second aspect of the embodiments of the present invention, there is provided an apparatus for multi-client customized volume QoS, as shown in fig. 2, the apparatus 200 includes:

a storage module 201, wherein the storage module 201 is configured to store the set QoS policy and the IP of the corresponding client in the metadata of the volume in response to receiving the instruction for setting QoS by the client.

The RBD layer (distributed object storage block device) receives an instruction of setting QoS by a client, wherein the instruction comprises IP information of the client needing to set QoS and a policy of the same or different QoS executed by each client, the QoS policy comprises IOPS (input output per second) and bandwidth, namely the number of IO capable of being passed through a volume per second and the total bandwidth upper limit are limited, then each QoS policy set by the client and the IP information of each client are obtained, the set QoS policy and the IP information of the client needing to execute the QoS policy are saved into metadata of the volume in the form of key value pairs, wherein the key is the IP information of the client, and the corresponding value is the QoS policy.

And the reading module 202, wherein the reading module 202 is configured to read the IP information of the client in response to the client starting a working thread.

And when the client starts the librbd working thread, reading the IP information of the client.

And an enforcement module 203, the enforcement module 203 configured to acquire the QoS policy stored in the metadata of the volume based on the read IP information and enforce the acquired QoS policy.

Inquiring a corresponding key value pair in metadata of a volume according to the read IP information, then obtaining a corresponding QoS strategy, if the QoS strategy is obtained according to the IP information, updating the number of tokens regularly put in a timer according to a bucket token algorithm, if the number of the tokens in a token bucket is insufficient, blocking IO (input/output) issuing until the number of the tokens is sufficient, and if the number of the tokens in the token bucket is sufficient, directly issuing IO, thereby achieving the effect of changing the QoS setting. If the QoS strategy is not obtained according to the IP information, the volume or the client is considered to be not provided with the QoS strategy, namely the maximum IO number and bandwidth are not limited, the working logic of the librbd working thread is cancelled, whether the token in the token bucket algorithm is sufficient for IO passing is not judged, and IO is directly issued.

In a preferred embodiment of the present invention, the QoS policy includes the number of IOs per second that can pass through the volume and the total bandwidth cap.

In a preferred embodiment of the invention, the worker threads comprise librbd worker threads.

In a preferred embodiment of the present invention, the storage module is further configured to:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode. Where the key is the client's IP information and the corresponding value is the QoS policy.

In a preferred embodiment of the present invention, the system further includes a deletion module, and the deletion module is configured to:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume. And after the QoS strategy is deleted, the QoS configuration in the memory is updated to be unlimited, namely the maximum IO number and the bandwidth are not limited.

In view of the above object, a third aspect of the embodiments of the present invention provides a computer device. Fig. 3 is a schematic diagram of an embodiment of a computer device provided by the present invention. As shown in fig. 3, an embodiment of the present invention includes the following means: at least one processor S21; and a memory S22, the memory S22 storing computer instructions S23 executable on the processor, the instructions S23 when executed by the processor S21 implementing the method of:

1. in response to receiving an instruction for a client to set QoS, the set QoS policy and an IP of the corresponding client are stored in metadata of the volume.

The RBD layer (distributed object storage block device) receives an instruction of setting QoS by a client, wherein the instruction comprises IP information of the client needing to set QoS and a policy of the same or different QoS executed by each client, the QoS policy comprises IOPS (input output per second) and bandwidth, namely the number of IO capable of being passed through a volume per second and the total bandwidth upper limit are limited, then each QoS policy set by the client and the IP information of each client are obtained, the set QoS policy and the IP information of the client needing to execute the QoS policy are saved into metadata of the volume in the form of key value pairs, wherein the key is the IP information of the client, and the corresponding value is the QoS policy.

2. And responding to the client to start the working thread, and reading the IP information of the client.

And when the client starts the librbd working thread, reading the IP information of the client.

3. And acquiring the QoS policy stored in the metadata of the volume based on the read IP information and executing the acquired QoS policy.

Inquiring a corresponding key value pair in metadata of a volume according to the read IP information, then obtaining a corresponding QoS strategy, if the QoS strategy is obtained according to the IP information, updating the number of tokens regularly put in a timer according to a bucket token algorithm, if the number of the tokens in a token bucket is insufficient, blocking IO (input/output) issuing until the number of the tokens is sufficient, and if the number of the tokens in the token bucket is sufficient, directly issuing IO, thereby achieving the effect of changing the QoS setting. If the QoS strategy is not obtained according to the IP information, the volume or the client is considered to be not provided with the QoS strategy, namely the maximum IO number and bandwidth are not limited, the working logic of the librbd working thread is cancelled, whether the token in the token bucket algorithm is sufficient for IO passing is not judged, and IO is directly issued.

In a preferred embodiment of the present invention, the QoS policy includes the number of IOs per second that can pass through the volume and the total bandwidth cap.

In a preferred embodiment of the invention, the worker threads comprise librbd worker threads.

In a preferred embodiment of the present invention, in response to receiving an instruction for a client to set QoS, storing the set QoS policy and the IP of the corresponding client in the metadata of the volume includes:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode. Where the key is the client's IP information and the corresponding value is the QoS policy.

In a preferred embodiment of the present invention, the method further comprises:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume. And after the QoS strategy is deleted, the QoS configuration in the memory is updated to be unlimited, namely the maximum IO number and the bandwidth are not limited.

In view of the above object, a fourth aspect of the embodiments of the present invention proposes a computer-readable storage medium. FIG. 4 is a schematic diagram illustrating an embodiment of a computer-readable storage medium provided by the present invention. As shown in fig. 4, the computer readable storage medium S31 stores a computer program S32 that when executed by a processor performs the method of:

1. in response to receiving an instruction for a client to set QoS, the set QoS policy and an IP of the corresponding client are stored in metadata of the volume.

The RBD layer (distributed object storage block device) receives an instruction of setting QoS by a client, wherein the instruction comprises IP information of the client needing to set QoS and a policy of the same or different QoS executed by each client, the QoS policy comprises IOPS (input output per second) and bandwidth, namely the number of IO capable of being passed through a volume per second and the total bandwidth upper limit are limited, then each QoS policy set by the client and the IP information of each client are obtained, the set QoS policy and the IP information of the client needing to execute the QoS policy are saved into metadata of the volume in the form of key value pairs, wherein the key is the IP information of the client, and the corresponding value is the QoS policy.

2. And responding to the client to start the working thread, and reading the IP information of the client.

And when the client starts the librbd working thread, reading the IP information of the client.

3. And acquiring the QoS policy stored in the metadata of the volume based on the read IP information and executing the acquired QoS policy.

Inquiring a corresponding key value pair in metadata of a volume according to the read IP information, then obtaining a corresponding QoS strategy, if the QoS strategy is obtained according to the IP information, updating the number of tokens regularly put in a timer according to a bucket token algorithm, if the number of the tokens in a token bucket is insufficient, blocking IO (input/output) issuing until the number of the tokens is sufficient, and if the number of the tokens in the token bucket is sufficient, directly issuing IO, thereby achieving the effect of changing the QoS setting. If the QoS strategy is not obtained according to the IP information, the volume or the client is considered to be not provided with the QoS strategy, namely the maximum IO number and bandwidth are not limited, the working logic of the librbd working thread is cancelled, whether the token in the token bucket algorithm is sufficient for IO passing is not judged, and IO is directly issued.

In a preferred embodiment of the present invention, the QoS policy includes the number of IOs per second that can pass through the volume and the total bandwidth cap.

In a preferred embodiment of the invention, the worker threads comprise librbd worker threads.

In a preferred embodiment of the present invention, in response to receiving an instruction for a client to set QoS, storing the set QoS policy and the IP of the corresponding client in the metadata of the volume includes:

acquiring a QoS strategy set by a client and IP information of each client;

and storing the set QoS policy and the client IP information into the metadata of the volume in a key value pair mode. Where the key is the client's IP information and the corresponding value is the QoS policy.

In a preferred embodiment of the present invention, the method further comprises:

responding to a received instruction for deleting the QoS strategy, and acquiring IP information of a client contained in the instruction;

and deleting the QoS strategy corresponding to the acquired IP information stored in the metadata of the volume. And after the QoS strategy is deleted, the QoS configuration in the memory is updated to be unlimited, namely the maximum IO number and the bandwidth are not limited.

Furthermore, the methods disclosed according to embodiments of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. Which when executed by a processor performs the above-described functions defined in the methods disclosed in embodiments of the invention.

Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.

In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.