阅读说明：本技术 基于设备驱动程序的本地存储容量扩充系统 (Local storage capacity expansion system based on device driver ) 是由 蒋昊坤 唐尧 黄超 汪强 谢磊 于 2019-09-05 设计创作，主要内容包括：本发明公开了基于设备驱动程序的本地存储容量扩充系统,包括三种不同类型的终端与服务端进行交互,所有终端与服务端相互间进行数据传输,所述终端包括类型一终端、类型二终端和类型三终端,所述类型一终端、类型二终端内的操作系统分为用户空间和内核空间,所述类型一终端通过内核空间内的驱动程序与服务端进行交互,所述类型二终端通过用户空间内的终端网络通信库与服务端进行交互,所述类型三终端包括嵌入式应用程序和函数库,通过嵌入式应用程序和函数库配合与服务端进行交互。所述三种类型的终端包含的程序集为用户创建若干个本地存储设备或者通过软总线、虚拟总线接口、虚拟总线设备、虚拟存储设备技术创建若干个存储设备以此来实现本地存储容量的扩充。(The invention discloses a local storage capacity expansion system based on a device driver, which comprises three different types of terminals and a server side, wherein all the terminals and the server side carry out data transmission mutually, each terminal comprises a type-I terminal, a type-II terminal and a type-III terminal, operating systems in the type-I terminal and the type-II terminal are divided into a user space and a kernel space, the type-I terminal carries out interaction with the server side through the driver in the kernel space, the type-II terminal carries out interaction with the server side through a terminal network communication library in the user space, and the type-III terminal comprises an embedded application program and a function library and carries out interaction with the server side through the cooperation of the embedded application program and the function library. The program set contained in the three types of terminals creates a plurality of local storage devices for users or creates a plurality of storage devices through the technology of a soft bus, a virtual bus interface, a virtual bus device and a virtual storage device so as to realize the expansion of the local storage capacity.)

1. the local storage capacity expansion system based on the device driver is characterized by comprising three different types of terminals connected with a server, wherein all the terminals are mutually subjected to data transmission, each terminal comprises a type-one terminal, a type-two terminal and a type-three terminal, operating systems in the type-one terminal and the type-two terminal are divided into a user space and a kernel space, the type-one terminal transmits data to the server through a driver in the kernel space, the type-two terminal transmits the data to the server through a terminal network communication library in the user space, the type-three terminal comprises an embedded application program and a function library, and the embedded application program and the function library are matched to transmit the data to the server.

2. The local storage capacity expansion system based on the device driver as claimed in claim 1, wherein the user space of the type-one terminal is installed with the end user state program, the kernel space is installed with the device driver, the terminal network communication library is built in the device driver, the end user state program sends the control command and the parameters to the device driver, and the device driver performs data exchange with the server through the built-in terminal network communication library after processing.

3. the local storage capacity expansion system based on the device driver as claimed in claim 1, wherein the user space of the type two terminal is installed with a terminal user mode program and a terminal network communication library, the kernel space is installed with a device driver, the terminal user mode program performs data interaction with the terminal network communication library and the device driver, and the terminal network communication library performs data interaction with the server.

4. The device driver-based local storage capacity expansion system according to any one of claims 2 and 3, wherein the end-user mode program is configured to: converting the operation of a user into a control command with parameters for the device driver, sending the control command and the parameters to the device driver, and providing necessary resource access service for the device driver; the device driver is to: establishing a plurality of local storage devices in a terminal operating system or establishing a plurality of storage devices through a soft bus, a virtual bus interface, a virtual bus device and a virtual storage device technology, receiving requests of reading, writing, inquiring, controlling and the like of the storage devices sent by an operating system component, repackaging the requests, and sending the repackaging requests to a server through a terminal network communication library integrated in a terminal program; the terminal network communication library is used for: and interacting with the server, and ensuring the reliability, confidentiality, integrity and verification of data transmission in the mobile environment and session maintenance.

5. The device driver-based local storage capacity expansion system of claim 1, wherein the type three embedded application is configured to: the network transceiving data function is realized by matched software of the embedded application program and is provided by a developer of the embedded application program, and the function library is used for: receiving callback registration operation of a network transceiving data function from the outside, and providing a general data read-write interface to the outside; the function library realizes the request packing, the sending to the server, the receiving of the server response and the notification of the caller data arrival of the function library, and realizes the data confidentiality, the data integrity, the authenticable and the mobile session maintenance in the network function part in the function library.

6. The device driver-based local storage capacity expansion system according to claim 1, wherein the server includes a server network communication library, a request processing module, and a data source management module, the server network communication library is configured to: receiving data sent by each terminal, performing data interaction with the request processing module, receiving data fed back by the request processing module, and sending the feedback data to the corresponding terminal; the request processing module is used for: receiving a storage equipment operation request transmitted by a terminal through a server network communication library, and performing data interaction with the server network communication library and a data source management module; the data source management module is used for: and performing data interaction with the request processing module, providing request response data of the user to the request processing module, executing the operation of the storage device, and returning an operation result to the request processing module.

Technical Field

The invention relates to a storage capacity expansion system, in particular to a local storage capacity expansion system based on a device driver.

Background

With the development of information technology, a large amount of information is converted into data which can be recognized by a computer through digitization and then is processed by the existing computer system, new requirements are put on the existing computer storage system, and the computer system is required to have elastic data storage capacity. The storage quota of the existing computer system is calibrated before the business system is on-line, and when the storage capacity is expanded in the later period, system shutdown processing is usually required, so that the requirements of modern application on non-shutdown and flexible dynamic capacity expansion are difficult to meet. In the smart device, a user may have insufficient capacity of the storage device due to taking a large number of photos, videos and the like, and the modern smart device has limited storage expansion capability and is difficult to flexibly meet the capacity expansion requirement of the user on the storage device.

In order to solve the above-mentioned demand of the user for the storage capacity expansion and due to the popularization of the cloud computing, many companies have introduced the cloud storage service, and various cloud disks have come to be shipped. The large volume of gmail has been used by users to store files in 2005, at which time the concept of network disk has become popular. 115 net disks, hua is DBank and the like in 2009 became representatives of domestic net disks. In 2012, various net disks rise together, and famous Baidu net disk, Tian Yi Yun, Wai Jia net disk, 115 net disk and the like, and the net disk enters 3.0 times, and personal cloud storage occupies an absolute leading role.

The existing network disks are realized in an application layer, a user needs to install a client application program corresponding to the network disk, upload and download own data through client software, and use storage resources of a cloud. Firstly, the implementation mode is troublesome to use, and a user needs to upload own data to a cloud end or download data from the cloud end manually through client software, so that the transparent and local operation cannot be realized; then, the user experience is poor, each file stored in the cloud by the user must be completely downloaded to the local through client software before each use, and the user experience is extremely influenced by the waiting process; moreover, currently, each network disk cannot dynamically, customizes and finely adjust cloud resource configuration according to the resource use condition of the user, and generally, storage capacity expansion of the user is performed in the GB level or above.

In the field of enterprise storage, conventional network storage technologies include technologies such as a Network File System (NFS) implemented at a file system level, iSCSI implemented at a disk level, and a Network Block Device (NBD), but these technologies are all designed for an enterprise network, and cannot be applied to a complex and variable mobile network environment, and cannot meet dynamic, customization, and mobility requirements of various intelligent terminals and embedded devices on storage devices at the present stage.

with the rapid development of 5G and the rapid improvement of network infrastructure, how to construct a cloud storage system which is transparent to users, quick in response and high in customization is a very valuable problem. The method of the invention abandons the current mode that each large network disk realizes the client application program in the user mode, and directly provides a plurality of virtual local storage devices to the upper layer through the mode that the client software communicates with the cloud storage system. The user can directly use the newly-added storage device as a local device. This allows the user to use the device just as if it were a local physical storage device, with no difference at all, and complete transparency. The method can be used on some common intelligent terminal devices, and can be modified, customized and transplanted to some embedded devices, so that the method has wide application prospect.

disclosure of Invention

The technical problem to be solved by the invention is to develop a program set to virtualize a plurality of local storage devices for users, wherein the program set comprises a corresponding terminal network communication library, a terminal user mode program and a device driver. The terminal network communication library sends various device read-write requests on the storage device to a remote server in real time, then the server performs corresponding operations on a rear-end storage network according to the requests of users, such as mounting of a specified storage device, capacity inquiry, data read-write and the like, and then returns operation results and user data (during data read operation) to the terminal network communication library, the terminal network communication library interacts with a device driver, and the device driver informs the completion of the requests, so that expansion of local storage capacity is realized, and the purpose is to provide a local storage capacity expansion system based on the device driver.

The invention is realized by the following technical scheme:

The local storage capacity expansion system based on the device driver comprises three different types of terminals connected with a server, wherein all the terminals and the server are mutually subjected to data transmission, each terminal comprises a type-I terminal, a type-II terminal and a type-III terminal, operating systems in the type-I terminal and the type-II terminal are divided into a user space and a kernel space, the type-I terminal is interacted with the server through the driver in the kernel space, the type-II terminal is interacted with the server through a terminal network communication library in the user space, the type-III terminal comprises an embedded application program and a function library, and data are transmitted into the server through the cooperation of the embedded application program and the function library.

In conventional storage systems, this Application Programming Interface (API) is the SCSI/iSCSI protocol, but in the cloud environment, these protocols evolve, with Web service front ends, file-based front ends, or even more conventional front ends. The front end is followed by a middle layer, called storage logic, which performs various functions such as replication and data compression by conventional data placement algorithms (taking into account geographical layout). Finally, the back-end implements physical storage of data, which may be a conventional back-end of a physical disk or an internal protocol that implements a specific function.

One of the most significant differences between cloud storage and traditional storage is its access method, with most providers implementing multiple access methods, but Web services Application Programming Interfaces (APIs) are the most common. Many APIs are implemented based on REST principles, an object-based scheme developed over HTTP (transported using the HTTP protocol). The cloud storage access method is to design some upper layer protocols at an application layer to realize data transmission and access.

The performance of cloud storage appears to be many-fold, but the ability to move data between users and remote cloud storage providers is the biggest challenge of cloud storage. The problem is the Transmission Control Protocol (TCP) of the network, which is also the master of the internet. TCP controls the flow of data from peer endpoints based on packet acknowledgements. Congestion control will be enabled in case of packet loss or delayed arrival, further limiting performance to avoid more global network problems. TCP is suitable for enabling small amounts of data over the global Internet, but is not suitable for large data moves that increase Round Trip Time (RTT).

In embedded applications and industrial internets, factory plants or other industrial facilities produce data, which are discrete points, analog quantities, intelligent device status, bar codes, etc., and a Human Machine Interface (HMI) data concentrator is connected to the controller to gather the information for local operators. The HMI data concentrator works in conjunction with the controller to collect all data from the edge equipment for real-time operation and process improvement can be made accordingly. Some information needs to be stored, usually as analytical data, in order to improve operational activities. And the data provided by the data concentrator is stored by the cloud. Promoting the cloud of data and even HMI application programs provides a way for maintaining the efficiency of machines and processes by utilizing data analysis.

In some applications, the embedded HMI may be a "bald" device without a local display. In this case, all operator interface functions may be implemented by connecting a local smart device, such as a smartphone or tablet, to the cloud. These hybrid systems not only provide the data aggregation functionality and operational interface of the HMI, but also have the ability to provide real-time and historical information for remote devices. While most of the data can be delivered to the cloud, it still requires local operations and monitoring, and it still requires that the data be delivered to a person in need for management, or to any other part of the manufacturing chain. The access method of the cloud storage has the disadvantages that the data transmission is carried out by adopting a data access protocol designed at the upper layer, so that the access needs to be carried out by means of an intermediate upper layer application program, the transparency cannot be realized, the terminal cannot use the data stored in the cloud end like using local data, the cloud end data must be downloaded to the local before being used, and the processing efficiency of a service system is reduced by the intermediate data transmission delay; for an individual user, such transmission delay greatly reduces the user experience; in the field of embedded industrial application, in order to support data communication using an upper layer protocol and a cloud, the embedded end needs to have sufficient software and hardware resources, which increases the hardware and software design cost of the embedded device.

therefore, the technical problem to be solved by the technology adopted in this application document needs to develop a program set to virtualize a plurality of local storage devices for the user, where the program set includes a corresponding terminal network communication library, a terminal user mode program, and a device driver. The terminal network communication library sends various device read-write requests on the storage device to a remote server in real time, then the server performs corresponding operations on a rear-end storage network according to the requests of users, such as mounting of a specified storage device, capacity inquiry, data read-write and the like, and then returns operation results and user data (during data read operation) to the terminal network communication library, the terminal network communication library interacts with a device driver, and the device driver informs the completion of the requests, so that the expansion of local storage capacity is realized. The biggest difference between the scheme of the invention and the prior art is that the invention additionally has locality and mobility. The locality is that the application program on the terminal device uses the storage device provided by the technology to be indistinguishable from the local physical device, the mobility provides a session maintaining function under the state of changing the network environment, and the session under the old network environment can be seamlessly migrated to the new network environment to provide smooth, consistent and imperceptible use experience.

Further, a terminal user state program is installed in the user space of the type-one terminal, an equipment driver is installed in the kernel space, the terminal network communication library is built in the equipment driver, the terminal user state program sends the control command and the parameters to the equipment driver, and after the control command and the parameters are processed by the equipment driver, data exchange is carried out between the terminal network communication library and the server through the terminal network communication library.

Furthermore, a terminal user mode program and a terminal network communication library are installed in the user space of the type two terminal, a device driver is installed in the kernel space, the terminal user mode program performs data interaction with the terminal network communication library and the device driver, and the terminal network communication library performs data interaction with the server.

Further, the end-user state program is configured to: converting the operation of a user into a control command with parameters for the device driver, sending the control command and the parameters to the device driver, and providing necessary resource access service for the device driver; the device driver is to: the method comprises the steps of establishing a plurality of local storage devices in a terminal operating system or establishing a plurality of storage devices through a soft bus, a virtual bus interface, a virtual bus device and a virtual storage device technology, receiving requests of reading, writing, inquiring, controlling and the like of the storage devices sent by an operating system component, repacking the requests, sending the repacked requests to a server through a terminal network communication library integrated in a terminal program, and ensuring the locality of the virtualized storage devices; the terminal network communication library is used for: and interacting with the server, and ensuring the reliability, confidentiality, integrity and verification of data transmission in the mobile environment and session maintenance.

Further, the embedded application within type three is to: the network transceiving data function is realized by matched software of the embedded application program and is provided by a developer of the embedded application program, and the function library is used for: receiving callback registration operation of a network transceiving data function from the outside, and providing a general data read-write interface to the outside; the function library realizes the request packing, the sending to the server, the receiving of the server response and the notification of the caller data arrival of the function library, and realizes the data confidentiality, the data integrity, the authenticable and the mobile session maintenance in the network function part in the function library.

Further, the server includes a server network communication library, a request processing module and a data source management module, and the server network communication library is configured to: receiving data sent by each terminal, performing data interaction with the request processing module, receiving data fed back by the request processing module, and sending the feedback data to the corresponding terminal; the request processing module is used for: receiving a storage equipment operation request transmitted by a terminal through a server network communication library, wherein the storage equipment operation request comprises a read-write request and a storage equipment control command, and performing data interaction with the server network communication library and a data source management module; the data source management module is used for: and performing data interaction with the request processing module, providing request response data of a user to the request processing module, executing the operation of the storage device, and returning an operation result to the request processing module, wherein the operation result comprises a read-write result, response data, a storage device control command execution condition and the like.

Compared with the prior art, the invention has the following advantages and beneficial effects:

1. The invention realizes the local storage capacity expansion system from the system bottom layer through the storage device virtual technology. Compared with the scheme of 'downloading before opening' of the network disk at the present stage, the technology provided by the invention can ensure that the original software is directly read and written on the storage equipment provided by the local storage capacity expansion system based on the equipment driving program without being changed, the downloading flow of the network disk is completely omitted, the local storage capacity expansion system based on the equipment driving program has the advantages of consistent use experience with the local physical storage equipment, strong compatibility and wider application range compared with the network disk;

2. The local storage capacity expansion system based on the device driver provided by the invention has a mobile session holding function. When a user switches among networks, the technology automatically maintains mobile session, and automatically switches the storage equipment session established in the old network environment to the new network environment, thereby effectively solving the problems that the traditional network storage technology cannot be adapted when the network environment and the IP address of the mobile terminal frequently change;

3. The local storage capacity expansion system based on the device driver provided by the invention has a transparent encryption function of storage device data. The user can judge whether the storage equipment is encrypted or not according to the requirement, the encryption key is customized, and the server stores the encrypted data. Encryption and decryption are completed at the terminal, and the user in the encryption process is completely independent and controllable. In the case of the correct decryption key being entered, the encrypted storage device is completely transparent to the upper layer application, which does not perceive the presence of the encryption. On the premise of not changing the original operation habit of the user, the privacy of the user data is effectively guaranteed.

4. The local storage capacity expansion system based on the device driver provided by the invention has the advantages that the consumption of the power, the data and the like of the device is very little, the energy can be effectively saved, the endurance time of the device is prolonged, and the local storage capacity expansion system is particularly suitable for mobile devices with limited conditions;

5. The local storage capacity expansion system based on the device driver can realize seamless access of user data among multiple devices. I.e. to mount the memory of the old device directly on the new device. When a user switches from an old device to a new device or switches from a household device to an office device, the local storage capacity expansion system based on the device driver provided by the invention can provide a fast and smooth data access experience among multiple devices, and is particularly suitable for users who often need to synchronize data in different occasions, such as: government agencies, national enterprises and public institutions, business personnel who frequently go on business, mobile office personnel who come and go among a plurality of places, university lecturers and the like;

6. The local storage capacity expansion system based on the device driver can realize the online upgrade of a terminal operating system, an application program, data and the like, and can realize the upgrade operation only by simply restarting the device. Namely, after the system is restarted, the upgraded new system, application program, data and the like are mounted without the intervention of the existing upgrading technology such as system programming (ISP), application programming (IAP), over-the-air (OTA) and the like.

Drawings

The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:

Fig. 1 is a flow diagram of a prior art Network File System (NFS) system architecture system.

Fig. 2 is a system flow diagram of a cloud storage access method in the prior art.

Fig. 3 is a flow chart of three terminal implementation and server implementation systems of the present invention.

Fig. 4 is a schematic diagram of the operation of the type-one terminal and the type-two terminal according to the present invention.

Fig. 5 is a schematic diagram of the operation of a type three terminal program of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples and accompanying drawings, and the exemplary embodiments and descriptions thereof are only used for explaining the present invention and are not meant to limit the present invention.