阅读说明：本技术 一种数据处理方法及装置 (A kind of data processing method and device ) 是由 刘军 刘宇 关雯雪 崔军红 勾毓 张桐 李博 冯英文 王俊 杜昕祺 于 2019-08-30 设计创作，主要内容包括：本发明提供一种数据处理方法及装置,获取传感器采集的采集点处的海洋环境数据,采集点为预先确定,对海洋环境数据进行处理并分类,获得不同类别的海洋环境数据,按照不同类别将海洋环境数据存储于预先构建的时序数据库中对应不同类别的存储区中,预先构建的时序数据库中包括组件信息存储区和数据存储区,该组件信息存储区包括用于存储传感器基础信息的第一存储区,用于存储采集点基础信息的第二存储区,其中,数据存储区包括不同类别对应的存储区。利用构建的具有分布式结构的时序数据库,存储不同类别的海洋环境数据,解决了当用于集中式管理海洋环境数据的数据库出现损坏时,会导致出现整个数据库中的海洋环境数据都不能被用户调用的问题。(The present invention provides a kind of data processing method and device, obtain the marine environment data at the collection point of sensor acquisition, collection point is predetermined, marine environment data is handled and is classified, obtain different classes of marine environment data, it is corresponded in the time series database constructed in advance in different classes of memory block according to different classes of be stored in marine environment data, it include module information memory block and data storage area in the time series database constructed in advance, the module information memory block includes the first memory block for storage sensor basic information, for storing the second memory block of collection point basic information, wherein, data storage area includes different classes of corresponding memory block.Utilize the time series database with distributed frame of building, store different classes of marine environment data, solves the problem of marine environment data that will lead to when the database for centralized management marine environment data damages occur in entire database cannot all be called by user.)

1. a kind of data processing method, which is characterized in that the described method includes:

The marine environment data at the collection point of sensor acquisition is obtained, the collection point is predetermined；

The marine environment data is handled and classified, different classes of marine environment data is obtained；

According to it is different classes of the marine environment data is stored in the time series database constructed in advance correspond to it is different classes of It include module information memory block and data storage area, the component letter in the time series database constructed in advance in memory block Breath memory block includes the first memory block for storage sensor basic information, and second for storing collection point basic information deposits Storage area, the data storage area include different classes of memory block.

2. the method according to claim 1, wherein the process of building time series database, comprising:

Building is used for the sensor sheet of storage sensor basic information, and the sensor sheet includes the identity of the sensor The identity ID of collection point belonging to ID, the sensor, the title of the sensor, the working condition of the sensor and The data category of the marine environment data of the sensor acquisition；

For storing collection point basic information collection point table, the collection point table includes the identity of the collection point for building ID, the location information of the collection point, the sensor type in the collection point；

The tables of data for storing different classes of marine environment data is constructed, the tables of data includes marine environment data class Not, the environmental data of the environmental data of ocean depth, the environmental data of ocean angle, ocean longitude and latitude.

3. according to the method described in claim 2, it is characterized in that, building is for storing different classes of marine environment data Table, comprising:

Construct thermohaline depth CTD table, dissolved oxygen SEB63 table, methane mets table and single-point current meter rcm table.

4. the method according to claim 1, wherein described handled and divided to the marine environment data Class obtains different classes of marine environment data, comprising:

Data decompression processing is carried out to the marine environment data of sensor acquisition, and judges having for the data after decompression Effect property obtains effective first data；

First data are subjected to data normalization processing, obtain the second data；

Second data are subjected to the processing of data re-scheduling, obtain third data；

Data quality control processing is carried out to the third data, obtains marine environment data after data processing；

The marine environment data after data processing is classified, different classes of marine environment data is obtained.

5. the method according to claim 1, wherein if the classification of the marine environment data includes temperature, salt Degree, oxygen, methane and current speed, it is described according to the different classes of timing for being stored in the marine environment data and constructing in advance It is corresponded in database in different classes of memory block, comprising:

Determine depth data, longitude data and the latitude data at each collection point；

Temperature, salinity, the time sequencing of oxygen, methane and current speed at the collection point are acquired according to each sensor, Respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, thing current speed data and North and south current speed data are stored in corresponding different classes of storage in conjunction with the depth data, longitude data and latitude data Qu Zhong.

6. a kind of data processing equipment, which is characterized in that described device includes:

Module is obtained, the marine environment data at collection point for obtaining sensor acquisition, the collection point is predetermined；

Processing module obtains different classes of marine environment data for the marine environment data to be handled and classified；

Memory module, for according to it is different classes of the marine environment data is stored in it is right in the time series database constructed in advance It answers in different classes of memory block, includes that module information memory block and data store in the time series database constructed in advance Area, the module information memory block includes the first memory block for storage sensor basic information, for storing collection point base Second memory block of plinth information, the data storage area include different classes of memory block.

7. device according to claim 6, which is characterized in that the memory module, comprising:

First construction unit, for constructing the sensor sheet for being used for storage sensor basic information, the sensor sheet includes institute State the identity ID of collection point belonging to the identity ID of sensor, the sensor, title of the sensor, described The data category of the working condition of sensor and the marine environment data of sensor acquisition；

Second construction unit, for constructing for storing collection point basic information collection point table, the collection point table includes institute State the identity ID of collection point, the location information of the collection point, the sensor type in the collection point；

Third construction unit, for constructing the tables of data for storing different classes of marine environment data, the tables of data packet Include marine environment data classification, the environmental data of ocean depth, the environmental data of ocean angle, ocean longitude and latitude environment Data.

8. device according to claim 7, which is characterized in that the third construction unit, comprising:

Subelement is constructed, for constructing thermohaline depth CTD table, dissolved oxygen SEB63 table, methane mets table and single-point current meter rcm table.

9. device according to claim 6, which is characterized in that the processing module, comprising:

Data decompression processing unit, the marine environment data for acquiring to the sensor carry out data decompression processing, And judge the validity of the data after decompression, obtain effective first data；

Data normalization processing unit obtains the second data for first data to be carried out data normalization processing；

Data re-scheduling processing unit obtains third data for second data to be carried out the processing of data re-scheduling；

Data quality control processing unit obtains for carrying out data quality control processing to the third data and passes through data Marine environment data that treated；

Taxon obtains different classes of sea for the marine environment data after data processing to be classified Foreign environmental data.

10. device according to claim 6, which is characterized in that the memory module, comprising:

Determination unit, for determining depth data, longitude data and latitude data at each collection point；

Storage unit, for acquiring temperature, salinity, oxygen, methane and ocean current speed at the collection point according to each sensor The time sequencing of degree, respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, thing sea Stream speed data and north and south current speed data in conjunction with the depth data, longitude data and latitude data be stored in it is corresponding not In generic memory block.

Technical field

The invention belongs to field of computer technology, are specially related to a kind of data processing method and device.

Background technique

With the progress of science and technology, the arrival in data information epoch, information content was fast-developing in recent years, was related to Field is very more, wherein just includes the exploration to ocean.During exploring marine field, to the marine environment of acquisition Data carry out centralized management in the database.

But marine environment data is managed with the way to manage of centralization, when for centralized management marine environment data Database when damaging, will lead to and the marine environment data in entire database occur and be unable to being asked by what user called Topic.

Summary of the invention

In view of this, being used to collect for solving to work as the purpose of the present invention is to provide a kind of data processing method and device The database of Chinese style management marine environment data is when damaging, and will lead to marine environment data in the entire database of appearance all The problem of can not being called by user.Technical solution is as follows:

The present invention provides a kind of data processing method, which comprises

The marine environment data at the collection point of sensor acquisition is obtained, the collection point is predetermined；

The marine environment data is handled and classified, different classes of marine environment data is obtained；

Inhomogeneity is corresponded to according to the different classes of marine environment data is stored in the time series database constructed in advance In other memory block, in the time series database constructed in advance include module information memory block and data storage area, described group Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, the data storage area include different classes of memory block.

Preferably, the process of time series database is constructed, comprising:

Building is used for the sensor sheet of storage sensor basic information, and the sensor sheet includes the identity of the sensor Identify the work shape of the identity ID of collection point belonging to ID, the sensor, the title of the sensor, the sensor The data category of state and the marine environment data of sensor acquisition；

For storing collection point basic information collection point table, the collection point table includes the identity of the collection point for building Identify ID, the location information of the collection point, the sensor type in the collection point；

The tables of data for storing different classes of marine environment data is constructed, the tables of data includes marine environment data Classification, the environmental data of ocean depth, the environmental data of ocean angle, ocean longitude and latitude environmental data.

Preferably, building is for storing different classes of marine environment data table, comprising:

Construct thermohaline depth CTD table, dissolved oxygen SEB63 table, methane mets table and single-point current meter rcm table.

Preferably, described that the marine environment data is handled and classified, obtain different classes of marine environment number According to, comprising:

Data decompression processing is carried out to the marine environment data of sensor acquisition, and judges the data after decompression Validity, obtain effective first data；

First data are subjected to data normalization processing, obtain the second data；

Second data are subjected to the processing of data re-scheduling, obtain third data；

Data quality control processing is carried out to the third data, obtains marine environment data after data processing；

The marine environment data after data processing is classified, different classes of marine environment number is obtained According to.

Preferably, described if the classification of the marine environment data includes temperature, salinity, oxygen, methane and current speed Different classes of storage is corresponded in the time series database constructed in advance according to different classes of be stored in the marine environment data Qu Zhong, comprising:

Determine depth data, longitude data and the latitude data at each collection point；

The time for acquiring temperature at the collection point, salinity, oxygen, methane and current speed according to each sensor is suitable Sequence, respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, thing current speed data Corresponding different classes of deposit is stored in conjunction with the depth data, longitude data and latitude data with north and south current speed data In storage area.

The present invention also provides a kind of data processing equipment, described device includes:

Module is obtained, the marine environment data at collection point for obtaining sensor acquisition, the collection point is preparatory It determines；

Processing module obtains different classes of marine environment for the marine environment data to be handled and classified Data；

Memory module, for the marine environment data to be stored in the time series database constructed in advance according to different classes of It include that module information memory block and data are deposited in the different classes of memory block of middle correspondence, in the time series database constructed in advance Storage area, the module information memory block includes the first memory block for storage sensor basic information, for storing collection point Second memory block of basic information, the data storage area include different classes of memory block.

Preferably, the memory module, comprising:

First construction unit, for constructing the sensor sheet for being used for storage sensor basic information, the sensor sheet packet Include the identity ID of collection point belonging to the identity ID of the sensor, the sensor, the title of the sensor, The data category of the working condition of the sensor and the marine environment data of sensor acquisition；

Second construction unit, for constructing for storing collection point basic information collection point table, the collection point table packet Include the identity ID of the collection point, the location information of the collection point, the sensor type in the collection point；

Third construction unit, for constructing the tables of data for storing different classes of marine environment data, the data Table includes marine environment data classification, the environmental data of ocean depth, the environmental data of ocean angle, ocean longitude and latitude Environmental data.

Preferably, the third construction unit, comprising:

Subelement is constructed, for constructing thermohaline depth CTD table, dissolved oxygen SEB63 table, methane mets table and single-point current meter Rcm table.

Preferably, the processing module, comprising:

Data decompression processing unit, the marine environment data for acquiring to the sensor carry out at data decompression Reason, and judge the validity of the data after decompression, obtain effective first data；

Data normalization processing unit obtains the second data for first data to be carried out data normalization processing；

Data re-scheduling processing unit obtains third data for second data to be carried out the processing of data re-scheduling；

Data quality control processing unit is passed through for carrying out data quality control processing to the third data Marine environment data after data processing；

Taxon obtains different classes of for the marine environment data after data processing to be classified Marine environment data.

Preferably, the memory module, comprising:

Determination unit, for determining depth data, longitude data and latitude data at each collection point；

Storage unit, for acquiring temperature, salinity, oxygen, methane and sea at the collection point according to each sensor The time sequencing of flow velocity degree, respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, east It flows speed data and north and south current speed data and is stored in correspondence in conjunction with the depth data, longitude data and latitude data in the Xihai sea Different classes of memory block in.

Compared with prior art, above-mentioned technical proposal provided by the invention has the advantages that

Obtain sensor acquisition collection point at marine environment data, wherein collection point be it is predetermined, to ocean ring Border data are handled and are classified, and different classes of marine environment data is obtained, and deposit marine environment data according to different classes of It is stored in and is corresponded in the time series database constructed in advance in different classes of memory block, wherein in the time series database constructed in advance Including module information memory block and data storage area, which includes for storage sensor basic information One memory block, for storing the second memory block of collection point basic information, wherein data storage area includes different classes of corresponding Memory block.Using the time series database with distributed frame of building, different classes of marine environment data is stored, is solved When the database for centralized management marine environment data damages, the ocean ring occurred in entire database will lead to The problem of border data cannot all be called by user.

Detailed description of the invention

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention Some embodiments for those of ordinary skill in the art without creative efforts, can also basis These attached drawings obtain other attached drawings.

Fig. 1 is a kind of flow chart of data processing method provided in an embodiment of the present invention；

Fig. 2 is a kind of flow chart for constructing time series database provided in an embodiment of the present invention；

Fig. 3 is a kind of tables of data constructed for storing different classes of marine environment data provided in an embodiment of the present invention Flow chart；

Fig. 4 is a kind of flow chart for obtaining different classes of marine environment data provided in an embodiment of the present invention；

Fig. 5 is provided in an embodiment of the present invention a kind of constructs in advance according to different classes of be stored in marine environment data The flow chart in different classes of memory block is corresponded in time series database；

Fig. 6 is a kind of structural schematic diagram of data processing equipment provided in an embodiment of the present invention.

Specific embodiment

The present invention provides a kind of data processing method and devices, are used for centralized management marine environment number for solving to work as According to database damage when, will lead to and occur what the marine environment data in entire database was unable to be called by user Problem.

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.

As shown in Figure 1, showing a kind of data processing method provided in an embodiment of the present invention, this method includes following step It is rapid:

S101: the marine environment data at the collection point of sensor acquisition is obtained.

In S101, collection point is predetermined in embodiments of the present invention.

During executing S101, there are multiple sensors at predetermined collection point, wherein multiple sensors In different, i.e., the different classes of sensor of the data category of marine environment data that is acquired at collection point of each sensor, adopt Collect the marine environment data of corresponding classification.

Such as: at a collection point, there are multiple sensors, wherein including temperature sensor, depth transducer, first Alkane sensor and salinity sensor etc., temperature sensor are mainly acquired the temperature data at collection point in ocean；Depth Sensor is mainly acquired the depth data at collection point in ocean；Methane transducer mainly to collection point in ocean at Methane content data are acquired；Salinity sensor is mainly acquired the salinity content data at marine acquisition point.

It should be noted that including but not limited to enumerated temperature sensor, depth transducer, methane transducer and Salinity sensor can arrange corresponding sensor type, at collection point according to the actual situation specifically in order to corresponding Marine environment data is acquired.

S102: handling marine environment data and classified, and different classes of marine environment data is obtained.

During executing S102, after acquiring marine environment data at collection point by sensor, ocean will be obtained Environmental data carries out data processing, the marine environment data after obtaining data processing.Then to ocean after data processing Environmental data is classified, and different classes of marine environment data is obtained.

Such as: the format of the methane content data of methane transducer acquisition is hexadecimal data, and ocean current sensor is adopted The format of the current speed data of collection is octadic data, then needs to unite the marine environment data of these different data formats One is converted into the decimal system, then classifies to being converted into metric different classes of marine environment data.

It, can be from a large amount of, rambling and difficult it should be noted that marine environment data after data processing To be extracted in the marine environment data of understanding and derive valuable and significant data.

S103: inhomogeneity is corresponded to according to different classes of marine environment data is stored in the time series database constructed in advance In other memory block.

It include module information memory block and data storage area in the time series database that constructs in advance, wherein group in S103 Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, the data storage area include the corresponding memory block of different classes of marine environment data.

It, will be through according to the memory block of classification different in the time series database constructed in advance during executing S103 Data processing and sorted marine environment data are crossed, is stored into the corresponding memory block of time series database constructed in advance. Make in time series database in this way, different classes of memory block stores corresponding data.

It should be noted that when in time series database, when some memory block is damaged, although the sea in the memory block of the damage Foreign environmental data cannot be called by user, and still, the marine environment data in other memory blocks is not by the memory block of the damage It is influenced, i.e., is not affected when marine environment data is called by user in other memory blocks.

Such as: in the time series database constructed in advance, there are 3 memory blocks, wherein the ocean ring of 3 memory blocks storage The classification of border data are as follows: memory block A storage be methane content data, memory block B storage be oxygen content data and storage C storage in area is current speed data.When memory block A damage, methane content data in the A of memory block cannot be by user institute It calls.But the current speed in the oxygen content data and memory block C in the B of memory block can be called by user.

It should be noted that each memory block in the time series database constructed in advance is mutually indepedent.

It should be noted that the specific implementation process of building time series database, as shown in Fig. 2, specifically including that

S201: building is used for the sensor sheet of storage sensor basic information.

During executing S201, by creating acquisition belonging to the gauge outfit of sensor identity ID, sensor What gauge outfit, the gauge outfit of sensor name, the gauge outfit of the working condition of sensor and the sensor of the identity ID of point acquired The gauge outfit of the data category of marine environment data forms sensor sheet then according to all kinds of gauge outfits of above-mentioned creation.

It should be noted that in embodiments of the present invention including but is not limited to all kinds of tables of the sensor sheet of above-mentioned creation Head specifically also needs which gauge outfit in the table of collection point created, can be increased according to the actual situation, no longer be gone to live in the household of one's in-laws on getting married here It states.

S202: building is for storing collection point basic information collection point table.

During executing S202, by creating the gauge outfit of collection point identity ID, the location information of collection point Gauge outfit and collection point in the gauge outfit of sensor type form collection point table then according to all kinds of gauge outfits of above-mentioned creation.

It should be noted that in embodiments of the present invention including but is not limited to all kinds of tables of the collection point table of above-mentioned creation Head specifically also needs which gauge outfit in the table of collection point created, can be increased according to the actual situation, no longer be gone to live in the household of one's in-laws on getting married here It states.

S203: the tables of data for storing different classes of marine environment data is constructed.

During executing S203, according to different classes of marine environment data, the tables of data of corresponding classification is constructed.

Based on S203 disclosed in the embodiments of the present invention, the number for storing different classes of marine environment data is constructed According to the specific implementation process of table, as shown in figure 3, specifically including that

S301: building thermohaline depth CTD table.

During executing S301, pass through the gauge outfit of creation temperature data, Salinity Data and depth data, wherein temperature Degree evidence, Salinity Data and depth data share the gauge outfit of the same gauge outfit, longitude data and latitude data, according to above-mentioned creation All kinds of gauge outfits, formed thermohaline deeply feel.

It should be noted that all kinds of tables that the thermohaline of including but not limited to above-mentioned creation is deeply felt in embodiments of the present invention Head, specifically also need to create thermohaline deeply feel in which gauge outfit, can be increased according to the actual situation, no longer be gone to live in the household of one's in-laws on getting married here It states.

S302: building dissolved oxygen SEB63 table.

During executing S302, by the gauge outfit, the gauge outfit of depth data, longitude data that create oxygen content data Dissolved oxygen SEB63 table is formed according to all kinds of gauge outfits of above-mentioned creation with the gauge outfit of latitude data.

It should be noted that in embodiments of the present invention including but is not limited to each of the dissolved oxygen SEB63 table of above-mentioned creation Class gauge outfit specifically also needs which gauge outfit in dissolved oxygen SEB63 table created, can be increased according to the actual situation, here No longer repeated.

S303: building methane mets table.

During executing S303, by the gauge outfit, the gauge outfit of depth data, longitude data that create methane content data Methane mets table is formed according to all kinds of gauge outfits of above-mentioned creation with the gauge outfit of latitude data.

It should be noted that in embodiments of the present invention including but is not limited to all kinds of tables of the methane mets table of above-mentioned creation Head specifically also needs which gauge outfit in methane mets table created, can be increased according to the actual situation, no longer be carried out here It repeats.

S304: building single-point current meter rcm table.

During executing S304, by create the gauge outfits of thing current speed data, the gauge outfit of north and south current speed, Gauge outfit, the gauge outfit of depth data, the gauge outfit of longitude data and latitude data of attitude angle data, according to all kinds of tables of above-mentioned creation Head forms single-point current meter rcm table.

It should be noted that in embodiments of the present invention including but is not limited to the single-point current meter rcm table of above-mentioned creation Which gauge outfit in single-point current meter rcm table specifically also needed to create, can be increased according to the actual situation for all kinds of gauge outfits, It is not discussed here.

The data processing method according to disclosed in the embodiments of the present invention is it is found that obtain at the collection point of sensor acquisition Marine environment data, wherein collection point be it is predetermined, marine environment data is handled and is classified, obtain it is different classes of Marine environment data, according to corresponding different in the different classes of time series database for being stored in marine environment data and constructing in advance In the memory block of classification, wherein include module information memory block and data storage area, the group in the time series database constructed in advance Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, wherein data storage area includes different classes of corresponding memory block.Using building with distributed frame when Sequence database stores different classes of marine environment data, solves when the data for being used for centralized management marine environment data When library is damaged, the problem of marine environment data occurred in entire database cannot all be called by user will lead to.

Based on data processing method disclosed in embodiments of the present invention Fig. 1, S102 shown in fig. 1: to marine environment number According to being handled and being classified, the specific implementation process of different classes of marine environment data is obtained, as shown in figure 4, specifically including that

S401: data decompression processing is carried out to the marine environment data of sensor acquisition, and judges the number after decompression According to validity, obtain effective first data.

During executing S401, due to the marine environment data of sensor acquisition, acoustic transmission is used in ocean, During transmission, to be limited transmission rate by physical condition very low.Therefore, before being transmitted to marine environment data into Row compression, rear end will carry out data prediction to marine environment data, first when obtaining the compressed data that sensor is sent back The compressed package is unziped it, the marine environment data after being decompressed.

But during decompression, it may be such that messy code, or the marine environment of compression occurs in marine environment data Data are unable to normal use.Therefore, it is also desirable to validity examination be carried out to the marine environment data after decompression, to judge to sense Device be transmitted back to come marine environment data whether be compression before marine environment data.

S402: the first data are subjected to data normalization processing, obtain the second data.

During executing S402, after carrying out validity examination to the marine environment data after decompression, based on foundation Standardization storage format, to the coded format of the marine environment data carry out unification, while to marine environment data carry out one Useless data information is rejected in fixed screening, the marine environment data after obtaining data normalization, i.e. the second data.

It should be noted that the model due to each sensor is different, there may be a variety of volumes for acquisition marine environment data Code form, it is therefore desirable to which unification is carried out to the coded format of marine environment data.

S403: the second data are subjected to the processing of data re-scheduling, obtain third data.

During executing S403, to the marine environment data after standardization, it is also necessary to carry out at data re-scheduling Reason, excludes duplicate data.Specifically, excluding duplicate marine environment data, not for program by the way of program re-scheduling The marine environment data that can be excluded excludes duplicate marine environment data according to the mode for manually shaving weight.

S404: data quality control processing is carried out to third data, obtains marine environment data after data processing.

During executing S404, during acquiring marine environment data due to, sensor or marine environment data During transmission, marine environment data will appear the case where shortage of data and error in data, for the situation, need logarithm According to re-scheduling treated marine environment data, data quality control processing is carried out.Specifically, for the marine environment data of mistake It is modified wrong data processing and rejects the data processing of apparent error.

Such as: whithin a period of time, since sensor device goes wrong, the marine environment data and actual value of acquisition There is very big difference, these are with the very big marine environment data of actual value difference without in all senses, needing not anticipate to these The data of justice are deleted.And if the marine environment data and actual value difference very little of acquisition, according to statistical method Data are modified.

S405: marine environment data after data processing is classified, and obtains different classes of marine environment number According to.

The data processing method according to disclosed in the embodiments of the present invention is it is found that obtain at the collection point of sensor acquisition Marine environment data, wherein collection point be it is predetermined, marine environment data is handled and is classified, obtain it is different classes of Marine environment data, according to corresponding different in the different classes of time series database for being stored in marine environment data and constructing in advance In the memory block of classification, wherein include module information memory block and data storage area, the group in the time series database constructed in advance Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, wherein data storage area includes different classes of corresponding memory block.Using building with distributed frame when Sequence database stores different classes of marine environment data, solves when the data for being used for centralized management marine environment data When library is damaged, the problem of marine environment data occurred in entire database cannot all be called by user will lead to.

It is related to based on data processing method disclosed in the embodiments of the present invention, if the classification packet of marine environment data Include temperature, salinity, oxygen, methane and current speed, according to it is different classes of marine environment data is stored in construct in advance when The specific implementation process in different classes of memory block is corresponded in sequence database, as shown in figure 5, specifically including that

S501: depth data, longitude data and the latitude data at each collection point are determined.

During executing S501, depth data, the longitude data at each collection point are determined according to specific equipment And latitude data.

S502: temperature at the collection point, salinity, oxygen, methane and current speed are acquired according to each sensor Time sequencing, respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, thing ocean current speed Degree evidence and north and south current speed data are stored in corresponding inhomogeneity in conjunction with the depth data, longitude data and latitude data In other memory block.

During executing S502, according to the time sequencing of storage, by temperature data, Salinity Data, depth data, warp Degree evidence and latitude data are stored in thermohaline depth CTD table, wherein the time sequencing of storage refers to each sensor acquisition Marine environment data stores by marine environment data after data processing and classification and corresponds to memory block into time series database Time.

Similarly, oxygen content data, depth data, longitude data and latitude data are deposited according to the time sequencing of storage Storage is in dissolved oxygen SEB63 table.

Similarly, methane content data, depth data, longitude data and latitude data are deposited according to the time sequencing of storage Storage is in methane mets table.

Similarly, according to the time sequencing of storage, by thing current speed data, north and south current speed data, attitude angle number According to, depth data, longitude data and latitude data, be stored in single-point current meter rcm table.

The data processing method according to disclosed in the embodiments of the present invention is it is found that obtain at the collection point of sensor acquisition Marine environment data, wherein collection point be it is predetermined, marine environment data is handled and is classified, obtain it is different classes of Marine environment data, according to corresponding different in the different classes of time series database for being stored in marine environment data and constructing in advance In the memory block of classification, wherein include module information memory block and data storage area, the group in the time series database constructed in advance Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, wherein data storage area includes different classes of corresponding memory block.Using building with distributed frame when Sequence database stores different classes of marine environment data, solves when the data for being used for centralized management marine environment data When library is damaged, the problem of marine environment data occurred in entire database cannot all be called by user will lead to.

Based on data processing method disclosed in the embodiments of the present invention, also correspondence of the embodiment of the present invention discloses a kind of number According to processing unit, as shown in fig. 6, be a kind of structural schematic diagram of data processing equipment provided in an embodiment of the present invention, it is main to wrap It includes: obtaining module 60, processing module 61 and memory module 62.

Module 60 is obtained, the marine environment data at collection point for obtaining sensor acquisition, the collection point is pre- First determine.

Processing module 61 obtains different classes of marine environment number for being handled marine environment data and being classified According to.

Memory module 62, for marine environment data to be stored in the time series database constructed in advance according to different classes of It include module information memory block and data storage area in the time series database that constructs in advance in corresponding different classes of memory block, Module information memory block includes the first memory block for storage sensor basic information, for storing collection point basic information Second memory block, data storage area include different classes of memory block.

A kind of alternative construction of memory module 62 in embodiments of the present invention are as follows: memory module 62 includes that the first building is single Member, the second construction unit lattice third construction unit.

First construction unit, for constructing the sensor sheet for being used for storage sensor basic information, sensor sheet includes passing The identity ID of collection point, the title of sensor, the working condition of sensor belonging to the identity ID of sensor, sensor With the data category of the marine environment data of sensor acquisition.

Second construction unit, for constructing for storing collection point basic information collection point table, collection point table includes adopting Collect the sensor type in the identity ID, the location information of collection point, collection point of point.

Third construction unit, for constructing the tables of data for storing different classes of marine environment data, tables of data packet Include marine environment data classification, the environmental data of ocean depth, the environmental data of ocean angle, ocean longitude and latitude environment Data.

Specifically, third construction unit includes: building subelement.

Subelement is constructed, for constructing thermohaline depth CTD table, dissolved oxygen SEB63 table, methane mets table and single-point current meter Rcm table.

Another alternative construction of memory module 62 in embodiments of the present invention are as follows: memory module 62 further include: determine single Member and storage unit.

Determination unit, for determining depth data, longitude data and latitude data at each collection point.

Storage unit, for acquiring temperature, salinity, oxygen, methane and sea at the collection point according to each sensor The time sequencing of flow velocity degree, respectively by collected temperature data, Salinity Data, oxygen content data, methane content data, east It flows speed data and north and south current speed data and is stored in correspondence in conjunction with the depth data, longitude data and latitude data in the Xihai sea Different classes of memory block in.

A kind of alternative construction of processing module 61 in embodiments of the present invention are as follows: processing module 61 includes that the first acquisition is single Member, the second obtaining unit, third obtaining unit, the 4th obtaining unit and the 5th obtaining unit.

Data decompression processing unit, the marine environment data for acquiring to sensor carry out data decompression processing, And judge the validity of the data after decompression, obtain effective first data.

Data normalization processing unit obtains the second data for the first data to be carried out data normalization processing.

Data re-scheduling processing unit obtains third data for the second data to be carried out the processing of data re-scheduling.

Data quality control processing unit obtains for carrying out data quality control processing to third data and passes through data Marine environment data that treated.

Taxon obtains different classes of sea for marine environment data after data processing to be classified Foreign environmental data.

The data processing equipment according to disclosed in the embodiments of the present invention is it is found that obtain at the collection point of sensor acquisition Marine environment data, wherein collection point be it is predetermined, marine environment data is handled and is classified, obtain it is different classes of Marine environment data, according to corresponding different in the different classes of time series database for being stored in marine environment data and constructing in advance In the memory block of classification, wherein include module information memory block and data storage area, the group in the time series database constructed in advance Part information storage area includes the first memory block for storage sensor basic information, for storing the of collection point basic information Two memory blocks, wherein data storage area includes different classes of corresponding memory block.Using building with distributed frame when Sequence database stores different classes of marine environment data, solves when the data for being used for centralized management marine environment data When library is damaged, the problem of marine environment data occurred in entire database cannot all be called by user will lead to.

It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng See the part explanation of embodiment of the method.

Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged Except there is also other identical elements in the process, method, article or apparatus that includes the element.

The foregoing description of the disclosed embodiments can be realized those skilled in the art or using the present invention.To this A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can Without departing from the spirit or scope of the present invention, to realize in other embodiments.Therefore, the present invention will not be limited It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest Range.

The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.