A kind of wisdom data recommendation method Internet-based, apparatus and system

文档序号:1742158 发布日期:2019-11-26 浏览:21次 中文

阅读说明:本技术 一种基于互联网的智慧数据推荐方法、装置及系统 (A kind of wisdom data recommendation method Internet-based, apparatus and system ) 是由 徐超 于 2019-07-03 设计创作,主要内容包括:本申请公开了一种基于互联网的智慧数据推荐方法、装置及系统,属于数据处理技术领域。所述方法包括:采集节点获取发布时间在预设时段内的各状态的关注数据,并在具有多个节点的数据网络中广播获取的关注数据;各统计节点获取具有多个节点的数据网络中的关注数据,根据获取的关注数据统计对应状态的发布者的受关注度,验证统计的受关注度,并在验证通过时,保存关注数据及受关注度。本申请中,不仅能够为文娱行业挖掘潜在的表演者提供了有利依据;而且避免了数据处理过程中伪造数据的现象;同时,将统计的数据保存至具有多个节点的数据网络,既保障了数据的安全稳定,又便于数据的查询和再利用。(This application discloses a kind of wisdom data recommendation methods Internet-based, apparatus and system, belong to technical field of data processing.The described method includes: acquisition node obtains the focused data of each state of the issuing time in preset period of time, and the focused data of acquisition is broadcasted in the data network with multiple nodes;Each statistics node obtains the focused data in the data network with multiple nodes, and the concerned degree of the publisher of corresponding states is counted according to the focused data of acquisition, verifies the concerned degree of statistics, and when being verified, saves focused data and concerned degree.In the application, potential performing artist can not only be excavated for entertainment industry and provide advantageous foundation;And the phenomenon that avoiding data falsification in data handling procedure;Meanwhile saving the data of statistics to the data network with multiple nodes, not only ensured the safety and stability of data, but also be convenient for the inquiry and recycling of data.)

1. a kind of wisdom data recommendation method Internet-based, which is characterized in that be used for acquisition node, comprising:

Obtain the focused data of each state of the issuing time in preset period of time;

The focused data is broadcasted, in the data network with multiple nodes for the publication of each statistics each state of node statistics The concerned degree of person.

2. the method according to claim 1, wherein it is described obtain preset period of time in each state focused data, Include:

The full-text data of each state of the issuing time in preset period of time is grabbed by web crawlers;

Extract publisher's mark and the focused data in each full-text data;

The concern record of each state is generated according to the data of extraction;

It is described that the focused data is broadcasted in the data network with multiple nodes, specifically: in the number with multiple nodes It is recorded according to the concern is broadcasted in network.

3. a kind of wisdom data recommendation data processing method Internet-based, which is characterized in that for counting node, comprising:

Obtain the focused data in the data network with multiple nodes;

The concerned degree of the publisher of corresponding states is counted according to the focused data;

The concerned degree is verified, and when being verified, saves the focused data and the concerned degree.

4. according to the method described in claim 3, it is characterized in that, the pass obtained in the data network with multiple nodes Data are infused, specifically: the concern record in the data network with multiple nodes is obtained, the concern record includes each state Publisher's mark and focused data.

5. according to the method described in claim 4, it is characterized in that, the hair for counting corresponding states according to the focused data The concerned degree of cloth person, comprising:

The focused data is cleaned to obtain effective focused data;

Effective focused data is sorted out, obtains each publisher and identifies corresponding all effective focused datas;

It successively calls preset analysis model analysis each publisher to identify corresponding all effective focused datas, obtains each publication Person identifies the label of corresponding each publisher;

The concerned degree of each publisher is determined according to the label of each publisher.

6. according to the method described in claim 3, it is characterized in that, the verifying concerned degree, specifically: using practical Byzantine failure tolerance mechanism verifies the concerned degree.

7. according to the method described in claim 3, it is characterized in that, the preservation focused data and the concerned degree, Include:

The digest value of the focused data is generated by default statistics node;

The last one current master data packet of identification carries out cryptographic calculation to the header of the master data packet of identification, obtains first and add Close value;

New master data packet is generated, first secret value is saved into the header of the new master data packet, and will be described Digest value is saved into the new master data packet;

The slave data packet for generating the new master data packet saves the concerned degree to described from data packet.

8. the method according to the description of claim 7 is characterized in that the slave data packet for generating the new master data packet, The concerned degree is saved to described from data packet, comprising:

Cryptographic calculation is carried out to the header of the new master data packet, obtains the second secret value;

Cryptographic calculation is carried out to second secret value, obtains third secret value;

The slave data packet for generating the new master data packet saves the third secret value to the header from data packet In, and the concerned degree is saved to described from data packet.

9. a kind of wisdom data recommendation device Internet-based characterized by comprising

First obtains module, for obtaining the focused data of each state of the issuing time in preset period of time;

Broadcast module obtains the attention number that module obtains for broadcasting described first in the data network with multiple nodes According to for the concerned degree of the publisher of each statistics each state of node statistics.

10. device according to claim 9, which is characterized in that the first acquisition module includes: crawl submodule, mentions It takes submodule and generates submodule;

The crawl submodule, for grabbing the full text number of each state of the issuing time in preset period of time by web crawlers According to;

The extracting sub-module, for extracting the mark of the publisher in each full-text data and focused data;

The generation submodule generates the concern record of each state for the data according to extraction;

The broadcast module is recorded specifically for broadcasting the concern in the data network with multiple nodes.

Technical field

This application involves technical field of data processing more particularly to a kind of data processing methods, apparatus and system.

Background technique

With the arrival of information age, big data is widely applied to each field.By analyzing user data, can learn User preference, to provide better service device;Likewise, passing through analysis user data, moreover it is possible to learn the potential spy of user Matter.Especially in internet area, current trill, fast video etc. have the live streaming application of video record function it is very powerful and exceedingly arrogant when Generation, panoramic personage are broadcast live the various videos of application recording by these and are published to network, comment ornamental for masses.And This virtually also provides valuable information for internet entertainment industry, how effectively to be dug using these valuable information Digging, there is the talent of performance power to be worth considering, meanwhile, the process that the talent is a monitored for prolonged periods of time and evaluation and test is excavated, once midway Loss of data all will be that all that has been achieved is spoiled, therefore, how effectively safeguard that the data during this are also the thing to merit attention Feelings.

Summary of the invention

To solve the deficiencies in the prior art, the application proposes a kind of data processing method, apparatus and system.

In a first aspect, the application proposes a kind of data processing method for acquisition node, comprising:

Obtain the focused data of each state of the issuing time in preset period of time;

The focused data is broadcasted, in the data network with multiple nodes for each statistics each state of node statistics The concerned degree of publisher.

Optionally, the focused data for obtaining each state in preset period of time, comprising:

The full-text data of each state of the issuing time in preset period of time is grabbed by web crawlers;

Extract publisher's mark and the focused data in each full-text data;

The concern record of each state is generated according to the data of extraction;

It is described that the focused data is broadcasted in the data network with multiple nodes, specifically: with multiple nodes Data network in broadcast concern record.

Second aspect, the application propose a kind of for counting the data processing method of node, comprising:

Obtain the focused data in the data network with multiple nodes;

The concerned degree of the publisher of corresponding states is counted according to the focused data;

The concerned degree is verified, and when being verified, saves the focused data and the concerned degree.

Optionally, the focused data obtained in the data network with multiple nodes, specifically: it obtains with multiple Concern record in the data network of node, the concern record include the publisher's mark and focused data of each state.

Optionally, the concerned degree of the publisher that corresponding states is counted according to the focused data, comprising:

The focused data is cleaned to obtain effective focused data;

Effective focused data is sorted out, obtains each publisher and identifies corresponding all effective focused datas;

It successively calls preset analysis model analysis each publisher to identify corresponding all effective focused datas, obtains each Publisher identifies the label of corresponding each publisher;

The concerned degree of each publisher is determined according to the label of each publisher.

Optionally, the verifying concerned degree, specifically: it is closed using the verifying of practical Byzantine failure tolerance mechanism is described Note degree.

Optionally, the preservation focused data and the concerned degree, comprising:

The digest value of the focused data is generated by default statistics node;

The last one current master data packet of identification carries out cryptographic calculation to the header of the master data packet of identification, obtains the One secret value;

New master data packet is generated, first secret value is saved into the header of the new master data packet, and will The digest value is saved into the new master data packet;

The slave data packet for generating the new master data packet saves the concerned degree to described from data packet.

Optionally, the slave data packet for generating the new master data packet, will the concerned degree preservation to it is described from Data packet, comprising:

Cryptographic calculation is carried out to the header of the new master data packet, obtains the second secret value;

Cryptographic calculation is carried out to second secret value, obtains third secret value;

The slave data packet for generating the new master data packet saves the third secret value to the report from data packet In head, and the concerned degree is saved to described from data packet.

The third aspect, the application propose a kind of data processing equipment, comprising:

First obtains module, for obtaining the focused data of each state of the issuing time in preset period of time;

Broadcast module obtains the concern that module obtains for broadcasting described first in the data network with multiple nodes Data, for the concerned degree of the publisher of each statistics each state of node statistics.

Optionally, the first acquisition module includes: crawl submodule, extracting sub-module and generates submodule;

The crawl submodule, for grabbing the full text of each state of the issuing time in preset period of time by web crawlers Data;

The extracting sub-module, for extracting the mark of the publisher in each full-text data and focused data;

The generation submodule generates the concern record of each state for the data according to extraction;

The broadcast module is recorded specifically for broadcasting the concern in the data network with multiple nodes.

Fourth aspect itself please propose a kind of data processing equipment, comprising:

Second obtains module, for obtaining the focused data in the data network with multiple nodes;

Statistical module, the concerned degree of the publisher for counting corresponding states according to the focused data;

Authentication module, for verifying the concerned degree;

Preserving module, for when the authentication module is verified, saving the focused data and the concerned degree.

Optionally, described second module is obtained, remembered specifically for obtaining the concern in the data network with multiple nodes Record, the concern record include the publisher's mark and focused data of each state.

Optionally, the statistical module includes: cleaning submodule, sorts out submodule, calls submodule and determine submodule;

The cleaning submodule, the focused data for obtaining to the second acquisition module, which is cleaned, effectively to be closed Infuse data;

It is corresponding to obtain each publisher's mark for sorting out to effective focused data for the classification submodule All effective focused datas;

The calling submodule, for successively calling preset analysis model analysis each publisher's mark corresponding all Effective focused data obtains the label that each publisher identifies corresponding each publisher;

The determining submodule, for determining the concerned degree of each publisher according to the label of each publisher.

Optionally, the authentication module is specifically used for verifying the concerned degree using practical Byzantine failure tolerance mechanism.

Optionally, the preserving module includes: to generate submodule, identification submodule, the first computational submodule, the first preservation Submodule and second saves submodule;

The generation submodule generates the digest value of the focused data for default statistics node;

The identification submodule, for identification the last one current master data packet;

First computational submodule, the header for the master data packet to identification carry out cryptographic calculation, obtain first and add Close value;

Described first saves submodule, and for generating new master data packet, first secret value is saved to described new Master data packet header in, and the digest value is saved into the new master data packet;

Described second saves submodule, for generating the slave data packet of the new master data packet, by the concerned degree It saves to described from data packet.

Optionally, the second preservation submodule includes: the first computing unit, the second computing unit and storage unit;

First computing unit carries out cryptographic calculation for the header to the new master data packet, obtains second and adds Close value;

Second computing unit obtains third secret value for carrying out cryptographic calculation to second secret value;

The storage unit saves the third secret value for generating the slave data packet of the new master data packet To described from the header of data packet, and the concerned degree is saved to described from data packet.

5th aspect, the application propose a kind of data processing system, comprising: the application third aspect and fourth aspect are any The device.

6th aspect, the application propose a kind of data processing equipment, comprising:

One or more processors store the storage device of one or more programs;

When one or more of programs are executed by one or more of processors, such as the application first aspect is realized And any method of second aspect.

7th aspect, the application proposes a kind of computer readable storage medium, is stored thereon with computer program, when described When computer program is executed by processor, realize the application first aspect and second aspect it is any as described in method.

The advantages of the application, is:

In the application, big data is combined with internet, on the one hand excavates potential performing artist for entertainment industry and provide Advantageous foundation;On the other hand, the phenomenon that avoiding data falsification during wisdom data recommendation;Meanwhile by the data of statistics It saves to the data network with multiple nodes, had not only ensured the safety and stability of data, but also be convenient for the inquiry and recycling of data.

Detailed description of the invention

By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the application Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:

Attached drawing 1 is a kind of data processing method flow chart for acquisition node according to the application embodiment;

Attached drawing 2 is according to a kind of for counting the data processing method flow chart of node of the application embodiment;

Attached drawing 3 is a kind of data processing method flow chart according to the application embodiment;

Attached drawing 4 is a kind of data processing equipment block diagram according to the application embodiment;

Attached drawing 5 is another data processing equipment block diagram according to the application embodiment.

Specific embodiment

The illustrative embodiments of the disclosure are more fully described below with reference to accompanying drawings.Although showing this public affairs in attached drawing The illustrative embodiments opened, it being understood, however, that may be realized in various forms the disclosure without the reality that should be illustrated here The mode of applying is limited.It is to be able to thoroughly understand the disclosure on the contrary, providing these embodiments, and can be by this public affairs The range opened is fully disclosed to those skilled in the art.

The method in the application is described in detail below.

13页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:一种基于搜索引擎的数据优化方法、装置及设备

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!