Intelligent mining system for sensitive information in public opinion information

文档序号:1324300 发布日期:2020-07-14 浏览:2次 中文

阅读说明:本技术 一种舆情信息中敏感信息的智能挖掘系统 (Intelligent mining system for sensitive information in public opinion information ) 是由 李惠柯 贺成龙 汤世松 高峰 刘蛰 孟令伍 于 2020-03-19 设计创作,主要内容包括:本发明公开了一种舆情信息中敏感信息的智能挖掘系统,包括:舆情信息预处理模块,用于滤除舆情信息中的杂质信息,获得已过滤舆情信息;敏感信息类别标注模块,用于在信息展示界面接收并记录人工标注信息,获得已标注舆情信息;基于bert模型的敏感信息识别模块,用于根据已标注舆情信息训练敏感信息分类模型获得挖掘模型;舆情信息敏感智能挖掘模块,用于根据挖掘模型实时智能挖掘舆情信息并输出挖掘结果;敏感信息可视化模块,用于将舆情信息与挖掘结果以可视化的形式展示在信息展示界面。采用前述系统,能够结合舆情工作人员的需求,完成舆情信息敏感智能挖掘,方便舆情工作人员实时、便捷地了解和掌握舆情信息,辅助相关工作人员完成决策。(The invention discloses an intelligent mining system for sensitive information in public sentiment information, which comprises: the public opinion information preprocessing module is used for filtering impurity information in the public opinion information to obtain filtered public opinion information; the sensitive information category marking module is used for receiving and recording the manual marking information on the information display interface to obtain marked public opinion information; the sensitive information identification module based on the bert model is used for training a sensitive information classification model according to the marked public opinion information to obtain a mining model; the public opinion information sensitive intelligent mining module is used for intelligently mining public opinion information in real time according to the mining model and outputting a mining result; and the sensitive information visualization module is used for displaying the public opinion information and the mining result on the information display interface in a visualization mode. By adopting the system, the requirements of public sentiment workers can be combined, the sensitive and intelligent mining of the public sentiment information can be completed, the public sentiment workers can conveniently know and master the public sentiment information in real time, and the decision making of the related workers can be assisted.)

1. An intelligent mining system for sensitive information in public opinion information, the system comprising:

the public opinion information preprocessing module is used for filtering impurity information in the captured public opinion information to obtain filtered public opinion information;

the sensitive information category marking module is used for receiving the filtered public opinion information, recording the artificial marking information of the filtered public opinion information, obtaining the marked public opinion information and storing the marked public opinion information into a background database for incremental training of a subsequent classification model;

the sensitive information identification module is used for carrying out fine adjustment on the bert model according to the marked public opinion information, debugging the parameters of the model in the fine adjustment process until a better studying and judging effect on a test data set is obtained, and training and obtaining a sensitive information classification model through the fine adjustment for sensitive studying and judging of real-time data of an online system;

the public opinion information sensitive intelligent mining module is used for intelligently judging whether the public opinion information is sensitive in real time according to the sensitive information classification model and outputting a result;

and the sensitive information visualization module is used for displaying the public opinion information and the mining result on an information display interface in a visualization mode.

2. The system of claim 1, wherein the public opinion information preprocessing module comprises a first filtering unit, a second filtering unit and a third filtering unit, and the first filtering unit, the second filtering unit and the third filtering unit are used for filtering the impurity information to obtain filtered public opinion information, wherein the impurity information comprises: vulgar information, advertising information, historical information, link symbols, and emoticon content;

filtering low popular information and advertisement information in public sentiment information through the first filtering unit;

filtering out historical information in public opinion information through the second filtering unit;

and filtering the link symbols and the emoticons in the public opinion information through the third filtering unit.

3. The system of claim 2, wherein the first filtering unit is a filtering algorithm for filtering popular information and advertisement information based on a naive Bayesian model:

the filtering algorithm of the low-popular information and the advertisement based on the naive Bayes model is based on Bayes' theorem, the probability that the item to be classified belongs to each possible category is calculated, and the classification of the item to be classified is confirmed according to the category with the maximum probability;

identifying the vulgar information and the advertisement information in the impurity information according to a naive Bayesian algorithm, namely formula (1):

and filtering out public opinion information containing low popular information or advertisement information.

4. The system of claim 2, wherein the second filtering unit is a history information filtering algorithm based on history information keywords:

the historical information filtering algorithm based on the historical information keywords comprises the following steps: according to the history famous characters and the event keywords, identifying the history information in the impurity information in a keyword matching mode, wherein the keyword matching mode is that after a keyword library is formed by collecting a history character library and major historical event keywords, public opinion information containing the history information is filtered by matching the relevant history information in the keyword library.

5. The system of claim 2, wherein the third filtering unit is a filtering algorithm for link symbols and emoticons based on a regular expression, and the link symbols are removed based on the regular expression, and the filtering algorithm includes regular expression matching of http and https;

the emoticons mainly exist in microblog data, after the microblog data are collected, emoticons are filtered through a mode of matching with the character emoticons, and the emoticons are represented in the microblog data through the character emoticons.

6. The system of claim 1, wherein the sensitive information labeling module receives artificial labeling information on the public sentiment information through an information display interface, the artificial labeling information comprises category information, and the category information comprises complaint maintenance, complaint, safe production, economic finance, wind construction, consciousness morphology, natural disasters, places of demolition and food medicine health.

7. The system of claim 1, wherein the sensitive information recognition module is used for fine-tuning the bert model based on manual labeling information and training to obtain a sensitive information classification model; after the preset interval time, according to the marked public opinion information obtained by the sensitive information classification marking module, fusing the data marked by the online user according to the marking system with the original basic marking data, and performing parameter fine adjustment on the bert model again to enable the bert model to adapt to the newly added marking data, so as to obtain a new sensitive information classification model and realize the regular updating of the sensitive information classification model.

8. The intelligent mining system for sensitive information in public opinion information according to claim 1, wherein the sensitive information visualization module displays the sensitive information intelligently mined by the system in a visual form, and the sensitive information visualization module comprises an information screening unit and an information display unit;

the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information;

the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions.

9. The system of claim 1, wherein the method for intelligently mining sensitive information in public opinion information comprises:

step 101, preprocessing mass public sentiment data, filtering advertisement information and vulgar information by using a Bayesian model, and filtering historical information by using basic historical keywords;

102, performing sensitive information incremental training based on a bert model, and performing training and updating of a classification model by using a Google open-source bert pre-training model and standard sensitive information data;

103, visualizing the sensitive information, automatically mining the captured internet public opinion data according to a trained intelligent sensitive information mining method, and displaying the captured internet public opinion data on an information display interface, wherein the display module comprises an information screening unit and an information display unit, and the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information; the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions, and the display content comprises sensitive information categories, related sensitive keywords and the release time of the sensitive information.

Technical Field

The invention relates to the field of public sentiment data intelligent analysis, in particular to an intelligent mining system for sensitive information in public sentiment information according to the actual demands of users.

Background

With the development of a new era, networks gradually become main media for people to transmit and obtain various information, the online information is complicated, the time cost for public opinion workers to mine the information is increased, and how to more quickly and effectively mine key public opinion information in mass public opinion information is a problem to be solved urgently.

Disclosure of Invention

The invention provides an intelligent mining system for sensitive information in public opinion information, which aims to solve the problem that the time cost of mining information by existing public opinion workers is high, so that key public opinion information in mass public opinion information is difficult to mine effectively.

An intelligent mining system for sensitive information in public opinion information, the system comprising:

the public opinion information preprocessing module is used for filtering impurity information in the captured public opinion information to obtain filtered public opinion information;

the sensitive information category marking module is used for receiving the filtered public opinion information, recording the artificial marking information of the filtered public opinion information, obtaining the marked public opinion information and storing the marked public opinion information into a background database for incremental training of a subsequent classification model;

the sensitive information identification module is used for carrying out fine adjustment on the bert model according to the marked public opinion information, debugging the parameters of the model in the fine adjustment process until a better studying and judging effect on a test data set is obtained, and training and obtaining a sensitive information classification model through the fine adjustment for sensitive studying and judging of real-time data of an online system;

the public opinion information sensitive intelligent mining module is used for intelligently judging whether the public opinion information is sensitive in real time according to the sensitive information classification model and outputting a result;

and the sensitive information visualization module is used for displaying the public opinion information and the mining result on an information display interface in a visualization mode.

Further, in an implementation manner, the public opinion information preprocessing module includes a first filtering unit, a second filtering unit and a third filtering unit, and the filtered public opinion information is obtained by filtering the impurity information through the first filtering unit, the second filtering unit and the third filtering unit, and the impurity information includes: vulgar information, advertising information, historical information, link symbols, and emoticon content;

filtering low popular information and advertisement information in public sentiment information through the first filtering unit;

filtering out historical information in public opinion information through the second filtering unit;

and filtering the link symbols and the emoticons in the public opinion information through the third filtering unit.

Further, in one implementation, the first filtering unit is a filtering algorithm based on the naive bayes model for the vulgar information and the advertisement information:

the filtering algorithm of the low-popular information and the advertisement based on the naive Bayes model is based on Bayes' theorem, the probability that the item to be classified belongs to each possible category is calculated, and the classification of the item to be classified is confirmed according to the category with the maximum probability;

identifying the vulgar information and the advertisement information in the impurity information according to a naive Bayesian algorithm, namely formula (1):

and filtering out public opinion information containing low popular information or advertisement information.

Further, in an implementation manner, the second filtering unit is a history information filtering algorithm based on a history information keyword:

the historical information filtering algorithm based on the historical information keywords comprises the following steps: according to the history famous characters and the event keywords, identifying the history information in the impurity information in a keyword matching mode, wherein the keyword matching mode is that after a keyword library is formed by collecting a history character library and major historical event keywords, public opinion information containing the history information is filtered by matching the relevant history information in the keyword library.

Further, in an implementation manner, the third filtering unit is a filtering algorithm for filtering the link symbols and the emoticons based on a regular expression, and removes the link symbols based on the regular expression, including "http." and "https." regular expression matching;

the emoticons mainly exist in microblog data, after the microblog data are collected, emoticons are filtered through a mode of matching with the character emoticons, and the emoticons are represented in the microblog data through the character emoticons.

Further, in an implementation manner, the sensitive information labeling module receives artificial labeling information of the public sentiment information through an information display interface, wherein the artificial labeling information includes category information, and the category information includes complaint dimension, complaint, safe production, economic and financial, wind construction, consciousness shape, natural disaster, removal destination and food medicine health.

Further, in an implementation manner, the sensitive information identification module performs fine adjustment on the bert model based on manual labeling information, and trains to obtain a sensitive information classification model; after the preset interval time, according to the marked public opinion information obtained by the sensitive information classification marking module, fusing the data marked by the online user according to the marking system with the original basic marking data, and performing parameter fine adjustment on the bert model again to enable the bert model to adapt to the newly added marking data, so as to obtain a new sensitive information classification model and realize the regular updating of the sensitive information classification model.

Further, in one implementation manner, the sensitive information visualization module displays the sensitive information intelligently mined by the system in a visualization manner, and the sensitive information visualization module includes an information screening unit and an information display unit;

the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information;

the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions.

Further, in an implementation manner, an intelligent mining method for sensitive information in public opinion information applied to the system includes:

step 101, preprocessing mass public sentiment data, filtering advertisement information and vulgar information by using a Bayesian model, and filtering historical information by using basic historical keywords;

102, performing sensitive information incremental training based on a bert model, and performing training and updating of a classification model by using a Google open-source bert pre-training model and standard sensitive information data;

103, visualizing the sensitive information, automatically mining the captured internet public opinion data according to a trained intelligent sensitive information mining method, and displaying the captured internet public opinion data on an information display interface, wherein the display module comprises an information screening unit and an information display unit, and the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information; the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions, and the display content comprises sensitive information categories, related sensitive keywords and the release time of the sensitive information.

According to the technical scheme, the intelligent mining system for the sensitive information in the public opinion information comprises: the public opinion information preprocessing module is used for filtering impurity information in the captured public opinion information to obtain filtered public opinion information; the sensitive information category marking module is used for receiving the filtered public opinion information, recording the artificial marking information of the filtered public opinion information, obtaining the marked public opinion information and storing the marked public opinion information into a background database for incremental training of a subsequent classification model; the sensitive information identification module is used for carrying out fine adjustment on the bert model according to the marked public opinion information, debugging the parameters of the model in the fine adjustment process until a better studying and judging effect on a test data set is obtained, and training and obtaining a sensitive information classification model through the fine adjustment for sensitive studying and judging of real-time data of an online system; the public opinion information sensitive intelligent mining module is used for intelligently judging whether the public opinion information is sensitive in real time according to the sensitive information classification model and outputting a result; and the sensitive information visualization module is used for displaying the public opinion information and the mining result on an information display interface in a visualization mode.

Drawings

In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.

Fig. 1 is a schematic diagram of a system architecture of an intelligent mining system for sensitive information in public opinion information according to an embodiment of the present invention;

fig. 2 is a schematic view of a display interface in an intelligent mining system for sensitive information in public opinion information according to an embodiment of the present invention;

fig. 3 is a schematic view of an actual operation interface in an intelligent mining system for sensitive information in public opinion information according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a sensitive information visualization module in an intelligent mining system for sensitive information in public opinion information according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

As shown in fig. 1, the system for intelligently mining sensitive information in public opinion information according to this embodiment includes:

the public opinion information preprocessing module is used for filtering impurity information in the captured public opinion information to obtain filtered public opinion information;

the sensitive information category marking module is used for receiving the filtered public opinion information, recording the artificial marking information of the filtered public opinion information, obtaining the marked public opinion information and storing the marked public opinion information into a background database for incremental training of a subsequent classification model; in this embodiment, the public opinion sensitive information mining system closely follows the actual needs of public opinion workers, divides the public opinion sensitive information into categories of complaint and maintenance, complaint and complaint, safe production, wind construction, economy and finance, national religion, removal of the place, natural disasters, consciousness forms, food, medicine and health and the like, and designs the public opinion sensitive information intelligent mining system.

The sensitive information identification module is used for carrying out fine adjustment on the bert model according to the marked public opinion information, debugging parameters of the model in the fine adjustment process until a better studying and judging effect on a test data set is obtained, training and obtaining a sensitive information classification model through the fine adjustment, and the sensitive information classification model is used for sensitive studying and judging of real-time data of an online system; in the embodiment, an operation entrance for manually modifying the standard is reserved in the sensitive information display system, so that public sentiment workers can manually mine and modify information mined by the system, the background records operation data, and the training model is updated in time according to the user operation data.

In this embodiment, the Bert model is a pre-training model on a huge data set, and in practical application, the fine-tuning stage is to use network models with different parameters according to different actual tasks; the method mainly aims at continuously adjusting certain parameters so as to obtain a training model with a better effect. The mining accuracy of the mining model can be effectively improved through the bert model-based sensitive information identification module. Specifically, a user history study and judgment information text and a label are used as training samples and input into the bert model, training parameters such as learning rate and batch processing amount are modified, and fine tuning training is performed on the model by using the GPU. In the implementation process of the project, the ratio of the training data to the verification data is 4: 1. The method comprises the steps of converting training data into vectors by using a word2vec technology, feeding the vectors to a bert model as input data, using a data label as output, using a random gradient descent algorithm as an optimization algorithm to train the model, setting and training parameters such as batch size, epochs and the like for multiple times, and selecting the best training model according to a verification effect of a verification set.

The public opinion information sensitive intelligent mining module is used for intelligently judging whether the public opinion information is sensitive in real time according to the sensitive information classification model and outputting a result;

and the sensitive information visualization module is used for displaying the public opinion information and the mining result on an information display interface in a visualization mode. Through this embodiment the visual module of sensitive information can make things convenient for public opinion worker in time accurate grasp public opinion developments. Specifically, as shown in fig. 3 and fig. 4, in this embodiment, a visual form, namely, a developed public opinion system is used to display the daily sensitive public opinion automatically researched and judged by the system to the user in a man-machine interaction manner in the sensitive straight-through vehicle block, and the user can browse the research and judgment result and simultaneously correct the result on line for fine tuning and updating the background model.

This embodiment in the intelligent excavation system of sensitive information in public opinion information, public opinion information preprocessing module includes first filter unit, second filter unit and third filter unit, through first filter unit, second filter unit and third filter unit filtering impurity information obtains filtered public opinion information, impurity information includes: vulgar information, advertising information, historical information, link symbols, and emoticon content;

filtering low popular information and advertisement information in public sentiment information through the first filtering unit;

filtering out historical information in public opinion information through the second filtering unit;

and filtering the link symbols and the emoticons in the public opinion information through the third filtering unit.

In this embodiment, the impurity information filtering in the preprocessing stage is mainly to perform impurity information identification on data, and the data can be preprocessed according to the first filtering unit, the second filtering unit and the third filtering unit, and in the actual processing process, if the information is identified to be vulgar or advertisement information, the historical information is not judged; if neither of the first two phases is recognized, the link symbols or emoticons in the message are filtered.

In the system for intelligently mining sensitive information in public opinion information described in this embodiment, the first filtering unit is a filtering algorithm of popular information and advertisement information based on a naive bayes model:

the filtering algorithm of the low-popular information and the advertisement based on the naive Bayes model is based on Bayes' theorem, the probability that the item to be classified belongs to each possible category is calculated, and the classification of the item to be classified is confirmed according to the category with the maximum probability;

identifying the vulgar information and the advertisement information in the impurity information according to a naive Bayesian algorithm, namely formula (1):

and filtering out public opinion information containing low popular information or advertisement information. In this embodiment, in the online data processing real-time stream, before data is put into a database, vulgar or advertisement information is identified, a field tag is given to mark, and subsequent business requirement development does not use the data as a basis for analysis.

In the intelligent mining system for sensitive information in public opinion information described in this embodiment, the second filtering unit is a history information filtering algorithm based on history information keywords:

the historical information filtering algorithm based on the historical information keywords comprises the following steps: according to the history famous characters and the event keywords, identifying the history information in the impurity information in a keyword matching mode, wherein the keyword matching mode is that after a keyword library is formed by collecting a history character library and major historical event keywords, public opinion information containing the history information is filtered by matching the relevant history information in the keyword library. Specifically, the keywords in the keyword library are vocabularies such as "rugou bridge change", "Kangxi emperor", and the like.

In the system for intelligently mining sensitive information in public opinion information described in this embodiment, the third filtering unit is a filtering algorithm for connecting link symbols and expression symbols based on a regular expression, and removes the link symbols based on the regular expression, including "http. and" https. the regular expression matching;

the emoticons mainly exist in microblog data, after the microblog data are collected, the emoticons are filtered in a mode of matching the word emoticons, and the emoticons are represented in the microblog data through the word emoticons. Specifically, the expression symbols include "greedy ]", "careful to you ]", "sun ]", and the like.

In the intelligent mining system for sensitive information in public opinion information, the sensitive information labeling module receives artificial labeling information of the public opinion information through an information display interface, the artificial labeling information comprises category information, and the category information comprises complaint and maintenance, complaint and complaint, safety production, economic and financial affairs, wind construction, consciousness shape, natural disasters, removal places and food, medicine and health.

In the system for intelligently mining sensitive information in public opinion information, the sensitive information identification module performs fine adjustment on the bert model based on artificial labeling information, trains to obtain a sensitive information classification model, fuses online users with original basic labeling data according to the labeled public opinion information obtained by the sensitive information classification labeling module after a preset interval time, performs parameter fine adjustment on the bert model again, so that the bert model adapts to newly added labeling data, obtains a new sensitive information classification model, and realizes the timed update of the sensitive information classification model. Specifically, the system can set a background to perform data fusion and model fine tuning training again in the morning every day. Through the sensitive information labeling module described in the embodiment, a public sentiment worker can perform system updating aiming at data classification results in the process of using the system, so that more labeling data are accumulated for updating the classification model.

In the system for intelligently mining sensitive information in public opinion information, the sensitive information visualization module displays the sensitive information intelligently mined by the system in a visual form, and the sensitive information visualization module comprises an information screening unit and an information display unit;

the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information;

the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions.

In addition, based on the system for intelligently mining sensitive information in public opinion information, the present implementation also provides a method for intelligently mining sensitive information in public opinion information, the method includes:

step 101, preprocessing mass public sentiment data, filtering advertisement information and vulgar information by using a Bayesian model, and filtering historical information by using basic historical keywords;

102, performing sensitive information incremental training based on a bert model, and performing training and updating of a classification model by using a Google open-source bert pre-training model and standard sensitive information data;

103, visualizing the sensitive information, automatically mining the captured internet public opinion data according to a trained intelligent sensitive information mining method, and displaying the captured internet public opinion data on an information display interface, wherein the display module comprises an information screening unit and an information display unit, and the information screening unit is used for screening the sensitivity degree, the media classification and the website category information of the information; the information display unit is used for displaying the sensitive information meeting the conditions according to the screening conditions, and the display content comprises sensitive information categories, related sensitive keywords and the release time of the sensitive information. In this embodiment, a basic sensitive information classification model is trained based on the historical accumulated labeled data and used for studying and judging the sensitive information of the data, after the model is online, a user corrects the model studying and judging result in the process of continuously using the system, and retraining and fine-tuning parameters of the basic model are performed based on the online labeled and corrected data of the user, so that the model is more and more accurate.

In this embodiment, the complete intelligent mining system for sensitive information in public opinion information includes background computing and foreground display. The background program receives public sentiment information, after the public sentiment information is preprocessed by the public sentiment information preprocessing module, the public sentiment information is input into a trained sensitive information classification model, the sensitive classification of the information is mined and output, meanwhile, sensitive words contained in the information are obtained, the mined sensitive information is stored in a data table, and the foreground displays corresponding sensitive information through inquiring the data table; meanwhile, the foreground provides a human-computer interaction interface through the sensitive information category marking module, a user can perform manual examination and mining in the process of using the system, the mining result is modified, the system can automatically record user operation data, and the retraining and updating process of the sensitive information mining model is performed by using the user operation data.

The layout of the information display interface in this embodiment is shown in fig. 2, an information screening area is above the interface, and the screening conditions include a statistical period, media classification, sensitivity, and region; the lower part of the interface is a sensitive information display area, namely sensitive information meeting the conditions is displayed according to the upper screening conditions, and each piece of sensitive information display content contains sensitive category, sensitive words, release time, title and other information. The modules of this embodiment are specifically described as follows:

public opinion sensitive information mining module, background program real-time calculation carries out the preliminary treatment according to the information received, and the model is excavated to store the result to the data sheet, specifically include:

(a) bayesian-based filtering of advertisement information. The internet information contains a lot of advertisement information, and the impurity information is effectively filtered, so that the accuracy of information mining can be greatly improved.

(b) And filtering based on historical information of historical key people. The massive internet information not only contains advertisement information, but also contains a great deal of historical information, so that the content needs to be filtered. When the part of data of the historical information is filtered, the filtering is mainly carried out according to the names of the historical characters, and if the names of the historical characters are contained for more than 3 times in the text, the text is considered to mainly explain the historical information.

The public opinion sensitive information mining model updating method includes that a background conducts model updating training and model file storage according to sensitive data marked by a user in a system using process, and is used for sensitive information mining later, and specifically includes the following steps:

(a) and training a sensitive information mining model based on a bert model. The Bert is a deep learning pre-training model of Google open source, can effectively identify semantic information, is used for training and updating the sensitive information mining model, and is greatly improved in accuracy compared with the sensitive information mining based on the existing keywords.

And the display module of the public opinion sensitive information carries out sensitivity mining on the public opinion information in real time in the background, stores the result into the data table, and displays the result according to the data of the database in the foreground display area.

(a) Condition screening area: the conditions which can be screened comprise a statistical period, media classification, sensitivity and website statistics; specifically, in this embodiment, the statistical period may be selected from 4 hours, 1 day, 3 days, and 1 week; the media classification can select news, microblogs, forums and the like; the sensitivity degree comprises extreme sensitivity, general sensitivity and sensitivity, a user selects conditions on a page by clicking a mouse, and the page automatically refreshes and displays sensitive information which meets the conditions and is automatically judged by a system.

(b) Sensitive information display area: displaying the mined sensitive public opinion information, wherein the display content of each piece of sensitive public opinion information comprises: the method comprises the steps of sensitive category, sensitive keywords, information titles, release time and release websites, specifically, in the embodiment, the sensitive keywords are a batch of sensitive words summarized based on experience and are displayed after being hit; the information title, the publishing time and the publishing website are all obtained in the data crawler stage, and only the information is displayed on the display page.

The implementation case is implemented according to the front-back sequence, data can be input into the trained mining model for sensitive information mining only through information preprocessing, and the front platform can display the mining result only by storing the mining result into the database.

In specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the system for intelligently mining sensitive information in public opinion information provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

12页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:一种处理文档的方法、装置、计算机存储介质及终端

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!