阅读说明：本技术 一种基于HDNet的输电场景下吊车入侵检测机制 (Crane intrusion detection mechanism under power transmission scene based on HDNet ) 是由 赵宏伟 张卫山 李兆桐 于 2019-04-15 设计创作，主要内容包括：本发明提出了一种基于HDNet的输电场景下吊车入侵检测机制,该机制利用传统图像几何变换和GAN来对数据集进行生成式数据增强；设计一种新的目标检测网络HDNet,包括吊车候选区域生成子网络HRDNet和吊车目标分类子网络HCNet；采用通道剪枝策略来删除无效节点,实现模型压缩,使之可以在嵌入式平台上平稳运行,提高目标检测的效率,保证输电场景下吊车入侵运作检测的可用性和健壮性。(The invention provides a crane intrusion detection mechanism under an HDNet-based power transmission scene, which utilizes traditional image geometric transformation and GAN to perform generative data enhancement on a data set; designing a new target detection network HDNet, which comprises a crane candidate area generation sub-network HRDNet and a crane target classification sub-network HCNet; and the invalid nodes are deleted by adopting a channel pruning strategy, so that model compression is realized, the model compression can be stably operated on an embedded platform, the target detection efficiency is improved, and the availability and the robustness of crane intrusion operation detection in a power transmission scene are ensured.)

1. A crane intrusion detection mechanism based on an HDNet (high-density data network) transmission scene utilizes traditional image geometric transformation and GAN (generic object network) to perform generative data enhancement on a data set; designing a new target detection network HDNet, which comprises a crane candidate area generation sub-network HRDNet and a crane target classification sub-network HCNet; and the invalid nodes are deleted by adopting a channel pruning strategy, so that model compression is realized, the model compression can be stably operated on an embedded platform, the target detection efficiency is improved, and the availability and the robustness of crane intrusion operation detection in a power transmission scene are ensured. The method comprises the following steps:

based on a traditional data enhancement method, obtaining a new image by adopting methods such as horizontal turning, rotation, random cutting and the like;

generating a crane image in a new power transmission scene by adopting DCGAN based on GAN, and performing generative data enhancement on a data set;

step (3), awakening a camera through a sensor, loading a neural network model, zooming the acquired image to a uniform size, and inputting the image into an HDNet;

step (4), the HDNet is divided into a precise crane candidate area extraction network HRDNet and a candidate area precise classification network HCNet;

step (5), in HRDNet, dividing the image into 9 x 9 grids, performing regression on the candidate region in each grid, and finally taking the candidate region with the confidence coefficient greater than a certain threshold value as a target region to be classified;

step (6), reclassifying the candidate regions in the HCNet to obtain a final detection result;

deleting redundant channel neurons by using a Frobenius norm large for convolution kernels on each channel level, realizing pruning of branches with small effect on a neural network, and obtaining a model with a smaller volume;

step (8), retraining the model obtained by pruning by using the training set so as to make up for the precision loss caused by pruning;

and (9) comprehensively analyzing the detection result and sending the detection result to a server terminal in a wireless manner.

Technical Field

The invention relates to the field of deep learning target detection, in particular to a crane detection mechanism under a power transmission scene based on HDNet.

Background

A crane detection mechanism under a power transmission scene based on HDNet is based on a deep learning target detection method, a novel convolutional neural network is designed, and the neural network is compressed. The closest techniques to the present invention are:

(1) the YOLO algorithm: the YOLO algorithm is one of typical representatives of the deep learning target detection one-stage algorithm, and the real-time target detection effect of the efficient end-to-end deep learning system is achieved. The YOLO algorithm first scales the image to a uniform size and then feeds the image into a convolutional neural network, which segments the input image into a plurality of grid cells, each grid cell being responsible for detecting those targets whose center points fall within the grid. Each detected target comprises coordinates and confidence degree provided by variable borrowing, and a bounding box of a correct target is obtained through regression calculation by utilizing back propagation. However, the efficiency of YOLO is subject to loss of accuracy, and when there are small targets or dense targets in an image, the detection effect of YOLO is very undesirable.

(2) The fast R-CNN algorithm: in 2016, the fast R-CNN provided by the two-stage method integrates the structure of feature extraction, candidate region generation, boundary frame regression and classification into a network, so that the comprehensive performance is greatly improved, and the detection speed in the two-stage method is particularly obvious. However, the detection efficiency is still far from that of the one-stage method, and the detection accuracy is still to be further improved.

In order to make up for the defects of the traditional deep learning target detection method in speed and precision and the difficult problem that an overlarge deep learning model is difficult to operate on a lightweight embedded computing platform, the method makes full use of the advantages of deep learning in the field of target detection, and further improves the speed and efficiency of crane intrusion detection in a power transmission scene by the traditional target detection method.

Disclosure of Invention

In order to solve the defects and shortcomings in the prior art, the invention provides a crane intrusion real-time detection mechanism in a power transmission scene based on HDNet, which utilizes traditional image geometric transformation and GAN to perform generative data enhancement on a data set; designing a new target detection network HDNet, which comprises a crane candidate area generation sub-network HRDNet and a crane target classification sub-network HCNet; and the invalid nodes are deleted by adopting a channel pruning strategy, so that model compression is realized, the model compression can be stably operated on an embedded platform, the target detection efficiency is improved, and the availability and the robustness of crane intrusion operation detection in a power transmission scene are ensured. The technical scheme of the invention is as follows:

based on a traditional data enhancement method, obtaining a new image by adopting methods such as horizontal turning, rotation, random cutting and the like;

generating a crane image in a new power transmission scene by adopting DCGAN based on GAN, and performing generative data enhancement on a data set;

step (3), awakening the camera through a sensor, loading a neural network model, zooming the acquired image to a uniform size, and inputting the image into an HDNet;

step (4), the HDNet is divided into a precise crane candidate area extraction network HRDNet and a candidate area precise classification network HCNet;

step (5), in HRDNet, dividing the image into 9 x 9 grids, performing regression on the candidate region in each grid, and finally taking the candidate region with the confidence coefficient greater than a certain threshold value as a target region to be classified;

step (6), reclassifying the candidate regions in the HCNet to obtain a final detection result;

deleting redundant channel neurons by using a Frobenius norm large for convolution kernels on each channel level, realizing pruning of branches with small effect on a neural network, and obtaining a model with a smaller volume;

step (8), retraining the model obtained by pruning by using the training set so as to make up for the precision loss caused by pruning;

and (9) comprehensively analyzing the detection result and sending the detection result to a server terminal in a wireless manner.

The invention has the beneficial effects that:

(1) the method expands the data set by combining the traditional geometric transformation and the GAN, thereby solving the problem of insufficient training samples;

(2) a new scheme of target monitoring is provided, namely, the detection gravity center is generated in a more accurate candidate area, and a smaller classification network is used for judging again;

(3) and a channel pruning scheme is adopted for model compression aiming at the limitation of part of lightweight computing platforms, so that the calculated amount of target monitoring is greatly reduced.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of a crane intrusion detection model in an HDNet-based power transmission scene according to the present invention; FIG. 2 is a diagram of a HDNet network architecture; FIG. 3 is a diagram of a network architecture for HRDNet; fig. 4 is a diagram showing the structure of an HCNet network.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As shown in fig. 1, a cache model diagram of a crane intrusion detection mechanism in an HDNet-based power transmission scenario combines a sensor and a model compression algorithm to reduce energy consumption so that the system can operate on a lightweight computing platform, and HDNet realizes high-precision and high-efficiency detection of a target. As shown in fig. 2, HDNet is divided into two parts, i.e., HRNet and HCNet, and the two sub-network structures are shown in fig. 3 and 4, and a crane target in an image is detected by processing the two sub-networks.

The following describes in detail a specific flow of a crane intrusion detection mechanism in an HDNet-based power transmission scenario:

based on a traditional data enhancement method, obtaining a new image by adopting methods such as horizontal turning, rotation, random cutting and the like;

generating a crane image in a new power transmission scene by adopting DCGAN based on GAN, and performing generative data enhancement on a data set;

step (3), awakening the camera through a sensor, loading a neural network model, zooming the acquired image to a uniform size, and inputting the image into an HDNet;

step (4), the HDNet is divided into a precise crane candidate area extraction network HRDNet and a candidate area precise classification network HCNet;

step (5), in HRDNet, dividing the image into 9 x 9 grids, performing regression on the candidate region in each grid, and finally taking the candidate region with the confidence coefficient greater than a certain threshold value as a target region to be classified;

step (6), reclassifying the candidate regions in the HCNet to obtain a final detection result;

deleting redundant channel neurons by using a Frobenius norm large for convolution kernels on each channel level, realizing pruning of branches with small effect on a neural network, and obtaining a model with a smaller volume;

step (8), retraining the model obtained by pruning by using the training set so as to make up for the precision loss caused by pruning;

and (9) comprehensively analyzing the detection result and sending the detection result to a server terminal in a wireless manner.

According to the crane intrusion detection mechanism based on the HDNet in the power transmission scene, the traditional image geometric transformation and the GAN are utilized to perform generative data enhancement on a data set. A crane detection network HDNet is designed, regions where a crane is likely to exist are generated by a crane candidate region sub-network HRNet, and reclassification is performed by HCNet. And deleting invalid nodes by adopting a channel pruning strategy, realizing model compression, and recovering the accuracy of the model through retraining again, so that the model can stably run on an embedded platform, the efficiency of target detection is improved, and the availability and the robustness of crane intrusion operation detection in a power transmission scene are ensured.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.