阅读说明：本技术 一种基于深度学习的烟梗形态智能识别系统及方法 (Tobacco stem form intelligent identification system and method based on deep learning ) 是由 徐大勇 堵劲松 李善莲 邓国栋 张玉海 于 2020-05-21 设计创作，主要内容包括：一种基于深度学习的烟梗形态智能识别系统及方法,特征是,所述识别系统包括烟梗传输装置,图像采集装置,深度学习烟梗识别模块；所述烟梗传输装置主要将烟梗进行分离传输,将其运送至图像采集工位,并给出光电信号；所述图像采集装置安装在烟梗传输装置上方,接收到烟梗传输装置发出的光电信号实时采集下方的烟梗图像并将其传输给深度学习烟梗识别模块；所述深度学习烟梗识别模块由深度学习开发板、上位机软件与烟梗识别深度学习模型三个部分组成,烟梗识别深度学习模型搭载于深度学习开发板上,用于烟梗图像的智能分析,确定烟梗形态。本发明可降低人为造成误差,提高检测效率,为卷烟原料挑选过程中烟梗识别分类提供一种自动化、智能化的检测手段。(A tobacco stem form intelligent identification system and method based on deep learning are characterized in that the identification system comprises a tobacco stem transmission device, an image acquisition device and a deep learning tobacco stem identification module; the tobacco stem transmission device mainly separates and transmits tobacco stems, conveys the tobacco stems to an image acquisition station and provides photoelectric signals; the image acquisition device is arranged above the tobacco stem transmission device, receives a photoelectric signal sent by the tobacco stem transmission device, acquires a tobacco stem image below the tobacco stem transmission device in real time and transmits the tobacco stem image to the deep learning tobacco stem identification module; the tobacco stem deep learning module is composed of a deep learning development board, upper computer software and a tobacco stem deep learning model, and the tobacco stem deep learning model is carried on the deep learning development board and used for intelligently analyzing tobacco stem images and determining tobacco stem shapes. The invention can reduce the artificial error, improve the detection efficiency and provide an automatic and intelligent detection means for identifying and classifying the tobacco stems in the cigarette raw material selection process.)

1. The utility model provides a offal form intelligent recognition system based on degree of deep learning which characterized in that: the tobacco stem identification system comprises a tobacco stem transmission device, an image acquisition device and a deep learning tobacco stem identification module; the tobacco stem transmission device is used for separating and transmitting tobacco stems, conveying the tobacco stems to an image acquisition station and giving out photoelectric signals; the image acquisition device is arranged above the tobacco stem transmission device, receives a photoelectric signal sent by the tobacco stem transmission device, acquires a tobacco stem image below the tobacco stem transmission device in real time and transmits the tobacco stem image to the deep learning tobacco stem identification module; the tobacco stem deep learning module is composed of a deep learning development board, upper computer software and a tobacco stem deep learning model, and the tobacco stem deep learning model is carried on the deep learning development board and used for intelligently analyzing tobacco stem images and determining tobacco stem shapes.

2. The intelligent tobacco stem shape recognition system based on deep learning of claim 1, wherein: the tobacco stem conveying device is composed of a conveying belt machine and a photoelectric detector, and tobacco stems are separated in the conveying process.

3. The intelligent tobacco stem shape recognition system based on deep learning of claim 1, wherein: the image acquisition device consists of an annular LED illumination light source, a CCD camera and an optical lens; after the tobacco stems are conveyed to an imaging station, a CCD camera receives photoelectric detection signals of a photoelectric detector, and tobacco stem images are collected through a low-distortion optical lens in an annular LED shimming illumination environment.

4. The intelligent tobacco stem shape recognition system based on deep learning of claim 1, wherein: the tobacco stem identification deep learning model is formed by training a large number of tobacco stem images based on deep learning frames such as CNN, FCN and YOLOV3, the image acquisition device transmits the images to the deep learning tobacco stem identification module, the upper computer software reads digital image information in the cache, and the tobacco stem identification deep learning model is called to complete tobacco stem form identification.

5. An intelligent tobacco stem form identification method based on deep learning is characterized in that: the method comprises the following steps:

1) the tobacco stem is separated and conveyed by using the belt conveyor;

2) acquiring a tobacco stem image through a specific lighting environment and a photographing device on a conveying line, and transmitting the image to a deep learning tobacco stem identification module;

3) training a preset deep learning model on a loaded deep learning development board through tobacco stem images acquired on line to generate a deep learning tobacco stem identification model file;

4) after the training is finished, loading the trained model on a deep learning development board, repeating the steps 1) and 2), then calling the trained deep learning tobacco stem recognition model file to analyze a real-time image, and thus, the on-line intelligent recognition and classification of the tobacco stem form can be finished.

Technical Field

The invention belongs to the technical field of cigarette raw material quality detection, and particularly relates to a tobacco stem form intelligent identification system and method based on deep learning.

Background

The tobacco stems are used as one of the main raw materials of the cigarette, and the cut stems or the cut stems processed by the tobacco stems have higher filling value and better combustibility, so the tobacco stems have very important effects on reducing harm and tar, reducing formula cost and improving the physical quality of the cigarette. The long stem rate of the tobacco stems, the leaf content rate in the stems, the thick stem rate and the like are important indexes for measuring the product quality and the processing level, the length, the thickness and the stem head of the tobacco stems have obvious influence on the cut stem structure, the cut rate, the cut stem proportion and the like, thereby influencing the physical quality of the rolled and finished cigarettes

The main detection indexes of the tobacco stem form are as follows: long stalk rate, short stalk rate, leaf (powder) content in stalk, coarse stalk rate, and stalk head ratio. The existing identification methods for the tobacco stem shapes are all manual methods, and the long stem rate/short stem rate is as follows: comparing the tobacco stem samples with the corresponding size plates one by one, and respectively calculating the percentage: selecting by a vibrating screen; the ratio of leaf (dust) content to stem head in the stem: manually selecting; the method has the advantages of high labor intensity, high possibility of causing fatigue of detection personnel, high detection result error and incapability of obtaining the distribution and uniformity of the tobacco stem structure.

Disclosure of Invention

The invention aims to overcome the defects of the prior art, and provides an intelligent tobacco stem form identification system and method based on deep learning, which can reduce the artificial error, improve the detection efficiency and provide an automatic and intelligent detection means for identifying and classifying the tobacco stems in the cigarette raw material selection process.

The purpose of the invention is realized by the following technical scheme:

an intelligent tobacco stem form identification system based on deep learning comprises a tobacco stem transmission device, an image acquisition device and a deep learning tobacco stem identification module; the tobacco stem transmission device is used for separating and transmitting tobacco stems, conveying the tobacco stems to an image acquisition station and giving out photoelectric signals; the image acquisition device is arranged above the tobacco stem transmission device, receives a photoelectric signal sent by the tobacco stem transmission device, acquires a tobacco stem image below the tobacco stem transmission device in real time and transmits the tobacco stem image to the deep learning tobacco stem identification module; the tobacco stem deep learning module is composed of a deep learning development board, upper computer software and a tobacco stem deep learning model, and the tobacco stem deep learning model is carried on the deep learning development board and used for intelligently analyzing tobacco stem images and determining tobacco stem shapes.

The tobacco stem conveying device is composed of a conveying belt machine and a photoelectric detector, and tobacco stems are separated in the conveying process.

The image acquisition device consists of an annular LED illumination light source, a CCD camera and an optical lens; after the tobacco stems are conveyed to an imaging station, a CCD camera receives photoelectric detection signals of a photoelectric detector, and tobacco stem images are collected through a low-distortion optical lens in an annular LED shimming illumination environment.

The tobacco stem deep learning model is formed by training a large number of tobacco stem images based on a deep learning frame such as CNN, FCN and YOLOV3 and is formed by transmitting the images to the deep learning tobacco stem recognition module through an image acquisition device, the upper computer software reads digital image information in a cache, calls the tobacco stem deep learning model and completes tobacco stem form recognition.

The principle and the method for intelligently identifying the tobacco stem form by using the identification system comprise the following processes:

1) the tobacco stem is separated and conveyed by using the belt conveyor;

2) acquiring a tobacco stem image through a specific lighting environment and a photographing device on a conveying line, and transmitting the image to a deep learning tobacco stem identification module;

3) training a preset deep learning model on a loaded deep learning development board through tobacco stem images acquired on line to generate a deep learning tobacco stem identification model file;

4) after the training is finished, loading the trained model on a deep learning development board, repeating the steps 1) and 2), then calling the trained deep learning tobacco stem recognition model file to analyze a real-time image, and thus, the on-line intelligent recognition and classification of the tobacco stem form can be finished.

The invention has the following beneficial effects:

(1) compared with the traditional image algorithm, the improved deep learning algorithm adopted by the invention has higher accuracy and recall rate in the identification and classification of tobacco stems.

(2) The tobacco stem detection device provided by the invention adopts an illumination mode of an annular light source and is matched with a network camera, so that the image acquired by the method is clearer and more real, and the subsequent image training and experimental testing are facilitated.

(3) The invention adopts the TX2 development board as a hardware processing core, and the operation core has small volume and high operation speed and is more convenient in the aspect of tobacco stem detection.

Drawings

Figure 1 is a schematic diagram of the system architecture,

in the figure: 1. the deep learning development board comprises a deep learning development board 2, an annular LED light source 3, a conveyor 4, a camera 5 and a photoelectric detector.

Fig. 2 is a flowchart of deep learning identification.

Detailed Description

The invention is further described in the following with reference to the accompanying drawings, and the operation flow is as follows:

as shown in figure 1, when the tobacco stem detection device is powered on and started, the conveyor 3 drives the tobacco stems to move, and when the tobacco stems reach the detection station, the photoelectric detector 5 detects the positions of the tobacco stems and sends trigger signals to the camera 4. The method comprises the following steps that a camera 4 shoots a tobacco stem picture in the environment of an annular LED light source 2 and transmits the picture to a deep learning development board 1, after the deep learning development board 1 obtains the tobacco stem picture, the identification step is as shown in FIG. 2, the tobacco stem picture is called by upper computer software after being preprocessed, and is guided into a pre-trained tobacco stem identification deep learning model to finish identification and classification; the tobacco stem identification deep learning model is obtained by collecting a large number of tobacco stem pictures for training through the device in the figure 1, and performing image preprocessing, image labeling and model training.

The specific working steps are as follows:

1. the tobacco stem detection device is characterized in that tobacco stems are conveyed to a conveyor by a feeding machine, the conveyor automatically conveys the tobacco stems, and when the tobacco stems pass through a detection station, a photoelectric detector generates a trigger signal.

2. After the trigger signal is received, a camera lens responsible for image acquisition shoots an image of the current tobacco stem in real time under the illumination of the annular LED annular light source, and transmits the image to the deep learning tobacco stem identification module.

3. After the tobacco stem image is received, the software system filters noise, background and other useless information in the original image through an image preprocessing algorithm, the size of the image is adjusted again, the complexity of the image is reduced, and a VOC format data set required by deep learning is manufactured.

4. After the tobacco stem data set is collected, label is carried out on the tobacco stem image data set manually by using labelimg software.

5. And after the labeling is finished, training the data set by using a deep learning framework such as CNN, FCN or YOLOV3 and the like to obtain a tobacco stem recognition model file based on deep learning.

6. And (3) repeating the steps 1 and 2, performing necessary filtering, image enhancement and the like on the acquired original image, segmenting the image, and preparing for image recognition.

7. And calling the trained tobacco stem identification model file in a pre-programmed software program to identify and classify the tobacco stem forms.

8. And calculating and measuring relevant parameters of the identified images by using traditional image analysis, and calculating the geometric parameters of the tobacco stems.