Intelligent garbage classification method combining vision and touch
阅读说明:本技术 视觉与触觉相结合的智能垃圾分类方法 (Intelligent garbage classification method combining vision and touch ) 是由 田卫新 张力 温征 刘本梦 于 2019-11-29 设计创作,主要内容包括:本发明公开了视觉与触觉相结合的智能垃圾分类方法,利用分拣头抓取垃圾分类面板上的垃圾,分拣头的抓爪内侧设有触觉传感器,将分拣头移动到垃圾的上方,采集垃圾的图像,分拣头抓取垃圾时触觉传感器取得垃圾的触觉数据,分拣头的控制器采用神经网络模型作为分类器,根据垃圾的图像和触觉数据对抓取的垃圾进行识别、分类,随后分拣头依据垃圾的分类将抓取的垃圾放入对应的垃圾分类区。本发明采用视觉与触觉相结合的方式,相对现有的单纯利用图像对垃圾进行识别分类的方法,大大降低误拣率,分类精度高,尤其易于识别出湿垃圾,分类效率高,省时省力。(The invention discloses an intelligent garbage classification method combining vision and touch, which comprises the steps of grabbing garbage on a garbage classification panel by utilizing a sorting head, arranging a touch sensor on the inner side of a grabbing claw of the sorting head, moving the sorting head to the upper side of the garbage, collecting images of the garbage, obtaining touch data of the garbage by the touch sensor when the sorting head grabs the garbage, using a neural network model as a classifier by a controller of the sorting head, identifying and classifying the grabbed garbage according to the images and the touch data of the garbage, and then placing the grabbed garbage into a corresponding garbage classification area by the sorting head according to the classification of the garbage. Compared with the existing method for identifying and classifying the garbage by simply utilizing the image, the method has the advantages of greatly reducing the false picking rate, being high in classification precision, being particularly easy to identify the wet garbage, being high in classification efficiency, saving time and labor.)
1. The intelligent garbage classification method combining vision and touch is characterized in that a sorting head is used for grabbing garbage on a garbage classification panel, a touch sensor is arranged on the inner side of a grabbing claw of the sorting head, the sorting head is moved above the garbage to collect images of the garbage, the touch sensor obtains touch data of the garbage when the sorting head grabs the garbage, a controller of the sorting head adopts a neural network model as a classifier, the grabbed garbage is identified and classified according to the images and the touch data of the garbage, and then the sorting head puts the grabbed garbage into a corresponding garbage classification area according to the classification of the garbage.
2. The vision and touch combined intelligent garbage classification method according to claim 1, characterized in that the collected and tiled garbage is sequentially sorted row by adopting a sorting head, the sorting distance is set according to the grabbing range of a grabbing claw of the sorting head, the sorted garbage is classified and put into a corresponding classification area, the intelligent garbage classification method comprises the following steps,
step 1: moving the picking spacing in the Y-axis direction;
step 2: moving the picking spacing in the X-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the step 5, the captured garbage is placed into a corresponding classification area, and the current sorting point is returned;
and 7: judging whether the sorting in the X-axis direction is finished or not;
step 7.1: if the picking in the X-axis direction is not finished, executing the step 2:
step 7.2: if the sorting in the X-axis direction is finished, executing a step 8;
and 8: judging whether the sorting in the Y-axis direction is finished or not;
step 8.1: if the sorting in the Y-axis direction is not finished, executing the step 1;
step 8.2: when the sorting in the Y-axis direction is completed, the process ends.
3. The vision and touch combined intelligent garbage classification method according to claim 1, characterized in that the collected and tiled garbage is sorted row by row in sequence by using a sorting head, the sorting distance is set according to the grabbing range of a grabbing claw of the sorting head, the sorted garbage is classified and put into a corresponding classification area, the intelligent garbage classification method comprises the following steps,
step 1: moving the picking spacing in the X-axis direction;
step 2: moving the picking spacing in the Y-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the step 5, the captured garbage is placed into a corresponding classification area, and the current sorting point is returned;
and 7: judging whether the sorting in the Y-axis direction is finished or not;
step 7.1: if the sorting in the Y-axis direction is not finished, executing step 2:
step 7.2: if the sorting in the Y-axis direction is finished, executing the step 8;
and 8: judging whether the sorting in the X-axis direction is finished or not;
step 8.1: if the sorting in the X-axis direction is not finished, executing the step 1;
step 8.2: when the sorting in the X-axis direction is completed, the process ends.
4. The intelligent garbage classification method combining vision and touch according to claim 2, characterized in that the intelligent garbage classification method selects the garbage thrown by citizens at one time, puts the garbage into the corresponding classification areas one by one, collects the images of the citizens' heads before the selection to confirm the identity of the citizens, and evaluates the garbage thrown by the citizens after the sorting and classification of the garbage thrown by citizens at one time, the specific steps are as follows,
step 1: moving the picking spacing in the Y-axis direction;
step 2: moving the picking spacing in the X-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the step 5, the captured garbage is placed into a corresponding classification area, and the current sorting point is returned;
and 7: judging whether the sorting in the X-axis direction is finished or not;
step 7.1: if the picking in the X-axis direction is not finished, executing the step 2:
step 7.2: if the sorting in the X-axis direction is finished, executing a step 8;
and 8: judging whether the sorting in the Y-axis direction is finished or not;
step 8.1: if the sorting in the Y-axis direction is not finished, executing the step 1;
step 8.2: if the sorting in the Y-axis direction is completed, executing step 9;
and step 9: recording the sorting times of sorting heads in the garbage sorting process as the quantity of garbage thrown by citizens at a single time, recording the garbage sorting processing time after the citizens throw the garbage at a single time, dividing the garbage sorting processing time by the quantity of the garbage to obtain the average processing time of single garbage, and evaluating the quality of the garbage thrown by the citizens according to the average processing time of the unit garbage thrown by the citizens.
5. The intelligent visual and tactile garbage classification method according to any one of claims 1-4, wherein the classifier is trained by collecting image data and tactile data of garbage, and the training method of the classifier comprises the following steps,
step 1: collecting images and touch data of recoverable garbage and harmful garbage, and dividing the images and touch data into a training set and a testing set;
step 2: training the classifier by using the training set in the step 1;
and step 3: testing the trained classifier by using the test set in the step 1 as the input of the classifier, and if the test is qualified, performing the step 4, otherwise, executing the step 1 for further training;
and 4, step 4: collecting images and touch data of wet garbage and dry garbage, and dividing the images and the touch data into a training set and a testing set;
and 5: training the classifier again by using the training set in the step 4;
step 6: and (4) testing the trained classifier by using the test set in the step (4) as the input of the classifier, finishing the training if the test is qualified, and otherwise, executing the step (4) for further training.
6. The intelligent visual and tactile garbage classification method according to any one of claims 1-4, wherein the neural network model is a CNN neural network model.
Technical Field
The invention belongs to the field of garbage classification, and particularly relates to an intelligent garbage classification method combining vision and touch.
Background
With the rapid development of economy and the improvement of living standard, the yield of the domestic garbage is also increased sharply. The household garbage is various in types, some garbage can be recycled, some garbage has great influence on the environment, and if the garbage is discarded at will, great pollution can be caused. The garbage classification and recovery work has been carried out for many years in China, and mainly classified garbage cans are used as the main part. But the effect of garbage classification is not ideal, and the awareness of people on garbage classification is weak.
In recent two years, China has begun to establish a strict garbage classification system in some cities. Taking the sea as an example, residents are required to classify garbage into four categories of recyclables, harmful garbage, wet garbage and dry garbage. Since the waste classification is required to be complicated and can not be performed by residents completely, a device for inspecting and secondarily classifying the classified waste thrown by users is urgently needed.
Disclosure of Invention
The invention has the technical problems that the existing method for automatically identifying and classifying garbage by simply adopting garbage images has high error rate, and the classification is wrong due to the fact that the garbage material is difficult to distinguish by adopting a single visual sensor according to the current garbage classification standard.
The invention aims to solve the problems and provides an intelligent garbage classification method combining vision and touch, which comprises the steps of collecting images of garbage by using a camera, collecting touch data of the garbage by using a touch sensor, using the images and the touch data of the garbage as input of a neural network model, identifying and classifying the garbage by using the neural network model, putting the garbage into a corresponding classification area, recording the quantity of the garbage put by citizens once and the time for completing classification treatment, and evaluating the classification condition of the garbage before the citizens put the garbage.
The technical scheme of the invention is an intelligent garbage classification method combining vision and touch, a sorting head is used for grabbing garbage on a garbage classification panel, a touch sensor is arranged on the inner side of a grabbing claw of the sorting head, the sorting head is moved above the garbage to collect images of the garbage, the touch sensor obtains touch data of the garbage when the sorting head grabs the garbage, a controller of the sorting head adopts a neural network model as a classifier, the grabbed garbage is identified and classified according to the images and the touch data of the garbage, and then the sorting head puts the grabbed garbage into a corresponding garbage classification area according to the classification of the garbage.
Furthermore, the intelligent garbage classification method adopts the sorting head to sort the gathered and tiled garbage row by row in sequence, the sorting distance is set according to the grabbing range of the grabbing claws of the sorting head, the sorted garbage is classified and put into the corresponding classification area, the intelligent garbage classification method comprises the following steps,
step 1: moving the picking spacing in the Y-axis direction;
step 2: moving the picking spacing in the X-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the
and 7: judging whether the sorting in the X-axis direction is finished or not;
step 7.1: if the picking in the X-axis direction is not finished, executing the step 2:
step 7.2: if the sorting in the X-axis direction is finished, executing a step 8;
and 8: judging whether the sorting in the Y-axis direction is finished or not;
step 8.1: if the sorting in the Y-axis direction is not finished, executing the
step 8.2: when the sorting in the Y-axis direction is completed, the process ends.
Furthermore, sorting the gathered and tiled garbage row by adopting a sorting head, setting a sorting distance according to the grabbing range of a grabbing claw of the sorting head, classifying the sorted garbage and putting the sorted garbage into a corresponding classification area, wherein the intelligent garbage classification method comprises the following steps of,
step 1: moving the picking spacing in the X-axis direction;
step 2: moving the picking spacing in the Y-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the
and 7: judging whether the sorting in the Y-axis direction is finished or not;
step 7.1: if the sorting in the Y-axis direction is not finished, executing step 2:
step 7.2: if the sorting in the Y-axis direction is finished, executing the step 8;
and 8: judging whether the sorting in the X-axis direction is finished or not;
step 8.1: if the sorting in the X-axis direction is not finished, executing the
step 8.2: when the sorting in the X-axis direction is completed, the process ends.
Further, the intelligent garbage classification method selects the garbage thrown in by citizens once, puts the garbage into the corresponding classification areas one by one, collects the head images of the citizens before selecting to confirm the identity of the citizens, and evaluates the garbage quality of the garbage thrown in by the citizens after the garbage thrown in by the citizens once is selected and classified,
step 1: moving the picking spacing in the Y-axis direction;
step 2: moving the picking spacing in the X-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the
and 7: judging whether the sorting in the X-axis direction is finished or not;
step 7.1: if the picking in the X-axis direction is not finished, executing the step 2:
step 7.2: if the sorting in the X-axis direction is finished, executing a step 8;
and 8: judging whether the sorting in the Y-axis direction is finished or not;
step 8.1: if the sorting in the Y-axis direction is not finished, executing the
step 8.2: if the sorting in the Y-axis direction is completed, executing step 9;
and step 9: recording the sorting times of sorting heads in the garbage sorting process as the quantity of garbage thrown by citizens at a single time, recording the garbage sorting processing time after the citizens throw the garbage at a single time, dividing the garbage sorting processing time by the quantity of the garbage to obtain the average processing time of single garbage, and evaluating the quality of the garbage thrown by the citizens according to the average processing time of the unit garbage thrown by the citizens.
Furthermore, the classifier acquires image data and tactile data of garbage to train the classifier, and the training method of the classifier comprises the following steps,
step 1: collecting images and touch data of recoverable garbage and harmful garbage, and dividing the images and touch data into a training set and a testing set;
step 2: training the classifier by using the training set in the
and step 3: testing the trained classifier by using the test set in the
and 4, step 4: collecting images and touch data of wet garbage and dry garbage, and dividing the images and the touch data into a training set and a testing set;
and 5: training the classifier again by using the training set in the
step 6: and (4) testing the trained classifier by using the test set in the step (4) as the input of the classifier, finishing the training if the test is qualified, and otherwise, executing the step (4) for further training.
Preferably, the neural network model adopts a CNN neural network model.
Preferably, the classification of the garbage in the intelligent garbage classification method comprises recyclables, harmful garbage, wet garbage and dry garbage.
Compared with the prior art, the invention has the beneficial effects that:
1) the invention adopts a mode of combining vision and touch, adopts a neural network model to identify and classify the garbage, classifies and places the garbage, is convenient for further disposal of the garbage, is convenient for recycling recyclable materials, is convenient for special treatment of harmful garbage, and reduces the pollution to the environment;
2) the garbage is identified and classified by the neural network model according to the image and the tactile data of the garbage in a mode of combining vision and tactile sense, so that compared with the existing method for identifying and classifying the garbage by only utilizing the image, the method has the advantages of greatly reducing the false picking rate, being high in classification precision, being particularly easy to identify wet garbage, being high in classification efficiency, saving time and labor;
3) the method of the invention evaluates the quality of the garbage thrown by citizens, and the average single piece processing time of the device for processing the garbage thrown by citizens is calculated to evaluate the quality of the garbage classification before the garbage is thrown, so that the method is convenient for knowing the garbage classification condition before the citizens throw the garbage, and is convenient for management departments to reward the citizens with good garbage classification, or judge whether the propaganda education of the garbage classification is necessary to be further strengthened for the citizens.
Drawings
The invention is further illustrated by the following figures and examples.
Fig. 1 is a schematic flow chart of an intelligent garbage classification method according to an embodiment.
Fig. 2 is a schematic structural diagram of the intelligent garbage classification device.
Fig. 3 is a schematic structural view of a garbage inlet control mechanism.
Fig. 4 is a schematic structural diagram of the sorting mechanism.
Fig. 5 is a schematic structural diagram of the transfer mechanism.
Fig. 6 is a schematic structural diagram of a neural network model according to an embodiment.
Description of reference numerals: the garbage
Detailed Description
The intelligent garbage classification method combining vision and touch utilizes a sorting head to grab garbage on a garbage classification panel, a touch sensor is arranged on the inner side of a grab of the sorting head, the sorting head is moved above the garbage to collect images of the garbage, the touch sensor obtains touch data of the garbage when the sorting head grabs the garbage, a controller of the sorting head adopts a neural network model as a classifier, the grabbed garbage is identified and classified according to the images and the touch data of the garbage, and then the sorting head puts the grabbed garbage into a corresponding garbage classification area according to the classification of the garbage.
The intelligent garbage classification method comprises the steps of spreading and gathering garbage thrown into a citizen once, then sorting the garbage, setting a sorting interval according to the grabbing range of a gripper of a sorting head, sorting the garbage one by one, then putting the garbage into a corresponding classification area, collecting head images of the citizen before starting sorting to confirm the identity of the citizen, and evaluating the quality of the garbage thrown into the citizen after sorting and classifying the garbage thrown into the citizen once, as shown in figure 1,
step 1: moving the picking spacing in the Y-axis direction;
step 2: moving the picking spacing in the X-axis direction;
and step 3: collecting image data of the garbage under the garbage sorting head;
and 4, step 4: the sorting head grabs garbage to obtain touch data;
and 5: the classifier classifies the captured garbage according to the image and the tactile data of the garbage;
step 6: according to the classification of the garbage in the
and 7: judging whether the sorting in the X-axis direction is finished or not;
step 7.1: if the picking in the X-axis direction is not finished, executing the step 2:
step 7.2: if the sorting in the X-axis direction is finished, executing a step 8;
and 8: judging whether the sorting in the Y-axis direction is finished or not;
step 8.1: if the sorting in the Y-axis direction is not finished, executing the
step 8.2: if the sorting in the Y-axis direction is completed, executing step 9;
and step 9: recording the sorting times of sorting heads in the garbage sorting process as the quantity of garbage thrown by citizens at a single time, recording the garbage sorting processing time after the citizens throw the garbage at a single time, dividing the garbage sorting processing time by the quantity of the garbage to obtain the average processing time of single garbage, and evaluating the quality of the garbage thrown by the citizens according to the average processing time of the unit garbage thrown by the citizens.
As shown in fig. 2-5, the intelligent garbage classification device of the intelligent garbage classification method combining visual sense and tactile sense comprises a
As shown in fig. 3, the
In the garbage classification process, before the garbage on the
As shown in fig. 4, the
One end of a Y-axis sliding table 304 of the
When the controller controls the
As shown in fig. 5, the conveying
In
- 上一篇:一种医用注射器针头装配设备
- 下一篇:智能垃圾分类装置及智能垃圾分类方法