Novel peucedanum praeruptorum weeding machine based on machine vision and convolutional neural network algorithm

文档序号:1027372 发布日期:2020-10-30 浏览:42次 中文

阅读说明:本技术 一种新型基于机器视觉和卷积神经网络算法的前胡除草机 (Novel peucedanum praeruptorum weeding machine based on machine vision and convolutional neural network algorithm ) 是由 曹成茂 王二锐 李琼 罗坤 彭美乐 周润东 孙燕 方梁菲 于 2020-07-24 设计创作,主要内容包括:本发明涉及一种新型基于机器视觉和卷积神经网络算法的前胡除草机,包括运动控制系统、图像处理目标检测系统、DELTA机械臂、除草机构。运动控制系统,用于控制机器人运动,转向与调速;图像处理系统,摄像头采集实时图像信息传递给处理器进行图像识别,采用TENSORFLOW特征提取目标检测的卷积神经网络进行前胡与杂草的检测、分类和定位,根据条播的前胡中心位置信息,通过最小二乘法拟合路径进行田间路径规划导航,TENSORFLOW特征提取目标检测算法标定杂草坐标信息,配合DELTA三轴机械臂、除草机构实现将杂草除去。该前胡除草机结构紧凑,布局合理、坚固耐用,工作效率高,节约劳力,实用性强,适合农作物株间除草。(The invention relates to a novel peucedanum praeruptorum dunn weeder based on machine vision and a convolutional neural network algorithm, which comprises a motion control system, an image processing target detection system, a DELTA mechanical arm and a weeding mechanism. The motion control system is used for controlling the robot to move, turn and regulate the speed; in the image processing system, a camera acquires real-time image information and transmits the real-time image information to a processor for image recognition, a convolutional neural network for detecting the TENSOFLOW characteristic extraction target is adopted for detecting, classifying and positioning the peucedanum and the weeds, a path is fitted by a least square method for planning and navigating the field path according to the center position information of the peucedanum for drilling, a TENSOFLOW characteristic extraction target detection algorithm calibrates the coordinate information of the weeds, and the weeds are removed by matching with a DELTA triaxial mechanical arm and a weeding mechanism. The peucedanum praeruptorum weeding machine is compact in structure, reasonable in layout, firm, durable, high in working efficiency, labor-saving, strong in practicability and suitable for weeding among crop plants.)

1. A novel peucedanum weeder based on machine vision and convolution neural network algorithm is characterized in that: the whiteflower hogfennel root weeder comprises three parts, namely a motion control system, an image processing target detection system and a weeding mechanism, and also comprises a battery for charging and discharging;

the motion control system comprises a frame (1), a damping device (11), wheels (12), a brushless direct current motor (13), an STM32 motion controller, a ZM6615 direct current brushless driver and a Hall sensor; the support frame of each wheel (12) is provided with a damping device (11), and a brushless direct current motor (13) is used as a mobile power output and is electrically connected with an STM32 motion controller through a ZM6615 direct current brushless driver;

the image processing target detection system comprises an electrical cabinet (2), an industrial camera (3) and an industrial computer; an electrical equipment motor driving circuit, image processing hardware and an MCU singlechip are integrated in the electrical cabinet (2), and the image processing target detection system realizes image target detection and positioning algorithm based on a convolutional neural network algorithm of TENSORFLOW deep learning;

the weeding mechanism comprises a speed reducer, a DELTA mechanical arm (4), a mechanical arm motor, a mechanical driving arm (42), a ball hinge (43), a mechanical driven arm (44), a weeding motor (45), a movable platform (46) and a weeding cutter (47); DELTA arm (4) are installed under frame (1), and the arm motor adopts three 57 step motor (41), and each other becomes 120, motor output torque 2.2N/M, and mechanical master arm (42) link to each other with the reduction gear axle, and mechanical master arm (42) and mechanical slave arm (44) all link to each other through ball hinge (43) with moving platform (46), and install on moving platform (46) weeding motor (45), and weeding cutter (47) are installed on weeding motor's (45) epaxial.

2. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the STM32 motion controller adopts STM32F407VET6 microcontroller inside to be provided with STM32F407VET6 singlechip, receives the weeds position information of industrial computer transmission, through HBS57 closed loop driver and STM32 motion controller electric connection.

3. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the four wheels (12) are respectively provided with a set of independent vibration damper (11), the driving motors of the wheels (12) adopt brushless direct current motors (13), an encoder is used for forming a closed loop feedback system, the rotating speed of the motor is monitored in real time to control the speed of the vehicle so as to cooperate with a weeding mechanism to complete weeding, the four wheels (12) are respectively provided with one brushless direct current motor (13), the differential speed and the differential reverse direction can be applied during steering, and the differential reverse direction can realize pivot steering.

4. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the 57 stepping motor (41) is connected with the mechanical driving arm (42) through a speed reducer with the speed reduction ratio of 10:1 to improve output torque, the mechanical driving arm (42) is made of aluminum alloy, the mechanical driven arm (44) is made of a high-strength carbon fiber pipe, and the mechanical driving arm (42) is connected with the mechanical driven arm (44) through a ball hinge (43).

5. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the weeding cutter (47) adopts a self-sharpening blade, is arranged on a movable platform (46) of the DELTA mechanical arm (4), and can rotate at high speed to cut off weeds along with the change of the position of the DELTA mechanical arm (4) at any time.

6. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the machine vision of the image processing target detection system adopts a high-definition industrial camera (3) to acquire real-time image information, and a TENSOFLOW frame convolutional neural network YoloV4 target detection algorithm is used for identifying weeds and transmitting results to an actuating mechanism to realize a weeding function;

the convolutional neural network adopts a target detection convolutional network algorithm of feature extraction, the trunk feature extraction network adopts CSPDACKNET53, the feature extraction capability is enhanced by using SPP and PANET structures, the MOSAIC data is enhanced, and CIOU is used as LOSS regression and MISH activation functions; the input image is a 416 × 416 × 3RGB three-channel color picture, and pixel coordinate values, scores, and classifications of the detection target are output.

7. The novel machine-vision and convolutional neural network algorithm-based peucedanum machine of claim 6, wherein: the image processing target detection system detects the center coordinates of the detected peucedanum of the drill by adopting a target detection deep learning algorithm and fits a lane line by adopting a least square method; in the moving process of the robot, if the number of missing seedlings on one side is small, path fitting is not influenced; when the number of the missing seedlings on one side is large, the path can be planned according to the plants on the other side, so that the autonomous navigation of the weeding machine is realized, and the weeding machine walks among the planted peucedanum praeruptorum plants.

8. The novel machine-vision and convolutional neural network algorithm-based peucedanum machine of claim 7, wherein: the image processing target detection system transmits images acquired by the industrial camera (3) to an industrial computer in real time, then the trained model industrial computer is used for fitting an ideal path, and then the industrial computer sends the planned path to an STM32 motion controller in a USB-to-serial port mode;

the STM32 motion controller sends a pulse modulation (PWM) pulse signal to a signal control end of the ZM6615 direct-current brushless driver, and the signal control end is used for driving two front wheels of the whiteflower hogfennel weeding machine, and the whiteflower hogfennel weeding machine realizes autonomous motion; when the current weed killer deviates, the rotating speed of the brushless direct current motors (13) on the two sides of the current weed killer is adjusted to adjust the moving direction, and meanwhile, the Hall sensor converts the rotating speed of the brushless direct current motors (13) into pulse signals and transmits the pulse signals to the STM32 motion controller for accurate steering control; the brushless direct current motor (13) and the STM32 motion controller are connected through a ZM6615 direct current brushless driver in the control process, and the STM32 motion controller outputs PWM pulse signals to control the speed and walk in the field through a motor driving circuit, so that the forward, turning and speed regulation are realized.

9. The novel machine vision and convolutional neural network algorithm-based peucedanum machine of claim 1, wherein: the image processing target detection system detects the position of weeds by adopting a deep learning algorithm, and performs sampling stacking through multiple convolution, pooling and stacking of residual edges; after deep network feature extraction, selecting a prediction box with the maximum score by adopting non-maximum inhibition, and finally outputting the position coordinate of the weeds; and calibrating the specific relation between the actual position coordinates and the pixel coordinates through the calibration plate, and determining the actual position of the coordinate point in the graph.

10. The novel machine-vision and convolutional neural network algorithm-based peucedanum machine of claim 9, wherein: the image processing target detection system transmits the image acquired by the industrial camera (3) to an industrial computer in real time, and then the trained model is used for detecting the target of the industrial computer to mark weeds and score conditions of a prediction frame;

calculating the actual spatial coordinates of the weeds through calibration, and then sending the weed position information to a controller-STM 32 motion controller of a DELTA mechanical arm (4) by an industrial computer in a USB-to-TTL serial port mode; the STM32 motion controller calculates and obtains the joint node for controlling the DELTA mechanical arm (4) by using the rotating angle of the 57 stepping motor (41) through the fed weed position information to realize the displacement motion of the weeding mechanism. The MOTION of the DELTA mechanical arm (4) adopts a space interpolation algorithm to realize a space arbitrary moving track, and adopts an ADEPT MOTION portal MOTION path for avoiding mistakenly removing the peucedanum and solving the problem of mechanism vibration during cross-region weeding.

Technical Field

The invention relates to a field weeding machine for peucedanum praeruptorum, in particular to a novel weeding machine for peucedanum praeruptorum based on machine vision and a convolutional neural network algorithm.

Background

Radix peucedani is a Chinese medicinal material with the functions of depressing qi, resolving phlegm, dispersing wind and clearing heat, and its rhizome is used as medicine. The rhizome traditional Chinese medicinal materials cannot use herbicides, fertilizers and pesticides in the planting process, otherwise the quality and the pesticide effect of the rhizome traditional Chinese medicinal materials are affected, and even the rhizome traditional Chinese medicinal materials have opposite effects. In addition, the labor cost is increased, the labor is difficult, the labor is expensive, the large-scale production is difficult, and the increase of the income of medical farmers is seriously restricted. The manual weeding consumes time and labor, the working efficiency is very low, and the cost required by the manual weeding is high every year. Aiming at solving the problem of 'inorganic availability' in the key link of the current planting of the peucedanum praeruptorum.

The traditional mechanical weeding mainly aims at weeding among crop rows, has larger weeding error, can not effectively remove weeds, and can not effectively remove weed among plants, so that the weeding of the peucedanum praeruptorum is still a big problem. The peucedanum praeruptorum weeding also has the characteristic that weeding operation is mainly concentrated in the seedling stage of the peucedanum praeruptorum, and when seedlings grow, weeds cannot influence the growth of the seedlings, so that weeding in the seedling stage is completed.

The convolutional neural network has obvious advantages in target detection. With the development of artificial intelligence technology, robots are increasingly designed and applied in the field of agricultural science. The invention designs the peucedanum root weeder based on the convolutional neural network deep learning algorithm, the deep learning algorithm based on target detection is adopted, the weeding structure adopts a four-wheel type frame structure, and the weeding mode adopts mechanical weeding.

Disclosure of Invention

The invention provides a weeding machine based on a machine vision technology and a neural network algorithm target positioning algorithm, wherein a convolutional neural network target detection algorithm is adopted to identify and distinguish peucedanum praeruptorum and weeds, so that the identification precision is effectively improved. The weed position information is transmitted to the actuating mechanism for control through serial port communication, the requirement of quick reaction under working conditions is met by adopting a Delta parallel mechanical arm with quick reaction, and the execution precision of the whole machine is guaranteed to be +/-1 mm, and the integral accuracy is more than or equal to 90%.

In order to solve the problems, the invention adopts the following technical scheme to realize:

a novel whiteflower hogfennel root weeder based on machine vision and a convolutional neural network algorithm comprises a motion control system, an image processing target detection system and a weeding mechanism, and also comprises a battery for charging and discharging, wherein the battery adopts a lithium battery, so that the electric quantity is large, and the endurance time is long; the motion control system comprises a frame, a damping device, wheels, a brushless direct current motor, an STM32 motion controller, a ZM6615 direct current brushless driver and a Hall sensor; the support frame of each wheel is provided with a damping device, and the brushless direct current motor is used as mobile power output and is electrically connected with the STM32 motion controller through a ZM6615 direct current brushless driver; the image processing target detection system comprises an electrical cabinet, an industrial camera and an industrial computer; the electrical cabinet is internally integrated with an electrical equipment motor driving circuit, image processing hardware and an MCU (microprogrammed control unit) singlechip, and the image processing target detection system realizes image target detection and positioning algorithm based on a TENSORFLOW deep learning convolutional neural network algorithm; the weeding mechanism comprises a speed reducer, a DELTA mechanical arm, a mechanical arm motor, a mechanical driving arm, a ball hinge, a mechanical driven arm, a weeding motor, a movable platform and a weeding cutter; DELTA arm is installed under the frame, and the arm motor adopts three 57 step motor, and each other becomes 120, motor output torque 2.2N/M, and mechanical driving arm links to each other with the reduction gear axle, and mechanical driving arm and mechanical driven arm all link to each other through the ball hinge with moving the platform, and the weeding motor is installed on moving the platform, and the weeding cutter is installed epaxially at the weeding motor.

Further, the STM32 motion controller adopts an STM32F407VET6 microcontroller, an STM32F407VET6 single chip microcomputer is arranged in the STM32F407VET6 microcontroller, receives weed position information transmitted by an industrial personal computer, and is electrically connected with the STM32 motion controller through an HBS57 closed-loop driver.

Furthermore, four wheels are respectively provided with a set of independent vibration damper, the driving motors of the wheels adopt brushless direct current motors, a closed loop feedback system is formed by using encoders, the rotating speed of the motors is monitored in real time to control the speed of the vehicle so as to cooperate with a weeding mechanism to complete weeding, the four wheels are respectively provided with one brushless direct current motor, the four wheels can be steered by applying differential speed and differential reverse steering, and the differential reverse steering can realize in-situ steering.

Furthermore, the mechanical arm adopts a three-axis parallel connection DELTA mechanical arm, and has the advantages of high movement speed, high response speed, flexibility, high precision and good stability, and can realize various complex movements; 57 the stepping motor is connected with the mechanical driving arm through a speed reducer with the speed reduction ratio of 10:1 to improve output torque, the mechanical driving arm is made of aluminum alloy, the mechanical driven arm is made of a high-strength carbon fiber tube, and the mechanical driving arm is connected with the mechanical driven arm through a ball hinge.

Furthermore, the weeding cutter adopts a self-sharpening blade, is arranged on a movable platform of the DELTA mechanical arm, changes the position along with the movement moment of the DELTA mechanical arm, and rotates at high speed to cut off weeds.

Furthermore, the machine vision of the image processing target detection system adopts a high-definition industrial camera to acquire real-time image information, a TENSOFLOW frame convolutional neural network YoloV4 target detection algorithm is used for identifying weeds, and the results are transmitted to an executing mechanism, so that the weeding function is realized; the convolutional neural network adopts a target detection convolutional network algorithm of feature extraction, the trunk feature extraction network adopts CSPDACKNET53, the feature extraction capability is enhanced by using SPP and PANET structures, the MOSAIC data is enhanced, and CIOU is used as LOSS regression and MISH activation functions; the input image is a 416 × 416 × 3RGB three-channel color picture, and pixel coordinate values, scores, and classifications of the detection target are output.

Further, the image processing target detection system detects the center coordinates of the detected peucedanum of the drill by adopting a target detection depth learning algorithm and fits a lane line by adopting a least square method; in the moving process of the robot, if the number of missing seedlings on one side is small, path fitting is not influenced; when the number of the missing seedlings on one side is large, the path can be planned according to the plants on the other side, so that the autonomous navigation of the weeding machine is realized, and the weeding machine walks among the planted peucedanum praeruptorum plants.

Further, after the image processing target detection system transmits the image acquired by the industrial camera to an industrial computer in real time, the trained model industrial computer is used for fitting an ideal path, and then the industrial computer sends the planned path to the STM32 motion controller in a USB-to-serial port mode; the STM32 motion controller sends a pulse modulation (PWM) pulse signal to a signal control end of the ZM6615 direct-current brushless driver, and the signal control end is used for driving two front wheels of the whiteflower hogfennel weeding machine, and the whiteflower hogfennel weeding machine realizes autonomous motion; when the current weed killer deviates, the rotating speed of the brushless direct current motors on the two sides of the peucedanum weed killer is adjusted to adjust the movement direction, and meanwhile, the Hall sensor converts the rotating speed of the brushless direct current motors into pulse signals and transmits the pulse signals to the STM32 movement controller for accurate steering control; the brushless direct current motor shown in the control process is connected with the STM32 motion controller through a ZM6615 direct current brushless driver, and the STM32 motion controller outputs PWM pulse signals to control the speed and walk in the field through a motor driving circuit, so that the advancing, turning and speed regulation are realized.

Further, the image processing target detection system detects the position of weeds by adopting a deep learning algorithm, and performs sampling stacking through multiple convolution, pooling and stacking of residual edges; after deep network feature extraction, selecting a prediction box with the maximum score by adopting non-maximum inhibition, and finally outputting the position coordinate of the weeds; and calibrating the specific relation between the actual position coordinates and the pixel coordinates through the calibration plate, and determining the actual position of the coordinate point in the graph.

Further, after the image processing target detection system transmits the image acquired by the industrial camera to an industrial computer in real time, the trained model is used for target detection by the industrial computer, and weeds and score conditions of a prediction frame are marked; calculating the actual spatial coordinates of the weeds through calibration, and then sending the weed position information to a controller-STM 32 motion controller of a DELTA mechanical arm by an industrial computer in a mode of converting USB into TTL serial ports; the STM32 motion controller calculates the weed position information to control the joint node of DELTA mechanical arm to realize the displacement motion of weeding mechanism by using the rotating angle of 57 stepping motors. The MOTION of the DELTA mechanical arm adopts a space interpolation algorithm to realize a space arbitrary moving track, and adopts an ADEPT MOTION portal MOTION path for avoiding mistakenly removing the peucedanum and solving the problem of mechanism vibration during cross-region weeding.

Compared with the prior art, the invention has the following beneficial effects: compared with the prior art, the invention adopts the four-wheel vehicle chassis to additionally arrange the damping device to be suitable for weeding on the terrain; the invention effectively identifies and distinguishes weeds and crops by using machine vision and digital image technology, thereby avoiding injuring the crops by mistake; the power is output by the direct current motor and is connected with the track driving wheel through the conveying device, and the weeding mechanical structure adopts a three-shaft parallel shaft mechanical arm to install a mechanical cutter for cutting weeds.

Drawings

Fig. 1 is a schematic diagram of the overall structure of a novel peucedanum weeder based on machine vision and a convolutional neural network algorithm.

Fig. 2 is a schematic diagram of a frame structure of a novel peucedanum weeding machine based on machine vision and a convolutional neural network algorithm.

FIG. 3 is a schematic structural diagram of a Delta mechanical arm in a weeding mechanism of a novel peucedanum weeding machine based on machine vision and a convolutional neural network algorithm.

Fig. 4 is a flow chart of a target detection system of the novel peucedanum weeder based on machine vision and a convolutional neural network algorithm.

Fig. 5 is a flow chart of the novel machine vision and convolutional neural network algorithm-based whiteflower hogfennel weeding machine.

Description of reference numerals: the device comprises a frame 1, a damping device 11, wheels 12, a brushless direct current motor 13, an electrical cabinet 2, an industrial camera 3, a DELTA mechanical arm 4, a stepping motor 41 to 57, a mechanical driving arm 42, a spherical hinge 43, a mechanical driven arm 44, a weeding motor 45, a movable platform 46 and a weeding cutter 47.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As shown in fig. 1, the novel machine vision and convolutional neural network algorithm-based whiteflower hogfennel weeding machine comprises three parts, namely a motion control system, an image processing target detection system and a weeding mechanism, and also comprises a battery for charging and discharging; the motion control system comprises a frame 1, a damping device 11, wheels 12, a brushless direct current motor 13, an STM32 motion controller, a ZM6615 direct current brushless driver and a Hall sensor; the support frame of each wheel 12 is provided with a damping device 11, and a brushless direct current motor 13 is used as mobile power output and is electrically connected with an STM32 motion controller through a ZM6615 direct current brushless driver; the image processing target detection system comprises an electrical cabinet 2, an industrial camera 3 and an industrial computer; an electrical equipment motor driving circuit, image processing hardware and an MCU singlechip are integrated in the electrical cabinet 2, and an image processing target detection system realizes an image target detection and positioning algorithm based on a TENSORFLOW deep learning convolutional neural network algorithm; the weeding mechanism comprises a speed reducer, a DELTA mechanical arm 4, a mechanical arm motor, a mechanical driving arm 42, a spherical hinge 43, a mechanical driven arm 44, a weeding motor 45, a movable platform 46 and a weeding cutter 47; DELTA mechanical arm 4 is installed under frame 1, and the mechanical arm motor adopts three 57 step motor 41, and each other becomes 120, motor output torque 2.2N/M, and mechanical master arm 42 links to each other with the reduction gear axle, and mechanical master arm 42 and mechanical slave arm 44 all link to each other through ball hinge 43 with moving platform 46, and weeding motor 45 installs on moving platform 46, and weeding cutter 47 installs on weeding motor 45's axle.

As shown in fig. 2, the STM32 motion controller adopts an STM32F407VET6 microcontroller, an STM32F407VET6 single chip microcomputer is arranged in the STM32F407VET6 microcontroller, receives weed position information transmitted by an industrial personal computer, and is electrically connected with the STM32 motion controller through an HBS57 closed-loop driver; four wheels 12 are respectively provided with a set of independent vibration damper 11, the driving motors of the wheels 12 adopt brushless direct current motors 13, a closed loop feedback system is formed by using encoders, the motor rotating speed is monitored in real time to control the vehicle speed so as to cooperate with a weeding mechanism to complete weeding, the four wheels 12 are respectively provided with one brushless direct current motor 13, the differential speed and the differential reverse direction can be applied during steering, and the differential reverse direction can realize in-situ steering.

As shown in fig. 3, 57 the stepping motor 41 is connected with the mechanical driving arm 42 through a speed reducer with the speed reduction ratio of 10:1 to improve output torque, the mechanical driving arm 42 is made of aluminum alloy, the mechanical driven arm 44 is made of high-strength carbon fiber tubes, the mechanical driving arm 42 is connected with the mechanical driven arm 44 through a ball hinge 43, the weeding cutter 47 is a self-sharpening blade and is arranged on a movable platform 46 of the DELTA mechanical arm 4, the position of the weeding cutter 47 of the self-sharpening blade is changed along with the movement time of the DELTA mechanical arm 4, and the weeding cutter 47 of the self-sharpening blade rotates at high speed to cut off weeds; the machine vision of the image processing target detection system adopts a high-definition industrial camera 3 to obtain real-time image information, and a TENSORFLOW frame convolutional neural network YoloV4 target detection algorithm is used for identifying weeds and transmitting results to an actuating mechanism to realize a weeding function;

the convolutional neural network adopts a target detection convolutional network algorithm of feature extraction, the trunk feature extraction network adopts CSPDACKNET53, the feature extraction capability is enhanced by using SPP and PANET structures, the MOSAIC data is enhanced, and CIOU is used as LOSS regression and MISH activation functions; the input image is a 416 x 3RGB three-channel color picture, and the pixel coordinate value, the score and the classification of the detection target are output;

the image processing target detection system detects the center coordinates of the detected peucedanum of the drill by adopting a target detection deep learning algorithm and fits a lane line by adopting a least square method; in the moving process of the robot, if the number of missing seedlings on one side is small, path fitting is not influenced; when the number of the missing seedlings on one side is large, the path can be planned according to the plants on the other side, so that the autonomous navigation of the weeding machine is realized, and the weeding machine walks among the planted peucedanum praeruptorum plants.

The image processing target detection system transmits the image acquired by the industrial camera 3 to an industrial computer in real time, then the trained model industrial computer is used for fitting an ideal path, and then the industrial computer sends the planned path to an STM32 motion controller in a USB-to-serial port mode; the STM32 motion controller sends a pulse modulation (PWM) pulse signal to a signal control end of the ZM6615 direct-current brushless driver, and the signal control end is used for driving two front wheels of the whiteflower hogfennel weeding machine, and the whiteflower hogfennel weeding machine realizes autonomous motion; when the current weed killer deviates, the rotating speed of the brushless direct current motor 13 on the two sides of the peucedanum weed killer is adjusted to adjust the moving direction, and meanwhile, the Hall sensor converts the rotating speed of the brushless direct current motor 13 into a pulse signal and transmits the pulse signal to the STM32 motion controller for accurate steering control; the brushless direct current motor 13 and the STM32 motion controller are connected through a ZM6615 direct current brushless driver in the control process, and the STM32 motion controller outputs PWM pulse signals to control the speed and walk in the field through a motor driving circuit, so that the advancing, turning and speed regulation are realized.

As shown in fig. 4 and 5, the image processing target detection system detects the position of the weeds by using a deep learning algorithm, and performs upsampling stacking through multiple convolution, pooling and stacking of residual edges; after deep network feature extraction, selecting a prediction box with the maximum score by adopting non-maximum inhibition, and finally outputting the position coordinate of the weeds; and calibrating the specific relation between the actual position coordinates and the pixel coordinates through the calibration plate, and determining the actual position of the coordinate point in the graph.

As shown in fig. 4 and 5, the image processing target detection system transmits the image acquired by the industrial camera 3 to the industrial computer in real time, and then the trained model is used for target detection by the industrial computer to mark weeds and score conditions of the prediction frame; calculating the actual spatial coordinates of the weeds through calibration, and then sending the weed position information to a controller-STM 32 motion controller of the DELTA mechanical arm 4 by the industrial computer in a USB-to-TTL serial port mode; the STM32 motion controller calculates the joint node of the control DELTA mechanical arm 4 by the received weed position information, and realizes the displacement motion of the weeding mechanism by using the rotating angle of the 57 stepping motor 41. The MOTION of the DELTA mechanical arm 4 adopts a space interpolation algorithm to realize a space arbitrary moving track, and adopts an ADEPT MOTION portal MOTION path for avoiding mistakenly removing the peucedanum and solving the problem of mechanism vibration during cross-region weeding.

As shown in fig. 4 and 5, in the workflow diagram of the whiteflower hogfennel weeding machine, when the weeding machine is powered on the planting field of the planted whiteflower hogfennel, the system starts to work, the industrial camera collects the video information of the farmland in real time and transmits the video information to the industrial computer, each frame of image is obtained through the computer processing, the system processes the image into a pixel image with the size of 416 × 416, then the image is input into a target detection depth learning frame based on TENSOFLOW to perform prediction classification and positioning, and the actual center coordinates of the whiteflower hogfennel and the weeds on the ground are obtained through the calibration of pixel coordinates and the actual physical coordinates. The industrial computer fits a travel route graph through a least square method according to the central coordinates of the peucedanum praeruptorum and sends the travel route graph to the STM32F407VET6 motion controller through a USB-to-serial port mode, and then the STM32F407VET6 motion controller outputs PWM pulse information to control the motion of the machine. Meanwhile, the industrial computer sends the position coordinates of the weeds to the STM32FF407VET6 controller of the DELTA mechanical arm 4, and then the STM32FF407VET6 controller of the DELTA mechanical arm 4 controls the three 57 stepping motors 41 to enable the DELTA mechanical arm 4 to reach the position of the weeds, thereby realizing the weeding function.

While only the preferred embodiments of the present invention have been described, it should be understood by those skilled in the art that the present invention is not limited to the above-described embodiments, and that various changes and modifications may be made without departing from the spirit and scope of the invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.

11页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:一种基于新能源的农业除草机

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!