阅读说明：本技术 一种工业机械臂智能化路径规划装置及方法 (Intelligent path planning device and method for industrial mechanical arm ) 是由 刘湘玲 刘孟祥 旷水章 匡增彧 王虎 于 2020-12-16 设计创作，主要内容包括：本发明涉及工业机械臂领域,具体涉及一种工业机械臂智能化路径规划装置及方法,包括加工工件、视觉系统、智能控制系统、机械臂、工作站,所述视觉系统包括视觉模块、A/D转换器和快速标定模块；所述智能控制系统包括图像学习模块、路径规划模块、坐标转换模块、逆运动学模块、电机控制模块,所述工作站模块包括工作服务器和显示器；所述机械臂模块包括基座、N个关节、与所述关节匹配的N个电机,以及加工装置。所述视觉系统被配置为通过视觉模块采集加工工件表面信息,通过三维视觉技术将加工工件的型面三维信息形成点云,再形成三维型面数据；所述智能控制系统被配置为基于所述视觉系统采集的信息控制机械臂的动作；所述工作服务器被配置用于机械臂参数调节,其内置机械臂控制平台软件,用于控制机械平台,显示器用于显示可控参数；该工业机械臂提高了现有机器人工作的自动化与加工效率、精度,实现了机械臂路径规划的智能化。(The invention relates to the field of industrial mechanical arms, in particular to an intelligent path planning device and method for an industrial mechanical arm, which comprises a processing workpiece, a vision system, an intelligent control system, a mechanical arm and a workstation, wherein the vision system comprises a vision module, an A/D converter and a quick calibration module; the intelligent control system comprises an image learning module, a path planning module, a coordinate conversion module, an inverse kinematics module and a motor control module, and the workstation module comprises a work server and a display; the mechanical arm module comprises a base, N joints, N motors matched with the joints and a processing device. The vision system is configured to acquire surface information of a machined workpiece through a vision module, form point cloud on the three-dimensional information of the profile of the machined workpiece through a three-dimensional vision technology, and then form three-dimensional profile data; the intelligent control system is configured to control the action of the mechanical arm based on the information collected by the vision system; the working server is configured for mechanical arm parameter adjustment, mechanical arm control platform software is arranged in the working server and used for controlling the mechanical platform, and the display is used for displaying controllable parameters; the industrial mechanical arm improves the automation, the processing efficiency and the precision of the existing robot work, and realizes the intellectualization of mechanical arm path planning.)

1. An intelligent path planning device for an industrial mechanical arm comprises a processing workpiece, a vision system, an intelligent control system, a mechanical arm and a workstation;

the vision system comprises a vision module, an A/D converter and a quick calibration module;

the intelligent control system comprises an image learning module, a path planning module, a coordinate conversion module, an inverse kinematics module and a motor control module,

the workstation comprises a work server and a display;

the mechanical arm comprises a base, N joints, N motors matched with the N joints and a processing device;

the method is characterized in that:

the vision system is configured to acquire surface information of a machined workpiece through a vision module, form point cloud on the three-dimensional information of the profile of the machined workpiece through a three-dimensional vision technology, and then form three-dimensional profile data; specifically, the three-dimensional profile data is transmitted to a rapid calibration module through an A/D converter, the rapid calibration module compares the three-dimensional profile data with pre-stored processing model profile data, and converts the difference between the three-dimensional profile data and the pre-stored processing model profile data into a pre-processed sample set;

the intelligent control system is configured to control the action of the mechanical arm based on the information acquired by the vision system, specifically, the output end of the rapid calibration module is connected with the input end of the image learning module, the sample set is used as input to the image learning module, and the judgment is made on the sample set through an image recognition model built in the image learning module; the output end of the image learning module is connected with the input end of the path planning module, the path planning module forms a new motion path based on the judged information and outputs the new motion path to the coordinate conversion module, the coordinate conversion module compares the new motion path with the motion path processed last time and calculates a compensation value of a processing curve, and the compensation value is transmitted to the inverse kinematics module to form joint motion compensation quantity; the joint motion compensation amount is transmitted to a motor control module, and a compensation control signal is formed through the motor control module;

the working server is configured for mechanical arm parameter adjustment, mechanical arm control platform software is arranged in the working server and used for controlling the mechanical platform, and the display is used for displaying controllable parameters;

the mechanical arm module is configured to execute a mechanical arm movement path, the base is provided with N motors and N joints, the N motors are connected with the N joints in a one-to-one correspondence mode, the N motors are connected to the output end of the motor control module, and the motors and the joints are controlled to move through electromagnetic signals sent by the motor control module, so that the change of the torque, the rotating speed and the rotating angle of the mechanical arm is realized.

2. The intelligent path planning device for industrial robot arm as claimed in claim 1, wherein: the rapid calibration module is calibrated by adopting a C + + language, and the specific calibration formula is as follows: sigma L ═ sigma L₁-L₂Wherein L is₁For pre-stored working spline functions, L₂And processing a spline function for the actually processed point cloud data.

3. The intelligent path planning device for industrial robot arm as claimed in claim 1 or 2, wherein: and a deep neural network is arranged in the image learning module to judge the sample set, and the development language of the image learning module is python.

4. The intelligent path planning device for industrial robot arm as claimed in claim 1 or 2, wherein: the processing curve compensation control signal calculation formula is as follows: Δ J ═ J^-1∑L₁-L₂Where Δ J is the compensation signal, J^-1For machining coordinates and relationsThe Jacobian inverse matrix of the nodal coordinates.

5. The intelligent path planning device for industrial robot arm as claimed in claim 1 or 2, wherein: the number N of the motors and the joints is 6, and the compensation control signal control rule is as follows: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

6. The intelligent path planning device for industrial robot arm as claimed in claim 1 or 2, wherein: the processing workpiece unit is a metal workpiece; the motors are all alternating current brushless servo motors; the electromagnetic control signals of the mechanical arm adopt step pulse signals; the vision module is a CCD or an industrial rapid camera; the machining device is preferably a tool.

7. An intelligent path planning method for an industrial mechanical arm is characterized by comprising the following steps:

step S1, image acquisition: shooting the workpiece processing surface by using a CCD camera, converting an image signal into point cloud data, and generating a real-time three-dimensional profile;

step S2, image calibration: superposing the generated three-dimensional molded surface with a processing benchmark of a preset processing model molded surface, and calculating the difference of a processing spline curve between the real-time molded surface and the preset molded surface to form sample data;

step S3, data learning: sending the sample data to an image learning module, training the sample data by using an RNN deep learning module, outputting a profile difference value between a shot image and an input model, judging whether the profile difference value exceeds a set threshold value, and if so, jumping to the step S7; if not, jumping to step S4;

step S4, path planning: forming a motion path for the profile data corresponding to the sample data, and calculating the compensation quantity of the processing path based on the difference between the real-time processing profile motion path and a preset path;

step S5, inverse kinematics planning: converting the machining path compensation quantity into motion compensation values of all joints through an inverse kinematics control algorithm built in the mechanical arm, and transmitting the motion compensation values to a motor control module;

step S6, motor control: converting the obtained compensation quantity of each joint into an electromagnetic signal, transmitting the electromagnetic signal to each motor unit, and controlling a motor to compensate the set path signal;

in step S7, control ends.

8. The intelligent path planning method for the industrial robot arm as claimed in claim 7, wherein: the number of learning samples of the RNN deep learning algorithm in step S3 is 10000.

9. The intelligent path planning method for the industrial robot arm as claimed in claim 7, wherein: the inverse kinematics control algorithm in the step S5 is realized by a built-in module in a CAM control platform of the mechanical arm; the number of the motors and the joints is 6, and the control rule of the compensation control signal is as follows: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

10. The intelligent path planning method for the industrial robot arm as claimed in claim 7, wherein: the processing curve compensation signal calculation formula is as follows: Δ J ═ J^-1∑L₁-L₂Where Δ J is the compensation signal, J^-1Is the Jacobian inverse matrix of the machining coordinate and the joint coordinate.

Technical Field

The invention relates to the field of industrial mechanical arms, in particular to an intelligent path planning device and method for an industrial mechanical arm.

Background

An industrial robot arm is defined as "its manipulator is automatically controlled, reprogrammable, versatile, and can program more than 3 axes. It may be stationary or mobile. In industrial automation applications. A manipulator is also defined as "a machine whose mechanism is generally composed of a series of members hinged or sliding with respect to each other. It usually has several degrees of freedom for grasping or moving an object (tool or workpiece). At present, industrial mechanical arms are more and more widely applied in the field of machining, particularly in the automobile machining industry. At present, the path planning of an industrial mechanical arm basically adopts a manual debugging mode, after a processing path is determined, inverse kinematics analysis is carried out on the mechanical arm, the processing steps are decomposed into links, and then the movement path is changed. However, as a result of manual debugging, the industrial production efficiency is reduced, the movement precision is reduced, and even in the debugging process, the superposition of processing errors is caused, which causes the occurrence of inferior-quality products and waste products, thereby affecting the processing precision and efficiency.

Disclosure of Invention

The invention aims to provide an intelligent path planning device and method for an industrial mechanical arm, which can improve the automation, the processing efficiency and the processing precision of the existing robot and realize the intellectualization of the path planning of the mechanical arm.

The invention specifically adopts the following technical scheme to realize the technical purpose:

an intelligent path planning device for an industrial mechanical arm comprises a processing workpiece, a vision system, an intelligent control system, a mechanical arm and a workstation;

the vision system comprises a vision module, an A/D converter and a quick calibration module;

the intelligent control system comprises an image learning module, a path planning module, a coordinate conversion module, an inverse kinematics module and a motor control module,

the workstation comprises a work server and a display;

the mechanical arm comprises a base, N joints, N motors matched with the joints and a processing device;

the vision system is configured to acquire surface information of a machined workpiece through a vision module, form point cloud on the three-dimensional information of the profile of the machined workpiece through a three-dimensional vision technology, and then form three-dimensional profile data; specifically, the three-dimensional profile data is transmitted to a rapid calibration module through an A/D converter, the rapid calibration module compares the three-dimensional profile data with pre-stored processing model profile data, and converts the difference between the three-dimensional profile data and the pre-stored processing model profile data into a pre-processed sample set;

the intelligent control system is configured to control the action of the mechanical arm based on the information acquired by the vision system, specifically, the output end of the rapid calibration module is connected with the input end of the image learning module, the sample set is used as input to the image learning module, and the judgment is made on the sample set through an image recognition model built in the image learning module; the output end of the image learning module is connected with the input end of the path planning module, the path planning module forms a new motion path based on the judged information and outputs the new motion path to the coordinate conversion module, the coordinate conversion module compares the new motion path with the motion path processed last time and calculates a compensation value of a processing curve, and the compensation value is transmitted to the inverse kinematics module to form joint motion compensation quantity; the joint motion compensation amount is transmitted to a motor control module, and a compensation control signal is formed through the motor control module;

the working server is configured for mechanical arm parameter adjustment, mechanical arm control platform software is arranged in the working server and used for controlling the mechanical platform, and the display is used for displaying controllable parameters;

the mechanical arm module is configured to execute a mechanical arm movement path, the base is provided with N motors and N joints, the N motors are connected with the N joints in a one-to-one correspondence mode, the N motors are connected to the output end of the motor control module, and the motors and the joints are controlled to move through electromagnetic signals sent by the motor control module, so that the change of the torque, the rotating speed and the rotating angle of the mechanical arm is realized.

In some embodiments, the fast calibration module performs calibration using a C + + language, and the specific calibration formula is: sigma L ═ sigma L₁-L₂Wherein L is₁For pre-stored working spline functions, L₂And processing a spline function for the actually processed point cloud data.

In some embodiments, the image learning module has a built-in deep neural network that makes a determination on the sample set, the image learning module having a development language of python.

In some embodiments, the process curve compensation control signal is calculated by the formula: Δ J ═ J^-1∑L₁-L₂Where Δ J is the compensation signal, J^-1Is the Jacobian inverse matrix of the machining coordinate and the joint coordinate.

In some embodiments, the number N of the motors and joints is 6, and the compensation control signal control rule is: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

In some embodiments, the processing workpiece unit is a metal part or a non-metal part, such as an alloy, iron, copper, plastic, or the like; the motors are all alternating current brushless servo motors; the electromagnetic control signals of the mechanical arm adopt step pulse signals; the vision module is a CCD or an industrial rapid camera; the machining device is preferably a tool.

The invention also comprises a processing method, and the specific scheme is as follows:

the intelligent path planning method for the industrial mechanical arm comprises the following steps:

step S1, image acquisition: shooting the workpiece processing surface by using a CCD camera, converting an image signal into point cloud data, and generating a real-time three-dimensional profile;

step S2, image calibration: superposing the generated three-dimensional molded surface with a processing benchmark of a preset processing model molded surface, and calculating the difference of a processing spline curve between the real-time molded surface and the preset molded surface to form sample data;

step S3, data learning: sending the sample data to an image learning module, training the sample data by using an RNN deep learning module, outputting a profile difference value between a shot image and an input model, judging whether the profile difference value exceeds a set threshold value, and if so, jumping to the step S7; if not, jumping to step S4;

step S4, path planning: forming a motion path for the profile data corresponding to the sample data, and calculating the compensation quantity of the processing path based on the difference between the real-time processing profile motion path and a preset path;

step S5, inverse kinematics planning: converting the machining path compensation quantity into motion compensation values of all joints through an inverse kinematics control algorithm built in the mechanical arm, and transmitting the motion compensation values to a motor control module;

step S6, motor control: converting the obtained compensation quantity of each joint into an electromagnetic signal, transmitting the electromagnetic signal to each motor unit, and controlling a motor to compensate the set path signal;

in step S7, control ends.

Preferably, the number of learning samples of the RNN deep learning algorithm in step S3 is 10000.

Preferably, the inverse kinematics control algorithm in step S5 is implemented by using a built-in module in a CAM control platform provided in the robot arm; the number of the motors and the joints is 6, and the control rule of the compensation control signal is as follows: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

Preferably, the processing curve compensation signal calculation formula is as follows: Δ J ═ J^-1∑L₁-L₂Wherein, Delta J is a compensation signal, and J-1 is a Jacobian inverse matrix of the processing coordinate and the joint coordinate.

The invention has the beneficial effects that: this industry arm is through the profile of automatic acquisition work piece, through decomposing profile information, when the processing profile surpassed the threshold value with the benchmark difference of setting for, can control the action of manipulator motor and joint and revise the processing action, does not need the manual work to debug, so can guarantee processingquality, very big improvement processingquality and machining efficiency, be applicable to the high quality processing of all kinds of work pieces.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.

Fig. 1 is a hardware scheme diagram of an intelligent path planning device for an industrial robot arm provided by the invention;

fig. 2 is a flowchart of an intelligent path planning method for an industrial robot arm provided by the invention.

Detailed Description

The technical scheme of the invention is further explained by the specific implementation mode in combination with the attached drawings.

Wherein the showings are for the purpose of illustration only and are shown by way of illustration only and not in actual form, and are not to be construed as limiting the present patent; to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product; it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.

The invention specifically adopts the following technical scheme to realize the technical purpose:

as shown in fig. 1, an intelligent path planning device for an industrial robot arm includes a processing workpiece, a vision system, an intelligent control system, a robot arm, and a workstation;

the vision system comprises a vision module, an A/D converter and a quick calibration module;

the intelligent control system comprises an image learning module, a path planning module, a coordinate conversion module, an inverse kinematics module and a motor control module,

the workstation comprises a work server and a display;

the mechanical arm comprises a base, N joints, N motors matched with the joints and a processing device;

the vision system is configured to acquire surface information of a processing workpiece through a vision module, form a point cloud of three-dimensional information of a profile of the processing workpiece through a three-dimensional vision technology, and form three-dimensional profile data, wherein the point cloud data refers to a set of vectors in a three-dimensional coordinate system, the vectors are usually expressed in the form of X, Y and Z three-dimensional coordinates, and are generally mainly used for representing the shape of an external surface of an object; specifically, the three-dimensional profile data is transmitted to a rapid calibration module through an A/D converter, the rapid calibration module compares the three-dimensional profile data with pre-stored processing model profile data, and converts the difference between the three-dimensional profile data and the pre-stored processing model profile data into a pre-processed sample set;

the intelligent control system is configured to control the action of the mechanical arm based on the information acquired by the vision system, specifically, the output end of the rapid calibration module is connected with the input end of the image learning module, the sample set is used as input to the image learning module, and the judgment is made on the sample set through an image recognition model built in the image learning module; the output end of the image learning module is connected with the input end of the path planning module, the path planning module forms a new motion path based on the judged information and outputs the new motion path to the coordinate conversion module, the coordinate conversion module compares the new motion path with the motion path processed last time and calculates a compensation value of a processing curve, and the compensation value is transmitted to the inverse kinematics module to form joint motion compensation quantity; the joint motion compensation amount is transmitted to a motor control module, and a compensation control signal is formed through the motor control module;

the working server is configured for mechanical arm parameter adjustment, mechanical arm control platform software is arranged in the working server and used for controlling the mechanical platform, and the display is used for displaying controllable parameters;

the mechanical arm module is configured to execute a mechanical arm movement path, the base is provided with N motors and N joints, the N motors are connected with the N joints in a one-to-one correspondence mode, the N motors are connected to the output end of the motor control module, and the motors and the joints are controlled to move through electromagnetic signals sent by the motor control module, so that the change of the torque, the rotating speed and the rotating angle of the mechanical arm is realized.

In some embodiments, the fast calibration module performs calibration using a C + + language, and the specific calibration formula is: sigma L ═ sigma L₁-L₂Wherein L is₁For pre-stored working spline functions, L₂And processing a spline function for the actually processed point cloud data.

In some embodiments, the image learning module has a built-in deep neural network that makes a determination on the sample set, the image learning module having a development language of python.

In some embodiments, the process curve compensation control signal is calculated by the formula: Δ J ═ J^-1∑L₁-L₂Where Δ J is the compensation signal, J^-1Is the Jacobian inverse matrix of the machining coordinate and the joint coordinate.

In some embodiments, the number N of the motors and joints is 6, and the compensation control signal control rule is: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

In some embodiments, the processing workpiece unit is a metal part or a non-metal part, such as an alloy, iron, copper, plastic, or the like; the motors are all alternating current brushless servo motors; the electromagnetic control signals of the mechanical arm adopt step pulse signals; the vision module is a CCD or an industrial rapid camera; the machining device is preferably a tool.

In some embodiments, for example, as the tool wears, the tool size decreases, the profile of the workpiece increases or decreases, and if the size change exceeds a certain range, the part is unqualified, and the size change should be avoided or reduced as much as possible.

As shown in fig. 2, the present invention further includes a processing method, and the specific scheme is as follows:

the intelligent path planning method for the industrial mechanical arm comprises the following steps:

step S1, image acquisition: shooting the workpiece processing surface by using a CCD camera, converting an image signal into point cloud data, and generating a real-time three-dimensional profile;

step S2, image calibration: superposing the generated three-dimensional molded surface with a processing benchmark of a preset processing model molded surface, and calculating the difference of a processing spline curve between the real-time molded surface and the preset molded surface to form sample data;

step S3, data learning: sending the sample data to an image learning module, training the sample data by using an RNN deep learning module, outputting a profile difference value between a shot image and an input model, judging whether the profile difference value exceeds a set threshold value, and if so, jumping to the step S7; if not, jumping to step S4;

step S4, path planning: forming a motion path for the profile data corresponding to the sample data, and calculating the compensation quantity of the processing path based on the difference between the real-time processing profile motion path and a preset path;

step S5, inverse kinematics planning: converting the machining path compensation quantity into motion compensation values of all joints through an inverse kinematics control algorithm built in the mechanical arm, and transmitting the motion compensation values to a motor control module;

step S6, motor control: converting the obtained compensation quantity of each joint into an electromagnetic signal, transmitting the electromagnetic signal to each motor unit, and controlling a motor to compensate the set path signal;

in step S7, control ends.

Preferably, the number of learning samples of the RNN deep learning algorithm in step S3 is 10000.

Preferably, the inverse kinematics control algorithm in step S5 is implemented by using a built-in module in a CAM control platform provided in the robot arm; the number of the motors and the joints is 6, and the control rule of the compensation control signal is as follows: the joint 1 is a longitudinal compensation signal, the joint 2 is a transverse compensation signal, the joint 3 is a rotation compensation signal, and the joints 4 to 6 are compensation positions of a tail end path.

Preferably, the processing curve compensation signal calculation formula is as follows: Δ J ═ J^-1∑L₁-L₂Wherein, Delta J is a compensation signal, and J-1 is a Jacobian inverse matrix of the processing coordinate and the joint coordinate.

The invention has the beneficial effects that: this industry arm is through the profile of automatic acquisition work piece, through decomposing profile information, when the processing profile surpassed the threshold value with the benchmark difference of setting for, can control the action of manipulator motor and joint and revise the processing action, does not need the manual work to debug, so can guarantee processingquality, very big improvement processingquality and machining efficiency, be applicable to the high quality processing of all kinds of work pieces.

It should be understood that the above-described embodiments are merely preferred embodiments of the invention and the technical principles applied thereto. It will be understood by those skilled in the art that various modifications, equivalents, changes, and the like can be made to the present invention. However, such variations are within the scope of the invention as long as they do not depart from the spirit of the invention. In addition, certain terms used in the specification and claims of the present application are not limiting, but are used merely for convenience of description.