阅读说明：本技术 一种三维立体曲面视觉引导对位系统及对位方法 (Three-dimensional curved surface vision guiding alignment system and alignment method ) 是由 王盼 蒋薇薇 张勇 刘中 于 2019-08-23 设计创作，主要内容包括：本发明公开了一种三维立体曲面视觉引导对位系统及对位方法,该系统包括设备壳体及设置在设备壳体中部的中部平台,中部平台包括相机模组、测距模组、控制模组和运动模组；本发明通过控制模组独立控制两套相机模组、测距模组和运动模组,利用相机模组和测距模组分别采集对位目标的二维坐标和高度坐标信息,实现三维立体曲面视觉引导对位,具有结构简单、对位精确度高、自动化性能优异等优点。(The invention discloses a three-dimensional curved surface vision guide alignment system and an alignment method, wherein the system comprises an equipment shell and a middle platform arranged in the middle of the equipment shell, and the middle platform comprises a camera module, a distance measurement module, a control module and a motion module; the three-dimensional curved surface vision-guided alignment system has the advantages of simple structure, high alignment accuracy, excellent automation performance and the like.)

1. a three-dimensional curved surface vision guiding alignment system is characterized by comprising an equipment shell (1) and a middle platform (2) arranged in the middle of the equipment shell (1);

an alignment platform (3) for performing multi-axis motion is arranged at the bottom of the equipment shell (1), and a first fixing device (4) for fixing a first alignment target is arranged on the alignment platform (3); a second fixing device (5) for fixing a second alignment target is arranged at the top of the equipment shell (1);

The middle platform (2) comprises a camera module (6), a distance measuring module (7), a control module and a motion module (8); camera module (6) and range finding module (7) are all installed on motion module (8), the control module is used for controlling motion module (8) to drive camera module (6) and gather the image data of first counterpoint target and/or second counterpoint target, handle the mark point two-dimensional coordinate data that obtains first counterpoint target and/or second counterpoint target to the image data of gathering, according to mark point two-dimensional coordinate data control motion module (8) drive range finding module (7) and gather the mark point height data of first counterpoint target and/or second counterpoint target, calculate the guide position according to mark point two-dimensional coordinate data and mark point height data, and convert guide position into counterpoint platform (3) control parameter, control counterpoint platform (3) according to the control parameter and carry out counterpoint operation.

2. The three-dimensional curved surface vision-guided alignment system of claim 1, wherein the middle platform (2) comprises an upper platform and a lower platform, the upper platform and the lower platform are arranged at the upper side and the lower side, the upper platform is used for aligning the first alignment target by using the camera module (6), the distance measuring module (7) and the motion module (8) which are arranged at the upper side of the middle platform (2), and the lower platform is used for aligning the second alignment target by using the camera module (6), the distance measuring module (7) and the motion module (8) which are arranged at the lower side of the middle platform (2).

3. The three-dimensional curved surface vision-guided alignment system according to claim 1 or 2, wherein the camera module (6) comprises a plurality of independently arranged camera modules, and the control module controls the motion positions of the camera modules independently according to the target size.

4. The three-dimensional curved surface vision-guided alignment system according to claim 3, wherein light source modules mounted on the camera module are disposed on both upper and lower sides of the middle platform (2), and the light source modules are used for providing auxiliary illumination for the camera module.

5. The three-dimensional curved surface vision-guided alignment system according to claim 4, wherein the first fixing device (4) and the second fixing device (5) are provided with suction cups, the first fixing device (4) is fixedly connected with the first alignment target through the suction cups, and the second fixing device (5) is fixedly connected with the second alignment target through the suction cups.

6. A three-dimensional curved surface visual guidance contraposition method is characterized by comprising the following steps:

s1, mounting the first alignment target and the second alignment target on a first fixing device and a second fixing device respectively, and enabling curved surfaces of the first fixing device and the second fixing device, which need to be measured and aligned, to be opposite to the middle platform respectively;

S2, controlling the motion module to drive the camera modules on the upper side and the lower side to move to positions right opposite to the first alignment target and the second alignment target respectively by using the control module to acquire image data of the first alignment target and the second alignment target, and controlling the motion module to drive the camera modules to return to a safe position after acquisition is completed;

s3, processing the image data acquired in the step S2 by using a control module to obtain two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target;

s4, controlling the motion module to drive the distance measuring modules at the upper side and the lower side to collect the height data of the mark points of the first alignment target and the second alignment target by using the control module according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3, and controlling the motion module to drive the distance measuring modules to return to a safe position after the collection is finished;

s5, calculating a guide position according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3 and the height data of the mark points obtained in the step S4 by using a control module, and converting the guide position into alignment platform control parameters;

and S6, controlling the aligning platform to execute the aligning operation by using the control module according to the control parameters obtained in the step S5.

7. the method as claimed in claim 6, wherein before step S1, the method further comprises calibrating the non-linear distortion of the camera module, calibrating the coordinates of the camera module at the upper and lower sides, calibrating the coordinates of the camera module and the distance measurement module, and calibrating the coordinates of the camera module and the alignment platform.

8. The method as claimed in claim 7, wherein the step S1 is followed by controlling the motion module to move the one or more camera modules to capture image data of the first alignment target and the second alignment target, calculating maximum contour size data of the first alignment target and the second alignment target according to the captured image data, and calculating the captured coordinate data of the camera modules according to the maximum contour size data of the first alignment target and the second alignment target.

9. The method as claimed in claim 8, wherein the step S2 uses the control module to control the motion module to drive the camera modules at the upper and lower sides to move to the corresponding positions respectively to capture the image data of the first alignment target and the second alignment target according to the captured coordinate data of the camera modules.

10. The visual guiding and aligning method for three-dimensional curved surfaces according to claim 9, wherein the step S5 specifically includes the following sub-steps:

S51, acquiring three-dimensional coordinate information of the marking points of the first alignment target, namely A1(x1, y1, z1), A2(x2, y2, z2), A3(x3, y3, z3), A4(x4, y4, z4), and three-dimensional coordinate information of the marking points of the second alignment target, namely B1(x1, y1, z1), B2(x2, y2, z2), B3(x3, y3, z3) and B4(x4, y4, z 4);

s52, a marking point fitting plane method is adopted, and three-dimensional plane equations Ax + By + Cz + D of the first counterpoint target and the second counterpoint target are respectively obtained and are equal to 0;

s53, acquiring a second alignment target alignment position target point B (x0, y0, z0) and an alignment direction vector B by taking the second alignment target as a reference target according to the three-dimensional plane equation obtained by fitting in the step S52;

s54, acquiring a first alignment target alignment position target point A (x0, y0, z0) and an alignment direction vector a by taking the first alignment target as a reference target according to the three-dimensional plane equation obtained by fitting in the step S52;

s55, calculating the coordinate difference between the target point of the first alignment target and the target point of the second alignment target by adopting a three-dimensional coordinate rotation and translation method, and converting the coordinate difference into an Euler angle expression mode of the multi-axis alignment platform to obtain the control parameters (x, y, z, alpha, beta, gamma) of the multi-axis alignment platform.

Technical Field

The invention belongs to the technical field of visual guide alignment, and particularly relates to a three-dimensional curved surface visual guide alignment system and method.

Background

in industrial automation equipment, many scenes use visual guidance to complete alignment and positioning functions. In practical application, most of the solutions and methods for visual guided alignment based on a two-dimensional plane exist, and the solutions and methods for visual guided alignment applied to a three-dimensional curved surface always exist as technical barriers and difficulties. Therefore, in a practical situation, the process flow related to three-dimensional curved surface alignment is often realized manually. On one hand, the cost of the process is increased, and the efficiency and the yield of the process are in a lower state.

disclosure of Invention

the invention mainly aims to provide a three-dimensional curved surface vision guide alignment system and a three-dimensional curved surface vision guide alignment method, and aims to solve all or part of technical problems in the existing method.

In order to achieve the purpose, the invention provides a three-dimensional curved surface vision guiding alignment system, which comprises an equipment shell and a middle platform arranged in the middle of the equipment shell;

An alignment platform for performing multi-axis motion is arranged at the bottom of the equipment shell, and a first fixing device for fixing a first alignment target is arranged on the alignment platform; a second fixing device for fixing a second alignment target is arranged at the top of the equipment shell;

The middle platform comprises a camera module, a distance measuring module, a control module and a motion module; the camera module and the distance measuring module are both installed on the motion module, the control module is used for controlling the motion module to drive the camera module to collect image data of a first contraposition target and/or a second contraposition target, the collected image data is processed to obtain mark point two-dimensional coordinate data of the first contraposition target and/or the second contraposition target, the motion module is controlled to drive the distance measuring module to collect mark point height data of the first contraposition target and/or the second contraposition target according to the mark point two-dimensional coordinate data, a guide position is calculated according to the mark point two-dimensional coordinate data and the mark point height data, the guide position is converted into contraposition platform control parameters, and the contraposition platform is controlled to execute contraposition operation according to the control parameters.

The invention also provides a three-dimensional curved surface visual guidance alignment method, which comprises the following steps:

S1, mounting the first alignment target and the second alignment target on a first fixing device and a second fixing device respectively, and enabling curved surfaces of the first fixing device and the second fixing device, which need to be measured and aligned, to be opposite to the middle platform respectively;

S2, controlling the motion module to drive the camera modules on the upper side and the lower side to move to positions right opposite to the first alignment target and the second alignment target respectively by using the control module to acquire image data of the first alignment target and the second alignment target, and controlling the motion module to drive the camera modules to return to a safe position after acquisition is completed;

s3, processing the image data acquired in the step S2 by using a control module to obtain two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target;

s4, controlling the motion module to drive the distance measuring modules at the upper side and the lower side to collect the height data of the mark points of the first alignment target and the second alignment target by using the control module according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3, and controlling the motion module to drive the distance measuring modules to return to a safe position after the collection is finished;

S5, calculating a guide position according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3 and the height data of the mark points obtained in the step S4 by using a control module, and converting the guide position into alignment platform control parameters;

and S6, controlling the aligning platform to execute the aligning operation by using the control module according to the control parameters obtained in the step S5.

the invention has the beneficial effects that: the three-dimensional curved surface vision-guided alignment system has the advantages of simple structure, high alignment accuracy, excellent automation performance and the like.

Drawings

FIG. 1 is a schematic structural diagram of a three-dimensional curved surface vision-guided alignment system according to the present invention;

FIG. 2 is a schematic view of a camera module according to the present invention;

FIG. 3 is a schematic view of the alignment platform and the first fixing device of the present invention;

Fig. 4 is a schematic flow chart of the three-dimensional curved surface visual guidance alignment method of the present invention.

Wherein the reference numerals are: the device comprises a device shell 1, a platform in the middle of the device shell 2, a contraposition platform 3, a first fixing device 4, a second fixing device 5, a camera module 6, a distance measurement module 7 and a motion module 8.

Detailed Description

in order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

the main solution of the embodiment of the invention is as follows:

Referring to fig. 1, 2 and 3, a three-dimensional curved surface vision guiding alignment system includes an apparatus housing 1 and a middle platform 2 disposed in the middle of the apparatus housing 1;

An alignment platform 3 for performing multi-axis motion is arranged at the bottom of the equipment shell 1, and a first fixing device 4 for fixing a first alignment target is arranged on the alignment platform 3; a second fixing device 5 for fixing a second alignment target is arranged at the top of the equipment shell 1;

The middle platform 2 comprises a camera module 6, a distance measuring module 7, a control module and a motion module 8; the camera module 6 and the distance measuring module 7 are both installed on the motion module 8, the control module is used for controlling the motion module 8 to drive the camera module 6 to collect image data of a first contraposition target and/or a second contraposition target, the collected image data is processed to obtain mark point two-dimensional coordinate data of the first contraposition target and/or the second contraposition target, the motion module 8 is controlled according to the mark point two-dimensional coordinate data to drive the distance measuring module 7 to collect mark point height data of the first contraposition target and/or the second contraposition target, a guide position is calculated according to the mark point two-dimensional coordinate data and the mark point height data, the guide position is converted into control parameters of the contraposition platform 3, and the contraposition platform 3 is controlled to execute contraposition operation according to the control parameters.

in an alternative embodiment of the present invention, the middle platform 2 of the present invention comprises an upper platform and a lower platform disposed at upper and lower sides; the upper platform comprises a camera module 6, a distance measuring module 7 and a motion module 8 which are arranged on the upper side of the middle platform 2 and are used for carrying out alignment treatment on the first alignment target; the lower platform comprises a camera module 6, a distance measuring module 7 and a motion module 8 which are arranged on the lower side of the middle platform 2 and are used for carrying out alignment treatment on a second alignment target; the control module respectively and independently controls the camera module 6, the distance measuring module 7 and the motion module 8 of the upper side platform and the lower side platform.

The camera module 6 comprises a camera module and a camera mounting bracket, the camera module is mounted on the motion module 8 through the camera mounting bracket, and the camera module is used for acquiring image data of the first alignment target and/or the second alignment target and sending the image data to the control module; in particular, as shown in fig. 2, the camera module 6 of the present invention includes a plurality of camera modules arranged independently, so that the control module can independently control and adjust the motion position of each camera module according to the size of the target, thereby adapting to alignment targets with different sizes.

above-mentioned range module 7 includes distancer and distancer installing support, and the distancer passes through the distancer installing support to be installed on motion module 8, and the distancer is used for gathering the mark point height data of first counterpoint target and/or second counterpoint target and sends to control module group.

The motion module 8 comprises a motion mechanism and an alignment platform 3, the motion mechanism is used for driving the camera module 6, the distance measuring module 7 and the alignment platform 3 to move according to the control of the control module, and the alignment platform 3 is used for driving the first alignment target to perform multi-axis motion according to the control of the control module, so that the alignment matching of the curved surfaces of the first alignment target and the second alignment target is realized.

the control module is used for controlling the motion modules 8 on the upper side and the lower side of the middle platform 2 to drive the camera module 6 to respectively acquire the image data of the first alignment target and the second alignment target, processing the collected image data to obtain two-dimensional coordinate data of the mark points of the first contraposition target and the second contraposition target, controlling the motion modules 8 at the upper side and the lower side of the middle platform 2 to drive the distance measuring module 7 to collect the height data of the mark points of the first contraposition target and the second contraposition target according to the two-dimensional coordinate data of the mark points, calculating the guide position according to the two-dimensional coordinate data and height data of the mark points, converting the guide position into alignment platform control parameters, and controlling the aligning platform 3 to move correspondingly according to the control parameters so that the first aligning target moves to adapt to the shape of the curved surface of the second aligning target, thereby realizing that the first aligning target and the second aligning target complete curved surface aligning assembly.

In an optional embodiment of the present invention, the light source modules installed on the camera module 6 are disposed on both upper and lower sides of the middle platform 2, the light source modules include an industrial light source and a light source bracket, the industrial light source is installed on the camera module 6 through the light source bracket, and the light source modules are used for providing auxiliary lighting for the camera module 6.

in an alternative embodiment of the present invention, suction cups are disposed on both the first fixing device 4 and the second fixing device 5, the first fixing device 4 is fixedly connected with the first alignment target through the suction cups, and the second fixing device 5 is fixedly connected with the second alignment target through the suction cups.

As shown in fig. 4, a schematic flow chart of a three-dimensional curved surface visual guidance alignment method is shown, and the following describes in detail the three-dimensional curved surface visual guidance alignment method based on the three-dimensional curved surface visual guidance alignment system, and includes the following steps:

S1, mounting the first alignment target and the second alignment target on a first fixing device and a second fixing device respectively, and enabling curved surfaces of the first fixing device and the second fixing device, which need to be measured and aligned, to be opposite to the middle platform respectively;

S2, controlling the motion module to drive the camera modules on the upper side and the lower side to move to positions right opposite to the first alignment target and the second alignment target respectively by using the control module to acquire image data of the first alignment target and the second alignment target, and controlling the motion module to drive the camera modules to return to a safe position after acquisition is completed;

s3, processing the image data acquired in the step S2 by using a control module to obtain two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target;

s4, controlling the motion module to drive the distance measuring modules at the upper side and the lower side to collect the height data of the mark points of the first alignment target and the second alignment target by using the control module according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3, and controlling the motion module to drive the distance measuring modules to return to a safe position after the collection is finished;

S5, calculating a guide position according to the two-dimensional coordinate data of the mark points of the first alignment target and the second alignment target obtained in the step S3 and the height data of the mark points obtained in the step S4 by using a control module, and converting the guide position into alignment platform control parameters;

and S6, controlling the aligning platform to execute the aligning operation by using the control module according to the control parameters obtained in the step S5.

in an optional embodiment of the present invention, before step S1, the present invention further needs to perform system calibration, that is, the system calibration includes performing camera module nonlinear distortion calibration, camera module coordinate calibration on the upper and lower sides, coordinate calibration of the camera module and the ranging module, and coordinate calibration of the camera module and the alignment platform; the invention can improve the position precision of the motion module control through system calibration.

in an optional embodiment of the present invention, after step S1, the present invention further includes controlling the movement module to drive one or more camera modules at upper and lower sides to move to positions facing the first alignment target and the second alignment target respectively to acquire image data of the first alignment target and the second alignment target, calculating maximum outline size data of the first alignment target and the second alignment target according to the acquired image data, and calculating acquired coordinate data of the camera modules according to the maximum outline size data of the first alignment target and the second alignment target.

After the collected coordinate data of the camera module is obtained, the invention further executes step S2 to control the motion module according to the collected coordinate data of the camera module by using the control module to drive the camera modules at the upper and lower sides to move to corresponding positions respectively to collect the image data of the first alignment target and the second alignment target.

In an alternative embodiment of the present invention, step S5 of the present invention specifically includes the following sub-steps:

S51, acquiring three-dimensional coordinate information of 4 marking points of a first contraposition target, namely A1(x1, y1, z1), A2(x2, y2, z2), A3(x3, y3, z3) and A4(x4, y4, z4) through camera modules and distance measuring modules on the upper side and the lower side of a middle platform, and acquiring three-dimensional coordinate information of 4 marking points of a second contraposition target, namely B1(x1, y1, z1), B2(x2, y2, z2), B3(x3, y3, z3) and B4(x4, y4, z 4);

s52, a marking point fitting plane method is adopted to respectively obtain a three-dimensional plane equation Ax + By + Cz + D of the first counterpoint target and a three-dimensional plane equation of the second counterpoint target, or a normal line type plane equation xcos alpha + ycos beta + zcos gamma, p;

s53, acquiring a second alignment target alignment position target point B (x0, y0, z0) and an alignment direction vector B by taking the second alignment target as a reference target according to the three-dimensional plane equation or the normal line plane equation obtained by fitting in the step S52;

S54, acquiring a first alignment target alignment position target point A (x0, y0, z0) and an alignment direction vector a by taking the first alignment target as a reference target according to the three-dimensional plane equation or the normal line plane equation obtained by fitting in the step S52;

S55, calculating the coordinate difference between the target point of the first alignment target and the target point of the second alignment target by adopting a three-dimensional coordinate rotation and translation method, and converting the coordinate difference into an Euler angle expression mode of the 6-axis alignment platform to obtain the control parameters (x, y, z, alpha, beta, gamma) of the 6-axis alignment platform.

it will be appreciated by those of ordinary skill in the art that the embodiments described herein are intended to assist the reader in understanding the principles of the invention and are to be construed as being without limitation to such specifically recited embodiments and examples. Those skilled in the art can make various other specific changes and combinations based on the teachings of the present invention without departing from the spirit of the invention, and these changes and combinations are within the scope of the invention.