阅读说明：本技术 曲面玻璃缺陷检测系统及方法 (Curved glass defect detection system and method ) 是由 张雄斌 王罡 于 2019-10-11 设计创作，主要内容包括：本发明公开了曲面玻璃缺陷检测系统及方法,利用双工位分布式布置的线阵相机与面阵相机,配合优化设计的第一程控三维多光场光源和第二程控三维多光场光源,实现对曲面玻璃不同部位(曲面玻璃平面部分与长弧边检测,R角与短弧边检测)在不同光照环境下的图像获取,再利用基于嵌入式系统的线阵相机数据预处理平台和面阵相机数据预处理平台对图像进行滤波、边界检测、缺陷检测等预先处理,预处理后图像数据通过程控交换机送达数据处理终端进行缺陷识别与分类,具有结构简单、系统稳定、检测高效、缺陷识别准确且易于管理的优点。(the invention discloses a curved glass defect detection system and a method, which utilize a linear array camera and an area array camera which are distributed at double stations to be matched with a first program-controlled three-dimensional multi-light-field light source and a second program-controlled three-dimensional multi-light-field light source which are optimally designed, realize the image acquisition of different parts (the plane part and the long arc edge of the curved glass, and the R angle and the short arc edge of the curved glass) of the curved glass under different illumination environments, then utilize a linear array camera data preprocessing platform and an area array camera data preprocessing platform based on an embedded system to carry out preprocessing such as filtering, boundary detection, defect detection and the like on images, and send the preprocessed image data to a data processing terminal through a program-controlled exchanger for defect identification and classification.)

1. Curved surface glass defect detecting system, its characterized in that includes:

the curved glass conveying device is used for conveying a workpiece to be detected during online detection;

sequentially arranging a linear array camera station and an area array camera station along the transmission direction of the curved glass transmission device, wherein the linear array camera station and the area array camera station are respectively used for detecting a plane part and a long arc edge of the curved glass and detecting an R angle and a short arc edge of the curved glass;

the linear array camera station comprises a first workpiece position detection sensor, a linear array camera with a lens, a first program-controlled three-dimensional multi-light-field light source, a first light source controller and a linear array camera data preprocessing platform, wherein the first workpiece position detection sensor is used for detecting whether a workpiece reaches the linear array detection station, the linear array camera is used for acquiring images of a plane part and a long arc edge position of the workpiece to be detected in different illumination environments, the first program-controlled three-dimensional multi-light-field light source is used for providing illumination environments with different angles, the first light source controller is used for controlling the first program-controlled three-dimensional multi-light-field light source, and the linear array camera data preprocessing platform is used for being responsible for data transfer, image preprocessing and network communication of the linear array;

the area array camera station comprises a second workpiece position detection sensor, an area array camera with a lens, a second program-controlled three-dimensional multi-light-field light source, a second light source controller and an area array camera data preprocessing platform, wherein the second workpiece position detection sensor is used for detecting whether a workpiece reaches the area array detection station, the area array camera is used for acquiring images of the short arc edge and the R angle position of the workpiece, the second program-controlled three-dimensional multi-light-field light source is used for providing illumination conditions of different angles, the second light source controller is used for controlling the second program-controlled three-dimensional multi-light-field light source, and the area array camera data preprocessing platform is used for being responsible for data transfer, image preprocessing and network communication of the area array camera;

the program controlled exchanger is used for the transfer of the preprocessed image data and the communication of control signals;

the signal interface platform is respectively connected with the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the program controlled switch and is used for inputting and outputting synchronous signals, control signals and signals of the first workpiece position detection sensor and the second workpiece position detection sensor;

the data processing terminal is connected with the stored program control exchanger and is used for the deep processing of image data, the data storage management and the system control;

and the display control component is connected with the data processing terminal and is used for displaying the processed result and the human-computer interaction interface.

2. the curved glass defect detection system of claim 1, wherein the line cameras are multiple and distributed in number, comprising:

the system comprises at least three first linear-array cameras, a light source and a controller, wherein the at least three first linear-array cameras are arranged above a workpiece to be detected and used for acquiring a workpiece image corresponding to a reflected light field;

at least three second linear-array cameras arranged below the workpiece to be detected and used for acquiring a workpiece image corresponding to the transmission light field;

The curved glass conveying device comprises at least three first linear cameras and at least three second linear cameras, wherein the at least three first linear cameras are arranged above a workpiece to be detected, and the at least three second linear cameras are arranged below the workpiece to be detected, and the curved glass conveying device is symmetrically arranged by taking the conveying direction of the curved glass conveying device as an axis.

3. the curved glass defect detection system of claim 2, wherein one of the at least three first line cameras disposed above the workpiece to be inspected is disposed at an intermediate position above the workpiece to be inspected, and forms an angle of 0 to 15 ° with the normal direction of the surface of the workpiece to be inspected, for acquiring an image of a planar portion of the workpiece; in addition, at least two first linear-array cameras are symmetrically distributed on two sides of one first linear-array camera, and the optical axis direction of each first linear-array camera is consistent with the normal direction of the arc edge of the workpiece to be detected, and the first linear-array cameras are respectively used for acquiring images of the arc edge on two sides of the workpiece to be detected.

4. The curved glass defect detection system of claim 1, wherein the area-array camera comprises:

one or more first area-array cameras arranged above a workpiece to be detected and used for acquiring reflection images of the workpiece in different illumination environments;

One or more second area-array cameras arranged below the workpiece to be detected and used for acquiring transmission images of the workpiece under different illumination environments;

One or more first area-array cameras arranged above the workpiece to be detected and one or more second area-array cameras arranged below the workpiece to be detected are symmetrically arranged by taking the transmission direction of the curved glass transmission device as an axis.

5. the curved glass defect detection system of claim 1, wherein the number of linear array camera data preprocessing platforms is the same as the number of linear array cameras; and/or the number of the area-array camera data preprocessing platforms is the same as that of the area-array cameras.

6. The curved glass defect detection system according to any one of claims 1 to 5, wherein the first programmable three-dimensional multi-light-field light source is an arched multi-angle light source with an open bottom, and is disposed perpendicular to the motion direction of the workpiece to be inspected, and the arched multi-angle light source includes a plurality of arc-shaped light sources with different heights inside, so as to provide uniform incident light with different angles for the workpiece to be inspected.

7. the curved glass defect detection system according to any one of claims 1 to 5, wherein said second programmable three-dimensional multi-light field light source is a multi-angle light source with an open bottom and a hemispherical or square box shape, and is disposed perpendicular to the moving direction of the workpiece to be detected, and said multi-angle light source with a hemispherical or square box shape contains a plurality of bar light sources with different heights inside for providing a plurality of uniform incident lights with different angles for the workpiece to be detected.

8. the curved glass defect detection system according to any one of claims 1 to 5, further comprising a temperature control system connected to the first light source controller, the second light source controller, the line camera data preprocessing platform, the area camera data preprocessing platform and the data processing terminal, respectively, for controlling the temperature of the first program-controlled three-dimensional multi-light-field light source, the second program-controlled three-dimensional multi-light-field light source, the line camera data preprocessing platform, the area camera data preprocessing platform and the data processing terminal.

9. The curved glass defect detection method is characterized in that the curved glass defect detection system of any one of claims 1 to 8 is used for detection, and the method comprises the following steps:

s1, placing the workpiece to be detected on the curved glass conveying device, and enabling the workpiece to be detected to move forwards stably at a constant speed;

s2, the first workpiece position detection sensor detects a workpiece to be detected, a linear array camera and a first program-controlled three-dimensional multi-light-field light source of the linear array camera station are started, an image of the workpiece to be detected is obtained according to a set light field, and image data are sent to the data processing terminal after being preprocessed by the linear array camera data preprocessing platform;

s3, the first workpiece position detection sensor detects that the workpiece to be detected leaves, and the linear array camera and the first program-controlled three-dimensional multi-light-field light source of the linear array camera station stop working;

S4, the second workpiece position detection sensor detects a workpiece to be detected, an area array camera of an area array camera station and a second program-controlled three-dimensional multi-light-field light source are started, an image of the workpiece to be detected is obtained according to a set light field, and image data are sent to the data processing terminal after being preprocessed by the area array camera data preprocessing platform;

s5, the second workpiece position detection sensor detects that the workpiece to be detected leaves, and the area array camera of the area array camera station and the second program-controlled three-dimensional multi-light-field light source stop working;

s6, the data processing terminal identifies and classifies defects through a conventional algorithm according to the processing results of the linear array camera data preprocessing platform and the area array camera data preprocessing platform, if the defects cannot be identified, the step S7 is carried out, otherwise, the step S8 is carried out;

s7, the data processing terminal identifies and classifies defects based on a deep learning algorithm;

And S8, returning to the step S1, restarting the next round of detection, and realizing online continuous detection.

10. The curved glass defect detection system of claim 9, wherein prior to utilizing the deep learning algorithm in step S7, deep learning model training is performed utilizing various types of defect image samples.

Technical Field

the invention belongs to the technical field of machine vision, particularly relates to a curved glass defect detection system and method, and is particularly suitable for online detection of 2.5D/3D/3.5D curved cover plate glass defects.

Background

the cover plate glass is a protective layer of the touch screen and is widely applied to the aspects of consumer electronics, automobile central control screens, industrial control and the like. In recent years, with the large-scale application of flexible OLED screens and the continuous optimization of various types of products in terms of ergonomics and appearance, cover glasses have undergone the development process from 2D to 2.5D to 3D to 3.5D. Compared with the traditional 2D plane cover plate glass, the curved surface cover plate glass has more excellent performance, has remarkable advantages in the aspects of fitting degree, heat dissipation, glossiness, attractiveness and the like, and is expected to be widely applied to various 3C products such as smart phones, smart watches, tablet computers, instrument panels and other wearable products in the future.

the defect detection of the curved cover plate glass is the key of product quality control, and directly influences the product productivity and the user experience. At present, domestic cover plate glass production enterprises mainly adopt manual visual inspection means, so that the efficiency is low, the omission factor is high, and the problem that the labor cost is continuously increased is solved. With the further expansion of the market demand of the curved cover plate glass, the automatic upgrading of related production lines is a necessary trend, and the automatic on-line curved cover plate glass defect detection equipment has a wide market. Compared with the traditional 2D cover plate glass, the 2.5D/3D/3.5D curved cover plate glass has more complex appearance. Different from the plane appearance of 2D cover glass, 2.5D cover glass is designed into an arc shape on the edge, 3D cover glass adopts the arc design in the middle or on the edge, and 3.5D cover glass is designed into an arc shape with the edge being close to 90 degrees. The complex processes and manufacturing processes inevitably result in a wide variety of defects in the curved cover glass product, including but not limited to scratches, pits, impurities, edge chipping, and the like. Due to the complex appearance structure of the curved cover plate glass, various defects present different visual characteristics along with the change of positions, illumination angles and visual angles, and very high requirements are provided for the design and manufacture of on-line automatic defect detection equipment based on machine vision.

in recent years, various devices and methods are invented to realize automatic online detection of defects of curved cover plate glass. The Chinese invention patent 'typical defect on-line detection device and method for mobile phone curved glass' (application number: 201910347948.7, application date: 2019.04.28) adopts multi-station configuration of an area-array camera and a line-array camera to acquire images of different positions of curved cover glass respectively, and utilizes a convolutional neural network to detect and classify defects, thereby having higher detection precision, but being limited in several aspects: firstly, a data acquisition and processing system is complex, and an independent acquisition card and a computer are adopted to process data acquired by a single camera, so that the system is high in cost, low in integration level and poor in stability; secondly, the motion control system is complex, and the curved cover plate glass needs to be rotated to respectively detect the long edge and the short edge, so that the detection efficiency of the system is low; finally, the light source configuration scheme mainly uses coaxial light and a strip-shaped light source, the detection effect on the classification type defects is poor, and the environmental interference influence of dust, flies and the like is serious. The Chinese invention patent 'a 3D curved glass screen detection surface light source' (application number: 201710531451.1, application date: 2017.07.03) adopts polarized light sources with different wavelengths to combine into a surface light source, realizes the stripe irradiation on the 3D curved glass, can well represent the normal vector of the screen surface, but has limited effect on defect identification and classification. The invention of the Chinese patent application No. 201810317450.1, application date 2018.04.10 discloses a multi-angle polishing device and acquisition system, wherein a plurality of light source modules with different irradiation angles are arranged in a three-dimensional space, so that illumination of a product to be detected at different angles is realized, illumination optimal configuration is not performed, so that a large amount of data is generated due to the large number of illumination fields, great challenges are brought to data transmission and processing, and the real-time performance of the system is seriously affected. The Chinese invention patent 'a glass defect detection method and device' (application number: 201711367046.7, application date: 2017.12.18) and the Chinese invention patent 'glass surface defect detection method and device' (application number: 201910342570.1, application date: 2019.04.26) respectively provide two image processing methods, wherein the former uses the energy response of images to detect defects, and the latter uses the difference values before and after image filtering to detect defects, so that certain effects can be achieved.

generally, many attempts are made on defect detection of a curved glass cover plate, but in the prior art, the detection device is complex in structure and operation method, low in system integration level, limited in performance, high in cost and not beneficial to popularization and application.

Disclosure of Invention

The invention aims to overcome the defects in the prior art and provide a curved glass defect detection system, aims to realize economical, efficient and high-precision online automatic detection of curved glass defects, and is particularly suitable for online detection of 2.5D/3D/3.5D curved cover plate glass defects.

the invention also aims to provide a curved glass defect detection method. The method utilizes double-station distributed arrangement of the area-array cameras and the linear-array cameras, cooperates with optimally designed program-controlled multi-light-field three-dimensional light sources, and performs defect identification and classification based on a linear-array camera data preprocessing platform, an area-array camera data preprocessing platform and a data processing terminal of an embedded system, and has the advantages of being simple, efficient in detection, accurate in defect identification and easy to manage.

the purpose of the invention is realized by the following technical scheme: there is provided a curved glass defect detection system comprising:

The curved glass conveying device is used for conveying a workpiece to be detected during online detection;

Sequentially arranging a linear array camera station and an area array camera station along the transmission direction of the curved glass transmission device, wherein the linear array camera station and the area array camera station are respectively used for detecting a plane part and a long arc edge of the curved glass and detecting an R angle and a short arc edge of the curved glass;

the linear array camera station comprises a first workpiece position detection sensor, a linear array camera with a lens, a first program-controlled three-dimensional multi-light-field light source, a first light source controller and a linear array camera data preprocessing platform, wherein the first workpiece position detection sensor is used for detecting whether a workpiece reaches the linear array detection station, the linear array camera is used for acquiring images of a plane part and a long arc edge position of the workpiece to be detected in different illumination environments, the first program-controlled three-dimensional multi-light-field light source is used for providing illumination environments with different angles, the first light source controller is used for controlling the first program-controlled three-dimensional multi-light-field light source, and the linear array camera data preprocessing platform is used for being responsible for data transfer, image preprocessing and network communication of the linear array;

the area array camera station comprises a second workpiece position detection sensor, an area array camera with a lens, a second program-controlled three-dimensional multi-light-field light source, a second light source controller and an area array camera data preprocessing platform, wherein the second workpiece position detection sensor is used for detecting whether a workpiece reaches the area array detection station, the area array camera is used for acquiring images of the short arc edge and the R angle position of the workpiece, the second program-controlled three-dimensional multi-light-field light source is used for providing illumination conditions of different angles, the second light source controller is used for controlling the second program-controlled three-dimensional multi-light-field light source, and the area array camera data preprocessing platform is used for being responsible for data transfer, image preprocessing and network communication of the area array camera;

the program controlled exchanger is used for the transfer of the preprocessed image data and the communication of control signals;

The signal interface platform is respectively connected with the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the program controlled switch and is used for inputting and outputting synchronous signals, control signals and signals of the first workpiece position detection sensor and the second workpiece position detection sensor;

The data processing terminal is connected with the stored program control exchanger and is used for the deep processing of image data, the data storage management and the system control;

And the display control component is connected with the data processing terminal and is used for displaying the processed result and the human-computer interaction interface.

as a further improvement, the number of line cameras is multiple and in a distributed arrangement, including:

the system comprises at least three first linear-array cameras, a light source and a controller, wherein the at least three first linear-array cameras are arranged above a workpiece to be detected and used for acquiring a workpiece image corresponding to a reflected light field;

at least three second linear-array cameras arranged below the workpiece to be detected and used for acquiring a workpiece image corresponding to the transmission light field;

the curved glass conveying device comprises at least three first linear cameras and at least three second linear cameras, wherein the at least three first linear cameras are arranged above a workpiece to be detected, and the at least three second linear cameras are arranged below the workpiece to be detected, and the curved glass conveying device is symmetrically arranged by taking the conveying direction of the curved glass conveying device as an axis.

As a further improvement, one of the at least three first linear cameras arranged above the workpiece to be detected is arranged at the middle position above the workpiece to be detected, and forms an included angle of 0-15 degrees with the normal direction of the surface of the workpiece to be detected, and is used for acquiring an image of the plane part of the workpiece; in addition, at least two first linear-array cameras are symmetrically distributed on two sides of one first linear-array camera, and the optical axis direction of each first linear-array camera is consistent with the normal direction of the arc edge of the workpiece to be detected, and the first linear-array cameras are respectively used for acquiring images of the arc edge on two sides of the workpiece to be detected.

as a further improvement, the area-array camera includes:

One or more first area-array cameras arranged above a workpiece to be detected and used for acquiring reflection images of the workpiece in different illumination environments;

one or more second area-array cameras arranged below the workpiece to be detected and used for acquiring transmission images of the workpiece under different illumination environments;

one or more first area-array cameras arranged above the workpiece to be detected and one or more second area-array cameras arranged below the workpiece to be detected are symmetrically arranged by taking the transmission direction of the curved glass transmission device as an axis.

As a further improvement, the number of the linear array camera data preprocessing platforms is the same as that of the linear array cameras; and/or the number of the area-array camera data preprocessing platforms is the same as that of the area-array cameras.

As further improvement, first programme-controlled three-dimensional many light field light source opens and is arched multi-angle light source for the bottom, with wait to examine work piece direction of motion and place perpendicularly, just be the inside arc light source that contains a plurality of co-altitude of arched multi-angle light source for wait to examine the even incident light that the work piece provided a plurality of co-angles.

As a further improvement, the second program-controlled three-dimensional multi-angle light source is a multi-angle light source with an open bottom and a hemispherical shape or a square box shape, and is vertically placed in the motion direction of the workpiece to be inspected, and the multi-angle light source with the hemispherical shape or the square box shape internally comprises a plurality of strip-shaped light sources with different heights, and is used for providing uniform incident light with a plurality of different angles for the workpiece to be inspected.

as a further improvement, the curved glass defect detection system further comprises a temperature control system respectively connected with the first light source controller, the second light source controller, the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the data processing terminal, and used for controlling the temperature of the first program-controlled three-dimensional multi-light-field light source, the second program-controlled three-dimensional multi-light-field light source, the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the data processing terminal.

the other purpose of the invention can be realized by the following technical scheme: the curved glass defect detection method based on machine vision comprises the following steps:

s1, placing the workpiece to be detected on the curved glass conveying device, and enabling the workpiece to be detected to move forwards stably at a constant speed;

s2, the first workpiece position detection sensor detects a workpiece to be detected, a linear array camera and a first program-controlled three-dimensional multi-light-field light source of the linear array camera station are started, an image of the workpiece to be detected is obtained according to a set light field, and image data are sent to the data processing terminal after being preprocessed by the linear array camera data preprocessing platform;

S3, the first workpiece position detection sensor detects that the workpiece to be detected leaves, and the linear array camera and the first program-controlled three-dimensional multi-light-field light source of the linear array camera station stop working;

s4, the second workpiece position detection sensor detects a workpiece to be detected, an area array camera of an area array camera station and a second program-controlled three-dimensional multi-light-field light source are started, an image of the workpiece to be detected is obtained according to a set light field, and image data are sent to the data processing terminal after being preprocessed by the area array camera data preprocessing platform;

S5, the second workpiece position detection sensor detects that the workpiece to be detected leaves, and the area array camera of the area array camera station and the second program-controlled three-dimensional multi-light-field light source stop working;

S6, the data processing terminal identifies and classifies defects through a conventional algorithm according to the processing results of the linear array camera data preprocessing platform and the area array camera data preprocessing platform, if the defects cannot be identified, the step S7 is carried out, otherwise, the step S8 is carried out;

s7, the data processing terminal identifies and classifies defects based on a deep learning algorithm;

And S8, returning to the step S1, restarting the next round of detection, and realizing online continuous detection.

as a further improvement, before the deep learning algorithm is used in step S7, deep learning model training is performed using various types of defect image samples.

Compared with the prior art, the system and the method for detecting the defects of the curved glass have the following advantages:

(1) The area-array camera and the linear array camera which are distributed in double stations reduce the stations to the maximum extent, improve the detection efficiency, ensure the rapid and accurate detection of common defects in the curved glass and prevent the omission and false detection;

(2) The area-array cameras and the line-array cameras which are distributed in an up-and-down symmetrical mode are combined with an image processing algorithm, so that the defects of the upper surface and the lower surface of a workpiece to be detected can be distinguished, and meanwhile, the interference of environmental factors such as dust, flies and the like can be eliminated;

(3) The linear array camera data preprocessing platform and the area array camera data preprocessing platform based on the embedded system improve the image processing efficiency to the maximum extent, improve the system data capacity, can be matched with a first program-controlled three-dimensional multi-light-field light source and a second program-controlled three-dimensional multi-light-field light source to acquire the images of the workpiece to be detected under different illumination environments as much as possible, and improve the detection precision;

(4) the system is more stable and efficient and has lower cost compared with a system architecture in which a plurality of sets of computers independently process a single camera;

(5) The whole detection system is simple in structure, accurate in identification and easy to manage.

Drawings

The invention is further illustrated by means of the attached drawings, but the embodiments in the drawings do not constitute any limitation to the invention, and for a person skilled in the art, other drawings can be obtained on the basis of the following drawings without inventive effort. In the drawings:

FIG. 1 is a schematic diagram of a defect inspection system for curved glass according to an embodiment of the present invention;

FIG. 2(a) is a side view of the upper half of a workpiece to be inspected in a linear array camera station of the present invention along the direction of motion of the workpiece to be inspected;

FIG. 2(b) is a side view of the upper half of the workpiece to be inspected in the linear array camera station of the present invention, perpendicular to the direction of motion of the workpiece to be inspected;

FIG. 3(a) is a side view of the upper half of a workpiece to be inspected in the direction of movement of the workpiece in the area-array camera station of the present invention;

FIG. 3(b) is a side view of the upper half of the workpiece to be inspected in the area-array camera station of the present invention, perpendicular to the direction of motion of the workpiece to be inspected;

FIG. 4(a) is a schematic perspective view of an embodiment of a first programmable three-dimensional multi-light field light source;

FIG. 4(b) is a side cross-sectional view of the first programmable three-dimensional multi-light-field light source of FIG. 4 (a);

FIG. 5(a) is a schematic perspective view of an embodiment of a second programmable three-dimensional multi-light field light source;

FIG. 5(b) is a side cross-sectional view of the second programmable three-dimensional multi-light field light source of FIG. 5 (a);

FIG. 5(c) is a schematic perspective view of another embodiment of a second programmable three-dimensional multi-lightfield light source;

FIG. 6 is a flow chart of one embodiment of a method for detecting defects in curved glass in accordance with the present invention;

description of reference numerals:

1-curved glass transmission device, 2-workpiece to be detected, 3-first program-controlled three-dimensional multi-light-field light source, 4-first workpiece position detection sensor, 5-first linear array camera, 6-second linear array camera, 7-first linear array camera data preprocessing platform, 8-second linear array camera data preprocessing platform, 9-second workpiece position detection sensor, 10-second program-controlled three-dimensional multi-light-field light source, 11-second linear array camera data preprocessing platform, 12-first data preprocessing platform, 13-first linear array camera, 14-second linear array camera, 15-program-controlled switch, 16-data processing terminal, 17-display control terminal, 18-signal interface platform, 19-temperature control system, 20-curved light source, 21-LED strip light source, alpha-the included angle between the first linear array camera 5 and the normal direction of the workpiece 2 to be detected, and beta-the included angle between the first linear array camera 13 and the normal direction of the workpiece 2 to be detected.

Detailed Description

In order to make those skilled in the art better understand the technical solution of the present invention, the following detailed description of the present invention is provided with reference to the accompanying drawings and specific embodiments, and it is to be noted that the embodiments and features of the embodiments of the present application can be combined with each other without conflict.

In the description of the present invention, it is to be understood that the terms "horizontal", "vertical", "left", "right", "top", "bottom", "inner", "outer", "upper", "lower", and the like, indicate orientations or positional relationships based on those shown in the drawings, and are used only for convenience in describing the present invention and for simplicity in description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and therefore, should not be construed as limiting the scope of the present invention.

FIG. 1 is a schematic diagram of a system for detecting defects in curved glass according to an embodiment of the present invention. As shown in fig. 1, a curved glass defect detecting system provided by an embodiment of the present invention includes a curved glass conveying device 1 for conveying a workpiece 2 to be detected during on-line detection, and a line camera station for detecting a curved glass plane portion and a long arc edge and an area camera station for detecting a curved glass R angle and a short arc edge are sequentially arranged along a conveying direction of the curved glass conveying device 1, specifically, the line camera station includes a first workpiece position detecting sensor 4, a line camera with a lens, a first programmed three-dimensional multi-light-field light source 3, a first light source controller and a line camera data preprocessing platform, the area camera station includes a second workpiece position detecting sensor 9, an area camera with a lens, a second programmed three-dimensional multi-light-field light source 10, a second light source controller and an area camera data preprocessing platform, the first workpiece position detecting sensor 4 is used for detecting whether the workpiece reaches the line camera station, the linear array camera is used for acquiring images of a plane part and a long arc edge of a workpiece 2 to be detected in different illumination environments, the first program-controlled three-dimensional multi-light-field light source 3 is used for providing illumination environments with different angles, the first light source controller is used for controlling the first program-controlled three-dimensional multi-light-field light source 3, particularly providing driving and control signals for the first program-controlled three-dimensional multi-light-field light source 3, the linear array camera data preprocessing platform is used for transferring data of the linear array camera, preprocessing the images and carrying out network communication, the second workpiece position detection sensor 9 is used for detecting whether the workpiece reaches a planar array detection station or not, the planar array camera is used for acquiring images of a short arc edge and an R angle of the workpiece, the second program-controlled three-dimensional multi-light-field light source 10 is used for providing illumination conditions with different angles, the second light source controller is used for controlling the second program-controlled three-dimensional multi, the area-array camera data preprocessing platform is used for taking charge of area-array camera data transfer, image preprocessing and network communication; meanwhile, the curved glass defect detection system also comprises a program controlled switch 15, a data processing terminal 16, a display control terminal 17 and a signal interface platform 18, wherein the program controlled switch 15 is used for transferring preprocessed image data and controlling signal communication; the signal interface platform 18 is respectively connected with the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the program controlled switch 15 and is used for inputting and outputting synchronous signals, control signals and signals of the first workpiece position detection sensor 4 and the second workpiece position detection sensor 9; the data processing terminal 16 is connected with the stored program control exchange 15 and is used for deep processing of image data, data storage management and system control, and preferably, a high-performance blade server can be selected; the display and control unit is connected to the data processing terminal 16 for displaying the processed result and a man-machine interface, preferably, a liquid crystal display and a mouse and keyboard are selected. Further, the curved glass defect detection system further comprises a temperature control system 19, wherein the temperature control system 19 is respectively connected with the first light source controller, the second light source controller, the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the data processing terminal 16 and is used for controlling the temperature of the first program-controlled three-dimensional multi-light-field light source 3, the second program-controlled three-dimensional multi-light-field light source 10, the linear array camera data preprocessing platform, the area array camera data preprocessing platform and the data processing terminal 16, and preferably, the temperature control system 19 can select a water cooling system.

it should be noted that the curved glass conveying device 1 mainly comprises a motor, magnetic wheels, bearings, a conveyor belt and encoders, wherein the motor drives the bearings to rotate along the moving direction of the workpiece 2 to be detected through the magnetic wheels, the bearings are connected with each other by the conveyor belt, and the encoders are connected to the motor and used for measuring the conveying speed.

through the arrangement, the invention realizes image acquisition of different parts of curved glass (curved glass plane part and long arc edge detection, R angle and short arc edge detection) under different illumination environments by using the linear array camera and the area array camera which are distributed at double stations and matching with the first program-controlled three-dimensional multi-light-field light source 3 and the second program-controlled three-dimensional multi-light-field light source 10 which are optimally designed, and then performs preprocessing such as filtering, boundary detection, defect detection and the like on the image by using the linear array camera data preprocessing platform and the area array camera data preprocessing platform based on the embedded system, and the preprocessed image data are sent to the data processing terminal 16 through the program control switch 15 for defect identification and classification.

in a further technical scheme, the number of line cameras is multiple and distributed, as shown in fig. 1, in this embodiment, the number of line cameras is the same as the number of line camera data preprocessing platforms, and the line cameras include a first line camera 5 arranged above a workpiece 2 to be inspected and a second line camera 6 arranged below the workpiece 2 to be inspected, the first line camera 5 is connected with the first line camera data preprocessing platform 7, the second line camera 6 is connected with the second line camera data preprocessing platform 8, the first line camera 5 is used for acquiring a workpiece image corresponding to a reflected light field, and the second line camera 6 is used for acquiring a workpiece image corresponding to a transmitted light field. It should be noted that, the first line-array camera 5 and the second line-array camera 6 are preferably provided with at least three portions, and the first line-array camera 5 of at least three portions and the second line-array camera 6 of at least three portions are symmetrically provided with the transmission direction of the curved glass transmission device 1 as an axis. Fig. 2(a) shows a case where the number of the first line cameras 5 is three. In the embodiment shown in fig. 2(a) and 2(b), one first line-array camera 5 is arranged above the middle position of the workpiece, and forms an included angle of 0-15 degrees with the normal direction of the surface of the workpiece, and is responsible for acquiring the image of the plane part of the workpiece, α in fig. 2(b) is the included angle between the first line-array camera 5 and the normal direction of the workpiece 2 to be inspected, and the other two first line-array cameras 5 are symmetrically distributed on both sides of the first line-array camera 5, and the optical axis direction of the cameras is consistent with the normal direction of the arc edge of the workpiece 2 to be inspected, and are used for acquiring the arc edge images on both sides respectively, and when the arc edge radian is too large, the number of the line-array cameras can. Namely, the number of the linear array cameras is adjusted according to the length and the angle of the arc edge of the curved glass of the workpiece 2 to be detected.

in a further preferred embodiment, the number of the area-array cameras in the present invention is also multiple, and the number of the area-array cameras is the same as that of the area-array camera data preprocessing stages. As shown in fig. 1, in this embodiment, the area-array camera includes a first area-array camera 13 disposed above the workpiece 2 to be inspected and a second area-array camera 14 disposed below the workpiece 2 to be inspected, the area-array camera data preprocessing platform includes a first area-array camera data preprocessing platform 12 and a first area-array camera data preprocessing platform 11, the first area-array camera 13 and the first area-array camera data preprocessing platform 12, the second area-array camera 14 and the second area-array camera data preprocessing platform 11, the first area-array camera 13 is used for acquiring reflection images of the workpiece in different lighting environments, and the second area-array camera 14 is used for acquiring transmission images of the workpiece in different lighting environments. It should be noted that the number of the first area-array camera 13 and the second area-array camera 14 may be one or multiple, and the first area-array camera 13 and the second area-array camera 14 are symmetrically arranged with the transmission direction of the curved glass transmission device 1 as an axis. Fig. 3(a) shows a case where the number of the first line cameras 5 is two. In the embodiment shown in fig. 3(a) and 3(b), the two first area-array cameras 13 are symmetrically distributed above the workpiece 2 to be inspected with the movement direction of the workpiece 2 to be inspected being perpendicular as an axis, and an included angle between each first area-array camera 13 and the normal direction of the workpiece 2 to be inspected is preferably 0-30 °, where β in fig. 3(b) is an included angle between each first area-array camera 13 and the normal direction of the workpiece 2 to be inspected. It is worth mentioning that the number of the area-array cameras is preferably adjusted according to the length of the short arc side of the curved glass of the workpiece 2 to be detected and the angle of the R angle.

Fig. 4(a) is a schematic structural diagram of a first embodiment of the programmed three-dimensional multi-light-field light source 3 according to the present invention. As shown in fig. 4(a), the first programmable three-dimensional multi-light-field light source 3 is arched in overall appearance, i.e. is an arched multi-angle light source with an open bottom, and is placed perpendicular to the moving direction of the workpiece 2 to be inspected. Specifically, as shown in fig. 4(b), the arched multi-angle light source includes a plurality of arc-shaped light sources 20 with different heights inside, which are used to provide a plurality of uniform incident lights with different angles for the workpiece 2 to be detected, i.e. the overall shape of each arc-shaped light source 20 is consistent with the appearance of the first programmed three-dimensional multi-light field light source 3, so as to facilitate installation. Preferably, the arc-shaped light source 20 is an LED light source, the irradiation direction of the LED light source is set to be vertical, and each LED light source can be independently controlled to be turned on or off through the first light source controller.

fig. 5(a) is a schematic structural diagram of a second embodiment of the programmed three-dimensional multi-light-field light source 10 according to the present invention. As shown in fig. 5(a), the whole appearance of the second program-controlled three-dimensional multi-light-field light source 10 is hemispherical, and is placed perpendicular to the moving direction of the workpiece to be inspected 2, a circular observation window is opened above the second program-controlled three-dimensional multi-light-field light source, the bottom of the second program-controlled three-dimensional multi-light-field light source is open, a plurality of LED strip light sources 21 are preferably installed inside the second program-controlled three-dimensional multi-light-field light source, the whole appearance of each LED strip light source 21 is consistent with the appearance of the second program-controlled three-dimensional multi-light-field light source 10, in the embodiment, each LED strip light source 21 is arranged in an arc shape, as shown in fig. 5(b), the LED irradiation. It should be noted that the overall appearance of the second programmed three-dimensional multi-light-field light source 10 is not limited to be hemispherical, and other appearance shapes of the second programmed three-dimensional multi-light-field light source 10 that can implement the technical solution are within the protection scope of the present invention. Fig. 5(c) shows that the second programmable three-dimensional multi-light field light source 10 is a square box shape in overall appearance.

as shown in fig. 6, the invention also provides a curved glass defect detection method, which is used for detecting the curved glass defect detection system, and the method comprises the following steps:

s1, placing the workpiece 2 to be detected on the curved glass conveying device 1 to enable the workpiece to be detected to move forwards stably at a constant speed, and preferably, placing the workpiece 2 to be detected on the curved glass conveying device 1 by means of a manipulator or other on-line automatic devices;

S2, the first workpiece position detection sensor 4 detects the workpiece 2 to be detected, the linear array camera of the linear array camera station and the first program-controlled three-dimensional multi-light-field light source 3 are started, the image of the workpiece 2 to be detected is obtained according to the set light field, and the image data is sent to the data processing terminal 16 after being preprocessed by the linear array camera data preprocessing platform;

s3, the first workpiece position detection sensor 4 detects that the workpiece 2 to be detected leaves, and the linear array camera of the linear array camera station and the first program-controlled three-dimensional multi-light-field light source 3 stop working;

S4, the second workpiece position detection sensor 9 detects the workpiece 2 to be detected, the area array camera of the area array camera station and the second program-controlled three-dimensional multi-light-field light source 10 are started, the image of the workpiece 2 to be detected is obtained according to the set light field, and the image data is sent to the data processing terminal 16 after being preprocessed by the area array camera data preprocessing platform;

s5, the second workpiece position detection sensor 9 detects that the workpiece 2 to be detected leaves, and the area array camera of the area array camera station and the second program-controlled three-dimensional multi-light-field light source 10 stop working;

s6, the data processing terminal 16 identifies and classifies defects through a conventional algorithm according to the processing results of the linear array camera data preprocessing platform and the area array camera data preprocessing platform, if the defects can not be identified, the step S7 is carried out, otherwise, the step S8 is carried out;

S7, the data processing terminal 16 identifies and classifies defects based on a deep learning algorithm;

and S8, returning to the step S1 for recycling, and realizing online continuous detection.

preferably, before the deep learning algorithm is used in step S7, deep learning model training is performed using various types of defect image samples.

Meanwhile, it is worth mentioning that the method is started by sequentially opening the data processing terminal 16, the display and control component 17, the curved glass conveying device 1 and the temperature control system 19.

Obviously, the method and the curved glass defect detection system can clearly and accurately identify defects such as scratches, pits, impurities, edge breakage, notches and the like, and have the advantages of simplicity, high efficiency, high detection precision and low cost.

in the description above, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore should not be construed as limiting the scope of the present invention.

in conclusion, although the present invention has been described with reference to the preferred embodiments, it should be noted that, although various changes and modifications may be made by those skilled in the art, they should be included in the scope of the present invention unless they depart from the scope of the present invention.