阅读说明：本技术 一种多光谱影像测量系统和方法 (Multispectral image measuring system and method ) 是由 卢罗宗 郝健 呼江勇 于 2021-06-25 设计创作，主要内容包括：本发明提供了一种多光谱影像测量系统和方法,包括多光谱光源控制模块根据产品CT时间和表面材质可编程控制对应的光谱同步和亮度一致的高速频闪光源；多光谱成像模块根据产品CT时间和高速频闪光源保持一致,获取特定光谱下的图像；多光谱图像标定模块对特定光谱下的图像进行标定,计算出相关参数以便后续进行实时补偿；多光谱图像合成模块根据标定的相关参数将不同光谱下的图像进行处理并合成清晰的多光谱图像；软件处理模块,控制所述多光谱光源控制模块、多光谱成像模块、多光谱图像标定模块和多光谱图像合成模块之间进行数据交互。(The invention provides a multispectral image measuring system and a multispectral image measuring method, which comprise that a multispectral light source control module can control a corresponding high-speed stroboscopic light source with spectrum synchronization and consistent brightness in a programmable manner according to the CT time of a product and the quality of a surface material; the multispectral imaging module is used for obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source; the multispectral image calibration module calibrates an image under a specific spectrum and calculates related parameters for subsequent real-time compensation; the multispectral image synthesis module processes images under different spectrums according to the calibrated related parameters and synthesizes clear multispectral images; and the software processing module is used for controlling the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to carry out data interaction.)

1. A multispectral image measurement system is characterized by comprising

The multispectral light source control module is used for controlling the corresponding high-speed stroboscopic light source with spectrum synchronization and consistent brightness in a programmable manner according to the CT time of the product and the surface material;

the multispectral imaging module is used for obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

the multispectral image calibration module is used for calibrating the image under the specific spectrum and calculating related parameters so as to carry out real-time compensation subsequently;

the multispectral image synthesis module is used for processing images under different spectrums according to the calibrated related parameters and synthesizing clear multispectral images;

and the software processing module is used for controlling data interaction among the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module, sending control data to the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module and receiving feedback data.

2. The system according to claim 1, wherein the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction therebetween, specifically means that

And the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction based on software UI design and parameter design.

3. The system according to claim 2, wherein the software UI is a medium for information interaction with a user, and is configured to receive a control command from the user, and further configured to display an operation interface and an operation status of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module, wherein the parameter is configured to receive a user-defined parameter from the user, and further configured to display an operation parameter, a default parameter, and a user-defined parameter of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module.

4. The multispectral image measurement system according to claim 1, further comprising a cloud processing module, wherein the cloud processing module is connected to the software processing module, and provides cloud computing and cloud storage support for the software processing module.

5. The system according to claim 1, wherein the multispectral image calibration module calibrates the image under a specific spectrum, and calculates the related parameters for subsequent real-time compensation

The multispectral image calibration module calibrates the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of a neural network, and calculates related parameters so as to carry out real-time compensation subsequently.

6. The multispectral image measurement system according to claim 1, wherein the multispectral imaging module comprises a black-and-white industrial camera and an imaging controller, the annular LED lamp is sleeved around a lens of the black-and-white industrial camera, the imaging controller is respectively connected with the black-and-white industrial camera and the annular LED lamp to control the black-and-white industrial camera and the annular LED lamp to work highly synchronously, and in the specific implementation process, the exposure parameter of the black-and-white industrial camera is set to be 3ms to suppress the influence of ambient light; the imaging controller controls the annular LED lamp and the black-and-white industrial camera to complete the acquisition of the rapid specific spectrum image and the reconstruction of the spectrum reflectivity, the spectrum reflectivity of the detected product is obtained from the output signal of the black-and-white camera, and the surface of the product is at the time t_iTime is given by relative spectral power distribution as l (lambda, t)_i) Light source of (1), black and white industrial camera at time t_iThe output of time is O (t)_i)＝∫l(λ,t_i) r (λ) s (λ) d λ, r (λ) and s (λ) are the object spectral reflectance and the spectral sensitivity of a black and white industrial camera, respectively.

7. A multispectral image measurement method is characterized by comprising the following steps:

s1, according to the CT time and the surface material of the product, the corresponding spectrum synchronization and high-speed stroboscopic light source with consistent brightness can be controlled in a programmable manner;

s2, obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

s3, calibrating the image under the specific spectrum, and calculating related parameters for subsequent real-time compensation;

and S4, processing the images under different spectrums according to the calibrated related parameters and synthesizing a clear multispectral image.

8. The method for measuring multispectral images according to claim 7, wherein the step S3 of calibrating the image under the specific spectrum, calculating the related parameters for the subsequent real-time compensation means

And calibrating the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of the neural network, and calculating related parameters so as to perform real-time compensation subsequently.

9. The method according to claim 8, wherein the multispectral image measurement is obtained by training in the cloud using an adaptive real-time calibration algorithm of a neural network.

Technical Field

The present invention relates to a multispectral image measurement technology, and more particularly, to a multispectral image measurement system and method.

Background

With the development of science and technology, the requirements for the measurement accuracy and efficiency of various workpieces and parts are higher and higher, and the requirements for detection in the semiconductor manufacturing industry are also higher and higher. The image measurement perfectly combines an image measurement technology, an optical technology, a control technology and a software technology, realizes the non-contact accurate measurement of products, and is the first choice for detecting a plurality of products with high surface requirements due to the non-contact characteristic. The full-automatic image measurement has the characteristics of high intelligence and automation, and the whole measurement process becomes simple and easy. Through simple programming, the automatic image measurement can easily learn all real operation processes of an operator, and has high-precision repeatability. Therefore, operators are relieved from tired accurate visual alignment, monotonous operations such as frequent point selection, repeated walking, function switching and the like and increasingly heavy tasks to be tested, the workpiece batch testing efficiency is improved exponentially, and the requirements of industrial spot inspection and large-batch detection are met.

The Chinese patent with the publication number of CN111999254A discloses a dual-channel-based additive manufacturing defect detection system, which comprises a defect light source control module, a multispectral light source module, an image acquisition module and an image processing module; the multispectral light source module comprises a visible light source module and an infrared light source module; the visible light source module comprises a visible light source and a water cooling system, and the water cooling system is used for keeping the visible light source module to work stably; the infrared light source module comprises an infrared light source and a water cooling system, and the water cooling system is used for keeping the infrared light source working stably; the defect light source control module comprises an infrared light source stroboscopic controller and a visible light source stroboscopic controller, and is used for controlling the visible light source and the infrared light source to alternately strobe and emit light; the image acquisition module comprises an infrared lens and an industrial CCD; after multispectral light waves emitted by the multispectral light source module irradiate the surface of the additive workpiece, the spectral information on the surface of the workpiece is reflected to an infrared lens in the image acquisition module and then is acquired by an industrial CCD (charge coupled device); the image processing module is connected with the image acquisition module; the image analysis processing module is used for carrying out image processing and analysis on visible light and infrared imaging information of the additive manufactured parts acquired by the image acquisition module, and rapidly identifying and evaluating the defect types of the additive manufactured parts.

Chinese patent publication No. CN102974918A discloses a vision monitoring system based on multispectral spectral photography, which includes a camera, where the outer side of the camera is provided with more than one auxiliary light source, and the camera includes a half-transmitting and half-reflecting mirror, a first narrow-band filter, a first light-reducing element, a first planar array image sensor, a second narrow-band filter, a second light-reducing element and a second planar array image sensor; the light emitted by the auxiliary light source irradiates a welding workpiece, the light reflected by the welding workpiece is transmitted to the semi-transparent and semi-reflective mirror through the lens of the camera, the transmission light of the semi-transparent and semi-reflective mirror is transmitted to the first array image sensor through the first narrow band filter and the first dimming element in sequence to complete imaging, and the normal direction of the first narrow band filter is parallel to the transmission light; reflected light rays of the semi-transparent and semi-reflective mirror are transmitted to the second area array image sensor through the second narrow band filter and the second light reduction element in sequence to complete imaging, and the normal direction of the second narrow band filter is parallel to the reflected light rays; and the optical path of the light ray from the reflecting surface of the half-transmitting and half-reflecting mirror to the first area array image sensor along the transmission optical path is equal to the optical path of the light ray to the second area array image sensor along the reflection optical path.

In the existing workpiece detection technology, there is no related technical scheme for calibrating the captured images under a specific spectrum, calculating related parameters for subsequent real-time compensation, and automatically synthesizing clear multispectral images from images of different spectra by combining multispectral calibration parameters.

Disclosure of Invention

Aiming at the defects in the prior art, the invention aims to provide a multispectral image measuring system and a multispectral image measuring method, which are used for calibrating a picture captured under a specific spectrum, calculating related parameters so as to perform real-time compensation subsequently, automatically synthesizing clear multispectral pictures from pictures of different spectrums by combining multispectral calibration parameters, and avoiding errors caused by light source attenuation.

In order to achieve the purpose, the invention adopts the following specific technical scheme:

a multispectral image measurement system comprises

The multispectral light source control module is used for controlling the corresponding high-speed stroboscopic light source with spectrum synchronization and consistent brightness in a programmable manner according to the CT time of the product and the surface material;

the multispectral imaging module is used for obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

the multispectral image calibration module is used for calibrating the image under the specific spectrum and calculating related parameters so as to carry out real-time compensation subsequently;

the multispectral image synthesis module is used for processing images under different spectrums according to the calibrated related parameters and synthesizing clear multispectral images;

and the software processing module is used for controlling data interaction among the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module, sending control data to the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module and receiving feedback data.

Preferably, the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction, specifically, the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction

And the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction based on software UI design and parameter design.

Preferably, the software UI is a medium for performing information interaction with a user, and is configured to receive a control command input by the user, and also configured to display an operation interface and an operation status of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module, where the parameter design is configured to receive a user-defined parameter from the user, and also configured to display an operation parameter, a default parameter, and a user-defined parameter of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module.

Preferably, the cloud processing module is connected with the software processing module and provides cloud computing and cloud storage support for the software processing module.

Preferably, the multispectral image calibration module calibrates the image under the specific spectrum, and calculates the related parameters for subsequent real-time compensation specifically means

The multispectral image calibration module calibrates the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of a neural network, and calculates related parameters so as to carry out real-time compensation subsequently.

Preferably, the multispectral imaging module comprises a black-and-white industrial camera and an imaging controller, the annular LED lamp is sleeved on the periphery of a lens of the black-and-white industrial camera, the imaging controller is respectively connected with the black-and-white industrial camera and the annular LED lamp and controls the black-and-white industrial camera and the annular LED lamp to work in a highly synchronous mode, and in the specific implementation process, the exposure parameter of the black-and-white industrial camera is set to be 3ms so as to inhibit the influence of ambient light; the imaging controller controls the annular LED lamp and the black-and-white industrial camera to complete the acquisition of the rapid specific spectrum image and the reconstruction of the spectrum reflectivity, the spectrum reflectivity of the detected product is obtained from the output signal of the black-and-white camera, and the surface of the product is at the time t_iTime is given by relative spectral power distribution as l (lambda, t)_i) Light source of (1), black and white industrial camera at time t_iThe output of time is O (t)_i)＝∫l(λ,t_i) r (λ) s (λ) d λ, r (λ) and s (λ) are the object spectral reflectance and the spectral sensitivity of a black and white industrial camera, respectively.

A multispectral image measurement method specifically comprises the following steps:

s1, according to the CT time and the surface material of the product, the corresponding spectrum synchronization and high-speed stroboscopic light source with consistent brightness can be controlled in a programmable manner;

s2, obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

s3, calibrating the image under the specific spectrum, and calculating related parameters for subsequent real-time compensation;

and S4, processing the images under different spectrums according to the calibrated related parameters and synthesizing a clear multispectral image.

Preferably, the step S3 of calibrating the image under the specific spectrum and calculating the relevant parameters for the subsequent real-time compensation specifically means that

And calibrating the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of the neural network, and calculating related parameters so as to perform real-time compensation subsequently.

Preferably, the method is obtained by training in the cloud by adopting a self-adaptive real-time calibration algorithm of a neural network.

The invention has the beneficial effects that: the captured images under the specific spectrum are calibrated, relevant parameters are calculated so as to be convenient for subsequent real-time compensation, and clear multispectral images are automatically synthesized from the images of different spectrums by combining multispectral calibration parameters, so that errors caused by light source attenuation can be avoided. The measurement range is increased, multispectral measurement is achieved, high-speed measurement is achieved, and the measurement efficiency of the machine is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic block diagram of a multispectral image measurement system according to an embodiment of the present invention;

fig. 2 is a flowchart of a multispectral image measurement system according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Other embodiments, which can be derived by one of ordinary skill in the art from the embodiments given herein without any creative effort, shall fall within the protection scope of the present invention.

In the description of the present invention, it should be noted that the terms "vertical", "upper", "lower", "horizontal", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.

In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.

As shown in FIG. 1, the present invention provides a multi-spectral image measuring system, which comprises

The multispectral light source control module is used for controlling the corresponding high-speed stroboscopic light source with spectrum synchronization and consistent brightness in a programmable manner according to the CT time of the product and the surface material; ct (cycle time) is the time of a cycle, the time from the occurrence of an action to the next occurrence of the action, and the time difference between the output of every two adjacent products on the production line. The CT time of the product in the invention is the cycle time of the product.

Specifically, the luminous frequency of the high-speed stroboscopic light source is adjusted according to the CT time programming of the product, and the luminous brightness of the high-speed stroboscopic light source is adjusted according to the surface material of the product.

The high-speed stroboscopic light source irradiates the surface of the detected product with light rays in a proper mode, so that the contrast between the detected product and the background is increased, and the target is easy to extract and identify. In the embodiment, the high-speed stroboscopic light source adopts an annular LED lamp.

The multispectral light source control module can be used for controlling the corresponding high-speed stroboscopic light source with spectrum synchronization and consistent brightness in a programmable manner according to the CT time of the product and the surface material; before that, a light source database aiming at the material of the product surface can be established in advance, firstly, monochromatic LED lamps with different wave bands are used for irradiating the product surface to obtain product images under different spectrums, and the definition, the image contrast and the edge information of each product image are quantized and recorded; then, a multispectral light source is adopted to irradiate the surface of the product, product images under the multispectral are obtained, and the definition, the image contrast and the edge information of each product image are quantized and recorded; fusing the product images acquired by the single-color LED lamps based on an algebraic fusion algorithm to obtain fused multispectral images, and quantifying and recording the definition, the image contrast and the edge information of the fused multispectral images; quantifying, comparing and recording the product image under the multispectral and the fused multispectral image; and counting and summarizing to obtain a light source database aiming at the surface material of the product.

In a specific implementation process, the multispectral light source control module can match corresponding light sources from a light source database according to required definition, image contrast and edge information. The light source is a light source of a specific spectrum.

The multispectral imaging module is used for obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

the multispectral imaging module comprises a black-and-white industrial camera and an imaging controller, the annular LED lamp is sleeved on the periphery of a lens of the black-and-white industrial camera, and the imaging controller is respectively connected with the black-and-white industrial camera and the annular LED lamp and controls the black-and-white industrial camera and the annular LED lamp to work in a highly synchronous mode. In the specific implementation process, the exposure parameter of the black-and-white industrial camera is set to be 3ms so as to inhibit the influence of ambient light; the imaging controller controls the annular LED lamp and the black-and-white industrial camera to complete the acquisition of the rapid multispectral image and the reconstruction of the spectral reflectivity, and the measured product is obtained from the output signal of the black-and-white cameraSpectral reflectance of the product at time t_iTime is given by relative spectral power distribution as l (lambda, t)_i) Light source of (1), black and white industrial camera at time t_iThe output of time is O (t)_i)＝∫l(λ,t_i) r (λ) s (λ) d λ, r (λ) and s (λ) are the object spectral reflectance and the spectral sensitivity of a black and white industrial camera, respectively.

The multispectral image calibration module is used for calibrating the image under the specific spectrum and calculating related parameters so as to carry out real-time compensation subsequently;

the multispectral image calibration module receives the image from the specific spectrum, calibrates the image by adopting a four-point calibration method, and takes the related parameters of the specific spectrum and the four-point calibration method as a data set so as to facilitate subsequent related processing.

The multispectral image synthesis module is used for processing images under different spectrums according to the calibrated related parameters and synthesizing clear multispectral images; and (4) carrying out rotation, scaling and other processing on the images under different spectrums according to the data set, and combining the images into a clear multispectral image.

Specifically, the image merging algorithm includes a pixel-level image fusion algorithm, a feature-level image fusion algorithm and a decision-level image fusion algorithm, and any pixel-level image fusion algorithm can be selected according to the definition, the image contrast, the edge information and the customer requirements corresponding to the light source database-specific spectrum.

And the software processing module is used for controlling data interaction among the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module, sending control data to the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module and receiving feedback data.

Preferably, the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction, specifically, the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction

And the software processing module controls the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module and the multispectral image synthesis module to perform data interaction based on software UI design and parameter design.

Preferably, the software UI is a medium for performing information interaction with a user, and is configured to receive a control command input by the user, and also configured to display an operation interface and an operation status of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module, where the parameter design is configured to receive a user-defined parameter from the user, and also configured to display an operation parameter, a default parameter, and a user-defined parameter of the multispectral light source control module, the multispectral imaging module, the multispectral image calibration module, and the multispectral image synthesis module.

Preferably, the cloud processing module is connected with the software processing module and provides cloud computing and cloud storage support for the software processing module.

Preferably, the multispectral image calibration module calibrates the image under the specific spectrum, and calculates the related parameters for subsequent real-time compensation specifically means

The multispectral image calibration module calibrates the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of a neural network, and calculates related parameters so as to carry out real-time compensation subsequently.

In other embodiments, the multispectral imaging module may further employ a 3D camera, and the 3D camera needs to be calibrated before acquiring an image of a specific spectrum, and mainly calibrates internal parameters of the 3D camera, and needs to implement conversion between image coordinates and space coordinates. The 3D camera comprises two lenses, a coordinate system is respectively established for the two lenses, P is a point in a three-dimensional space, and the point P₁(X₁,Y₁)、p₂(X₂,Y₂) P is the imaging point of the two lenses on the imaging plane, f is the focal length of the two lenses, theta is the angle between the optical axis of the camera and the projection beam of the digital light projector, and d₁、d₂Respectively the distance from the light source to the optical centers of the two lenses, and the coordinate of P in the coordinate system corresponding to the first lens is P (x)₁，y₁，z₁) At the second placeThe coordinate in the coordinate system corresponding to each lens is P (x)₂，y₂，z₂) Then, thenCoordinates (u) of the imaged point in the image coordinate system₁，v₁) With imaging plane coordinates (X)₁，Y₁) In a relationship ofAndis the pixel size of the lens in two directions on the image coordinates, and therefore,in the same way, P (x) can be obtained₂，y₂，z₂)。

The invention integrates the technologies in the fields of computer vision, light source control, intelligent IO programming and the like, is the development trend in the field of intelligent manufacturing, and can be widely applied to online measurement and automatic high-precision laminating assembly of various industrial products such as mobile phone screens, hardware, circuit boards and the like. The method can provide a quick solution for detection, fitting and assembly of the parts of the smart phone, and has good economic and social benefits.

As shown in fig. 2, the present invention further provides a multispectral image measurement method, which specifically includes the following steps:

s1, according to the CT time and the surface material of the product, the corresponding spectrum synchronization and high-speed stroboscopic light source with consistent brightness can be controlled in a programmable manner; ct (cycle time) is the time of a cycle, the time from the occurrence of an action to the next occurrence of the action, and the time difference between the output of every two adjacent products on the production line. The CT time of the product in the invention is the cycle time of the product.

Specifically, the luminous frequency of the high-speed stroboscopic light source can be adjusted according to the CT time programming of the product, and the luminous brightness of the high-speed stroboscopic light source can be adjusted according to the surface material of the product. The high-speed stroboscopic light source irradiates the surface of the detected product with light rays in a proper mode, so that the contrast between the detected product and the background is increased, and the target is easy to extract and identify. In the embodiment, the high-speed stroboscopic light source adopts an annular LED lamp.

In other embodiments, a light source database for the material of the product surface can be established in advance, monochromatic LED lamps with different wave bands are firstly used for irradiating the product surface to obtain product images under different spectra, and the definition, image contrast and edge information of each product image are quantified and recorded; then, a multispectral light source is adopted to irradiate the surface of the product, product images under the multispectral are obtained, and the definition, the image contrast and the edge information of each product image are quantized and recorded; fusing the product images acquired by the single-color LED lamps based on an algebraic fusion algorithm to obtain fused multispectral images, and quantifying and recording the definition, the image contrast and the edge information of the fused multispectral images; quantifying, comparing and recording the product image under the multispectral and the fused multispectral image; and counting and summarizing to obtain a light source database aiming at the surface material of the product.

In a specific implementation process, the multispectral light source control module can match corresponding light sources from a light source database according to required definition, image contrast and edge information. The light source is a light source of a specific spectrum.

S2, obtaining an image under a specific spectrum according to the consistency of the CT time of the product and the high-speed stroboscopic light source;

the method comprises the steps that images under specific spectrums can be obtained, multispectral images can be obtained through a black-and-white industrial camera and an imaging controller, an annular LED lamp is sleeved on the periphery of a lens of the black-and-white industrial camera, the imaging controller is respectively connected with the black-and-white industrial camera and the annular LED lamp, and the black-and-white industrial camera and the annular LED lamp are controlled to work in a highly synchronous mode. In a specific implementation, the exposure parameter of the black and white industrial camera is set to 3ms to suppress the influence of ambient light.

The imaging controller controls the annular LED lamp and the black and white industrial camera to complete the acquisition of the fast multispectral image and the reconstruction of the spectral reflectivity. And obtaining the spectral reflectivity of the tested product from the output signal of the black and white camera. Product(s)Surface at time t_iTime is given by relative spectral power distribution as l (lambda, t)_i) Light source of (1), black and white industrial camera at time t_iThe output of time is O (t)_i)＝∫l(λ,t_i) r (λ) s (λ) d λ, r (λ) and s (λ) are the object spectral reflectance and the spectral sensitivity of a black and white industrial camera, respectively.

S3, calibrating the image under the specific spectrum, and calculating related parameters for subsequent real-time compensation;

and S4, processing the images under different spectrums according to the calibrated related parameters and synthesizing a clear multispectral image.

Preferably, the step S3 of calibrating the image under the specific spectrum and calculating the relevant parameters for the subsequent real-time compensation specifically means that

And calibrating the image under the specific spectrum by adopting a self-adaptive real-time calibration algorithm of the neural network, and calculating related parameters so as to perform real-time compensation subsequently.

Preferably, the method is obtained by training in the cloud by adopting a self-adaptive real-time calibration algorithm of a neural network.

The invention has the beneficial effects that: the captured images under the specific spectrum are calibrated, relevant parameters are calculated so as to be convenient for subsequent real-time compensation, and clear multispectral images are automatically synthesized from the images of different spectrums by combining multispectral calibration parameters, so that errors caused by light source attenuation can be avoided. The measurement range is increased, multispectral measurement is achieved, high-speed measurement is achieved, and the measurement efficiency of the machine is improved.

In light of the foregoing description of the preferred embodiments of the present invention, those skilled in the art can now make various alterations and modifications without departing from the scope of the invention. The technical scope of the present invention is not limited to the contents of the specification, and must be determined according to the scope of the claims.