Retina camera and its implementation
阅读说明：本技术 视网膜相机及其实现方法 (Retina camera and its implementation ) 是由 陈兵 邹兴文 赵泽宇 于 2019-09-17 设计创作，主要内容包括：本发明提供一种视网膜相机及其实现方法,相机包括：RGBW视网膜传感器,用于分别感知红、绿、蓝和白色的亮度分量后转换为对应的电信号；数据采集系统,用于采集所述RGBW视网膜传感器的电信号后发送至图像处理系统；图像处理系统,用于转换接收到的电信号为对应的原始图像信号,而后对所述原始图像信号依次进行色彩插值、RGB颜色分量恢复、颜色校正以及亮度颜色信号融合处理后,得到对应的色彩图像信号。本发明能实现相机光电感知灵敏度的提高,显著提高弱光环境下色彩图像的分辨率和灵敏度,使得在强光和弱光下都能得到高质量的彩色图像。(It includes: RGBW retina sensor that the present invention, which provides a kind of retina camera and its implementation, camera, is converted to corresponding electric signal after the luminance component for perceiving red, green, blue and white respectively；Data collection system is sent to image processing system after the electric signal for acquiring the RGBW retina sensor；Image processing system, for converting the electric signal received as corresponding original image signal, after then successively carrying out color interpolation, the recovery of RGB color component, color correction and the processing of lightness colors signal fused to the original image signal, corresponding color image signal is obtained.The present invention is able to achieve the raising that camera light inductance knows sensitivity, significantly improves the resolution ratio and sensitivity of color image under low light environment, so that can obtain the color image of high quality under strong light and dim light.)
1. a kind of retina camera, which is characterized in that including sequentially connected RGBW retina sensor, data collection system and Image processing system；
The RGBW retina sensor, for being converted to corresponding electricity after perceiving red, green, blue and white luminance component respectively Signal；
The data collection system is sent to image procossing system after the electric signal for acquiring the RGBW retina sensor System；
Described image processing system, for converting the electric signal received into corresponding original image signal, then to the original Beginning picture signal successively carries out color interpolation, RGB color component restores, color correction and lightness colors signal fused are handled Afterwards, corresponding color image signal is obtained.
2. a kind of retina camera as described in claim 1, which is characterized in that the RGBW retina sensor includes difference The RGB photosensitive unit and W photosensitive unit being connect with data collection system；
The RGB photosensitive unit, for perceiving the luminance component including red, green and blue；
The W photosensitive unit, for perceiving the luminance component of white.
3. a kind of retina camera as described in claim 1, which is characterized in that described image processing system includes being sequentially connected Decoding unit, interpolating unit, component recovery unit, correction unit and integrated unit；
The decoding unit obtains corresponding parallel photoreceptor signal, then by the parallel sense for being decoded to electric signal Optical signal is converted to corresponding serial original image signal；
The interpolating unit obtains each pixel for carrying out interpolation processing to the Bayer signal component in original image signal The corresponding R component signal of point, G component signal, B component signal, W component signal and IR component signal；
The component recovery unit, for removing the corresponding R component signal of each pixel, G component signal, B component letter respectively IR component signal in number obtains true R component signal, true G component signal and true the B component letter of each pixel Number；
The correction unit, for true R component signal, true G component signal and the true B to each pixel points It measures signal and carries out color correction, the RGB image after obtaining color rendition；
The integrated unit is obtained for merging the corresponding W component signal of the RGB image after the correction of each pixel The color image signal of each pixel.
4. a kind of retina camera as described in claim 1, which is characterized in that the RGBW retina sensor, data are adopted Collecting system and image processing system are integrated on mainboard module.
5. a kind of retina camera implementation method characterized by comprising
Corresponding electric signal is converted to after perception red, green, blue and the luminance component of white respectively；
Image processing system is sent to after acquiring the electric signal of the RGBW retina sensor；
The electric signal received is converted as corresponding original image signal, color is successively then carried out to the original image signal Interpolation, RGB color component restore, after color correction and the processing of lightness colors signal fused, obtain corresponding color image letter Number.
6. a kind of retina camera implementation method as claimed in claim 5, which is characterized in that described to perceive red, green, blue respectively With white luminance component, specifically:
Perception includes the luminance component of red, green and blue；
Perceive the luminance component of white.
7. a kind of retina camera implementation method as claimed in claim 5, which is characterized in that described to convert the telecommunications received Number be corresponding original image signal, specifically:
Electric signal is decoded, corresponding parallel photoreceptor signal is obtained, the parallel photoreceptor signal is then converted into correspondence Serial original image signal；
The color interpolation, specifically:
Interpolation processing is carried out to the Bayer signal component in original image signal, obtains the corresponding R component letter of each pixel Number, G component signal, B component signal, W component signal and IR component signal；
The RGB color component restores, specifically:
The corresponding R component signal of each pixel, G component signal, the IR component signal in B component signal are removed respectively, are obtained True R component signal, true G component signal and the true B component signal of each pixel；
The color correction, specifically:
Color school is carried out to the true R component signal, true G component signal and true B component signal of each pixel Just, the RGB image after obtaining color rendition；
The lightness colors signal fused, specifically:
The corresponding W component signal fusion of RGB image after the correction of each pixel, obtains the color image of each pixel Signal.
Technical field
The present invention relates to field optics and technical field of imaging, and in particular to a kind of retina camera and its implementation.
Background technique
With the continuous improvement of visual imaging industry requirement, have to the performance indicator such as sensitivity etc. of imaging device higher It is required that.Conventional color camera is imaged very under light field (i.e. strong light) based on the sensor design of RGGB type Bayer distribution It is good, but in dark field, i.e., the sensing capability under dim light or pole dim light is short of, so that the optical imagery under dark field is very poor.
Human visual system is by retina cell to the perception of light, and cone cell is responsible for perceiving strong light and color, about There are 7,000,000, is distributed mainly on macula lutea central recess；Rod cell 8 is responsible for induction dim light and without colour vision, up to 120,000,000, Just there is rod cell since central recess edge, then rod cell increasing number outward.The wherein quantity of rod cell 8 It is as many as 18 times of cone cell, rod cell plays a major role under dark field low light environment.It is distributed as shown in Figure 1, original image From related data, so according to the ratio of rod cell and cone cell and being distributed this characteristic, we can be thin by the cone Born of the same parents are equivalent to red (R), green (G) and blue (B) filter unit in photoelectric sensor part, and rod cell is considered as white (W) filter unit, to improve the sensitivity of photoelectricity sension unit.
Summary of the invention
The technical problems to be solved by the present invention are: providing a kind of retina camera and its implementation, guaranteeing daytime While image quality, high-resolution, highly sensitive color image can also be obtained in the environment of atomic dim light by realizing.
In order to solve the above-mentioned technical problem, the technical solution adopted by the present invention are as follows:
A kind of retina camera, including sequentially connected RGBW retina sensor, data collection system and image procossing System；
The RGBW retina sensor, for being converted to correspondence after perceiving red, green, blue and white luminance component respectively Electric signal；
The data collection system is sent to image procossing after the electric signal for acquiring the RGBW retina sensor System；
Described image processing system, for converting the electric signal received into corresponding original image signal, then to institute Original image signal is stated successively to carry out at color interpolation, the recovery of RGB color component, color correction and lightness colors signal fused After reason, corresponding color image signal is obtained.
Another technical solution provided by the invention are as follows:
A kind of retina camera implementation method, comprising:
Corresponding electric signal is converted to after perception red, green, blue and the luminance component of white respectively；
Image processing system is sent to after acquiring the electric signal of the RGBW retina sensor；
The electric signal received is converted as corresponding original image signal, then the original image signal is successively carried out Color interpolation, RGB color component restore, after color correction and the processing of lightness colors signal fused, obtain corresponding chromaticity diagram As signal.
The beneficial effects of the present invention are: ratio and distribution character based on rod cell and cone cell, the cone is thin Born of the same parents are equivalent to red (R), green (G) and blue (B) filter unit in photoelectric sensor part, and rod cell is considered as white (W) the analysis processing that photosignal is carried out after filter unit, realizes that camera light inductance knows the raising of sensitivity with this, so that strong The color image that high quality can be obtained under light and dim light, especially significantly improve under low light environment the resolution ratio of color image and Sensitivity.
Detailed description of the invention
Fig. 1 is retina cell's distribution schematic diagram of human visual system；
Fig. 2 is a kind of structure connection diagram of retina camera of one embodiment of the invention；
Fig. 3 is a kind of structure connection diagram of retina camera of the embodiment of the present invention one；
Fig. 4 is a kind of flow chart of data processing signal of the image processing system of retina camera of the embodiment of the present invention one Figure；
Fig. 5 is the Bayer signal component distribution schematic diagram of RGBWIR in the embodiment of the present invention two；
Fig. 6 is the pixel arrangement figure referred to when executing W difference in the embodiment of the present invention two；
Fig. 7 is the pixel arrangement figure referred to when executing IR interpolation in the embodiment of the present invention two；
Fig. 8 is the pixel arrangement figure referred to when executing the RGB difference for having IR in the embodiment of the present invention two；
Fig. 9 is a kind of structural schematic diagram of retina camera of the embodiment of the present invention three.
Label declaration:
1, RGBW retina senses；2, data collection system；3, image processing system；
4, display；5, red cones cell；6, green cone cell；7, blue cones cell；
8, rod cell；9, lower casing；10, interface plate module；11, middle shell；12, mainboard module；
13, heat-conducting plate；14, dust protection rubber；15, retainer ring；16, window；17, copper gasket；
18, sealing ring；19, upper casing；20, C mouthfuls of adapter rings.
Specific embodiment
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and cooperate attached Figure is explained.
The most critical design of the present invention is: sensor uses retina sensor, and by image processing system to sense Optical signal carries out a series of processing, to can obtain the color image of high quality under strong light and dim light.
Explanation of technical terms of the present invention:
Fig. 1 and Fig. 2 is please referred to, the present invention provides a kind of retina camera, including sequentially connected RGBW retina passes Sensor, data collection system and image processing system；
The RGBW retina sensor, for being converted to correspondence after perceiving red, green, blue and white luminance component respectively Electric signal；
The data collection system is sent to image procossing after the electric signal for acquiring the RGBW retina sensor System；
Described image processing system, for converting the electric signal received into corresponding original image signal, then to institute Original image signal is stated successively to carry out at color interpolation, the recovery of RGB color component, color correction and lightness colors signal fused After reason, corresponding color image signal is obtained.
Further, the RGBW retina sensor includes the RGB photosensitive unit connecting respectively with data collection system With W photosensitive unit；
The RGB photosensitive unit, for perceiving the luminance component including red, green and blue；
The W photosensitive unit, for perceiving the luminance component of white.
Seen from the above description, independent, the accurate perception to each luminance component is realized.
Further, described image processing system includes sequentially connected decoding unit, interpolating unit, component recovery list Member, correction unit and integrated unit；
The decoding unit obtains corresponding parallel photoreceptor signal, then by described in simultaneously for being decoded to electric signal Row photoreceptor signal is converted to corresponding serial original image signal；
The interpolating unit obtains each for carrying out interpolation processing to the Bayer signal component in original image signal The corresponding R component signal of pixel, G component signal, B component signal, W component signal and IR component signal；
The component recovery unit, for removing the corresponding R component signal of each pixel, G component signal, B point respectively The IR component signal in signal is measured, the true R component signal, true G component signal and true B component of each pixel are obtained Signal；
The correction unit, for true R component signal, the true G component signal and true to each pixel Real B component signal carries out color correction, the RGB image after obtaining color rendition；
The integrated unit, for the corresponding W component signal of the RGB image after the correction of each pixel to be merged, Obtain the color image signal of each pixel.
Seen from the above description, by a series of processing of image processing system, high-resolution, Gao Ling can be obtained with making laughs The color image of sensitivity.
Further, the RGBW retina sensor, data collection system and image processing system are integrated in mainboard mould On block.
Seen from the above description, kernel component is concentrated and is laid, effective protective action can be played to it, while also can Volume is reduced to occupy.
Another technical solution provided by the invention are as follows:
A kind of retina camera implementation method, comprising:
Corresponding electric signal is converted to after perception red, green, blue and the luminance component of white respectively；
Image processing system is sent to after acquiring the electric signal of the RGBW retina sensor；
The electric signal received is converted as corresponding original image signal, then the original image signal is successively carried out Color interpolation, RGB color component restore, after color correction and the processing of lightness colors signal fused, obtain corresponding chromaticity diagram As signal.
Further, the luminance component of the perception red, green, blue and white respectively, specifically:
Perception includes the luminance component of red, green and blue；
Perceive the luminance component of white.
Further, the electric signal received of converting is corresponding original image signal, specifically:
Electric signal is decoded, corresponding parallel photoreceptor signal is obtained, is then converted to the parallel photoreceptor signal Corresponding serial original image signal；
The color interpolation, specifically:
Interpolation processing is carried out to the Bayer signal component in original image signal, obtains the corresponding R component of each pixel Signal, G component signal, B component signal, W component signal and IR component signal；
The RGB color component restores, specifically:
The corresponding R component signal of each pixel, G component signal, the IR component signal in B component signal are removed respectively, Obtain the true R component signal, true G component signal and true B component signal of each pixel；
The color correction, specifically:
Face is carried out to the true R component signal, true G component signal and true B component signal of each pixel Color correction, the RGB image after obtaining color rendition；
The lightness colors signal fused, specifically:
The corresponding W component signal fusion of RGB image after the correction of each pixel, obtains the color of each pixel Picture signal.
Please refer to Fig. 1-4, the embodiment of the present invention one are as follows:
As shown in Figure 1, according to rod cell 8 and cone cell (including red cones cell 5, green cone cell 6 and Cyanopia Bore cell 7) ratio and be distributed this characteristic, we cone cell can be equivalent to red (R) in photoelectric sensor part, Rod cell is considered as white (W) filter unit, to obtain the view of the present embodiment by green (G) and blue (B) filter unit Film camera.
A kind of retina camera, including sequentially connected photoelectricity sensory perceptual system, data collection system, image processing system, Data transmission system and display system；
Referring to Fig. 3, the photoelectricity sensory perceptual system is photosensitive by the progress of RGBW retina sensor, it is substantially back-illuminated type light Electric transducer sCMOS can provide light-receiving area and closely provide photoelectric conversion efficiency, have to avoid light by the interference of wiring layer There is high sensitivity.Specifically, the RGBW retina sensor includes RGB photosensitive unit, W photosensitive unit and conversion Unit；The RGB photosensitive unit, for perceiving the luminance component including red, green and blue, the i.e. color of 400nm~760nm point Amount；The W photosensitive unit, for perceiving the luminance component of white, i.e. 400~1000nm luminance component；The converting unit is used In the reception for the near-infrared wavelength signal for being responsible for 760nm-1000nm, and RGB photosensitive unit and W photosensitive unit perceived bright Degree component is converted to corresponding electric signal.
The data collection system is sent to image procossing after the electric signal for acquiring the RGBW retina sensor System；
Referring to Fig. 4, described image processing system, believes for converting the electric signal received into corresponding original image Number, color interpolation, the recovery of RGB color component, color correction and brightness face are then successively carried out to the original image signal After chrominance signal fusion treatment, corresponding color image signal is obtained.
Specifically, described image processing system can be FPGA image processing system, including sequentially connected decoding list Member, interpolating unit, component recovery unit, correction unit and integrated unit, it is corresponding to realize above-mentioned each function.
Wherein, decoding unit is used to be decoded electric signal (LVDS signal), obtains corresponding parallel photoreceptor signal, The parallel photoreceptor signal is then converted to the serial image picture element signal for being more advantageous to signal processing, i.e. original image signal RGBWIR；
The interpolating unit, for being carried out at interpolation respectively to the Bayer signal component in original image signal RGBWI Reason, so that each pixel all has signal component in 4, i.e. R component signal, G component signal, B component signal, W component signal And IR component signal；
The component recovery unit, because R component, G component and B component signal that interpolating unit obtains contain near-infrared IR component, therefore, it is necessary to component recovery units to remove the IR component in R component, G component and B component signal respectively, obtain true R, G, B component signal.
The correction unit carries out color correction for the true rgb signal to each pixel, i.e., respectively to true R Component signal, true G component signal and true B component signal carry out color correction, the RGB image after obtaining color rendition；
The integrated unit, for the corresponding W component signal of the RGB image after the correction of each pixel to be merged, That is color (RGB) and brightness (W) fusion obtains the color image signal of each pixel high sensitivity；
And the data transmission system of system, it is responsible for that treated highly sensitive meets the mankind by image processing system The color image signal (final vision signal) of vision system is transmitted to display module and is shown.
Referring to figure 5. -8, the embodiment of the present invention two are as follows:
The present embodiment is further to the image processing system in embodiment one to be limited.
One, to the Bayer signal component difference of RGBWIR performed by the decoding unit in described image processing system Method is as follows:
By the Bayer diagram of Fig. 5 it is found that the distribution mode of W, IR and the RGB with IR are different, therefore are respectively adopted Interpolation method is also different, should retain details as far as possible for W；And for IR and the RGB interpolation with IR be terrible To the true RGB of more high s/n ratio, it is finally served only for color, so its interpolation method is denoising as far as possible.
(1) W interpolation
As shown in fig. 6, every row dot interlace is distributed an all-pass component W in pixel arrangement, each column dot interlace is distributed a W, i.e., There are 2 W on diagonal line in every 2 × 2 four pixels.Therefore, W realizes the interpolation of remaining 1/2 pixel pixel using following algorithm, That is W22 judges that edge direction carries out interpolation by W12 and W32, W21 and W23, and formula is as follows:
In formula, i, j, which are respectively represented, currently needs the corresponding row and column coordinate of interpolation W, and thw is empirical value, is taken here 8bit corresponding 4.
(2) IR interpolation
As shown in fig. 7, every 4 pixels just have an IR, interlacing just has RI every column, but the effect of IR is primarily to extensive Multiple true RGB is used, therefore is suitble to the interpolation algorithm using low pass behavior, following formula (2).
For there is an interpolation of lacked IR on the row of IR, and have the interpolation of lacked IR on the column of IR on column, be all made of 2 points it is linear Interpolation algorithm, other are using 4 linear interpolation algorithms on diagonal line.
(3) the RGB interpolation of IR is had
As shown in figure 8, for the RGB color component for having IR, containing there are two GIR, one in every 4 × 4 i.e. 16 pixels RIR and BIR, i.e. green are 2 times of red indigo plant, this is identical with traditional Bayer distribution proportion.For any scarce component of institute, Amphicheirality's interpolation algorithm is all made of to realize.
If wanting interpolation GIR, there is formula:
If wanting interpolation RIR or BIR, amphicheirality's interpolation, i.e. formula 4 are directly utilized:
Wherein,I, j are respectively the row and column of current desired interpolating pixel, and mod is complementation fortune It calculates.
Similarly, BIR is identical as RIR.
Two, the method that the component recovery unit execution restores true RGB color component is as follows:
According to spectral response characteristic, RIR, GIR and BIR after interpolation have IR component, it is therefore necessary to be removed ability True colour is presented, otherwise because of the influence of IR component, image will necessarily be partially red.
RGB removes the influence of IR component by following equation 5, i.e.,
Wherein a, b, c are respectively impact factor of the IR to RGB component；A, b, c are by shooting standard under a certain light source Colour atla image obtains the RGB component average value of colour atla, is then fitted by least-squares algorithm and generates coefficient, fitting algorithm is not Minimal Fitting Algorithm is only included, further includes other fitting algorithms commonly used in the art.
Three, the method for correction unit execution RGB component color correction is as follows:
Color rendition refers to that first passing through standard color card is fitted to obtain color rendition Matrix C CM, in the colour temperature of different light sources Under, it obtains 24 colour atla images and calculates the average value of colour atla, 3 × 3 color correction matrix is calculated by least square method Then CCM obtains the image after color rendition by following equation 6:
Four, it is as follows to execute the method that W is merged with RGB for integrated unit:
W represents luminance information, if the RGB after correction merges W, will improve the sensitivity of retina camera, such as W is directly replaced the brightness in RGB by fruit, then fused color will change, therefore, fusion steps are as follows:
Step1: RGB is transformed by the domain YUV by formula 7:
In formula, Y, U, V are illustrated respectively in the luminance component, blue component and red component in the domain YUV, are 16 processing here Camera, therefore the offset of UV be 32768.
Step2: Y is replaced with W:
Y in YUV is replaced by W, such camera there will be higher sensitivity.
Step3:UV gain calibration calculates:
Calculate UV correction coefficient, since Y is substituted by W, correction coefficient kuv are as follows:
Wherein, the purpose of Y+1 is in order to which denominator is not zero.
Then, UV is corrected respectively, i.e.,
By handling above, will obtain with true colors and the very high retina camera processing effect of sensitivity.
Please refer to Fig. 9, the embodiment of the present invention three are as follows:
Based on embodiment one or embodiment two, provided retina camera is further defined that
A kind of retina camera, as shown, including camera case (lower casing 9, middle shell 11 and upper casing 19), C mouthfuls of adapter rings 20, sealing ring 18, copper gasket 17, window 16, retainer ring 15, dust protection rubber 14, heat-conducting plate 13, interface plate module 10 and mainboard module 12。
Mainboard module 12 includes the core systems such as RGBW retina sensor and image processing system.As shown in figure 3, mainboard Module 12 include sequentially connected RGBW retina sensor 1, LVDS data collection system (corresponding data acquisition system 2), FPGA image processing system (correspondence image processing system 3) and USB image delivering system.
The embodiment of the present invention four are as follows:
The present embodiment corresponding embodiment one or embodiment two provide a kind of retina camera implementation method, comprising:
Corresponding electric signal is converted to after perception red, green, blue and the luminance component of white respectively；
Image processing system is sent to after acquiring the electric signal of the RGBW retina sensor；
The electric signal received is converted as corresponding original image signal, then the original image signal is successively carried out Color interpolation, RGB color component restore, after color correction and the processing of lightness colors signal fused, obtain corresponding chromaticity diagram As signal.
Further, the luminance component of the perception red, green, blue and white respectively, specifically:
Perception includes the luminance component of red, green and blue；
Perceive the luminance component of white.
Further, the electric signal received of converting is corresponding original image signal, specifically:
Electric signal is decoded, corresponding parallel photoreceptor signal is obtained, is then converted to the parallel photoreceptor signal Corresponding serial original image signal；
The color interpolation, specifically:
Interpolation processing is carried out to the Bayer signal component in original image signal, obtains the corresponding R component of each pixel Signal, G component signal, B component signal, W component signal and IR component signal；
The RGB color component restores, specifically:
The corresponding R component signal of each pixel, G component signal, the IR component signal in B component signal are removed respectively, Obtain the true R component signal, true G component signal and true B component signal of each pixel；
The color correction, specifically:
Face is carried out to the true R component signal, true G component signal and true B component signal of each pixel Color correction, the RGB image after obtaining color rendition；
The lightness colors signal fused, specifically:
The corresponding W component signal fusion of RGB image after the correction of each pixel, obtains the color of each pixel Picture signal.
In conclusion a kind of retina camera provided by the invention and its implementation, are able to achieve camera light inductance and know spirit The raising of sensitivity significantly improves the resolution ratio and sensitivity of color image under low light environment, so that can under strong light and dim light Obtain the color image of high quality；Meanwhile independent perception, calculating and processing are carried out for each luminance component, it is ensured that calculate knot The precision of fruit；Finally, also having the features such as compact-sized, small in size, practicability is high.
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, similarly include In scope of patent protection of the invention.
- 上一篇：一种医用注射器针头装配设备
- 下一篇：一种光热光学相干层析成像方法及系统