阅读说明：本技术 色温测试方法及装置、计算机可读介质和电子设备 (Color temperature testing method and device, computer readable medium and electronic equipment ) 是由 王文涛 于 2021-08-23 设计创作，主要内容包括：本公开提供一种色温测试方法、色温测试装置、计算机可读介质和电子设备,涉及光谱识别技术领域。该方法包括：基于色温传感器的多个感光单元采集当前场景对应的原始光谱矩阵,多个感光单元的中心波长包括多种取值；获取色温传感器对应的校正矩阵,通过校正矩阵对原始光谱矩阵进行校正,得到校正后的光谱矩阵。本公开利用中心波长取值不同的多个感光单元对可识别波段的光谱进行分割,可以实现更准确和响应度更高的光谱重构,提高了光谱识别的准确性,进而可以提升成像结果的色彩表现力。(The disclosure provides a color temperature testing method, a color temperature testing device, a computer readable medium and electronic equipment, and relates to the technical field of spectrum identification. The method comprises the following steps: the method comprises the steps that a plurality of light sensing units based on a color temperature sensor acquire an original spectrum matrix corresponding to a current scene, and the central wavelengths of the light sensing units comprise various values; and acquiring a correction matrix corresponding to the color temperature sensor, and correcting the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix. The spectrum of the identifiable wave band is segmented by the multiple photosensitive units with different central wavelength values, so that more accurate spectrum reconstruction with higher responsivity can be realized, the accuracy of spectrum identification is improved, and the color expressive force of an imaging result can be improved.)

1. A color temperature test method, comprising:

collecting an original spectrum matrix corresponding to a current scene by a plurality of light sensing units based on a color temperature sensor, wherein the central wavelengths of the light sensing units comprise various values;

and acquiring a correction matrix corresponding to the color temperature sensor, and correcting the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

2. The method of claim 1, wherein the obtaining a correction matrix corresponding to the color temperature sensor comprises:

acquiring calibration spectrum matrixes corresponding to calibration light based on the plurality of photosensitive units, and acquiring spectrum line matrixes corresponding to the calibration light;

and calculating the correction matrix according to the calibration spectrum matrix and the spectral line matrix.

3. The method of claim 2, wherein the calibration light comprises a monochromatic light, and wherein a tuning range of the monochromatic light coincides with the central wavelength range defined by the plurality of values.

4. The method of claim 2, wherein calculating the correction matrix from the calibration spectral matrix and the spectral line matrix comprises:

and taking the calibration spectrum matrix and a preset matrix as calculation input of a preset calculation method, and adjusting matrix parameters in the preset matrix to obtain a correction matrix so as to enable the calculation output of the preset calculation method to be equal to the spectrum line matrix.

5. The method of claim 4, wherein the correcting the original spectrum matrix by the correction matrix to obtain a corrected spectrum matrix comprises:

and calculating by taking the original spectrum matrix and the correction matrix as calculation inputs of the preset calculation method, and taking the calculation output as a corrected spectrum matrix.

6. The method of claim 1, wherein the color temperature sensor comprises a short wave infrared sensor.

7. The method of claim 1, wherein any two of the plurality of values include any value therebetween.

8. A color temperature test apparatus, comprising:

the data acquisition module is used for acquiring an original spectrum matrix corresponding to a current scene based on a plurality of photosensitive units of the color temperature sensor, wherein the central wavelengths of the photosensitive units comprise a plurality of values;

and the data correction module is used for acquiring a correction matrix corresponding to the color temperature sensor, and correcting the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

9. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 7.

10. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the method of any of claims 1-7 via execution of the executable instructions.

Technical Field

The disclosure relates to the technical field of spectrum identification, in particular to a color temperature testing method, a color temperature testing device, a computer readable medium and electronic equipment.

Background

In electronic devices, silicon-based sensors are generally used for light source detection and spectral recognition, and then imaging. Wherein, the imaging process is as follows: referring to fig. 1 and 2, a light source S (λ) is irradiated on an object, and after the object is acted on, a reflection spectrum is a convolution of a light source spectrum and an object reflection function, and is denoted as H (λ) ═ S (λ) × (λ); where ρ (λ) is the reflectance function of the object; reflected light H (lambda) is transmitted into the imaging sensor through the imaging lens, convolution is carried out in different channels of the imaging sensor to obtain blind channel convolution values, and then the CCT meter of the current ambient light is carried out through the channel convolution valuesAnd calculating to calculate the gain of each channel of the AWB, and finally obtaining the color coordinate of the current scene. For example, there are three channels in the imaging sensorThe intensity values detected by each channel are respectively as follows:

at this time, the CCT of the current ambient light is calculated by the detected x, y, z values, and the gain of each channel of the AWB is calculated, so that the color coordinates of the current scene can be obtained finally.

When the sensor performs color temperature measurement, color temperature measurement of ambient light may be achieved based on the multispectral image. Specifically, color blocks in a standard color plate can be calibrated in advance to obtain multispectral data of each color module, then the color temperature of ambient light is changed to obtain multispectral data of the color blocks under different color temperatures, and a related database is established. When the device is used, comparison and analysis are carried out according to the collected multispectral data, the data are regressed through least square fitting, and the reflection function and the light source color temperature of the shooting object are determined.

However, this method is implemented using an area array sensor, and has a large data volume and high power consumption; meanwhile, a uniform single light source is required to be used for irradiation in the calibration process, and the light source environment in an actual application scene is often complex and cannot meet the condition; in addition, only the standard color plate is calibrated, so that the number of objects is small, and the real scene is easy to lose effectiveness.

Disclosure of Invention

The present disclosure is directed to a color temperature testing method, a color temperature testing apparatus, a computer readable medium, and an electronic device, so as to improve the accuracy of a spectral matrix at least to a certain extent, and further improve the color expressive power of imaging.

According to a first aspect of the present disclosure, there is provided a color temperature test method, comprising: collecting an original spectrum matrix corresponding to a current scene by a plurality of light sensing units based on a color temperature sensor, wherein the central wavelengths of the light sensing units comprise various values; and acquiring a correction matrix corresponding to the color temperature sensor, and correcting the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

According to a second aspect of the present disclosure, there is provided a color temperature testing apparatus including: the data acquisition module is used for acquiring an original spectrum matrix corresponding to a current scene based on a plurality of photosensitive units of the color temperature sensor, wherein the central wavelengths of the photosensitive units comprise a plurality of values; and the data correction module is used for acquiring a correction matrix corresponding to the color temperature sensor, and correcting the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

According to a third aspect of the present disclosure, a computer-readable medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, is adapted to carry out the above-mentioned method.

According to a fourth aspect of the present disclosure, there is provided an electronic apparatus, comprising: a processor; and memory storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the above-described method.

According to the color temperature testing method provided by the embodiment of the disclosure, the original spectrum matrix corresponding to the current scene is collected through the color temperature sensor composed of the plurality of photosensitive units with the central wavelengths including various values, and then the original spectrum matrix is corrected based on the correction matrix corresponding to the color temperature sensor, so that the corrected spectrum matrix can be obtained. The spectrum of the identifiable wave band is segmented by the multiple photosensitive units with different central wavelength values, so that more accurate spectrum reconstruction with higher responsivity can be realized, the accuracy of spectrum identification is improved, and the color expressive force of an imaging result can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty. In the drawings:

FIG. 1 shows a schematic imaging flow diagram of a silicon-based sensor;

FIG. 2 shows a schematic diagram of data processing in imaging of a silicon-based sensor;

FIG. 3 illustrates a schematic diagram of an exemplary system architecture to which embodiments of the present disclosure may be applied;

FIG. 4 shows a schematic diagram of an electronic device to which embodiments of the present disclosure may be applied;

FIG. 5 shows the absorption of incident light at different wavelengths by a silicon-based material;

FIG. 6 schematically illustrates a flow chart of a color temperature testing method in an exemplary embodiment of the present disclosure;

FIG. 7 schematically illustrates a structural diagram of a color temperature sensor in an exemplary embodiment of the disclosure;

FIG. 8 schematically shows response curves of 6 channels in a multi-channel multi-spectral short-wave infrared color temperature sensor;

FIG. 9 is a schematic diagram schematically illustrating a color temperature testing method in an exemplary embodiment of the present disclosure;

FIG. 10 schematically illustrates a calibration process in an exemplary embodiment of the disclosure;

FIG. 11 schematically illustrates a schematic diagram of a multiplication-based calculation of a correction matrix in an exemplary embodiment of the disclosure;

fig. 12 schematically shows a composition diagram of a color temperature testing apparatus in an exemplary embodiment of the present disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

Fig. 3 is a schematic diagram illustrating a system architecture of an exemplary application environment to which the color temperature testing method and apparatus according to the embodiments of the present disclosure may be applied.

As shown in fig. 3, the system architecture 300 may include one or more of terminal devices 301, 302, 303, a network 304, and a server 305. The network 304 serves as a medium for providing communication links between the terminal devices 301, 302, 303 and the server 305. Network 304 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few. The terminal devices 301, 302, 303 may be various terminal devices configured with a color temperature sensor, and the color temperature sensor includes a plurality of light sensing units whose central wavelengths include various values; for example, desktop computers, portable computers, smart phones, tablet computers, and the like, configured with color temperature sensors, may be included, but are not limited thereto. It should be understood that the number of terminal devices, networks, and servers in fig. 3 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation. For example, server 305 may be a server cluster comprised of multiple servers, or the like.

The color temperature testing method provided by the embodiment of the disclosure is generally executed by the terminal equipment 301, 302, 303, and accordingly, the color temperature testing device is generally arranged in the terminal equipment 301, 302, 303. However, it is easily understood by those skilled in the art that the color temperature testing method provided in the embodiment of the present disclosure may also be executed by the server 305, and accordingly, the color temperature testing apparatus may also be disposed in the server 305, which is not particularly limited in the present exemplary embodiment. For example, in an exemplary embodiment, the server 305 may control the color temperature sensors configured in the terminal devices 301, 302, 303 to acquire the raw spectrum matrix corresponding to the current scene, and acquire the correction matrix corresponding to the color temperature sensors configured in the terminal devices 301, 302, 303 through the network 304; and then, the spectrum matrix is sent to the server 305 through the network 304, and after receiving the original spectrum matrix and the correction matrix, the server 305 corrects the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

Exemplary embodiments of the present disclosure provide an electronic device for implementing a color temperature test method, which may be the terminal device 301, 302, 303 or the server 305 in fig. 3. The electronic device comprises at least a processor and a memory for storing executable instructions of the processor, the processor being configured to perform the color temperature testing method via execution of the executable instructions.

The following takes the mobile terminal 400 in fig. 4 as an example, and exemplifies the configuration of the electronic device. It will be appreciated by those skilled in the art that the configuration of figure 4 can also be applied to fixed type devices, in addition to components specifically intended for mobile purposes. In other embodiments, the mobile terminal 400 may include more or fewer components than illustrated, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The interfacing relationship between the various components is shown schematically and does not constitute a structural limitation of the mobile terminal 400. In other embodiments, the mobile terminal 400 may also interface differently than shown in fig. 4, or a combination of multiple interfaces.

As shown in fig. 4, the mobile terminal 400 may specifically include: processor 410, internal memory 421, external memory interface 422, Universal Serial Bus (USB) interface 430, charge management module 440, power management module 441, battery 442, antenna 1, antenna 2, mobile communication module 450, wireless communication module 460, audio module 470, speaker 471, microphone 472, microphone 473, earphone interface 474, sensor module 480, display 490, camera module 491, indicator 492, motor 493, keys 494, and Subscriber Identification Module (SIM) card interface 495, etc. Wherein the sensor module 480 may include a depth sensor 4801, a pressure sensor 4802, a gyro sensor 4803, and the like.

Processor 410 may include one or more processing units, such as: the Processor 410 may include an Application Processor (AP), a modem Processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband Processor, and/or a Neural Network Processor (NPU), and the like. The different processing units may be separate devices or may be integrated into one or more processors.

A memory is provided in the processor 410. The memory may store instructions for implementing six modular functions: detection instructions, connection instructions, information management instructions, analysis instructions, data transmission instructions, and notification instructions, and execution is controlled by processor 410.

The mobile terminal 400 implements a display function through the GPU, the display screen 490, the application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 490 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information. In an exemplary embodiment, the imaged image may be processed based on image microprocessing such as a GPU.

The mobile terminal 400 may implement a photographing function through the ISP, the camera module 491, the video codec, the GPU, the display screen 490, the application processor, and the like. The ISP is used for processing data fed back by the camera module 491; the camera module 491 is used for capturing still images or videos; the digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals; the video codec is used to compress or decompress digital video, and the mobile terminal 400 may also support one or more video codecs.

The color temperature sensor 4801, also called RGB sensor, is used to sense the color temperature of the ambient light, and can distinguish different spectral components and distributions of different light sources. In some embodiments, a color temperature sensor may be disposed in the camera module 491 for receiving the reflected light of the current scene collected by the camera module 491.

The depth sensor 4802 is used to acquire depth information of a scene. The pressure sensor 4803 is used to sense pressure signal and convert the pressure signal into electrical signal. In addition, sensors with other functions, such as a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor, may be provided in the sensor module 480 according to actual needs.

In the correlated color temperature testing technology, a color temperature sensor based on a silicon-based material is generally adopted for color temperature testing. Specifically, color blocks in a standard color plate can be calibrated in advance to obtain multispectral data of each color module, then the color temperature of ambient light is changed to obtain multispectral data of the color blocks under different color temperatures, and a related database is established. When the device is used, comparison and analysis are carried out according to the collected multispectral data, the data are regressed through least square fitting, and the reflection function and the light source color temperature of the shooting object are determined. However, this method is implemented using an area array sensor, and has a large data volume and high power consumption; meanwhile, a uniform single light source is required to be used for irradiation in the calibration process, and the light source environment in an actual application scene is often complex and cannot meet the condition; in addition, only the standard color plate is calibrated, so that the number of objects is small, and the real scene is easy to lose effectiveness.

Further, as shown in FIG. 5, the silicon-based material has a maximum absorption wavelength of only 1100nm due to the band width limitation of the silicon-based material itself, and cannot detect infrared light having a wavelength of more than 1100nm or the like. However, short-wave infrared light is an important wave band for light source identification and classification, and the silicon-based material cannot be detected, which means that the acquisition of original data is short of an important part during light source identification. Meanwhile, as can be seen from fig. 5, the silicon-based material has a significantly reduced absorption rate in the wavelength band of 700nm or more, and thus it is necessary to increase the pixel area to increase the absorption rate or to extend the exposure time. However, increasing the pixel area affects the increase of the volume of the sensor and the module, and further affects the structure or appearance of the terminal device equipped with the sensor; and the imaging time can be directly increased by prolonging the exposure time, the power consumption of the whole machine system is increased, and the user experience is further influenced.

Based on one or more of the problems described above, the present example embodiment provides a color temperature test method. The color temperature test method may be applied to one or more of the terminal devices 301, 302, 303 described above, which is not particularly limited in the present exemplary embodiment. Referring to fig. 6, the color temperature test method may include the following steps S610 to S620:

in step S610, a plurality of light sensing units based on a color temperature sensor acquire a raw spectrum matrix corresponding to a current scene.

The central wavelength of a plurality of photosensitive units included in the color temperature sensor comprises a plurality of values. For example, the basic structure of the color temperature sensor comprises a plurality of photosensitive units, and each photosensitive unit is a photosensitive area with a determined central wavelength. Taking the example that the central wavelengths of all the photosensitive units are different, a plurality of photosensitive units can be arranged from left to right and from top to bottom to obtain a complete pixel whole column. The central wavelengths of the light-sensing units are different, and the difference between the central wavelengths is 50nm, so that the central wavelengths corresponding to all the light-sensing units can be uniformly dispersed in the wavelength band range detectable by the color temperature sensor, and assuming that the wavelength band range detectable by the color temperature sensor is 400nm to 1600nm, the basic structure shown in fig. 7 can be obtained.

It should be noted that, when determining different central wavelength values corresponding to a plurality of light sensing units, in the plurality of values, an interval between any two values may include any value. In addition, when multiple values are taken, the photosensitive unit corresponding to each value can be set according to requirements, and the photosensitive unit is not specially limited by the disclosure. In addition, smaller intervals can be adopted for the specific area, so that the specific area can obtain a reconstructed spectrum with richer feature points.

Further, in an exemplary embodiment, the configuration in which the central wavelengths are not uniform may be adopted for some of the plurality of light-sensing units in the color temperature sensor, and the other light-sensing units adopt the uniform central wavelength and do not perform the transmission spectrum filtering process. Through the arrangement, original data acquired by multiple spectrums can be referred, and the accuracy rate of the original data is improved.

In addition, the color temperature sensor may include a sensor having an increased detectable wavelength range relative to conventional silicon-based sensors and a continuous spectral response in the visible, near infrared, and short wave infrared bands.

In an exemplary embodiment, the color temperature sensor may include a multi-channel multi-spectral short-wave infrared color temperature sensor or the like. Referring to fig. 8, the short wave infrared sensor has a larger detectable wavelength range compared to the conventional silicon-based sensor, and has continuous spectral response in the visible, near infrared and short wave infrared bands, and particularly, the quantum efficiency in the near infrared and short wave infrared bands is obviously improved. Based on the method, the image can be imaged with better signal-to-noise ratio; meanwhile, because light source data in near infrared and short wave infrared wave bands can be collected, more accurate color images can be realized.

By adopting the multispectral short-wave infrared color temperature sensor, the data corresponding to the current scene can be respectively collected through multiple channels while the spectrum segmentation of an infrared region is improved by fully utilizing the short-wave infrared color temperature sensor, and then more accurate spectrum reconstruction with higher responsivity is realized.

In an exemplary embodiment, a raw spectrum matrix corresponding to a current scene may be directly acquired based on a plurality of light sensing units included in a color temperature sensor. Specifically, referring to fig. 9, in an actual use process, a light source irradiates on an object, reflected light is obtained after the light source is reflected by the object, the reflected light is transmitted into a color temperature sensor through an imaging lens, and a plurality of light sensing units included in the color temperature sensor perform data acquisition on the reflected light transmitted into the color temperature sensor, so as to obtain an original spectrum matrix.

In step S620, a correction matrix corresponding to the color temperature sensor is obtained, and the original spectrum matrix is corrected by the correction matrix, so as to obtain a corrected spectrum matrix.

In an exemplary embodiment, when the correction matrix corresponding to the color temperature sensor is obtained, the calibration may be performed in a calibration manner. Specifically, the spectrum matrix corresponding to the calibration light may be collected based on the plurality of photosensitive units, the spectrum line matrix corresponding to the calibration light may be obtained at the same time, and then the correction matrix may be calculated according to the calibration spectrum matrix and the spectrum line matrix.

The calibration light may include various monochromatic lights. It should be noted that, in order to enable the plurality of light-sensing units to adapt to different scenes, the monochromatic light serving as the calibration light may be set to be monochromatic light with a tunable wavelength, and the tunable range of the monochromatic light may be consistent with the range determined by the central wavelengths of the plurality of light-sensing units. For example, when the center wavelength of the plurality of photosensitive cells can cover a wavelength band from visible light to short-wavelength infrared light, the tunable range of monochromatic light as calibration light can also be made from visible light to short-wavelength infrared light.

For example, the calibration spectrum matrix and the spectrum line matrix corresponding to the calibration light can be obtained by the aid of equipment such as a monochromator, an integrating sphere and a spectrometer. Referring to fig. 10, laser light of only a single wavelength is emitted by a monochromator, and the wavelength of the laser of the monochromator is tunable, and the tunable range is determined according to the detectable range of the color temperature sensor. And introducing monochromatic light into an integrating sphere, homogenizing incident laser in the integrating sphere, dividing the homogenized incident laser into two paths, measuring one path by a spectrometer to obtain a spectral line matrix corresponding to the calibration light with the dimension m & lt 1 & gt, measuring the other path by a color temperature sensor to obtain a calibration spectral matrix with the dimension n & lt 1 & gt, and calculating a correction matrix through the calibration spectral matrix and the spectral line matrix.

In an exemplary embodiment, when calculating the correction matrix according to the calibration spectrum matrix and the spectral line matrix, a preset calculation method may be set in advance, then the calibration spectrum matrix and the preset matrix are used as input of the preset calculation method, then the spectral line matrix is used as a target of output of the preset calculation method, and matrix parameters in the preset matrix are adjusted to obtain the correction matrix, so that the calculation output obtained by calculating the calibration spectrum matrix and the correction matrix based on the preset calculation method is equal to the spectral line matrix. The preset calculation method may include any method for calculating the two matrices. For example, the preset calculation method may include multiplication as shown in fig. 11, wherein the dimensions of the spectral line matrix and the calibration spectral matrix may be determined based on the data paths of the spectrometer and the color temperature sensor, respectively. In addition, the parameters in the spectral line matrix and the calibration spectral matrix may be arranged in a predetermined manner, and correspondingly, when the calibration matrix is used, the parameters in the acquired original spectral matrix may also be arranged in a predetermined manner. For example, the spectral line matrix and the calibration spectral matrix may be ordered from top to bottom by wavelength from small to large or from large to small.

In an exemplary embodiment, after the raw spectral matrix is collected by the color temperature sensor, the raw spectral matrix may be corrected by the correction matrix. Specifically, when the correction matrix is obtained by calculation through a preset calculation method, the original spectrum matrix and the correction matrix may be used as inputs of the preset calculation method, calculation is performed by the preset calculation method, and the obtained calculation output is used as the corrected spectrum matrix. After the original spectrum matrix is corrected by the correction matrix, the original spectrum matrix can be converted into a corresponding spectrum matrix, and the spectrum matrix is a predicted spectrum line matrix, so that the effects of white balance improvement, color improvement and the like can be realized.

In summary, in the exemplary embodiment, based on the finer light source calibration and the more accurate spectrum recovery caused thereby, the finer light source classification and identification are finally realized, and the spectrum and the color temperature of the light source are obtained. The scheme is a single-point multispectral color temperature sensor scheme, and has the advantages of small data volume, less calculation power and low power consumption; meanwhile, when the multispectral short-wave infrared color temperature sensor is used as the color temperature sensor, the scheme fully utilizes the short-wave infrared to improve the spectrum segmentation of an infrared region, and simultaneously respectively reads the terminal spectrum reconstruction functions which are more accurate and have higher responsivity, so that the spectrum accuracy and the color expressive force are improved.

In addition, in the practical use process, the multispectral short-wave infrared color temperature sensor can also comprise a Micro Control Unit (MCU) besides the sensor structure, and the processing of pixel noise reduction, analog-to-digital conversion, automatic exposure and the like can be directly carried out in the sensor. At the moment, the multispectral short-wave infrared color temperature sensor can subdivide a short-wave infrared region into a plurality of spectral channels on the basis of visible light to short-wave infrared, and based on the structure of the sensor, a spectrum reconstruction implementation mode under different illumination environments is given: under different ordinary illumination, image sensor only reads each passageway, calibrates through standard monochromator and obtains the calibration matrix of spectrum reconstruction, realizes the more accurate reconsitution of spectrum of light source and object convolution light through the calibration matrix, promotes white balance performance and color accuracy.

It is noted that the above-mentioned figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.

Further, referring to fig. 12, the embodiment of the present example further provides a color temperature testing apparatus 1200, which includes a data collecting module 1210 and a data correcting module 1220. Wherein:

the data acquisition module 1210 may be configured to acquire an original spectrum matrix corresponding to a current scene based on a plurality of light sensing units of a color temperature sensor, where a central wavelength of the plurality of light sensing units includes a plurality of values.

The data correction module 1220 may be configured to obtain a correction matrix corresponding to the color temperature sensor, and correct the original spectrum matrix through the correction matrix to obtain a corrected spectrum matrix.

In an exemplary embodiment, the data correction module 1220 may be configured to acquire a calibration spectrum matrix corresponding to calibration light based on a plurality of photosensitive units, and acquire a spectral line matrix corresponding to the calibration light; and calculating a correction matrix according to the calibration spectrum matrix and the spectral line matrix.

In an exemplary embodiment, the calibration light may include a monochromatic light, and the tuning range of the monochromatic light coincides with the central wavelength range defined by the plurality of values.

In an exemplary embodiment, the data correction module 1220 may be configured to use the calibration spectrum matrix and the preset matrix as calculation inputs of a preset calculation method, and adjust matrix parameters in the preset matrix to obtain a correction matrix, so that a calculation output of the preset calculation method is equal to the spectrum line matrix.

In an exemplary embodiment, the data correction module 1220 may be configured to calculate the raw spectrum matrix and the correction matrix as calculation inputs of a preset calculation method, and output the calculation as a corrected spectrum matrix.

In an exemplary embodiment, the color temperature sensor may include a short wave infrared sensor.

In an exemplary embodiment, the central wavelength of the plurality of light-sensing units includes a plurality of values, and an interval between any two values includes an arbitrary value.

The specific details of each module in the above apparatus have been described in detail in the method section, and details that are not disclosed may refer to the method section, and thus are not described again.

As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

Exemplary embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, various aspects of the disclosure may also be implemented in the form of a program product including program code for causing a terminal device to perform the steps according to various exemplary embodiments of the disclosure described in the above-mentioned "exemplary methods" section of this specification, when the program product is run on the terminal device, for example, any one or more of the steps in fig. 6 may be performed.

It should be noted that the computer readable media shown in the present disclosure may be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Furthermore, program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.