阅读说明：本技术 温度补偿的方法、装置、电子设备及计算机可读存储介质 (Method and device for temperature compensation, electronic equipment and computer readable storage medium ) 是由 黄思平 于 2020-06-12 设计创作，主要内容包括：本申请公开了温度补偿的方法、装置、电子设备及计算机可读存储介质,适用于红外热像仪,涉及计算机技术领域、红外测温领域和温度补偿领域。具体实现方案为：获取待测温人体的红外图像和目标可见光图像,根据该目标可见光图像确定该待测温人体的实际测温距离,基于预先确定的距离与补偿温度间的函数关系,确定与该实际测温距离对应的实际补偿温度,基于该实际补偿温度,确定该红外图像中的该待测温人体的实际温度。该方案提供了一种使用可见光图像确定红外热像仪与待测温人体的实际测温距离,并根据该实际测温距离动态的对红外热像仪所测定的温度进行温度补偿,使得红外热像仪测定的待测温人体的温度更加准确。(The application discloses a temperature compensation method, a temperature compensation device, electronic equipment and a computer readable storage medium, which are suitable for a thermal infrared imager and relate to the technical field of computers, the field of infrared temperature measurement and the field of temperature compensation. The specific implementation scheme is as follows: acquiring an infrared image and a target visible light image of a human body to be measured, determining an actual temperature measurement distance of the human body to be measured according to the target visible light image, determining an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relation between a predetermined distance and the compensation temperature, and determining the actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature. The scheme provides a method for determining the actual temperature measurement distance between the thermal infrared imager and the human body to be measured by using the visible light image, and dynamically performing temperature compensation on the temperature measured by the thermal infrared imager according to the actual temperature measurement distance, so that the temperature of the human body to be measured by the thermal infrared imager is more accurate.)

1. A method of temperature compensation, comprising:

acquiring an infrared image and a target visible light image of a human body to be subjected to temperature measurement;

determining the actual temperature measuring distance of the human body to be measured according to the target visible light image;

determining an actual compensation temperature corresponding to the actual temperature measuring distance based on a function relation between a predetermined distance and the compensation temperature;

and determining the actual temperature of the human body to be subjected to temperature measurement in the infrared image based on the actual compensation temperature.

2. The method of claim 1, wherein the acquiring the infrared image and the target visible light image of the human body to be temperature-measured comprises:

under a preset working condition, acquiring the infrared image and the target visible light image; and/or

And processing the original visible light image according to the infrared image so as to enable the processed visible light image and the infrared image to have the same size and coincide with each other in image content at the same position, and thus obtaining the target visible light image.

3. The method of claim 2, wherein the preset operating conditions include at least one of:

the difference between the focal lengths and the shooting positions of the two devices for shooting the infrared image and the target visible light image is smaller than a threshold value; and

and the direction, the elevation angle, the yaw angle, the roll angle, the shooting frame rate and the image transmission rate of the two devices which shoot the target visible light image and the infrared image are the same.

4. The method of claim 2, wherein the processing of the raw visible light image from the infrared image comprises:

taking the infrared image as a reference image, and adjusting the original visible light image to enable control points in the adjusted visible light image and the infrared image to be correspondingly registered; and

and cutting the adjusted size of the visible light image to obtain the target visible light image with the size same as that of the infrared image.

5. The method of claim 1, wherein the determining the actual thermometric distance of the human body to be measured from the target visible light image comprises:

determining a minimum rectangle which can completely contain the image of the human body to be measured in the target visible light image, and determining a target width value of the minimum rectangle; and

and determining the actual temperature measuring distance corresponding to the target width value according to a predetermined distance function.

6. The method of claim 1, wherein the determining the actual temperature of the human body to be thermometric in the infrared image based on the actual compensated temperature comprises:

acquiring the original temperature of the human body to be subjected to temperature measurement in the infrared image;

and compensating the original temperature by using the actual compensation temperature to obtain the actual temperature of the human body to be measured in the infrared image.

7. The method of claim 1, further comprising:

judging whether the human body to be subjected to temperature measurement contains a trunk area or not;

if the body area is contained, responding to the body area containing the body area to be measured in the temperature measuring human body, and outputting the infrared image corresponding to the body area of the temperature measuring human body and superposed with the actual temperature to the client;

if the human body does not contain the trunk area of the human body, judging whether the human body to be subjected to temperature measurement contains the face area of the human body;

if the human body facial area is included, responding to the human body to be measured containing the human body facial area, and outputting the infrared image corresponding to the human body to be measured with the actual temperature superposed on the facial area to the client;

and if the facial area of the human body is not included, outputting the target visible light image to a client as a unqualified image.

8. The method of any of claims 1-7, further comprising:

when the target visible light image and the infrared image comprise at least one other human body, respectively executing the operation of any one of the methods 1-8 on the other human body.

9. A temperature compensated device comprising:

the infrared image acquisition unit is configured to acquire an infrared image of a human body to be measured;

a visible light image acquisition unit configured to acquire a target visible light image of the human body to be warmed;

the temperature measurement distance analysis unit is configured to determine the actual temperature measurement distance of the human body to be measured according to the target visible light image;

a compensation temperature calculation unit configured to determine an actual compensation temperature corresponding to the actual temperature measurement distance based on a functional relationship between a predetermined distance and a compensation temperature;

an actual temperature determination unit configured to determine an actual temperature of the human body to be temperature-measured in the infrared image based on the actual compensated temperature.

10. The device of claim 9, wherein the infrared image acquisition unit is further configured to acquire the infrared image under a preset condition; the target visible light image is further configured to acquire the target visible light image under a preset working condition; and/or

And the visible light image processing unit is configured to process the original visible light image according to the infrared image, so that the processed visible light image is overlapped with the image content on the same position with the same size of the infrared image, and the target visible light image is obtained.

11. The apparatus of claim 10, wherein the preset conditions in the infrared image capturing unit and the visible light image capturing unit include at least one of:

the difference between the focal lengths and the shooting positions of the two devices for shooting the infrared image and the target visible light image is smaller than a threshold value; and

and the direction, the elevation angle, the yaw angle, the roll angle, the shooting frame rate and the image transmission rate of the two devices which shoot the target visible light image and the infrared image are the same.

12. The apparatus of claim 10, wherein the visible light image acquisition unit further comprises:

a visible light image processing subunit, further configured to take the infrared image as a reference image, and adjust the original visible light image so that control points in the adjusted visible light image and the infrared image are correspondingly registered; and

and cutting the adjusted size of the visible light image to obtain the target visible light image with the size same as that of the infrared image.

13. The apparatus of claim 9, wherein the actual thermometric distance in the thermometric distance resolving unit is determined based on:

the actual temperature measurement distance determining subunit is configured to determine a minimum rectangle which can completely contain the image of the human body to be measured in the target visible light image, and determine a target width value of the minimum rectangle; and

and determining the actual temperature measuring distance corresponding to the target width value according to a predetermined distance function.

14. The apparatus of claim 9, wherein the actual temperature in the actual temperature determination unit is determined based on:

an original temperature acquisition unit configured to acquire an original temperature of the human body to be temperature-measured in the infrared image;

and the temperature compensation subunit is configured to compensate the original temperature by using the actual compensation temperature to obtain the actual temperature of the human body to be measured in the infrared image.

15. The apparatus of claim 9, further comprising:

the trunk area judging unit is configured to judge whether the human body to be subjected to temperature measurement contains the trunk area; and/or

A facial region judging unit configured to judge whether the human body to be measured includes the facial region; and

a visible light image output unit configured to output the target visible light image as a non-conforming image to a client in response to the human body to be thermometered not including the face region and the torso region;

and the infrared image output unit responds to the human body to be subjected to temperature measurement and comprises the face area and/or the trunk area, and outputs the infrared image corresponding to the face area and/or the trunk area of the human body to be subjected to temperature measurement and superposed with the actual temperature to the client.

16. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

17. A non-transitory computer readable storage medium storing computer instructions, comprising: the computer instructions are for causing the computer to perform the method of any one of claims 1-7.

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to the field of infrared temperature measurement and the field of temperature compensation, and particularly relates to a method and a device for temperature compensation, electronic equipment and a computer-readable storage medium.

Background

Because the thermal infrared imager measures the temperature of the human body based on the human body thermal radiation principle, as the distance between the human body to be measured and the thermal infrared imager is increased, partial thermal imaging loss and thermal loss are generated in heat transmission, so that the measurement result is inaccurate, and in order to provide the accuracy of the measurement result, in the prior art, the temperature compensation is required to be performed on the temperature result measured by the thermal infrared imager according to the distance between the human body to be measured and the thermal infrared imager.

Disclosure of Invention

The application provides a method, a device, an electronic device and a storage medium for temperature compensation.

In a first aspect, an embodiment of the present application provides a method of temperature compensation, including: acquiring an infrared image and a target visible light image of a human body to be measured, determining an actual temperature measurement distance of the human body to be measured according to the target visible light image, determining an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relation between a predetermined distance and the compensation temperature, and determining the actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature.

In a second aspect, an embodiment of the present application provides a temperature compensation apparatus, including: the temperature measurement device comprises an infrared image acquisition unit, a visible light image acquisition unit, a temperature measurement distance analysis unit, a compensation temperature calculation unit and an actual temperature determination unit, wherein the infrared image acquisition unit is configured to acquire an infrared image of a human body to be measured, the visible light image acquisition unit is configured to acquire a target visible light image of the human body to be measured, the temperature measurement distance analysis unit is configured to determine an actual temperature measurement distance of the human body to be measured according to the target visible light image, the compensation temperature calculation unit is configured to determine an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relation between a predetermined distance and a compensation temperature, and the actual temperature determination unit is configured to determine the actual temperature of the human body to be measured in the infrared image based on the.

In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the temperature compensation method as described in any one of the implementations of the first aspect.

In a fourth aspect, embodiments of the present application provide a non-transitory computer readable storage medium having computer instructions stored thereon, comprising: the computer instructions are for causing the computer to perform a method of temperature compensation as described in any implementation of the first aspect.

The actual temperature measurement distance of the human body to be measured is acquired from the visible light image of the human body to be measured, the actual temperature measurement distance can be more accurately and dynamically provided for the thermal infrared imager by the acquiring mode, the temperature measured by the thermal infrared imager is compensated according to the actual temperature measurement distance, namely, partial thermal imaging loss and thermal loss in heat transmission are compensated, and the temperature of the human body to be measured by the thermal infrared imager is more accurate.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:

FIG. 1 is an exemplary system architecture to which the present application may be applied;

FIG. 2 is a flow diagram of one embodiment of a temperature compensation method according to the present application;

FIG. 3 is a flow chart of another embodiment of a temperature compensation method according to the present application

FIG. 4 is a schematic diagram of a wide value of an application scenario as a function of an actual temperature measurement distance according to the temperature compensation method of the present application;

FIG. 5 is a schematic block diagram of one embodiment of a temperature compensation device according to the present application;

FIG. 6 is a block diagram of an electronic device suitable for use in implementing temperature compensation of embodiments of the present application.

Detailed Description

The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the temperature compensation methods, apparatus, electronic devices, and computer-readable storage media of the present application may be applied.

As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the terminal devices 101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. Various communication client applications, such as a human body temperature measurement application, an environment temperature measurement application, an object measurement application, and the like, may be installed on the terminal devices 101, 102, and 103.

The terminal apparatuses 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices with display screens, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. When the terminal apparatuses 101, 102, 103 are software, they can be installed in the electronic apparatuses listed above. It may be implemented as a plurality of software or software modules (for example to implement a temperature compensation service) or as a single software or software module. And is not particularly limited herein.

The server 105 may be a server providing various services, for example, an infrared image and a target visible light image sent by the terminal devices 101, 102, and 103 that send a temperature compensation request to the user in the present application through the network 104, determine an actual temperature measurement distance of the human body to be measured according to the target visible light image, determine an actual compensation temperature, and finally determine an actual temperature of the human body to be measured according to the actual compensation temperature.

The server 105 may be a server providing various services, such as a background server providing support for the terminal devices 101, 102, 103. The background server can analyze and process the received data such as the request and feed back the processing result to the terminal equipment.

The server may be hardware or software. When the server is hardware, it may be implemented as a distributed server cluster formed by multiple servers, or may be implemented as a single server. When the server is software, it may be implemented as multiple pieces of software or software modules, for example, to provide distributed services, or as a single piece of software or software module. And is not particularly limited herein.

It should be noted that the temperature compensation method provided in the following embodiments of the present application is generally executed by the terminal 101, 102, 103 or the server 105, and accordingly, the temperature compensation device is generally disposed in the terminal 101, 102, 103 or the server 105.

It should be noted that the infrared image, the original visible light image, and the target visible light image may all be stored locally in the server 105, or the data may be dispersedly stored in the terminal devices 101, 102, and 103 according to all possible storage special requirements in an actual application scenario, where the storage terminal devices 101, 102, and 103 may be original or backup, and are not limited specifically here. The exemplary system architecture 100 may also not include the terminal devices 101, 102, 103 and the network 104 when the terminal devices 101, 102, 103 are virtual machines running on the server 105.

It should be further noted that the terminal devices 101, 102, and 103 may also be installed with a temperature compensation application, and the terminal devices 101, 102, and 103 may also complete acquiring an infrared image and a target visible light image of a human body to be measured in temperature, determine an actual temperature measurement distance of the human body to be measured in temperature according to the target visible light image, determine an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relationship between a predetermined distance and the compensation temperature, and determine an actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature. In this case, the temperature compensation method may be executed by the terminal apparatuses 101, 102, and 103, and accordingly, the temperature compensation device may be provided in the terminal apparatuses 101, 102, and 103. At this point, the exemplary system architecture 100 may also not include the server 105 and the network 104.

The server 105 may be hardware or software. When the server 105 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. When the server is software, it may be implemented as a plurality of software or software modules (for example, for providing a temperature compensation service), or may be implemented as a single software or software module. And is not particularly limited herein.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

With continued reference to FIG. 2, a flow 200 of one embodiment of a method of temperature compensation according to the present application is shown. The temperature compensation method comprises the following steps:

step 201, acquiring an infrared image and a target visible light image of a human body to be subjected to temperature measurement.

In the embodiment, the execution subject of the temperature compensation method (for example, the server 105 shown in fig. 1) may acquire the infrared image and the target visible light image of the human body to be temperature-measured from a local or non-local storage device (for example, the terminal devices 101, 102, 103 shown in fig. 1).

The local storage device can be a data storage module arranged in the execution main body, and under the condition, the infrared image and the target visible light image of the human body to be measured can be obtained only by locally reading; the non-local storage device can also be another data storage server specially used for storing query information of a user, in this case, the execution main body can acquire the infrared image and the target visible light image of the human body to be measured, which are returned by the data storage server, by sending the infrared image and the target visible light image acquisition command of the human body to be measured to the data storage server.

The infrared image of the human body to be measured is generally an infrared image containing the human body to be measured, which is generated by an infrared image acquisition device such as an infrared camera, and the target visible light image is generally a visible light image containing the human body to be measured, which is generated by a visible light image acquisition device such as a visible light camera, or a visible light image obtained by adjusting the visible light image acquired by the visible light acquisition device as an original visible light image.

It should be understood that, for the purpose of determining the actual temperature measurement distance of the human body to be measured by using the target visible light image in the present application, it should be ensured that the difference between the actual shooting distance of the target visible light image and the actual shooting distance of the infrared image (i.e. the actual temperature measurement distance) is smaller than the threshold, that is, the postures, the positions, the pixels, the proportions of occupied picture contents, and the like of the target visible light image and the infrared image of the human body to be measured in the same size or in the size difference smaller than the threshold should be the same or the difference smaller than the threshold.

In some embodiments, a large number of infrared images of the human body to be warmed and the target visible light image can be directly collected and centrally stored in the database. In this scenario, the execution body may obtain the user data set from the database. In other embodiments, a large number of infrared images and target visible light images of the human body to be warmed may be stored in various user terminal devices. In this scenario, the execution main body may obtain an infrared image and a target visible light image of a human body to be subjected to temperature measurement from various user terminal devices.

Step 202, determining the actual temperature measurement distance of the human body to be measured according to the target visible light image.

In this embodiment, the executing body may determine the actual shooting distance of the human body with the temperature to be measured according to the content in the optical image obtained in step 201, and use the actual shooting distance as the actual temperature measurement distance of the infrared image.

For example, the executing body may obtain a size of the human body or other object to be measured in the target visible light image, compare the size with an actual size of the human body or other object to be measured to obtain a distance scaling ratio, then obtain an actual shooting distance of the target visible light image by using the scaling ratio based on a distance between the human body to be measured in the visible light image and the frame, and use the actual shooting distance as an actual temperature measuring distance of the infrared image, where the actual shooting distance is approximately equal to an actual shooting distance of the infrared image.

Step 203, determining an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relation between the predetermined distance and the compensation temperature.

In this embodiment, it is known that the loss amount of heat in the air has a functional relationship with the propagation distance in the thermal radiation process, and the execution main body and the terminal of the temperature compensation have computing capabilities, and the functional relationship between the distance and the thermal imaging loss and the heat loss amount is predetermined according to the corresponding relationship between the distance and the compensation temperature in the history data, and the functional relationship between the distance and the compensation temperature is further determined according to the numerical relationship between the distance and the thermal imaging loss and the heat loss amount, and the actual compensation temperature corresponding to the actual temperature measurement distance is determined.

The functional relationship between the distance and the thermal imaging loss and the thermal loss amount can be predetermined according to the corresponding relationship between the actual equipment in the historical data and the distance and the compensation temperature of the actual scene, and the functional relationship between the distance and the thermal imaging loss and the thermal loss amount can also be predetermined according to the corresponding relationship between the distance and the compensation temperature in other scenes to perform function fitting on the functional relationship between the distance and the thermal imaging loss and the thermal loss amount so as to obtain the functional relationship between the distance and the thermal imaging loss and the thermal loss amount of the actual scene.

The actual compensation temperature may be: when the actual temperature of the human body to be measured is obtained, the actual compensation temperature determined based on the temperature lost by the heat emitted by the human body to be measured, which is lost due to the actual shooting distance, may also be determined by a temperature compensation coefficient according to a functional relationship between the distance and the compensation temperature, and the actual compensation temperature determined by using the temperature compensation coefficient.

Illustratively, when the actual temperature measuring distance is 1 meter, the heat loss rate is 1% according to the functional relationship between the distance and the compensation temperature, the compensation coefficient is determined to be 0.99, and the actual compensation temperature is determined according to the compensation coefficient.

It should be understood that the functional relationship between the distance and the compensation temperature may be obtained in other ways and predetermined according to the requirement, and the application is not limited thereto.

And 204, determining the actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature.

Specifically, the executing body may determine a corresponding manner according to the form of the actual compensation temperature obtained in step 203, and determine the actual temperature of the human body to be measured in the infrared image according to the original temperature of the human body to be measured in the infrared image in combination with the actual compensation temperature.

For example, the temperature of the human body to be measured without temperature compensation in the infrared image is determined and obtained, the temperature without temperature compensation is determined as the original temperature of the human body to be measured, and the original temperature of the human body to be measured and the actual compensation temperature are superposed to obtain the actual temperature of the human body to be measured in the infrared image.

The temperature compensation method provided by the embodiment of the application obtains the infrared image and the target visible light image of the human body to be measured, determines the actual temperature measurement distance of the human body to be measured according to the target visible light image, determines the actual compensation temperature corresponding to the actual temperature measurement distance based on the function relation between the predetermined distance and the compensation temperature, and determines the actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature. According to the temperature compensation method provided by the embodiment of the application, the actual temperature measurement distance between the thermal infrared imager and the human body to be measured can be determined by using the visible light image, and the temperature measured by the thermal infrared imager is dynamically compensated according to the actual temperature measurement distance, namely, the partial thermal imaging loss and the thermal loss in heat transmission are compensated, so that the temperature of the human body to be measured by the thermal infrared imager is more accurate.

In some optional implementation manners of this embodiment, acquiring the infrared image and the target visible light image of the human body to be measured includes: under a preset working condition, acquiring the infrared image and the target visible light image; and/or

And processing the original visible light image according to the infrared image so as to enable the processed visible light image to be overlapped with the image content on the same position with the same size of the infrared image, thereby obtaining the target visible light image.

In some specific examples, the infrared image and the target visible light image may be obtained by the obtaining device under the same working condition, that is, the working condition is preset, so that the two obtaining devices perform obtaining operation under the same working condition, so as to obtain the infrared image and the target visible light image, and ensure that a difference between an actual shooting distance of the target visible light image and an actual shooting distance of the infrared image (that is, an actual temperature measurement distance) is smaller than a threshold value.

Alternatively or additionally, in some specific examples, the original visible light image may be processed according to the acquired infrared image, because both the infrared image and the visible light image are taken of the same human body to be subjected to temperature measurement, the visible light image acquired by the visible light acquisition device, which contains the same or similar content as that in the infrared image, is selected as the original visible light image, the infrared image is used as the reference image, processing the original image to make the processed visible light image and the infrared image have the same size and coincide with each other at the same position, so as to ensure that the difference between the actual shooting distance of the target visible light image and the actual shooting distance of the infrared image (namely the actual temperature measuring distance) is less than the threshold value, so as to better reduce the difference between the actual shooting distance of the visible light image and the actual shooting distance of the infrared image of the target.

It should be understood that the visible light image acquired under the same working condition as the original visible light image may be processed by using the above processing method to obtain the target visible light image, so as to better reduce the difference between the actual shooting distance of the target visible light image and the actual shooting distance of the infrared image.

In some optional implementations of this embodiment, the preset condition includes at least one of: the difference between the focal length and the shooting position of the two devices for shooting the infrared image and the target visible light image is smaller than a threshold value; and the direction, the elevation angle, the yaw angle, the roll angle, the shooting frame rate and the image transmission rate of the two devices for shooting the target visible light image and the target infrared image are the same.

Specifically, the difference between the focal length and the shooting position of two pieces of acquisition equipment for acquiring the infrared image and the target visible light image is smaller than a threshold, and the pointing direction, the elevation angle, the yaw angle, the roll angle, the shooting frame rate and the image transmission rate of the two pieces of equipment are set to be the same, so that the difference between the content of the same position in the infrared image and the target visible light image acquired by the two pieces of equipment is smaller than the threshold, and the reduction of the error between the actual shooting distance of the target visible light image and the actual shooting distance of the infrared image (i.e., the actual temperature measurement distance) is realized.

In some optional implementations of the embodiment, processing the raw visible light image according to the infrared image includes: taking the infrared image as a reference image, and adjusting the original visible light image to enable control points in the adjusted visible light image and the infrared image to be correspondingly registered; and cutting the adjusted size of the visible light image to obtain the target visible light image with the size same as that of the infrared image.

Specifically, after an original visible light image is acquired, an infrared image is used as a reference image to adjust the original visible light image, so that control points in the adjusted visible light image and the infrared image are correspondingly registered, the size of the adjusted visible light image is cut, the target visible light image with the size same as that of the infrared image is obtained, and the error between the actual shooting distance of the target visible light image and the actual shooting distance (namely, the actual temperature measuring distance) of the infrared image is reduced.

Furthermore, the steps and parameters for adjusting and processing the visible light image can be encapsulated to obtain a visible light image filter, so that the visible light image filter can be used for adjusting and processing the visible light image.

In some optional implementations of this embodiment, determining the actual thermometric distance of the thermometric human body according to the target visible light image includes: determining a minimum rectangle which can completely contain the image of the human body to be measured in the target visible light image, and determining a target width value of the minimum rectangle; and determining a target distance corresponding to the target width value according to a predetermined distance function.

Specifically, the method includes the steps of capturing a pixel of a human body to be measured in a target visible light image, determining a rectangle which can completely contain a captured pixel result and has a minimum area, determining a width value of the rectangle with the minimum area, and obtaining a corresponding actual temperature measurement distance by using a predetermined functional relation so as to accurately and dynamically obtain the actual temperature measurement distance.

It is known that as the image capturing device is far from the object, the size of the object in the image is scaled proportionally, so that the function can be determined according to the relationship between the distance of the object in the image and the actual size of the object. The predetermined function can be determined by a main body with computing capability such as an execution main body and a terminal of temperature compensation according to historical data, and can also be determined by other setting modes such as manual setting and the like so as to achieve the purpose of obtaining the actual shooting distance of the human body with the temperature to be measured in the target visible light image according to the target width value of the human body with the temperature to be measured in the target visible light image, and further, the corresponding actual temperature measurement distance can be dynamically obtained for each human body with the temperature to be measured.

On the basis of the above embodiments, the present application further provides an implementation process 300 of another embodiment for temperature compensation through fig. 3, which is different from the implementation process 200 shown in fig. 2, and the implementation process 300 performs temperature compensation on a human body sub-region to be temperature-measured, thereby further improving accuracy of temperature compensation. The method comprises the following steps:

step 301, acquiring an infrared image and a visible light image.

Step 302, judging whether the infrared image and the visible light image contain the trunk area of the human body to be measured.

Specifically, the contents of the infrared image and the visible light image are processed to determine whether the image includes the trunk region of the human body to be measured, for example, whether the image includes pixels corresponding to the trunk or not may be determined by pixel extraction, whether the image includes features corresponding to the trunk or not may be determined by extracting features from the image contents, and the like, and if the determination result is that the image includes the trunk region, step 305 is executed, and if the image does not include the trunk region, step 303 is executed.

And step 303, judging whether the infrared image and the visible light image contain the facial area of the human body to be measured.

Specifically, similar to the step 302, the contents of the infrared image and the visible light image are processed to determine whether the image includes the facial region of the human body to be measured, if so, step 305 is executed, and if not, step 304 is executed.

And step 304, outputting the visible light image to the client as a unqualified image.

Specifically, since the face and/or torso region of the human body to be temperature-measured cannot be identified in the acquired infrared image and the acquired visible light image, it is considered that there is no object requiring temperature compensation, i.e., the human body to be temperature-measured, in the infrared image and the visible light image, and therefore the optical image and the infrared image cannot be used in the temperature compensation method in the application, and therefore the visible light image can be output to the client.

And 305, determining the actual temperature measuring distance of the human body to be measured according to the target visible light image.

Specifically, similar to the embodiment shown in fig. 2, the actual compensation distance of the human body to be temperature-measured may be directly determined for performing temperature compensation, or the corresponding actual compensation distances may be determined according to the face area and the trunk area, respectively, for performing more accurate temperature compensation.

For example, the method for determining the minimum rectangle in the target visible light image, which is disclosed in the above embodiment, that completely includes the image of the human body to be temperature-measured, and determining the actual temperature measurement distance according to the target width value of the minimum rectangle is taken as an example, if the target visible light image includes the face region and the torso region, the minimum rectangle may be determined according to the whole body including the target region and the torso region in the target visible light image, the actual temperature measurement distance may be calculated according to the width value of the rectangle, and the actual temperature measurement distances may be used for temperature compensation of the face region and the torso region, or two minimum rectangles may be determined according to the content of the face region and the content of the torso region, so as to obtain the actual temperature measurement distances of the two regions, respectively, and implement more accurate temperature compensation.

Step 306, determining an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relation between the predetermined distance and the compensation temperature.

And 307, outputting the infrared image corresponding to the torso area and/or the face area of the human body to be subjected to temperature measurement and superposed with the corresponding actual temperature to the client.

The contents of the above steps 301 and 306 are the same as those of the steps 201 and 204 shown in fig. 2, and the contents of the same parts refer to the corresponding parts of the previous embodiment, which are not described herein again. The temperature compensation mode provided by the embodiment can perform temperature compensation on the human body to be subjected to temperature measurement in different regions, so that the accuracy of the temperature compensation is further improved, and the unqualified image and the infrared image corresponding to the superimposed compensation result can be output to the client, so that the subsequent client can render and output the images, and the compensated result is fed back to a user.

Further, in some embodiments, the method further includes, when at least one other human body is included in the target visible light image and the target infrared image, performing the temperature compensation method in any of the above embodiments on the other human body, respectively.

In order to deepen understanding, the application also provides a specific implementation scheme by combining a specific application scene. In the application scene, by presetting that the difference between the focal lengths and the shooting positions of two devices for acquiring the infrared image A and the visible light image is less than a threshold value, and presetting the same pointing direction, elevation angle, yaw angle, roll angle, shooting frame rate and image transmission rate of the two devices, thereby ensuring that the difference between the actual shooting distances of the two acquisition devices is less than a threshold value, adjusting the visible light image by taking the infrared image as a reference, and finally, the difference of the posture, the position, the pixel, the proportion of the occupied picture content and the like of the human body C to be subjected to temperature measurement in the infrared image A and the visible light image B is smaller than a threshold value.

Capturing a temperature measurement human body C in a target visible light image B, determining a rectangle D which can completely contain the minimum area of the temperature measurement human body, determining a target width value of the rectangle D with the minimum area, wherein the target width value of the rectangle D with the minimum area is 100 pixels, obtaining a corresponding actual temperature measurement distance of 5 meters by using a function relation which is determined by a temperature compensation execution main body shown in figure 4 according to historical data statistics in advance, and determining an actual compensation temperature corresponding to the actual temperature measurement distance based on the function relation between the predetermined distance and the compensation temperature.

As shown in fig. 5, the temperature compensation device 500 of the present embodiment may include: the temperature measurement device comprises an infrared image acquisition unit 501 configured to acquire an infrared image of a human body to be measured, a visible light image acquisition unit 502 configured to acquire a target visible light image of the human body to be measured, a temperature measurement distance analysis unit 503 configured to determine an actual temperature measurement distance of the human body to be measured according to the target visible light image, a compensation temperature calculation unit 504 configured to determine an actual compensation temperature corresponding to the actual temperature measurement distance based on a function relationship between a predetermined distance and the compensation temperature, and an actual temperature determination unit 505 configured to determine an actual temperature of the human body to be measured in the infrared image based on the actual compensation temperature.

In some optional implementations of this embodiment, the infrared image acquisition unit 501 and the visible light image acquisition unit 502 include: under a preset working condition, acquiring the infrared image and the target visible light image; and/or

And the visible light image processing subunit is configured to process the original visible light image according to the infrared image, so that the processed visible light image is superposed with the image content on the same position with the same size of the infrared image, and the target visible light image is obtained.

In some optional implementations of the present embodiment, the preset conditions in the infrared image obtaining unit 501 and the visible light image obtaining unit 502 include at least one of the following: acquiring a difference between focal lengths and shooting positions of the two devices of the infrared image and the target visible light image, wherein the difference is smaller than a threshold value; and the direction, the elevation angle, the yaw angle, the roll angle, the shooting frame rate and the image transmission rate of the two devices for shooting the target visible light image and the infrared image are the same.

In some optional implementations of the present embodiment, the visible light image obtaining unit 502 further includes: a visible light image processing subunit, further configured to take the infrared image as a reference image, and adjust the original visible light image so that the adjusted visible light image and the control point in the infrared image are correspondingly registered; and cutting the adjusted size of the visible light image to obtain the target visible light image with the size same as that of the infrared image.

In some optional implementations of this embodiment, the actual thermometric distance in the thermometric distance analyzing unit 503 is determined based on the following units: and the actual temperature measuring distance determining subunit is configured to determine a minimum rectangle which can completely contain the image of the human body to be measured in the target visible light image, determine a target width value of the minimum rectangle, and determine an actual temperature measuring distance corresponding to the target width value according to a predetermined distance function.

In some optional implementations of the present embodiment, the actual temperature in the actual temperature determination unit 505 is determined based on the following units: an original temperature acquisition unit configured to acquire an original temperature of the human body to be temperature-measured in the infrared image; and the temperature compensation subunit is configured to compensate the original temperature by using the actual compensation temperature to obtain the actual temperature of the human body to be measured in the infrared image.

In some optional implementations of the present embodiment, the temperature compensation apparatus 500 further includes a trunk area determination unit configured to determine whether the human body to be measured includes the trunk area; and/or a facial region judging unit configured to judge whether the human body to be measured contains the facial region; and a visible light image output unit configured to output the target visible light image as a nonconforming image to a client in response to the human body to be warmed not including the face region and the torso region; and the infrared image output unit responds to the human body to be measured with the temperature including the face area and/or the trunk area, and outputs the infrared image corresponding to the face area and/or the trunk area of the human body to be measured with the actual temperature superposed to the client.

The present embodiment exists as an apparatus embodiment corresponding to the above method embodiment, and the same contents refer to the description of the above method embodiment, which is not repeated herein. The temperature compensation device provided by this embodiment can determine the actual temperature measurement distance between the thermal infrared imager and the human body to be measured by using the visible light image, and dynamically perform temperature compensation on the temperature measured by the thermal infrared imager according to the actual temperature measurement distance, that is, compensate for partial thermal imaging loss and thermal loss in heat transmission, so that the temperature of the human body to be measured by the thermal infrared imager is more accurate.

According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.

Fig. 6 is a block diagram of an electronic device according to the temperature compensation method of the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.

The memory 602 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of temperature compensation provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method of temperature compensation provided herein.

The memory 602, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the method of temperature compensation in the embodiments of the present application (for example, the infrared image acquisition unit 501, the visible light image acquisition unit 502, the thermometric distance analysis unit 503, the compensated temperature calculation unit 504, and the actual temperature determination unit 505 shown in fig. 5). The processor 601 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 602, that is, implementing the temperature compensation method in the above method embodiment.

The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the temperature-compensated electronic device, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected to the temperature compensated electronics over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device of the temperature compensation method may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.

The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the temperature compensated electronic device, such as a touch screen, keypad, mouse, track pad, touch pad, pointer stick, one or more mouse buttons, track ball, joystick, or other input device. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

According to the technical scheme of the embodiment of the application, the actual temperature measurement distance between the thermal infrared imager and the human body to be measured is determined by using the visible light image, and the temperature measured by the thermal infrared imager is dynamically compensated according to the actual temperature measurement distance, so that the temperature of the human body to be measured by the thermal infrared imager is more accurate.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.

The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.