Method and device for controlling terminal display and computer readable medium

文档序号：1956878 发布日期：2021-12-10 浏览：12次中文

阅读说明：本技术 控制终端显示的方法、装置以及计算机可读介质 (Method and device for controlling terminal display and computer readable medium ) 是由袁檀于 2020-07-03 设计创作，主要内容包括：本发明公开了一种控制终端显示的方法、装置以及计算机可读介质,涉及通信技术领域。该方法包括：当检测到显示屏开始执行操作时,获取摄像头的感光度,以检测外部环境的亮暗程度在第一预设时间内有无变化；当检测到外部环境的亮暗程度在第一预设时间内有变化时,根据摄像头的感光度以及预设的摄像头的感光度与显示屏的显示亮度的对应关系,调整显示屏的显示亮度；获取摄像头拍摄的目标图像数据；当在目标图像数据中检测到人脸时,根据目标图像数据确定人脸与显示屏的距离；当检测到人脸与显示屏的距离在第二预设时间内有变化时,根据人脸与显示屏的距离调整显示屏的字体大小。该实施方式可以减缓用户的用眼疲劳。(The invention discloses a method and a device for controlling terminal display and a computer readable medium, and relates to the technical field of communication. The method comprises the following steps: when the fact that the display screen starts to execute operation is detected, acquiring the light sensitivity of the camera to detect whether the brightness degree of the external environment changes within a first preset time; when the brightness degree of the external environment is detected to be changed within a first preset time, adjusting the display brightness of the display screen according to the sensitivity of the camera and the corresponding relation between the preset sensitivity of the camera and the display brightness of the display screen; acquiring target image data shot by a camera; when a human face is detected in the target image data, determining the distance between the human face and the display screen according to the target image data; and when the distance between the face and the display screen is detected to be changed within the second preset time, adjusting the font size of the display screen according to the distance between the face and the display screen. This embodiment may reduce eye strain for the user.)

1. A method for controlling a terminal display, comprising:

when the fact that the display screen starts to execute operation is detected, acquiring the light sensitivity of the camera to detect whether the brightness degree of the external environment changes within a first preset time;

when the brightness degree of the external environment is detected to be changed within a first preset time, adjusting the display brightness of the display screen according to the sensitivity of the camera and the preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen;

acquiring target image data shot by the camera, wherein the target image data is image data with definition and image brightness meeting preset requirements;

when a human face is detected in the target image data, determining the distance between the human face and a display screen according to the target image data;

and when the fact that the distance between the face and the display screen is changed within a second preset time is detected, adjusting the font size of the display screen according to the distance between the face and the display screen.

2. The method according to claim 1, wherein the adjusting the display brightness of the display screen according to the sensitivity of the camera and a preset corresponding relationship between the sensitivity of the camera and the display brightness of the display screen comprises:

when the brightness degree of the external environment is detected to be changed within a first preset time, judging whether the sensitivity of the camera is within a first preset range;

if the sensitivity of the camera is not within a first preset range, adjusting parameters of the camera, and adjusting the display brightness of the display screen according to the sensitivity of the camera in an external environment and a preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen;

and if the sensitivity of the camera is within a first preset range or after the display brightness of the display screen is adjusted, executing the step of acquiring target image data shot by the camera.

3. The method for controlling terminal display according to claim 1 or 2, wherein the acquiring target image data captured by the camera comprises:

acquiring candidate image data shot by the camera according to a preset acquisition strategy;

determining a sharpness of each of the candidate image data;

judging whether the definition of each candidate image data is within a second preset range or not;

if the definition of the first candidate image data is not in the second preset range but in the third preset range, adjusting the definition of the first candidate image data, and then continuing to execute the step of judging whether the definition of each candidate image data is in the second preset range;

if the definition of the first candidate image data is within a second preset range, determining the image brightness of the first candidate image data;

judging whether the image brightness of the first candidate image data is within a fourth preset range;

if the image brightness of the first candidate image data is not within a fourth preset range, adjusting the image brightness of the first candidate image data until the image brightness of the first candidate image data is within the fourth preset range;

and if the image brightness of the first candidate image data is within a fourth preset range, determining the first candidate image data as target image data, and acquiring the first candidate image data.

4. The method of claim 3, wherein the determining the sharpness of each candidate image data comprises:

determining a sharpness of each of the candidate image data based on an open source computer vision library and employing a Laplace variance algorithm.

5. The method for controlling the terminal to display according to claim 3, wherein the determining the distance between the human face and the display screen according to the target image data comprises:

identifying the interpupillary distance of the face in the target image data through a face identification algorithm;

and determining the distance between the human face and the display screen according to the interpupillary distance of the human face in the target image data.

6. The method for controlling the display of the terminal according to claim 5, wherein the identifying the interpupillary distance of the face in the target image data by a face recognition algorithm according to the target image data comprises:

determining the position of a human face in the target image data according to the target image data;

intercepting image data of a designated area in the target image data according to the position of the face in the target image data, wherein the designated area is a preset area around the face as the center;

and identifying the interpupillary distance of the face in the target image data through a face identification algorithm according to the image data of the designated area.

7. The method for controlling terminal display according to claim 1, wherein after the step of adjusting the font size of the display screen according to the distance between the face and the display screen, the method for controlling terminal display further comprises:

if the distance between the face and the display screen is not changed within a second preset time or after the font size of the display screen is adjusted, acquiring the duration time and the current time of the operation;

judging whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range;

and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message.

8. The method of controlling a terminal display according to claim 1, further comprising:

when detecting that the display screen starts to execute the operation, adjusting the background color of the display screen to a designated color or displaying an interface for the user to select the background color.

9. An apparatus for controlling a display of a terminal, comprising:

the first obtaining submodule is used for obtaining the light sensitivity of the camera when the display screen is detected to start to execute operation so as to detect whether the brightness degree of the external environment changes within a first preset time;

the first adjusting submodule is used for adjusting the display brightness of the display screen according to the sensitivity of the camera and the preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen when the brightness of the external environment is detected to change within a first preset time;

the second acquisition submodule is used for acquiring target image data shot by the camera, wherein the target image data is image data with definition and image brightness meeting preset requirements;

the determining submodule is used for determining the distance between the human face and the display screen according to the target image data when the human face is detected in the target image data;

and the second adjusting submodule is used for adjusting the font size of the display screen according to the distance between the face and the display screen when the fact that the distance between the face and the display screen is changed within second preset time is detected.

10. An apparatus for controlling a display of a terminal, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-8.

11. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-8.

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for controlling terminal display, and a computer readable medium.

Background

With the continuous development and progress of scientific technology, different types of terminals (such as mobile phones and other terminals) become an indispensable part of daily life. Although the terminal may facilitate the life of the user, the user may experience eyestrain when using the terminal for a long time, particularly, a user who gets lost in a mobile game or a network novel.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, and a computer-readable medium for controlling a terminal display, which can solve the problem of eye fatigue of a user when the user uses the terminal for a long time.

To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided a method of controlling a display of a terminal.

The method for controlling the display of the terminal comprises the following steps:

acquiring target image data shot by the camera, wherein the target image data is image data with definition and image brightness meeting preset requirements;

when a human face is detected in the target image data, determining the distance between the human face and a display screen according to the target image data;

Optionally, the adjusting the display brightness of the display screen according to the sensitivity of the camera and a preset correspondence between the sensitivity of the camera and the display brightness of the display screen includes:

when the brightness degree of the external environment is detected to be changed within a first preset time, judging whether the sensitivity of the camera is within a first preset range;

Optionally, the acquiring target image data captured by the camera includes:

acquiring candidate image data shot by the camera according to a preset acquisition strategy;

determining a sharpness of each of the candidate image data;

judging whether the definition of each candidate image data is within a second preset range or not;

if the definition of the first candidate image data is within a second preset range, determining the image brightness of the first candidate image data;

judging whether the image brightness of the first candidate image data is within a fourth preset range;

Optionally, the determining the sharpness of each of the candidate image data comprises:

determining a sharpness of each of the candidate image data based on an open source computer vision library and employing a Laplace variance algorithm.

Optionally, the determining a distance between the human face and the display screen according to the target image data includes:

identifying the interpupillary distance of the face in the target image data through a face identification algorithm;

and determining the distance between the human face and the display screen according to the interpupillary distance of the human face in the target image data.

Optionally, the recognizing, according to the target image data, the interpupillary distance of the face in the target image data through a face recognition algorithm includes:

determining the position of a human face in the target image data according to the target image data;

and identifying the interpupillary distance of the face in the target image data through a face identification algorithm according to the image data of the designated area.

Optionally, after the step of adjusting the font size of the display screen according to the distance between the face and the display screen, the method for controlling the display of the terminal further includes:

judging whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range;

and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message.

Optionally, the method further comprises:

To achieve the above object, according to another aspect of an embodiment of the present invention, there is provided an apparatus for controlling a display of a terminal.

The device for controlling the display of the terminal comprises the following components:

To achieve the above object, according to another aspect of an embodiment of the present invention, there is provided an apparatus for controlling a display of a terminal.

The device for controlling the display of the terminal comprises the following components:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method as described above.

To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a computer-readable medium.

A computer-readable medium of an embodiment of the invention has stored thereon a computer program which, when executed by a processor, implements the method as described above.

One embodiment of the above invention has the following advantages or benefits:

in the embodiment of the invention, the method for controlling the terminal display is realized based on OpenCV (cross-platform computer vision library) and the functional characteristics of the camera, the method can adjust the display brightness of the display screen in real time according to the brightness of the external environment, and can also adjust the font size in real time according to the distance between the face and the display screen, and the method can reduce the harm to eyes caused by the fact that a user stares at the terminal display screen for a long time, and can relieve the eye fatigue of the user.

Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.

Drawings

The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:

fig. 1 is one of schematic diagrams of a main flow of a method of controlling a terminal display according to an embodiment of the present invention;

FIG. 2 is a second schematic diagram illustrating a main flow of a method for controlling a display of a terminal according to an embodiment of the present invention;

fig. 3 is a third schematic diagram of the main flow of a method for controlling a terminal display according to an embodiment of the present invention;

FIG. 4 is one of schematic diagrams of main blocks of an apparatus for controlling a terminal display according to an embodiment of the present invention;

FIG. 5 is a second schematic diagram of the main modules of the apparatus for controlling the display of a terminal according to the embodiment of the present invention;

FIG. 6 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;

fig. 7 is a schematic block diagram of a computer system suitable for use in implementing a terminal device or server of an embodiment of the invention.

Detailed Description

Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Currently, there are various ways to reduce the harm to the user's eyes by the terminal, and two of these ways are exemplified below:

the first mode is as follows: blue light emitted by the terminal can be reduced, so that harm to eyes of a user by the terminal is reduced. However, this method cannot solve the visual fatigue caused by the user gazing at the display screen for a long time, especially when the brightness contrast is large at night. Also, the materials used to make reduced-emission and blue-light displays are expensive and too costly for users of moderate living standards.

The second mode is as follows: the usage time of the user is controlled. After the user uses the terminal for a certain time, the user is reminded that the use time is too long and eyes need to rest, so that the use time of the user on the terminal is reduced, and the harm of the terminal to the eyes of the user is reduced. For users who need to look at the terminal or are enthusiastic in the mobile game or novel during work for a long time, it is obviously not possible to reduce the harm of the terminal in this way.

Although the above two methods can reduce the damage of the terminal to the eyes of the user to a certain extent, they still have some disadvantages, so that a more convenient, cheap and effective eye protection method still needs to be found.

Based on the above analysis, the embodiment of the present invention provides a method for controlling a terminal display, which aims to alleviate visual fatigue of a user, and solves a problem that the eyes of the user are damaged when the user uses the terminal for a long time in a relatively cheap manner through a currently advanced terminal and an IT technology, so as to alleviate the visual fatigue generated when the user uses the terminal and reduce harm to the eyes when the user stares at the terminal for a long time. The method can adopt proper measures to make up the defects of the first mode in a dark environment, can also perform some settings on the terminal to practically reduce the damage of the display screen to the eyes of people, and is not a second mode of simply reminding the user of overlong use time of the terminal. The method for controlling the terminal display can effectively relieve the visual fatigue of the user caused by using the terminal for a long time and reduce the harm of the terminal to the eyes of the user.

Fig. 1 is a schematic diagram of a main flow of a method for controlling a terminal display according to an embodiment of the present invention, and as shown in fig. 1, the method for controlling a terminal display is applied to a terminal, and the terminal at least includes: the camera comprises a camera and a display screen, wherein the shooting direction of the camera is consistent with the display direction of the display screen. The method for controlling the display of the terminal specifically comprises the following steps:

step 101: when the detection display screen starts to execute operation, acquiring the sensitivity of the camera to detect whether the brightness degree of the external environment changes within a first preset time; when detecting that the brightness level of the external environment changes within a first preset time, executing step 102; when it is detected that the brightness level of the external environment does not change within the first preset time, step 101 is repeatedly executed.

In step 101, the operation may be one or more of the following: clicking, sliding, playing video and/or displaying web page. The sensitivity (ISO) of the camera refers to the sensitivity of the camera to the intensity of light, and the sensitivity of the camera can be used for reflecting the brightness of the external environment. It can be understood that there is a corresponding relationship between the sensitivity of the camera and the brightness of the external environment, and whether the brightness of the external environment changes within the first preset time can be known through the sensitivity of the camera. Wherein, the external environment may be understood as the external environment in which the terminal is currently located. The first preset time can be understood as a detection period, and a value of the first preset time can be determined according to detection requirements.

Step 102: when the brightness degree of the external environment is detected to be changed within a first preset time, adjusting the display brightness of the display screen according to the sensitivity of the camera and the preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen;

in step 102, the display brightness of the display screen may be adjusted according to a fitting formula of the sensitivity of the camera and the display brightness of the display screen; the fitting formula may be used to represent a correspondence between sensitivity of the camera and display brightness of the display screen, and is as follows:

y₁＝k₁g(x₁)

wherein x is₁Representing the sensitivity of the camera; y is₁Displaying the display brightness of the display screen corresponding to each sensitivity; k is a radical of₁Represents a proportionality coefficient, and k₁Is a fixed value.

When determining a fitting formula of the sensitivity of the camera and the brightness degree of the external environment, firstly, acquiring different sensitivities of a preset number and target display brightness of a display screen corresponding to each sensitivity; and then obtaining a fitting formula of the sensitivity of the camera and the display brightness of the display screen according to the preset number of different sensitivities and the target display brightness of the display screen corresponding to each sensitivity. The target display brightness can be understood as optimal display brightness corresponding to different sensitivities, and the target display brightness can be obtained in advance according to experiments.

For example: the display brightness range of the display screen is between 0 and 100, and the display brightness of the display screen can be divided into the following five grades: dark, shade, weak light, normal and strong light, wherein the display brightness values of the display screens of five grades are respectively (20, 40, 60, 80 and 100). Correspondingly, the values of the sensitivity of the camera corresponding to the display brightness of each level are respectively (2000, 1000, 200, 100, 30). According to the sensitivity of the camera corresponding to the display brightness of different levels, the corresponding relation between the sensitivity of the camera and the display brightness of the display screen, namely y, can be obtained through fitting₁＝k₁g(x₁)。

It is understood that the display brightness of the display screen can be changed along with the brightness of the external environment through the step 102. For example: if the external environment becomes bright, the display brightness of the display screen is increased; if the external environment becomes dark, the display brightness of the display screen is reduced. Therefore, the problem that the display brightness is too high to cause dazzling in a darker environment and the problem that the display content of the display screen cannot be seen clearly by a user due to too low display brightness in a bright environment can be solved, and the eyestrain of the user can be relieved.

In addition, in order to obtain the target image data in step 103, before adjusting the display brightness of the display screen, it may be first determined whether the sensitivity of the camera is within a first preset range; if the sensitivity of the camera is not within a first preset range, adjusting parameters of the camera, and adjusting the display brightness of the display screen according to the sensitivity of the camera in an external environment and a preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen; if the sensitivity of the camera is within a first preset range or after adjusting the parameters of the camera, step 103 is executed.

It should be noted that the first preset range is used to determine whether the brightness level of the external environment where the terminal is located is within an ideal range. It can be understood that, if the sensitivity of the camera is not within the first preset range, it indicates that the brightness of the external environment is not satisfactory, which may be unfavorable to both eyes of the user, and may even affect the acquisition of the target image data in step 103, and the display brightness of the display screen and the parameters of the camera may be adjusted. For example: the light supplementing rate of the camera can be adjusted, so that the target image data can be conveniently acquired.

Step 103: acquiring target image data shot by the camera, wherein the target image data is image data with definition and image brightness meeting preset requirements;

in step 103, the target image data may specifically be image data with a definition in a second preset range and an image brightness in a fourth preset range, where the image data may be data such as a picture or a video. The definition of the target image data refers to the definition of each detail shadow and its boundary of the target image data, and the definition can be used for reflecting the image quality of the target image data. The image brightness of the target image data refers to the brightness degree of the target image data picture. The second preset range is a threshold of the definition of the image data, the fourth preset range is a threshold of the image brightness of the image data, and values of the second preset range and the fourth preset range may be determined as needed.

When target image data shot by the camera is obtained, candidate image data shot by the camera can be collected according to a preset collection strategy; then determining the sharpness of each of the candidate image data; further judging whether the definition of each candidate image data is within a second preset range; if the definition of the first candidate image data is not in the second preset range but in the third preset range, adjusting the definition of the first candidate image data, and then continuing to execute the step of judging whether the definition of each candidate image data is in the second preset range; if the definition of the first candidate image data is within a second preset range, determining the image brightness of the first candidate image data; judging whether the image brightness of the first candidate image data is within a fourth preset range; if the image brightness of the first candidate image data is not within a fourth preset range, adjusting the image brightness of the first candidate image data until the image brightness of the first candidate image data is within the fourth preset range; and if the image brightness of the first candidate image data is within a fourth preset range, determining the first candidate image data as target image data, and acquiring the first candidate image data.

Step 104: when a human face is detected in the target image data, determining the distance between the human face and a display screen according to the target image data;

in step 104, firstly, according to the target image data, identifying the interpupillary distance of the human face in the target image data through a human face recognition algorithm; and then determining the distance between the human face and the display screen according to the interpupillary distance of the human face in the target image data.

When identifying the interpupillary distance of the face in the target image data, firstly, determining the position of the face in the target image data according to the target image data; then according to the position of the face in the target image data, intercepting image data of a designated area in the target image data, wherein the designated area is a preset area around the face as the center; and finally, according to the image data of the specified area, identifying the interpupillary distance of the face in the target image data through a face identification algorithm.

Then, the distance between the human face and the display screen can be determined according to the following formula and the interpupillary distance of the human face in the target image data:

y₂＝k₂x₂+b₂

wherein, y₂Representing the interpupillary distance of the human face in the target image data; k is a radical of₂Represents a scaling factor; x is the number of₂Representing the distance between the human face and the display screen; b₂Representing interpupillary distance when the distance between the face and the display screen is minimal, and b₂Is a fixed value.

Step 105: and when the fact that the distance between the face and the display screen is changed within a second preset time is detected, adjusting the font size of the display screen according to the distance between the face and the display screen.

In step 105, firstly, judging whether the distance between the human face and the display screen changes within a second preset time; if the distance between the face and the display screen is not changed within a second preset time or after the font size of the display screen is adjusted, whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range can be judged; and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message. If the distance between the face and the display screen is changed within a second preset time, the font size of the display screen can be adjusted according to the following formula and the distance between the face and the display screen:

y₃＝k₃x₃+b₃

wherein, y₃Representing the font size of the display screen; k is a radical of₃Represents a scaling factor; x is the number of₃Representing the distance between the human face and the display screen; b₃Is a fixed value.

For example: the distance between the human face and the display screen ranges from 20cm to 40cm, the distance between a user and the display screen is 40cm when the user normally uses the terminal, and the font size of the display screen is corresponding to a No. 10 font. From this, k is₃＝-0.5，b_3＝30。

In the embodiment of the invention, the method for controlling the terminal display is realized based on OpenCV and the functional characteristics of the camera, and the OpenCV is a cross-platform computer vision library and can run on Linux, Windows, Android and Mac OS operating systems. The method can adjust the display brightness of the display screen in real time according to the brightness degree of the external environment, and can also adjust the font size in real time according to the distance between the face and the display screen.

Fig. 2 is a schematic diagram of a main flow of a method for controlling a terminal display according to an embodiment of the present invention, and as shown in fig. 2, the method for controlling a terminal display is applied to a terminal, where the terminal at least includes: the camera comprises a camera and a display screen, wherein the shooting direction of the camera is consistent with the display direction of the display screen. The method for controlling the display of the terminal specifically comprises the following steps:

step 201: when the fact that the display screen starts to execute operation is detected, acquiring the light sensitivity of the camera to detect whether the brightness degree of the external environment changes within a first preset time; when detecting that the brightness level of the external environment changes within a first preset time, executing step 202; when it is detected that the brightness level of the external environment does not change within the first preset time, step 201 is repeatedly performed.

In step 201, the operation may be one or more of the following: clicking, sliding, playing video and/or displaying web page. The sensitivity (ISO) of the camera refers to the sensitivity of the camera to the intensity of light, and the sensitivity of the camera can be used for reflecting the brightness of the external environment. It can be understood that there is a corresponding relationship between the sensitivity of the camera and the brightness of the external environment, and whether the brightness of the external environment changes within the first preset time can be known through the sensitivity of the camera. Wherein, the external environment may be understood as the external environment in which the terminal is currently located. The first preset time can be understood as a detection period, and a value of the first preset time can be determined according to detection requirements.

Step 202: when the brightness degree of the external environment is detected to be changed within a first preset time, adjusting the display brightness of the display screen according to the sensitivity of the camera and the preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen;

in step 202, the display brightness of the display screen may be adjusted according to a fitting formula of the sensitivity of the camera and the display brightness of the display screen; the fitting formula can be used for representing the corresponding relation between the sensitivity of the camera and the display brightness of the display screen. The fitting formula is as follows:

y₁＝k₁g(x₁)

It should be noted that the implementation principle of step 202 is the same as that of step 102, and the description of the same parts is omitted.

Step 203: acquiring target image data shot by the camera, wherein the target image data is image data with definition and image brightness meeting preset requirements;

in step 203, the target image data may specifically be image data with a definition within a second preset range and an image brightness within a fourth preset range, and the image data may be data such as a picture or a video. The definition of the target image data refers to the definition of each detail shadow and its boundary of the target image data, and the definition can be used for reflecting the image quality of the target image data. The image brightness of the target image data refers to the brightness degree of the target image data picture. The second preset range is a threshold of the definition of the image data, the fourth preset range is a threshold of the image brightness of the image data, and values of the second preset range and the fourth preset range may be determined as needed.

Step 204: when a human face is detected in the target image data, determining the distance between the human face and a display screen according to the target image data;

in step 204, firstly, according to the target image data, identifying the interpupillary distance of the human face in the target image data through a human face recognition algorithm; and then determining the distance between the human face and the display screen according to the interpupillary distance of the human face in the target image data.

Then, the distance between the human face and the display screen can be determined according to the following formula and the interpupillary distance of the human face in the target image data:

y₂＝k₂x₂+b₂

Step 205: judging that the distance between the face and the display screen is changed within a second preset time; if the distance between the face and the display screen is detected to be changed within the second preset time, executing step 206; if the distance between the face and the display screen is not changed within a second preset time, step 207 is executed.

Step 206: and when the fact that the distance between the face and the display screen is changed within a second preset time is detected, adjusting the font size of the display screen according to the distance between the face and the display screen. Then, step 207 is performed after step 206.

In step 206, first, it is determined whether the distance between the face and the display screen changes within a second preset time; if the distance between the face and the display screen is not changed within a second preset time or after the font size of the display screen is adjusted, the duration time and the current time of the operation can be acquired, and whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range is judged; and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message. If the distance between the face and the display screen is changed within a second preset time, the font size of the display screen can be adjusted according to the following formula and the distance between the face and the display screen:

y₃＝k₃x₃+b₃

Step 207: if the distance between the face and the display screen is not changed within a second preset time or after the font size of the display screen is adjusted, acquiring the duration time and the current time of the operation;

step 208: judging whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range; if the duration of the operation exceeds a fifth preset range or the current time exceeds a sixth preset range, go to step 209; and if the duration time of the operation does not exceed the fifth preset range and the current time does not exceed the sixth preset range, ending the process.

In step 208, the duration of the operation refers to the duration of the operation performed by the user on the display screen, or the duration of the operation may be understood as the time that the user keeps staring at the display screen. The fifth preset range is a threshold of the duration of the operation, and a user can set a value of the fifth preset range according to a usual use habit, and can also select a default value of the system. The sixth preset range may be understood as a normal use time of the user, for example: the sixth preset range can be 6 to 23 points, the user can set the value of the sixth preset range according to the usual use habit, and the user can also select the default value of the system.

When the duration of the operation is determined, when the fact that the user executes the operations of clicking, sliding, playing videos or displaying webpages and the like and the distance between the face and the display screen is within the detection range is detected, a timer starts timing, and the duration of the operation is calculated. It can be understood that the duration of the operation is determined based on the user performing operations such as clicking, sliding, playing a video or displaying a web page, and the like, and assisted by whether the distance between the face and the display screen is within the detection range.

Step 209: and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message.

In step 209, the prompt message is used to prompt the user that the operation time is too long or the normal use time has been exceeded. The prompt message may be a voice message, a text message, or a video message.

In the embodiment of the invention, the method for controlling the terminal display is realized based on OpenCV and the functional characteristics of a camera of the mobile device, the method can adjust the display brightness of the display screen in real time according to the brightness degree of the external environment, can also adjust the font size in real time according to the distance between the face and the display screen, and can also send prompt information when the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range.

Fig. 3 is a schematic diagram of a main flow of a method for controlling a terminal display according to an embodiment of the present invention, and as shown in fig. 3, the method for controlling a terminal display is applied to a terminal, where the terminal at least includes: the camera comprises a camera and a display screen, wherein the shooting direction of the camera is consistent with the display direction of the display screen. The method for controlling the display of the terminal specifically comprises the following steps:

step 301: when detecting that the display screen starts to execute the operation, adjusting the background color of the display screen to a designated color or displaying an interface for the user to select the background color. Then, step 302 is performed after step 301.

In step 301, the designated color may be understood as a color that facilitates eye protection, such as: the specified color may be green. In addition, in order to improve the use experience of the user, an interface for the user to select the background color can be displayed, so that the user can conveniently select the favorite background color according to the requirement.

Step 302: acquiring the light sensitivity of the camera to detect whether the brightness degree of the external environment changes within a first preset time; when detecting that the brightness level of the external environment changes within a first preset time, executing step 303; when it is detected that the brightness level of the external environment does not change within the first preset time, step 302 is repeatedly performed.

In step 302, the operation may be one or more of: clicking, sliding, playing video and/or displaying web page. The sensitivity (ISO) of the camera refers to the sensitivity of the camera to the intensity of light, and the sensitivity of the camera can be used for reflecting the brightness of the external environment. It can be understood that there is a corresponding relationship between the sensitivity of the camera and the brightness of the external environment, and whether the brightness of the external environment changes within the first preset time can be known through the sensitivity of the camera. Wherein, the external environment may be understood as the external environment in which the terminal is currently located. The first preset time can be understood as a detection period, and a value of the first preset time can be determined according to detection requirements.

Step 303: when the brightness degree of the external environment is detected to be changed within a first preset time, judging whether the sensitivity of the camera is within a first preset range; if the sensitivity of the camera is not within the first preset range, executing step 304; if the sensitivity of the camera is within the first preset range, step 305 is executed.

In step 303, the sensitivity of the camera is within a first preset range, which indicates that the brightness of the external environment is good, so as to obtain the target image data. The sensitivity of the camera is not within a first preset range, which indicates that the external environment is too dark, and in order to shoot target image data meeting preset requirements, the light supplementing rate of the camera can be adjusted to perform light supplementing processing.

It should be noted that the first preset range is used to determine whether the brightness level of the external environment where the terminal is located is within an ideal range. It can be understood that, if the sensitivity of the camera is not within the first preset range, it indicates that the brightness of the external environment is not satisfactory, which may be unfavorable to both eyes of the user, and may even affect the acquisition of the target image data in step 312, and the display brightness of the display screen and the parameters of the camera may be adjusted. For example: the light supplementing rate of the camera can be adjusted, so that the target image data can be conveniently acquired.

Step 304: adjusting parameters of the camera, and adjusting the display brightness of the display screen according to the sensitivity of the camera and a preset corresponding relation between the sensitivity of the camera and the display brightness of the display screen;

in step 304, the display brightness of the display screen may be adjusted according to a fitting formula of the sensitivity of the camera and the display brightness of the display screen; the fitting formula can be used for representing the corresponding relation between the sensitivity of the camera and the display brightness of the display screen. In this way, the display brightness of the display screen can be adjusted by the brightness level of the external environment through step 304, so as to prevent the user's eyes from being pricked by the light-dark difference. In addition, through step 304, light supplement processing can be performed on darker image data, and the light supplement rate of the camera is increased, so that the problem that target image data cannot be acquired due to the fact that the image brightness of the image data is darker is solved.

In the embodiment of the present invention, the fitting formula is as follows:

y₁＝k₁g(x₁)

When determining a fitting formula of the sensitivity of the camera and the brightness degree of the external environment, firstly, acquiring different sensitivities of a preset number and target display brightness of a display screen corresponding to each sensitivity; and then obtaining a fitting formula of the sensitivity of the camera and the display brightness of the display screen according to the preset number of different sensitivities and the target display brightness of the display screen corresponding to each sensitivity. The target display brightness may be understood as an optimal display brightness corresponding to each sensitivity, and the target display brightness may be obtained in advance according to an experiment.

It should be noted that the implementation principle of step 304 is the same as that of step 202, and the description of the same parts is omitted.

Step 305: if the sensitivity of the camera is within a first preset range or after the display brightness of the display screen is adjusted, acquiring candidate image data shot by the camera according to a preset acquisition strategy;

in step 305, the preset acquisition strategy may be understood as acquiring candidate image data shot by the camera according to a preset acquisition frequency. Because the external environment where the user is located and the distance between the human face and the display screen are greatly changed in a short time, and meanwhile, in order to reduce the workload of the terminal, when candidate image data are collected, the candidate image data can be collected once at intervals according to a preset collection period by combining the brightness degree (the light sensitivity ISO of a camera) of the external environment. For example: a bright environment of ISO <200 or a dark environment of ISO >1000, the time interval is set to 1 minute since the environment does not change much, otherwise 30 s.

Step 306: determining a sharpness of each of the candidate image data;

in step 306, the sharpness of each of the candidate image data may be determined using the basis function provided by OpenCV and the laplacian variance algorithm. Simply speaking, the candidate image data is only required to be converted into a data type required by cvMat (important matrix transformation function in OpenCV), convolution operation is performed through a laplacian variance method on the gray value of the candidate image data of the picture, so as to obtain a pixel matrix, the variance is calculated on the numerical values in the matrix, and the definition of each candidate image data is determined. The variance is larger if the candidate image data is sharper at edges and larger in difference between pixels, the sharper the candidate image data is. Otherwise, the candidate image data is blurred, and the pixel difference between edges is small, the variance is smaller.

Step 307: judging whether the definition of each candidate image data is within a second preset range or not; if the sharpness of the first candidate image data is not within the second preset range, go to step 308; if the sharpness of the first candidate image data is within the second preset range, go to step 309;

for example: when the definition of the candidate image data is qualified, the candidate image data may be regarded as the target image data. When the definition of the candidate image data is not lower than 80% of the second preset range, the definition of the candidate image data can be improved by adopting a development method provided by a mobile platform. When the sharpness of the candidate image data is lower than 80% of the second preset range, the candidate image data is directly discarded.

Step 308: if the definition of the first candidate image data is not within the second preset range but within the third preset range, adjusting the definition of the first candidate image data, and then continuing to execute step 307;

step 309: if the definition of the first candidate image data is within a second preset range, determining the image brightness of the first candidate image data;

step 310: judging whether the image brightness of the first candidate image data is within a fourth preset range;

step 311: if the image brightness of the first candidate image data is not within a fourth preset range, adjusting the image brightness of the first candidate image data until the image brightness of the first candidate image data is within the fourth preset range;

step 312: and if the image brightness of the first candidate image data is within a fourth preset range, determining the first candidate image data as target image data, and acquiring the first candidate image data.

Step 313: when a human face is detected in the target image data, identifying the interpupillary distance of the human face in the target image data through a human face identification algorithm according to the target image data;

in step 313, the position of the human face in the target image data may be determined according to the target image data; then according to the position of the face in the target image data, intercepting image data of a designated area in the target image data, wherein the designated area is a preset area around the face as the center; and finally, according to the image data of the specified area, identifying the interpupillary distance of the face in the target image data through a face identification algorithm.

When the position of the face in the target image data is determined, a coordinate system can be established by taking one point of the target image data as an origin, and then the coordinates of the designated area corresponding to the face are determined.

Step 314: and determining the distance between the human face and the display screen according to the interpupillary distance of the human face in the target image data.

In step 314, the distance between the human face and the display screen may be determined according to the following formula and the interpupillary distance of the human face in the target image data:

y₂＝k₂x₂+b₂

Step 315: judging whether the distance between the face and the display screen changes within a second preset time; if the distance between the face and the display screen is changed within a second preset time, executing step 316; if the distance between the face and the display screen is not changed within the second preset time, step 317 is executed.

Step 316: and if the distance between the face and the display screen is changed within a second preset time, adjusting the font size of the display screen according to the distance between the face and the display screen. Step 317 is then performed after step 316.

In step 316, determining whether the distance between the face and the display screen changes within a second preset time; if the distance between the face and the display screen is not changed within second preset time or after the font size of the display screen is adjusted, judging whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range; and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message. If the distance between the face and the display screen is changed within a second preset time, the font size of the display screen can be adjusted according to the following formula and the distance between the face and the display screen:

y₃＝k₃x₃+b₃

Step 317: if the distance between the face and the display screen is not changed within a second preset time or after the font size of the display screen is adjusted, acquiring the duration time and the current time of the operation;

step 318: judging whether the duration time of the operation exceeds a fifth preset range or whether the current time exceeds a sixth preset range; if the duration of the operation exceeds a fifth preset range or the current time exceeds a sixth preset range, go to step 319; and if the duration time of the operation does not exceed the fifth preset range and the current time does not exceed the sixth preset range, ending the process.

Step 319: and if the operation duration exceeds a fifth preset range or the current time exceeds a sixth preset range, sending a prompt message.

In step 319, the prompt message is used to prompt the user that the operation time is too long or the normal use time has been exceeded. The prompt message may be a voice message, a text message, or a video message.

In the embodiment of the invention, the method for controlling the display of the terminal is realized based on OpenCV and the self functional characteristics of the camera, the OpenCV is a cross-platform computer vision library and can be operated on Linux, Windows, Android and Mac OS operating systems. The method can adjust the display brightness of the display screen in real time according to the brightness degree of the external environment, and can also adjust the font size in real time according to the distance between the face and the display screen.

Fig. 4 is a schematic diagram of main modules of an apparatus for controlling terminal display according to an embodiment of the present invention, and referring to fig. 4, the apparatus 400 for controlling terminal display may specifically include:

the first obtaining submodule 401 is configured to, when it is detected that the display screen starts to perform an operation, obtain sensitivity of the camera to detect whether a brightness level of an external environment changes within a first preset time;

a first adjusting submodule 402, configured to adjust the display brightness of the display screen according to the sensitivity of the camera and a preset correspondence between the sensitivity of the camera and the display brightness of the display screen when it is detected that the brightness of the external environment changes within a first preset time;

a second obtaining submodule 403, configured to obtain target image data captured by the camera, where the target image data is image data whose definition and image brightness both meet preset requirements;

a determining sub-module 404, configured to determine, when a face is detected in the target image data, a distance between the face and a display screen according to the target image data;

and a second adjusting submodule 405, configured to, when it is detected that the distance between the face and the display screen changes within a second preset time, adjust the font size of the display screen according to the distance between the face and the display screen.

Optionally, the first adjusting submodule 402 is further configured to:

when the brightness degree of the external environment is detected to be changed within a first preset time, judging whether the sensitivity of the camera is within a first preset range;

if the sensitivity of the camera is within a first preset range or after the display brightness of the display screen is adjusted, the second obtaining sub-module 403 is turned on to perform the step of obtaining the target image data captured by the camera.

Optionally, the second obtaining sub-module 403 is further configured to: