阅读说明：本技术 触摸屏时延检测方法、系统、装置、设备和存储介质 (Touch screen time delay detection method, system, device, equipment and storage medium ) 是由 石宏伟 陈勇 薛晓栋 于 2020-03-26 设计创作，主要内容包括：本发明公开了一种触摸屏时延检测方法,包括以下步骤：接收到时延检测请求时,分析目标终端发送的事件日志,在所述事件日志是点击事件日志时,发送录制指令至预设摄像装置,通过所述预设摄像装置录制所述目标终端触摸屏状态改变的视频,接收所述预设摄像装置发送的视频,并对所述视频进行分帧处理,得到帧集合,分析所述帧集合中的各画面帧,获得目标画面帧,将所述目标画面帧的相对时间作为所述目标终端触摸屏的时延时间。本发明还公开了一种触摸屏时延检测方法、系统、装置、设备和存储介质。本发明通过自动化手段和图像比对技术完成了触摸屏时延测试,简化测试方法中的人为操作,提升了触摸屏时延测试的准确性。(The invention discloses a touch screen time delay detection method, which comprises the following steps: when a time delay detection request is received, analyzing an event log sent by a target terminal, when the event log is a click event log, sending a recording instruction to a preset camera device, recording a video with the state of a touch screen of the target terminal changed through the preset camera device, receiving the video sent by the preset camera device, performing framing processing on the video to obtain a frame set, analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the touch screen of the target terminal. The invention also discloses a method, a system, a device, equipment and a storage medium for detecting the time delay of the touch screen. According to the invention, the touch screen time delay test is completed by an automatic means and an image comparison technology, the manual operation in the test method is simplified, and the accuracy of the touch screen time delay test is improved.)

1. A touch screen time delay detection method is characterized by comprising the following steps:

when a time delay detection request is received, analyzing an event log sent by a target terminal;

when the event log is a click event log, sending a recording instruction to a preset camera device, and recording a video with the state changed by the target terminal touch screen through the preset camera device;

receiving a video sent by the preset camera device, and performing framing processing on the video to obtain a frame set;

analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

2. The touch screen delay detection method according to claim 1, wherein the step of analyzing the event log sent by the target terminal when receiving the delay detection request includes:

when a time delay detection request is received, sending a log acquisition instruction to a target terminal to be detected;

receiving an event log sent by the target terminal, analyzing the event log, and judging whether the event log is a click event log;

and when the event log is a click event log, executing the step of sending a recording instruction to a preset camera device and recording the video with the changed state of the target terminal touch screen through the preset camera device.

3. The method for detecting the time delay of the touch screen according to claim 1, wherein the step of sending a recording instruction to a preset camera device when the event log is a click event log, and recording the video with the changed state of the touch screen of the target terminal by the preset camera device comprises the steps of;

when the event log is a click event log, stopping receiving the event log sent by the target terminal within preset time;

and sending a recording instruction to a preset camera device, and recording the video with the changed state of the target terminal touch screen through the preset camera device.

4. The touch screen delay detection method according to claim 1, wherein the step of analyzing each picture frame in the frame set to obtain a target picture frame, and taking a relative time of the target picture frame as the delay time of the target terminal touch screen comprises:

acquiring the refresh rate of the touch screen of the target terminal and a preset threshold corresponding to the refresh rate of the touch screen;

comparing two adjacent picture frames from a first picture frame of a frame set to obtain the similarity of the two corresponding picture frames;

if the similarity of the two image frames is greater than a preset threshold value, comparing the next group of adjacent two image frames to obtain the similarity of the corresponding two image frames;

and when the similarity is smaller than a preset threshold value, acquiring the relative time of a later picture frame used in the comparison, and taking the relative time as the time delay time of the target terminal.

5. The touch screen delay detection method according to claim 1, wherein the step of analyzing each picture frame in the frame set to obtain a target picture frame, and taking a relative time of the target picture frame as the delay time of the target terminal touch screen comprises:

acquiring the refresh rate of the touch screen of the target terminal and a preset threshold corresponding to the refresh rate of the touch screen;

comparing a first picture frame of a frame set with other changed picture frames except the first picture frame in the frame set to obtain the similarity of the first picture frame and the changed picture frames;

and taking the picture frame with the similarity smaller than a preset threshold value with the first picture frame as a target picture frame, acquiring the relative time of the first picture frame, and taking the relative time as the time delay time of the target terminal.

6. The method according to any one of claims 1 to 5, wherein the step of analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the delay time of the target terminal touch screen, comprises:

judging whether the time delay time is within a preset time range or not;

if the time delay time is not within the preset time range, giving up the time delay time and triggering a time delay detection request;

if the time delay time is within the preset time range, writing the time delay time into a memory, and triggering a time delay detection request;

acquiring the time delay time of a target terminal for multiple times;

and averaging the time delay time of the target terminal obtained for multiple times, and taking the average value as the final time delay time.

7. The utility model provides a touch-sensitive screen time delay detecting system which characterized in that, touch-sensitive screen time delay detecting system includes communication connection's touch-sensitive screen time delay check out test set, target terminal and predetermines camera device, the step that touch-sensitive screen time delay detecting system realized includes:

a target terminal detects a real-time event and generates a corresponding event log;

when the touch screen delay detection equipment receives a delay detection request, analyzing an event log sent by a target terminal;

when the event log is a click event log, the touch screen time delay detection equipment sends a recording instruction to a preset camera device, and a video with the state changed by the touch screen of the target terminal is recorded through the preset camera device;

the preset camera device sends the recorded video containing the target terminal to touch screen time delay detection equipment;

the touch screen time delay detection equipment receives the video sent by the preset camera device and performs framing processing on the video to obtain a frame set;

and the touch screen time delay detection equipment analyzes each picture frame in the frame set to obtain a target picture frame, and the relative time of the target picture frame is taken as the time delay time of the touch screen of the target terminal.

8. A touch screen time delay detection device, characterized in that, the touch screen time delay detection device includes:

a receiving and analyzing module: the system comprises a time delay detection module, a time delay module and a time delay module, wherein the time delay detection module is used for receiving a time delay detection request and analyzing an event log sent by a target terminal;

a judging and sending module: the event log sending unit is used for sending a recording instruction to a preset camera device when the event log is a click event log, and recording a video with the state changed by the target terminal touch screen through the preset camera device;

the video processing module: the system comprises a preset camera device, a frame processing device and a video processing device, wherein the preset camera device is used for receiving a video sent by the preset camera device and performing frame processing on the video to obtain a frame set;

a time delay determining module: and the time delay unit is used for analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

9. A touch screen delay detection device, comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:

the computer program when executed by the processor implementing the steps of the touch screen latency detection method of any one of claims 1 to 6.

10. A computer storage medium, characterized in that the computer storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the touch screen latency detection method according to any one of claims 1 to 6.

Technical Field

The invention relates to the field of automatic testing, in particular to a method, a system, a device, equipment and a storage medium for detecting time delay of a touch screen.

Background

A Touch Screen (also called a Touch Screen or a Touch panel) is an inductive display device capable of receiving input signals such as a Touch, and when a user touches the Touch Screen, the Touch Screen can drive various connecting devices according to a pre-programmed program, and a vivid image effect is produced by a liquid crystal display Screen. As a latest input device, the touch screen brings great convenience to the life of people. Meanwhile, the experience requirements of the user on the touch screen are becoming higher and higher, wherein the response time of the touch screen is an important index in the user experience.

In order to accurately evaluate the experience of the touch screen, the response time of the touch screen needs to be acquired first, and the current methods for acquiring the response time of the touch screen mainly include two methods: the first method is that the touch screen is manually acquired, an operator operates the touch screen, and meanwhile, the response time of the touch screen is recorded through a timing tool such as a stopwatch; the second method is that a time acquisition code is added to a source code of an application program in a buried mode, a time point when a user touches a screen and a time point when the screen responds are acquired, and the difference value of the two time points is calculated and used as the response time of the touch screen.

Because the method is limited by the reaction speed of people and most of test operations are carried out manually, the first method is only suitable for touch screens with slow response speed, such as electronic ink screens (E-ink), and the test results are possibly influenced by the subjective of people and are inaccurate, and the second method is characterized in that the response time of the touch screens is influenced by a code execution mechanism and the obtained results are inaccurate.

Disclosure of Invention

The invention mainly aims to provide a touch screen time delay detection method, a system, a device, equipment and a storage medium, and aims to solve the technical problems that the current touch screen time delay detection method is small in application range and inaccurate in detection result.

In order to achieve the above object, the present invention provides a method for detecting a touch screen delay, which comprises the following steps:

when a time delay detection request is received, analyzing an event log sent by a target terminal;

when the event log is a click event log, sending a recording instruction to a preset camera device, and recording a video with the state changed by the target terminal touch screen through the preset camera device;

receiving a video sent by the preset camera device, and performing framing processing on the video to obtain a frame set;

analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

In an embodiment, the step of analyzing the event log sent by the target terminal when the delay detection request is received includes:

when a time delay detection request is received, sending a log acquisition instruction to a target terminal to be detected;

receiving an event log sent by the target terminal, analyzing the event log, and judging whether the event log is a click event log;

and when the event log is a click event log, executing the step of sending a recording instruction to a preset camera device and recording the video with the changed state of the target terminal touch screen through the preset camera device.

In an embodiment, the step of sending a recording instruction to a preset camera device when the event log is a click event log, and recording the video with the changed state of the target terminal touch screen by using the preset camera device includes;

when the event log is a click event log, stopping receiving the event log sent by the target terminal within preset time;

and sending a recording instruction to a preset camera device, and recording the video with the changed state of the target terminal touch screen through the preset camera device.

In an embodiment, the analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the delay time of the target terminal touch screen includes:

acquiring the refresh rate of the touch screen of the target terminal and a preset threshold corresponding to the refresh rate of the touch screen;

comparing two adjacent picture frames from a first picture frame of a frame set to obtain the similarity of the two corresponding picture frames;

if the similarity of the two image frames is greater than a preset threshold value, comparing the next group of adjacent two image frames to obtain the similarity of the corresponding two image frames;

and when the similarity is smaller than a preset threshold value, acquiring the relative time of a later picture frame used in the comparison, and taking the relative time as the time delay time of the target terminal.

In an embodiment, the analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the delay time of the target terminal touch screen includes:

acquiring the refresh rate of the touch screen of the target terminal and a preset threshold corresponding to the refresh rate of the touch screen;

comparing a first picture frame of a frame set with other changed picture frames except the first picture frame in the frame set to obtain the similarity of the first picture frame and the changed picture frames;

and taking the picture frame with the similarity smaller than a preset threshold value with the first picture frame as a target picture frame, acquiring the relative time of the first picture frame, and taking the relative time as the time delay time of the target terminal.

In an embodiment, after the step of analyzing each picture frame in the frame set to obtain a target picture frame and taking the relative time of the target picture frame as the delay time of the target terminal touch screen, the method includes:

judging whether the time delay time is within a preset time range or not;

if the time delay time is not within the preset time range, giving up the time delay time and triggering a time delay detection request;

if the time delay time is within the preset time range, writing the time delay time into a memory, and triggering a time delay detection request;

acquiring the time delay time of a target terminal for multiple times;

and averaging the time delay time of the target terminal obtained for multiple times, and taking the average value as the final time delay time.

In addition, in order to achieve the above object, the present invention further provides a touch screen delay detection system, where the touch screen delay detection system includes a touch screen delay detection device, a target terminal, and a preset camera device, and the touch screen delay detection system includes:

a target terminal detects a real-time event and generates a corresponding event log;

when the touch screen delay detection equipment receives a delay detection request, analyzing an event log sent by a target terminal;

when the event log is a click event log, the touch screen time delay detection equipment sends a recording instruction to a preset camera device, and a video with the state changed by the touch screen of the target terminal is recorded through the preset camera device;

the preset camera device sends the recorded video containing the target terminal to touch screen time delay detection equipment;

the touch screen time delay detection equipment receives the video sent by the preset camera device and performs framing processing on the video to obtain a frame set;

and the touch screen time delay detection equipment analyzes each picture frame in the frame set to obtain a target picture frame, and the relative time of the target picture frame is taken as the time delay time of the touch screen of the target terminal.

In addition, to achieve the above object, the present invention further provides a touch screen delay detection device, including:

a receiving and analyzing module: the system comprises a time delay detection module, a time delay module and a time delay module, wherein the time delay detection module is used for receiving a time delay detection request and analyzing an event log sent by a target terminal;

a judging and sending module: the event log sending unit is used for sending a recording instruction to a preset camera device when the event log is a click event log, and recording a video with the state changed by the target terminal touch screen through the preset camera device;

the video processing module: the system comprises a preset camera device, a frame processing device and a video processing device, wherein the preset camera device is used for receiving a video sent by the preset camera device and performing frame processing on the video to obtain a frame set;

a time delay determining module: and the time delay unit is used for analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

In addition, to achieve the above object, the present invention further provides a touch screen delay detection device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:

the computer program, when executed by the processor, implements the steps of the touch screen latency detection method as described above.

In addition, to achieve the above object, the present invention further provides a computer storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the touch screen delay detection method.

According to the touch screen time delay detection method, the touch screen time delay detection system, the touch screen time delay detection device and the storage medium, the event log of the target terminal is received and analyzed in real time, when the click event log of the target terminal is received, a recording instruction is sent to the preset camera device, the preset camera device records the video with the changed state of the touch screen of the target terminal, the touch screen time delay detection device receives the video, the video is subjected to framing processing to obtain a frame set, the frame set is analyzed to obtain a target picture frame, and the relative time of the target picture frame is used as the time delay time of the touch screen, so that the automatic detection of the time delay of the touch screen is realized, the manual operation is greatly simplified, the detection error caused by human factors is avoided, and the accuracy of the time delay detection result of the touch screen is improved.

Drawings

FIG. 1 is a schematic diagram of an apparatus in a hardware operating environment according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a touch screen delay detection method according to a first embodiment of the present invention;

fig. 3 is a flowchart illustrating a touch screen delay detection method according to a fourth embodiment of the present invention.

The objects, features and advantages of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Because the existing touch screen time delay detection method mainly relies on technical personnel to carry out manual detection, the detection result is not accurate. With the development of technology, some testing methods started from device software appear in the industry, that is, a time is added to a source code of an application program to obtain a code for detection, but the obtained result is not accurate due to the influence of a code execution mechanism.

The invention provides a solution, which enables a touch screen time delay detection device to receive and analyze an event log of a target terminal in real time, and when receiving a click event log of the target terminal, a recording instruction is sent to a preset camera device, so that the preset camera device records a video with a changed state of a touch screen of the target terminal, the touch screen time delay detection device receives the video, performs framing processing on the video to obtain a frame set, analyzes the frame set to obtain a target picture frame, and takes the relative time of the target picture frame as the touch screen time delay time, thereby realizing automatic detection of touch screen time delay, greatly simplifying manual operation, avoiding detection errors caused by human factors, and improving the accuracy of a detection result of the touch screen.

As shown in fig. 1, fig. 1 is a schematic structural diagram of a terminal (also called a touch screen delay detection device, where the touch screen delay detection device may be formed by a separate touch screen delay detection device, or may be formed by combining other devices with the touch screen delay detection device) in a hardware operating environment according to an embodiment of the present invention.

The terminal of the embodiment of the invention can be a fixed terminal or a mobile terminal, such as an intelligent air conditioner with a networking function, an intelligent electric lamp, an intelligent power supply, an intelligent sound box, an automatic driving automobile, a Personal Computer (PC), a smart phone, a tablet computer, an electronic book reader, a portable computer and the like.

As shown in fig. 1, the terminal may include: a processor 1001, e.g., a Central Processing Unit (CPU), a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., WIFI interface, WIreless FIdelity, WIFI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.

Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, and a WiFi module; the input unit is compared with a display screen and a touch screen; the network interface may optionally be other than WiFi, bluetooth, probe, etc. in the wireless interface. Such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor and a proximity sensor; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.

Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

As shown in fig. 1, the computer software product is stored in a storage medium (storage medium: also called computer storage medium, computer medium, readable storage medium, computer readable storage medium, or direct storage medium, etc., and the storage medium may be a non-volatile readable storage medium, such as RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the method according to the embodiments of the present invention, and a memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a computer program.

In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call the computer program stored in the memory 1005 and execute the steps in the method for detecting the touch screen latency provided by the following embodiments of the present invention.

Referring to fig. 2, in a first embodiment of a touch screen delay detection method according to the present invention, the touch screen delay detection method includes:

and step S10, analyzing the event log sent by the target terminal when the time delay detection request is received.

The step is executed on a touch screen time delay detection device, which may be a PC, a single chip, or the like, and is not particularly limited herein. And when the touch screen delay detection equipment receives the delay detection request, analyzing an event log finally sent by the target. The delay detection request is a starting point for starting to execute detection by the touch screen delay detection device, and the delay detection request may be triggered when a user clicks the touch screen delay detection device, or may be triggered automatically, for example: when the target device is connected, it may be determined that a detection task is started, that is, when the touch screen delay detection device detects that the target device is connected, the delay detection request is automatically triggered. The target terminal is a terminal which needs to perform touch screen time delay detection at this time, and the target terminal may be a mobile device with a touch screen, such as a smart phone, a tablet computer, an e-book reader, or a household appliance device with a touch screen, such as a refrigerator, a washing machine, and the like.

The intelligent device based on various platforms usually has a corresponding debugging mode, such as an Android debugging Bridge (ADB, Android Debug Bridge) of an Android mobile phone, the Android debugging Bridge is essentially a command line window used for interaction between a computer end and a mobile phone end or between the computer end and a simulator end, through the Android debugging Bridge, the touch screen delay detection device can obtain an event log of the Android mobile phone, the event log is a one-to-one event log automatically generated according to an event running in the Android mobile phone, events such as key pressing, display brightness change and touch screen clicking are recorded, the event log of the same type has a specific identifier, and the touch screen delay detection device can know the event occurring in the Android mobile phone in real time through the specific identifier.

And step S20, when the event log is the click event log, sending a recording instruction to a preset camera device, and recording the video with the state change of the target terminal touch screen through the preset camera device.

When the touch screen time delay detection device analyzes and determines that a touch screen click event occurs on the android mobile phone in real time, a recording instruction is sent to a preset image pickup device, wherein the preset image pickup device is a device capable of recording a large number of image frames in unit time, such as a smart phone with a high-speed image pickup function, a high-speed camera and the like, and the description is given only by taking the high-speed camera as an example without specific limitation. The frame rate is the number of frames of pictures that can be acquired by a camera within one second, and is an important performance index for measuring a high-speed camera, such as a common 240fps high-speed camera, where 240fps indicates that the high-speed camera can acquire 240 frames of pictures within 1 second, that is, an event within 1 second can be displayed by 240 frames of pictures, details of a rapidly occurring event can be captured in detail, and it can also be known that the higher the frame rate of the high-speed camera is, the clearer the details of the rapidly occurring time can be captured. The method comprises the steps that a touch screen time delay detection device sends a recording instruction to a high-speed camera, an electronic shutter of the high-speed camera is triggered to start recording a video with a changed state of a touch screen of the android mobile phone, and the video is sent to the touch screen time delay detection device.

And step S30, receiving the video sent by the preset camera device, and performing frame division processing on the video to obtain a frame set.

The touch screen time delay detection equipment receives a video sent by the preset camera device, namely the high-speed camera, and frames the video to obtain a frame set, wherein the frame set is a set formed by sequentially arranging all picture frames in the video.

And step S40, analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

And analyzing each picture frame in the frame set by the touch screen time delay detection equipment, for example, reading an image by using a Python image library and performing processing work. Specifically, for example, by means of Python, two adjacent frames in the frame set are compared group by group as a group to obtain similarity information, for example, a first frame and a second frame in the frame set form a first group, and through algorithm comparison, the similarity of the two frames is n, and n is a value very close to 100%, it can be understood that the similarity usually cannot reach 100% due to the variation of environmental influence factors such as light, and the like, and thereafter, the second frame and a third frame in the frame set form a second group, and through algorithm comparison, the similarity of the two frames is m, if n-m > 1-n, that is, the difference between the similarity of n and m is greater than the difference caused by environmental variation, it can be determined that a screen has changed between the corresponding time point of the second frame and the corresponding time point of the third frame (in detection, in order to distinguish between the frames before and after clicking, a high-pair comparison pure color frame is used as the frames before and after clicking, if the time is white before clicking and black after clicking), the median time between the time point corresponding to the second frame and the time point corresponding to the third frame can be taken, the median time is the relative time in the video time line, and the median time is the time delay of the target terminal touch screen.

In the embodiment, the event log of the target terminal is received and analyzed in real time through the touch screen time delay detection device, when the click event log of the target terminal is received, a recording instruction is sent to the preset camera device, the preset camera device records the video with the changed state of the touch screen of the target terminal, the touch screen time delay detection device receives the video, the video is subjected to framing processing to obtain a frame set, the frame set is analyzed to obtain a target picture frame, the relative time of the target picture frame is used as the time delay time of the touch screen, automatic detection of time delay of the touch screen is achieved, manual operation is greatly simplified, detection errors caused by human factors are avoided, and the accuracy of the time delay detection result of the touch screen is improved.

Further, on the basis of the first embodiment of the present invention, a second embodiment of the touch screen delay detection method of the present invention is provided, where this embodiment is a refinement of step S10, and the touch screen delay detection method includes:

step a1, when receiving the delay detection request, sending a log obtaining instruction to the target terminal to be detected.

Step a2, receiving the event log sent by the target terminal, analyzing the event log, and judging whether the event log is a click event log.

Step a3, when the event log is a click event log, executing the step of sending a recording instruction to a preset camera device, and recording the video with the changed state of the target terminal touch screen by the preset camera device.

When receiving a delay detection request, the touch screen delay detection equipment sends a log acquisition instruction to a target terminal to be detected so as to establish a real-time event stream with the target terminal and receive a real-time event log sent by the target terminal. And after receiving the event log, the touch screen time delay detection equipment analyzes the event log, in the embodiment, the event log is provided with a specific identifier, specific time can be identified through the specific identifier, when the event log is clicked by a touch screen, a recording instruction is sent to a preset camera device, and a video changed by the touch screen of the target terminal is recorded through the preset camera device.

In this embodiment, the touch screen delay detection device receives an event log sent by a target terminal in real time, and sends a recording instruction to the preset camera when receiving a click event log, so as to complete the conversion from an event signal to the recording instruction, so as to trigger the preset camera to record a video with a changed state of the touch screen of the target terminal, thereby realizing automatic detection, simplifying manual operation, and avoiding errors caused by operation.

Further, on the basis of the first embodiment of the present invention, a third embodiment of the touch screen delay detection method of the present invention is provided, where this embodiment is a refinement of step S20, and the touch screen delay detection method includes:

and b1, when the event log is the click event log, stopping receiving the event log sent by the target terminal within a preset time.

And b2, sending a recording instruction to a preset camera device, and recording the video with the state change of the touch screen of the target terminal through the preset camera device.

When the touch screen delay detection equipment analyzes and recognizes that an event log sent by a target terminal is a click event log, stopping receiving the event log sent by the target terminal within a preset time, sending a recording instruction to a preset camera device, and recording a video with a changed state of the touch screen of the target terminal through the preset camera device. It can be understood that, in the process of clicking the touch screen, multiple clicks may be caused by a false touch, multiple click event logs are formed in a short time, and processing pressure is brought to the preset image pickup device and the touch screen delay detection device, so that when the touch screen delay detection device analyzes and recognizes that an event log sent by a target terminal is a click event log, the event log sent by the target terminal is stopped being received within a preset time, so as to solve the problem, wherein the preset time is an artificially estimated period for completing one touch screen delay detection.

In the embodiment, by adding the judgment mechanism, when the event log is the click event log, the event log sent by the target terminal is stopped being received within the preset time, so that the problem that the processing pressure is brought to the preset camera device and the touch screen delay detection equipment by multiple clicks formed by mistaken touch is avoided, and the accuracy of data processing is influenced.

Further, referring to fig. 3, on the basis of the first embodiment of the present invention, a fourth embodiment of the touch screen delay detection method of the present invention is provided, where this embodiment is a refinement of step S40, and the touch screen delay detection method includes:

and step S41, acquiring the touch screen refresh rate of the target terminal and a preset threshold corresponding to the touch screen refresh rate.

The touch screen refresh rate is an important index for measuring the quality of the touch screen of the equipment, the touch screen refresh rate directly relates to the impression of the touch screen of the mobile phone, the current mainstream touch screen refresh rates include 60HZ, 90HZ and the like, and the characteristic represents that the screen of the touch screen can be refreshed for 60 times and 90 times in one second respectively, and it can be understood that the unit screen refresh time of the touch screen with the 60HZ refresh rate is larger than the unit screen refresh time of the touch screen with the 90HZ refresh rate, and the characteristic can influence the time delay detection result of the touch screen.

In the capture of the high-speed camera, the change of the screen before and after clicking is reflected in a gradual change process in the picture frame instead of instantly finishing the change, so a standard is needed for measuring the same and different limits of the two picture frames under different refresh rates, namely a preset threshold value.

The method includes the steps that a touch screen time delay detection device obtains a touch screen refresh rate of a target terminal, a preset threshold table is inquired through screen refresh rate information, the preset threshold table records a relation between the touch screen refresh rate and a corresponding threshold value, so that a preset threshold value is obtained, the preset threshold value is a standard value for judging whether two picture frames are the same, if the similarity of the two picture frames is larger than the preset threshold value, the two picture frames are considered to be the same, if the similarity of the two picture frames is smaller than the preset threshold value, the two picture frames are considered to be different, and in this embodiment, it can be stated that the comparison of the later frame with the previous frame is changed.

Step S42, comparing two adjacent frames from the first frame of the frame set to obtain the similarity of the two corresponding frames.

The touch screen delay detection device compares two adjacent picture frames from a first picture frame, specifically, for example, reading an image by using a Python image library and performing processing work, for example, using an opencv library, a PI L library, a skimage library, and the like, the selection of a specific library is not limited herein, and a more preferable method may be selected according to an actual situation, and the two adjacent frames in the frame set are used as a group to perform group-by-group comparison, so as to obtain the similarity of the two corresponding picture frames.

Step S43, if the similarity of the two frames is greater than the preset threshold, comparing the two adjacent frames of the next group to obtain the similarity of the two corresponding frames.

If the similarity of the two image frames is larger than a preset threshold value, the two image frames are not changed, and the touch screen does not respond to the click event within the time corresponding to the two image frames.

And step S44, when the similarity is smaller than a preset threshold, acquiring the relative time of a later picture frame used in the comparison, and taking the relative time as the time delay time of the target terminal.

If the similarity of the two picture frames is smaller than a preset threshold value, the two picture frames are changed, the former picture frame of the two picture frames is determined not to be the changed picture frame of the touch screen in the last group of comparison, therefore, the picture frame with the later relative time in the comparison is taken as a target frame, the relative time of the target frame is the time delay time of the touch screen, the relative time is the time point of the picture frame in the video time line, and the video time line starts from 0 second, namely the first picture frame.

In this embodiment, by obtaining the refresh rate of the screen to determine the preset threshold for comparing the similarity of the two frames, using different refresh rates to correspond to different preset thresholds, and using the image comparison method to determine whether the change of the two frames occurs within the time period of the two frames, the touch screen delay detection device can perform accurate detection with respect to the screen with different refresh rates, thereby widening the application range of the touch screen delay detection method.

Further, on the basis of the first embodiment of the present invention, a fifth embodiment of the touch screen delay detection method of the present invention is provided, where the present embodiment is a refinement of step S40, and the touch screen delay detection method includes:

and c1, acquiring the touch screen refresh rate of the target terminal and a preset threshold corresponding to the touch screen refresh rate.

And c2, comparing the first picture frame of the frame set with other changed picture frames except the first picture frame in the frame set to obtain the similarity between the first picture frame and the changed picture frame.

And c3, taking the picture frame with the similarity smaller than a preset threshold value with the first picture frame as a target picture frame, acquiring the relative time of the first picture frame, and taking the relative time as the time delay time of the target terminal.

The method for obtaining the refresh rate and the preset threshold of the touch screen and the function thereof have been described in the previous embodiment, and are not described herein again.

The touch screen delay detection device compares a first picture frame of a frame set with other changed picture frames except for the first picture frame sequentially frame by frame (the comparison method is explained in the previous embodiment and is not repeated here), obtains the similarity between the first picture frame and the changed picture frame, takes a changed picture frame with the similarity smaller than a preset threshold value with the first picture frame as a target picture frame, obtains the relative time of the first picture frame, and takes the relative time as the delay time of the target terminal.

In this embodiment, by obtaining the refresh rate of the screen to determine the preset threshold for comparing the similarity of the two frames, using different refresh rates to correspond to different preset thresholds, and using the image comparison method to determine the target frame that changes for the first time, the touch screen delay detection device can perform accurate detection on the target frame according to the screens with different refresh rates, thereby widening the application range of the touch screen delay detection method.

In addition, the screen delay detection method in the fourth embodiment may be implemented in combination with the screen delay detection method in the fifth embodiment, for example, averaging the touch screen delay time obtained in the fourth embodiment with the touch screen delay time obtained in the fifth embodiment as obtaining the one-time touch screen delay time helps to weaken the error generated as a result in one of the fourth and fifth embodiments.

Further, on the basis of the above embodiment of the present invention, a sixth embodiment of the touch screen delay detection method of the present invention is provided, where the sixth embodiment is a step subsequent to step S40, and the touch screen delay detection method includes:

and d1, judging whether the delay time is in a preset time range.

And d2, if the delay time is not in the preset time range, discarding the delay time and triggering a delay detection request.

And d3, if the delay time is in the preset time range, writing the delay time into a memory, and triggering a delay detection request.

And d4, acquiring the time delay time of the target terminal for multiple times.

And d5, averaging the time delay times of the target terminal obtained for multiple times, and taking the average value as the final time delay time.

The touch screen time delay detection terminal judges whether the time delay time is in a preset time range, the preset time range is set to float up and down by a certain percentage compared with parameters given by an equipment manufacturer, if the actually measured time delay time is not in the preset time range, the data is considered to be far away from a normal value, the data is abandoned as unavailable data, a time delay detection request is triggered to be obtained again, if the actually measured time delay time is in the preset time range, the time delay time is written into a memory, the time delay detection request is triggered to be obtained for multiple times, the time delay time of a target terminal obtained for multiple times is averaged, and the average value is used as the final time delay time.

In this embodiment, by judging whether the delay time is within a normal range, obviously abnormal data is removed, and multiple detections are performed to obtain an average value, so that the influence of errors in the detection on the final monitoring result is weakened.

In addition, an embodiment of the present invention further provides a touch screen delay detection system, where the touch screen delay detection system includes:

a target terminal detects a real-time event and generates a corresponding event log;

when the touch screen delay detection equipment receives a delay detection request, analyzing an event log sent by a target terminal;

when the event log is a click event log, the touch screen time delay detection equipment sends a recording instruction to a preset camera device, and a video with the state changed by the touch screen of the target terminal is recorded through the preset camera device;

the preset camera device sends the recorded video containing the target terminal to touch screen time delay detection equipment;

the touch screen time delay detection equipment receives the video sent by the preset camera device and performs framing processing on the video to obtain a frame set;

and the touch screen time delay detection equipment analyzes each picture frame in the frame set to obtain a target picture frame, and the relative time of the target picture frame is taken as the time delay time of the touch screen of the target terminal.

In addition, an embodiment of the present invention further provides a touch screen delay detection apparatus, where the touch screen delay detection apparatus includes:

a receiving and analyzing module: the system comprises a time delay detection module, a time delay module and a time delay module, wherein the time delay detection module is used for receiving a time delay detection request and analyzing an event log sent by a target terminal;

a judging and sending module: the event log sending unit is used for sending a recording instruction to a preset camera device when the event log is a click event log, and recording a video with the state changed by the target terminal touch screen through the preset camera device;

the video processing module: the system comprises a preset camera device, a frame processing device and a video processing device, wherein the preset camera device is used for receiving a video sent by the preset camera device and performing frame processing on the video to obtain a frame set;

a time delay determining module: and the time delay unit is used for analyzing each picture frame in the frame set to obtain a target picture frame, and taking the relative time of the target picture frame as the time delay time of the target terminal touch screen.

The steps implemented by each functional module of the touch screen delay detection device may refer to each embodiment of the touch screen delay detection method of the present invention, and are not described herein again.

In addition, an embodiment of the present invention further provides a touch screen delay detection device, where the touch screen delay detection device includes:

a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:

the computer program, when executed by the processor, implements the steps of the touch screen delay detection method described above.

In addition, the embodiment of the invention also provides a computer storage medium.

The computer storage medium stores thereon a computer program, and the computer program, when executed by a processor, implements the operations in the touch screen latency detection method provided by the above embodiments.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity/action/object from another entity/action/object without necessarily requiring or implying any actual such relationship or order between such entities/actions/objects; the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

For the apparatus embodiment, since it is substantially similar to the method embodiment, it is described relatively simply, and reference may be made to some descriptions of the method embodiment for relevant points. The above-described apparatus embodiments are merely illustrative, in that elements described as separate components may or may not be physically separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.