Method and device for automatically processing popup window

文档序号：815302 发布日期：2021-03-26 浏览：44次中文

阅读说明：本技术 一种自动处理弹窗方法及装置 (Method and device for automatically processing popup window ) 是由毛颖颖于 2020-12-22 设计创作，主要内容包括：本申请提供一种自动处理弹窗方法及装置,其中所述自动处理弹窗方法包括：对当前展示页面进行监控,冻结并捕获当前展示页面中的节点元素；在成功捕获当前展示页面中的节点元素的情况下,参考所述节点元素的历史弹窗成功处理数据对所述节点元素中的弹窗进行处理；在未成功捕获当前展示页面中的节点元素的情况下,参考当前展示页面所在终端对应的历史弹窗成功处理数据对当前展示页面中的弹窗进行处理。通过本申请提供的方法,可以监测当前展示页面中的弹窗情况,并且可以根据捕获节点元素的情况进行针对性的处理,保证了对处理弹窗的高效性和针对性。(The application provides a method and a device for automatically processing pop-up windows, wherein the method for automatically processing the pop-up windows comprises the following steps: monitoring the current display page, freezing and capturing node elements in the current display page; under the condition of successfully capturing the node elements in the current display page, referring to historical popup window successful processing data of the node elements to process popup windows in the node elements; and under the condition that the node elements in the current display page are not successfully captured, referring to historical popup window successful processing data corresponding to the terminal where the current display page is located to process the popup window in the current display page. By the method, the popup condition in the current display page can be monitored, the targeted processing can be performed according to the condition of the captured node element, and the efficiency and the pertinence of popup processing are guaranteed.)

1. An automatic pop-up window processing method, comprising:

monitoring the current display page, freezing and capturing node elements in the current display page;

under the condition of successfully capturing the node elements in the current display page, referring to historical popup window successful processing data of the node elements to process popup windows in the node elements;

and under the condition that the node elements in the current display page are not successfully captured, referring to historical popup window successful processing data corresponding to the terminal where the current display page is located to process the popup window in the current display page.

2. The method of claim 1, wherein the node element comprises a condition field and a target field, the condition field is used for recording text information of the node element, and the target field is used for recording an operation method of the node element;

referring to the historical popup successful processing data of the node elements to process the popup in the node elements, wherein the popup comprises:

matching the condition field of the node element with the condition field of the node element in the history popup successfully processed data of the node element;

and under the condition that the condition field of the node element is matched with the condition field of the node element in the history popup successful processing data of the node element, calling an operation method in the target field of the node element in the history popup successful processing data of the node element to operate the node element.

3. The method of claim 2, wherein the method further comprises:

submitting an auditing request to the node element when the condition field of the node element does not accord with the condition field of the node element in the history popup successfully processed data of the node element;

and receiving an operation fed back to the node element based on the audit request, and adding the node element and the operation corresponding to the node element into the historical popup successfully processed data of the node element.

4. The method of claim 2, wherein invoking the operation method in the target field of the node element in the history popup successfully processed data of the node element operates on the node element, comprising:

under the condition that one button control element exists in the node elements, calling an operation method corresponding to the button control element in the historical popup window successfully processed data of the node elements to operate the button control element, storing text information of the button control element in a condition field, and storing the operation in a target field;

and under the condition that the node elements have a plurality of button control elements, sequentially calling operation methods corresponding to the button control elements in the historical popup successfully processed data of the node elements to operate the button control elements.

5. The method of claim 4, wherein after storing the operation in a target field, the method further comprises:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

6. The method of claim 4, wherein after invoking the operation method corresponding to the button control element in the historical popup successful processing data of the node element in sequence to operate the button control elements, the method further comprises:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

7. The method of claim 2, wherein after invoking the operation method in the target field of a node element in the historical popup successful processing data of the node element to operate on the node element, further comprising:

under the condition that the node element processing fails, executing a step of processing the popup in the node element by referring to historical popup successful processing data of the node element, and if the operation is not successful within preset execution times, executing a step of unsuccessfully capturing the condition of the node element in the current display page;

and under the condition that the node element processing fails and the process reports errors, saving an operation log of the node element, and performing the steps of freezing and capturing the node element in the current display page.

8. The method of claim 5 or 6, further comprising:

and under the condition that the popup in the node element is successfully processed by referring to the historical popup successful processing data of the node element, storing the node element in the historical popup successful processing data of the node element according to the sequence from high to low of the calling times.

9. The method of any one of claims 1-7, further comprising:

judging whether the popup in the node element is successfully processed by referring to the historical popup successful processing data of the node element;

and if not, executing the step of processing the popup window in the current display page by referring to the historical popup window successful processing data corresponding to the terminal where the current display page is located.

10. The method of claim 1, wherein the processing of the popup in the current presentation page with reference to historical popup successful processing data corresponding to a terminal where the current presentation page is located comprises:

matching in the history popup successfully processed data corresponding to the terminal according to the equipment model of the terminal and the resolution of the display screen;

under the condition that the corresponding terminal exists in the history popup window successfully processed data corresponding to the terminal, processing the popup window of the current display page based on the popup window processing method of the terminal;

under the condition that no corresponding terminal exists in the historical popup window successfully processed data corresponding to the terminal, obtaining position information of a popup window in the terminal according to the historical popup window successfully processed data corresponding to the terminal and the resolution of a display screen of the terminal;

and operating the popup window in the terminal based on the position information, and storing the equipment model, the display screen resolution and the operation method of the popup window in the terminal into historical popup window successfully-processed data corresponding to the terminal.

11. The method of claim 10, wherein the method further comprises:

under the condition that the popup processing fails, executing a step of processing the popup in the node element by referring to historical popup successful processing data of the node element, and if the operation is not successful within preset execution times, executing a step of freezing and capturing the node element in the current display page;

and under the condition that the node element processing fails and the process is in error, executing the steps of freezing and capturing the node element in the current display page, recording an error log if the node element processing fails within the preset execution times, submitting an audit request to the popup window, receiving the operation of the popup window based on the audit request, and storing the popup window and the corresponding operation method into the historical popup window successfully-processed data corresponding to the terminal.

12. The method of claim 10, wherein after processing the popup in the current presentation page with reference to the historical popup successful processing data corresponding to the terminal where the current presentation page is located, further comprising:

and storing the equipment model, the display screen resolution, the popup type and the corresponding operation method of the terminal in the history popup successfully processed data of the terminal according to the sequence of the calling times from high to low.

13. The method of claim 1, wherein capturing node elements in a current presentation page comprises:

and acquiring the node elements in the current display page, and storing the node elements into a node list.

14. The method of claim 13, wherein the node element comprises a condition field and a target field, the condition field is used for recording text information of the node element, and the target field is used for recording an operation method of the node element;

referring to the historical popup successful processing data of the node elements to process the popup in the node elements, wherein the popup comprises:

traversing the node list, and matching the condition fields of the node elements in the node list with the condition fields of the node elements in the history popup successfully processed data of the node elements;

and when the condition field of the node element in the node list is consistent with the condition field of the node element in the history popup successfully processed data of the node element, calling an operation method in the target field of the node element in the history popup successfully processed data of the node element to operate the node element.

15. An automatic pop-up window processing device, comprising:

the monitoring module is configured to monitor the current display page, freeze and capture node elements in the current display page;

the first processing module is configured to refer to historical popup window successful processing data of the node elements to process popup windows in the node elements under the condition that the node elements in the current display page are successfully captured;

and the second processing module is configured to refer to the historical popup window successful processing data corresponding to the terminal where the current display page is located to process the popup window in the current display page under the condition that the node element in the current display page is not successfully captured.

16. A computing device comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1-14 when executing the instructions.

17. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 14.

Technical Field

The application relates to the technical field of internet, in particular to a method for automatically processing pop-up windows. The application also relates to an automatic pop-up window processing device, a computing device and a computer readable storage medium.

Background

With the development of the mobile phone industry, various mobile phone applications are also developed. During the process of using the mobile phone application program by the user, pop-up windows such as advertisements or user protocols are popped up in the mobile phone application program for various needs.

In the prior art, a manual method is generally adopted to process the appearing popup window, and a method based on a UI (user interface) control search frame is also used for processing. However, the manual treatment of the pop-up window is complex in operation, high in repeatability, time-consuming and labor-consuming, and low in efficiency of treatment of the pop-up window. And the use of a UI (user interface) control search frame has the problems of unstable popup processing effect, incapability of simultaneously supporting a plurality of mobile phone applications and the like.

Disclosure of Invention

In view of this, the present application provides an automatic pop-up window processing method. The application also relates to an automatic popup window processing device, a computing device and a computer readable storage medium, which are used for solving the problems of low efficiency of manual popup window processing and poor stability of a UI (user interface) control searching frame processing popup window in the prior art.

According to a first aspect of embodiments of the present application, there is provided a method for automatically processing a pop-up window, including:

monitoring the current display page, freezing and capturing node elements in the current display page;

According to a second aspect of embodiments of the present application, there is provided an automatic pop-up window processing apparatus, including:

the monitoring module is configured to monitor the current display page, freeze and capture node elements in the current display page;

According to a third aspect of embodiments herein, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of the method for automatically processing pop-windows when executing the instructions.

According to a fourth aspect of embodiments herein, there is provided a computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the automatic pop-up window processing method.

According to the method for automatically processing the popup window, the current display page is monitored, and node elements in the current display page are frozen and captured; under the condition of successfully capturing the node elements in the current display page, referring to historical popup window successful processing data of the node elements to process popup windows in the node elements; and under the condition that the node elements in the current display page are not successfully captured, referring to historical popup window successful processing data corresponding to the terminal where the current display page is located to process the popup window in the current display page.

According to the method and the device, the node elements in the current display page are captured by monitoring the current display page, so that the popup window in the current display page can be timely and accurately processed, and the processing efficiency of the popup window is effectively improved; the targeted processing is carried out according to the condition of capturing the node elements, the accuracy of popup processing is further ensured, and the defects that popup processing in the prior art is unstable and a plurality of application programs cannot be supported simultaneously are overcome.

Drawings

FIG. 1 is a flow chart of a method for automatically processing pop-up windows according to an embodiment of the present disclosure;

fig. 2a is a processing flow chart of an automatic pop-up window processing method applied to a mobile phone terminal according to an embodiment of the present application;

fig. 2b is a processing flowchart of a poco framework-based automatic pop-up window processing method applied to a mobile phone terminal according to an embodiment of the present application;

fig. 2c is a processing flow chart of an automatic pop-up window processing method applied to a mobile phone terminal according to an embodiment of the present application, based on an Android debug bridge;

fig. 3 is a schematic diagram illustrating installation of a plug-in unit of a mobile phone according to an embodiment of the present application;

fig. 4 is a schematic diagram of a mobile phone application process provided in an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating a pop-up window operation failure scenario according to an embodiment of the present disclosure;

FIG. 6 is a schematic view of an apparatus for automatically processing pop-up windows according to an embodiment of the present disclosure;

fig. 7 is a block diagram of a computing device according to an embodiment of the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.

The terminology used in the one or more embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present application. As used in one or more embodiments of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments of the present application to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first aspect may be termed a second aspect, and, similarly, a second aspect may be termed a first aspect, without departing from the scope of one or more embodiments of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

First, the noun terms to which one or more embodiments of the present application relate are explained.

The mobile phone application program comprises the following steps: app (application), which refers to software installed in a mobile phone.

UI (user interface): a User Interface (User Interface).

ADB: (Android Debug Bridge) Android Debug Bridge tool.

Poco: for creating cross-platform applications.

Stack: the set of elements is an abstract data type and is stored according to a last-in first-out rule.

In the present application, an automatic pop-up window processing method is provided, and the present application relates to an automatic pop-up window processing apparatus, a computing device, and a computer-readable storage medium, which are described in detail in the following embodiments one by one.

Fig. 1 shows a flowchart of a method for automatically processing a pop-up window according to an embodiment of the present application, which specifically includes the following steps:

step S102: and monitoring the current display page, freezing and capturing the node elements in the current display page.

It should be noted that the node element in the present application indicates a control in the current presentation page, and also includes a popup window appearing in the current presentation page. For example, in the event that capturing a node element in the current presentation page is successful, the occurrence of a pop-up window is included in the captured node element. In addition, in the case of unsuccessfully capturing the node element in the current presentation page, the popup may be processed independently of the node element.

In practical application, the method provided by the application can be embedded in an application program, and the current display page can be monitored after the application program is started. For example, at a mobile terminal of a mobile phone, the method provided by the present application may be installed to the mobile terminal of the mobile phone in a manner of being embedded in a mobile phone application process, and the mobile terminal runs in a mobile phone background after the process is started, and after a mobile phone application program to be monitored is started, the process may be monitored in real time, and a popup window appearing in the process may be processed, or the process may be monitored periodically, which is not specifically limited in the present application.

In practical application, the frequency of freezing the currently displayed page can be set according to specific use conditions. For example, the current presentation page may be frozen at a preset time interval, such as 0.5 second or 0.3 second freezing and capturing the node elements in the current presentation page once.

By monitoring the current display page and acquiring the node elements in the current display page, the popup window which can be timely and accurately processed in the current display page is ensured, and the processing efficiency of the popup window is effectively improved.

Step S104: and under the condition of successfully capturing the node elements in the current display page, referring to the historical popup window successful processing data of the node elements to process the popup windows in the node elements.

It should be noted that, in the history popup successfully processed data of the node element, the stored data are the type of the node element and the operation method corresponding to the type. For example, node element a is stored in the history popup success processing data of the node element, and the operation method corresponding to node element a: sliding to the right.

In practical application, assuming that a node element B in a current display page is successfully captured and the node element B includes a popup to be processed, a popup corresponding to the node element B is searched in historical popup processing data of the node element, and the popup in the node element B is processed according to an operation method corresponding to the popup in the historical popup successfully processing data of the node element.

And operating the captured node elements according to the historical popup successfully processed data of the node elements, thereby ensuring that the popup contained in the node elements can be rapidly and accurately processed.

Specifically, the node element includes a condition field and a target field, the condition field is used for recording text information of the node element, and the target field is used for recording an operation method of the node element.

In practical applications, for example, there is currently a node element C to be processed, where the condition field in the node element C is used to store the text information of the node element C: "determine", the target field of the node element C is used to store the operation method of the node element C: "click once".

In an optional implementation manner of this embodiment, the processing the popup in the node element with reference to the historical popup successful processing data of the node element includes:

matching the condition field of the node element with the condition field of the node element in the history popup successfully processed data of the node element;

In practical application, firstly, the text information of the node element is compared with the text information of the node element in the history popup successfully processed data, if the comparison result is matched, the current captured node element is determined to be consistent with the node element stored in the history popup successfully processed data, then, an operation method in a target field of the node element stored in the history popup successfully processed data is called, and the captured node element is operated according to the operation method.

For example, an existing node element D is first configured according to the text information in the condition field of the node element D: and canceling, namely searching the node element matched with the node element D in the history popup successfully processed data of the node element. When a node element E of which the text information conforms to the node element D is matched, according to the operation method of the node element E: the "slide right" operates on node element D.

The method comprises the steps of firstly matching corresponding node elements in history popup successfully processed data according to text information, and secondly operating the node elements to be processed according to the operation methods of the corresponding node elements, thereby further ensuring that the node elements to be processed can be accurately and rapidly operated, and ensuring that the reliable operation method can be obtained to process the current node elements to be processed.

In an optional implementation manner of this embodiment, when the condition field of the node element does not match the condition field of the node element in the history popup successfully processed data of the node element, an audit request is submitted to the node element;

In practical applications, there may be a case that the history popup successful processing data does not include the node element to be processed currently. For example, the text information of the node element to be currently processed is: "hello-", but the history popup successful processing data does not include a node element having "hello-" as text information. In this case, an audit request is submitted to the node element to be currently processed, and the node element to be currently processed is operated based on the audit request.

It should be noted that the audit request may be processed by switching to manual processing, or may be other audit methods, which is not limited in this application.

After the audit request is submitted and the current node element to be processed is operated, the text information of the node element and the operation method are stored into the history popup successful processing data together.

And submitting an audit request for the node elements which do not exist in the history popup successfully processed data, operating the node elements according to the audit request, and then storing the node elements and corresponding operations into the history popup successfully processed data, thereby ensuring that the node elements and the corresponding operations can effectively deal with various different popup conditions, ensuring that the node elements and the corresponding operations have the learning reinforcement capability, and further learning and collecting the popup under various conditions.

In an optional implementation manner of this embodiment, invoking an operation method in a target field of a node element in history popup successfully processed data of the node element to operate the node element includes:

In practical application, after the acquired node elements are matched with the condition fields which are consistent in the history popup successful processing data according to the condition fields, the acquired node elements are operated according to the operation method stored in the target field in the history popup successful processing data. The specific operation steps can be adjusted according to the number of button control elements contained in the node elements. For example, if the captured node elements only include one button control element, the button control element is processed according to the corresponding operation method in the history popup successful processing data, then the text information corresponding to the button control element is stored in the condition field of the node element, and the operation method corresponding to the button control element is stored in the target field. For example, assuming that there is only one button control element Y included in an existing node element X, when the same node element has been matched according to the text information of the button control element Y in the history popup successful processing data, the button control Y is operated by "sliding left" according to the operation method of the matched node element. It should be noted that the operation method described in this application may be a click operation, a slide operation, or another type of operation method, and this application is not limited in this respect.

In an optional implementation manner of this embodiment, after storing the operation in the target field, the method further includes:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

In an optional implementation manner of this embodiment, after sequentially invoking an operation method corresponding to the button control element in the historical popup successfully processed data of the node element to operate the button control elements, the method further includes:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

It should be noted that after the button control is operated according to the operation method of the node element in the history popup successful processing data, the number of times of calling the operation method of the node element in the history popup successful processing data also needs to be accumulated, for example, a counter may be set for each called object, and each time the called object is called, the counter may add one to the number of times of calling the called object, so as to facilitate subsequent sorting and storing operations of the number of times of calling.

And similarly to the case that only one button control element is contained in the captured node elements, if the captured node elements contain a plurality of button control elements, after the button control elements are matched with the same node elements in the historical popup window successful processing data, operating the button control elements one by one according to the operation methods of the same node elements in sequence, and accumulating the calling times of the operation methods of the corresponding node elements in the historical popup window node successful processing data after operation so as to facilitate the subsequent sequencing storage operation of the calling times. In addition, the operation method of the multiple button control elements may be a click operation, a slide operation, or another type of operation method, which is not specifically limited in this application.

In an optional implementation manner of this embodiment, after invoking an operation method in a target field of a node element in the history popup successfully processed data of the node element to operate the node element, the method further includes:

In practical applications, in the case of failure of operation on a node element in a current presentation page, an error retry mechanism is also required for the node element with failed operation.

The following describes an error retry mechanism in a case where the method in the present application is embedded in an application process of a mobile phone.

After the application process embedded with the automatic popup processing method is operated, under the condition that the operation of the processing node element fails but the application process does not report an error, the node element with the operation failure is operated again according to the current operation method. And the number of times of re-operation on the node element with failed operation is preset to be three. It should be noted that, in practical applications, the number of retries for the operation failure of the node element may be determined by a specific use case, and the application is not limited to this.

After a mobile phone application is started, an application process embedded with the automatic popup processing method is started. And if the operation is still prompted to fail and the process does not report an error after three times of re-operation, considering that the node elements in the current mobile phone application fail to be captured, and processing according to the condition that the node elements in the current display page are not successfully captured.

If the operation is still prompted to fail after three times of re-operation and the application process embedded with the automatic popup processing method reports errors, an operation log of the node elements displayed in the current mobile phone application is saved, the application process embedded with the automatic popup processing method is restarted, and then the node elements are processed again.

Through an error retry mechanism, the problem that the application process is stuck under the condition that the current node element processing has errors is effectively avoided, and the process can be smoothly operated.

In an optional implementation manner of this embodiment, the method further includes:

After the processing of the node elements is completed, the node elements which have been stored in the history popup successfully processed data need to be stored in the order of the calling times from high to low.

It should be noted that the storage structure of the history popup successfully processed data storage node element may be a stack, and the node element is called according to a principle of last-in first-out.

Node elements are stored in the history popup successfully processed data according to a certain storage sequence, so that rapid calling is guaranteed, process loss is reduced, and the high efficiency of the application is further guaranteed.

In an optional implementation manner of this embodiment, it is determined whether or not processing of the popup in the node element is successful by referring to the historical popup successful processing data of the node element;

In practical application, if the historical popup window of the reference node element fails to process data successfully, the node element is considered to be unsuccessfully captured in the current display page, and then the popup window in the current display page is processed according to a corresponding method.

Step S106: and under the condition that the node elements in the current display page are not successfully captured, referring to historical popup window successful processing data corresponding to the terminal where the current display page is located to process the popup window in the current display page.

In practical application, if the node elements cannot be acquired in the current display page, the popup in the current terminal is processed according to the current terminal, the terminal model corresponding to the terminal and the resolution of the display screen.

After the historical popup of the reference node element fails to process data successfully, the situation that the node element in the current display page is not captured successfully is switched to process, so that the operation situation of the current display page can be accurately judged, and a corresponding popup processing method is provided in a targeted manner.

In an optional implementation manner of this embodiment, the processing of the popup in the current presentation page with reference to the historical popup successful processing data corresponding to the terminal where the current presentation page is located includes:

matching in the history popup successfully processed data corresponding to the terminal according to the equipment model of the terminal and the resolution of the display screen;

It should be noted that, in practical applications, the data stored in the history popup successful processing data corresponding to the terminal is a model of the terminal, a resolution of a display screen, a popup type, a corresponding operation method, and an area (relative position coordinates) with the highest operation frequency in the display screen of the terminal, and the five data are in a group, correspond to a popup type, and include at least one group of data in the history popup successful processing data corresponding to the terminal.

In practical application, after the popup in the node element is unsuccessfully processed by referring to the historical popup processing data of the node element, or under the condition that the processing of the node element in the current display page is failed and the process is reported in error, the situation that the node element in the current display page is not successfully captured needs to be switched to for processing.

In this case, the comparison is not performed according to the node elements, but is performed directly according to the comparison between the popup window in the current display page and the history popup window successfully processed data corresponding to the terminal.

If the terminal model and the resolution corresponding to the current terminal exist in the historical popup successful processing data corresponding to the terminal, calling a popup operation method corresponding to the current terminal in the historical popup successful processing data corresponding to the terminal to operate the popup in the current display page;

and if the terminal model and the resolution corresponding to the current terminal do not exist in the historical popup window successfully processed data corresponding to the terminal, estimating the operation area of the popup window in the current terminal to be processed according to the area with the highest operation frequency in the terminal display screen stored in the historical popup window successfully processed data corresponding to the terminal. Specifically, the absolute position coordinate of the current terminal to be processed is obtained by multiplying the resolution of the current terminal to be processed by the relative position coordinate, and the absolute position coordinate is stored as the position information of the popup window in the current terminal to be processed. And then receiving an ADB instruction to click on the area corresponding to the absolute position coordinate based on the position information. And if the process does not report an error after clicking and the popup is successfully processed, judging that the operation is successful. And finally, storing the model, the resolution, the popup type, the corresponding operation method and the absolute position coordinate of the current terminal to be processed into historical popup successfully processed data corresponding to the terminal.

The absolute position information of the current terminal to be processed is obtained from the successfully processed data of the popup window according to the model and the resolution of the terminal and the history popup window corresponding to the terminal, so that the popup window position in the current terminal to be processed can be accurately and quickly positioned, and the accuracy of popup window processing is further ensured. After the popup in the current terminal to be processed is successfully processed, corresponding information is stored into historical popup successfully processed data corresponding to the terminal, the popup can be further processed by the method and the device, various different terminals can be further processed, the method and the device have a reinforcement learning function, and different popup processing methods can be further learned in the using process.

In an optional implementation manner of this embodiment, in a case that the popup processing fails, a step of processing the popup in the node element with reference to historical popup successful processing data of the node element is performed, and if the operation is not successful within a preset number of execution times, a step of freezing and capturing the node element in the currently displayed page is performed;

In practical applications, there may be a case where the corresponding pop-up window processing method of the terminal fails in processing. And supposing that the popup A exists in the current terminal page and the popup A fails to be processed more than three times but the process does not report an error, re-executing the steps of freezing and capturing the node elements in the current display page. The number of times of reprocessing the popup window a is set to three times in advance, and in practical applications, a specific number of retries may be set according to a usage situation, which is not particularly limited in the present application.

If the popup window A fails to process and the process is reported to be wrong, re-executing the process, freezing and capturing the node elements in the current display page; similarly, if the popup window a cannot be successfully processed within the preset processing times, the error log of the popup window a is recorded, and several auditing requests are made for the popup window a. In practical applications, the audit request may be processed by a manual operation on the popup window a, or may be other audit methods, which is not specifically limited in this application.

And after the manual operation is successful, saving the type of the popup window A, the model and the resolution of the current terminal to be processed, the operation method of the popup window A and the corresponding operation area into historical popup window successful processing data corresponding to the terminal.

Through carrying out failure trial and error mechanism to the condition that popup window processing failed in the terminal, guaranteed that popup window processing in the current terminal is failed after, can also further right popup window operates, the effectual accuracy of having guaranteed this application to popup window processing. In addition, by means of auditing the popup window which fails to be processed and has a program error, the popup window can be accurately and efficiently processed.

In an optional implementation manner of this embodiment, after processing the popup in the current presentation page with reference to the historical popup successful processing data corresponding to the terminal where the current presentation page is located, the method further includes:

In the above example, after the popup a is successfully processed, the popup type of the popup a, the device model of the current terminal, the operation method for the popup a, and the operation area of the popup a also need to be stored in the historical popup successfully processed data of the terminal. The reinforcement learning ability of the application is further ensured by storing the relevant information of the popup which is successfully operated, and various popup types and corresponding processing modes can be effectively covered.

In an optional implementation manner of this embodiment, capturing node elements in the current presentation page includes:

and acquiring the node elements in the current display page, and storing the node elements into a node list.

In practical applications, the obtained node elements may be stored in the form of a node list. When the operation method in the node element is called, reading and calling can be performed in a mode of traversing the node list.

The node elements are stored in the node list mode, so that the node elements are clear in storage structure and convenient to call.

In an optional implementation manner of this embodiment, the node element includes a condition field and a target field, where the condition field is used to record text information of the node element, and the target field is used to record an operation method of the node element;

referring to the historical popup successful processing data of the node elements to process the popup in the node elements, wherein the popup comprises:

In practical applications, the node list for storing the node elements includes a condition field and a target field, where the condition field is used for storing text information of the node elements, and the target field is used for storing operation methods of the node elements. For example, in the existing node element F, the text information "return" of the node element F is stored in the condition field of the node element F, and the operation information "click" of the node element F is stored in the target field of the node element F.

The information of the node elements is recorded through different fields, so that the accurate and clear storage of the information corresponding to the node elements can be ensured, the calling can be fast and efficiently performed, and the accuracy of the application is further ensured.

It should be noted that, according to the method for automatically processing a popup window provided in this embodiment, after the popup window in the current display page is processed, the current display page may be continuously monitored. For example, in the mobile phone terminal, assuming that the popup in the current display page has been successfully processed, the automatic popup processing method may further continue to run in the background of the mobile phone terminal to continuously monitor the current display page.

By continuously monitoring the current display page, the method for automatically processing the popup window can continuously monitor the current display page, ensure that the popup window needing to be processed does not appear in the current display page, and effectively improve the user experience.

The following will further describe the method for automatically processing pop-up window by taking an application of the method for automatically processing pop-up window provided by the present application in a mobile phone terminal as an example with reference to fig. 2 a. Fig. 2a is a processing flow chart of an automatic pop-up window processing method applied to a mobile phone terminal according to an embodiment of the present application, which specifically includes the following steps:

step S202: and installing a popup window processing process in the mobile phone terminal, and opening the popup window processing process.

In practical application, when the bullet processing popup window method provided by the application is used on a terminal on a mobile phone, the bullet processing popup window method provided by the application can be embedded into a mobile phone application program and used in the form of a mobile phone App. As shown in fig. 3, fig. three is a schematic diagram of the mobile phone App installed in a mobile phone terminal, where 301 is the mobile phone App that needs to perform popup processing, and 302 is a mobile phone application plug-in (hereinafter referred to as process B) embedded with the automatic popup processing method.

After the installation is completed and the popup processing process is started, the popup processing process can run in a background of the mobile phone, and the use of other mobile phone application processes is not influenced.

Step S204: and monitoring a mobile phone application process needing to process the popup, and freezing and capturing the node elements in the current display page under the condition that the popup of the current display page is monitored.

As shown in fig. 4, fig. 4 is a schematic diagram of an open state of a process (hereinafter referred to as process a) of a mobile phone application that needs to process a popup, where 401 is a node element N in a current presentation page, and 402 is a processing area in the popup. After the process a is started, a popup of a user protocol occurs, and at this time, the process B freezes the current display page of the current process a, and obtains a node element N in the current display page.

Step S206: and judging the capture condition of the node element N in the current display page.

If the node element in the current display page is successfully captured, step S208 is executed, and if the node element in the current display page is not successfully captured, step S210 is executed.

After the popup window user protocol in the current display page is successfully processed, the popup window user protocol is not displayed in the current display page, and the popup window user protocol is not displayed if the process A is opened again.

In practical applications, the following steps S208 to S218 may be implemented based on a Poco frame, as shown in fig. 2b, where fig. 2b is a processing flow chart of an automatic pop window processing method applied to a mobile phone terminal based on a Poco frame, which is provided by an embodiment of the present application, and specifically includes the following steps:

step S208: node element N is traversed.

Step S210: and judging whether the popup type corresponding to the node element N exists in the use case database or not according to the popup type corresponding to the node element N in the use case database.

It should be noted that, in the use case database described in this embodiment, the history popup successful processing data of the node element is stored, and the history popup successful processing data may be created manually.

Firstly, searching in the use case database according to the text information "agree to the protocol" of the node element N, if yes, executing step S212, and if not, executing step S214.

Step S212: and calling a corresponding operation method in the use case database based on the text information of the node element N.

Specifically, the node element which is the same as the text information is searched in the use case database according to the text information 'agreeing with the protocol' of the node element N. Assume that a node element M exists in the use case database, and the text information is: the protocol is agreed, and the operation method comprises the following steps: and clicking, namely clicking to operate the node element N according to the operation method of the node element M. Moreover, after the node element N is operated by the operation method of the node element M, the number of times of calling the operation method of the node element M needs to be increased by one in the use case database, so as to facilitate subsequent sequencing storage operations.

Step S214: submitting a checking request to the node element N, operating based on the checking request, and storing the type and the operating method of the node element N into a use case database.

And if no corresponding node element exists in the use case database, submitting the node element N to a verification request, wherein the verification request can be submitted to manual processing, operating the node element N in a manual mode, judging the type of the node element N, and storing the type of the node element N and a corresponding operation method into the use case database. The node elements which do not exist in the case database and the corresponding operation methods are stored in the case database, so that the case database can achieve the function of reinforcement learning.

If the above-mentioned step processing fails, step S216 is executed.

Step S216: if the node element N fails to operate but the process B does not report an error, operating the node element N again; if node element N operation fails and process B reports an error, process B is restarted.

It should be noted that, if the operation on the node element N fails, the trial-and-error mechanism is started, and the operation on the node element N is started again according to the step S208. If the operations fail for three times, it is determined that the node element N is not successfully captured, and step S220 is performed.

And if the node element N fails to operate and the process B reports an error, saving an operation log of the node element N, restarting the process B, and operating the node element N again.

Step S218: and storing the data in the case database according to the sequence of the calling frequency from high to low.

After the node element N is successfully processed, the data in the use case database needs to be stored in the sequence from high to low in the calling frequency, so that the subsequent calling is convenient, fast and convenient.

In practical applications, the following steps S220 to S230 may be implemented based on an Android debug bridge, as shown in fig. 2c, where fig. 2c is a processing flow chart of an automatic popup window processing method applied to a mobile phone terminal, provided by an embodiment of the present application, based on the Android debug bridge, and specifically includes the following steps:

step S220: and obtaining the model and the display screen resolution of the current mobile phone terminal.

Firstly, the model and the display resolution of the current mobile phone terminal are obtained, and the model of the current mobile phone terminal is assumed to be Noaa type, and the screen resolution is 2560 x 1080.

Step S222: and searching a corresponding operation method in the use case database based on the model of the current mobile phone terminal and the resolution of the display screen.

Specifically, based on the model of the current mobile phone terminal: noaa type and screen resolution: 2560 × 1080, mobile phone terminals of the same model and the same screen resolution are searched in the use case database.

If the operation method corresponding to the model and the display screen resolution of the current mobile phone terminal exists in the use case database, executing step S224; if the operation method corresponding to the model and the resolution of the display screen of the current mobile phone terminal does not exist in the use case database, step S226 is executed.

Step S224: and operating the popup window X in the current mobile phone terminal based on the operation method in the use case database.

Step S226: and estimating and operating the operation area of the popup window X, and if the operation is successful, storing the popup window type, the model of the mobile phone terminal, the resolution of the display screen and the operation area of the popup window X into the use case database.

Specifically, the operation area of the popup X is estimated according to the operation area (hereinafter referred to as a relative position coordinate) with the largest number of calls in the use case database, the absolute position coordinate of the popup X is obtained by multiplying the resolution of the display screen of the mobile phone terminal by the relative position coordinate, and the ADB instruction is received to perform a click operation on the popup X based on the absolute position coordinate. It should be noted that, after the above operation is successfully performed, the absolute position coordinate, the popup type of the popup X, and the model of the mobile phone terminal need to be added together with the number of times of calling the operation area called by the operation in the use case database: noaa type and display resolution: 2560 × 1080, to the use case database, to facilitate subsequent sequence storage and call operations.

If the above processing steps fail, step S228 is executed. As shown in fig. 5, fig. 5 is a schematic diagram of a pop-up window operation failure provided in the embodiment of the present application, where 501 identifies a pop-up window X still stored in a current display page due to a processing failure, and 502 identifies a processing area in the pop-up window X.

Step S228: if the operation of the popup window X fails but the process B does not report an error, operating the popup window X again; if the popup window X fails to process and the process B reports an error, recording an error log of the popup window X and submitting an auditing request to the popup window X.

It should be noted that, if the operation on the popup X fails, the trial-and-error mechanism is turned on, and the popup X starts to operate again according to the step S220. And if the operation fails for three times, the steps of freezing and capturing the node elements in the current display page are executed again.

And under the condition that the operation of the popup X is failed and the process B reports an error, re-executing the steps of freezing and capturing the node elements in the current display page, and submitting an audit request to the popup X if the popup X is not successfully processed after being executed for three times, wherein the audit request can be to audit the popup X in a manual operation mode. And after the verification and the operation are passed, then, storing the operation method of the popup window X, the model of the current mobile phone terminal, the resolution of the display screen and the type of the popup window X into the use case database.

Step S230: and storing the equipment model, the display screen resolution, the popup type and the corresponding operation method of the terminal in the history popup successfully processed data of the terminal according to the sequence of the calling times from high to low.

After the popup window X is processed, the data in the use case database also needs to be stored according to the number of calls.

Step S232: and the popup window processing in the current display page is successful.

According to the method for automatically processing the popup window provided by the embodiment, the method for automatically processing the popup window is embedded in the application program of the mobile phone and installed and used at the mobile phone end, so that the method for automatically processing the popup window provided by the application can be conveniently and quickly applied to an actual application scene, and the user experience is improved. And the automatic popup window processing method is embedded into the mobile phone application program, so that the mobile phone application program runs in the background of the mobile phone, and the current display page of the mobile phone end can be monitored in real time.

Secondly, matching corresponding node elements in the history popup successfully processed data through the text information, and operating the node elements to be processed according to the operation method of the corresponding node elements in the history popup successfully processed data, so that the node elements to be processed can be accurately and rapidly operated, and the node elements to be processed can be processed by obtaining a reliable operation method.

And thirdly, accumulating and sequencing the called operation methods in the history popup successfully processed data, so that the subsequent calling can be more convenient and faster. Moreover, after the node elements in the current display page fail to operate, corresponding processing steps are provided to deal with the condition of operation failure, so that the automatic popup window processing method can effectively deal with different error conditions, and the reliability of the automatic popup window processing method is improved.

In addition, under the condition that the historical popup window successfully processed data does not have the corresponding operation method, the automatic popup window processing method can be guaranteed to carry out reinforcement learning by submitting audit and adding the corresponding operation method to the historical popup window successfully processed data, the practicability of the automatic popup window processing method is further improved, and popup windows appearing in the current display page can be effectively dealt with.

Corresponding to the above method embodiment, the present application further provides an embodiment of an automatic pop-up window processing device, and fig. 6 shows a schematic structural diagram of the automatic pop-up window processing device provided in an embodiment of the present application. As shown in fig. 6, the apparatus includes:

a monitoring module 602 configured to monitor a current display page, freeze and capture node elements in the current display page;

a first processing module 604, configured to, in a case that a node element in a current display page is successfully captured, refer to historical popup successful processing data of the node element to process a popup in the node element;

the second processing module 606 is configured to, when the node element in the current display page is not successfully captured, refer to historical popup successful processing data corresponding to the terminal where the current display page is located to process the popup in the current display page.

Optionally, the node element includes a condition field and a target field, where the condition field is used to record text information of the node element, and the target field is used to record an operation method of the node element;

the first processing module 604, further configured to:

matching the condition field of the node element with the condition field of the node element in the history popup successfully processed data of the node element;

The first processing module 604, further configured to:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

The first processing module 604, further configured to:

and accumulating the calling times of the operation method corresponding to the button control element in the history popup successfully processed data.

The first processing module 604, further configured to:

The automatic popup window processing device further comprises:

a first storage module 608, configured to, in a case that the popup in the node element is successfully processed with reference to the historical popup successful processing data of the node element, store the node elements in the historical popup successful processing data of the node element in an order from high to low in the call times.

The automatic popup window processing device further comprises:

a switching module 610 configured to determine whether the processing of the popup in the node element is successful with reference to the historical popup successful processing data of the node element;

The second processing module 606, further configured to:

matching in the history popup successfully processed data corresponding to the terminal according to the equipment model of the terminal and the resolution of the display screen;

The second processing module 606, further configured to:

The automatic popup window processing device further comprises:

a second storage module 612 configured to:

The monitoring module 602, further configured to:

and acquiring the node elements in the current display page, and storing the node elements into a node list.

the monitoring module 602, further configured to:

By monitoring the current display page and acquiring the node elements in the current display page, the automatic popup window processing device provided by the embodiment ensures that the popup windows appearing in the current display page can be timely and accurately processed, and effectively improves the processing efficiency of the popup windows; and moreover, the corresponding operation methods are matched in the history popup successful processing data according to the types of different node elements to operate the node elements in the current display page, so that the node elements to be processed can be accurately and quickly processed, and the reliable operation method can be obtained to process the node elements to be processed.

Secondly, the node elements and the corresponding operation methods which do not exist in the history popup successfully processed data are stored in the history popup successfully processed data, so that the history popup successfully processed data is guaranteed to have a function of reinforcement learning, the automatic popup processing device provided by the embodiment is further guaranteed to be capable of effectively dealing with different types of popup, and the popup processing reliability is guaranteed.

In addition, in the history popup successfully processed data, the calling times of the operation methods are accumulated and sequenced when the corresponding operation methods are called each time, so that the history popup successfully processed data is ensured to have a clear storage structure, and the subsequent calling is facilitated.

The above is an illustrative scheme of an automatic pop-up window processing device of this embodiment. It should be noted that the technical solution of the automatic pop-up window processing device and the technical solution of the automatic pop-up window processing method belong to the same concept, and details of the technical solution of the automatic pop-up window processing device, which are not described in detail, can be referred to the description of the technical solution of the automatic pop-up window processing method.

Fig. 7 illustrates a block diagram of a computing device 700 provided according to an embodiment of the present application. The components of the computing device 700 include, but are not limited to, memory 710 and a processor 720. Processor 720 is coupled to memory 710 via bus 730, and database 750 is used to store data.

Computing device 700 also includes access device 740, access device 740 enabling computing device 700 to communicate via one or more networks 760. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 740 may include one or more of any type of network interface, e.g., a Network Interface Card (NIC), wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.

In one embodiment of the application, the above-described components of the computing device 700 and other components not shown in fig. 7 may also be connected to each other, for example, by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 7 is for purposes of example only and is not limiting as to the scope of the present application. Those skilled in the art may add or replace other components as desired.

Computing device 700 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 700 may also be a mobile or stationary server.

Wherein, the steps of the automatic pop-up window processing method are implemented when the processor 720 executes the instructions.

The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the automatic pop-up window processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the automatic pop-up window processing method.

An embodiment of the present application also provides a computer readable storage medium storing computer instructions, which when executed by a processor, implement the steps of the automatic pop-up window processing method as described above.

The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the automatic pop-up window processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the automatic pop-up window processing method.

The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The preferred embodiments of the present application disclosed above are intended only to aid in the explanation of the application. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the application and its practical applications, to thereby enable others skilled in the art to best understand and utilize the application. The application is limited only by the claims and their full scope and equivalents.

26页详细技术资料下载

Method and device for automatically processing popup window

相关技术

网友询问留言