阅读说明：本技术 数据处理方法、装置、电子设备及计算机存储介质 (Data processing method and device, electronic equipment and computer storage medium ) 是由 隋承达 于 2020-04-23 设计创作，主要内容包括：本发明实施例提供了一种数据处理方法、装置、电子设备及计算机存储介质,其中,数据处理方法包括：触发目标信息对应的操作控件,获取当前界面展示的目标信息；根据目标信息执行目标操作；在当前界面,展示目标操作结果。通过本发明实施例,设备可以获取到当前界面展示的目标信息执行目标操作,获取信息的方式更加灵活,可以实现更多功能。(The embodiment of the invention provides a data processing method, a data processing device, electronic equipment and a computer storage medium, wherein the data processing method comprises the following steps: triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to execute the target operation, the information acquisition mode is more flexible, and more functions can be realized.)

1. A method of data processing, comprising:

triggering an operation control corresponding to target information, and acquiring the target information displayed on a current interface;

executing target operation according to the target information;

and displaying a target operation result on the current interface.

2. The method according to claim 1, wherein the triggering an operation control corresponding to target information to obtain the target information displayed on a current interface includes:

triggering an operation control corresponding to the target information, and displaying at least one option included in the operation control;

and receiving a trigger operation of a target option matched with the target information in the at least one option, and acquiring the target information matched with the target option based on the content displayed on the current interface.

3. The method according to claim 1 or 2, wherein the operation control comprises a preset display window, and the displaying of the target operation result in the current interface comprises:

determining to obtain the target operation result corresponding to the target operation, and triggering and displaying the preset display window;

and displaying the target operation result in the preset display window.

4. The method of claim 3, wherein the preset presentation window comprises at least one tab, and the presenting the target operation result in the preset presentation window comprises:

and displaying the target operation result on a tab page corresponding to the target operation in the preset display window.

5. The method of claim 3, wherein the method further comprises:

receiving size adjustment operation and/or position adjustment operation of the preset display window;

and displaying the preset display window on the current interface according to the adjusted size and/or position, and updating the display of the target operation result in the adjusted preset display window.

6. The method of claim 3, wherein the operational control comprises a hover icon, the method further comprising:

receiving switching operation of the preset display window, and reducing the preset display window into the floating icon; and displaying the floating icon at the edge of the current interface.

7. The method of claim 1, wherein the performing a target operation according to the target information comprises:

and comparing the prices of the target items indicated in the target information to obtain a price comparison result of the target items, wherein the target operation result comprises the price comparison result.

8. The method of claim 7, wherein the price comparison comprises at least one purchase link for the target item; the method further comprises the following steps:

and displaying a page corresponding to the purchase link according to the trigger operation of the purchase link.

9. The method of claim 1, wherein the performing a target operation according to the target information comprises:

and obtaining comment information, and adding a comment to the target information according to the comment information to obtain a comment result, wherein the target operation result comprises the comment result.

10. The method of claim 1, wherein the performing a target operation according to the target information comprises:

and searching the target information to obtain a search result corresponding to the target information, wherein the target operation result comprises the search result.

11. The method of claim 1, wherein the performing a target operation according to the target information comprises:

converting the target information into an editable recording result, wherein the target operation result comprises the editable recording result;

displaying a target operation result on the current interface, wherein the target operation result comprises the following steps:

and displaying the editable recording result on the current interface, and displaying at least one editing tool option.

12. The method according to claims 7-11, wherein the triggering an operation control corresponding to target information to obtain the target information displayed on a current interface includes:

triggering the operation control corresponding to the target information and displaying an interception frame;

receiving adjustment operation on the intercepting frame, and acquiring the content displayed on the current interface according to the adjusted intercepting frame to obtain acquired data;

and carrying out artificial intelligence recognition on the collected data, and acquiring the target information according to a recognition result.

13. The method of claim 12, wherein the receiving an adjustment operation for the capture frame, and acquiring the content displayed by the current interface according to the adjusted capture frame to obtain the acquisition data comprises:

and receiving size adjustment operation and/or position adjustment operation of the intercepting frame, and carrying out image interception on a content area corresponding to the intercepting frame in the current interface to obtain the acquired data.

14. The method of claim 12, wherein the receiving an adjustment operation for the capture frame, and acquiring the content displayed by the current interface according to the adjusted capture frame to obtain the acquisition data comprises:

and receiving length adjustment operation and/or position adjustment operation of the intercepting frame, and performing audio interception on a content area corresponding to the intercepting frame in the current interface to obtain the acquired data.

15. The method according to claim 12, wherein the triggering an operation control corresponding to target information to obtain the target information displayed on a current interface includes:

and triggering the operation control corresponding to the target information, and capturing video frames in the video displayed on the current interface according to the triggered time to obtain the acquired data.

16. The method of claim 12, wherein the collected data includes collected image data, and the target information includes text obtained by text recognition of the image data or a target element obtained by target element recognition of the image data.

17. The method of claim 12, wherein the collected data includes collected audio data, and the target information includes audio key information obtained by extracting key information from the audio data, or text key information obtained by extracting key information from text after converting the audio data into text.

18. The method of claim 1, wherein the performing a target operation according to the target information comprises:

and calling the target application to which the operation control belongs to execute the target operation on the target information to obtain the target operation result.

19. A data processing apparatus comprising:

the acquisition module is used for triggering an operation control corresponding to the target information and acquiring the target information displayed on the current interface;

the processing module is used for executing target operation according to the target information;

and the display module is used for displaying the target operation result on the current interface.

20. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to any one of claims 1-18.

21. A computer storage medium, on which a computer program is stored which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 18.

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to a data processing method and device, electronic equipment and a computer storage medium.

Background

With the development of internet technology and mobile communication technology, more and more conventional items are being electronized through Application programs (APPs) through which users can use various functions. However, in the process of using an application program, a user can only input information displayed/collected by the application program to realize the function of the application program, and if one application program is used to collect information in another application program, the application program needs to be continuously switched, so that some functions are very complicated to realize or cannot be realized.

Disclosure of Invention

In view of the above, embodiments of the present invention provide a data processing method, an apparatus, an electronic device, and a computer storage medium to solve some or all of the above problems.

According to a first aspect of the embodiments of the present invention, there is provided a data processing method, including: triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface; executing target operation according to the target information; and displaying the target operation result on the current interface.

According to a second aspect of the embodiments of the present invention, there is provided a data processing apparatus including: the acquisition module is used for triggering the operation control corresponding to the target information and acquiring the target information displayed on the current interface; the processing module is used for executing target operation according to the target information; and the display module is used for displaying the target operation result on the current interface.

According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus, including: the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is used for storing at least one executable instruction, and the executable instruction enables the processor to execute the corresponding operation of the data processing method of the first aspect.

According to a fourth aspect of embodiments of the present invention, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method of the first aspect.

According to the data processing method, the data processing device, the electronic equipment and the computer storage medium, an operation control corresponding to target information is triggered, and the target information displayed on a current interface is acquired; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to perform target operation, the information acquisition mode is more flexible, and more functions can be realized.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present invention, and it is also possible for a person skilled in the art to obtain other drawings based on the drawings.

Fig. 1 is a schematic view of a data processing method according to an embodiment of the present invention;

fig. 2 is a flowchart of a data processing method according to an embodiment of the present invention;

fig. 3 is a flowchart of a data processing method according to a second embodiment of the present invention;

fig. 3A is a schematic diagram illustrating a screenshot effect provided in the second embodiment of the present invention;

fig. 3B is a schematic view of a search scenario according to a second embodiment of the present invention;

fig. 3C is a schematic view of a translation scenario provided in the second embodiment of the present invention;

fig. 4 is a flowchart of a data processing method according to a third embodiment of the present invention;

fig. 4A is a schematic diagram of an audio capture effect according to a third embodiment of the present invention;

fig. 4B is a schematic view of a recorded scene according to a third embodiment of the present invention;

fig. 5A is a schematic diagram of a tab effect of a preset display control according to a fourth embodiment of the present invention;

fig. 5B is a schematic diagram illustrating an effect of a preset display control according to a fourth embodiment of the present invention;

fig. 5C is a schematic diagram of a display effect of a preset display control according to a fourth embodiment of the present invention;

fig. 6A is a schematic diagram illustrating a triggering effect of a floating icon according to a fourth embodiment of the present invention;

fig. 6B is a schematic diagram illustrating a moving effect of a floating icon according to a fourth embodiment of the present invention;

fig. 6C is a schematic diagram illustrating a hiding effect of a floating icon according to a fourth embodiment of the present invention;

fig. 6D is a schematic diagram illustrating a dynamic special effect of a floating icon according to a fourth embodiment of the present invention;

fig. 7 is a structural diagram of a data processing apparatus according to a fifth embodiment of the present invention;

fig. 8 is a block diagram of an electronic device according to a fifth embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention shall fall within the scope of the protection of the embodiments of the present invention.

The following further describes specific implementation of the embodiments of the present invention with reference to the drawings.

Example one

For easy understanding, a scenario in which the data processing method according to the first embodiment of the present invention is applied is described with reference to fig. 1, where fig. 1 is a schematic view of the scenario of the data processing method according to the first embodiment of the present invention, and certainly, fig. 1 is only an application scenario of the data processing method according to the first embodiment of the present invention, and is not only applicable to the scenario shown in fig. 1, but the application scenario of the data processing method is not limited by the present invention, and is only an exemplary description for easy understanding, in fig. 1, the scenario includes an electronic device 101 and a cloud end 102, the electronic device 101 and the cloud end 102 are connected through a Network, and data interaction is performed through the Network, and in the present invention, the Network includes a Local Area Network (LAN), a Wide Area Network (WAN), a Local Area Network (WAN), a wireless Network (LAN), a wireless Network, a, A mobile communication network; such as the World Wide Web (WWW), Long Term Evolution (LTE) networks, 2G networks (2 th Generation Mobile Network), 3G networks (3 th Generation Mobile Network), 5G networks (5 th Generation Mobile Network), etc. Of course, this is merely an example and does not represent a limitation of the present invention.

The cloud 102 may include various devices connected by a network, such as servers, relay devices, Device-to-Device (D2D) devices, and so forth.

The electronic device 101 may be a device having a display function, the specific form of the electronic device is not limited in the present invention, and the electronic device may be a smart speaker, a smart phone, a tablet computer, a notebook computer, or the like. Various application software is installed on the electronic device 101, and the cloud 102 may include a server of the application software installed on the electronic device 101. The user performs operation on the electronic device 101, performs data acquisition on the content displayed on the current interface, performs target operation on the acquired target information to obtain a target operation result, and displays the target operation result on the current interface.

Referring to fig. 2 in conjunction with the scenario shown in fig. 1, fig. 2 is a flowchart of a data processing method according to an embodiment of the present invention, where the method may be applied to the scenario shown in fig. 1, and further, may be applied to the electronic device shown in fig. 1, that is, the electronic device serves as an execution subject of the method, and of course, this is merely an exemplary illustration, and does not represent that the present invention is limited thereto, and in conjunction with the scenario shown in fig. 1, the method includes the following steps:

step 201, triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface.

The operation control can be a control for man-machine interaction, the operation control can be displayed on a current interface, the operation control can be a suspension icon or a preset display control, the preset display control can comprise a preset display window or a preset display floating layer, and the specific representation form of the operation control is not limited.

The triggering operation of the operation control can be in various forms, including a touch operation and a non-touch operation, wherein the touch operation includes a touch operation, a key operation and the like, and the non-touch operation includes a gesture operation, a voice operation and the like.

The triggering operation can trigger the display of various functional icons of the operation control, including an artificial intelligence recognition icon, a search icon, a translation icon, a recording icon, an image uploading icon, a price comparison icon, a comment icon and the like, and further, different functions are realized through the operation of different icons.

In this embodiment, when obtaining the target information to be processed based on the content displayed on the current interface, data acquisition, such as image acquisition, text acquisition, audio acquisition, and the like, may be performed on the content displayed on the current interface, and then the target information is obtained based on the acquired data, where the target information includes but is not limited to: keywords, key image data, key audio data, and the like. The scope of the keyword/word may be set by those skilled in the art according to actual needs, and in some application scenarios, the scope of the keyword/word may be all or part of the word/word after processing the acquired data.

Optionally, triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface, including: triggering an operation control corresponding to the target information, and displaying at least one option included in the operation control; and receiving a trigger operation of a target option matched with the target information in at least one option, and acquiring the target information matched with the target option based on the content displayed on the current interface.

The operation control comprises at least one option, and a user can select different options to realize different functions, so that the user experience is improved. In one implementation, the operation control may be a floating icon, and when the floating icon is triggered, at least one option is displayed; in another implementation, the operation control may be a preset presentation control, and at least one option is displayed when a menu option of the preset presentation control is triggered. The at least one option is displayed, so that the user can conveniently select the option, the operation control does not need to display the at least one option all the time, the area of the current interface occupied by the operation control is reduced, and the influence on the normal browsing of the user is avoided.

Optionally, triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface, including: triggering an operation control corresponding to the target information, and acquiring the content displayed on the current interface to obtain acquired data; and carrying out artificial intelligence recognition on the collected data, and acquiring target information according to a recognition result. Through artificial intelligence recognition, target information can be accurately and efficiently acquired.

It should be noted that the content displayed on the current interface includes an image, a text, a video, an audio, and the like displayed on the current interface, and the content displayed on the current interface may be acquired through screen capture, video frame capture, audio capture, text capture, and the like. Because the collected data can contain data in various forms, different artificial intelligence models can be adopted for carrying out artificial intelligence identification on the collected data according to the data types, for example, the collected data comprises images, and the image identification model is utilized for carrying out image identification on the collected data; for another example, the collected data includes audio, the collected data is subjected to audio recognition by using an audio recognition model, the audio may include voice of the user, and the voice data may be subjected to voice recognition by using a voice recognition model; for another example, the text may include language text, numbers, formulas, etc., and different models are used for recognizing different texts; since a video is composed of video frames, one video frame can be regarded as one image, and thus the recognition of the video is similar to the image recognition.

Further optionally, triggering an operation control corresponding to the target information, and acquiring the target information displayed on the current interface, including: triggering an operation control corresponding to the target information, and displaying an interception frame; receiving an adjustment operation on the intercepting frame; acquiring the content displayed on the current interface according to the adjusted interception frame to obtain acquired data; and carrying out artificial intelligence recognition on the collected data, and acquiring target information according to a recognition result. The intercepted content (namely the acquired data) is selected by the intercepting frame, so that the user can conveniently select which content is intercepted, and the user experience is improved.

Based on the above description, different types of data can be achieved through different acquisition manners, and here, three data acquisition manners are listed to describe how to obtain the acquired data, which is only an exemplary illustration here and does not represent that the present invention is not limited thereto:

optionally, in a first data acquisition mode, for image data, triggering an operation control corresponding to target information, and acquiring content displayed on a current interface to obtain acquired data, where the method includes:

and triggering an operation control corresponding to the target information, and carrying out image interception on the content displayed on the current interface to obtain acquired data. The image capture may also be referred to as screen capture, and the acquired data is image data. In many application scenes, the user browses information through the display screen, the requirement of the user for acquiring information through the target application can be met in many application scenes through a screen capturing mode, the convenience of acquiring/inputting information by the target application is improved, and the user experience is also improved. Further optionally, acquiring the content displayed on the current interface according to the adjusted capture frame to obtain acquired data, including: and receiving size adjustment operation and/or position adjustment operation of the intercepting frame, and carrying out image interception on a content area corresponding to the intercepting frame in the current interface to obtain acquired data.

Optionally, in a second data acquisition mode, for video data, triggering an operation control corresponding to target information, and acquiring content displayed on a current interface to obtain acquired data includes:

and triggering an operation control corresponding to the target information, and capturing video frames in the video displayed on the current interface according to the triggering time to obtain the acquired data. The video frame interception can enable a user to intercept the watched content when watching the video, the video is more intuitive due to the fact that the video is transmitted, the video is very widely applied in life, the mode that the target application collects information is further enriched by the video frame interception in the process that the user watches the video, the target application can acquire information in a video screen to provide intelligent service for the user, the function of the target application is further enriched, and the user experience is improved.

Optionally, in a third data acquisition mode, acquiring, according to the adjusted capture frame, the content displayed on the current interface for the audio data to obtain acquired data includes:

and receiving length adjustment operation and/or position adjustment operation of the intercepting frame, and performing audio interception on a content area corresponding to the intercepting frame in the current interface to obtain acquired data. The information is transmitted through the audio frequency, the information is also an important information transmission mode, in the audio frequency playing process, the audio frequency data can be collected by intercepting the audio frequency data through the target application, the data types collected by the target application are further enriched, more functions can be provided for a user, and the user experience is improved.

The three data acquisition modes are divided according to different data types, and for target operation of a user for triggering operation indication, the three data acquisition modes can be combined with any one operation, for example, the data acquired by the three data acquisition modes can be subjected to any one operation of artificial intelligence recognition, searching, translation, recording and image uploading. The executed operation is a data processing stage, and the data acquisition is a data acquisition stage, so that the data acquisition can be combined with different operations to realize different functions, the electronic equipment can provide more functions for users, and the user experience is improved.

The identification of the collected data is completed by calling a target application, and in one implementation mode, the electronic equipment can be used for carrying out artificial intelligence identification on the collected data by calling a program of the target application to obtain an identification result and acquiring target information according to the identification result; in another implementation manner, the electronic device may call a program of the target application to transmit the collected data to the cloud, the cloud performs artificial intelligence recognition on the collected data to obtain a recognition result, and acquires target information, and then the cloud transmits the target information to the electronic device. Of course, this is merely an example and does not represent a limitation of the present invention. Generally, electronic equipment's operational capability will be weaker than the high in the clouds, if be complicated operation, high in the clouds operating speed is faster, if simple operation, electronic equipment is because with user direct interaction, data transmission has been removed from, therefore response speed is faster, based on above-mentioned analysis, if some artificial intelligence discernments that the operand is few, electronic equipment directly discerns the response faster, if the artificial intelligence discernment that some operands are big, the high in the clouds operates, it is faster to return target information to electronic equipment, can choose different modes to improve response speed under the scene of difference.

The target information may include an identification result obtained after the collected data is subjected to artificial intelligence identification, or may include key content obtained after the identification result is extracted, and the content included in the target information may be different for different functions triggered by the user. Optionally, in an implementation manner, the collected data includes collected image data, and the target information includes a text obtained after performing text recognition on the image data, or a target element obtained after performing target element recognition on the image data. Optionally, in another implementation manner, the collected data includes collected audio data, and the target information includes audio key information obtained by extracting key information from the audio data, or text key information obtained by extracting key information from text after converting the audio data into text. The characters are obtained by identifying the image data, which is equivalent to converting the information contained in the image into the characters, so that more operations suitable for character processing are performed, and more functions can be realized; the operation control is obtained by identifying the image data, the target information in the image data is extracted, and naturally, the extraction of the target information can be realized by identifying the image data to obtain characters, the target information is processed, and the operation efficiency of data processing is improved.

And 202, executing target operation according to the target information.

Optionally, executing the target operation according to the target information and obtaining a target operation result, including:

and calling the target application to which the operation control belongs to execute target operation on the target information to obtain a target operation result.

By triggering the operation control, the content displayed on the current interface can be collected, and the target application to which the operation control belongs is called to execute the target operation, so that the limitation of data collection in the application program is broken, more data can be collected by the target application, and the target application can be directly called on the current interface to perform artificial intelligence recognition when a user browses more interfaces, so that the functions of electronic equipment are enriched, and the user experience is improved.

The operation control can be a control belonging to the target application, the target application can be called to provide services through the operation control, but the current interface can be an interface not belonging to the target application, so that in any interface of the electronic equipment, the content displayed on the current interface can be collected and the target application can be called to process through the operation control, more functions can be realized, and the limitation of information input of a user in an application program is broken to a certain extent. Optionally, the application to which the current interface belongs is different from the target application.

In step 202, different functions correspond to different operations in conjunction with the description of the multiple functions triggered by the user's trigger operation in step 201, and here, five specific examples are listed for explanation, which, of course, is only for illustration and does not represent that the present invention is not limited thereto.

Optionally, in a first example, when the operation control includes an option for instructing to perform a search, performing a target operation according to the target information includes:

and searching the target information to obtain a search result corresponding to the target information, wherein the target operation result comprises the search result. Optionally, the target application to which the operation control belongs may be called to search the target information, and a search result corresponding to the target information is obtained. The electronic equipment can transmit the target information to the cloud end, the cloud end searches in the network resources according to the target information to obtain a search result, and the search result is transmitted to the electronic equipment. In this example, with reference to the exemplary description of obtaining the target information in step 201, optionally, after performing artificial intelligence recognition on the collected data to obtain a recognition result, extracting at least one keyword from the recognition result and generating the target information, where the target information includes the at least one keyword. This example can be combined with any of the three data acquisition modalities listed in step 201.

By utilizing the search, the user can search the content which is interested in the content displayed on the current interface, other application programs do not need to be opened, the operation is directly completed on the current interface, the user search is more convenient, the content which is interested in can be immediately searched after being browsed, and the user experience is better.

Optionally, the search results may include at least one link related to the target information; the method further comprises the following steps: and receiving the triggering operation of the link by the user, and jumping to the page corresponding to the link according to the triggering operation. The user can jump to the corresponding page by clicking the link, and the user does not need to search again, so that the method is more convenient and faster. For example, the link may be a purchase link for an item; as another example, the link may be a user-specified link for an item, although this is merely an example and does not represent a limitation of the present invention.

Optionally, in a second example, when the operation control includes an option for instructing to perform translation, performing a target operation according to the target information includes:

and translating the target information to obtain a translation result corresponding to the target information. Optionally, the target information may be translated to obtain a translation result corresponding to the target information, and the target operation result includes the translation result. The electronic equipment can transmit the target information to the cloud end, the cloud end utilizes the translation model to translate the target information to generate a translation result, and the translation result is transmitted to the electronic equipment. In this example, with reference to the exemplary description of obtaining the target information in step 201, optionally, after the target application is invoked to perform artificial intelligence recognition on the collected data to obtain a recognition result, the recognition result is used as the target information. This example can be combined with any of the three data acquisition modalities listed in step 201.

In many scenes, a user must input characters for translation to obtain translation contents corresponding to the characters, and many times, contents displayed on a current interface are not only characters but also images, videos, audios and the like, and the user cannot obtain character information for input.

Optionally, in a third example, when the operation control includes an option for instructing to record, performing a target operation according to the target information includes:

and recording the target information to obtain a recording result corresponding to the target information. Optionally, the target information may be converted into an editable recording result, and the target operation result includes the editable recording result. The electronic device may generate an editable recording result based on the target information. In the example, a user can identify the content displayed on the current interface through recording, and an editable recording result is generated according to the identification result, so that the user can edit the content conveniently. In this example, with reference to the exemplary description of obtaining the target information in step 201, optionally, after the target application is invoked to perform artificial intelligence recognition on the collected data to obtain a recognition result, the recognition result is used as the target information. This example can be combined with any of the three data acquisition modalities listed in step 201.

Optionally, in a fourth example, performing the target operation according to the target information includes: and carrying out price comparison on the target item indicated in the target information to obtain a price comparison result of the target item, wherein the target operation result comprises a price comparison result. Optionally, the target application to which the operation control belongs may be called to transmit the target information to the cloud, the cloud searches for the price of the target item in the network resource according to the target information, compares the price to obtain a price comparison result, and transmits the price comparison result to the electronic device. In this example, the user can intuitively browse the price comparison result of the target item, and the user can conveniently select the price comparison result when purchasing the target item. This example can be combined with any of the three data acquisition modalities listed in step 201.

Further optionally, the price comparison result comprises at least one purchase link for the target item; the method further comprises the following steps: and displaying a page corresponding to the purchase link according to the trigger operation of the purchase link. The purchase link is displayed in the price comparison result, and a page corresponding to the purchase link can be directly opened, so that the user can purchase conveniently.

Optionally, in a fifth example, performing the target operation according to the target information includes: and obtaining comment information, and adding comments to the target information according to the comment information to obtain a comment result. When browsing the current interface, the user can add comments to the target information contained in the current interface, so that the user comments more conveniently.

And step 203, displaying a target operation result on the current interface.

Optionally, the operation control includes a preset display window, and the displaying of the target operation result on the current interface includes: determining a target operation result corresponding to the obtained target operation, and triggering and displaying a preset display window; and displaying the target operation result in a preset display window.

The preset display control can be used for triggering corresponding functions and displaying results, and a user can browse conveniently.

The size and position of the preset presentation control may be adjustable, for example, in one implementation, the method further comprises: receiving size adjustment operation and/or position adjustment operation of a preset display window; and displaying a preset display window on the current interface according to the adjusted size and/or position, and updating the display of the target operation result in the adjusted preset display window. By adjusting the size of the preset display window, the user can browse the target operation result through the preset display window, and by adjusting the position of the preset display window, the preset display window can be prevented from influencing the browsing of the user on other contents of the current interface.

Optionally, the preset display window may include at least one tab, and the displaying of the target operation result in the preset display window includes: and displaying a target operation result on a label page corresponding to the target operation in a preset display window. Different operation results are displayed on different tab pages, and when a user switches the tab pages, the user can see the corresponding operation results, so that the user can browse conveniently.

It should be noted that the operation control further includes a floating icon, and if the user does not want to continue to view after browsing the target operation result, the preset display window may be closed or switched to the floating icon, and the method further includes: receiving switching operation on a preset display window, and reducing the preset display window into a floating icon; and displaying a floating icon at the edge of the current interface. After the preset display window is switched to the suspension icon, the suspension icon does not affect the user to browse the current interface, various functions can be realized by triggering the suspension icon, and the use of the user is facilitated.

In combination with the five operations listed in step 202, correspondingly, the displayed target operation result is the target operation result corresponding to the executed target operation. For example, corresponding to the first example in step 202, when the operation control includes an object for indicating to perform a search, the target operation result includes a search result; for another example, corresponding to the second example in step 202, when the operation control includes an object for indicating translation, the target operation result includes a translation result; for another example, corresponding to the third example in step 202, when the operation control includes an object for indicating to perform recording, the target operation result includes an editable recording result, and the presenting the target operation result in the current interface includes: displaying an editable recording result on a current interface, and displaying at least one editing tool option; for another example, corresponding to the fourth example in step 202, when the operation control includes an object for indicating price comparison, the target operation result includes a price comparison result; as another example, corresponding to the fifth example in step 202, when the operation control includes an object for indicating to comment, the target operation result includes a comment result.

It should be noted that the operation control may be a preset display control, the preset display control may be a floating layer or a window in the current interface, and the size of the preset display control may be adjusted, so that the user does not influence the browsing of the current interface.

The data processing method provided by the embodiment of the invention triggers the operation control corresponding to the target information to acquire the target information displayed on the current interface; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to perform target operation, the information acquisition mode is more flexible, and more functions can be realized.

Example two

Based on the data processing method described in the first embodiment, a second embodiment of the present invention provides a data processing method, which is exemplarily illustrated by taking screen capture search as an example, but does not represent that the present invention is limited thereto, and as shown in fig. 3, the method includes the following steps:

step 301, when screen capture searching is triggered to be performed on the content displayed on the current interface, image capture is performed on the content displayed on the current interface by using a capture frame, and acquired data is obtained.

Step 301 is a further detailed description of the scenario of screen capture search, based on the description in step 201 of the first embodiment, that is, the operation control corresponding to the trigger target information acquires the content displayed on the current interface to obtain the acquisition data.

Two specific examples are listed here to illustrate image interception in detail:

optionally, in a first example, the image capturing the content displayed in the current interface by using the capture frame to obtain the collected data includes:

and detecting a content area of the content displayed on the current interface, and intercepting the image of the detected content area by using an intercepting frame with the size matched with that of the content area to obtain acquired data.

Optionally, in a second example, the image capturing the content displayed by the current interface by using the capture frame to obtain the collected data includes:

detecting a content area of the content displayed on the current interface, and displaying an intercepting frame in the content area in the current interface; and according to the size adjustment operation and/or the position adjustment operation of the intercepting frame, carrying out image interception on the detected content area by using the adjusted intercepting frame to obtain the acquired data. The user can better meet the user requirements and improve the user experience by adjusting the intercepting box to determine the content to be intercepted.

As shown in fig. 3A, fig. 3A is a schematic diagram of a screenshot effect provided by a second embodiment of the present invention, in fig. 3A, when it is determined to perform screenshot search on content displayed on a current interface according to a trigger operation of a user on a displayed operation control, the operation control may be hidden, the current interface displays a capture frame, the user may adjust the size and the position of the capture frame by dragging the capture frame, after the user has adjusted the capture frame, the capture may be triggered to be completed by determining the operation, and an electronic device performs image capture by using the capture frame; alternatively, the user may trigger cancellation of the screen capture by a cancel operation. In fig. 3A, the icon "confirm" indicates confirmation, and the icon "cancel" indicates cancellation, however, fig. 3A is only an illustration, and does not represent that the present invention is limited thereto.

Step 302, calling a target application to perform artificial intelligence recognition on the collected data, and acquiring target information according to a recognition result.

In this embodiment, the acquired data may include a screen capture image, and the image recognition model may be used to recognize the screen capture image to obtain a recognition result, where it should be noted that in this embodiment, the recognition result may include characters obtained after character recognition is performed on characters in the screen capture image, or information related to an operation control obtained after recognition is performed on an operation control in the screen capture image.

And step 303, calling the target application to which the operation control belongs to search the target information to obtain a search result corresponding to the target information.

Here, step 303 is the same as the first example in step 202 in the first embodiment, and is not described here again.

And 304, displaying the search result by operating the control based on the current interface.

Step 304 is the same as step 203 in the first embodiment, and is not described herein again.

With reference to fig. 3B, fig. 3B is a schematic view of a search scenario provided by a second embodiment of the present invention, where the scenario shown in fig. 3B is based on a data processing method provided by the second embodiment, a specific scenario of the search described in the first example in step 202 is illustrated, and with reference to the interface 1 in fig. 3B, an operation control is displayed as a floating icon, that is, a circular icon in fig. 3B, and a user can implement a search by triggering the floating icon, in this scenario, the floating icon is only exemplarily illustrated by taking the floating icon as an example, and does not represent that the present invention is limited thereto, and the floating icon is displayed on the current interface in a floating manner, where the current interface may be any one interface, and the interface 1 in fig. 3B shows a topic, which is merely an exemplary illustration and does not represent that the present invention is limited thereto; as in interface 2 in fig. 3B, the triggering operation of the user may be to click the floating icon, click the floating icon (i.e., triggering operation) to trigger the search, and enter interface 3 in fig. 3B, i.e., screen capture interface; in the interface 3, the dashed line frame represents the capture frame, a user can adjust the position and size of the capture frame through the dragging operation of the capture frame, it should be noted that a confirmation key and a cancel key can be displayed below the capture frame, of course, the confirmation key and the cancel key are virtual keys, clicking the confirmation key and the cancel key can be realized through touch operation, the user can confirm that the adjustment of the size and the position of the capture frame is completed through the confirmation operation, and image capture of the content in the capture frame is triggered; as shown in the interface 4 in fig. 3B, the confirmation operation of the user may be to click a confirmation key, and if the user clicks a cancel key, the search is cancelled; after the user clicks the confirmation key, the electronic device performs image capture (which may also be referred to as screen capture) on the content in the capture frame in the current interface to obtain a captured image, as shown in an interface 5 in fig. 3B, the interface 5 shows one captured image, and the interface 5 illustrates an example of the user capturing one topic shown in the current interface, which does not represent that the present invention is limited thereto; the electronic equipment calls a target application corresponding to an operation control (namely, a suspension icon) to perform image recognition on the intercepted image to obtain a recognition result, the recognition result can comprise characters obtained after the characters of the intercepted image are recognized and/or target elements obtained after the target elements of image data are recognized, keywords are extracted from the recognition result to obtain key information, searching is performed based on the key information, the intercepted image comprises a topic in combination with the graph 3B, and an answer of the topic can be searched; as shown in an interface 6 in fig. 3B, the answer is displayed in a preset display window, the preset display window is suspended in the current interface, and the user can adjust the size and the position of the preset display window by dragging, so that the user does not influence the browsing of the content of the current interface. The process of screen capture and question searching is exemplarily shown from the interface 1 to the interface 6, and due to the arrangement of the operation control, the user can acquire the content displayed on the current interface through triggering operation triggering, so that the data acquisition mode in the application program is broken, the user does not need to open the application program, and when browsing any one interface, the data acquisition can be triggered through the triggering operation on the operation control, so that the operations such as searching and the like are completed, and the functions which can be realized by the electronic equipment are enriched. Of course, this is only an exemplary illustration, and the data processing method provided by the present invention may also be applied in other scenarios.

With reference to fig. 3C, fig. 3C is a schematic view of a scenario of translation provided by the second embodiment of the present invention, the scenario shown in fig. 3C is based on the data processing method provided by the second embodiment, for a specific scenario of the translation described in the second example of step 202, in conjunction with interface 1 in fig. 3C, the operation control is shown as a preset display control, i.e., the control at the bottom of the interface in fig. 3C, this scenario is only exemplified by the preset presentation control, without representing the limitation of the present invention, the user may perform the translation by triggering the preset display control, the preset display control is displayed on the current interface in a floating manner, the current interface can be any one interface, interface 1 in FIG. 3C, for example, shows a English letter, although this is merely an illustration and does not represent that the invention is not limited thereto; as in interface 2 in fig. 3C, the user's trigger operation may be to click a translation key in the preset display control, in this example, the translation key is a virtual key, and click the translation key through a touch operation to trigger translation, and before translation, a current interface is intercepted, as in interface 3 in fig. 3C, that is, a screen interception interface; in the interface 3, the dashed line frame represents the capture frame, a user can adjust the position and size of the capture frame through the dragging operation of the capture frame, it should be noted that a confirmation key and a cancel key can be displayed below the capture frame, of course, the confirmation key and the cancel key are virtual keys, clicking the confirmation key and the cancel key can be realized through touch operation, the user can confirm that the adjustment of the size and the position of the capture frame is completed through the confirmation operation, and image capture of the content in the capture frame is triggered; as shown in the interface 4 in fig. 3C, the confirmation operation of the user may be to click a confirmation button, and if the user clicks a cancel button, the translation is cancelled; after the user clicks the confirmation key, the electronic device performs image capture (which may also be referred to as screen capture) on the content in the capture frame in the current interface to obtain a captured image, as shown in an interface 5 in fig. 3C, the interface 5 shows one captured image, and the interface 5 illustrates an example of capturing one english word shown in the current interface by the user, which does not represent that the present invention is limited thereto; the electronic equipment calls a target application corresponding to an operation control (namely a preset display control) to perform image recognition on the intercepted image to obtain a recognition result, wherein the recognition result can comprise characters obtained after the characters of the intercepted image are recognized, in the example, the recognized characters are used as target information, translation is performed based on the target information, a target language of translation can be set by a user, and in the example, the translation is exemplarily explained by using English translation as Chinese; as shown in an interface 6 in fig. 3C, the translation result, i.e., the translated chinese language, is displayed on the preset display control, the preset display control is suspended on the current interface, and the user can adjust the size and the position of the preset display control by dragging, so that the user does not influence the browsing of the content of the current interface. The process of screen capture translation is exemplarily shown from the interface 1 to the interface 6, and due to the arrangement of the operation control, the user can trigger the acquisition of the content shown on the current interface through triggering operation, so that the data acquisition mode in the application program is broken, the user does not need to open the application program, and when browsing any one interface, the data acquisition can be triggered through the triggering operation on the operation control, so that the operations such as translation and the like are completed, and the functions which can be realized by the electronic equipment are enriched. Of course, this is only an exemplary illustration, and the data processing method provided by the present invention may also be applied in other scenarios.

EXAMPLE III

Based on the data processing method described in the first embodiment, a third embodiment of the present invention provides a data processing method, which is exemplarily illustrated by recording audio, but does not represent that the present invention is limited thereto, and as shown in fig. 4, the method includes the following steps:

step 401, when triggering the audio processing of the content displayed on the current interface, performing audio data interception on the audio content displayed on the current interface according to the interception frame to obtain the acquired data.

Step 401 is a further detailed description of "triggering the operation control corresponding to the target information and acquiring the content displayed on the current interface to obtain the acquired data" in the scene of audio search based on the description in step 201 of the first embodiment.

Optionally, the audio data interception is performed on the audio content displayed on the current interface according to the interception frame to obtain collected data, and the method includes:

displaying the interception frame in the current interface; and receiving the length adjustment operation and/or the position adjustment operation of the user on the intercepting frame, and intercepting audio data of the audio content displayed on the current interface by using the adjusted intercepting frame to obtain collected data.

As shown in fig. 4A, fig. 4A is a schematic diagram of an audio capture effect according to a third embodiment of the present invention, in fig. 4A, two ends of a capture frame are respectively provided with two icons that can move on a time axis, and dragging the icons at the two ends can change the position and time length of the capture frame on the time axis, so as to determine to capture the section of audio data. Of course, fig. 4A is merely an exemplary illustration and does not represent a limitation of the present invention.

And 402, calling a target application to perform artificial intelligence identification on the acquired data, and acquiring target information according to an identification result.

And step 403, converting the target information into an editable recording result.

Here, step 403 is the same as the first example in step 202 in the first embodiment, and is not described here again.

And step 404, displaying the editable recording result through a preset display control based on the current interface.

Step 404 is the same as step 203 in the first embodiment, and is not described here again.

With reference to fig. 4B, fig. 4B is a schematic view of a recorded scene provided in a third embodiment of the present invention, the scene shown in fig. 4B is based on the data processing method provided in the third embodiment of the present invention, illustrating a specific scenario of the recording described in the third example of step 202, in conjunction with interface 1 in fig. 4B, the operation control is shown as a preset display control, i.e., the control at the bottom of the interface in fig. 4B, this scenario is only exemplified by the preset presentation control, without representing the limitation of the present invention, the user may implement recording by triggering the preset display control, the preset display control is displayed on the current interface in a floating manner, the current interface can be any one interface, interface 1 in fig. 4B is an audio playing interface, which is, of course, only exemplary and not meant to limit the invention thereto; as shown in the interface 2 in fig. 4B, the user's trigger operation may be to click a record button in the preset display control, in this example, the record button is a virtual button, and click the record button through a touch operation to trigger recording, and before recording, the audio data played on the current interface is intercepted, as shown in the interface 3 in fig. 4B, two solid triangular marks represent an intercepting frame, which correspond to the start time and the end time of the intercepted audio data, respectively, the user may adjust the position and the length of the intercepting frame through a dragging operation of the intercepting frame, it should be noted that a confirmation button and a cancellation button may be displayed below the intercepting frame, of course, the confirmation button and the cancellation button are virtual buttons, and the click confirmation button and the cancellation button may both be implemented through touch operations, and the user may confirm that the size of the intercepting frame is completed through the confirmation operation, Adjusting the length, and triggering the audio data interception of the content in the interception frame; as shown in the interface 4 in fig. 4B, the confirmation operation of the user may be to click a confirmation key, and if the user clicks a cancel key, the record is cancelled; after the user clicks the confirmation key, the electronic equipment intercepts audio data of the content in the interception frame in the current interface and obtains intercepted audio data; the electronic equipment calls a target application corresponding to an operation control (namely, a preset display control) to perform image recognition on the intercepted audio data to obtain a recognition result, wherein the recognition result can include characters obtained after the characters of the intercepted audio data are recognized, in the example, the recognized characters are used as target information and are recorded based on the target information to generate an editable recording result; as shown in an interface 5 in fig. 4B, the editable recording result is displayed on the preset display control, the preset display control is suspended on the current interface, and the size and the position of the preset display control can be adjusted by dragging for the user. The recording is triggered by presetting the display control, the non-editable audio data is converted into editable characters, the editing by a user is facilitated, the recording is completed, and the functions which can be realized by the electronic equipment are enriched. Of course, this is only an exemplary illustration, and the data processing method provided by the present invention may also be applied in other scenarios.

In this embodiment, the collected data may include intercepted audio data, and the audio data may be identified by using an audio identification model to obtain an identification result, where it should be noted that in this embodiment, the identification result may include characters or audio information after the audio data is identified, and the target information includes audio target information obtained after the audio data is subjected to target information extraction, or text target information obtained after the audio data is converted into characters and the characters are subjected to target information extraction.

Example four

In combination with the data processing methods described in the first to third embodiments, the fourth embodiment exemplifies two specific application scenarios to illustrate the operation control, and the operation control may include a preset display control or a floating icon, which is, of course, only exemplary illustrated here, and the operation control may have various forms, and the different forms may be switched, which is not limited herein. The descriptions in the two application scenarios of the fourth embodiment can be used to explain any one of the data processing methods described in the first to third embodiments.

Optionally, in a first application scenario, taking a preset display control as an example, where the preset display control includes at least one tab, the data processing method according to any embodiment of the present invention further includes:

and if the target tab page of the operation control is detected to be triggered, displaying the content of the target tab page, wherein the operation control comprises at least one tab page.

As shown in fig. 5A, fig. 5A is a schematic diagram of a tab effect of a preset display control according to a fourth embodiment of the present invention, where one tab may correspond to one function, and when a user selects the corresponding tab, the preset display control displays a result of displaying the corresponding function, that is, an operation result obtained by implementing the function through a corresponding operation.

The size of the preset display control can be adjusted, and when the height of the preset display control is adjusted to be minimum by a user, the preset display control only displays a few shortcut options, as shown in fig. 5B, where fig. 5B is a schematic diagram of an effect of the preset display control provided by the fourth embodiment of the present invention, and the schematic diagram may include options of minimization, exit, menu, shortcut, and the like. The user clicks the exit, the preset display control can be closed, the user clicks the quick screen to perform screen recognition, the user clicks the menu to display at least one option, and the user selects the options through touch operation, namely, the corresponding functions can be realized. As shown in fig. 5C, fig. 5C is a schematic diagram illustrating a display effect of a preset display control according to a fourth embodiment of the present invention, where in fig. 5C, four options are displayed, that is, four functions are displayed, and one option corresponds to one function, and includes artificial intelligence recognition, search, translation, recording, and image uploading, and corresponds to four options of a floating icon.

Optionally, when the user clicks the minimum, the preset display control may be switched to the floating icon, and optionally, in an implementation manner, the data processing method according to any embodiment of the present invention further includes:

when a first switching operation on the preset display control is detected, the preset display control is hidden and switched to display of the floating icon.

Optionally, in a second application scenario, the operation control is a floating icon, and when a trigger operation on the floating icon is detected, at least one option included in the floating icon is displayed; and if the target option in the at least one option is triggered, acquiring target information matched with the target option based on the content displayed on the current interface. It should be noted that at least one option of the floating icon may correspond to at least one option of the preset presentation control. One option corresponds to one function, including artificial intelligence recognition, searching, translation, recording, image uploading, and the like.

As shown in fig. 6A, fig. 6A is a schematic diagram illustrating a triggering effect of a floating icon according to a fourth embodiment of the present invention; in fig. 6A, when the user clicks the floating icon, four function options (i.e., at least one option, and one function option is one option) are displayed around the floating icon, of course, fig. 6A is an example for illustration, there may be more function options, and the user may select a function option to implement a corresponding function. The user can trigger and display four function options by clicking the floating icon, and the user can trigger and display the four function options by long-time pressing of the floating icon. It should be noted that, in an implementation manner, when the user presses the floating icon for a long time, the position of the floating icon may also be moved by dragging, as shown in fig. 6B, where fig. 6B is a schematic diagram of a moving effect of the floating icon provided in the fourth embodiment of the present invention.

Optionally, in an implementation manner, the data processing method according to any embodiment of the present invention further includes: and hiding the floating icon at the edge of the current interface when the operation for indicating to hide the floating icon is detected.

Optionally, the operation of indicating to hide the floating icon may be to drag the floating icon to an edge of the current interface, and when the user drags the floating icon to the edge of the current interface, the floating icon is hidden, as shown in fig. 6C, fig. 6C is a schematic view of a hiding effect of the floating icon provided by the fourth embodiment of the present invention.

Optionally, in an implementation manner, the data processing method according to any embodiment of the present invention further includes: and detecting the moving track of the operation position, and controlling the suspension icon to display a dynamic special effect according to the moving track.

Referring to fig. 6D, fig. 6D is a schematic diagram of a dynamic special effect of a floating icon according to a fourth embodiment of the present invention, in fig. 6D, the floating icon includes a solid dot, the solid dot is pointed to an operation position of a user in the floating icon, when the operation position of the user changes, the solid dot changes in the floating icon along with the change of the operation position of the user, and the dynamic special effect may improve user experience in a use process.

Optionally, in an implementation manner, the data processing method according to any embodiment of the present invention further includes: and when the second switching operation on the floating icon is detected, hiding the floating icon, and switching to display a preset display window.

The second switching operation may be an operation of selecting any one of the functions by the user, that is, when the user selects any one of the functions, the floating icon is switched to the preset display control.

EXAMPLE five

With reference to the methods described in the first to fourth embodiments, a fifth embodiment of the present invention provides a data processing apparatus for executing the methods described in the first to fourth embodiments, and referring to fig. 7, the data processing apparatus 70 includes:

the obtaining module 701 is configured to trigger an operation control corresponding to target information, and obtain target information displayed on a current interface;

a processing module 702, configured to execute a target operation according to the target information;

and a display module 703, configured to display the target operation result on the current interface.

Optionally, in an implementation manner, the obtaining module 701 is configured to trigger an operation control corresponding to the target information, and display at least one option included in the operation control; and receiving a trigger operation of a target option matched with the target information in at least one option, and acquiring the target information matched with the target option based on the content displayed on the current interface.

Optionally, in an implementation manner, the operation control includes a preset display window, and the display module 703 is configured to determine to obtain a target operation result corresponding to the target operation, and trigger to display the preset display window; and displaying the target operation result in a preset display window.

Optionally, in an implementation manner, the preset display window includes at least one tab, and the display module 703 is configured to display the target operation result on the tab corresponding to the target operation in the preset display window.

Optionally, in an implementation manner, the display module 703 is configured to receive a size adjustment operation and/or a position adjustment operation on a preset display window; and displaying a preset display window on the current interface according to the adjusted size and/or position, and displaying the target operation result in the adjusted preset display window.

Optionally, in an implementation manner, the display module 703 is configured to receive a switching operation on a preset display window, and reduce the preset display window to a floating icon; and displaying a floating icon at the edge of the current interface.

Optionally, in an implementation manner, the processing module 702 is configured to perform price comparison on the target item indicated in the target information to obtain a price comparison result of the target item, where the target operation result includes the price comparison result.

Optionally, in an implementation manner, the price comparison result includes at least one purchase link of the target item, and the display module 702 is configured to display a page corresponding to the purchase link according to a triggering operation on the purchase link.

Optionally, in an implementation manner, the processing module 702 is configured to obtain comment information, and add a comment to the target information according to the comment information to obtain a comment result, where the target operation result includes the comment result.

Optionally, in an implementation manner, the processing module 702 is configured to search the target information to obtain a search result corresponding to the target information, where the target operation result includes the search result.

Optionally, in an implementation manner, the processing module 702 is configured to translate the target information to obtain a translation result corresponding to the target information, where the target operation result includes the translation result.

Optionally, in an implementation manner, the processing module 702 is configured to convert the target information into an editable recording result, where the target operation result includes the editable recording result; and the display module 703 is configured to display the editable recording result on the current interface and display at least one editing tool option.

Optionally, in an implementation manner, the display module 703 is configured to trigger an operation control corresponding to the target information and display the capture frame; an obtaining module 701, configured to receive an adjustment operation on an intercept box; acquiring the content displayed on the current interface according to the adjusted interception frame to obtain acquired data;

and carrying out artificial intelligence recognition on the collected data, and acquiring target information according to a recognition result.

Optionally, in an implementation manner, the obtaining module 701 is configured to receive a size adjustment operation and/or a position adjustment operation on the capture frame, and perform image capture on a content area corresponding to the capture frame in the current interface to obtain the acquired data.

Optionally, in an implementation manner, the obtaining module 701 is configured to receive a length adjustment operation and/or a position adjustment operation on the capture frame, and perform audio capture on a content area corresponding to the capture frame in the current interface to obtain the collected data.

Optionally, in an implementation manner, the obtaining module 701 is configured to perform content region detection on content displayed in a current interface, and display an interception frame in a content region in the current interface; and according to the size adjustment operation and/or the position adjustment operation of the intercepting frame, carrying out image interception on the detected content area by using the adjusted intercepting frame to obtain the acquired data.

Optionally, in an implementation manner, the obtaining module 701 is configured to trigger an operation control corresponding to the target information, and capture a video frame in a video displayed on a current interface according to the triggered time to obtain the acquired data.

Optionally, in an implementation manner, the collected data includes collected image data, and the target information includes a text obtained after performing text recognition on the image data, or a target element obtained after performing target element recognition on the image data.

Optionally, in an implementation manner, the collected data includes collected audio data, and the target information includes audio key information obtained by extracting key information from the audio data, or text key information obtained by extracting key information from text after converting the audio data into text.

Optionally, in an implementation manner, the processing module 702 is configured to invoke a target application to which the operation control belongs to perform a target operation on the target information, so as to obtain a target operation result.

The data processing device provided by the embodiment of the invention triggers the operation control corresponding to the target information to acquire the target information displayed on the current interface; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to perform target operation, the information acquisition mode is more flexible, and more functions can be realized.

EXAMPLE six

With reference to the methods described in the first to fourth embodiments, a sixth embodiment of the present invention provides an electronic device, which is configured to execute the methods described in the first to fourth embodiments, and fig. 8 is a block diagram of the electronic device according to the sixth embodiment of the present invention.

As shown in fig. 8, the electronic device 80 may include: a processor (processor)802, a Communications Interface 804, a memory 806, and a communication bus 808.

Wherein:

the processor 802, communication interface 804, and memory 806 communicate with one another via a communication bus 808.

A communication interface 804 for communicating with other electronic devices, such as a terminal device or a server.

The processor 802 is configured to execute the program 810, and may specifically perform relevant steps in the above-described data processing method embodiments.

In particular, the program 810 may include program code comprising computer operating instructions.

The processor 802 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 806 stores a program 810. The memory 806 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 810 may be specifically configured to enable the processor 802 to execute the methods described in the foregoing first to fourth embodiments.

For specific implementation of each step in the program 810, reference may be made to corresponding steps and corresponding descriptions in units in the foregoing data processing method embodiments, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.

The electronic equipment provided by the embodiment of the invention triggers the operation control corresponding to the target information to acquire the target information displayed on the current interface; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to perform target operation, the information acquisition mode is more flexible, and more functions can be realized.

Example seven,

With reference to the methods described in the first to fourth embodiments, a seventh embodiment of the present invention provides a computer storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method described in any of the embodiments of the present invention.

When a stored computer program is executed, the computer storage medium triggers an operation control corresponding to target information to acquire the target information displayed on a current interface; executing target operation according to the target information; and displaying the target operation result on the current interface. By the embodiment of the invention, the equipment can acquire the target information displayed on the current interface to perform target operation, the information acquisition mode is more flexible, and more functions can be realized.

It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present invention may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present invention.

The above-described method according to an embodiment of the present invention may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein may be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware such as an ASIC or FPGA. It will be appreciated that the computer, processor, microprocessor controller or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the data processing methods described herein. Further, when a general-purpose computer accesses code for implementing the data processing method shown herein, execution of the code converts the general-purpose computer into a special-purpose computer for executing the data processing method shown herein.

Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.

The above embodiments are only for illustrating the embodiments of the present invention and not for limiting the embodiments of the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention, so that all equivalent technical solutions also belong to the scope of the embodiments of the present invention, and the scope of patent protection of the embodiments of the present invention should be defined by the claims.