阅读说明：本技术 一种多屏交互的方法、装置、系统、电子设备及存储介质 (Multi-screen interaction method, device and system, electronic equipment and storage medium ) 是由 黄斌 于 2021-08-11 设计创作，主要内容包括：本申请公开了一种多屏交互的方法、装置、系统、电子设备及存储介质,属于多设备互动技术领域。其中,一种多屏交互的方法,其特征在于,应用于第一设备,所述方法包括：获取交互指令；识别所述交互指令对应的指示参数,发送调取指令至所述指示参数对应的第二设备；其中,所述调取指令用于指示调取所述第二设备的实时屏幕界面；获取所述第二设备根据所述调取指令返回的实时屏幕界面数据,并根据所述实时屏幕界面数据显示所述第二设备的实时屏幕界面。可以在第一设备的屏幕上对第二设备进行控制,达到方便快捷实现多屏互动的效果,提升用户体验。(The application discloses a multi-screen interaction method, device and system, electronic equipment and a storage medium, and belongs to the technical field of multi-equipment interaction. The method for multi-screen interaction is applied to a first device, and comprises the following steps: acquiring an interactive instruction; identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment; and acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data. The second equipment can be controlled on the screen of the first equipment, the effect of conveniently and quickly realizing multi-screen interaction is achieved, and user experience is improved.)

1. A method for multi-screen interaction, which is applied to a first device, comprises the following steps:

acquiring an interactive instruction;

identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

and acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data.

2. A multi-screen interaction method as recited in claim 1, wherein the sending a call instruction to a second device corresponding to the indication parameter includes:

sending the indication parameter to a server, wherein the server stores a mapping relation between the indication parameter and the identification information of the second device; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; sending a calling instruction to the second equipment according to the identification information of the second equipment;

alternatively, the first and second electrodes may be,

acquiring a mapping relation between the locally stored indication parameter and the identification information of the second device; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; sending a calling instruction to the second equipment according to the identification information of the second equipment;

the identification information includes an access address or a device number.

3. A multi-screen interaction method as recited in claim 1 or claim 2, wherein prior to the sending of the invocation instruction to the second device corresponding to the indication parameter, the method further comprises:

determining whether a communication connection has been established with the second device;

and if not, establishing communication connection with the second equipment.

4. A method for multi-screen interaction according to claim 1, wherein the interaction instruction is an N-finger gesture instruction, and N is a natural number greater than or equal to 3.

5. A multi-screen interaction method as recited in claim 4, wherein the obtaining interaction instructions comprises:

acquiring at least one gesture instruction recognized within a preset time length;

and determining a gesture instruction which is obtained with the earliest and effective time in the at least one gesture instruction as the interaction instruction.

6. A method for multi-screen interaction as recited in claim 1, wherein the displaying the real-time screen interface of the second device comprises:

and displaying the real-time screen interface of the second equipment on a screen in a floating window mode.

7. A method for multi-screen interaction as recited in claim 6, wherein after the displaying the real-time screen interface of the second device in a floating window manner on the screen, the method further comprises:

when an operation instruction is not obtained within a preset time length, exiting the floating window; wherein the operation instruction is used for controlling the second device at the first device.

8. A method for multi-screen interaction as recited in claim 6, wherein after the displaying the real-time screen interface of the second device in a floating window manner on the screen, the method further comprises:

acquiring a switching instruction of multi-screen interaction; the switching instruction is generated after a calling instruction is sent to third equipment;

switching the content displayed by the floating window into a real-time screen interface of the third equipment; or, the screen of the first device is displayed in a split screen mode, the floating window of the real-time screen interface of the second device is displayed in the first split screen mode, and the floating window of the real-time screen interface of the third device is displayed in the second split screen mode.

9. A method for multi-screen interaction, which is applied to a second device, comprises the following steps:

acquiring a calling instruction sent by the first equipment, wherein the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

acquiring real-time screen interface data according to the calling instruction;

and transmitting the real-time screen interface data to the first equipment.

10. An apparatus for multi-screen interaction between devices, applied to a first device, the apparatus comprising:

the first acquisition module is used for acquiring an interactive instruction;

the sending module is used for identifying the indication parameters corresponding to the interactive instructions and sending the calling instructions to the second equipment corresponding to the indication parameters; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

and the second acquisition module is used for acquiring real-time screen interface data returned by the second equipment according to the calling instruction and displaying the real-time screen interface of the second equipment according to the real-time screen interface data.

11. A multi-screen interaction device applied to a second device, the device comprising:

the third obtaining module is used for obtaining a calling instruction sent by the first equipment, wherein the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

the fourth acquisition module is used for acquiring real-time screen interface data according to the calling instruction;

and the transmission module is used for transmitting the real-time screen interface data to the first equipment.

12. A system for multi-screen interaction, comprising a first device and a second device, the system comprising:

the first equipment is used for acquiring an interactive instruction; identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment; acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data;

the second device is used for acquiring a calling instruction sent by the first device, wherein the calling instruction is used for indicating to call a real-time screen interface of the second device; acquiring real-time screen interface data according to the calling instruction; and transmitting the real-time screen interface data to the first equipment.

13. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the steps of the method for multi-screen interaction of any one of claims 1-8 or claim 9 when executing a program stored in the memory.

14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for multi-screen interaction according to any one of claims 1-8 or claim 9.

Technical Field

The present application relates to the field of multi-device interaction technologies, and in particular, to a multi-screen interaction method, apparatus, system, electronic device, and storage medium.

Background

With the continuous improvement of living standard of people, various devices with screens are more and more widely applied, such as smart phones, large-screen refrigerators, air conditioners with screens and the like. In the use process, when different devices are adjusted, the devices need to be adjusted on the control screens of the devices independently, and the use is very inconvenient.

At present, when cross-screen resource sharing is realized, the existing interaction between multi-screen interaction products is complex in connection process, the interaction operation interface is complex, the use habit of a user is not met, and the user experience degree is poor.

Disclosure of Invention

In order to solve the problems of complex connection process, complex operation and poor user experience when multi-screen interaction is carried out between devices with screens, the application provides a multi-screen interaction method, a multi-screen interaction device, a multi-screen interaction system, electronic equipment and a storage medium.

In a first aspect, the present application provides a method for multi-screen interaction, which is applied to a first device, and the method includes:

acquiring an interactive instruction;

identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data;

further, the foregoing scheme further includes that the sending of the call instruction to the second device corresponding to the indication parameter includes:

sending the indication parameter to a server, wherein the server stores a mapping relation between the indication parameter and the identification information of the second device; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; sending a calling instruction to the second equipment according to the identification information of the second equipment;

alternatively, the first and second electrodes may be,

acquiring a mapping relation between the locally stored indication parameter and the identification information of the second device; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; sending a calling instruction to the second equipment according to the identification information of the second equipment;

the identification information comprises an access address or a device number;

further, before the sending the invoking instruction to the second device corresponding to the indication parameter, the method further includes:

determining whether a communication connection has been established with the second device;

if not, establishing communication connection with the second equipment;

further, the above scheme further includes that the interactive instruction is an N-finger gesture instruction, where N is a natural number greater than or equal to 3;

further, the above scheme further includes that the obtaining of the interactive instruction includes:

acquiring at least one gesture instruction recognized within a preset time length;

determining a gesture instruction which is earliest in time and effective in obtaining of the at least one gesture instruction as the interaction instruction;

further, the above scheme further includes that the displaying of the real-time screen interface of the second device includes:

displaying a real-time screen interface of the second device on a screen in a floating window mode;

further, after the displaying the real-time screen interface of the second device on the screen in a floating window manner, the method further includes:

when an operation instruction is not obtained within a preset time length, exiting the floating window; wherein the operating instruction is used for controlling the second device at the first device;

further, after the displaying the real-time screen interface of the second device on the screen in a floating window manner, the method further includes:

acquiring a switching instruction of multi-screen interaction; the switching instruction is generated after a calling instruction is sent to third equipment;

switching the content displayed by the floating window into a real-time screen interface of the third equipment; or, the screen of the first device is displayed in a split screen mode, the floating window of the real-time screen interface of the second device is displayed in the first split screen mode, and the floating window of the real-time screen interface of the third device is displayed in the second split screen mode.

In a second aspect, the present application provides a method for multi-screen interaction, which is applied to a second device, and the method includes:

acquiring a calling instruction sent by the first equipment, wherein the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

acquiring real-time screen interface data according to the calling instruction;

and transmitting the real-time screen interface data to the first equipment.

In a third aspect, the present application provides a multi-screen interaction apparatus, which is applied to a first device, and includes:

the first acquisition module is used for acquiring an interactive instruction;

the sending module is used for identifying the indication parameters corresponding to the interactive instructions and sending the calling instructions to the second equipment corresponding to the indication parameters; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

and the second acquisition module is used for acquiring real-time screen interface data returned by the second equipment according to the calling instruction and displaying the real-time screen interface of the second equipment according to the real-time screen interface data.

In a fourth aspect, the present application provides an apparatus for multi-screen interaction, which is applied to a second device, and the apparatus includes:

the third obtaining module is used for obtaining a calling instruction sent by the first equipment, wherein the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

the fourth acquisition module is used for acquiring real-time screen interface data according to the calling instruction;

and the transmission module is used for transmitting the real-time screen interface data to the first equipment.

In a fifth aspect, the present application provides a multi-screen interaction system, including a first device and a second device, where the first device and the second device establish a communication connection therebetween, and the system includes:

the first equipment is used for acquiring an interactive instruction; identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment; acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data;

the second device is used for acquiring a calling instruction sent by the first device, wherein the calling instruction is used for indicating to call a real-time screen interface of the second device; acquiring real-time screen interface data according to the calling instruction; and transmitting the real-time screen interface data to the first equipment.

In a sixth aspect, an electronic device is provided, which includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for implementing the steps of the multi-screen interaction method according to any one of the embodiments of the first aspect and the second aspect when executing the program stored in the memory.

In a seventh aspect, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, implements the steps of the method for multi-screen interaction according to any one of the embodiments of the first and second aspects.

Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:

according to the method provided by the embodiment of the application, first equipment acquires an interactive instruction; identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment; and acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data. Through sending the interactive instruction to first equipment, the real-time screen interface of second equipment is transferred, can control the second equipment on the screen of first equipment, reaches convenient and fast and realizes the interactive effect of many screens, promotes user experience.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

FIG. 1 is a system architecture diagram of a method for multi-screen interaction according to an embodiment of the present application;

fig. 2 is a flowchart illustrating a multi-screen interaction method according to an embodiment of the present application;

FIG. 3 is a schematic diagram illustrating a manipulation gesture and a corresponding execution of a pull-up screen in a multi-screen interaction method according to an embodiment of the present application;

fig. 4 is a schematic layout diagram of multiple devices in a multi-screen interaction method according to an embodiment of the present application;

FIG. 5 is a flowchart illustrating another multi-screen interaction method according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an apparatus for multi-screen interaction according to an embodiment of the present application;

FIG. 7 is a block diagram illustrating an exemplary multi-screen interactive apparatus according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

According to an aspect of the embodiments of the present application, a method for multi-screen interaction is provided, and the method may be applied to a system architecture as shown in fig. 1, where the system architecture includes at least a first device 101 and a second device 102.

The first device 101 acquires an interactive instruction;

the first equipment 101 identifies an indication parameter corresponding to the interactive instruction and sends a calling instruction to the second equipment 102 corresponding to the indication parameter; the calling instruction is used for instructing to call a real-time screen interface of the second device 102;

the first device 101 obtains real-time screen interface data returned by the second device 102 according to the call instruction, and displays a real-time screen interface of the second device 102 according to the real-time screen interface data.

In the system architecture, after the first device obtains the interaction instruction, the first device can interact with the second device.

Based on the system architecture, the embodiment of the multi-screen interaction method is described, and the method can be applied to the first device and also can be applied to the second device.

It should be noted that, the first device generally refers to a device that performs interaction on the device, and the second device generally refers to a device to be interacted with which the first device wants to perform interaction, where the first device and the second device described herein do not represent that the system architecture only includes two devices, but may include at least one first device and at least one second device. When a plurality of second devices exist, the second devices, the third devices, the fourth devices, and so on may be referred to, where the third devices and the fourth devices are only referred to differently, and the actual interaction process is the same as that of the second devices.

When applied to the first device, as shown in fig. 2, the multi-screen interaction method mainly includes:

step 201, an interactive instruction is obtained.

In this embodiment, the interactive instruction is obtained at the first device, and the interactive instruction may be any instruction different from the instruction for operating the first device itself. For example, the interactive instruction may be a gesture instruction with three or more fingers or a voice instruction, and when the first device is provided with the shooting device, the interactive instruction may also be an air gesture instruction.

In one embodiment, the interactive instruction is an N-finger gesture instruction, and N is a natural number greater than or equal to 3. In devices using gesture instructions, such as smart phones, single-finger gestures are generally used to select applications, slide screen interfaces, or perform certain functions, or double-finger gestures are used to zoom on a screen or within an application. In this embodiment, in order to distinguish the gesture instruction of the first device, the multi-screen interaction instruction with another device uses a three-finger gesture instruction or any other multi-finger gesture instruction larger than three fingers, so that various gesture instructions can be effectively distinguished.

The following example takes an interactive instruction as a three-finger gesture instruction:

there are multiple devices with screens in the room, including smart phones, air conditioners, water heaters, and refrigerators. The multi-screen interaction is carried out by conveniently and rapidly controlling a plurality of pieces of equipment with screens, for example, the functions of controlling an air conditioner, a water heater and a refrigerator are realized on a smart phone. At this time, a plurality of interactive instructions carrying indication parameters of the air conditioner, the water heater and the refrigerator need to be defined.

As shown in fig. 3, the three-finger gesture command is used to slide to the right side on the screen of the smart phone to represent that the screen of the air conditioner is pulled up on the screen of the smart phone, the switch of the air conditioner can be controlled on the screen of the smart phone, the temperature of the air conditioner can be adjusted, the wind direction of the air conditioner can be adjusted, the three-finger gesture command is used to slide downwards on the screen of the smart phone to represent that the screen of the water heater is pulled up on the screen of the smart phone, the switch of the water heater can be controlled on the screen of the smart phone, the set water temperature can be adjusted, and the three-finger gesture command is used to slide to the left side on the screen of the smart phone to represent that the screen of the refrigerator is pulled up on the screen of the smart phone, so that the function of controlling the refrigerator is realized. Of course, the three-finger gesture command is only an example, and may also be other multi-finger gesture commands larger than three fingers, and sliding to the left, the right, or downward is also only an example, and may also be sliding to other directions, sliding in the shape of some figures, characters, numbers, or letters to represent corresponding different devices, as long as they can be distinguished from each other.

In one embodiment, obtaining the interactive instructions comprises: acquiring at least one gesture instruction recognized within a preset time length; and determining a gesture instruction which is obtained at the earliest and effective time in at least one gesture instruction as an interaction instruction.

In this embodiment, for example, the interactive instruction is a three-finger gesture instruction, the obtained interactive instruction may have an invalid gesture instruction, and the invalid gesture instruction may interfere with a multi-screen interaction process, so that the invalid instruction needs to be eliminated. And obtaining a gesture instruction with the earliest time and effectiveness as an interactive instruction from at least one acquired gesture instruction, wherein the effectiveness is that relative to a three-finger gesture instruction, the gesture instruction is determined as a non-effective instruction when the recognized gesture instruction is a single-finger gesture or a two-finger gesture, and other gesture instructions are continuously recognized within a preset time length.

Step 202, identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; and the calling instruction is used for indicating to call the real-time screen interface of the second equipment.

In one embodiment, the process of determining the second device corresponding to the indication parameter may be divided into two cases, namely, storing the second device in the server and storing the second device locally in the first device.

A case that when judged in the server, sends a call instruction to a second device corresponding to the indication parameter, comprising: sending the indication parameter to a server, wherein the server stores a mapping relation between the indication parameter and the identification information of the second equipment; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; and sending a calling instruction to the second equipment according to the identification information of the second equipment.

In this case, a mapping relationship between the indication parameter and the identification information of the second device is stored in the server, for example, when the smartphone acquires the three-finger gesture instruction and the three-finger gesture instruction slides downwards, the three-finger gesture instruction sliding downwards is sent to the server, the identification information of the water heater corresponding to the downward-sliding control gesture is determined according to the mapping relationship between the three-finger gesture instruction stored in the server and the access address of the second device, an instruction for calling the real-time screen interface of the water heater is sent to the water heater, and the real-time screen interface of the water heater is called.

In another case, that is, when the determination is performed locally at the first device, the sending of the call instruction to the second device according to the indication parameter of the second device includes: acquiring a mapping relation between the locally stored indication parameter and the identification information of the second equipment; acquiring identification information of the second equipment corresponding to the indication parameter according to the mapping relation; and sending a calling instruction to the second equipment according to the identification information of the second equipment.

In this case, the mapping relationship between the indication parameter and the access address of the second device is locally stored in the first device, for example, when the smartphone acquires the three-finger gesture instruction, and the three-finger gesture instruction is a downward sliding instruction, in the mapping relationship between the three-finger gesture instruction locally stored in the smartphone and the access address of the second device, it is determined that the downward sliding operation gesture corresponds to the identification information of the water heater, and an instruction for calling the real-time screen interface of the water heater is sent to the water heater, so as to call the real-time screen interface of the water heater.

In both cases, the identification information of the second device includes an access address or a device number. In the above two cases, the three-finger gesture command and the downward sliding track are used only for illustration, which does not represent that only this way is adopted in the embodiment, and other multi-finger gesture commands and gesture commands with other shapes or tracks may also be used.

In one embodiment, before sending the call instruction to the second device corresponding to the indication parameter, the method further includes: determining whether a communication connection has been established with a second device; and if not, establishing communication connection with the second equipment. In this embodiment, before the first device sends the call instruction, it is determined whether a communication connection is established with the second device, if the communication connection is already established, the call instruction is sent to the second device, and if the connection is not established, the communication connection is established first and then the call instruction is sent.

And 203, acquiring the real-time screen interface returned by the second equipment according to the calling instruction, and displaying the real-time screen interface of the second equipment according to the real-time screen interface data.

In one embodiment, displaying a real-time screen interface of a second device includes: and displaying the real-time screen interface of the second device on the screen in a floating window mode.

In this embodiment, when the real-time screen interface of the second device is displayed on the first device, the real-time screen interface is displayed on the screen of the first device in a suspension window manner, in the generated suspension window, touch operation can be performed on the second device, the purpose of directly controlling the second device on the first screen is achieved, a user does not need to walk to the corresponding device respectively, only a plurality of other devices can be conveniently and quickly controlled on the first device such as a mobile phone, and the problems of inconvenience and poor experience during multi-screen interaction are solved. The display is performed in a floating window mode, so that different applications can be opened when the first equipment performs multi-screen interaction, and the normal use of the functions of the first equipment is not influenced. It should be noted that, during multi-screen interaction, one floating window may be set, and multi-screen interaction is performed on one device each time, or multiple floating windows may be set, and multi-screen interaction is performed on multiple devices simultaneously.

In one embodiment, after displaying the real-time screen interface of the second device in a floating window manner on the screen, the method further comprises: when the operation instruction is not obtained within the preset duration, exiting the floating window; the operation instruction is used for controlling the second equipment at the first equipment.

In this embodiment, a preset duration is set, when the preset duration is exceeded and no operation instruction of the user is obtained, the default user does not need to perform multi-screen interaction, the suspension window is automatically withdrawn, the operation steps of the user can be reduced, the use is convenient, the experience of the user during multi-screen interaction is improved, wherein the preset duration can be preset to a value, and the user can also perform self-defined modification on the preset duration according to own use habits.

In one embodiment, after displaying the real-time screen interface of the second device in a floating window manner on the screen, the method further comprises: acquiring a switching instruction of multi-screen interaction; the switching instruction is generated after a calling instruction is sent to the third equipment according to the indication parameter of the third equipment; switching the content displayed by the floating window into a real-time screen interface of the third equipment; or, the screen of the first device is displayed in a split screen mode; and displaying the floating window of the real-time screen interface of the second device on the first split screen, and displaying the floating window of the real-time screen interface of the third device on the second split screen.

In this embodiment, when the first device sets a floating window for multi-screen interaction, for example, the user has called the real-time screen interface of the air conditioner through the gesture instruction, after the air conditioner is adjusted, the water heater needs to be interacted with, at this time, the floating window interface of the air conditioner does not need to be closed, but the gesture instruction for calling the water heater is directly input, and the floating window containing the real-time screen interface of the air conditioner can be directly switched to the floating window containing the real-time screen interface of the water heater, so that the tedious operation steps during multi-screen interaction of the user can be reduced, and the experience of the user during multi-screen interaction is improved.

When the first device is provided with a plurality of floating windows for multi-screen interaction, for example, a user wants to adjust the air conditioner and the water heater through a smart phone, at this time, the user does not need to adjust one of the air conditioner and the water heater, but can directly input gesture instructions for adjusting the air conditioner and the water heater on the screen of the smart phone respectively. Under the condition, after the smart phone calls the floating window containing the real-time screen interface of the air conditioner, the gesture instruction for calling the water heater is received, at the moment, the smart phone displays the screen of the smart phone in a split mode, displays the floating window containing the real-time screen interface of the air conditioner on the first split screen, and displays the floating window containing the real-time screen interface of the water heater on the second split screen. The convenience of customers is operated water heater and air conditioner simultaneously, saves time, reduces the operating procedure, promotes the experience of user's many screen interaction use. It should be noted that, the split-screen display here is exemplified by controlling two devices simultaneously, and does not represent that only two split screens are available, nor represents that only two devices are available, the number of split screens may also be other values greater than two, and the split-screen display may be matched and displayed according to the number of devices that are controlled simultaneously.

In an embodiment, as shown in fig. 4, while a mapping relationship between an indication parameter stored in a server or a first device and identification information of a second device is stored, a spatial position relationship between the devices is also stored, when it is detected that multi-screen interaction is required, for example, when the first device obtains an interaction instruction, the spatial position relationship is displayed on the first device, and a user may display a real-time screen interface of the second device in a floating window of the first device by sliding the second device to the first device on a displayed diagram of the spatial position relationship. For example, in a spatial position relationship diagram displayed on a smartphone, the screen of the water heater is slid downwards to the screen of the smartphone to represent that a user wants to display a real-time screen interface of the water heater on the screen of the smartphone and operate the water heater, and at this time, the real-time screen interface of the water heater is displayed in the screen of the smartphone in a form of a floating window. The method is more intuitive and easy to operate, and the experience of the user in multi-screen interaction is improved.

In another aspect of the embodiments of the present application, as applied to a second device, as shown in fig. 5, the method includes:

step 501, a calling instruction sent by first equipment is obtained, wherein the calling instruction is used for indicating to call a real-time screen interface of second equipment;

step 502, acquiring real-time screen interface data according to a calling instruction;

step 503, transmitting the real-time screen interface data to the first device.

In this embodiment, after the call instruction is obtained, the multi-screen interaction mode is entered, and the real-time screen interface of the second device is displayed on the first device in a mirror image manner. By means of mirror image display, the state of the second device can be checked and interacted with in the first device, and the current state of the second device can be visually checked at the second device end.

Based on the same concept, an embodiment of the present application further provides a multi-screen interaction apparatus, as shown in fig. 6, applied to a first device, including:

a first obtaining module 601, configured to obtain an interactive instruction;

a sending module 602, configured to identify an indication parameter corresponding to the interactive instruction, and send a call instruction to a second device corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

the second obtaining module 603 is configured to obtain real-time screen interface data returned by the second device according to the call instruction, and display a real-time screen interface of the second device according to the real-time screen interface data.

Through being applied to the many screen interaction device of first equipment, can convenient and fast realize many screen interactions with the second equipment, show the real-time screen interface of second equipment on the screen of first equipment, promote user experience.

An embodiment of the present application further provides another multi-screen interaction apparatus, as shown in fig. 7, which is applied to a second device, and includes:

a third obtaining module 701, configured to obtain a call instruction sent by the first device, where the call instruction is used to instruct to call a real-time screen interface of the second device;

a fourth obtaining module 702, configured to obtain real-time screen interface data according to the call instruction;

the transmission module 703 is configured to transmit the real-time screen interface data to the first device.

As shown in fig. 8, an embodiment of the present application provides an electronic device, which includes a processor 111, a communication interface 112, a memory 113, and a communication bus 114, where the processor 111, the communication interface 112, and the memory 113 complete mutual communication through the communication bus 114,

a memory 113 for storing a computer program;

in an embodiment of the present application, when the processor 111 is configured to execute the program stored in the memory 113, the method for implementing multi-screen interaction provided in any one of the foregoing method embodiments is applied to a first device, and includes:

acquiring an interactive instruction;

identifying an indication parameter corresponding to the interactive instruction, and sending a calling instruction to second equipment corresponding to the indication parameter; the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

and acquiring real-time screen interface data returned by the second equipment according to the calling instruction, and displaying a real-time screen interface of the second equipment according to the real-time screen interface data.

Or, applied to a second device, comprising:

acquiring a calling instruction sent by the first equipment, wherein the calling instruction is used for indicating to call a real-time screen interface of the second equipment;

acquiring real-time screen interface data according to the calling instruction;

and transmitting the real-time screen interface data to the first equipment.

The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the terminal and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

The present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method for multi-screen interaction provided in any one of the foregoing method embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.