阅读说明：本技术 显示设备、终端设备及通信连接方法 (Display device, terminal device and communication connection method ) 是由 朱子鸣 商潮 于 2021-08-05 设计创作，主要内容包括：本申请公开了一种显示设备、终端设备及通信连接方法。当检测到显示设备与终端设备建立通信连接时,响应于显示设备的设备信息的变更,显示设备可以将网络信息发送至终端设备,以使终端设备根据网络信息生成设备信息获取请求；响应于终端设备发送的设备信息获取请求,将变更后的设备信息发送至终端设备,并与终端设备重新建立通信连接。因此,显示设备可以主动和终端设备再次进行通信连接,不需要终端设备主动发送通信连接请求的过程,提高了显示设备和终端设备进行通信连接的智能化程度,提高了用户的体验性。还可以保证显示设备和终端设备的通信连接不会失效,用户可以通过终端设备控制显示设备,进一步提高了用户的体验性。(The application discloses a display device, a terminal device and a communication connection method. When the display device is detected to be in communication connection with the terminal device, the display device can send the network information to the terminal device in response to the change of the device information of the display device, so that the terminal device generates a device information acquisition request according to the network information; and responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment, and reestablishing communication connection with the terminal equipment. Therefore, the display device can be actively in communication connection with the terminal device again, the process that the terminal device actively sends a communication connection request is not needed, the intelligent degree of the communication connection between the display device and the terminal device is improved, and the user experience is improved. The communication connection between the display device and the terminal device can be guaranteed not to be invalid, the user can control the display device through the terminal device, and the user experience is further improved.)

1. A display device, comprising:

a display;

a communicator configured to receive information input by a terminal device;

a controller configured to:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of the equipment information of the display equipment, and sending the network information of the display equipment to the terminal equipment so that the terminal equipment generates an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring the changed equipment information of the display equipment;

and responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment, and reestablishing communication connection with the terminal equipment.

2. The display device according to claim 1, wherein before performing the step of transmitting the network information of the display device to the terminal device in response to the change of the device information of the display device, the controller is further configured to:

acquiring a communication connection request sent by terminal equipment to a network;

responding to the communication connection request, and sending network information of the display equipment to the terminal equipment;

receiving a first acquisition request sent by terminal equipment, wherein the first acquisition request is used for acquiring equipment information of display equipment;

and sending the equipment information of the display equipment to the terminal equipment, and establishing communication connection with the terminal equipment.

3. The display device according to claim 2, wherein before the step of receiving the first acquisition request sent by the terminal device is performed, the controller is further configured to:

and responding to the communication connection request, and sending the physical address of the display equipment to the terminal equipment so that the terminal equipment generates a first acquisition request according to the network information and the physical address.

4. The display device of claim 3, wherein the controller is further configured to:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of a physical address and network information of the display equipment, and sending the changed network information and the changed physical address to the terminal equipment so that the terminal equipment generates a second acquisition request according to the changed network information and the changed physical address, wherein the second acquisition request is used for acquiring the current equipment information of the display equipment;

and responding to a second acquisition request sent by the terminal equipment, sending the current equipment information of the display equipment to the terminal equipment, and reestablishing communication connection with the terminal equipment.

5. The display device according to claim 2, wherein before the step of receiving the first acquisition request sent by the terminal device is performed, the controller is further configured to:

responding to the communication connection request, sending the awakening information of the display equipment to the terminal equipment so that the terminal equipment generates an awakening instruction according to the awakening information; the awakening information comprises a physical address and awakening time of the display equipment, and the awakening time is the time for the display equipment to enter a working state from a standby state;

and responding to a wake-up instruction sent by the terminal equipment, and controlling the display equipment to enter a working state from a standby state.

6. The display device of claim 1, wherein the controller is further configured to:

when the display equipment is detected to be in communication connection with the terminal equipment, storing equipment information of the terminal equipment into a communication connection list;

in the step of performing transmission of the network information of the display device to the terminal device in response to the change of the device information of the display device, the server is further configured to:

determining all terminal devices in the communication connection list;

and sending the network information of the display device to all the terminal devices.

7. The display device according to claim 6, wherein before the step of determining all terminal devices in the communication connection list is performed, the controller is further configured to:

when the display device is detected to be in communication connection with the terminal device, if the terminal device and the display device do not perform information interaction in a preset communication connection period, deleting the device information of the terminal device from the communication connection list.

8. A terminal device, characterized in that the terminal device is configured to:

when the communication connection between the display equipment and the terminal equipment is detected, responding to network information sent by the display equipment, and generating an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring equipment information after the display equipment is changed;

and receiving the changed equipment information sent by the display equipment.

9. The terminal device according to claim 8, wherein before performing the step of generating a device information acquisition request from the network information in response to the network information sent by the display device, the terminal device is further configured to:

sending a communication connection request to a network;

responding to network information sent by display equipment, and generating a first acquisition request according to the network information, wherein the first acquisition request is used for acquiring equipment information of the display equipment;

and receiving the equipment information sent by the display equipment.

10. A communication connection method is applied to a display device, and is characterized by comprising the following steps:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of the equipment information of the display equipment, and sending the network information of the display equipment to the terminal equipment so that the terminal equipment generates an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring the changed equipment information of the display equipment;

and responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment, and reestablishing communication connection with the terminal equipment.

Technical Field

The present application relates to the field of display device technologies, and in particular, to a display device, a terminal device, and a communication connection method.

Background

With the rapid development of artificial intelligence technology and the continuous improvement of living standard of people, people have higher and higher intelligent demands on display equipment, and the display equipment can integrate functions such as audio and video, games and the like through the internet technology. The user can also use the terminal equipment and the display equipment to carry out communication connection, so that the interaction between the terminal equipment and the display equipment is realized.

Before the terminal equipment and the display equipment are in communication connection, identity verification can be carried out, and when the identity verification is passed, the display equipment can allow the terminal equipment to be in communication connection. The terminal equipment can carry out information interaction with the display equipment, and a user can control the display equipment through the terminal equipment, so that functions such as screen projection and the like are realized. When the screen projection function is used, a user can check all display devices in the current communication connection of the terminal device in a screen projection list of the terminal device and control a target display device to realize the screen projection function. The user can also change some information of the display device, such as the name, etc., thereby ensuring that the screen projection function can be implemented in the target display device.

However, the inventors of the present application have found that when information of the display device is changed, the communication connection between the display device and the terminal device may fail. The original name of the display device is displayed in the screen projection list of the terminal device, and a user cannot control the display device through the terminal device, so that the user experience is poor.

Disclosure of Invention

The application provides a display device, a terminal device and a communication connection method. The problem that in an existing display device, when information of the display device is changed, a user cannot control the display device through a terminal device, and accordingly experience of the user is poor is solved.

In a first aspect, the present application provides a display device comprising a display, a communicator, and a controller. Wherein the communicator is configured to receive information input by the terminal device; the controller is configured to perform the steps of:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of the equipment information of the display equipment, and sending the network information of the display equipment to the terminal equipment so that the terminal equipment generates an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring the changed equipment information of the display equipment; and responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment, and reestablishing communication connection with the terminal equipment.

In some implementations, the controller is further configured to:

acquiring a communication connection request sent by terminal equipment to a network; responding to the communication connection request, and sending network information of the display equipment to the terminal equipment; receiving a first acquisition request sent by terminal equipment, wherein the first acquisition request is used for acquiring equipment information of display equipment; and sending the equipment information of the display equipment to the terminal equipment, and establishing communication connection with the terminal equipment.

In some implementations, the controller is further configured to:

and responding to the communication connection request, and sending the physical address of the display equipment to the terminal equipment so that the terminal equipment generates a first acquisition request according to the network information and the physical address.

In some implementations, the controller is further configured to:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of a physical address and network information of the display equipment, and sending the changed network information and the changed physical address to the terminal equipment so that the terminal equipment generates a second acquisition request according to the changed network information and the changed physical address, wherein the second acquisition request is used for acquiring the current equipment information of the display equipment; and responding to a second acquisition request sent by the terminal equipment, sending the current equipment information of the display equipment to the terminal equipment, and reestablishing communication connection with the terminal equipment.

In some implementations, the controller is further configured to:

responding to the communication connection request, sending the awakening information of the display equipment to the terminal equipment so that the terminal equipment generates an awakening instruction according to the awakening information; the awakening information comprises a physical address and awakening time of the display equipment, and the awakening time is the time for the display equipment to enter a working state from a standby state; and responding to a wake-up instruction sent by the terminal equipment, and controlling the display equipment to enter a working state from a standby state.

In some implementations, the controller is further configured to:

and when the display equipment is detected to establish communication connection with the terminal equipment, storing the equipment information of the terminal equipment into a communication connection list.

In some implementations, the server is further configured to:

determining all terminal devices in the communication connection list; and sending the network information of the display device to all the terminal devices.

In some implementations, the controller is further configured to:

when the display device is detected to be in communication connection with the terminal device, if the terminal device and the display device do not perform information interaction in a preset communication connection period, deleting the device information of the terminal device from the communication connection list.

In a second aspect, the present application provides a terminal device configured to:

when the communication connection between the display equipment and the terminal equipment is detected, responding to network information sent by the display equipment, and generating an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring equipment information after the display equipment is changed; and receiving the changed equipment information sent by the display equipment.

In some implementations, the terminal device is further configured to:

sending a communication connection request to a network; responding to network information sent by display equipment, and generating a first acquisition request according to the network information, wherein the first acquisition request is used for acquiring equipment information of the display equipment; and receiving the equipment information sent by the display equipment.

In a third aspect, the present application provides a communication connection method applied to a display device, including:

when the communication connection between the display equipment and the terminal equipment is detected, responding to the change of the equipment information of the display equipment, and sending the network information of the display equipment to the terminal equipment so that the terminal equipment generates an equipment information acquisition request according to the network information, wherein the equipment information acquisition request is used for acquiring the changed equipment information of the display equipment; and responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment, and reestablishing communication connection with the terminal equipment.

According to the technical scheme, when some information of the display equipment is changed, the display equipment can send the changed information to the terminal equipment, so that the display equipment and the terminal equipment are in communication connection again. The display device can be actively in communication connection with the terminal device again, the process that the terminal device actively sends a communication connection request is not needed, namely, the display device and the terminal device are not needed to be manually connected, the intelligent degree of the communication connection between the display device and the terminal device is improved, and the user experience is improved. Meanwhile, due to the fact that the display device actively conducts the reconnection process, the fact that communication connection between the display device and the terminal device cannot fail can be guaranteed, a user can control the display device through the terminal device, and user experience is further improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 shows a schematic diagram of a user interface in some embodiments;

FIG. 6 illustrates a flow diagram for a display device and a terminal device to communicatively couple in some embodiments;

FIG. 7 is a diagram illustrating a list of display devices in a terminal device in some embodiments;

FIG. 8 is a schematic diagram illustrating the display of reconnect mode confirmation information in the display in some embodiments;

FIG. 9 is an interaction flow diagram that illustrates a display device and a terminal device resuming communication when device information changes in some embodiments;

FIG. 10 is an interaction flow diagram that illustrates a display device and a terminal device resuming communication when a network connectivity is changed in some embodiments;

FIG. 11 illustrates a flow diagram for interaction between a display device and a terminal device in some embodiments;

FIG. 12 illustrates a flow diagram for interaction between a display device and a terminal device in some embodiments;

fig. 13 is a flowchart illustrating an embodiment of a communication connection method provided in the present application;

fig. 14 is a flowchart illustrating a communication connection method according to another embodiment of the present application.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence of any particular one, Unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

As shown in fig. 4, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

As shown in fig. 4, the system of the display device is divided into three layers, i.e., an application layer, a middleware layer and a hardware layer from top to bottom.

The Application layer mainly includes common applications on the television and an Application Framework (Application Framework), wherein the common applications are mainly applications developed based on the Browser, such as: HTML5 APPs; and Native APPs (Native APPs);

an Application Framework (Application Framework) is a complete program model, and has all basic functions required by standard Application software, such as: file access, data exchange, and interfaces to use these functions (toolbars, status lists, menus, dialog boxes).

Native APPs (Native APPs) may support online or offline, message push, or local resource access.

The middleware layer comprises various television protocols, multimedia protocols, system components and other middleware. The middleware can use basic service (function) provided by system software to connect each part of an application system or different applications on a network, and can achieve the purposes of resource sharing and function sharing.

The hardware layer mainly comprises an HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for butting all the television chips, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

When the screen projection function is used, a user can check all display devices in the current communication connection of the terminal device in a screen projection list of the terminal device and control a target display device to realize the screen projection function. The user can also change some information of the display device, such as the name, etc., thereby ensuring that the screen projection function can be implemented in the target display device. However, when the information of the display device is changed, the communication connection between the display device and the terminal device may fail. The original name of the display device is displayed in the screen projection list of the terminal device, and a user cannot control the display device through the terminal device, so that the user experience is poor.

In order to solve the technical problem, an embodiment of the present application provides a display device and a terminal device. Wherein the display device includes a display, a communicator, and a controller. The display is configured to display a user interface; the communicator is configured to receive information input by the terminal device. The terminal device may be a mobile terminal, a notebook computer or a tablet computer.

The terminal device may transmit a communication connection request to the display device to make the terminal device and the display device perform communication connection. After the terminal device and the display device are in communication connection, communication interaction can be performed, for example, a user can control the terminal device to download some media resource from the display device, and can also upload the media resource in the terminal device to the display device for playing.

In some embodiments, the display device may be provided with a communication mode.

When the communication mode is closed, the display device does not receive the communication connection request transmitted by the terminal device. At the moment, the display device does not allow the terminal device to carry out communication connection, and at the moment, the display device does not carry out information interaction with any terminal device.

When the communication mode is started, the display device receives a communication connection request sent by the terminal device. At this time, the display device may allow the terminal device and the display device to perform communication connection, thereby implementing information interaction. The user may input a communication mode on command to the display device, and when the controller receives the communication mode on command, the display device may be controlled to enter a communication mode.

In some embodiments, the user may transmit a communication mode on instruction to the display device by operating a designated key of the remote controller. And binding the corresponding relation between the communication mode opening instruction and the remote controller key in advance in the actual application process. For example, a communication mode key is provided on the remote controller, and when the user touches the communication mode key, the remote controller may send a communication mode start instruction to the controller, and at this time, the controller controls the display device to enter a communication mode. When the user touches the key again, the controller may control the display device to exit the communication mode.

A communication mode option may also be set in the UI interface of the display device, and when the user clicks on the option, the display device may be controlled to enter or exit the communication mode.

In some embodiments, when the display device is in the communication mode, an authentication mode may be further set in consideration of security. When the identity authentication mode is closed, the display device does not perform identity authentication on the terminal device, and at the moment, the terminal device can be directly in communication connection with the display device. That is, when the terminal device transmits a communication connection request to the display device, the display device may perform communication connection directly with the terminal device without authenticating the communication connection request.

When the identity authentication mode is started, the display equipment can carry out identity authentication on the terminal equipment. Namely, when the display device receives the communication connection request sent by the terminal device, the communication connection request is verified, and when the verification is passed, the communication connection request is allowed, so that the communication connection is carried out with the terminal device.

FIG. 5 illustrates a schematic diagram of a user interface in some embodiments. When the user selects to turn on the communication mode, the user can further select to turn on the identity authentication mode or turn off the identity authentication mode.

Fig. 6 illustrates a flow diagram for communicatively coupling a display device and a terminal device in some embodiments.

In some embodiments, the terminal device may be communicatively interactive with the display device when the display device is in the communication mode. The terminal device needs to send a communication connection request to the display device, and the display device can further determine whether to perform communication connection with the terminal device. For example, when a user wants to use a screen projection function, a screen projection request can be sent by using a terminal device, so that the display device and the terminal device are in communication connection to realize screen projection.

In some embodiments, the terminal device and the display device may be communicatively connected based on DIAL protocol to enable communication interaction, such as to enable a screen projection function. The DIAL Server in the display device can realize the function of the DIAL Server; the terminal device may be installed with applications supporting the DIAL protocol, such as YouTube, Netflix, etc., and the DIAL Client among these applications may implement the functions of the DIAL Client. The communication interaction between the display device and the terminal device can be realized through the interaction between the DIAL Server and the DIAL Client. The user can use the application program in the terminal equipment to realize the screen projection function.

In some embodiments, the terminal device may send a communication connection request to the display device. For example, when the user wants to use the screen projection function, the user may open a related application program, such as YouTube, in the terminal device, and may send a screen projection request to the display device through the application program.

In some embodiments, the terminal device may send a Search instruction (M-Search multicast request) to the network, and specifically may send the Search instruction to a multicast address of the local area network, for example, the multicast address may be 239.255.255.250.

All the devices in the local area network can receive the search instruction through the multicast address, that is, the display device can acquire the search instruction from the multicast address. When the display device acquires the search instruction, it may be considered that the terminal device has sent the communication connection request.

After receiving the communication connection request, the controller may determine the network information of the display device first, and then transmit the network information of the display device to the terminal device. For example, the controller may transmit a Location URL (uniform resource locator) of the display device to the terminal device, and the IP address of the display device may be included in the UPL.

In some embodiments, the controller may further determine a physical address (i.e., a MAC address) of the display device, and send the physical address of the display device to the terminal device, where the MAC address is used to identify a network card of the display device.

In some embodiments, after receiving the network information and the physical address sent by the display device, the terminal device may generate the first obtaining request according to the network information and the physical address. The first obtaining request is used for obtaining the equipment information of the display equipment. Further, the first acquisition request may be sent to the display device.

In some embodiments, the controller may transmit the device information of the display device to the terminal device after receiving the first acquisition request. At this time, the controller may allow the terminal device to transmit a communication connection request, that is, allow the terminal device and the display device to perform communication interaction. Further, the display device may establish a communication connection with the terminal device.

The device information of the display device may include a display device name, a brand name, and a model name. The name of the display device is used for enabling the terminal device to distinguish the display device from other display devices which may exist, and the name can be set by a user or set according to a preset rule. The brand name and the model name are factory parameters of the display device, and are generally fixed names.

After the display device and the terminal device establish communication connection, communication interaction can be carried out between the display device and the terminal device, and the terminal device can send image data to the display device and achieve a screen projection function.

In some embodiments, the controller may further transmit wake-up information of the display device to the terminal device after receiving the communication connection request. Specifically, the wake-up information of the display device may include a physical address and a wake-up time of the display device. The wake-up time refers to a time taken for the display apparatus to enter an operating state from a standby state, and specifically, a time taken for preparation work performed for the display apparatus to enter the operating state.

At this time, the controller may package the network information and the wake-up information of the display device to the terminal device. For example, the controller may send a UDP message packet to the end device, where the UDP message includes the network information and the wake-up information of the display device.

In some embodiments, after receiving the wake-up information sent by the display device, the terminal device may generate a wake-up instruction, where the wake-up instruction is used to control the display device to enter a working state from a standby state. Specifically, the terminal device may generate the wake-up instruction according to a physical address, i.e., an MAC address, of the display device.

The terminal device may send the wake-up instruction to the display device. After receiving the wake-up instruction, the controller can control the display device to enter a working state from a standby state so as to realize functions such as screen projection and the like.

In some embodiments, when the display device is in a standby state or a sleep state, the display device itself does not work, but the network card of the display device is still in a power-on state where it can receive data packets.

Therefore, based on the MAC address, the mobile terminal can adopt a WOW (Wake on WLAN) or WOL (Wake on LAN) method to send a corresponding Wake-up instruction to the display device so as to Wake up the display device. More specifically, the mobile terminal may send a wakeup data packet (or referred to as a magic data packet) to the display device based on the obtained MAC address, and the network card of the display device may wake up the display device after receiving the wakeup data packet. At this time, the display apparatus may enter an operating state from a standby state.

In some embodiments, after the display device and the terminal device establish the communication connection, a display device list may be displayed in the terminal device, where the display device list includes names of all display devices for which the terminal device has currently established the communication connection. Fig. 7 is a diagram illustrating a list of display devices in a terminal device in some embodiments.

The user may click on a display device from the list of display devices as the target display device. At this time, the terminal device may send the image data to the target display device, so as to play the image data in the target display device, thereby implementing the screen projection function.

In some embodiments, the user may make changes to some information of the display device. For example, the user may change the name of the display device so that the display device is distinguished from other display devices, so that the user may identify the display device in the list of display devices. However, when the display device name is changed, the original display device name is still displayed in the display device list, and in this case, when the user clicks the original display device name, the display device cannot be controlled.

For another example, the user may change the network connection mode of the display device, specifically, change the network of the display device from a wired connection state to a wireless connection state. At this time, a path of the communication connection between the display device and the terminal device may fail, and when the user clicks the display device in the display device list, the user cannot control the display device.

In some embodiments, the display device has a reconnection function, and can perform communication connection with the terminal device again. Specifically, the display device may set a reconnection mode. In the reconnection mode, when it is detected that some information of the display apparatus is changed, the display apparatus may automatically transmit the changed information to the terminal apparatus and perform communication connection again.

In some embodiments, the user may send a reconnect mode instruction to the display device by operating a designated key of the remote control. And binding the corresponding relation between the reconnection mode instruction and the remote controller key in advance in the actual application process. For example, a reconnection mode key is arranged on the remote controller, when a user touches the reconnection mode key, the remote controller sends a reconnection mode instruction to the controller, and the controller controls the display device to enter a reconnection mode. When the user touches the key again, the controller may control the display device to exit the reconnection mode.

In some embodiments, the corresponding relationship between the reconnection mode instruction and the plurality of remote controller keys may also be bound in advance, and when the user touches the plurality of keys bound to the reconnection mode instruction, the remote controller sends the reconnection mode instruction. In a feasible embodiment, the keys bound by the reconnect mode command are sequentially direction keys (left, down, left, down), that is, when the user continuously touches the keys (left, down, left, down) within a preset time, the remote controller sends the reconnect mode command to the controller. By adopting the binding method, the reconnection mode instruction can be prevented from being sent out due to misoperation of a user. The embodiments of the present application are merely exemplary in providing several binding relationships between the reconnection mode instruction and the key, and the binding relationship between the reconnection mode instruction and the key may be set according to the habit of the user in the actual application process, which is not limited herein.

In some embodiments, the user may send a reconnect mode instruction to the display device by way of voice input using a sound collector of the display device, such as a microphone, to control the display device to enter a reconnect mode. An intelligent voice system can be arranged in the display device, and the intelligent voice system can recognize the voice of the user so as to extract the instruction content input by the user. The user can input a preset awakening word through the microphone so as to start the intelligent voice system, and the controller can respond to the instruction input by the user. And a reconnection mode instruction is input within a certain time, so that the display device enters a reconnection mode. For example, the user may enter "something classmate" to activate the intelligent speech system. And inputting 'enter reconnection mode', and sending a reconnection mode instruction to the display equipment.

In some embodiments, the user may also send a reconnect mode instruction to the display device through a preset gesture. The display device may detect the user's behavior through an image collector, such as a camera. When the user makes a preset gesture, it may be considered that the user has sent a reconnection mode instruction to the display device. For example, it can be set as: when the V-word is detected to be scribed by the user, the user is determined to input a reconnection mode instruction to the display device. The user may also send a reconnect mode command to the display device through a preset action. For example, it can be set as: when it is detected that the user lifts the left foot and the right hand at the same time, it is determined that the user inputs a reconnection mode instruction to the display device.

In some embodiments, when the user controls the display device using the smart device, for example using a cell phone, a reconnect mode instruction may also be sent to the display device. In the process of practical application, a control can be set in the mobile phone, whether the mobile phone enters the reconnection mode can be selected through the control, and therefore a reconnection mode instruction is sent to the controller, and at the moment, the controller can control the display equipment to enter the reconnection mode.

In some embodiments, when the user controls the display device using the cell phone, a continuous click command may be issued to the cell phone. The continuous click command refers to: in a preset period, the number of times that a user clicks the same area of the mobile phone touch screen exceeds a preset threshold value. For example: when the user continuously clicks a certain area of the mobile phone touch screen for 3 times within 1s, the user is regarded as a continuous clicking instruction. After receiving the continuous click command, the mobile phone can send a reconnection mode command to the display device, so that the controller controls the display device to enter a reconnection mode.

In some embodiments, when the user uses the mobile phone to control the display device, the following may also be set: when detecting that a touch pressure value of a certain area of the mobile phone touch screen by a user exceeds a preset pressure threshold, the mobile phone can send a reconnection mode instruction to the display device.

A reconnect mode option may also be set in the UI interface of the display device, and when the user clicks on the option, the display device may be controlled to enter or exit the reconnect mode.

In some embodiments, to prevent the user from triggering the reconnection mode by mistake, when the controller receives the reconnection mode instruction, the controller may control the display to display reconnection mode confirmation information, so that the user performs secondary confirmation to determine whether to control the display device to enter the reconnection mode. Fig. 8 illustrates a schematic diagram of displaying reconnection mode confirmation information in a display in some embodiments.

When the display device enters the reconnection mode, if some information of the display device, such as the name of the display device, is detected to be changed, the display device may automatically send the changed information to the terminal device, so that the terminal device and the display device are in communication connection again.

In some embodiments, when the display device and the terminal device have established a communication connection and the display device is in a reconnection mode, if some information of the display device is detected to be changed, the controller may transmit the changed information to the terminal device.

Fig. 9 is an interaction flow diagram illustrating a display device and a terminal device resuming communication connection when device information is changed in some embodiments.

When the user changes the name of the display device, that is, when the device information of the display device is changed, the controller may transmit the network information of the display device to the terminal device.

When the name of the display device is changed, the network information and the physical address of the display device are not changed. Therefore, the network information sent by the display device at this time is already sent at the stage of establishing the communication connection between the terminal device and the display device, that is, the terminal device already stores the network information. The terminal device receives a duplicate network message.

After the terminal device receives the network information, it may be determined that the device information of the display device corresponding to the network information has changed, but the network information and the physical address have not changed. At this time, the terminal device may generate a device information acquisition request for acquiring device information after the display device is changed, according to the network information.

Since the network information and the physical address of the display device are not changed, only the device information is changed. Therefore, the device information acquisition request and the first acquisition request may be the same, and the terminal device may transmit the first acquisition request to the display device again.

After receiving the device information acquisition request sent by the terminal device, the display device can send the changed device information to the terminal device, and meanwhile, the display device can reestablish communication connection with the terminal device, so that the display device can perform communication interaction with the terminal device, and functions such as screen projection and the like are achieved.

When the terminal equipment receives the changed equipment information, the name of the display equipment in the display equipment list can be changed, so that a user can click the changed name of the display equipment, the display equipment is continuously controlled, and the screen projection function is realized.

Fig. 10 is an interaction flow diagram illustrating a display device and a terminal device resuming communication connection when a network connection mode is changed in some embodiments.

In some embodiments, the user may also make changes to the network connection mode of the display device. For example, the display device may be changed from a wired connection to a wireless connection, or from a wireless connection to a wired connection. When the network connection mode of the display device is changed, the network information and the physical address of the display device are also changed.

When the network information and the physical address of the display device are changed, the device information of the display device is not changed. However, the path of the communication connection between the display device and the terminal device may fail, resulting in no further communication connection between the display device and the terminal device. Therefore, the display device needs to be communicatively connected to the terminal device again.

When detecting that the network information and the physical address of the display device are changed, the display device may send the changed network information and the changed physical address to the terminal device. The network information and the physical address sent by the display device at this time are not sent at the stage of establishing communication connection between the terminal device and the display device, that is, the terminal device does not store the network information and the physical address.

After receiving the network information and the physical address, the terminal device may determine that a network connection mode of a certain display device is changed in the display device list, which may cause a path of communication connection to fail, but the terminal device may not determine which display device is specifically in the display device list.

The terminal device may generate a second acquisition request according to the changed network information and the physical address, where the second acquisition request is used to acquire current device information of the display device. Due to the change of the network information and the physical address, the terminal device needs to regenerate the acquisition instruction of the device information according to the new network information and the physical address, that is, generate the second acquisition request. The second acquisition request is different from the first acquisition request. Further, the terminal device sends the second acquisition request to the display device.

After receiving the second acquisition request sent by the terminal device, the display device may send the current device information of the display device to the terminal device. Since the device information of the display device is not changed, the device information sent by the display device is the device information that has been sent before. Meanwhile, the display equipment can reestablish communication connection with the terminal equipment, so that the display equipment can perform communication interaction with the terminal equipment, and functions such as screen projection and the like are realized.

Since the device information of the display device is not changed, the device information received by the terminal device is the device information that has already been stored, and specifically corresponds to a certain display device in the display device list. In this case, the terminal device may determine that the network connection mode of the display device is changed, that is, the network information and the physical address of the display device are changed. Further, the terminal device may determine a current communication connection path with the display device and perform updating. When the user clicks the name of the display device, the terminal device can send image data and the like to the display device through the updated communication connection path, and functions such as screen projection and the like are achieved, so that the user can control the display device.

Therefore, when some information of the display device is changed, the changed information can be transmitted to the terminal device, so that the communication connection with the terminal device can be performed again. The display device can be actively in communication connection with the terminal device again, the process that the terminal device actively sends a communication connection request is not needed, namely, the display device and the terminal device are not needed to be manually connected, the intelligent degree of the communication connection between the display device and the terminal device is improved, and the user experience is improved. Meanwhile, due to the fact that the display device actively conducts the reconnection process, the fact that communication connection between the display device and the terminal device cannot fail can be guaranteed, a user can control the display device through the terminal device, and user experience is further improved.

In some embodiments, it is considered that the display device is connected to more than one terminal device, and therefore when it is detected that the display device establishes a communication connection with a certain terminal device, the device information of the terminal device may be stored to the communication connection list. That is, the communication connection list includes all terminal devices that the display device allows communication connection, including the terminal device that the display device is currently in communication connection, and the history terminal device that the display device is not currently connected but has been connected before.

Fig. 11 illustrates a flow diagram for interaction between a display device and a terminal device in some embodiments.

In some embodiments, when detecting that the device information of the display device is changed, the controller may determine all terminal devices in the communication connection list, and send the network information of the display device to all terminal devices in the communication connection list, so that all terminal devices establish communication connection with the display device again.

Fig. 12 illustrates a flow diagram for interaction between a display device and a terminal device in some embodiments.

In some embodiments, when detecting that the network connection mode of the display device is changed, the controller may send the changed network information and the changed physical address of the display device to all the terminal devices in the communication connection list, so that all the terminal devices establish communication connection with the display device again.

In some embodiments, it is considered that not all terminal devices in the communication connection list are within range of the communication connection, i.e. not all terminal devices are in communication connection with the display device at the current time.

Therefore, one communication connection cycle can be set in advance.

After a certain terminal device and a display device are in communication connection, timing is started from the time when the connection is successful. If the terminal device and the display device do not perform information interaction in the communication connection period, the terminal device is considered to have left the local area network, namely the communication connection range, or the terminal device does not use the screen projection function. The device information of the terminal device can be deleted from the communication connection list at this time.

In some embodiments, the timing may be started each time the terminal device and the display device perform an information interaction. If the terminal device and the display device do not perform information interaction in the communication connection period, that is, the time interval between two adjacent information interactions of the terminal device and the display device is greater than the communication connection period, the terminal device is considered to have left the local area network, that is, the communication connection range, or the terminal device does not use the screen projection function any more. The device information of the terminal device can be deleted from the communication connection list at this time.

An embodiment of the present application provides a communication connection method, which is applied to a display device, and as shown in fig. 13, the method includes the following steps:

s1301, when the fact that the communication connection between the display device and the terminal device is established is detected, the network information of the display device is sent to the terminal device in response to the change of the device information of the display device, so that the terminal device generates a device information obtaining request according to the network information, and the device information obtaining request is used for obtaining the device information after the display device is changed.

S1302, responding to the device information acquisition request sent by the terminal device, sending the changed device information to the terminal device, and reestablishing communication connection with the terminal device.

An embodiment of the present application provides a communication connection method, which is applied to a terminal device, and as shown in fig. 14, the method includes the following steps:

s1401, when detecting that the display device and the terminal device establish communication connection, responding to network information sent by the display device, and generating a device information acquisition request according to the network information, wherein the device information acquisition request is used for acquiring device information after the display device is changed.

And S1402, receiving the changed device information sent by the display device.

The embodiment of the present application further provides a communication connection method, including the following steps:

when detecting that the display device establishes communication connection with the terminal device, the display device transmits the network information to the terminal device in response to a change in the device information of the display device.

And when the terminal equipment receives the network information sent by the display equipment, generating an equipment information acquisition request according to the network information, and sending the equipment information acquisition request to the display equipment.

And responding to the equipment information acquisition request sent by the terminal equipment, sending the changed equipment information to the terminal equipment by the display equipment, and reestablishing communication connection with the terminal equipment.

And the terminal equipment receives the changed equipment information sent by the display equipment.

The same and similar parts in the embodiments in this specification may be referred to one another, and are not described herein again.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of software products, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and include instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method in the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.