阅读说明：本技术 监控方法、网关和系统 (Monitoring method, gateway and system ) 是由 周杰 路颖 崔瑞琳 于 2018-08-16 设计创作，主要内容包括：本公开提出一种监控方法、网关和系统,涉及物联网技术领域。本公开的一种监控方法包括：网关获取视频监控数据；网关获取传感器采集的传感数据；根据同一场景下的视频监控数据和传感数据生成复合监控数据。通过这样的方法,能够将同一场景下的视频监控数据和传感数据绑定,生成复合监控数据,从而在由视频监控数据提供视频图像的同时,由传感数据提供传感器探测信息,丰富了监控数据的信息量,能够通过传感数据迅速提取信息,降低了对监控数据的处理难度,提高了处理效率。(The disclosure provides a monitoring method, a gateway and a system, and relates to the technical field of the Internet of things. The monitoring method comprises the following steps: the gateway acquires video monitoring data; the gateway acquires sensing data acquired by a sensor; and generating composite monitoring data according to the video monitoring data and the sensing data in the same scene. By the method, the video monitoring data and the sensing data in the same scene can be bound to generate the composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.)

1. A method of monitoring, comprising:

the gateway acquires video monitoring data;

the gateway acquires sensing data acquired by a sensor;

and generating composite monitoring data according to the video monitoring data and the sensing data in the same scene.

2. The method of claim 1, further comprising:

sending a matching initiating instruction to a sensor so that the sensor sends short-distance matching information;

receiving the short-distance matching information uploaded by the video acquisition equipment receiving the short-distance matching information;

determining a sensor sending the short-distance matching information according to the short-distance matching information;

and determining that the video acquisition equipment uploading the short-distance matching information and the sensor sending the short-distance matching information are positioned in the same scene.

3. The method of claim 1, further comprising:

sending a matching initiating instruction to video acquisition equipment so that the video acquisition equipment can send short-distance matching information;

receiving the short-distance matching information uploaded by the sensor receiving the short-distance matching information;

determining the video acquisition equipment sending the short-distance matching information according to the short-distance matching information;

and determining that the sensor for uploading the short-distance matching information and the video acquisition equipment for sending the short-distance matching information are positioned in the same scene.

4. A method according to claim 2 or 3, wherein the short-range matching information comprises voiceprint information.

5. The method of claim 2, further comprising:

receiving registration information from a sensor, wherein the registration information comprises a sensor identifier and short-distance matching information;

sending sensor access information to video acquisition equipment so that the video acquisition equipment can monitor the short-distance matching information;

and sending a matching initiating instruction to the sensor which sends the registration information so that the sensor sends short-distance matching information.

6. The method of claim 1, further comprising at least one of:

under the condition of receiving a monitoring video watching request, sending the composite monitoring data to a user terminal; or the like, or, alternatively,

and under the condition that the measured value of the sensing data reaches a preset threshold value, activating the user terminal to prompt the playing of the monitoring video, and sending the composite monitoring data to the user terminal.

7. A monitoring gateway, comprising:

a video data acquisition unit configured to acquire video monitoring data;

a sensing data acquisition unit configured to acquire sensing data acquired by a sensor;

and the composite data generation unit is configured to generate composite monitoring data according to the video monitoring data and the sensing data in the same scene.

8. The gateway of claim 7, further comprising a device matching unit configured to:

sending a matching initiating instruction to a sensor so that the sensor sends short-distance matching information;

receiving the short-distance matching information uploaded by the video acquisition equipment receiving the short-distance matching information;

determining a sensor sending the short-distance matching information according to the short-distance matching information;

and determining that the video acquisition equipment uploading the short-distance matching information and the sensor sending the short-distance matching information are positioned in the same scene.

9. The gateway of claim 7, further comprising a device matching unit configured to:

sending a matching initiating instruction to video acquisition equipment so that the video acquisition equipment can send short-distance matching information;

receiving the short-distance matching information uploaded by the sensor receiving the short-distance matching information;

determining the video acquisition equipment sending the short-distance matching information according to the short-distance matching information;

and determining that the sensor for uploading the short-distance matching information and the video acquisition equipment for sending the short-distance matching information are positioned in the same scene.

10. The gateway of claim 8 or 9, wherein the short range matching information comprises voiceprint information.

11. The gateway of claim 8, the device matching unit further configured to:

receiving registration information from a sensor, wherein the registration information comprises a sensor identifier and short-distance matching information;

sending sensor access information to video acquisition equipment so that the video acquisition equipment can monitor the short-distance matching information;

and sending a matching initiating instruction to the sensor which sends the registration information so that the sensor sends short-distance matching information.

12. The gateway of claim 7, further comprising a data sending unit configured to perform at least one of:

under the condition of receiving a monitoring video watching request, sending the composite monitoring data to a user terminal; or the like, or, alternatively,

and under the condition that the measured value of the sensing data reaches a preset threshold value, activating the user terminal to prompt the playing of the monitoring video, and sending the composite monitoring data to the user terminal.

13. A monitoring gateway, comprising:

a memory; and

a processor coupled to the memory, the processor configured to perform the method of any of claims 1-6 based on instructions stored in the memory.

14. A computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the method of any one of claims 1 to 6.

15. A monitoring system, comprising:

the monitoring gateway of any of claims 7 to 13;

a video capture device configured to obtain a surveillance image; and

a sensor configured to acquire sensing data.

16. The system of claim 15, wherein,

the sensor is also configured to send short-distance matching information according to the initiating matching instruction from the monitoring gateway;

the video acquisition equipment is also configured to acquire the short-distance matching information and upload the monitoring gateway so that the monitoring gateway can determine the video acquisition equipment and the sensor which are positioned in the same scene.

Technical Field

The disclosure relates to the technical field of internet of things, in particular to a monitoring method, a gateway and a system.

Background

In the process of monitoring and capturing information through video images, due to the problems of video dead angles, image definition, limited information provided by images and the like, the effect is strong and satisfactory, the data processing of the video images is complex, especially in the process of viewing historical videos, the video images are often manually viewed to extract the information, the labor is consumed, and the efficiency is low.

Disclosure of Invention

One purpose of this disclosure is to optimize the monitoring data, reduce the processing degree of difficulty of monitoring data, improve the treatment effeciency.

According to an aspect of the present disclosure, a monitoring method is provided, including: the gateway acquires video monitoring data; the gateway acquires sensing data acquired by a sensor; and generating composite monitoring data according to the video monitoring data and the sensing data in the same scene.

Optionally, the monitoring method further includes: sending a matching initiating instruction to the sensor so that the sensor sends short-distance matching information; receiving short-distance matching information uploaded by the video acquisition equipment receiving the short-distance matching information; determining a sensor sending short-distance matching information according to the short-distance matching information; and determining that the video acquisition equipment uploading the short-distance matching information and the sensor sending the short-distance matching information are positioned in the same scene.

Optionally, the monitoring method further includes: sending a matching initiating instruction to the video acquisition equipment so that the video acquisition equipment sends short-distance matching information; receiving short-distance matching information uploaded by a sensor receiving the short-distance matching information; determining video acquisition equipment sending short-distance matching information according to the short-distance matching information; and determining that the sensor for uploading the short-distance matching information and the video acquisition equipment sending the short-distance matching information are positioned in the same scene.

Optionally, the short-range matching information comprises voiceprint information.

Optionally, the monitoring method further includes: receiving registration information from a sensor, wherein the registration information comprises a sensor identifier and short-distance matching information; sending sensor access information to the video acquisition equipment so that the video acquisition equipment can monitor short-distance matching information; and sending a matching initiating instruction to the sensor which sends the registration information so that the sensor sends short-distance matching information.

Optionally, the monitoring method further comprises at least one of: under the condition of receiving a monitoring video watching request, sending the composite monitoring data to a user terminal; or, under the condition that the measured value of the sensing data reaches a preset threshold value, activating the user terminal to prompt the playing of the monitoring video, and sending the composite monitoring data to the user terminal.

By the method, the video monitoring data and the sensing data in the same scene can be bound to generate the composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

According to another aspect of the present disclosure, a monitoring gateway is provided, including: a video data acquisition unit configured to acquire video monitoring data; a sensing data acquisition unit configured to acquire sensing data acquired by a sensor; and the composite data generation unit is configured to generate composite monitoring data according to the video monitoring data and the sensing data in the same scene.

Optionally, the monitoring gateway further comprises a device matching unit configured to: sending a matching initiating instruction to the sensor so that the sensor sends short-distance matching information; receiving short-distance matching information uploaded by the video acquisition equipment receiving the short-distance matching information; determining a sensor sending short-distance matching information according to the short-distance matching information; and determining that the video acquisition equipment uploading the short-distance matching information and the sensor sending the short-distance matching information are positioned in the same scene.

Optionally, the monitoring gateway further comprises a device matching unit configured to: sending a matching initiating instruction to the video acquisition equipment so that the video acquisition equipment sends short-distance matching information; receiving short-distance matching information uploaded by a sensor receiving the short-distance matching information; determining video acquisition equipment sending short-distance matching information according to the short-distance matching information; and determining that the sensor for uploading the short-distance matching information and the video acquisition equipment sending the short-distance matching information are positioned in the same scene.

Optionally, the short-range matching information comprises voiceprint information.

Optionally, the device matching unit is further configured to: receiving registration information from a sensor, wherein the registration information comprises a sensor identifier and short-distance matching information; sending sensor access information to the video acquisition equipment so that the video acquisition equipment can monitor short-distance matching information; and sending a matching initiating instruction to the sensor which sends the registration information so that the sensor sends short-distance matching information.

Optionally, the monitoring gateway further comprises a data sending unit configured to perform at least one of the following: under the condition of receiving a monitoring video watching request, sending the composite monitoring data to a user terminal; or, under the condition that the measured value of the sensing data reaches a preset threshold value, activating the user terminal to prompt the playing of the monitoring video, and sending the composite monitoring data to the user terminal.

According to yet another aspect of the present disclosure, a monitoring gateway is provided, including: a memory; and a processor coupled to the memory, the processor configured to perform any of the monitoring methods above based on instructions stored in the memory.

The monitoring gateway can bind the video monitoring data and the sensing data in the same scene to generate composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

According to yet another aspect of the disclosure, a computer-readable storage medium is proposed, on which computer program instructions are stored, which instructions, when executed by a processor, implement the steps of any of the monitoring methods above.

By executing the instructions on the computer-readable storage medium, the video monitoring data and the sensing data in the same scene can be bound to generate composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information amount of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

Further, according to an aspect of the present disclosure, there is provided a monitoring system including: any of the monitoring gateways above; a video capture device configured to obtain a surveillance image; and a sensor configured to acquire sensing data.

Optionally, the sensor is further configured to issue short-distance matching information according to the initiating matching instruction from the monitoring gateway; the video acquisition device is also configured to acquire short-distance matching information and upload the short-distance matching information to the monitoring gateway so that the monitoring gateway can determine the video acquisition device and the sensor which are positioned in the same scene.

The monitoring system can bind the video monitoring data and the sensing data in the same scene to generate composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure and not to limit the disclosure. In the drawings:

fig. 1 is a flow chart of one embodiment of a monitoring method of the present disclosure.

Fig. 2 is a flow chart of another embodiment of a monitoring method of the present disclosure.

Fig. 3 is a flow chart of yet another embodiment of a monitoring method of the present disclosure.

Fig. 4 is a schematic diagram of one embodiment of a monitoring gateway of the present disclosure.

Fig. 5 is a schematic diagram of another embodiment of a monitoring gateway of the present disclosure.

Fig. 6 is a schematic diagram of yet another embodiment of a monitoring gateway of the present disclosure.

FIG. 7 is a schematic diagram of one embodiment of a monitoring system of the present disclosure.

Fig. 8 is a schematic diagram of another embodiment of a monitoring system of the present disclosure.

Detailed Description

The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.

A flow chart of one embodiment of a monitoring method of the present disclosure is shown in fig. 1.

In step 101, the gateway obtains video surveillance data. In one embodiment, the video surveillance data includes an identification of the video capture device that captured the data.

In step 102, the gateway acquires sensing data collected by the sensor. In one embodiment, the sensed data may be detected data from various sensors, such as a photosensor, a smoke detector, a radio frequency identification device, and the like. In one embodiment, the sensory data includes an identification of the sensor that acquired the data.

The steps 101 and 102 have no sequence, and the video monitoring data and the sensing data can be synchronously received.

In step 103, composite monitoring data is generated according to the video monitoring data and the sensing data in the same scene. In one embodiment, the association relationship between the video capture device and the sensor may be prestored in the monitoring gateway, or the video capture devices and the sensors with close distances and close detection ranges may be associated with each other in the process of accessing the video capture device and the sensor to the gateway. In one embodiment, one or more video capture devices may be associated with one or more sensors in the same scene.

By the method, the video monitoring data and the sensing data in the same scene can be bound to generate the composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

A flow chart of another embodiment of the monitoring method of the present disclosure is shown in fig. 2.

In step 201, the gateway sends out a matching initiating instruction to the sensor so that the sensor sends out short-distance matching information. In one embodiment, the gateway may feed back a matching instruction to the sensor upon initial sensor access to cause the sensor to issue short range matching information. In one embodiment, the short-range matching information may be voiceprint information, radio frequency communication information, bluetooth signals, and the like.

The matching information is sent in a short-distance communication mode, so that the video acquisition equipment capable of completing matching is ensured to be close to the sensor and positioned in the same scene, the fit degree of the video monitoring data and the sensing data in the composite monitoring data is ensured, and the accuracy of the composite monitoring data is improved.

In step 202, the gateway receives the short-distance matching information uploaded by the video capture device that received the short-distance matching information. In an embodiment, if the short-distance matching information is voiceprint information, the video capture device may encode the voiceprint information in a predetermined processing manner, or extract sensor identification data in the voiceprint information according to a predetermined encoding and decoding manner.

In step 203, the sensor that sent out the short-range matching information is determined based on the short-range matching information. In one embodiment, the gateway stores the corresponding relationship between the voiceprint code and the sensor so as to match information according to the short distance uploaded by the video acquisition equipment. In one embodiment, the sensor may upload its identifying short-range matching information at initial access.

In step 204, it is determined that the video capture device uploading the short-distance matching information and the sensor sending the short-distance matching information are located in the same scene, so that the video monitoring data and the sensing data in the same scene can be bound to generate composite monitoring data according to the manner in the embodiment shown in fig. 1.

By the method, the monitoring gateway can actively activate the sensor to initiate matching, so that the control capability of the monitoring gateway is improved; the video acquisition equipment and the sensor under the same scene can be determined and stored according to the information fed back by the video acquisition equipment, so that the composite monitoring data is generated according to the stored information in the monitoring process, and the efficiency of generating the composite monitoring data is improved.

In one embodiment, the video acquisition device can also provide self short-distance matching information when accessing the gateway, the video acquisition device sends the short-distance matching information, and the short-distance matching information is received by the sensor and uploaded to the gateway to complete matching, so that the matching between the video acquisition device and the sensor under the condition of back access of the video acquisition device is realized.

A flow chart of yet another embodiment of the monitoring method of the present disclosure is shown in fig. 3.

In step 301, the gateway receives registration information from the sensor, wherein the registration information includes the sensor identification and the short-range matching information.

In step 302, sensor access information is sent to the video capture device so that the video capture device listens for short-range matching information.

In step 303, an initiate matching instruction is issued to the sensor that issued the registration information, so that the sensor issues short-distance matching information.

In step 304, an initiate match instruction is issued to the sensor so that the sensor issues short range match information.

In step 305, short-distance matching information uploaded by the video capture device receiving the short-distance matching information is received.

In step 306, the sensor that sent the short-range matching information is determined based on the short-range matching information.

In step 307, it is determined that the video capture device uploading the short-range matching information is located in the same scene as the sensor of the short-range matching information.

In step 308, when the video monitoring data and the sensing data are received, composite monitoring data is generated according to the video monitoring data and the sensing data in the same scene.

By the method, the video acquisition equipment can be activated to monitor the short-distance matching information after the registration information of the sensor is received, so that the video acquisition equipment is prevented from being in a monitoring state for a long time, and the burden of the video acquisition equipment is reduced.

In one embodiment, the monitoring gateway may further transmit the composite monitoring data to the user terminal in case of receiving a monitoring video viewing request. In one embodiment, the monitoring gateway may upload the composite monitoring data to the monitoring platform first, and the monitoring platform forwards the composite monitoring data to the user terminal, so as to facilitate the user to obtain the composite monitoring data in real time.

In another embodiment, the monitoring platform may first upload the composite monitoring data to the monitoring platform, and the monitoring platform activates the user terminal to pop up a monitoring play prompt or a monitoring play window so that the user can see the composite monitoring data in time.

A schematic diagram of one embodiment of a monitoring gateway of the present disclosure is shown in fig. 4. The video data acquisition unit 401 can acquire video monitoring data, which may include an identifier of a video capture device that captures the data. The sensing data acquiring unit 402 can acquire sensing data acquired by a sensor, and the sensing data may include an identifier of the sensor acquiring the sensing data. The composite data generation unit 403 can generate composite monitoring data from the video monitoring data and the sensing data in the same scene.

The monitoring gateway can bind the video monitoring data and the sensing data in the same scene to generate composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

In one embodiment, as shown in fig. 4, the monitoring gateway may further include a device matching unit 404, which is capable of sending a matching initiation instruction to the sensor, so that the sensor sends short-distance matching information, receiving short-distance matching information uploaded by the video capture device that receives the short-distance matching information, determining the sensor that sends the short-distance matching information according to the short-distance matching information, and then determining that the video capture device that uploads the short-distance matching information and the sensor that sends the short-distance matching information are located in the same scene.

The monitoring gateway can actively activate the sensor to initiate matching, so that the control capability of the monitoring gateway is improved; the video acquisition equipment and the sensor under the same scene can be determined and stored according to the information fed back by the video acquisition equipment, so that the composite monitoring data is generated according to the stored information in the monitoring process, and the efficiency of generating the composite monitoring data is improved.

In one embodiment, the device matching unit 404 can send a matching initiation instruction to the video capture device, so that the video capture device sends short-distance matching information, can receive the short-distance matching information uploaded by the bed in which the short-distance matching information is received, can determine the video capture device sending the short-distance matching information according to the short-distance matching information, and then determine that the sensor uploading the short-distance matching information and the video capture device sending the short-distance matching information are located in the same scene, thereby realizing matching between the video capture device and the sensor under the condition of back access of the video capture device.

In one embodiment, as shown in fig. 4, the monitoring gateway may further include a data transmitting unit 405 capable of transmitting the composite monitoring data to the user terminal in case of receiving a monitoring video viewing request. In one embodiment, the monitoring gateway may upload the composite monitoring data to the monitoring platform first, and the monitoring platform forwards the composite monitoring data to the user terminal, so as to facilitate the user to obtain the composite monitoring data in real time.

In an embodiment, the data sending unit 405 may monitor the sensing data, activate the user terminal to prompt to play the monitoring video and send the composite monitoring data to the user terminal when a measurement value of the sensing data reaches a predetermined threshold, for example, when an indoor temperature is higher or lower than the predetermined threshold, and a sensor at a door or a window detects someone intrusion, and a smoke sensor performs early warning, and in one embodiment, the composite monitoring data may be uploaded to the monitoring platform, and the monitoring platform activates the user terminal to pop up a monitoring play prompt or a monitoring play window, so that the user can see the composite monitoring data in time.

A schematic structural diagram of an embodiment of the monitoring gateway of the present disclosure is shown in fig. 5. The monitoring gateway comprises a memory 501 and a processor 502. Wherein: the memory 501 may be a magnetic disk, flash memory, or any other non-volatile storage medium. The memory is for storing instructions in the corresponding embodiments of the monitoring method above. The processor 502 is coupled to the memory 501 and may be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 502 is used for executing instructions stored in the memory, enriches the information amount of the monitoring data, can rapidly extract information through the sensing data, reduces the processing difficulty of the monitoring data, and improves the processing efficiency.

In one embodiment, as also shown in fig. 6, monitoring gateway 600 includes a memory 601 and a processor 602. The processor 602 is coupled to the memory 601 by a BUS 603. The monitoring gateway 600 may also be coupled to an external storage 605 via a storage interface 604 for invoking external data, and may also be coupled to a network or another computer system (not shown) via a network interface 606. And will not be described in detail herein.

In the embodiment, the data instruction is stored in the memory, and the instruction is processed by the processor, so that the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

In another embodiment, a computer-readable storage medium has stored thereon computer program instructions which, when executed by a processor, implement the steps of the method in the corresponding embodiment of the monitoring method. As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, apparatus, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

A schematic diagram of one embodiment of the monitoring system of the present disclosure is shown in fig. 7. The monitoring gateway 71 may be any of the monitoring gateways described above. The video capture device 72 can acquire the monitored images and the sensor 73 can acquire the sensed data.

The monitoring system can bind the video monitoring data and the sensing data in the same scene to generate composite monitoring data, so that the sensing data provides sensor detection information while the video monitoring data provides video images, the information content of the monitoring data is enriched, the information can be rapidly extracted through the sensing data, the processing difficulty of the monitoring data is reduced, and the processing efficiency is improved.

A schematic diagram of another embodiment of the monitoring system of the present disclosure is shown in fig. 8.

In 801, sensor 83 is plugged into the electrical network and initiates a registration request to monitoring platform 84 through monitoring gateway 81. In one embodiment, the monitoring gateway may be a local access gateway.

In 802, a sensor is registered with a platform.

At 803, the monitoring gateway sends a broadcast message to all video capture devices 82 below it, informing that a new sensor is accessed.

At 804, the monitoring gateway replies that the sensor registration was successful.

In one embodiment 803, 804 may be executed synchronously or in reverse order.

Upon receipt of the success message, the sensor sounds a series of special sounds seeking a match at 805. Voiceprint information or characteristics of the voice can be reported at the monitoring gateway or platform for identification by the monitoring gateway.

At 806, the voiceprint information is uploaded to the monitoring gateway after the nearby video capture devices capable of receiving voice receive the voiceprint information.

In one embodiment, the device that sends out the voiceprint information may be a video capture device and the device that receives the voiceprint information may be a sensor device.

In 807, the monitoring gateway completes matching and binding of the video acquisition device and the sensor according to the voiceprint information. In one embodiment, the monitoring gateway may upload the received voiceprint information to the monitoring platform, and determine the sensor to which the voiceprint information belongs based on the correspondence between the voiceprint features and the sensors stored in the monitoring platform.

At 808, the monitoring gateway draws the sensing data from the video stream according to the matching relationship between the video capture device and the sensor, forming a composite stream.

In 809, when the user requests to watch the video, the monitoring gateway sends the composite stream to the monitoring platform, and the platform forwards the composite stream to the client 85, so as to complete the overlay display of the video and the data. When the sensor reaches the alarm preset condition, the monitoring gateway prompts the user terminal to automatically pop up the display video through the monitoring platform.

The system can utilize the characteristic of limited sound propagation distance to ensure that the sensor and the video acquisition equipment are in the same scene, and the video acquisition equipment can accurately present the scene of the sensor; the access gateway of the local node is used for completing matching binding and composite flow superposition of the sensor and the camera, so that a monitoring platform is avoided, and cost and workload are effectively reduced.

The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Thus far, the present disclosure has been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.

The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

Finally, it should be noted that: the above examples are intended only to illustrate the technical solutions of the present disclosure and not to limit them; although the present disclosure has been described in detail with reference to preferred embodiments, those of ordinary skill in the art will understand that: modifications to the specific embodiments of the disclosure or equivalent substitutions for parts of the technical features may still be made; all such modifications are intended to be included within the scope of the claims of this disclosure without departing from the spirit thereof.