阅读说明：本技术 视频会议与视频监控融合方法、系统、终端及存储介质 (Video conference and video monitoring fusion method, system, terminal and storage medium ) 是由 柴亚伟 尹许梅 于 2021-10-14 设计创作，主要内容包括：本发明公开了一种视频会议与视频监控融合方法、系统、终端及存储介质,应用于融合终端,所述视频会议与视频监控融合方法包括以下步骤：向预设视频会议服务器和预设视频监控服务器进行注册；若接收到会议信令,则打开与所述预设视频会议服务器的上行信道和下行信道；若接收到监控信令,则打开与所述预设视频监控服务器的上行信道。本发明通过融合终端兼容了视频会议和视频监控的功能,使得参加视频会议和进入视频监控的方式简单便捷。(The invention discloses a method, a system, a terminal and a storage medium for fusing a video conference and video monitoring, which are applied to a fusion terminal, wherein the method for fusing the video conference and the video monitoring comprises the following steps: registering with a preset video conference server and a preset video monitoring server; if a conference signaling is received, opening an uplink channel and a downlink channel of the preset video conference server; and if the monitoring signaling is received, opening an uplink channel with the preset video monitoring server. The invention enables the modes of participating in the video conference and entering the video monitoring to be simple and convenient by integrating the functions of the video conference and the video monitoring of the terminal.)

1. A video conference and video monitoring fusion method is applied to a fusion terminal and is characterized by comprising the following steps:

registering with a preset video conference server and a preset video monitoring server;

if a conference signaling is received, opening an uplink channel and a downlink channel of the preset video conference server;

and if the monitoring signaling is received, opening an uplink channel with the preset video monitoring server.

2. The method of claim 1, wherein the step of registering with the predetermined videoconference server and the predetermined video surveillance server comprises:

sending a conference registration request to the preset video conference server so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration;

and sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request to complete registration.

3. The method for merging video conference and video monitoring as claimed in claim 2, wherein the step of sending a conference registration request to the preset video conference server so that the preset video conference server obtains the merging terminal identification information in the conference registration request, and the step of completing registration comprises:

based on an SIP protocol or an H.323 protocol, sending a conference registration request to the preset video conference server;

the step of sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request includes:

and sending a monitoring registration request to the preset video monitoring server based on the GB28181 protocol.

4. The method as claimed in claim 1, wherein the step of opening the uplink channel and the downlink channel of the predetermined videoconference server after receiving the conference signaling comprises:

acquiring conference audio and video information and monitoring audio and video information;

sending conference audio and video information to a preset video conference server, receiving far-end audio and video information of the preset video conference server, and decoding and displaying;

if the monitoring signaling is received, the step of opening the uplink channel with the preset video monitoring server comprises the following steps:

and sending monitoring audio and video information to the preset video monitoring server.

5. The video conference and video surveillance fusion method according to claim 4, wherein the step of obtaining the conference audio-video information and the surveillance audio-video information comprises, after:

and sending the monitoring audio and video information to the preset video conference server.

6. The method as claimed in claim 1, wherein the monitoring signaling further includes a voice intercom instruction, and the step of opening an uplink channel with the predetermined video monitoring server if the monitoring signaling is received further includes:

if the voice talkback instruction is received, receiving the far-end audio information sent by the preset video monitoring server, and decoding and outputting the far-end audio information;

and acquiring local sound information, encoding the local sound information, and uploading the local sound information to a preset video monitoring server.

7. The method as claimed in claim 1, wherein the monitoring signaling further includes an inquiry command and a video playback command, and the step of opening an uplink channel with the predetermined video monitoring server if the monitoring signaling is received further includes:

acquiring monitoring audio and video information, and caching the monitoring audio and video information to a preset memory;

if the query instruction is received, uploading the video recording time information of the cached monitoring audio and video information to the preset video monitoring server so that the preset video monitoring server returns a video playback instruction;

and receiving the video playback instruction, and sending the cached monitoring audio and video information corresponding to the video playback instruction to the preset video monitoring server.

8. A video conference and video monitoring fusion system is characterized in that the video conference and video monitoring fusion system comprises:

the registration module is used for registering to a preset video conference server and a preset video monitoring server;

the conference module is used for opening an uplink channel and a downlink channel of the preset video conference server if a conference signaling is received;

and the monitoring module is used for opening an uplink channel with the preset video monitoring server if the monitoring signaling is received.

9. A convergence terminal, characterized in that the convergence terminal comprises: memory, processor and computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the video conferencing and video surveillance fusion method according to any of claims 1 to 7.

10. A computer-readable storage medium, wherein the computer-readable storage medium has stored thereon a video conferencing and video surveillance fusion program, which when executed by a processor implements the steps of the video conferencing and video surveillance fusion method according to any one of claims 1 to 7.

Technical Field

The invention relates to the technical field of communication, in particular to a method, a system, a fusion terminal and a computer readable storage medium for fusing a video conference and video monitoring.

Background

At present, video conference systems and video monitoring systems are gradually applied in depth in various industries, but it is found that scenes requiring video conference and video monitoring at the same time are more and more extensive. However, for a user who needs to deploy two systems, namely a video conference system and a video monitoring system, two sets of networks are often built, one set of the networks is used for building the video conference network, the other set of the networks is used for building the video monitoring network, and the two sets of the systems are independent of each other. The existing video conference and video monitoring fusion scheme is mainly characterized in that audio and video media of a video conference and monitored streaming media are decoded and then fused and displayed by means of system integration; or the method of monitoring the convergence gateway is adopted for convergence, the monitored streaming media is introduced into the video conference, and scheduling is carried out in the video conference. However, in the prior art, the scheme of integrating the video conference and the video monitoring is often complex and difficult to use.

The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.

Disclosure of Invention

The invention mainly aims to provide a video conference and video monitoring fusion method, and aims to solve the technical problem that the existing video conference and video monitoring fusion scheme is high in complexity.

In order to achieve the above object, the present invention provides a method for integrating a video conference and video monitoring, wherein the method for integrating a video conference and video monitoring comprises the following steps:

registering with a preset video conference server and a preset video monitoring server;

if a conference signaling is received, opening an uplink channel and a downlink channel of the preset video conference server;

and if the monitoring signaling is received, opening an uplink channel with the preset video monitoring server.

Preferably, the step of registering with the preset video conference server and the preset video monitoring server includes:

sending a conference registration request to the preset video conference server so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration;

and sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request to complete registration.

Preferably, the step of sending a conference registration request to the preset video conference server to enable the preset video conference server to obtain the convergence terminal identification information in the conference registration request includes:

based on an SIP protocol or an H.323 protocol, sending a conference registration request to the preset video conference server;

the step of sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request includes:

and sending a monitoring registration request to the preset video monitoring server based on the GB28181 protocol.

Preferably, if the conference signaling is received, the step of opening the uplink channel and the downlink channel with the preset video conference server includes:

acquiring conference audio and video information and monitoring audio and video information;

sending conference audio and video information to a preset video conference server, receiving far-end audio and video information of the preset video conference server, and decoding and displaying;

if the monitoring signaling is received, the step of opening the uplink channel with the preset video monitoring server comprises the following steps:

and sending monitoring audio and video information to the preset video monitoring server.

Preferably, the step of acquiring the conference audio-video information and the monitoring audio-video information includes:

and sending the monitoring audio and video information to the preset video conference server.

Preferably, the monitoring signaling further includes a voice intercom instruction, and the step of opening an uplink channel with the preset video monitoring server further includes, if the monitoring signaling is received:

if the voice talkback instruction is received, receiving the far-end audio information sent by the preset video monitoring server, and decoding and outputting the far-end audio information;

and acquiring local sound information, encoding the local sound information, and uploading the local sound information to a preset video monitoring server.

Preferably, the monitoring signaling further includes an inquiry instruction and a video playback instruction, and the step of opening an uplink channel with the preset video monitoring server if the monitoring signaling is received further includes:

acquiring monitoring audio and video information, and caching the monitoring audio and video information to a preset memory;

if the query instruction is received, uploading the time information of the cached monitoring audio and video information to the preset video monitoring server so that the preset video monitoring server returns a video playback instruction;

and receiving the video playback instruction, and sending the cached monitoring audio and video information corresponding to the video playback instruction to the preset video monitoring server.

Preferably, the video conference and video monitoring fusion system includes:

the registration module is used for registering to a preset video conference server and a preset video monitoring server;

the conference module is used for opening an uplink channel and a downlink channel of the preset video conference server if a conference signaling is received;

and the monitoring module is used for opening an uplink channel with the preset video monitoring server if the monitoring signaling is received.

In addition, to achieve the above object, the present invention further provides a convergence terminal, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the video conferencing and video surveillance fusion method as described in any one of the above.

In addition, to achieve the above object, the present invention further provides a computer readable storage medium, where a video conference and video surveillance fusion program is stored, and when executed by a processor, the computer readable storage medium implements the steps of the video conference and video surveillance fusion method according to any one of the above descriptions.

The invention provides a video conference and video monitoring fusion method, which comprises the following steps that firstly, a fusion terminal registers to a preset video conference server and a preset video monitoring server; the method comprises the steps that registration requests are sent to a preset video conference server (such as a multipoint control unit) and a preset video monitoring server (such as a central monitoring platform) respectively, so that the preset video conference server and the preset video monitoring server can obtain identification information of a fusion terminal from the registration requests after receiving the registration requests, and therefore the preset video conference server and the preset video monitoring server can send conference signaling and monitoring signaling to the fusion terminal And setting an uplink channel of the video monitoring server to upload a corresponding audio/video media stream. The audio/video media stream may be acquired conference audio/video information or acquired monitoring audio/video information. According to the invention, the fusion terminal is respectively accessed to the preset video conference server and the preset video monitoring server, so that the interaction between the fusion terminal and the video conference network and the interaction between the fusion terminal and the video monitoring network can be realized, and compared with a conventional mode that the video conference network and the video monitoring network are separately arranged, the deployment cost and difficulty are reduced. For a user, the fusion terminal adds a configuration page registered to a preset video monitoring server on the traditional terminal, so that the difficulty in fusion and use of the video conference and the video monitoring is reduced, and the fusion terminal is simpler and more convenient compared with the existing fusion scheme of the video conference and the video monitoring.

Drawings

Fig. 1 is a schematic flowchart of a first embodiment of a video conference and video surveillance fusion method according to the present invention;

FIG. 2 is a schematic flowchart of a second embodiment of a video conference and video surveillance fusion method according to the present invention;

fig. 3 is a schematic structural diagram of a video conference and video monitoring fusion system according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a convergence terminal in a hardware operating environment according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Referring to fig. 1, a first embodiment of the present invention provides a method for merging a video conference and video surveillance, where the method for merging a video conference and video surveillance includes:

step S100, registering the preset video conference server and the preset video monitoring server;

specifically, the convergence terminal sends registration requests to a preset video conference server and a preset video monitoring server respectively to complete registration of the convergence terminal in the preset video conference server and the preset video monitoring server, so as to join a video conference network and a video monitoring network. The preset video conference server can be a multipoint control unit, and the preset video monitoring server can be a central monitoring platform.

Further, in another embodiment, the step S100 includes the steps of:

a1, sending a conference registration request to the preset video conference server, so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration;

step a2, sending a monitoring registration request to the preset video monitoring server, so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request, and completing registration.

Specifically, the conference registration request and the monitoring registration request both include identification information of the convergence terminal, where the identification information may be information such as an IP address, a device ID, a software and hardware version, and security identity information of the convergence terminal. The fusion terminal sends a conference registration request to the preset video conference server so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration; after the preset video conference server finishes registration, when a video conference needs to be held, the fusion terminal can join the corresponding video conference in a calling or called mode. And the fusion terminal sends a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request to complete registration.

In another embodiment, step a1 further includes the steps of:

step b1, based on SIP protocol or H.323 protocol, sending conference registration request to the preset video conference server;

step a2 further includes the steps of:

and step b2, sending a monitoring registration request to the preset video monitoring server based on the GB28181 protocol.

Specifically, the convergence terminal sends a conference registration request to the preset video conference server based on an SIP protocol or an h.323 protocol; and the convergence terminal sends a monitoring registration request to the preset video monitoring server based on a GB28181 protocol.

Step S200, if a conference signaling is received, an uplink channel and a downlink channel of the preset video conference server are opened;

specifically, the convergence terminal can join a corresponding video conference in a calling or called manner, and according to the fact that when the convergence terminal receives a conference signaling sent by a preset video conference server, the convergence terminal opens an uplink channel and a downlink channel of the preset video conference server, so that interaction of audio information, video information or audio and video information can be performed between the convergence terminal and the preset video conference server. For example, the fusion terminal may send the local conference audio/video information and/or the monitoring audio/video information to a preset video conference server, and receive remote conference audio/video information returned by the preset video conference server. Therefore, the fusion terminal can interact with other terminals in the video conference created by the preset video conference server.

Step S300, if the monitoring signaling is received, an uplink channel with the preset video monitoring server is opened.

Specifically, when the convergence terminal receives a monitoring signaling sent by a preset video monitoring server, the convergence terminal opens an uplink channel with the preset video monitoring server, so that the convergence terminal uploads the acquired audio information, video information or audio/video information to the preset video monitoring server. For example, the fusion terminal may send the local conference audio/video information and/or the monitoring audio/video information to a preset video monitoring server. Therefore, the fusion terminal can realize the real-time monitoring function.

In the first embodiment of the invention, firstly, a convergence terminal registers to a preset video conference server and a preset video monitoring server; the method comprises the steps that registration requests are sent to a preset video conference server (such as a multipoint control unit) and a preset video monitoring server (such as a central monitoring platform) respectively, so that the preset video conference server and the preset video monitoring server can obtain identification information of a fusion terminal from the registration requests after receiving the registration requests, and therefore the preset video conference server and the preset video monitoring server can send conference signaling and monitoring signaling to the fusion terminal And setting an uplink channel of the video monitoring server to upload a corresponding audio/video media stream. The audio/video media stream may be acquired conference audio/video information or acquired monitoring audio/video information. In this embodiment, the fusion terminal is respectively connected to the preset video conference server and the preset video monitoring server, so that the interaction between the fusion terminal and the video conference network and the interaction between the fusion terminal and the video monitoring network can be realized, and compared with a conventional mode in which the video conference network and the video monitoring network are separately arranged, the deployment cost and difficulty are reduced. For a user, the fusion terminal adds a configuration page registered to a preset video monitoring server on the traditional terminal, so that the difficulty in fusion and use of the video conference and the video monitoring is reduced, and the fusion terminal is simpler and more convenient compared with the existing fusion scheme of the video conference and the video monitoring.

Further, referring to fig. 2, a second embodiment of the present invention provides a method for integrating a video conference and video monitoring, based on the embodiment shown in fig. 1, the method includes the following steps after step S200:

step S210, acquiring conference audio and video information and monitoring audio and video information;

step S220, sending conference audio and video information to a preset video conference server, receiving far-end audio and video information of the preset video conference server, and decoding and displaying;

specifically, the fusion terminal can acquire surrounding sound information and image information through a camera module and a pickup module, and obtain conference audio/video information and monitoring audio/video information, and can also respectively obtain the conference audio/video information and the monitoring audio/video information through a conference camera (usually located in a conference hall) and a monitoring camera (usually located indoors or outdoors) which are externally connected with the fusion terminal. The specific connection mode of the convergence terminal and the conference camera and the specific connection mode of the convergence terminal and the monitoring camera can be wired connection (such as a video line, a control line, an HDMI line and the like) or wireless connection (such as WI-FI, Bluetooth, Ethernet and the like). After the fusion terminal opens an uplink channel and a downlink channel of the preset video conference server, the fusion terminal can send conference audio and video information to the preset video conference server, receive far-end audio and video information of the preset video conference server, decode and display the information, and therefore interaction between the fusion terminal and other terminals in a video conference created by the preset video conference server is achieved.

Step S300 is followed by the steps of:

and step S310, sending monitoring audio and video information to a preset video monitoring server.

Specifically, after the fusion terminal opens an uplink channel with the preset video monitoring server, the acquired monitoring audio/video information can be sent to the preset video monitoring server in real time, so that a real-time monitoring function is realized. Furthermore, if the monitoring signaling sent by the preset video monitoring server contains a pan-tilt control instruction, the monitoring camera can be controlled according to the pan-tilt control instruction, so that the functions of pan-tilt operation, defense arrangement, fortification and the like are realized.

Still further, in another embodiment, the step S210 further includes the following steps:

and c1, sending the monitoring audio and video information to a preset video conference server.

Specifically, the fusion terminal can select conference audio and video information to upload to a preset video conference server when a conference is held, and can select monitoring audio and video information to upload to a preset video monitoring server when the conference is not held; and the fusion terminal can select monitoring audio and video information to upload a preset video conference server when a conference is held. In the embodiment, the monitoring audio and video information is sent to the preset video conference server through the fusion terminal, so that the monitoring audio and video information is shared in the conference process, and the method and the device can be used for image analysis or comprehensive application such as on-site command and scheduling.

Further, in another embodiment, the monitoring signaling further includes a voice intercom instruction, and after the step S300, the following steps are further included:

step d1, if receiving the voice talkback instruction, receiving the far-end audio information sent by the preset video monitoring server, and decoding and outputting the far-end audio information;

and d2, acquiring local sound information, coding the local sound information, and uploading the local sound information to a preset video monitoring server.

Specifically, the monitoring signaling further includes a voice talkback instruction. When a voice talkback instruction in a monitoring signaling sent by a preset video monitoring server is received, receiving far-end audio information sent by the preset video monitoring server, and performing decoding output so as to play the far-end audio information through a fusion terminal or a monitoring camera connected with the fusion terminal; and then local sound information is acquired through the fusion terminal or a monitoring camera connected with the fusion terminal, and the local sound information is encoded and uploaded to a preset video monitoring server. Therefore, the real-time voice talkback function of the video monitoring system is realized.

Further, in another embodiment, the monitoring signaling further includes an inquiry instruction and a video playback instruction, and after step S300, the following steps are included:

step e1, acquiring monitoring audio and video information, and caching the monitoring audio and video information to a preset memory;

step e2, if the query instruction is received, uploading the time information of the cached monitoring audio and video information to the preset video monitoring server, so that the preset video monitoring server returns a video playback instruction;

and e3, sending the cached monitoring audio and video information corresponding to the video playback instruction to the preset video monitoring server when the video playback instruction is received.

Specifically, the convergence terminal acquires monitoring audio and video information through a monitoring camera, and caches the monitoring audio and video information to a preset memory (such as a memory card, a mechanical hard disk, a solid state hard disk, a usb disk, and the like), where the preset memory may be a memory built in the convergence terminal or a memory externally connected to the convergence terminal. The monitoring signaling also comprises an inquiry instruction and a video playback instruction. The query instruction is used for querying the time information of the monitoring audio and video information cached in the fusion terminal preset memory by the preset video monitoring server. And after the preset video monitoring server issues a query instruction, acquiring the system time corresponding to the monitoring audio and video information cached by the fusion terminal according to the returned time information. And issuing a video playback instruction, wherein the video playback instruction comprises playback time information. And the fusion terminal receives the video playback instruction, and then sends the cached monitoring audio and video information corresponding to the playback time information in the video playback instruction to the preset video monitoring server. For example, the convergence terminal obtains 24-hour monitoring audio/video information of a certain day through the monitoring camera, stores the monitoring audio/video information into a U disk connected to the convergence terminal, and returns the cached time information of the monitoring audio/video information (namely 0 to 24 hours of the certain day) to the preset video monitoring server when receiving a query instruction of the preset video monitoring server. And then the preset video monitoring server generates a video playback instruction according to the time information returned by the fusion terminal, wherein the video playback instruction comprises playback time information (10-12 times of a certain day), the fusion terminal receives the video playback information, and the monitoring audio and video information of the U disk at 10-12 times of a certain day is sent to the preset video monitoring server. Therefore, the function of video playback in the video monitoring system is realized in the embodiment.

As shown in fig. 3, fig. 3 is a schematic structural diagram of a video conference and video monitoring fusion system according to an embodiment of the present invention, and an embodiment of the present invention provides a video conference and video monitoring fusion system, where the video conference and video monitoring fusion system includes:

a registration module 10, configured to register with the preset video conference server and the preset video monitoring server;

the conference module 20 is configured to open an uplink channel and a downlink channel with the preset video conference server if the conference signaling is received;

and the monitoring module 30 is configured to open an uplink channel with the preset video monitoring server if the monitoring signaling is received.

Further, the video conference and video monitoring fusion system further includes:

the registration module 10 is further configured to send a conference registration request to the preset video conference server, so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration; and the video monitoring server is further used for sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request to complete registration.

Further, the video conference and video monitoring fusion system further includes:

the registration module 10 is further configured to send a conference registration request to the preset video conference server based on an SIP protocol or an h.323 protocol; and the video monitoring server is also used for sending a monitoring registration request to the preset video monitoring server based on the GB28181 protocol.

Further, the video conference and video monitoring fusion system further includes: an acquisition module 40;

the acquisition module 40 is used for acquiring conference audio and video information and monitoring audio and video information;

the conference module 20 is configured to send conference audio and video information to a preset video conference server, receive far-end audio and video information of the preset video conference server, and perform decoding display;

and the monitoring module 30 sends monitoring audio and video information to a preset video monitoring server.

Further, the video conference and video monitoring fusion system further includes:

and the conference module 20 is configured to send the monitoring audio and video information to a preset video conference server.

Further, the monitoring signaling further includes a voice talkback instruction, and the video conference and video monitoring fusion system further includes:

the conference module 20 is configured to receive the far-end audio information sent by the preset video monitoring server and perform decoding output if the voice intercom instruction is received;

and the acquisition module 40 is used for acquiring local sound information, encoding the local sound information, and uploading the local sound information to a preset video monitoring server.

Further, the monitoring signaling further includes an inquiry instruction and a video playback instruction, and the video conference and video monitoring fusion system further includes:

the acquisition module 40 is used for acquiring monitoring audio and video information and caching the monitoring audio and video information to a preset memory;

the monitoring module 30 is configured to, if the query instruction is received, upload time information of the cached monitored audio/video information to the preset video monitoring server, so that the preset video monitoring server returns a video playback instruction; and the video playback instruction is also used for sending the cached monitoring audio and video information corresponding to the video playback instruction to the preset video monitoring server after receiving the video playback instruction.

As shown in fig. 4, fig. 4 is a schematic structural diagram of a convergence terminal of a hardware operating environment according to an embodiment of the present invention.

The integrated terminal can be a mobile terminal with a display function, such as a television, a smart phone, a desktop computer, a notebook computer and a tablet computer.

As shown in fig. 4, the convergence terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface). The Memory 1005 may be a high-speed RAM Memory or a Non-Volatile Memory (Non-Volatile Memory), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.

Optionally, the device may also include a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, Wi-Fi modules, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen, turn off the display screen and/or the backlight according to the brightness of ambient light. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the terminal is stationary, and can be used for identifying applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for moving the attitude of the fusion terminal, vibration identification related functions (such as pedometer and tapping) and the like; of course, the fusion terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.

Those skilled in the art will appreciate that the convergence terminal configuration shown in fig. 4 is not intended to be limiting of the convergence terminal and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.

As shown in fig. 4, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a video conference and video monitoring convergence application program.

In the apparatus shown in fig. 4, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the video conference and video surveillance fusion application stored in the memory 1005 and perform the following operations:

registering with a preset video conference server and a preset video monitoring server;

if a conference signaling is received, opening an uplink channel and a downlink channel of the preset video conference server;

and if the monitoring signaling is received, opening an uplink channel with the preset video monitoring server.

Further, the processor 1001 may call the video conference and video surveillance fusion application stored in the memory 1005, and further perform the following operations:

sending a conference registration request to the preset video conference server so that the preset video conference server obtains the fusion terminal identification information in the conference registration request to complete registration;

and sending a monitoring registration request to the preset video monitoring server so that the preset video monitoring server obtains the fusion terminal identification information in the monitoring registration request to complete registration.

Further, the processor 1001 may call the video conference and video surveillance fusion application stored in the memory 1005, and further perform the following operations:

based on an SIP protocol or an H.323 protocol, sending a conference registration request to the preset video conference server;

and sending a monitoring registration request to the preset video monitoring server based on the GB28181 protocol.

Further, the processor 1001 may call the video conference and video surveillance fusion application stored in the memory 1005, and further perform the following operations:

acquiring conference audio and video information and monitoring audio and video information;

sending conference audio and video information to a preset video conference server, receiving far-end audio and video information of the preset video conference server, and decoding and displaying;

and sending monitoring audio and video information to a preset video monitoring server.

Further, the processor 1001 may call the video conference and video surveillance fusion application stored in the memory 1005, and further perform the following operations:

and sending the monitoring audio and video information to a preset video conference server.

Further, the monitoring signaling further includes a voice intercom instruction, and the processor 1001 may call the video conference and video monitoring fusion application program stored in the memory 1005, and further perform the following operations:

if the voice talkback instruction is received, receiving the far-end audio information sent by the preset video monitoring server, and decoding and outputting the far-end audio information;

and acquiring local sound information, encoding the local sound information, and uploading the local sound information to a preset video monitoring server.

Further, the monitoring signaling further includes an inquiry instruction and a video playback instruction, and the processor 1001 may invoke the video conference and video monitoring fusion application program stored in the memory 1005, and further perform the following operations:

acquiring monitoring audio and video information, and caching the monitoring audio and video information to a preset memory;

if the query instruction is received, uploading the time information of the cached monitoring audio and video information to the preset video monitoring server so that the preset video monitoring server returns a video playback instruction;

and receiving the video playback instruction, and sending the cached monitoring audio and video information corresponding to the video playback instruction to the preset video monitoring server.

In addition, an embodiment of the present invention further provides a computer storage medium, where a computer program is stored on the computer storage medium, and when the computer program is executed by a processor, the operation in the video conference and video monitoring fusion method provided in the foregoing embodiment is implemented, and specific steps are not described here again.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity/action/object from another entity/action/object without necessarily requiring or implying any actual such relationship or order between such entities/actions/objects; the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

For the apparatus embodiment, since it is substantially similar to the method embodiment, it is described relatively simply, and reference may be made to some descriptions of the method embodiment for relevant points. The above-described apparatus embodiments are merely illustrative, in that elements described as separate components may or may not be physically separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a television, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.