阅读说明：本技术 一种融合多媒体及人工智能的电梯物联网边缘计算设备 (Elevator thing networking edge computing equipment that fuses multi-media and artificial intelligence ) 是由 卢峰 刘国辉 李名哲 刘阿鑫 栗向磊 于 2021-09-26 设计创作，主要内容包括：本申请公开了一种融合多媒体及人工智能的电梯物联网边缘计算设备,包括多媒体处理装置、人工智能图像处理装置、数据采集装置、数据处理装置、网络通信装置；所述电梯物联网边缘计算设备通过网络通信装置与网络设备相连,所述电梯物联网边缘计算设备通过网络通信装置连接有云平台；所述多媒体处理装置用于处理多媒体数据,所述人工智能图像处理装置用于识别检测图像,所述数据采集装置用于采集电梯运行数据,所述数据采集装置与数据处理装置相连。通过设置边缘计算设备,不但能作为通信节点,还能处理各种数据,实现电梯控制,数据能本地处理,降低网络开销和中央计算中心的压力,且能降低处理信息的处理时间,提高响应效率。(The application discloses elevator internet of things edge computing equipment integrating multimedia and artificial intelligence, which comprises a multimedia processing device, an artificial intelligence image processing device, a data acquisition device, a data processing device and a network communication device; the elevator Internet of things edge computing equipment is connected with the network equipment through a network communication device, and the elevator Internet of things edge computing equipment is connected with a cloud platform through the network communication device; the system comprises a multimedia processing device, an artificial intelligence image processing device, a data acquisition device and a data processing device, wherein the multimedia processing device is used for processing multimedia data, the artificial intelligence image processing device is used for identifying detection images, the data acquisition device is used for acquiring elevator operation data, and the data acquisition device is connected with the data processing device. By arranging the edge computing equipment, the edge computing equipment not only can be used as a communication node, but also can process various data, so that elevator control is realized, the data can be processed locally, the network overhead and the pressure of a central computing center are reduced, the processing time for processing information can be reduced, and the response efficiency is improved.)

1. An elevator thing networking edge computing device that fuses multi-media and artificial intelligence, characterized by, includes: the system comprises a multimedia processing device, an artificial intelligent image processing device, a data acquisition device, a data processing device and a network communication device; the elevator Internet of things edge computing equipment is connected with the network equipment through a network communication device, and the elevator Internet of things edge computing equipment is connected with a cloud platform through the network communication device; the system comprises a multimedia processing device, an artificial intelligence image processing device, a data acquisition device, a data processing device and a data processing device, wherein the multimedia processing device is used for processing multimedia data, the artificial intelligence image processing device is used for identifying detection images, the data acquisition device is used for acquiring elevator operation data, the data acquisition device is connected with the data processing device, and the data processing device is used for processing the data detected by the data acquisition device and responding.

2. The elevator internet of things edge calculation device of claim 1, wherein the data processing device is connected to the elevator control system through a communication link, and sends a safety handling command to the elevator when the data processing device finds that the elevator is operating abnormally according to the data detected by the data acquisition device.

3. The elevator internet of things edge computing equipment according to claim 2, wherein the elevator internet of things edge computing equipment is connected with a camera through a network, the camera is used for shooting an image inside the elevator, the camera sends video information to the elevator internet of things edge computing equipment through the network, an artificial intelligence image processing device of the elevator internet of things edge computing equipment is used for identifying unsafe objects, when the elevator identifies the unsafe objects, the artificial intelligence image processing device sends a message to a data processing device, and the data processing device controls an elevator system to perform safe operation.

4. The elevator internet of things edge computing device of claim 3, wherein the display screen is linked to the multimedia processing device, the multimedia processing device pulls or receives multimedia messages from a cloud, and the multimedia processing device processes multimedia data and sends the processed multimedia data to the display screen through the network communication device to play multimedia.

5. The elevator internet of things edge computing equipment according to claim 3, wherein the multimedia processing device comprises a video processing module, an audio processing module and a picture processing module, the multimedia processing device is connected with a projection device and a loudspeaker through a network, the multimedia processing device displays images through the projection device, and the multimedia processing device plays sounds through the loudspeaker.

6. The elevator internet of things edge computing device of claim 3, wherein the network communication means comprises a switch module and a router module, the elevator internet of things edge computing device can implement internal communication between different settings of the same network segment through the switch module, and the elevator internet of things edge computing device can implement communication of different network segments through the router module.

7. The elevator internet of things edge calculation device of claim 3, wherein the data collection device comprises a plurality of sensors disposed at various locations of the elevator, the data collection device comprises an interface connected to an elevator control system, the data collection device is connected to the elevator control system via the interface, and the data collection device obtains elevator operation data via the interface.

8. The elevator internet of things edge computing device of claim 3, wherein the artificial intelligence image processing means comprises a video framing module connected with an image recognition model; the video framing module decomposes continuous video information into images of one frame, the video framing module sends the produced images of one frame to the image recognition model, and the image recognition model recognizes objects contained in the pictures.

9. The elevator internet of things edge calculation device according to claim 8, wherein the image recognition model is connected with an information statistic module, the image recognition model sends the recognition result to the information statistic module, the information statistic module is used for counting the number of the articles recognized by the image recognition model, and the image recognition result can be determined only when the number of the articles reaches a certain threshold value in continuous unit time, so that the recognition error is prevented; the information statistics module is connected with an information reporting module, the information statistics module sends results to the information reporting module, and the information reporting module sends the results to the cloud.

10. The elevator internet of things edge computing equipment of claim 9, wherein the information statistics module is connected with an information forwarding module, the information forwarding module is connected to a data processing device, and the data processing device makes elevator control response according to multi-party data; the artificial intelligence image processing device comprises an archiving module, and the archiving module is used for storing the identification result.

Technical Field

The application relates to the technical field of edge computing, in particular to elevator internet of things edge computing equipment integrating multimedia and artificial intelligence.

Background

With the rapid development of economy and the acceleration of urbanization process, elevators have become important transportation tools, and are closely related to the work and life of people. By the end of 2020, the holding capacity of elevators in China reaches 780 ten thousand. Along with the increase of the service life of the elevator, more and more accidents happen to the elevator, the types of the accidents are various, and the accidents are caused by the elevator itself before people get out of service and are trapped. Accidents caused by fire disasters caused by the fact that the battery cars go upstairs occur frequently in recent two years. The monitoring of elevator operation and fault state is urgently needed to be enhanced by relevant departments, so that the internet of things of the elevator becomes necessary.

On one hand, the access of the elevator to the Internet of things requires a large amount of sensors, Internet of things gateways, communication equipment and other related equipment to access, and a large amount of capital investment is consumed; on the other hand, the property as an elevator management party still depends on manual management to maintain normal operation of the elevator, although the labor cost is high, the property also hopes to reduce manual dependence and improve the human efficiency ratio through technical means such as the Internet of things, and the like, but because the income is single, no extra fund is invested in the construction of the Internet of things of the elevator, and a contradiction point is formed.

The existing system scheme can only monitor the operation of a single elevator, and if other functions such as battery cars and the like need to be monitored, additional hardware investment is needed, and two aspects of cost and performance cannot be considered. This makes the construction, which is inherently more expensive, more prohibitive.

This patent will describe and disclose a technique that converts a product that solves many of the problems described above.

Disclosure of Invention

The main aim at of this application provides an elevator thing networking edge computing equipment who fuses multi-media and artificial intelligence to solve elevator safety monitoring's problem, solved the problem that elevator bulletin playback devices is with high costs, solved the problem that elevator operation data detected, solved elevator operation safety control's problem.

In order to achieve the purpose, the application provides an elevator Internet of things edge computing device integrating multimedia and artificial intelligence.

An elevator internet of things edge computing device fusing multimedia and artificial intelligence, comprising: the system comprises a multimedia processing device, an artificial intelligent image processing device, a data acquisition device, a data processing device and a network communication device; the elevator Internet of things edge computing equipment is connected with the network equipment through a network communication device, and the elevator Internet of things edge computing equipment is connected with a cloud platform through the network communication device; the system comprises a multimedia processing device, an artificial intelligence image processing device, a data acquisition device, a data processing device and a data processing device, wherein the multimedia processing device is used for processing multimedia data, the artificial intelligence image processing device is used for identifying detection images, the data acquisition device is used for acquiring elevator operation data, the data acquisition device is connected with the data processing device, and the data processing device is used for processing the data detected by the data acquisition device and responding. By arranging the edge computing equipment, the edge computing equipment not only can be used as a communication node, but also can process various data, so that elevator control is realized, the data can be processed locally, the network overhead and the pressure of a central computing center are reduced, the processing time for processing information can be reduced, and the response efficiency is improved.

Further, the present technology discloses a preferred elevator internet of things edge computing device, the data processing device is connected to the elevator control system through a communication link, and when the data processing device finds that the elevator is abnormally operated according to the data detected by the data acquisition device, a safety processing command is sent to the elevator.

Further, the elevator internet of things edge computing equipment is connected with a camera through a network, the camera is used for shooting an image inside the elevator, the camera sends video information to the elevator internet of things edge computing equipment through the network, an artificial intelligence image processing device of the elevator internet of things edge computing equipment is used for identifying unsafe objects, when the elevator identifies the unsafe objects, the artificial intelligence image processing device sends a message to a data processing device, and the data processing device controls an elevator system to perform safe operation.

Furthermore, the multimedia processing device is connected with a display screen in a linked mode, the multimedia processing device pulls or receives multimedia messages from the cloud, and the multimedia processing device processes multimedia data and sends the processed multimedia data to the display screen through the network communication device to play multimedia.

Furthermore, the multimedia processing device comprises a video processing module, an audio processing module and a picture processing module, the multimedia processing device is connected with a projection device and a loudspeaker through a network, the multimedia processing device displays images through the projection device, and the multimedia processing device plays sounds through the loudspeaker.

Further, the network communication device comprises a switch module and a router module, the elevator internet of things edge computing equipment can realize internal communication between different settings of the same network segment through the switch module, and the elevator internet of things edge computing equipment can realize communication of different network segments through the router module.

Furthermore, the data acquisition device comprises a plurality of sensors, the sensors are arranged at all positions of the elevator, the data acquisition device comprises an interface connected with an elevator control system, the data acquisition device is connected with the elevator control system through the interface, and the data acquisition device acquires elevator operation data through the interface.

Furthermore, the artificial intelligence image processing device comprises a video framing module, wherein the video framing module is connected with an image recognition model; the video framing module decomposes continuous video information into images of one frame, the video framing module sends the produced images of one frame to the image recognition model, and the image recognition model recognizes objects contained in the pictures.

Furthermore, the image recognition model is connected with an information statistics module, the image recognition model sends the recognition result to the information statistics module, the information statistics module is used for counting the number of the articles recognized by the image recognition model, and the image recognition result can be determined only when the continuous unit time reaches a certain threshold value, so that the recognition error is prevented; the information statistics module is connected with an information reporting module, the information statistics module sends results to the information reporting module, and the information reporting module sends the results to the cloud.

Furthermore, the information statistic module is connected with an information forwarding module, the information forwarding module is connected to a data processing device, and the data processing device makes elevator control response according to the multi-party data; the artificial intelligence image processing device comprises an archiving module, and the archiving module is used for storing the identification result.

The technology has the advantages that one device can integrate a plurality of functions, the investment of the device is reduced, and the economic benefit is improved;

the technology can realize the fusion of multiple information, is convenient for integrating all information to realize a safer control strategy and a dynamic and telescopic control strategy, and improves the safe and convenient elevator control;

by realizing the calculation of the edge, the load of the central server is reduced, the response speed of information processing is improved, the reliability and the stability of the system are improved, and the maintenance cost is reduced.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this application, serve to provide a further understanding of the application and to enable other features, objects, and advantages of the application to be more apparent. The drawings and their description illustrate the embodiments of the invention and do not limit it. In the drawings:

FIG. 1 is a schematic diagram of a structure provided in accordance with an embodiment of the present application;

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

In this application, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings. These terms are used primarily to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.

Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meaning of these terms in this application will be understood by those of ordinary skill in the art as appropriate.

In addition, the term "plurality" shall mean two as well as more than two.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

Example 1:

as shown in fig. 1, the invention discloses a preferred embodiment of an elevator internet of things edge computing device integrating multimedia and artificial intelligence, comprising: multimedia processing device, artificial intelligence image processing device, data acquisition device, data processing device, network communication device, wherein:

the multimedia processing device is used for receiving advertisement contents issued by the cloud platform, mainly multimedia files such as audio and video, judging whether the currently received contents are played immediately or not through an internally configured playing rule, and if the currently received contents are distributed to the advertisement screen in each elevator, only a simple display screen such as a pure display projector is needed. If not, the current content is temporarily stored, and then is issued to the advertisement screen according to the playing rule. The device has the advantages that only one simple display screen is required to be installed in the elevator car, and more calculation works such as multimedia processing are placed on the edge side. Therefore, the cost of the advertisement screen is reduced, nodes in a system network are reduced, and the fault occurrence rate is reduced.

The artificial intelligence image processing device is used for identifying video images in the car, and is connected with a camera in the car through an artificial intelligence model which is built in the device in advance, so that a machine can replace a manual inspection mode, objects needing to be controlled are identified in advance, and the objects are output to a management end to intervene or control related equipment of the elevator to intervene. For example, in order to prevent the fire risk caused by the fact that the battery car is charged upstairs, the battery car can be identified in real time when the battery car enters the elevator car, the elevator door is controlled not to be closed through the network communication device, and therefore the mode of manual inspection is replaced, labor cost is saved, and fire hazard is avoided.

The data acquisition device is used for acquiring data of the running state of the elevator, the running state of the elevator is acquired in real time through a sensor additionally arranged on relevant equipment of the elevator, whether the elevator runs abnormally is judged through the data processing device according to a judgment rule configured in the data processing device in advance, if the elevator runs abnormally, the elevator runs, the data acquisition device reports the elevator to the cloud platform through a network communication device, and the elevator runs, and the cloud platform sends the elevator to the field through a mobile terminal held by staff.

The data processing device is used for processing the data collected by the data collecting device, processing the elevator running data collected by the data collecting device through a processing rule which is built in advance, and transmitting the analyzed result to a corresponding application end or equipment end through a network through the network communication device.

The network communication device is used for data communication and forwarding between equipment, between devices and equipment and between application terminals, and transmits data sent by one terminal to the other receiving terminal through a network protocol, and meanwhile, the bidirectional communication of the data is kept, so that the equipment, the devices, the equipment and the application terminals can work more efficiently.

Example 2:

as shown in fig. 1, the invention discloses a preferred embodiment of an elevator internet of things edge computing device integrating multimedia and artificial intelligence, comprising:

the system comprises a multimedia processing device, an artificial intelligent image processing device, a data acquisition device, a data processing device and a network communication device; the elevator Internet of things edge computing equipment is connected with the network equipment through a network communication device, and the elevator Internet of things edge computing equipment is connected with a cloud platform through the network communication device; the system comprises a multimedia processing device, an artificial intelligence image processing device, a data acquisition device, a data processing device and a data processing device, wherein the multimedia processing device is used for processing multimedia data, the artificial intelligence image processing device is used for identifying detection images, the data acquisition device is used for acquiring elevator operation data, the data acquisition device is connected with the data processing device, and the data processing device is used for processing the data detected by the data acquisition device and responding. By arranging the edge computing equipment, the edge computing equipment not only can be used as a communication node, but also can process various data, so that elevator control is realized, the data can be processed locally, the network overhead and the pressure of a central computing center are reduced, the processing time for processing information can be reduced, and the response efficiency is improved.

The network communication device comprises a switch module and a router module, the elevator Internet of things edge computing equipment can realize internal communication between different settings of the same network segment through the switch module, and the elevator Internet of things edge computing equipment can realize communication of different network segments through the router module. Thus, the edge computing device can be used as a complete communication node to realize network communication. The network communication device is provided with a plurality of communication interfaces, including a network port, a network interface supporting POE, an optical fiber interface, wireless 4G communication, WiFi communication and Internet of things communication.

The data processing device is connected to the elevator control system through a communication link, and when the data processing device finds that the elevator runs abnormally according to the data detected by the data acquisition device, a safety processing command is sent to the elevator. The data acquisition device comprises a plurality of sensors, the sensors are arranged at all positions of the elevator, the data acquisition device comprises an interface connected with an elevator control system, the data acquisition device is connected with the elevator control system through the interface, and the data acquisition device acquires elevator operation data through the interface. The sensors comprise an acceleration sensor, a vibration sensor, a smoke sensor and the like, the running condition of the elevator is detected from another angle, the cross validation of information improves the comprehensive collection of elevator information, and the safety of elevator control is improved.

The elevator Internet of things edge computing equipment is connected with a camera through a network, the camera is used for shooting images inside the elevator, and the camera sends video information to the elevator Internet of things edge computing equipment through the network. The multimedia processing device is connected with the display screen in a linked mode, the multimedia processing device pulls or receives multimedia messages from the cloud end, and the multimedia processing device processes multimedia data and sends the processed multimedia data to the display screen through the network communication device to play multimedia. The multimedia processing device comprises a video processing module, an audio processing module and a picture processing module, the multimedia processing device is connected with a projection device and a loudspeaker through a network, the multimedia processing device displays images through the projection device, and the multimedia processing device plays sounds through the loudspeaker.

The artificial intelligence image processing device of the elevator internet of things edge computing equipment is used for identifying unsafe articles, when the elevator identifies the unsafe articles, the artificial intelligence image processing device sends a message to the data processing device, and the data processing device controls the elevator system to perform safe operation. The artificial intelligent image processing device comprises a video framing module, and the video framing module is connected with an image recognition model; the video framing module decomposes continuous video information into images of one frame, the video framing module sends the produced images of one frame to the image recognition model, and the image recognition model recognizes objects contained in the pictures. The image recognition model is connected with an information statistics module, the image recognition model sends a recognition result to the information statistics module, the information statistics module is used for counting the number of the articles recognized by the image recognition model, and the result can be determined only when the image recognition result reaches a certain threshold value in continuous unit time, so that recognition errors are prevented; the information statistics module is connected with an information reporting module, the information statistics module sends results to the information reporting module, and the information reporting module sends the results to the cloud. The information statistical module is connected with an information forwarding module, the information forwarding module is connected to a data processing device, and the data processing device makes elevator control response according to the multi-party data; the artificial intelligence image processing device comprises an archiving module, and the archiving module is used for storing the identification result.

The image recognition model comprises object recognition, number recognition and the like, can be upgraded on line, and can be intervened through manual recognition in the operation process, so that the recognition accuracy and recognition efficiency of the image recognition model are improved through continuous training.

The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.