阅读说明：本技术 基于网关的电力越界行为告警方法、装置、设备和介质 (Power out-of-range behavior warning method, device, equipment and medium based on gateway ) 是由 王翀 罗洪江 杨康萍 王晓蕾 于 2021-09-15 设计创作，主要内容包括：本申请涉及一种基于网关的电力越界行为告警方法、装置、网关设备和存储介质。所述方法包括：网关设备确定变电站中的待识别区域；待识别区域中包含有与待检测的电力越界行为匹配的目标区域；通过安装于变电站的图像采集设备获取针对于待识别区域的连续多帧区域图像,利用预设的人体目标检测算法从连续多帧区域图像中提取出连续多帧存在目标人体的目标图像；根据目标图像生成针对于目标人体的行动轨迹,根据行动轨迹判断目标人体是否存在电力越界行为；若判断目标人体存在电力越界行为,则向目标区域对应的报警装置触发告警信号。采用本方法不容易发生报警误动,从而提高了告警的准确性。(The application relates to a gateway-based electric power out-of-range behavior warning method and device, gateway equipment and a storage medium. The method comprises the following steps: the method comprises the steps that gateway equipment determines an area to be identified in a transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected; acquiring continuous multi-frame region images aiming at a region to be identified through image acquisition equipment installed in a transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm; generating a motion track aiming at the target human body according to the target image, and judging whether the target human body has electric power out-of-range behavior or not according to the motion track; and if the electric power out-of-range behavior of the target human body is judged, triggering an alarm signal to an alarm device corresponding to the target area. By adopting the method, the alarm misoperation is not easy to occur, thereby improving the accuracy of the alarm.)

1. A power out-of-range behavior alarm method based on a gateway is applied to gateway equipment and comprises the following steps:

determining an area to be identified in a transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected;

acquiring continuous multi-frame region images aiming at the region to be identified through image acquisition equipment installed in the transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm;

generating a motion track aiming at the target human body according to the target image, and judging whether the target human body has electric power out-of-range behavior or not according to the motion track;

and if the electric power boundary crossing behavior of the target human body is judged, triggering an alarm signal to an alarm device corresponding to the target area.

2. The method of claim 1, wherein the determining the area to be identified in the substation comprises:

determining target power equipment from the power equipment of the transformer substation, and acquiring equipment position information corresponding to the target power equipment;

and acquiring the area to be identified and the target area according to the equipment position information.

3. The method according to claim 2, wherein the obtaining the area to be identified and the target area according to the device location information comprises:

acquiring a preset first distance and a preset second distance; wherein the first distance is greater than the second distance;

taking an area formed by taking the equipment position information as a circle center and the first distance as a radius as the area to be identified;

and taking the area formed by taking the equipment position information as a circle center and the second distance as a radius as the target area.

4. The method of claim 3, wherein the determining a target electrical device from the electrical devices of the substation comprises:

acquiring power equipment with working voltage larger than a preset voltage threshold value from the power equipment of the transformer substation as the target power equipment;

and/or

And acquiring the electric equipment with the mechanical transmission phenomenon from the electric equipment of the transformer substation as the target electric equipment.

5. The method of claim 1, wherein generating a trajectory of action for the target human from the target image comprises:

acquiring position information of the target human body in each frame of target image and shooting time corresponding to each frame of target image;

and generating a motion track aiming at the target human body by using the position information according to the time sequence of the shooting time corresponding to each frame of target image.

6. The method according to claim 5, wherein the determining whether the target human body has the electric power out-of-range behavior according to the action track comprises:

and if the action track is that the target human body continuously approaches the target area, judging that the electric power boundary crossing behavior exists in the target human body.

7. The method according to claim 1, characterized in that an infrared sensor is arranged in the zone boundary of the zone to be identified;

the acquiring of the continuous multi-frame region image aiming at the region to be identified through the image acquisition equipment installed in the transformer substation comprises the following steps:

and after the infrared sensor detects a trigger signal, acquiring continuous multi-frame area images aiming at the area to be identified through the image acquisition equipment.

8. A power out-of-range behavior alarm device based on a gateway is applied to gateway equipment and comprises the following components:

the area determining module is used for determining an area to be identified in the transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected;

the image acquisition module is used for acquiring continuous multi-frame region images aiming at the region to be identified through image acquisition equipment installed in the transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm;

the boundary crossing judging module is used for generating a motion track aiming at the target human body according to the target image and judging whether the target human body has electric power boundary crossing behavior according to the motion track;

and the alarm triggering module is used for triggering an alarm signal to an alarm device corresponding to the target area if the electric power out-of-range behavior of the target human body is judged.

9. A gateway device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.

Technical Field

The present application relates to the field of power security technologies, and in particular, to a power out-of-range behavior warning method and apparatus based on a gateway, a gateway device, and a storage medium.

Background

With the development of power technology, the power safety of the transformer substation is more and more emphasized. Meanwhile, the areas of the power transformer substation are more and more complex, dangerous or potential risk areas may exist in a plurality of transformer substation areas, for example, dangerous areas such as a power distribution cabinet or high-voltage equipment, alarm devices are usually set in the dangerous areas in order to ensure the safety of power personnel, and when the power personnel mistakenly enter the dangerous areas, the alarm devices are started to remind the power personnel to leave the dangerous areas.

Among the conventional art, the identification of entering the danger area by mistake for electric power personnel is usually carried out based on the mode of the infrared sensor which is arranged, the physical fence, the warning line and the hang tag are arranged in the boundary of the danger area to block, the infrared sensor is arranged on the boundary, and when the infrared sensor detects that someone passes through, the alarm is triggered. However, in this detection method, since the infrared sensor is prone to alarm malfunction, for example, when leaves drift into the detection area, an alarm is also triggered, and thus the alarm accuracy of the current border-crossing behavior alarm method is low.

Disclosure of Invention

In view of the foregoing, it is necessary to provide a power out-of-range behavior warning method and apparatus based on a gateway, a gateway device, and a storage medium.

A power out-of-range behavior alarm method based on a gateway is applied to gateway equipment and comprises the following steps:

determining an area to be identified in a transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected;

acquiring continuous multi-frame region images aiming at the region to be identified through image acquisition equipment installed in the transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm;

generating a motion track aiming at the target human body according to the target image, and judging whether the target human body has electric power out-of-range behavior or not according to the motion track;

and if the electric power boundary crossing behavior of the target human body is judged, triggering an alarm signal to an alarm device corresponding to the target area.

In one embodiment, the determining the area to be identified in the substation includes: determining target power equipment from the power equipment of the transformer substation, and acquiring equipment position information corresponding to the target power equipment; and acquiring the area to be identified and the target area according to the equipment position information.

In one embodiment, the acquiring the area to be identified and the target area according to the device location information includes: acquiring a preset first distance and a preset second distance; wherein the first distance is greater than the second distance; taking an area formed by taking the equipment position information as a circle center and the first distance as a radius as the area to be identified; and taking the area formed by taking the equipment position information as a circle center and the second distance as a radius as the target area.

In one embodiment, the determining a target electrical device from the electrical devices of the substation includes: acquiring power equipment with working voltage larger than a preset voltage threshold value from the power equipment of the transformer substation as the target power equipment; and/or acquiring the electric equipment with mechanical transmission phenomenon from the electric equipment of the substation as the target electric equipment.

In one embodiment, the generating a motion track for the target human body according to the target image includes: acquiring position information of the target human body in each frame of target image and shooting time corresponding to each frame of target image; and generating a motion track aiming at the target human body by using the position information according to the time sequence of the shooting time corresponding to each frame of target image.

In one embodiment, the determining whether the target human body has the power out-of-range behavior according to the action track includes: and if the action track is that the target human body continuously approaches the target area, judging that the electric power boundary crossing behavior exists in the target human body.

In one embodiment, an infrared sensor is arranged in the area boundary of the area to be identified; the acquiring of the continuous multi-frame region image aiming at the region to be identified through the image acquisition equipment installed in the transformer substation comprises the following steps: and after the infrared sensor detects a trigger signal, acquiring continuous multi-frame area images aiming at the area to be identified through the image acquisition equipment.

A power out-of-range behavior alarm device based on a gateway is applied to gateway equipment and comprises the following components:

the area determining module is used for determining an area to be identified in the transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected;

the image acquisition module is used for acquiring continuous multi-frame region images aiming at the region to be identified through image acquisition equipment installed in the transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm;

the boundary crossing judging module is used for generating a motion track aiming at the target human body according to the target image and judging whether the target human body has electric power boundary crossing behavior according to the motion track;

and the alarm triggering module is used for triggering an alarm signal to an alarm device corresponding to the target area if the electric power out-of-range behavior of the target human body is judged.

A gateway device comprising a memory storing a computer program and a processor implementing the steps of the above method when executing the computer program.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.

According to the electric power out-of-range behavior warning method and device based on the gateway, the gateway equipment and the storage medium, the gateway equipment determines the area to be identified in the transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected; acquiring continuous multi-frame region images aiming at a region to be identified through image acquisition equipment installed in a transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm; generating a motion track aiming at the target human body according to the target image, and judging whether the target human body has electric power out-of-range behavior or not according to the motion track; and if the electric power out-of-range behavior of the target human body is judged, triggering an alarm signal to an alarm device corresponding to the target area. The method comprises the steps of obtaining an image of a region to be identified, which comprises a target region matched with the electric power border crossing behavior to be detected, from image acquisition equipment through gateway equipment, finding out an image of a target human body from the image, and judging the border crossing behavior of the target human body through the action track of the target human body.

Drawings

FIG. 1 is a diagram of an application environment of a gateway-based power out-of-range behavior warning method according to an embodiment;

FIG. 2 is a flowchart illustrating a gateway-based power out-of-range behavior alerting method according to an embodiment;

FIG. 3 is a schematic diagram illustrating a positional relationship between a region to be recognized and a target region in one embodiment;

FIG. 4 is a schematic flow diagram illustrating the determination of an area to be identified in a substation according to one embodiment;

FIG. 5 is a schematic flow chart illustrating the acquisition of a region to be identified and a target region in one embodiment;

FIG. 6 is a schematic diagram illustrating a positional relationship between a region to be recognized and a target region in one embodiment;

FIG. 7 is a flow diagram illustrating the generation of an action track for a target human in one embodiment;

FIG. 8 is a block diagram of a gateway-based power violation behavior alerting device in one embodiment;

fig. 9 is an internal configuration diagram of a gateway device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The gateway-based electric power out-of-range behavior warning method can be applied to the application environment shown in fig. 1. The gateway device 102 communicates with the image capturing device 101 and the alarm apparatus 103 via a network. Specifically, the image acquisition device 101 may acquire, in real time, an area image of an area to be identified including a target area matched with the power boundary crossing behavior to be detected, and send the area image to the gateway device 102. Then, the gateway device 102 may find out a target image including a target human body from the received area image, and obtain a motion trajectory of the target human body to determine the power boundary crossing behavior, and if it is determined that the power boundary crossing behavior exists, trigger an alarm signal to the alarm device 103 of the target area, and perform an alarm of the power boundary crossing behavior by the alarm device 103. The gateway device 102 may be an intelligent gateway with edge computing capability, the image capturing device 101 may be implemented by a monitoring camera installed in a substation, and the alarm device 103 may be an alarm indicator lamp or an alarm broadcasting device installed in the target area.

In one embodiment, as shown in fig. 2, a gateway-based power out-of-range behavior warning method is provided, which is described by taking the gateway device 102 in fig. 1 as an example, and includes the following steps:

step S201, the gateway device 102 determines an area to be identified in the transformer substation; the region to be identified comprises a target region matched with the electric power boundary crossing behavior to be detected.

The area to be recognized is an area that needs image acquisition by the image acquisition device 101, and the area may include an area related to the power out-of-range behavior that needs to be detected, that is, a target area matched with the power out-of-range behavior to be detected, as shown in fig. 3, an area formed by a dotted line portion in the area to be recognized may be a target area matched with the power out-of-range behavior, and when there is a person entering the target area, that is, when the person enters the dotted line area, it may be determined that the person has the power out-of-range behavior. For example, a user may preset, through the gateway device 102, a target area matched with the power out-of-range behavior to be detected, which may be some areas where there may be a high-voltage leakage risk, and the like, and then the gateway device 102 may determine, according to the target area set by the user, an area to be identified that includes the target area from a plurality of areas of the substation.

Step S202, the gateway device 102 acquires continuous multi-frame region images aiming at the region to be identified through the image acquisition device 101 installed in the substation, and extracts continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm.

The area image refers to an image for an area to be identified, which is captured by the image capturing device 101, which may be installed in a substation. When the power out-of-range behavior alarm needs to be performed, the gateway device 102 may obtain, from the image capturing device 101, continuous multi-frame images for the area to be identified, which may be video recording information of the area to be identified, captured by the image capturing device 101 in a certain period of time, and extract video recording according to a recorded time frame, so as to obtain continuous multi-frame area images in the period of time. Then, the gateway device 102 may further find out an area image in which a human body portion exists in the image from the collected continuous multi-frame area images through a preset human body target detection algorithm, for example, a YOLO algorithm, as the target image.

Step S203, the gateway device 102 generates an action track aiming at the target human body according to the target image, and judges whether the power out-of-range behavior exists in the target human body according to the action track;

step S204, if the power out-of-range behavior of the target human body is judged, the gateway device 102 triggers an alarm signal to the alarm device 103 corresponding to the target area.

The action track refers to a motion track of a target human body in a target image in an area to be identified, and if the gateway device 102 obtains a plurality of continuous frames of target images, the action track of the target human body can be obtained, for example, the motion track is generated through a tracking algorithm, such as an LSTM algorithm, and whether the power out-of-range behavior of the target human body entering the target area occurs is determined according to the generated action track. If the gateway device 102 determines that the target human body will have the electric power out-of-range behavior, the alarm device 103 corresponding to the target area, which may be the alarm device 103 installed in the target area, is used as the alarm device 103 corresponding to the target area, an alarm signal is triggered to the alarm device 103, and the alarm device 103 performs an alarm for the person having the electric power out-of-range behavior.

In the power out-of-range behavior warning method based on the gateway, the gateway device 102 determines a region to be identified in a transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected; acquiring continuous multi-frame region images aiming at a region to be identified through image acquisition equipment 101 installed in a transformer substation, and extracting continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm; generating a motion track aiming at the target human body according to the target image, and judging whether the target human body has electric power out-of-range behavior or not according to the motion track; and if the electric power out-of-range behavior of the target human body is judged, triggering an alarm signal to the alarm device 103 corresponding to the target area. According to the method, the gateway device 102 is used for acquiring the image of the area to be identified, which contains the target area matched with the electric power border crossing behavior to be detected, from the image acquisition device 101, the image of the target human body is found out, and the action track of the target human body is judged so as to judge the border crossing behavior.

In one embodiment, as shown in fig. 4, step S201 may further include:

step S401, the gateway device 102 determines a target power device from the power devices of the substation, and acquires device location information corresponding to the target power device.

The target power equipment is power equipment which needs to perform power out-of-range behavior detection in a transformer substation, generally, the power out-of-range behavior alarm is used for preventing personnel from entering a dangerous area possibly caused by certain power equipment, and therefore, the setting of the area to be identified and the target area can also be determined according to the target power equipment. Specifically, the gateway device 102 may find out a target power device that needs to perform power out-of-range behavior determination from power devices of multiple substations, and determine device location information corresponding to the target power device.

In step S402, the gateway device 102 obtains the area to be identified and the target area according to the device location information.

After the gateway device 102 obtains the device location information of the target power device, it may determine the corresponding to-be-identified region and the target region according to the device location information, for example, it may be configured to generate a corresponding target region by taking the device location information as a center and taking the dangerous range as a range of the region according to a dangerous range that may be caused by the target power device and the device location information of the target power device, and obtain an appropriate to-be-identified region according to the target region and the device location information of the target power device.

Further, as shown in fig. 5, step S402 may further include:

step S501, the gateway device 102 obtains a preset first distance and a preset second distance; wherein the first distance is greater than the second distance.

In this embodiment, as shown in fig. 6, the area to be recognized and the target area may be two circular areas with different sizes formed by taking the target power device as a center, where the range of the circular area may be set according to the needs of the user, for example, the safe distance of the target power device may be set as the second distance for generating the target area, and then the user may also set a first distance larger than the second distance according to the second distance for generating the area to be recognized.

Step S502, the gateway device 102 takes the area formed by taking the device position information as the center of a circle and the first distance as the radius as the area to be identified;

in step S503, the gateway device 102 sets, as the target area, an area formed with the device location information as the center of a circle and the second distance as the radius.

After obtaining the first distance and the second distance, the gateway device 102 may generate the area to be identified and the target area according to the device location information of the target power device, and the first distance and the second distance, respectively. Specifically, the gateway device 102 may use the device location information as a center of a circle and use the first distance and the second distance as radii, respectively, to form two circular areas, which are the area to be identified and the target area, respectively.

In addition, in this embodiment, step S401 may further include: the gateway device 102 acquires, from the power devices of the substation, a power device having a working voltage greater than a preset voltage threshold as a target power device; and/or the gateway device 102 acquires the power device with the mechanical transmission phenomenon from the power devices of the substation as the target power device.

In this embodiment, the target power equipment may be high-voltage equipment that may exist in some substations or equipment that may cause a human injury accident due to a mechanical transmission phenomenon, and specifically, the gateway device 102 may use, as the target power equipment, a power equipment whose operating voltage is greater than a certain voltage threshold value, that is, a high-voltage equipment, in the power equipment of the substation, and may also use, as the target power equipment, a power equipment that has a mechanical transmission phenomenon, that is, a mechanical transmission equipment, so that it may be ensured that a person does not mistakenly enter a dangerous area of the high-voltage equipment or the mechanical transmission equipment.

In the above embodiment, the gateway device 102 may obtain the device location information of the high-voltage device or the mechanical transmission device in the substation, and the high-voltage device or the mechanical transmission device is used as a center to generate the region to be identified and the target region, respectively, so that the accuracy and the scientificity of the region to be identified and the target region obtained by the gateway device 102 may be ensured, and the accuracy and the safety of the electric power out-of-range behavior alarm may be further improved.

In one embodiment, as shown in fig. 7, step S203 may further include:

in step S701, the gateway device 102 obtains the position information of the target human body in each frame of target image and the shooting time corresponding to each frame of target image.

The shooting time refers to the shooting time of the target images of consecutive frames, and may be, for example, a time stamp corresponding to the target image shot by the image capture device 101. Specifically, after obtaining multiple consecutive frames of target images, the gateway device 102 may determine the position of the target human body in each frame of target image and a timestamp corresponding to each frame of target image as the corresponding shooting time.

In step S702, the gateway device 102 generates an action trajectory for the target human body using the position information in accordance with the time sequence of the shooting time corresponding to each frame of the target image.

Then, the gateway device 102 may sort the target images of the consecutive frames according to the time sequence of the shooting time of each frame of target image, and determine the sequence of the plurality of pieces of position information according to the sequence of the target images, so as to generate the action track for the target human body according to the sequence of the position information.

For example, if there is a target human body in the target images of 3 consecutive frames, and the time sequence of the corresponding shooting times is the target image a, the target image B, and the target image C, and the position information of the target human body in the target image a is the position a, the position information of the target human body in the target image B is the position B, and the position information of the target human body in the target image C is the position C, the generated action trajectory for the target human body is the action trajectory of the target human body from the position a to the position C after passing through the position B.

In step S203, the gateway device 102 may further determine whether the target human body has the power out-of-range behavior according to the action trajectory, and may further include: if the action track is that the target human body is continuously close to the target area, the gateway device 102 determines that the power out-of-range behavior exists in the target human body.

Then, the gateway device 102 may determine whether there is an electric power boundary crossing behavior according to the action track of the target human body, for example, the gateway device 102 may determine whether the target human body is approaching the target area continuously according to the extending direction of the action track, and if the action track determines that the target human body is approaching the target area continuously, the gateway device 102 may determine that the target human body may have the electric power boundary crossing behavior entering the target area, and then execute triggering an alarm signal to the alarm device 103 corresponding to the target area to prevent the target human body from entering the target area.

In this embodiment, the gateway device 102 may generate the action track of the target human body according to the obtained position information of the target human body in each frame of target image and the time sequence of the shooting time of each frame of target image, and may determine whether the power boundary-crossing behavior exists according to the action track of the target human body, so as to ensure the accuracy of the generated action track, and implement that the alarm can be given when the power boundary-crossing behavior does not occur in the target human body, thereby further improving the safety of the power boundary-crossing behavior alarm.

In addition, in one embodiment, an infrared sensor is arranged in the region boundary of the region to be identified; step S202 may further include: after the infrared sensor detects the trigger signal, the gateway device 102 acquires a continuous multiframe area image for the area to be identified through an image acquisition device.

In order to reduce the complexity of the gateway device 102 performing image analysis on the area image obtained by the image acquisition device 101, in this embodiment, an infrared sensor may be disposed in the area boundary of the area to be identified, and the gateway device 102 may perform detection of the power out-of-range behavior on the area image acquired by the image acquisition device 101 only after the infrared sensor detects a trigger signal, that is, the infrared sensor determines that an object enters the area to be identified. By the method, the complexity of electric power boundary crossing behavior detection can be effectively reduced, and the working efficiency of electric power boundary crossing behavior detection is improved.

In this embodiment, by setting the infrared sensor in the area boundary of the area to be identified, the gateway device 102 detects the power out-of-range behavior after the infrared sensor receives the trigger signal, so that the complexity of the power out-of-range behavior detection can be effectively reduced, and the working efficiency of the power out-of-range behavior detection can be improved.

In an application example, an electric power boundary crossing behavior warning method is further provided, namely images related to a dangerous area are collected through a camera, the images of the area are analyzed through an intelligent gateway with edge computing capability, whether boundary crossing behaviors of electric power personnel exist or not is judged, and if yes, warning is carried out. In particular, the method may comprise the steps of:

(1) and determining a region to be identified, wherein the region to be identified comprises a dangerous region.

The dangerous area refers to a substation area where high-voltage equipment/mechanical transmission equipment exists, specifically, a user may confirm, through an electronic map of the substation, the high-voltage equipment in the substation, for example, the equipment with an operating voltage greater than a certain voltage threshold or the mechanical transmission equipment with a possibility of mechanical transmission phenomenon, and respectively determine the dangerous area and an area to be identified according to the equipment positions of the high-voltage equipment/mechanical transmission equipment, for example, the dangerous area may be a region formed by centering on the position of the equipment and centering on a first distance as a radius, and the region formed by centering on the position of the equipment and centering on a second distance as a radius as an area to be identified; wherein the first distance is less than the second distance.

(2) The method comprises the steps of obtaining continuous frames of images aiming at a region to be identified through image acquisition equipment installed in a transformer substation, detecting target images of power personnel from the images by using a human body target detection algorithm, generating action tracks aiming at the power personnel, and judging whether power users can enter a dangerous region or not according to the action tracks.

Specifically, the action track for the power person is generated by extracting the position information of the power person in each target image and the corresponding shooting time in each target image, and generating the corresponding action track according to the position information based on the sequence of the shooting time.

And if the action track is that the power consumer is continuously close to a dangerous area in the area to be identified, judging that the power consumer can enter the dangerous area.

(3) And if the action track of the power user is determined to be entering a dangerous area, triggering an alarm device to an alarm signal.

(4) In addition, the setting of the infrared sensor in the boundary of the area to be identified may further include acquiring several consecutive frames of images for the area to be identified by an image acquisition device installed in the substation: after the infrared sensor detects the trigger signal, images of several consecutive frames are acquired for the area to be identified.

In the application example, the camera is used for collecting images related to the dangerous area, the images in the dangerous area are analyzed by using the intelligent gateway with the edge computing capability, whether the border crossing behavior of the electric power personnel exists or not is judged, if yes, an alarm is given, and the accuracy of the border crossing behavior alarm of the electric power personnel can be improved.

It should be understood that, although the steps in the flowcharts of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in the figures may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of execution of the steps or stages is not necessarily sequential, but may be performed alternately or in alternation with other steps or at least some of the other steps or stages.

In one embodiment, as shown in fig. 8, there is provided a gateway-based power out-of-range behavior warning apparatus, applied to a gateway device, including: the system comprises an area determining module 801, an image obtaining module 802, an out-of-range judging module 803 and an alarm triggering module 804, wherein:

the area determination module 801 is used for determining an area to be identified in the transformer substation; the area to be identified comprises a target area matched with the electric power border crossing behavior to be detected;

the image acquisition module 802 is configured to acquire continuous multi-frame region images for a region to be identified through image acquisition equipment installed in a substation, and extract continuous multi-frame target images with target human bodies from the continuous multi-frame region images by using a preset human body target detection algorithm;

the boundary crossing judging module 803 is configured to generate a motion trajectory for the target human body according to the target image, and judge whether the target human body has an electric power boundary crossing behavior according to the motion trajectory;

and the alarm triggering module 804 is configured to trigger an alarm signal to an alarm device corresponding to the target area if it is determined that the target human body has the electric power out-of-range behavior.

In an embodiment, the area determining module 801 is further configured to determine a target power device from power devices of the substation, and obtain device location information corresponding to the target power device; and acquiring the area to be identified and the target area according to the equipment position information.

In one embodiment, the area determining module 801 is further configured to obtain a preset first distance and a preset second distance; wherein the first distance is greater than the second distance; taking an area formed by taking the equipment position information as a circle center and taking the first distance as a radius as an area to be identified; and taking the area formed by taking the equipment position information as a circle center and the second distance as a radius as a target area.

In one embodiment, the area determining module 801 is further configured to obtain, from the power devices in the substation, a power device with an operating voltage greater than a preset voltage threshold as a target power device; and the power equipment is used for acquiring the power equipment with the mechanical transmission phenomenon from the power equipment of the substation as target power equipment.

In one embodiment, the boundary crossing determining module 803 is further configured to obtain position information of the target human body in each frame of target image and a shooting time corresponding to each frame of target image; and generating a motion track aiming at the target human body by using the position information according to the time sequence of the shooting time corresponding to each frame of target image.

In one embodiment, the boundary crossing determining module 803 is further configured to determine that the target human body has the electric power boundary crossing behavior if the action trajectory is that the target human body is continuously approaching the target area.

In one embodiment, an infrared sensor is arranged in the region boundary of the region to be identified; the image obtaining module 802 is further configured to obtain, by the image capturing device, a continuous multiframe area image for the area to be identified after the infrared sensor detects the trigger signal.

For specific limitations of the gateway-based power boundary crossing behavior warning device, reference may be made to the above limitations of the gateway-based power boundary crossing behavior warning method, which is not described herein again. The modules in the gateway-based power out-of-range behavior warning device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the gateway device, and can also be stored in a memory in the gateway device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a gateway device is provided, the internal structure of which may be as shown in fig. 9. The gateway device includes a processor, a memory, and a communication interface connected by a system bus. Wherein the processor of the gateway device is configured to provide computing and control capabilities. The memory of the gateway device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the gateway device is used for performing wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a gateway-based power out-of-bounds behavior alerting method.

Those skilled in the art will appreciate that the structure shown in fig. 9 is a block diagram of only a portion of the structure associated with the present application and does not constitute a limitation on the gateway device to which the present application applies, and that a particular gateway device may include more or less components than those shown, or combine certain components, or have a different arrangement of components.

In one embodiment, there is further provided a gateway device, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.