阅读说明：本技术 基于智能网关的输电线路外力破坏监测方法和装置 (Power transmission line external force damage monitoring method and device based on intelligent gateway ) 是由 孟秋实 何泽斌 黄凯涛 吴任博 邱烜 于 2021-07-23 设计创作，主要内容包括：本申请涉及一种基于智能网关的输电线路外力破坏监测方法,所述方法包括：获取针对输电线路设备采集的环境图像；所述环境图像表征所述输电线路设备所处位置预设范围内的环境状态；调用所述智能网关中的模型接口,通过所述模型接口中封装的图像识别模型基于所述环境图像,识别所述输电线路设备所处位置预设范围内是否存在破坏对象；所述破坏对象为对所述输电线路设备造成破坏的对象；当确定所述输电线路设备所处位置预设范围内存在破坏对象时,发送针对所述输电线路设备的预警信息,实现了输电线路设备的实时损毁防范,及时发现妨碍输电线路设备正常运行的因素并作出警示,将事后处理转变为事前预防,提高了防范效率。(The application relates to a power transmission line external force damage monitoring method based on an intelligent gateway, which comprises the following steps: acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment; calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment; when the damage object is determined to exist in the preset range of the position where the power transmission line equipment is located, the early warning information aiming at the power transmission line equipment is sent, real-time damage prevention of the power transmission line equipment is achieved, factors which hinder normal operation of the power transmission line equipment are found in time and are warned, post-processing is converted into pre-prevention, and prevention efficiency is improved.)

1. A power transmission line external force damage monitoring method based on an intelligent gateway is characterized by being applied to the intelligent gateway and comprising the following steps:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

2. The method of claim 1, wherein the invoking a model interface in the intelligent gateway and identifying whether a damage object exists within a preset range of a location of the power transmission line device based on the environment image through an image recognition model encapsulated in the model interface comprises:

calling a plurality of model interfaces in the intelligent gateway, and identifying whether a specified type of damage object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in each model interface based on the environment image;

wherein the image recognition model comprises: the system comprises a pile machine identification model, a cement grouting vehicle identification model, a road roller identification model, a transport vehicle identification model, a forest fire identification model, a smoke identification model, a wire foreign matter identification model and a film identification model.

3. The method of claim 2, further comprising:

obtaining a sample environment image and a destructive object label corresponding to the sample environment image;

inputting the sample environment image into a neural network model to be trained, and predicting a damage object existing in the sample environment image through the neural network model to obtain a prediction result;

and adjusting model parameters corresponding to the neural network model according to the prediction result and the damaged object label until a training end condition is met, so as to obtain a trained image recognition model.

4. The method of claim 1, wherein the obtaining the environmental image collected for the power transmission line equipment comprises:

acquiring a monitoring video acquired by a camera device aiming at the power transmission line device;

and extracting multi-frame images from the monitoring video to be used as environment images.

5. The method according to claim 4, wherein the acquiring of the monitoring video acquired by the camera device for the power transmission line device comprises:

acquiring a monitoring video acquired by the unmanned aerial vehicle for the power transmission line equipment during inspection;

and/or the presence of a gas in the gas,

acquiring a monitoring video acquired by monitoring equipment; the monitoring equipment is located in a preset range of the power transmission line equipment.

6. The method of claim 1, wherein the sending early warning information for the power transmission line device comprises:

acquiring a danger level corresponding to the damaged object;

and determining a related terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the related terminal.

7. The method of claim 6, wherein the step of obtaining the corresponding risk level of the damaged object is followed by:

judging whether the danger level reaches a preset danger level or not;

if yes, executing the association terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the association terminal;

and if not, executing the acquisition of the environment image acquired by the power transmission line equipment again.

8. The utility model provides a transmission line external damage monitoring devices based on intelligent gateway which characterized in that is applied to intelligent gateway, the device includes:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.

Technical Field

The application relates to the technical field of power transmission lines, in particular to a power transmission line external force damage monitoring method and device based on an intelligent gateway, computer equipment and a storage medium.

Background

With the continuous improvement of power grids, power grid equipment is increasingly abundant, and a large number of exposed power grid equipment, such as power transmission lines in cities or in the field, exist.

In the prior art, in order to avoid the damage of the power transmission line caused by external force, such as the accidental or artificial damage of the power transmission line, a special inspection person is required to be assigned to perform regular inspection on the power transmission line. However, this method has a certain hysteresis, and because the number of inspectors is limited, it is difficult to inspect a large number of power transmission line facilities in a short time, and it is impossible to comprehensively prevent the damage of the power transmission line due to external force. Therefore, there is a problem that the prevention efficiency is low and the prevention is delayed in the prevention of the damage of the power transmission line equipment.

Disclosure of Invention

Therefore, it is necessary to provide a method and an apparatus for monitoring external damage to a power transmission line based on an intelligent gateway, a computer device, and a storage medium for solving the above technical problems.

A power transmission line external force damage monitoring method based on an intelligent gateway is applied to the intelligent gateway, and comprises the following steps:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

In one embodiment, the calling a model interface in the intelligent gateway, and identifying whether a damaged object exists within a preset range of a location where the power transmission line equipment is located through an image recognition model encapsulated in the model interface based on the environment image includes:

calling a plurality of model interfaces in the intelligent gateway, and identifying whether a specified type of damage object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in each model interface based on the environment image;

wherein the image recognition model comprises: the system comprises a pile machine identification model, a cement grouting vehicle identification model, a road roller identification model, a transport vehicle identification model, a forest fire identification model, a smoke identification model, a wire foreign matter identification model and a film identification model.

In one embodiment, the method further comprises the following steps:

obtaining a sample environment image and a destructive object label corresponding to the sample environment image;

inputting the sample environment image into a neural network model to be trained, and predicting a damage object existing in the sample environment image through the neural network model to obtain a prediction result;

and adjusting model parameters corresponding to the neural network model according to the prediction result and the damaged object label until a training end condition is met, so as to obtain a trained image recognition model.

In one embodiment, the acquiring an environmental image collected for a power transmission line device includes:

acquiring a monitoring video acquired by a camera device aiming at the power transmission line device;

and extracting multi-frame images from the monitoring video to be used as environment images.

In one embodiment, the acquiring a monitoring video acquired by a camera device for a power transmission line device includes:

acquiring a monitoring video acquired by the unmanned aerial vehicle for the power transmission line equipment during inspection;

and/or the presence of a gas in the gas,

acquiring a monitoring video acquired by monitoring equipment; the monitoring equipment is located in a preset range of the power transmission line equipment.

In one embodiment, the sending the warning information for the power transmission line device includes:

acquiring a danger level corresponding to the damaged object;

and determining a related terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the related terminal.

In one embodiment, after the step of obtaining the risk level corresponding to the damaged object, the method further includes:

judging whether the danger level reaches a preset danger level or not;

if yes, executing the association terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the association terminal;

and if not, executing the acquisition of the environment image acquired by the power transmission line equipment again.

The utility model provides a transmission line external damage monitoring devices based on intelligent gateway, is applied to intelligent gateway, the device includes:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

A computer device comprising a memory storing a computer program and a processor implementing the steps of the method as claimed in any one of the above when the computer program is executed.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of the preceding claims.

According to the method, the device, the computer equipment and the storage medium for monitoring the external force damage of the power transmission line based on the intelligent gateway, the environment image acquired by the power transmission line equipment can be acquired, the model interface in the intelligent gateway is called, whether a damage object exists in the preset range of the position of the power transmission line equipment is identified based on the environment image through the image identification model encapsulated in the model interface, and when the damage object exists in the preset range of the position of the power transmission line equipment, the early warning information for the power transmission line equipment is sent, so that the real-time damage prevention of the power transmission line equipment is realized, the factors hindering the normal operation of the power transmission line equipment are timely found and the warning is given, the after-treatment is changed into the before-prevention, and the prevention efficiency is improved.

Drawings

Fig. 1 is a schematic flowchart of a method for monitoring external damage to a power transmission line based on an intelligent gateway in an embodiment;

fig. 2 is a block diagram of a device for monitoring external damage to a power transmission line based on an intelligent gateway in one embodiment;

FIG. 3 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

In an embodiment, as shown in fig. 1, a method for monitoring external damage to a power transmission line based on an intelligent gateway is provided, and this embodiment is exemplified by applying the method to the intelligent gateway, and the intelligent gateway may be implemented by an independent server or a server cluster formed by a plurality of servers. It is understood that the method can also be applied to a terminal, and can also be applied to a system comprising the terminal and a server, and is realized through the interaction of the terminal and the server. In this embodiment, the method may include the steps of:

step 101, an environment image collected by the power transmission line equipment is obtained.

The environment image represents the environment state of the power transmission line equipment within a preset range. For example, the environment image may include the power transmission line equipment and the environment around the power transmission line equipment, such as construction conditions and traffic conditions. The power transmission line equipment may include a power transmission line erected outdoors.

In specific implementation, the environmental image of the power transmission line equipment can be acquired through the camera equipment and uploaded to the intelligent gateway, so that the intelligent gateway can acquire the environmental image of the power transmission line equipment.

And 102, calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not based on the environment image through an image identification model packaged in the model interface.

The damage object may be an object that damages the transmission line equipment, such as a pile machine, a cement grouting material, a road roller, a transportation vehicle, a mountain fire, smoke, a foreign wire, a film, and the like that are or will be damaged and damage the transmission line equipment. Specifically, for example, a pile driver, a cement grouting agent, a road roller, a transportation vehicle, and the like located in the range of the underline protection area or the preset range of the tower footing may affect the normal operation of the transmission line equipment, a mountain fire located in the range of the underline protection area or the preset range of the tower footing may cause a line trip, smoke may be caused by the mountain fire, and a foreign matter, a thin film, and the like of a wire may affect the line safety.

In practical application, after the environment image corresponding to the power transmission line equipment is obtained, a model interface in an intelligent gateway can be called, a pre-trained image recognition model is packaged in the model interface, and the image recognition model can recognize a damage object which can damage the power transmission line equipment in the environment image. Specifically, the image recognition model may recognize whether a damage object exists within a preset range of a position where the power transmission line device is located based on the environment image, and output a corresponding recognition result. By encapsulating the image recognition model in the interface and deploying the interface in the intelligent gateway, the use convenience of the image recognition model is improved, and the image recognition model can be conveniently reused by workers.

Step 103, when it is determined that a damage object exists in the preset range of the position where the power transmission line equipment is located, sending early warning information for the power transmission line equipment.

After the recognition result output by the image recognition model is obtained, the intelligent gateway can read and further process the recognition result. Specifically, if it is determined that the damage object exists at the position of the power transmission line device according to the identification result, the warning information for the power transmission line device may be sent.

In the embodiment, the environmental image acquired by the power transmission line equipment can be acquired, the model interface in the intelligent gateway is called, whether a damage object exists in the preset range of the position of the power transmission line equipment is identified through the image identification model encapsulated in the model interface based on the environmental image, and when the damage object exists in the preset range of the position of the power transmission line equipment, the early warning information aiming at the power transmission line equipment is sent, so that the real-time damage prevention of the power transmission line equipment is realized, the factors hindering the normal operation of the power transmission line equipment are found in time and a warning is given, the post-processing is converted into pre-prevention, and the prevention efficiency is improved.

In an embodiment, the calling a model interface in the intelligent gateway, and identifying whether a damaged object exists within a preset range of a location where the power transmission line device is located through an image recognition model encapsulated in the model interface based on the environment image includes:

calling a plurality of model interfaces in the intelligent gateway, and identifying whether a specified type of damage object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in each model interface based on the environment image;

wherein the image recognition model comprises: the system comprises a pile machine identification model, a cement grouting vehicle identification model, a road roller identification model, a transport vehicle identification model, a forest fire identification model, a smoke identification model, a wire foreign matter identification model and a film identification model.

In practical application, different image recognition models can be trained respectively for dialed-through destructive objects, one image recognition model is trained for each type of destructive object, and each image recognition model is packaged in one model interface independently.

After the environment image of the power transmission line equipment is obtained, a plurality of model interfaces in the intelligent gateway can be called, the image recognition model packaged in each model interface can analyze the currently input environment image and recognize whether the specified type of damage object exists in the preset range of the position of the power transmission line equipment. For example, the pile driver identification model may identify whether a pile driver image exists in the environment image, the grout vehicle identification model may identify whether a grout vehicle image exists in the environment image, the transport vehicle identification model may identify whether a transport vehicle image exists in the environment image, the mountain fire identification model may identify whether a mountain fire image exists in the environment image, the smoke identification model may identify whether a related image of smoke exists in the environment image, the wire foreign matter identification model may identify whether a foreign matter exists on a wire in the environment image, and the film identification model may identify whether the wire in the environment image is covered by a film.

In this embodiment, by calling a plurality of model interfaces in the intelligent gateway, and identifying whether a specific type of damaged object exists within a preset range of the position of the power transmission line equipment based on the environment image through the image identification model encapsulated in each model interface, one or more damaged objects near the power transmission line equipment can be accurately identified, and the identification efficiency is improved.

In one embodiment, the method may further comprise the steps of:

obtaining a sample environment image and a destructive object label corresponding to the sample environment image; inputting the sample environment image into a neural network model to be trained, and predicting a damage object existing in the sample environment image through the neural network model to obtain a prediction result; and adjusting model parameters corresponding to the neural network model according to the prediction result and the damaged object label until a training end condition is met, so as to obtain a trained image recognition model.

As an example, the corrupt object tag may comprise at least one of: pile machine label, cement grouting vehicle label, road roller label, transport vehicle label, mountain fire label, smog label, wire foreign matter label, film label. The neural network model may be an artificial intelligence neural network algorithm.

In a specific implementation, a sample environment image and a destructive object tag corresponding to the sample environment image may be obtained, where a shooting mode of the sample environment image may be the same as a shooting mode of an environment image in a monitoring process.

After the sample environment image is obtained, the sample environment image can be input into a neural network model to be trained, and a damage object existing in the sample environment image is predicted through the neural network model based on the input sample environment image, so that a prediction result is obtained. After the prediction result is obtained, the model parameters corresponding to the neural network model may be adjusted according to the prediction result and the damaged object label, for example, by using a back propagation algorithm. After the parameters are adjusted, the step of inputting the sample environment image into the neural network model to be trained can be returned, and the above process is repeated until the training end condition is met, for example, the loss function reaches the threshold value or the current iteration number reaches the preset iteration number, so that the trained image recognition model can be obtained, and the image recognition model can be packaged in an interface form.

In this embodiment, a sample environment image and a damage object label corresponding to the sample environment image may be obtained, the sample environment image is input to a neural network model to be trained, a damage object existing in the sample environment image is predicted through the neural network model, a prediction result is obtained, a model parameter corresponding to the neural network model is adjusted according to the prediction result and the damage object label until a training end condition is satisfied, a trained image recognition model is obtained, and an image recognition model can be provided for rapidly recognizing a damage object that may damage power transmission line equipment.

In one embodiment, the acquiring the environmental image collected for the power transmission line equipment may include the following steps:

acquiring a monitoring video acquired by a camera device aiming at the power transmission line device; and extracting multi-frame images from the monitoring video to be used as environment images.

In specific implementation, video monitoring can be performed on the power transmission line equipment through the camera equipment, and corresponding monitoring videos are stored. After the monitoring video is obtained, the camera device can upload the monitoring video to the intelligent gateway for unified processing. When the monitoring video acquired by the camera equipment for the power transmission line equipment is acquired, the intelligent gateway can extract a plurality of frames of images from the monitoring video to be used as environment images.

Specifically, when the intelligent gateway extracts images from the monitoring video, the images can be extracted according to a preset time interval, a high-frequency time period during which the power transmission line equipment is damaged can be determined based on historical damage records, and continuous multi-frame images are selected from the monitoring video as environment images based on the high-frequency time period.

In this embodiment, a plurality of frames of images are extracted from the monitoring video by acquiring the monitoring video acquired by the camera device for the power transmission line device, and the images are used as environmental images, so that the power transmission line device can be monitored timely and quickly.

In an embodiment, the acquiring the monitoring video acquired by the camera device for the power transmission line device may include the following steps:

acquiring a monitoring video acquired by the unmanned aerial vehicle for the power transmission line equipment during inspection; and/or acquiring a monitoring video acquired by monitoring equipment; the monitoring equipment is located in a preset range of the power transmission line equipment.

Specifically, to open air transmission circuit equipment, can patrol and examine it through unmanned aerial vehicle, to the surveillance video that transmission line equipment gathered when unmanned aerial vehicle patrols and examines, its angle that corresponds can be for overlooking the angle, and intelligent gateway can confirm when analyzing it and destroy the distribution condition of object on the plane.

Alternatively, a fixed monitoring device, for example, a monitoring camera mounted on a wall or a column, may be set within a preset range of the power transmission line device, and the monitoring video for the power transmission line device is acquired by the monitoring camera. The monitoring video collected by the monitoring device may be a video at a bottom view angle.

In this embodiment, can acquire the surveillance video that unmanned aerial vehicle patrolled and examined the time and gathered to transmission line equipment, perhaps, can acquire the surveillance video that supervisory equipment gathered, can gather near transmission line equipment's environment image by the multi-angle ground, effectively improve the discernment accuracy of destruction object, improve and take precautions against efficiency.

In one embodiment, the sending the warning information for the power transmission line device may include:

acquiring a danger level corresponding to the damaged object; and determining a related terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the related terminal.

In particular implementations, different damaging objects may have different levels of risk. Specifically, for example, for recognized cement grouting vehicles, road rollers, transport vehicles, foreign matters of wires and films, because the influence on the normal operation of the transmission line equipment is low or the possibility of occurrence of abnormality is low, the corresponding danger level can be a common hidden danger level; when the pile machine is identified, the pile machine may have a significant influence on the transmission line equipment during construction operation, for example, the underground transmission line is cut off, so that the corresponding danger level is a significant hidden danger level; when it is recognized that mountain fire or smoke is equal to a fire-related damage object, since a fire is easily caused, the corresponding danger level is an emergency risk level.

After the damaged object is determined through the image recognition model, the danger level corresponding to the damaged object can be obtained according to a preset mapping relation, and the associated terminal corresponding to the danger level is determined. After the association terminal is determined, early warning information aiming at the power transmission line equipment can be sent to the association terminal, a user is reminded to check the field condition in time, and corresponding preventive measures are taken.

In the embodiment, the danger level corresponding to the damage object can be acquired, the associated terminal corresponding to the danger level is determined, and the early warning information aiming at the power transmission line equipment is sent to the associated terminal, so that related personnel can be timely reminded to process the information, and the prevention efficiency is improved.

In one embodiment, after the step of obtaining the corresponding risk level of the damaged object, the method may further include the steps of:

judging whether the danger level reaches a preset danger level or not; if yes, executing the association terminal corresponding to the danger level, and sending early warning information aiming at the power transmission line equipment to the association terminal; and if not, executing the acquisition of the environment image acquired by the power transmission line equipment again.

In practical application, after the danger level corresponding to the damage object is obtained, whether the danger level reaches a preset danger level or not can be judged. If the current danger level is determined to reach a preset danger level, such as a major hidden danger level, an associated terminal corresponding to the danger level can be determined, and early warning information for the power transmission line equipment is sent to the associated terminal to notify related personnel. If it is determined that the current danger level does not reach a preset danger level, for example, a slight hidden danger level, due to the fact that the damage degree generated by the slight hidden danger level is small, related personnel can be temporarily not prompted, the intelligent gateway can acquire the environment image acquired by the power transmission line equipment again, and the power transmission line equipment is continuously monitored.

In this embodiment, whether the danger level reaches a preset danger level or not may be determined, if yes, an associated terminal corresponding to the danger level is determined, and early warning information for the power transmission line equipment is sent to the associated terminal; if not, the environment image acquired by the power transmission line equipment is acquired again, so that data processing resources can be saved, and frequent reminding is avoided.

It should be understood that, although the steps in the flowchart of fig. 1 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 1 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.

In one embodiment, as shown in fig. 2, there is provided a power transmission line external force damage monitoring device based on an intelligent gateway, applied to the intelligent gateway, the device including:

an environment image acquisition module 201, configured to acquire an environment image acquired for the power transmission line device; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

the interface calling module 202 is configured to call a model interface in the intelligent gateway, and identify whether a damaged object exists within a preset range of a location where the power transmission line equipment is located based on the environment image through an image identification model encapsulated in the model interface; the damage object is an object which causes damage to the power transmission line equipment;

the early warning information sending module 203 is configured to send early warning information for the power transmission line device when it is determined that a damage object exists within a preset range of a position where the power transmission line device is located.

In an embodiment, the interface calling module 202 is specifically configured to call a plurality of model interfaces in the intelligent gateway, and identify, based on the environment image, whether a specific type of damaged object exists within a preset range of a location where the power transmission line device is located through an image identification model encapsulated in each model interface;

wherein the image recognition model comprises: the system comprises a pile machine identification model, a cement grouting vehicle identification model, a road roller identification model, a transport vehicle identification model, a forest fire identification model, a smoke identification model, a wire foreign matter identification model and a film identification model.

In one embodiment, the apparatus further comprises:

the label obtaining module is used for obtaining a sample environment image and a destructive object label corresponding to the sample environment image;

the prediction module is used for inputting the sample environment image into a neural network model to be trained, predicting a damage object existing in the sample environment image through the neural network model, and obtaining a prediction result;

and the model training module is used for adjusting model parameters corresponding to the neural network model according to the prediction result and the damaged object label until a training end condition is met, so as to obtain a trained image recognition model.

In one embodiment, the environment image acquisition module 201 includes:

the monitoring video acquisition submodule is used for acquiring a monitoring video acquired by the camera equipment aiming at the power transmission line equipment;

and the image extraction submodule is used for extracting multi-frame images from the monitoring video to be used as environment images.

In one embodiment, the surveillance video acquisition sub-module is specifically configured to:

acquiring a monitoring video acquired by the unmanned aerial vehicle for the power transmission line equipment during inspection;

and/or the presence of a gas in the gas,

acquiring a monitoring video acquired by monitoring equipment; the monitoring equipment is located in a preset range of the power transmission line equipment.

In one embodiment, the warning information sending module 203 includes:

the danger level determining submodule is used for acquiring a danger level corresponding to the damaged object;

and the associated terminal determining submodule is used for determining the associated terminal corresponding to the danger level and sending early warning information aiming at the power transmission line equipment to the associated terminal.

In one embodiment, the warning information sending module 203 further includes:

the judgment submodule is used for judging whether the danger level reaches a preset danger level; if yes, calling the associated terminal to determine a submodule; if not, the environment image acquisition module 201 is called.

For specific limitations of the power transmission line external force damage monitoring device based on the intelligent gateway, refer to the above limitations of the power transmission line external force damage monitoring method based on the intelligent gateway, which are not described herein again. All modules in the power transmission line external force damage monitoring device based on the intelligent gateway can be completely or partially realized through software, hardware and a combination of the software and the hardware. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 3. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing the environment image. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to realize the intelligent gateway-based power transmission line external force damage monitoring method.

Those skilled in the art will appreciate that the architecture shown in fig. 3 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

In one embodiment, the steps in the other embodiments described above are also implemented when the computer program is executed by a processor.

In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:

acquiring an environment image acquired aiming at the power transmission line equipment; the environment image represents an environment state in a preset range of the position of the power transmission line equipment;

calling a model interface in the intelligent gateway, and identifying whether a damaged object exists in a preset range of the position of the power transmission line equipment or not through an image identification model packaged in the model interface based on the environment image; the damage object is an object which causes damage to the power transmission line equipment;

and when the fact that the damage object exists in the preset range of the position where the power transmission line equipment is located is determined, sending early warning information aiming at the power transmission line equipment.

In one embodiment, the computer program when executed by the processor also performs the steps in the other embodiments described above.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.