阅读说明：本技术 一种扶梯的缺级检测方法、装置、设备及存储介质 (Method, device and equipment for detecting step defect of escalator and storage medium ) 是由 陈彦明 李智宇 陈小武 张立群 梁泽成 于 2019-11-20 设计创作，主要内容包括：本发明实施例公开了一种扶梯的缺级检测方法、装置、设备及存储介质。该方法包括：获取扶梯区域的视频图像,并在视频图像中确定缺级检测区域；在缺级检测区域中,识别出多个梯级边界线的位置；根据相邻的梯级边界线之间的梯级距离,以及预设的梯级距离阈值,判断扶梯是否存在缺级。本发明实施例所提供的技术方案,解决了现有扶梯缺级检测方法所采用的装置结构复杂、精度不足且占用扶梯空间而不利于加装的问题,实现了在扶梯设备外部检测扶梯缺级的问题,为检测设备的安装提供了便利,并提高了扶梯缺级检测的准确性。(The embodiment of the invention discloses a method, a device, equipment and a storage medium for detecting the step defect of an escalator. The method comprises the following steps: acquiring a video image of an escalator region, and determining a defective grade detection region in the video image; identifying the positions of a plurality of step boundary lines in the step-missing detection area; and judging whether the escalator has a step defect or not according to the step distance between adjacent step boundary lines and a preset step distance threshold. The technical scheme provided by the embodiment of the invention solves the problems that the device adopted by the existing escalator step-lack detection method is complex in structure, insufficient in precision and unfavorable for installation due to the fact that the escalator space is occupied, realizes the step-lack detection of the escalator outside the escalator equipment, provides convenience for installation of the detection equipment, and improves the step-lack detection accuracy of the escalator.)

1. A step defect detection method of an escalator is characterized by comprising the following steps:

acquiring a video image of an escalator region, and determining a defective grade detection region in the video image;

identifying the positions of a plurality of step boundary lines in the step defect detection area;

and judging whether the escalator has a step defect or not according to the step distance between the adjacent step boundary lines and a preset step distance threshold value.

2. The method of claim 1, further comprising, prior to identifying the location of the plurality of step boundary lines in the defect detection area:

acquiring a training sample set of the step boundary line; wherein the set of training samples comprises positive training samples and negative training samples; the video image of the escalator region of the training sample comprises a step boundary line; the video image of the escalator region of the negative training sample does not comprise a step boundary line;

setting labels for the positive training samples and the negative training samples, and respectively extracting directional gradient histogram features;

training the label of the positive training sample, the label of the negative training sample, the histogram feature of the directional gradient of the positive training sample and the histogram feature of the directional gradient of the negative training sample through a support vector machine to obtain a target detector;

accordingly, identifying the location of a plurality of step boundary lines in the defect detection area includes:

and marking the positions of the step boundary lines in the step-lacking detection area through a plurality of step boundary detection frames by the target detector.

3. The method of claim 2, further comprising, after marking the position of each step boundary line in the defect detection area by the target detector with a plurality of step boundary detection frames, respectively:

and carrying out coordinate marking on the midpoint of the left line of each step boundary detection frame, and taking the marked coordinate as the reference point coordinate of the step boundary line corresponding to the step boundary detection frame.

4. The method of claim 3, wherein determining whether the escalator has a step defect according to the step distance between adjacent step boundary lines and a preset step distance threshold comprises:

and calculating the step distance between the adjacent step boundary lines according to the reference point coordinates of each step boundary line, and judging whether the escalator has a step defect according to a preset step distance threshold value.

5. The method of claim 4, wherein calculating step distances between adjacent step boundary lines according to reference point coordinates of each of the step boundary lines if a left edge line of each of the step boundary detection frames is parallel to a y-axis comprises:

calculating the step distance between the adjacent step boundary lines according to the y-axis coordinate values of the adjacent step boundary lines; and the y-axis direction is the left line direction of the defect detection area.

6. The method of claim 4, wherein calculating step distances between adjacent step boundary lines according to reference point coordinates of each of the step boundary lines if a left edge line of each of the step boundary detection frames is not parallel to a y-axis comprises:

calculating the step distance between the adjacent step boundary lines according to the x-axis coordinate value and the y-axis coordinate of the adjacent step boundary lines; the x-axis direction is the upper edge line direction of the default detection area, and the y-axis direction is the left edge line direction of the default detection area.

7. The method of claim 1, wherein if it is determined that the escalator is in the absence of a step, an alarm notification is sent by voice, indicator lights and/or video.

8. A missing step detection device of an escalator is characterized by comprising:

the device comprises a step-lack detection area determining module, a step-lack detection area determining module and a step-lack detection area determining module, wherein the step-lack detection area determining module is used for acquiring a video image of an escalator area and determining a step-lack detection area in the video image;

the step boundary line identification module is used for identifying the positions of a plurality of step boundary lines in the step-missing detection area;

and the step lack judging module is used for judging whether the escalator has step lack according to the step distance between the adjacent step boundary lines and a preset step distance threshold value.

9. An apparatus, comprising:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the method of detecting a step defect of an escalator as claimed in any one of claims 1-7.

10. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing a method of detecting a step defect of an escalator as claimed in any one of claims 1-7.

Technical Field

The embodiment of the invention relates to the technical field of image recognition, in particular to a method, a device, equipment and a storage medium for detecting the grade defect of an escalator.

Background

At present, escalators are increasingly applied to the life of people, and the safety problem of the escalators needs to be paid more attention. Therefore, some detection devices are required to reflect the running state of the escalator at any time during the automatic running of the escalator. Due to the complex structure of the escalator, gaps exist among the steps, which easily causes the trapping of foreign matters, thereby causing serious safety threats, and the problems of the dislocation of the steps, the missing of the steps, the sinking of the steps and the like of the escalator caused by mechanical faults, and therefore, related detection equipment is needed to improve the use safety of the escalator.

The conventional staircase step defect detection methods mainly comprise two methods: one method is to arrange detection equipment at different positions of the escalator, but the method needs a large number of detection devices, occupies a large amount of installation space, and has a complex structure and insufficient precision; the other is to add a step sensor to the escalator, but the sensitivity of the general sensor is low, the detection process is complex, and the general sensor is easily influenced by external factors to cause errors. Meanwhile, the methods adopted by the two prior art need to add a large number of components on the original escalator, so that the great difficulty in rectifying and modifying the existing large-quantity elevator storage which is put into use is high, and the realization is not facilitated.

Disclosure of Invention

The embodiment of the invention provides a step-lack detection method, a step-lack detection device, step-lack detection equipment and a storage medium of an escalator, and aims to solve the problems that the conventional step-lack detection method of the escalator is complex in structure, insufficient in precision, and unfavorable for installation due to the fact that the space of the escalator is occupied.

In a first aspect, an embodiment of the present invention provides a method for detecting a step defect of an escalator, where the method includes:

acquiring a video image of an escalator region, and determining a defective grade detection region in the video image;

identifying the positions of a plurality of step boundary lines in the step-missing detection area;

and judging whether the escalator has a step defect or not according to the step distance between adjacent step boundary lines and a preset step distance threshold.

In a second aspect, an embodiment of the present invention provides a step defect detection apparatus for an escalator, including:

the device comprises a step-lack detection area determining module, a step-lack detection area determining module and a step-lack detection area determining module, wherein the step-lack detection area determining module is used for acquiring a video image of an escalator area and determining a step-lack detection area in the video image;

the step boundary line identification module is used for identifying the positions of a plurality of step boundary lines in the step-missing detection area;

and the step lack judging module is used for judging whether the escalator has step lack according to the step distance between adjacent step boundary lines and a preset step distance threshold value.

In a third aspect, an embodiment of the present invention further provides an apparatus, where the apparatus includes:

one or more processors;

a memory for storing one or more programs;

the camera is used for acquiring a video image of the escalator area;

when the one or more programs are executed by the one or more processors, the one or more processors implement the method for detecting the grade defect of the escalator provided by any embodiment of the invention.

In a fourth aspect, embodiments of the present invention further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, implement the method for detecting a step defect of an escalator provided in any of the embodiments of the present invention.

The embodiment of the invention provides a step lack detection scheme of an escalator, which is characterized in that after an area needing step lack detection is determined, the position of each step boundary line is identified, and the distance between adjacent step boundary lines is calculated to be compared with an actual distance threshold value, so that whether the escalator has step lack or not is judged. The problem of the device structure that current staircase lacks step detection method adopted complicated, the precision is not enough and occupy the staircase space and be unfavorable for installing additional is solved. The problem of detecting the lack of the escalator outside the escalator equipment is solved, convenience is provided for installation of the detection equipment, and the accuracy of detecting the lack of the escalator is improved.

Drawings

Fig. 1A is a flowchart of a step detection method for an escalator according to an embodiment of the present invention;

fig. 1B is a schematic view of a video image of an escalator region provided in accordance with one embodiment of the present invention;

fig. 2A is a flowchart of a step detection method for an escalator provided in the second embodiment of the present invention;

fig. 2B is a flowchart of a method for detecting a step defect of an escalator provided in a first specific application scenario of the present invention;

fig. 3 is a structural block diagram of a step-lack detection device of an escalator provided by the third embodiment of the invention;

fig. 4 is a schematic structural diagram of an apparatus according to a fourth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.