阅读说明：本技术 骑行安全实现方法、装置、介质及电子设备 (Riding safety implementation method, device, medium and electronic equipment ) 是由 孙路伟 王斌 郑运广 赵然 王小明 朱光 贾侦修 于 2021-03-19 设计创作，主要内容包括：本发明提供了一种骑行安全实现方法,包括：根据终端的传感器数据,确定非机动车的运动状态,当非机动车的运动状态为骑行状态时,通过终端的摄像头获取非机动车所处环境的至少一张图像,向服务器发送非机动车所处环境的至少一张图像,以使得服务器根据非机动车所处环境的至少一张图像,确定非机动车的环境信息和行驶信息,这样终端可以根据非机动车的环境信息和行驶信息,触发逆行报警机制,播放逆行报警信息,以此方式可以自动播放报警信息,以提醒快递员或外卖员要安全骑行,这样保证了行人和自己的安全,还可以避免交通事故的发生。(The invention provides a method for realizing riding safety, which comprises the following steps: the method comprises the steps of determining the motion state of the non-motor vehicle according to sensor data of a terminal, obtaining at least one image of the environment where the non-motor vehicle is located through a camera of the terminal when the motion state of the non-motor vehicle is the riding state, sending the at least one image of the environment where the non-motor vehicle is located to a server, enabling the server to determine environment information and running information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located, and therefore the terminal can trigger a retrograde motion alarm mechanism according to the environment information and the running information of the non-motor vehicle to play retrograde motion alarm information.)

1. A method for realizing riding safety is applied to a terminal, the terminal is fixed on a non-motor vehicle, and the method comprises the following steps:

determining the motion state of the non-motor vehicle according to the sensor data of the terminal;

when the motion state of the non-motor vehicle is a riding state, acquiring at least one image of the environment where the non-motor vehicle is located through a camera of the terminal;

sending at least one image of the environment where the non-motor vehicle is located to a server, so that the server determines environment information and driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located;

receiving environmental information and driving information of the non-motor vehicle transmitted by the server;

and triggering a retrograde motion alarm mechanism according to the environmental information and the driving information of the non-motor vehicle, and playing retrograde motion alarm information.

2. The method of claim 1, wherein determining the motion state of the non-motor vehicle from the sensor data of the terminal comprises:

when the angle sensor data of the terminal is in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is more than 5km/h, determining that the motion state of the non-motor vehicle is a riding state; or

And when the angle sensor data of the terminal is not in the range of 20-90 degrees and the GPS sensor data of the terminal is less than or equal to 5km/h, determining that the motion state of the non-motor vehicle is a non-riding state.

3. The method of claim 1, further comprising:

storing the motion state of the non-motor vehicle in real time; and

and storing the environmental information and the driving information of the non-motor vehicle in real time.

4. The method of claim 3, further comprising:

monitoring the terminal screen;

when an event that a user operates the terminal screen is monitored, inquiring the motion state of the non-motor vehicle and inquiring the environmental information of the non-motor vehicle;

and if the motion state of the non-motor vehicle is the riding state and the environment information of the non-motor vehicle is the outdoor environment, triggering an operation alarm mechanism and displaying operation alarm information.

5. A riding safety implementation method is applied to a server, and the method further comprises the following steps:

when the motion state of the non-motor vehicle is a riding state, receiving at least one image of the environment where the non-motor vehicle is located, which is sent by a terminal;

determining environment information and driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located;

and sending the environmental information and the driving information of the non-motor vehicle to the terminal, so that the terminal triggers an alarm mechanism and plays alarm information according to the environmental information and the driving information of the non-motor vehicle.

6. The method of claim 5, wherein determining environmental information and driving information for the non-motor vehicle based on at least one image of an environment in which the non-motor vehicle is located comprises:

processing at least one image of the environment where the non-motor vehicle is located through an artificial intelligence image recognition algorithm in an AI layer to obtain environment information and running information of the non-motor vehicle, wherein the environment information of the non-motor vehicle comprises an indoor environment or an outdoor environment, and the running information of the non-motor vehicle comprises reverse running or normal running.

7. The utility model provides a safe realization device rides, is applied to the terminal, the terminal is fixed in on the non-motor vehicle, and the device includes:

the motion state determining module is used for determining the motion state of the non-motor vehicle according to the sensor data of the terminal;

the image acquisition module is used for acquiring at least one image of the environment where the non-motor vehicle is located through a camera of the terminal when the motion state of the non-motor vehicle is the riding state;

the sending module is used for sending the at least one image of the environment where the non-motor vehicle is located to a server so that the server can determine the environment information and the driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located;

the receiving module is used for receiving the environment information and the driving information of the non-motor vehicle, which are sent by the server;

and the retrograde motion alarm module is used for triggering a retrograde motion alarm mechanism according to the environmental information and the running information of the non-motor vehicle and playing retrograde motion alarm information.

8. The utility model provides a safe realizing device rides, is applied to the server, and the device still includes:

the non-motor vehicle driving system comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving at least one image of the environment where a non-motor vehicle is located, which is sent by a terminal, when the motion state of the non-motor vehicle is a riding state;

the image analysis module is used for determining the environment information and the driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located;

and the sending module is used for sending the environmental information and the driving information of the non-motor vehicle to the terminal so that the terminal triggers an alarm mechanism and plays alarm information according to the environmental information and the driving information of the non-motor vehicle.

9. An electronic device, comprising:

one or more processors; and

storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to carry out a method according to any one of claims 1 to 4 or a method according to any one of claims 5 to 6.

10. A computer-readable medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1 to 4 or the method according to any one of claims 5 to 6.

Technical Field

The invention relates to the technical field of image processing, in particular to a method, a device, a medium and electronic equipment for realizing riding safety.

Background

With the rapid development of the internet, people increasingly like to shop and order on the internet. Thus, after a user makes a purchase on the web, the formed package requires distribution by a courier. After the user orders the meal on the web, the formed meal box needs to be delivered by a take-out. Typically, a courier or a takeaway uses a non-motorized vehicle to deliver a package or meal box. Sometimes, a courier or a takeout person chooses to drive in the wrong direction in order to deliver the package or the lunch box to a destination within a specified time, so that the courier or the takeout person drives the non-motor vehicle in the wrong direction to bring danger to the courier or the takeout person. Therefore, there is a need for a method of alerting a user to ride safely when a courier or a takeaway runs in the wrong direction on a non-motorized vehicle.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present invention and therefore may include information that does not constitute prior art known to a person of ordinary skill in the art.

Disclosure of Invention

The embodiment of the invention aims to provide a method, a device, a medium and an electronic device for realizing riding safety, so that alarm information can be automatically played at least to a certain extent to remind a courier or a takeaway to ride safely, thus ensuring the safety of pedestrians and the self and avoiding traffic accidents.

Additional features and advantages of the invention will be set forth in the detailed description which follows, or may be learned by practice of the invention.

According to a first aspect of the embodiments of the present invention, there is provided a method for implementing riding safety, which is applied to a terminal, where the terminal is fixed on a non-motor vehicle, and the method includes: determining the motion state of the non-motor vehicle according to the sensor data of the terminal; when the motion state of the non-motor vehicle is a riding state, acquiring at least one image of the environment where the non-motor vehicle is located through a camera of the terminal; sending at least one image of the environment where the non-motor vehicle is located to a server, so that the server determines environment information and driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located; receiving environmental information and driving information of the non-motor vehicle transmitted by the server; and triggering a retrograde motion alarm mechanism according to the environmental information and the driving information of the non-motor vehicle, and playing retrograde motion alarm information.

In some embodiments of the invention, determining the motion state of the non-motor vehicle from the sensor data of the terminal comprises: when the angle sensor data of the terminal is in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is more than 5km/h, determining that the motion state of the non-motor vehicle is a riding state; or when the angle sensor data of the terminal is not in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is less than or equal to 5km/h, determining that the motion state of the non-motor vehicle is a non-riding state.

In some embodiments of the invention, the method further comprises: storing the motion state of the non-motor vehicle in real time; and storing the environmental information and the driving information of the non-motor vehicle in real time.

In some embodiments of the invention, the method further comprises: monitoring the terminal screen; when an event that a user operates the terminal screen is monitored, inquiring the motion state of the non-motor vehicle and inquiring the environmental information of the non-motor vehicle; and if the motion state of the non-motor vehicle is the riding state and the environment information of the non-motor vehicle is the outdoor environment, triggering an operation alarm mechanism and displaying operation alarm information.

According to a second aspect of the embodiments of the present invention, there is provided a method for implementing riding safety, applied to a server, the method further including: when the motion state of the non-motor vehicle is a riding state, receiving at least one image of the environment where the non-motor vehicle is located, which is sent by a terminal; determining environment information and driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located; and sending the environmental information and the driving information of the non-motor vehicle to the terminal, so that the terminal triggers an alarm mechanism and plays alarm information according to the environmental information and the driving information of the non-motor vehicle.

In some embodiments of the invention, determining environmental information and driving information for the non-motor vehicle based on at least one image of an environment in which the non-motor vehicle is located comprises: processing at least one image of the environment where the non-motor vehicle is located through an artificial intelligence image recognition algorithm in an AI layer to obtain environment information and running information of the non-motor vehicle, wherein the environment information of the non-motor vehicle comprises an indoor environment or an outdoor environment, and the running information of the non-motor vehicle comprises reverse running or normal running.

According to a third aspect of the embodiments of the present invention, there is provided a riding safety realizing device, applied to a terminal, the terminal being fixed on a non-motor vehicle, the device including: the motion state determining module is used for determining the motion state of the non-motor vehicle according to the sensor data of the terminal; the image acquisition module is used for acquiring at least one image of the environment where the non-motor vehicle is located through a camera of the terminal when the motion state of the non-motor vehicle is the riding state; the sending module is used for sending the at least one image of the environment where the non-motor vehicle is located to a server so that the server can determine the environment information and the driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located; the receiving module is used for receiving the environment information and the driving information of the non-motor vehicle, which are sent by the server; and the retrograde motion alarm module is used for triggering a retrograde motion alarm mechanism according to the environmental information and the running information of the non-motor vehicle and playing retrograde motion alarm information.

In some embodiments of the invention, the motion state determination module is configured to: when the angle sensor data of the terminal is in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is more than 5km/h, determining that the motion state of the non-motor vehicle is a riding state; or when the angle sensor data of the terminal is not in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is less than or equal to 5km/h, determining that the motion state of the non-motor vehicle is a non-riding state.

In some embodiments of the invention, the apparatus further comprises: the first storage module is used for storing the motion state of the non-motor vehicle in real time; and the second storage module is used for storing the environmental information and the driving information of the non-motor vehicle in real time.

In some embodiments of the invention, the apparatus further comprises: the monitoring module is used for monitoring the terminal screen; the inquiry module is used for inquiring the motion state of the non-motor vehicle and inquiring the environmental information of the non-motor vehicle when monitoring an event that a user operates the terminal screen; and the operation alarm module is used for triggering an operation alarm mechanism and displaying operation alarm information if the motion state of the non-motor vehicle is a riding state and the environment information of the non-motor vehicle is an outdoor environment.

According to a fourth aspect of the embodiments of the present invention, there is provided a riding safety implementation device, applied to a server, the device further including: the non-motor vehicle driving system comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving at least one image of the environment where a non-motor vehicle is located, which is sent by a terminal, when the motion state of the non-motor vehicle is a riding state; the image analysis module is used for determining the environment information and the driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located; and the sending module is used for sending the environmental information and the driving information of the non-motor vehicle to the terminal so that the terminal triggers an alarm mechanism and plays alarm information according to the environmental information and the driving information of the non-motor vehicle.

In some embodiments of the invention, the image analysis module is configured to: processing at least one image of the environment where the non-motor vehicle is located through an artificial intelligence image recognition algorithm in an AI layer to obtain environment information and running information of the non-motor vehicle, wherein the environment information of the non-motor vehicle comprises an indoor environment or an outdoor environment, and the running information of the non-motor vehicle comprises reverse running or normal running.

According to a fifth aspect of embodiments of the present invention, there is provided an electronic apparatus, including: one or more processors; a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the implement method for cycling safety as described in the first aspect or the second aspect of the foregoing embodiments.

According to a sixth aspect of the embodiments of the present invention, there is provided a computer readable medium, on which a computer program is stored, the program, when executed by a processor, implements the riding safety implementation method as described in the first aspect or the second aspect of the embodiments above.

The technical scheme provided by the embodiment of the invention has the following beneficial effects:

in the technical scheme provided by some embodiments of the invention, the motion state of the non-motor vehicle is determined according to the sensor data of the terminal, when the motion state of the non-motor vehicle is a riding state, at least one image of the environment where the non-motor vehicle is located is obtained through the camera of the terminal, and the at least one image of the environment where the non-motor vehicle is located is sent to the server, so that the server determines the environment information and the running information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located, and thus the terminal can trigger a reverse running alarm mechanism according to the environment information and the running information of the non-motor vehicle and play the reverse running alarm information.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention. It is obvious that the drawings in the following description are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort. In the drawings:

FIG. 1A is a schematic diagram illustrating an exemplary system architecture to which a cycling safety implementing method or a cycling safety implementing apparatus according to an embodiment of the present invention may be applied;

FIG. 1B is a diagram illustrating terminal and server interactions to which embodiments of the present invention may be applied;

FIG. 2 is a flow chart schematically illustrating a method for implementing riding safety applied to a terminal according to an embodiment of the present invention;

FIG. 3 schematically shows a flowchart of a method for implementing riding safety applied to a terminal according to another embodiment of the present invention;

FIG. 4 is a flow chart schematically illustrating a method for implementing riding safety applied to a server according to an embodiment of the present invention;

FIG. 5 schematically shows a flow diagram of terminal interaction with a server according to an embodiment of the invention;

fig. 6 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to an embodiment of the present invention;

fig. 7 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to another embodiment of the present invention;

fig. 8 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to another embodiment of the present invention;

FIG. 9 schematically illustrates a block diagram of a cycling safety implementing device applied to a server according to an embodiment of the present invention;

FIG. 10 illustrates a schematic diagram of a terminal suitable for use in implementing embodiments of the present invention;

FIG. 11 illustrates a schematic structural diagram of a computer system suitable for use as a server to implement an embodiment of the present invention.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations or operations have not been shown or described in detail to avoid obscuring aspects of the invention.

The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.

The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.

Fig. 1A is a schematic diagram illustrating an exemplary system architecture to which a riding safety implementation method or a riding safety implementation apparatus according to an embodiment of the present invention may be applied.

As shown in fig. 1A, system architecture 100 may include a terminal 110, an interface layer 120, an AI layer 130, a data store layer 140, and a base layer 150.

In this embodiment, the terminal 110 may include a network module, a core module, an alarm module, and a user module. The network module may be used to receive or transmit information, such as receiving sensor data, transmitting an image of the environment in which the non-motor vehicle is located, and the like. The core module may be used to monitor the terminal screen, for example, the core module may be a client developed by the SDK, and package information or meal box information delivered by a courier or a takeaway may be queried in the client to deliver a route map, and the like. The user module may be used to store identity information of the courier or the takeaway.

In the present embodiment, the server includes an interface layer 120, an AI layer 130, a data store layer 140, and a base layer 150. The interface layer 120 includes an interface api, which can be used to receive or transmit information. For example, receiving an image of the environment in which the non-motor vehicle is located, transmitting the results of analyzing the image, and so forth. The AI layer 130 includes an artificial intelligence platform, and may be configured to analyze an image of an environment where the non-motor vehicle is located, and obtain environmental information and driving information of the non-motor vehicle. Data store layer 140 contains image storage services and large data databases. The image storage service can be used for storing images of the environment where the non-motor vehicle is located, and the big data base is used for storing the motion state, the environment information, the driving information and the like of the non-motor vehicle. Base layer 150 is used to provide hardware or software functional support for interface layer 120, AI layer 130, and data store layer 140. For example, base layer 150 may contain a network, redis, storage, tomacat, operating system, nginx, and so forth.

Fig. 1B shows a schematic diagram of a terminal interacting with a server to which an embodiment of the invention may be applied.

As shown in fig. 1B, the client sdk a1 determines the motion state of the non-motor vehicle based on the sensor data of the terminal. When the motion state of the non-motor vehicle is the riding state, at least one image of the environment where the non-motor vehicle is located is obtained through a camera of the terminal. And sends at least one image of the environment in which the non-motor vehicle is located to interface layer a 2.

The interface layer a2 receives at least one image of the environment in which the non-motor vehicle is located and transmits the at least one image of the environment in which the non-motor vehicle is located to the AI layer A3.

The AI layer A3 receives the at least one image of the environment of the non-motor vehicle, processes the at least one image of the environment of the non-motor vehicle through an image recognition algorithm of the artificial intelligence platform to obtain environment information and driving information of the non-motor vehicle, and sends the environment information and the driving information of the non-motor vehicle to the interface layer A2 and the data storage layer A4.

The interface layer a2 receives environmental information and driving information of the non-motor vehicle and transmits the environmental information and driving information of the non-motor vehicle to the client sdk a 1.

The data storage layer A4 receives the environmental information and the driving information of the non-motor vehicle, and also receives the motion state of the non-motor vehicle and the image of the environment where the non-motor vehicle is located, which are sent by the interface layer A2, and then stores the images.

The client side sdk A1 triggers a reverse driving alarm mechanism according to the environment information and the driving information of the non-motor vehicle, and reminds a user of safe riding by playing reverse driving alarm information.

In addition, the client sdk a1 may monitor the terminal screen in real time, inquire about a motion state of the non-motor vehicle when an event that the user operates the terminal screen is monitored, and inquire about environmental information of the non-motor vehicle. For example, a query request is sent to interface layer a 2.

The interface layer A2 receives the query request and sends it to the data store layer A4.

Data store layer A4 receives the query request, and queries the state of motion of the non-motor vehicle and the environmental information of the non-motor vehicle based on the query request. The query results are sent to interface layer a 2.

The interface layer A2 receives the query result and then sends it to the client sdk A1.

And the client side sdk A1 receives the query result, and if the motion state of the non-motor vehicle in the query result is the riding state and the environment information of the non-motor vehicle is the outdoor environment, an operation alarm mechanism is triggered to display operation alarm information so as to remind a user of riding safely.

Fig. 2 schematically shows a flowchart of a riding safety implementation method applied to a terminal according to an embodiment of the present invention.

As shown in fig. 2, the implementation method of the riding safety applied to the terminal may include steps S210 to S250.

In step S210, a motion state of the non-motor vehicle is determined according to the sensor data of the terminal.

In step S220, when the motion state of the non-motor vehicle is a riding state, at least one image of an environment where the non-motor vehicle is located is obtained through a camera of the terminal.

In step S230, at least one image of the environment where the non-motor vehicle is located is sent to a server, so that the server determines environment information and driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located.

In step S240, the environmental information and the driving information of the non-motor vehicle transmitted by the server are received.

In step S250, a retrograde motion warning mechanism is triggered according to the environmental information and the driving information of the non-motor vehicle, and a retrograde motion warning information is played.

The method can determine the motion state of the non-motor vehicle according to the sensor data of the terminal, when the motion state of the non-motor vehicle is a riding state, at least one image of the environment where the non-motor vehicle is located is obtained through the camera of the terminal, the at least one image of the environment where the non-motor vehicle is located is sent to the server, so that the server determines the environment information and the running information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located, the terminal can trigger a retrograde motion alarm mechanism according to the environment information and the running information of the non-motor vehicle, and reverse motion alarm information is played.

In an embodiment of the present invention, a client developed by SDK may be installed on the terminal, and the client may obtain sensor data of the terminal in real time. For example, angle sensor data is acquired, and GPS (Global Positioning System, GPS for short) sensor data is acquired.

In one embodiment of the present invention, determining the motion state of the non-motor vehicle based on the sensor data of the terminal includes: when the angle sensor data of the terminal is in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is more than 5km/h, determining that the motion state of the non-motor vehicle is a riding state; or when the angle sensor data of the terminal is not in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is less than or equal to 5km/h, determining that the motion state of the non-motor vehicle is a non-riding state.

In one embodiment of the present invention, the riding state of the non-motor vehicle may refer to a state when the courier or the takeaway rides the non-motor vehicle at a speed of more than 5 km/h. The non-riding state of the non-motor vehicle may refer to the non-motor vehicle being in a stationary state, or may refer to a state in which a courier or a takeout manually pushes the non-motor vehicle.

In one embodiment of the invention, when the motion state of the non-motor vehicle is the riding state, at least one image of the environment where the non-motor vehicle is located is obtained through a camera of the terminal. For example, when the movement state of the non-motor vehicle is determined to be the riding state, at least one image of the environment where the non-motor vehicle is located is obtained through a rear camera of the terminal. Then, at least one image of the environment in which the non-motor vehicle is located is transmitted to the server through the client installed at the terminal, so that the server determines environment information and driving information of the non-motor vehicle according to the at least one image of the environment in which the non-motor vehicle is located.

In one embodiment of the invention, a retrograde motion warning mechanism is triggered according to the environmental information and the driving information of the non-motor vehicle, and retrograde motion warning information is played. For example, the environmental information of the non-motor vehicle is outdoor, and the travel information of the non-motor vehicle is retrograde travel. Under the condition, a retrograde motion alarm mechanism is triggered, retrograde motion alarm information is played, and in such a way, the retrograde motion alarm information can be automatically played to remind a courier or a takeaway to ride safely, so that the safety of pedestrians and self is ensured, and traffic accidents can be avoided.

Fig. 3 schematically shows a flowchart of a riding safety implementation method applied to a terminal according to another embodiment of the present invention.

As shown in FIG. 3, the implementation method of the riding safety applied to the terminal may include S310 to S330.

In step S310, the terminal screen is listened to.

In step S320, when an event that the user operates the terminal screen is monitored, the motion state of the non-motor vehicle is queried, and the environment information of the non-motor vehicle is queried.

In step S330, if the motion state of the non-motor vehicle is the riding state and the environmental information of the non-motor vehicle is the outdoor environment, an operation alarm mechanism is triggered to display operation alarm information.

The method can monitor a terminal screen, when an event that a user operates the terminal screen is monitored, the motion state of the non-motor vehicle and the environment information of the non-motor vehicle are inquired, if the motion state of the non-motor vehicle is a riding state and the environment information of the non-motor vehicle is an outdoor environment, an operation alarm mechanism is triggered, operation alarm information is displayed, and therefore a courier or a takeout person is reminded of not operating the terminal in the riding process, traffic accidents can be avoided, and therefore pedestrians and the safety of the passersby and the passersby can be protected.

In one embodiment of the invention, after a user (e.g., courier or takeaway) starts a client of a terminal, the terminal screen may be listened to by the client. For example, the user clicks on the screen to call the recipient, at which time the event can be heard by the client. As another example, the user slides the screen to find a delivery route, at which time the event can be heard by the client.

In one embodiment of the invention, the method further comprises: storing the motion state of the non-motor vehicle in real time; and storing the environmental information and the driving information of the non-motor vehicle in real time. For example, the terminal can store the motion state of the non-motor vehicle in the local hard disk in real time and store the environmental information and the driving information of the non-motor vehicle in the local hard disk in real time, so that the motion state, the environmental information and the driving information of the non-motor vehicle at the current moment can be called from the local hard disk quickly when an operation event is monitored subsequently.

In one embodiment of the invention, if the motion state of the non-motor vehicle is the riding state and the environment information of the non-motor vehicle is the outdoor environment, an operation alarm mechanism is triggered to display operation alarm information. For example, if the motion state of the non-motor vehicle is the riding state and the environment information of the non-motor vehicle is the outdoor environment in the query result, an operation alarm mechanism is triggered at the moment, and operation alarm information is displayed, wherein the operation alarm information can be a statement for reminding a user of safe riding and the like. For example, please not operate the terminal screen during riding, so that life safety of you and pedestrians can be guaranteed.

Fig. 4 schematically shows a flowchart of a riding safety implementation method applied to a server according to an embodiment of the present invention.

As shown in fig. 4, the implementation method of riding safety applied to the server includes steps S410 to S430.

In step S410, when the motion state of the non-motor vehicle is the riding state, at least one image of the environment where the non-motor vehicle is located, which is sent by the terminal, is received.

In step S420, environment information and driving information of the non-motor vehicle are determined according to at least one image of an environment in which the non-motor vehicle is located.

In step S430, the environmental information and the driving information of the non-motor vehicle are sent to the terminal, so that the terminal triggers an alarm mechanism and plays an alarm message according to the environmental information and the driving information of the non-motor vehicle.

The method can determine the environmental information and the driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located, and send the environmental information and the driving information of the non-motor vehicle to the terminal, so that the terminal triggers an alarm mechanism according to the environmental information and the driving information of the non-motor vehicle and plays alarm information.

In one embodiment of the invention, determining environmental information and driving information of the non-motor vehicle based on at least one image of an environment in which the non-motor vehicle is located comprises: processing at least one image of the environment where the non-motor vehicle is located through an artificial intelligent image recognition algorithm in the AI layer to obtain environment information and running information of the non-motor vehicle, wherein the environment information of the non-motor vehicle comprises an indoor environment or an outdoor environment, and the running information of the non-motor vehicle comprises reverse running or normal running.

In one embodiment of the invention, the front-face image of the road, the tree, the vehicle and the pedestrian in at least one image of the environment where the non-motor vehicle is located can be obtained through analysis by an artificial intelligence image recognition algorithm, and the environment information of the non-motor vehicle is determined to be the outdoor environment and the driving information of the non-motor vehicle is the reverse driving according to the front-face image of the road, the tree, the vehicle and the pedestrian in at least one image of the environment where the non-motor vehicle is located.

In an embodiment of the invention, at least one image of the environment where the non-motor vehicle is located can be analyzed and obtained through an artificial intelligence image recognition algorithm, wherein the image comprises a back image of roads, trees, vehicles and pedestrians, and according to a front face image of the roads, the trees, the vehicles and the pedestrians contained in the at least one image of the environment where the non-motor vehicle is located, the environment information of the non-motor vehicle is determined to be an outdoor environment, and the driving information of the non-motor vehicle is determined to be normal driving.

In one embodiment of the invention, the at least one image of the environment where the non-motor vehicle is located comprises the table, the wall, the lamp and the floor through the artificial intelligence image recognition algorithm, and the environment information of the non-motor vehicle is determined to be the indoor environment according to the table, the wall, the lamp and the floor which are contained in the at least one image of the environment where the non-motor vehicle is located.

In an embodiment of the present invention, playing the alarm information may refer to playing a piece of audio for reminding the user of driving safely.

Fig. 5 schematically shows a flow chart of terminal interaction with a server according to an embodiment of the invention.

As shown in fig. 5, the terminal and server interaction process includes the following steps:

s1: the method includes the steps of obtaining angular velocity sensor data of a terminal, wherein the terminal is a smart phone for example. And judging whether the included angle between the smart phone and the horizontal plane is greater than 20 degrees and less than 90 degrees. If the angle between the smart phone and the horizontal is greater than 20 degrees and less than 90 degrees, step S2 is executed. And conversely, the angle between the smart phone and the horizontal plane is less than 20 degrees and/or more than 90 degrees, and the ending step is executed.

S2: and judging whether the GPS sensor data of the terminal is more than 5 km/h. If so, S3 is executed. Conversely, if less than or equal to the result step is performed.

S3: and uploading the photos. For example, when the angle between the smart phone and the horizontal plane is greater than 20 degrees and less than 90 degrees and the GPS sensor data of the terminal is greater than 5km/h, it is determined that the motion state of the non-motor vehicle is the riding state. At least one image of the environment in which the non-motor vehicle is located is then obtained and sent to a server.

S4: the photos are analyzed by artificial intelligence. For example, the server receives at least one image of the environment where the non-motor vehicle is located, analyzes the at least one image of the environment where the non-motor vehicle is located through an artificial intelligence image recognition algorithm, and sends an analysis result to the terminal.

S5: the terminal judges whether the analysis result contains outdoor information, if it contains, it executes S6, otherwise, it does not contain the execution ending step.

S6: if the analysis result contains outdoor information, continuing to judge whether the analysis result contains reverse running information, if so, executing S7, otherwise, executing an ending step if not.

S7: a warning is issued. For example, when the non-motor vehicle is located outdoors and runs in the wrong direction, the wrong-way driving alarm mechanism is triggered to play wrong-way driving alarm information. For another example, when the environment in which the non-motor vehicle is located is outdoor and the user operates the terminal screen (e.g., step S9), the operation alarm mechanism is triggered to play the operation alarm information.

S8: and storing the result of the artificial intelligence analysis, the motion state of the non-motor vehicle, the image of the environment where the non-motor vehicle is positioned, and the like.

Fig. 6 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to an embodiment of the present invention.

As shown in fig. 6, the riding safety implementation device 600 applied to the terminal includes a motion state determination module 601, an image acquisition module 602, a sending module 603, a receiving module 604, and a retrograde alert module 605.

Specifically, the motion state determination module 601 is configured to determine a motion state of the non-motor vehicle according to sensor data of the terminal.

The image obtaining module 602 is configured to obtain at least one image of an environment where the non-motor vehicle is located through a camera of the terminal when the motion state of the non-motor vehicle is a riding state.

The sending module 603 is configured to send the at least one image of the environment where the non-motor vehicle is located to a server, so that the server determines environment information and driving information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located.

A receiving module 604, configured to receive the environment information and the driving information of the non-motor vehicle sent by the server.

And the reverse driving alarm module 605 is configured to trigger a reverse driving alarm mechanism according to the environment information and the driving information of the non-motor vehicle, and play reverse driving alarm information.

The riding safety implementation device 600 applied to the terminal can determine the motion state of the non-motor vehicle according to the sensor data of the terminal, when the motion state of the non-motor vehicle is the riding state, at least one image of the environment where the non-motor vehicle is located is obtained through the camera of the terminal, the at least one image of the environment where the non-motor vehicle is located is sent to the server, so that the server determines the environment information and the running information of the non-motor vehicle according to the at least one image of the environment where the non-motor vehicle is located, the terminal can trigger a retrograde motion alarm mechanism according to the environment information and the running information of the non-motor vehicle, and reverse motion alarm information is played.

According to the embodiment of the present invention, the riding safety implementation device 600 applied to the terminal may be used to implement the riding safety implementation method applied to the terminal described in the embodiment of fig. 2.

In some embodiments of the invention, the motion state determination module 601 is configured to: when the angle sensor data of the terminal is in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is more than 5km/h, determining that the motion state of the non-motor vehicle is a riding state; or when the angle sensor data of the terminal is not in the range of 20 degrees to 90 degrees and the GPS sensor data of the terminal is less than or equal to 5km/h, determining that the motion state of the non-motor vehicle is a non-riding state.

Fig. 7 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to another embodiment of the present invention.

As shown in fig. 7, the riding safety implementing device 600 applied to the terminal further includes a first storage module 606 and a second storage module 607.

Specifically, the first storage module 606 is used for storing the motion state of the non-motor vehicle in real time.

And the second storage module 607 is used for storing the environmental information and the driving information of the non-motor vehicle in real time.

The riding safety implementation device 600 applied to the terminal can store the motion state of the non-motor vehicle in a local hard disk in real time and store the environmental information and the running information of the non-motor vehicle in the local hard disk in real time, so that the motion state, the environmental information and the running information of the non-motor vehicle at the current moment can be quickly called from the local hard disk when an operation event is monitored subsequently.

Fig. 8 schematically shows a block diagram of a riding safety implementing apparatus applied to a terminal according to another embodiment of the present invention.

As shown in fig. 8, the riding safety implementing apparatus 600 applied to the terminal further includes a monitoring module 608, a query module 609, and an operation alarm module 610.

Specifically, the monitoring module 608 is configured to monitor the terminal screen.

And the query module 609 is used for querying the motion state of the non-motor vehicle and querying the environmental information of the non-motor vehicle when monitoring the event that the user operates the terminal screen.

And the operation alarm module 610 triggers an operation alarm mechanism to display operation alarm information if the motion state of the non-motor vehicle is a riding state and the environment information of the non-motor vehicle is an outdoor environment.

This be applied to safe realization device 600 of riding at terminal can monitor the terminal screen, when monitoring the incident of user operation terminal screen, the motion state of inquiry non-motor vehicle, and the environmental information of inquiry non-motor vehicle, if the motion state of non-motor vehicle is when the environment information of the state of riding and non-motor vehicle is outdoor environment, trigger operation alarm mechanism, show operation alarm information, remind courier or takeout person to do not require operation terminal at the in-process of riding with this, can avoid the traffic accident like this, thereby protect pedestrian and own safety.

According to the embodiment of the present invention, the riding safety implementation device 600 applied to the terminal may be used to implement the riding safety implementation method applied to the terminal described in the embodiment of fig. 3.

Since each module of the riding safety implementation device applied to the terminal according to the exemplary embodiment of the present invention may be used to implement the steps of the exemplary embodiment of the riding safety implementation method applied to the terminal described in fig. 2 to 3, please refer to the embodiment of the riding safety implementation method applied to the terminal according to the present invention described above for details that are not disclosed in the embodiment of the device according to the present invention.

It is understood that the motion state determination module 601, the image acquisition module 602, the transmission module 603, the reception module 604, the retrograde alarm module 605, the first storage module 606, the second storage module 607, the monitoring module 608, the query module 609 and the operation alarm module 610 may be combined and implemented in one module, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present invention, at least one of the motion state determining module 601, the image obtaining module 602, the sending module 603, the receiving module 604, the retrograde alert module 605, the first storage module 606, the second storage module 607, the listening module 608, the querying module 609, and the operation alert module 610 may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or any other reasonable manner in which a circuit may be integrated or packaged, as hardware or firmware, or as a suitable combination of three implementations of software, hardware, and firmware. Alternatively, at least one of the motion state determination module 601, the image acquisition module 602, the transmission module 603, the reception module 604, the retrograde alert module 605, the first storage module 606, the second storage module 607, the listening module 608, the query module 609, and the operation alert module 610 may be at least partially implemented as a computer program module which, when executed by a computer, may perform the functions of the respective modules.

Fig. 9 schematically shows a block diagram of a riding safety implementing apparatus applied to a server according to an embodiment of the present invention.

As shown in fig. 9, the riding safety implementation device 900 applied to the server includes a receiving module 901, an image analysis module 902 and a sending module 903.

Specifically, the receiving module 901 receives at least one image of an environment where the non-motor vehicle is located, which is sent by the terminal, when the motion state of the non-motor vehicle is the riding state.

And the image analysis module 902 is used for determining the environment information and the driving information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located.

A sending module 903, configured to send the environment information and the driving information of the non-motor vehicle to the terminal, so that the terminal triggers an alarm mechanism and plays alarm information according to the environment information and the driving information of the non-motor vehicle.

The riding safety implementation device 900 applied to the server can determine the environment information and the running information of the non-motor vehicle according to at least one image of the environment where the non-motor vehicle is located, and send the environment information and the running information of the non-motor vehicle to the terminal, so that the terminal triggers an alarm mechanism according to the environment information and the running information of the non-motor vehicle and plays alarm information, and in this way, a distributor can be reminded of riding safely, the accident sending rate of the distributor is reduced, and the accident rate of pedestrians caused by the backward running of the distributor is reduced.

According to the embodiment of the invention, the riding safety implementation device 900 applied to the server can be used for implementing the riding safety implementation method applied to the server described in the embodiment of fig. 4.

In some embodiments of the present invention, image analysis module 902 is configured to: processing at least one image of the environment where the non-motor vehicle is located through an artificial intelligence image recognition algorithm in an AI layer to obtain environment information and running information of the non-motor vehicle, wherein the environment information of the non-motor vehicle comprises an indoor environment or an outdoor environment, and the running information of the non-motor vehicle comprises reverse running or normal running.

Fig. 10 shows a schematic structural diagram of a terminal suitable for implementing an embodiment of the present invention. In this embodiment, terminal 1000 can have an angular velocity sensor, a GPS sensor, a camera, and a device with client SDK installed.

As shown in fig. 10, terminal 1000 can be a smart phone. The smart phone may be affixed to a non-motor vehicle. The included angle between the back face of the smart phone and the horizontal plane is larger than 20 degrees and smaller than 90 degrees. The intelligent mobile phone comprises an angular velocity sensor, a GPS sensor and a camera. The intelligent mobile phone is provided with a client SDK used for acquiring angular velocity sensor data and GPS sensor data and acquiring an image of the environment where the non-motor vehicle is located, wherein the image is acquired through a camera.

In this embodiment, the client SDK may determine the motion state of the non-motor vehicle based on the angular velocity sensor data and the GPS sensor data. For example, the angular velocity sensor data is greater than 20 degrees and less than 90 degrees, and the GPS sensor data is greater than 5km/h, when the motion state of the non-motor vehicle is determined as the riding state.

In this embodiment, the client SDK may upload an image of an environment where the non-motor vehicle is located to the server, receive an analysis result of the server on the image of the environment where the non-motor vehicle is located, and trigger an alarm mechanism according to the analysis result. For example, when the environment of the non-motor vehicle is outdoor and the driving information is retrograde motion, the retrograde motion alarm mechanism is triggered to play the retrograde motion alarm information. For another example, when the environment of the non-motor vehicle is an outdoor environment and the client SDK monitors that the user is operating the terminal screen, an operation alarm mechanism is triggered to display operation alarm information.

Referring now to FIG. 11, a block diagram of a computer system 1100 suitable for use as a server in implementing embodiments of the present invention is shown. The computer system 1100 of the server shown in fig. 11 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.

As shown in fig. 11, the computer system 1100 includes a Central Processing Unit (CPU)1101, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for system operation are also stored. The CPU 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.

The following components are connected to the I/O interface 1105: an input portion 1106 including a keyboard, mouse, and the like; an output portion 1107 including a signal output unit such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 1108 including a hard disk and the like; and a communication section 1109 including a network interface card such as a LAN card, a modem, or the like. The communication section 1109 performs communication processing via a network such as the internet. A driver 1110 is also connected to the I/O interface 1105 as necessary. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1110 as necessary, so that a computer program read out therefrom is mounted into the storage section 1108 as necessary.

In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the invention include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 1109 and/or installed from the removable medium 1111. The above-described functions defined in the system of the present application are executed when the computer program is executed by a Central Processing Unit (CPU) 1101.

It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.

As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device implements the implementation method of the riding safety applied to the server as described in the above embodiments.

For example, the server may implement the following as shown in fig. 4: in step S410, when the motion state of the non-motor vehicle is the riding state, at least one image of the environment where the non-motor vehicle is located, which is sent by the terminal, is received. In step S420, environment information and driving information of the non-motor vehicle are determined according to at least one image of an environment in which the non-motor vehicle is located. In step S430, the environmental information and the driving information of the non-motor vehicle are sent to the terminal, so that the terminal triggers an alarm mechanism and plays an alarm message according to the environmental information and the driving information of the non-motor vehicle.

It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the invention. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.

Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiment of the present invention.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.