Method and device for transmitting passenger information to rescue call center for vehicle

文档序号:1942019 发布日期:2021-12-07 浏览:16次 中文

阅读说明:本技术 用于车辆的向救援呼叫中心发送乘员信息的方法及装置 (Method and device for transmitting passenger information to rescue call center for vehicle ) 是由 邵昌旭 许亮 李轲 范亦卿 伍俊 于 2021-08-31 设计创作,主要内容包括:本公开涉及一种用于车辆的向救援呼叫中心发送乘员信息的方法及装置、电子设备和存储介质,所述方法包括:响应于检测到车辆发出救援呼叫信息,获取所述车辆的车舱内的影像信息;对所述影像信息进行人脸检测和/或人体检测;基于检测到的人脸和/或人体,确定所述车舱内的乘员的状态信息,所述状态信息包括与医疗救助需求相关的身体状态信息和/或乘车状态信息;向救援呼叫中心发送所述状态信息。(The present disclosure relates to a method and apparatus for transmitting occupant information to a rescue call center for a vehicle, an electronic device, and a storage medium, the method including: responding to the detection that a vehicle sends rescue call information, and acquiring image information in a vehicle cabin of the vehicle; carrying out face detection and/or human body detection on the image information; determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs; and sending the state information to a rescue call center.)

1. A method for a vehicle to transmit occupant information to a rescue call center, comprising:

responding to the detection that a vehicle sends rescue call information, and acquiring image information in a vehicle cabin of the vehicle;

carrying out face detection and/or human body detection on the image information;

determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs;

and sending the state information to a rescue call center.

2. The method of claim 1, wherein determining the status information of the occupant in the cabin based on the detected human face and/or body comprises:

carrying out identity recognition on the detected face to determine the identity information of the passenger;

determining status information of the occupant based on the identity information.

3. The method of claim 2, wherein the body state information relating to the need for medical assistance comprises: medical record information;

the determining the state information of the occupant based on the identity information includes:

and acquiring medical record information of the passenger based on the identity information.

4. The method of claim 3, wherein the medical profile information comprises at least one of:

blood type, past history, and allergy history.

5. The method according to any one of claims 1-4, wherein the status information further comprises occupant attribute information, and wherein determining the status information of the occupant in the cabin based on the detected human face and/or body comprises:

occupant attribute information is determined based on the detected face and/or body.

6. The method of claim 5, wherein the occupant attribute information comprises at least one of:

age, sex;

the determining of the attribute information of the passenger based on the detected human face and/or human body comprises:

carrying out age identification on the human face to determine the age of the passenger in the cabin; and/or the presence of a gas in the gas,

and carrying out gender identification on the face to determine the gender of the passenger in the vehicle cabin.

7. The method of claim 6, wherein determining the occupant attribute information based on the detected human face and/or body comprises:

and determining whether the passenger in the vehicle cabin is an old man or a child based on the age of the passenger in the vehicle cabin.

8. The method of claim 1, further comprising:

determining the number information of the passengers in the vehicle cabin based on the detected number information of the human faces and/or human bodies, and

transmitting the number information of the passengers to a rescue call center;

and/or the presence of a gas in the gas,

determining the position information of the passengers in the vehicle cabin based on the detected human face position and/or human body position information, and

and transmitting the position information of the passenger to a rescue call center.

9. The method according to any one of claims 1 to 8, wherein determining the status information of the occupants in the cabin based on the detected human face and/or body comprises: and identifying the use state of the safety protection device in the vehicle for the passenger based on the detected human body to obtain the riding state information of the passenger related to the medical rescue requirement.

10. The method of claim 9, wherein determining the status information of the occupant in the cabin based on the detected face and/or body comprises:

identifying a child occupant within the vehicle cabin based on the detected face;

detecting a safety seat in the vehicle cabin based on the image information;

and determining the use state of the safety seat of the child passenger according to the human body detection result of the child passenger and the detection result of the safety seat.

11. The method of claim 9, wherein determining the status information of the occupant in the cabin based on the detected face and/or body comprises:

and detecting the wearing condition of the safety belt of the passenger corresponding to the detected face and/or human body based on the image information to obtain the using state of the safety belt of the passenger in the vehicle cabin.

12. The method of any of claims 1-9, wherein the occupant status information includes occupant injury level information;

the determining state information of the passengers in the vehicle cabin based on the detected human faces and/or human bodies comprises:

detecting a bleeding state of the occupant based on the detected face and body;

and determining injury degree information of the passenger according to the bleeding state.

13. The method of any of claims 1-12, wherein after determining status information of an occupant in the vehicle compartment, the method further comprises:

determining needed rescue resource information according to the state information;

and sending the rescue resource information to an emergency call center.

14. The method of claim 13, wherein determining the required rescue resource information according to the state information comprises:

determining the type of medical materials required for rescue and/or the professional direction of medical personnel according to at least one item of medical file information, passenger attribute information, the use state of a safety protection device and the information of the injury degree of passengers in the vehicle cabin; and/or

And determining the quantity of medical materials and/or medical personnel required for rescue according to the quantity information of the passengers in the vehicle cabin.

15. The method according to any one of claims 1-14, wherein said obtaining image information within a cabin of said vehicle comprises:

acquiring target image information in a vehicle cabin, which is acquired by a vehicle-mounted camera device, within a preset time period before and after rescue calling information is sent by a vehicle;

the performing of the face detection and/or the body detection on the image information includes:

and carrying out face detection and/or human body detection on the target image information.

16. An apparatus for transmitting occupant information to a rescue call center for a vehicle, comprising:

the image information acquisition unit is used for responding to the detection that a vehicle sends rescue call information and acquiring image information in a vehicle cabin of the vehicle;

the detection unit is used for carrying out human face detection and/or human body detection on the image information;

the state information determining unit is used for determining state information of passengers in the cabin based on the detected human faces and/or human bodies, wherein the state information comprises body state information and/or riding state information related to medical rescue requirements;

and the sending unit is used for sending the state information to the rescue call center.

17. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to invoke the memory-stored instructions to perform the method of any one of claims 1 to 15.

18. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 15.

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for transmitting occupant information of a vehicle, an electronic device, and a storage medium.

Background

In the road transportation process, traffic accidents may occur to automobiles, and at the moment, if rescue workers can timely acquire accident information and carry out rescue, accident parties can be timely rescued, so that property loss is reduced, and casualties are reduced.

In order to enable rescue workers to know accident information in time, an automobile-mounted emergency call (eCall) system can be integrated on an automobile, and the eCall system belongs to typical application of the internet of vehicles. Based on technologies such as automobile sensing, mobile communication and satellite positioning, the emergency rescue system is in contact with a public rescue center at the first time after an accident occurs, automatically sends the position of the vehicle and vehicle information to the rescue center, and the rescue center rescues accident personnel after confirming the accident.

However, the conventional emergency call function has difficulty in determining the injury of the occupant in the accident after the accident occurs, and the emergency call cannot confirm the situation of the occupant in the vehicle, and it is difficult to provide a targeted rescue resource.

Disclosure of Invention

The present disclosure proposes a technical solution for a vehicle to send occupant information to a rescue call center.

According to an aspect of the present disclosure, there is provided a method for transmitting occupant information to a rescue call center for a vehicle, including:

responding to the detection that a vehicle sends rescue call information, and acquiring image information in a vehicle cabin of the vehicle;

carrying out face detection and/or human body detection on the image information;

determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs;

and sending the state information to a rescue call center.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes:

carrying out identity recognition on the detected face to determine the identity information of the passenger;

determining status information of the occupant based on the identity information.

In one possible implementation, the physical state information related to medical assistance needs includes: medical record information;

the determining the state information of the occupant based on the identity information includes:

and acquiring medical record information of the passenger based on the identity information.

In one possible implementation, the medical profile information includes at least one of:

blood type, past history, and allergy history.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body further includes:

occupant attribute information is determined based on the detected face and/or body.

In one possible implementation, the occupant attribute information includes at least one of:

age, sex;

the determining of the attribute information of the passenger based on the detected human face and/or human body comprises:

carrying out age identification on the human face to determine the age of the passenger in the cabin; and/or the presence of a gas in the gas,

and carrying out gender identification on the face to determine the gender of the passenger in the vehicle cabin.

In one possible implementation, the determining the occupant attribute information based on the detected human face and/or human body includes:

and determining whether the passenger in the vehicle cabin is an old man or a child based on the age of the passenger in the vehicle cabin.

In one possible implementation, the method further includes:

determining the number information of the passengers in the vehicle cabin based on the detected number information of the human faces and/or human bodies, and

transmitting the number information of the passengers to a rescue call center;

and/or the presence of a gas in the gas,

determining the position information of the passengers in the vehicle cabin based on the detected human face position and/or human body position information, and

and transmitting the position information of the passenger to a rescue call center.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes: and identifying the use state of the safety protection device in the vehicle for the passenger based on the detected human body to obtain the riding state information of the passenger related to the medical rescue requirement.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes:

identifying a child occupant within the vehicle cabin based on the detected face;

detecting a safety seat in the vehicle cabin based on the image information;

and determining the use state of the safety seat of the child passenger according to the human body detection result of the child passenger and the detection result of the safety seat.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes:

and detecting the wearing condition of the safety belt of the passenger corresponding to the detected face and/or human body based on the image information to obtain the using state of the safety belt of the passenger in the vehicle cabin.

In one possible implementation, the occupant status information includes occupant injury level information;

the determining state information of the passengers in the vehicle cabin based on the detected human faces and/or human bodies comprises:

detecting a bleeding state of the occupant based on the detected face and body;

and determining injury degree information of the passenger according to the bleeding state.

In one possible implementation, after determining the status information of the occupant in the vehicle cabin, the method further comprises:

determining needed rescue resource information according to the state information;

and sending the rescue resource information to an emergency call center.

In a possible implementation manner, the determining, according to the state information, required rescue resource information includes:

determining the type of medical materials required for rescue and/or the professional direction of medical personnel according to at least one item of medical file information, passenger attribute information, the use state of a safety protection device and the information of the injury degree of passengers in the vehicle cabin; and/or

And determining the quantity of medical materials and/or medical personnel required for rescue according to the quantity information of the passengers in the vehicle cabin.

In one possible implementation manner, the acquiring image information in a cabin of the vehicle includes:

acquiring target image information in a vehicle cabin, which is acquired by a vehicle-mounted camera device, within a preset time period before and after rescue calling information is sent by a vehicle;

the performing of the face detection and/or the body detection on the image information includes:

and carrying out face detection and/or human body detection on the target image information.

According to an aspect of the present disclosure, there is provided an apparatus for transmitting occupant information to a rescue call center for a vehicle, including:

the image information acquisition unit is used for responding to the detection that a vehicle sends rescue call information and acquiring image information in a vehicle cabin of the vehicle;

the detection unit is used for carrying out human face detection and/or human body detection on the image information;

the state information determining unit is used for determining state information of passengers in the cabin based on the detected human faces and/or human bodies, wherein the state information comprises body state information and/or riding state information related to medical rescue requirements;

and the sending unit is used for sending the state information to the rescue call center.

In one possible implementation manner, the state information determining unit includes:

the identity information determining unit is used for identifying the identity of the detected face and determining the identity information of the passenger;

a state information determination subunit configured to determine state information of the occupant based on the identity information.

In one possible implementation, the physical state information related to medical assistance needs includes: medical record information;

the state information determination subunit includes:

and the medical file information determining unit is used for acquiring the medical file information of the passenger based on the identity information.

In one possible implementation, the medical profile information includes at least one of:

blood type, past history, and allergy history.

In one possible implementation, the state information further includes occupant attribute information, and the state information determination unit includes:

an attribute information determination unit for determining occupant attribute information based on the detected face and/or body.

In one possible implementation, the occupant attribute information includes at least one of:

age, sex;

the attribute information determination unit includes:

the age determining unit is used for carrying out age identification on the human face and determining the age of the passenger in the cabin; and/or the presence of a gas in the gas,

and the gender determining unit is used for carrying out gender identification on the human face and determining the gender of the passenger in the vehicle cabin.

In a possible implementation manner, the attribute information determining unit includes:

and the old people and children determining unit is used for determining whether the passengers in the vehicle cabin are old people or children or not based on the ages of the passengers in the vehicle cabin.

In one possible implementation, the apparatus further includes:

a number information determination unit for determining the number information of the passengers in the vehicle cabin based on the detected number information of the human face and/or the human body, and

transmitting the number information of the passengers to a rescue call center;

and/or the presence of a gas in the gas,

a position information determination unit for determining position information of the passenger in the vehicle cabin based on the detected face position and/or human body position information, and

and transmitting the position information of the passenger to a rescue call center.

In one possible implementation manner, the state information determining unit includes: and the safety protection device use state identification unit is used for identifying the use state of the safety protection device in the vehicle for the passenger based on the detected human body to obtain the riding state information of the passenger related to the medical rescue requirement.

In one possible implementation manner, the state information determining unit includes:

a child passenger identification unit for identifying a child passenger in the vehicle cabin based on the detected face;

the safety seat identification unit is used for detecting a safety seat in the vehicle cabin based on the image information;

and the safety seat use state determining unit is used for determining the use state of the safety seat of the child passenger according to the human body detection result of the child passenger and the detection result of the safety seat.

In one possible implementation manner, the state information determining unit includes:

and the safety belt use state determining unit is used for detecting the safety belt wearing condition of the passenger corresponding to the detected human face and/or human body based on the image information to obtain the safety belt use state of the passenger in the vehicle cabin.

In one possible implementation, the occupant status information includes occupant injury level information;

the state information determination unit includes:

a bleeding state detection unit for detecting a bleeding state of the occupant based on the detected face and the human body;

and the injury degree determining unit is used for determining injury degree information of the passenger according to the bleeding state.

In one possible implementation, after determining the status information of the occupant in the vehicle cabin, the apparatus further comprises:

the rescue resource determining unit is used for determining needed rescue resource information according to the state information;

and the rescue resource information sending unit is used for sending the rescue resource information to an emergency call center.

In one possible implementation manner, the rescue resource determining unit includes:

the medical resource type determining unit is used for determining the type of medical materials required for rescue and/or the professional direction of medical personnel according to at least one item of medical file information, passenger attribute information, the using state of a safety protection device and the injury degree information of passengers in the cabin; and/or

And the medical resource quantity determining unit is used for determining the quantity of medical materials and/or the quantity of medical personnel required for rescue according to the quantity information of the passengers in the vehicle cabin.

In one possible implementation manner, the image information obtaining unit includes:

the system comprises a target image information acquisition unit, a vehicle-mounted camera device and a vehicle-mounted display device, wherein the target image information acquisition unit is used for acquiring target image information in a vehicle cabin, which is acquired by the vehicle-mounted camera device, within a preset time period before and after rescue calling information is sent by a vehicle;

and the detection unit is used for carrying out face detection and/or human body detection on the target image information.

According to an aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method.

In the embodiment of the disclosure, in response to detecting that a vehicle sends rescue call information, acquiring image information in a cabin of the vehicle; carrying out face detection and/or human body detection on the image information; determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs; and sending the state information to a rescue call center. Therefore, the rescue resources required for rescue can be determined in a targeted manner based on the state information of the passengers in the vehicle cabin, so that the passengers in the vehicle cabin can be rescued in a targeted manner, symptomatic rescue is implemented, and rescue efficiency is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

FIG. 1 illustrates a flow chart of a method of transmitting occupant information of a vehicle according to an embodiment of the present disclosure;

fig. 2 illustrates a block diagram of an apparatus for transmitting occupant information of a vehicle according to an embodiment of the present disclosure;

FIG. 3 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure;

fig. 4 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.

As described in the background, emergency call service can reduce rescue time and reduce the mortality of rescued people in a vehicle accident. However, in the related art, it is difficult to confirm the casualty of the passengers in the vehicle after the accident occurs, so that the rescue center cannot provide targeted rescue resources, and cannot timely provide targeted rescue for the injured passengers, and therefore, precious rescue time may be missed.

In the embodiment of the disclosure, in response to detecting that a vehicle sends rescue call information, acquiring image information in a cabin of the vehicle; carrying out face detection and/or human body detection on the image information; determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs; and sending the state information to a rescue call center. Therefore, the rescue resources required for rescue can be determined in a targeted manner based on the state information of the passengers in the vehicle cabin, so that the passengers in the vehicle cabin can be rescued in a targeted manner, symptomatic rescue is implemented, and rescue efficiency is improved.

In one possible implementation, the execution subject of the method may be an intelligent driving control device installed on a vehicle. In one possible implementation, the method may be performed by a terminal device or a server or other processing device. The terminal device may be a vehicle-mounted device, a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, or a wearable device. The vehicle-mounted device may be a vehicle or a domain controller in a vehicle cabin, and may also be a device host used in an ADAS (Advanced Driving Assistance System), an OMS (Occupant Monitoring System), or a DMS (Driver Monitoring System) for executing a method of transmitting vehicle Occupant information. In some possible implementations, the information sending method may be implemented by a processor calling computer readable instructions stored in a memory.

For convenience of description, in one or more embodiments of the present specification, an execution subject of information transmission may be an in-vehicle device in a vehicle, and hereinafter, an embodiment of the method will be described by taking the execution subject as the in-vehicle device as an example. It is understood that the method is carried out by the vehicle-mounted device only for illustrative purposes, and is not to be construed as limiting the method.

Fig. 1 illustrates a flowchart of a method for transmitting occupant information to a rescue call center for a vehicle according to an embodiment of the present disclosure, the method for transmitting vehicle occupant information including, as shown in fig. 1:

in step S11, in response to detecting that the vehicle issues rescue call information, image information in the cabin of the vehicle is acquired.

The vehicle may be at least one of private cars, shared cars, net appointment cars, taxis, trucks, and the like, and the specific type of vehicle is not limited by the present disclosure.

The image information here may be image information of an area where an occupant is located in the cabin, and the image information may be acquired by an on-board image acquisition device provided in or outside the cabin of the vehicle, and the on-board image acquisition device may be an on-board camera or an image acquisition device provided with a camera. The camera can be a camera for collecting image information inside the vehicle or a camera for collecting image information outside the vehicle.

For example, the camera may include a camera in the DMS and/or a camera in the OMS, etc., which may be used to capture image information of the interior of the vehicle; the camera may also include a camera in the ADAS, which may be used to collect image information outside the vehicle. Of course, the vehicle-mounted image capturing device may also be a camera in other systems, or may also be a separately configured camera, and the embodiment of the present disclosure does not limit the specific vehicle-mounted image capturing device.

The carrier of the image information can be a two-dimensional image or video, for example, the image information can be a visible light image/video or an infrared light image/video; the method may also be a three-dimensional image formed by a point cloud scanned by a radar, and the like, which may be determined according to an actual application scenario, and this disclosure does not limit this.

The image information collected by the vehicle-mounted image collecting device can be acquired through the communication connection established between the vehicle-mounted image collecting device and the vehicle-mounted image collecting device. In one example, the vehicle-mounted image capturing device may transmit the captured image information to the vehicle-mounted controller or the remote server through the bus or the wireless communication channel in real time, and the vehicle-mounted controller or the remote server may receive the real-time image information through the bus or the wireless communication channel.

The vehicle can trigger emergency rescue under the condition of accidents such as collision and the like, and rescue calling information is sent to a rescue calling center. Once the rescue call information sent by the vehicle is detected, the passenger in the vehicle cabin needs to be rescued, so that the image information in the vehicle sending the rescue call information can be acquired at the moment so as to detect the state of the passenger.

In step S12, face detection and/or human body detection is performed on the image information.

After the image information in the cabin is obtained, human body detection and/or human face detection can be performed on the cabin based on the image information to obtain human body detection results and/or human face detection results in the cabin, and passenger detection results in the cabin can be obtained based on the human body detection results and/or the human face detection results in the cabin. For example, the human body detection result and/or the human face detection result in the cabin may be used as the passenger detection result in the cabin. For another example, the passenger detection result in the cabin may be obtained after further processing the human detection result and/or the human face detection result in the cabin.

In the embodiment of the disclosure, human body detection and/or human face detection is performed on the cabin to obtain a human body detection result and/or a human face detection result in the cabin, wherein the detection result comprises position information of a human body and/or a human face. For example, in the case where one occupant is detected, the occupant detection result includes position information of the occupant; in the case where a plurality of occupants are detected, the occupant detection result may include position information of the detected individual occupants.

In step S13, state information of the occupant in the cabin is determined based on the detected human face and/or body.

The status information may include physical status information and/or ride status information relating to medical assistance needs. The body state information related to the medical assistance requirement may be body state information used for representing medical assistance required by the passenger, and may be a state presented by the body of the passenger, for example, information about the physical health condition of the passenger, whether bleeding occurs, age, sex, and the like. The riding state information of the occupant may be information such as the position of the occupant in the vehicle cabin, the use state of the safety protection device (for example, whether the seat belt is fastened, whether the child is seated on the safety seat, or the like). In addition, the state information of the occupant may also include other information representing the emotional state of the occupant, the state corresponding to the driving operation capability, and the like, which is not limited by the embodiment of the present disclosure.

The state information of the passenger can be determined based on the detected human face and/or human body, and can be specifically realized based on an image processing technology, for example, the identity information of the passenger can be identified based on the image processing technology, and then the medical archive information of the passenger can be determined based on the identified identity information of the passenger; for another example, whether blood exists on the passenger can be identified based on an image processing technology to determine whether the passenger is in a bleeding state, and when the passenger identifies that the blood exists on the passenger, the passenger can be determined to be in the bleeding state; for another example, the body posture of the passenger can be recognized based on image processing technology to determine whether the passenger is in a state without driving control capability, such as coma and fracture; as another example, the age, gender, etc. of the occupant may be identified based on image processing techniques; as another example, the position information of the occupant in the vehicle cabin may be determined based on the detected position of the human face and/or the human body; as another example, the use state information of the safety protection devices of the occupants in the vehicle cabin may be detected based on image processing techniques. Specific ways of determining the state of the occupant can be found in the following possible implementations, which are not described in detail herein.

In step S14, the status information is transmitted to a rescue call center.

After the state information of the passengers is determined, the state information can be sent to the rescue center. For example, the alarm information may be sent to a rescue call center through an onboard emergency call (eCall) system integrated in the vehicle, and the vehicle position and the vehicle information may be automatically sent to the rescue center.

After the rescue call center confirms the accident, rescue resources needed by rescue are determined according to the obtained state information, and the accident personnel are rescued in a targeted manner. For example, in the case that the state information of the passenger indicates that the passenger is in a blood loss state, the identity information of the passenger is determined by identifying the face of the passenger, and the medical record information of the passenger is further read according to the identity information, the passenger can be determined to be urgently transfused according to a large amount of bleeding of the passenger, and the blood type of the required blood is determined according to the blood type in the medical record information of the passenger, so that the rescuers can carry the blood of the corresponding blood type to go to the accident site for rescue. For another example, the rescuer can learn about the allergy of the drug to the injured occupant based on the allergy history in the medical record of the occupant, and select a drug more suitable for the occupant.

Alternatively, the personal information such as the medical profile described above, which is associated with the occupant identification information, may be acquired with the occupant's information authorization obtained in advance. The method can request the passengers to authorize the personal information such as medical files related to the identity information of the passengers under the condition of emergency call when the passengers register the face information, and read the medical file information of the users once the emergency call occurs and the users need medical assistance through face recognition under the condition of user authorization.

In the embodiment of the disclosure, in response to detecting that a vehicle sends rescue call information, acquiring image information in a cabin of the vehicle; carrying out face detection and/or human body detection on the image information; determining state information of passengers in the cabin based on the detected human face and/or human body, wherein the state information comprises body state information and/or riding state information related to medical aid needs; and sending the state information to a rescue call center. Therefore, the rescue resources required for rescue can be determined in a targeted manner based on the state information of the passengers in the vehicle cabin, so that the passengers in the vehicle cabin can be rescued in a targeted manner, symptomatic rescue is implemented, and rescue efficiency is improved.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes: carrying out identity recognition on the detected face to determine the identity information of the passenger; determining status information of the occupant based on the identity information.

The position of the face can be obtained through face detection, the position can be represented by a rectangular frame, and the identity information of the passenger can be determined by performing face recognition based on the image features in the rectangular frame. The image features in the rectangular frame are face feature information of a person, and identity information of an occupant is determined by identity recognition based on the face feature information of the person. In the process of identity recognition, the face features to be recognized are compared with the face feature template with known identity information, and the identity information of the face is recognized according to the similarity degree, and for the specific recognition process, the detailed description is omitted here. The identity information of the occupant may specifically be a logo that characterizes the identity of the occupant.

Part of the status information of the occupant is available on the basis of identity information, e.g. medical profile information of the occupant, age of the occupant, etc. In one possible implementation, the physical state information related to medical assistance needs includes: medical record information; the determining the state information of the occupant based on the identity information includes: and acquiring medical record information of the passenger based on the identity information.

The medical record information can record the body state information of the passengers related to medical rescue requirements, accurately reflect the body states of the passengers, and is convenient for the rescue call center to provide accurate rescue resources. The medical file information can be acquired through a third-party interface provided by a medical institution such as a hospital, the medical file information of the passenger can be acquired by calling the third-party interface provided by the medical institution, and when the interface is called, the corresponding medical file information can be returned by the interface through inputting the identity information of the passenger into the interface.

In one possible implementation, the medical profile information includes at least one of: blood type, past history, and allergy history. Based on the blood type information in the medical record information, the rescuers can prepare blood of corresponding blood type to transfuse a large amount of bleeding passengers, and provide blood of accurate blood type to improve the rescue efficiency; based on the past medical history information in the medical file information, corresponding medicines and medical care personnel can be provided for injured passengers, and more accurate rescue resources are provided for the passengers with the past medical history; based on the allergic history information in the medical record information, the allergic medicine can be avoided for the injured passenger, and more accurate rescue is provided.

In the embodiment of the disclosure, the identity information of the passenger is determined by identifying the detected face, and the state information of the passenger is determined based on the identity information, so that the state information of the passenger can be accurately determined, and accurate rescue is provided for the passenger in the vehicle cabin.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body further includes: occupant attribute information is determined based on the detected face and/or body.

In one possible implementation, the occupant attribute information includes at least one of:

age, sex;

the determining of the attribute information of the passenger based on the detected human face and/or human body comprises:

carrying out age identification on the human face to determine the age of the passenger in the cabin; and/or the presence of a gas in the gas,

and carrying out gender identification on the face to determine the gender of the passenger in the vehicle cabin.

The attribute information of the passenger can be determined based on an image processing technology, specifically, for the age of the passenger, an image of a face can be obtained, then, positions, such as skin, pupils, eye corners, mouth corners, and noses, in the face, which obviously change with the age can be located, and the age of the passenger is estimated according to the characteristics of the positions, and the specific estimation process is not described herein any more; further, it is also possible to recognize the occupant identification information based on the image of the face and then determine the age of the occupant based on the occupant identification information.

For the gender of the passenger, the image of the face/human body can be obtained, and then the gender of the passenger is predicted through a trained neural network based on the image of the face/human body; alternatively, it is also possible to recognize the occupant identification information based on the image of the face and then determine the gender of the occupant based on the occupant identification information.

In the embodiment of the disclosure, the information of attributes such as age and sex of the passenger is acquired so as to provide targeted rescue, and the rescue efficiency is improved.

In one possible implementation, the determining the occupant attribute information based on the detected human face and/or human body includes: and determining whether the passenger in the vehicle cabin is an old man or a child based on the age of the passenger in the vehicle cabin.

Based on the age of the occupant, it can be determined whether the occupant in the cabin is an elderly person or a child, for example, if the occupant is 0 to 18 years old, the occupant is determined to be a child, and if the occupant is 60 years old or older, the occupant is determined to be an elderly person. It should be noted that the age range of the adult or the child is only for demonstration, and the specific age standard can be determined according to actual conditions, which is not limited by the present disclosure.

Determining whether the occupant is an elderly person or a child can provide targeted rescue resources to the occupant, e.g., for elderly or children, a corresponding geriatric doctor or pediatrician may be provided. In addition, in the case that the passenger is determined to be a child, whether the child is located in the safety seat can be further determined, so that the injury degree of the child can be estimated, and a targeted rescue measure can be provided.

In one possible implementation, the method further includes: determining the number information of passengers in the vehicle cabin based on the detected number information of the human faces and/or human bodies, and sending the number information of the passengers to a rescue call center; and/or determining the position information of the passenger in the vehicle cabin based on the detected human face position and/or human body position information, and sending the position information of the passenger to a rescue call center.

After the face detection and/or the human body detection are performed on the image information, the number of faces and/or the number of human bodies can be obtained, and therefore, the number of detected faces can be used as the number of passengers, or the number of detected human bodies can be used as the number of passengers. In the case of detecting the human face and the human body at the same time, the maximum value of the obtained number of the human faces and the number of the human bodies may be determined as the number of the passengers. The number of passengers has a great reference significance to the number of called rescue resources, and the rescue call center is convenient to provide targeted rescue.

The position information of the passenger in the vehicle cabin may be identified by a position identifier in the vehicle cabin, and for example, the position information in the vehicle cabin may be represented by an identifier of a seat in the vehicle cabin, for example, a front-row driver seat, a front-row copilot seat, a rear-row left side, a rear-row middle, a rear-row right side, a safety seat, and the like, and for example, the seat in the vehicle cabin may be numbered in advance as: 1. 2, 3, 4, 5, etc., characterizing occupant position information within the vehicle cabin based on the seat number.

In the case that the angle of view of the image capturing device in the vehicle cabin is fixed, the position information corresponding to different image areas in the image information captured by the image capturing device may be labeled in advance, for example, the graphic area a corresponds to the seat 1, the image area b corresponds to the seat 2, the image area c corresponds to the seat 3, the image area d corresponds to the seat 4, the image area e corresponds to the seat 5, and so on. Then, when the image feature of the detected face/body is located in the pre-labeled image area, that is, the position information of the detected occupant is determined, for example, when the face is detected in the image area a, the position information of the occupant is determined to be the seat 1.

Furthermore, it is also possible to determine positional information in the vehicle cabin based on structural components of the vehicle in the vehicle cabin, for example, if a detected face/body of a person is located at a seat in front of a steering wheel, it is determined that a passenger is located at a driving seat; if the detected human face/human body is positioned in the front row of the vehicle and no steering wheel is arranged in front of the human face/human body, determining that the passenger is positioned in a copilot; if the detected human face/human body is positioned at the rear row of the vehicle and is close to the left side door, determining that the passenger is positioned at the left side of the rear row; if the detected human face/human body is positioned at the rear row of the vehicle and is close to the right side door, determining that the passenger is positioned at the right side of the rear row; and if the detected human face/human body is positioned at the middle position in the rear row of the vehicle, determining that the passenger is positioned at the middle position in the rear row.

After the occupant position information is obtained, the occupant position information may be used as an Identification (ID) for each occupant when transmitting the state information to identify and distinguish each occupant.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes: and identifying the use state of the safety protection device in the vehicle for the passenger based on the detected human body to obtain the riding state information of the passenger related to the medical rescue requirement.

The safety protection device in the vehicle is used to protect a passenger and reduce or avoid the injury of the passenger in an accident, and the safety protection device in the vehicle may be, for example, a child seat, a safety belt, etc., and two possible implementation manners provided by the embodiments of the present disclosure will be described in detail below by taking the child seat and the safety belt as examples.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes: identifying a child occupant within the vehicle cabin based on the detected face; detecting a safety seat in the vehicle cabin based on the image information; and determining the use state of the safety seat of the child passenger according to the human body detection result of the child passenger and the detection result of the safety seat.

Based on the detected face, the child occupant in the vehicle cabin can be identified, for example, based on age detection, the child occupant in the vehicle cabin can be determined. In addition, the position of the safety seat in the vehicle cabin can be detected based on the image information through an image detection technology, so that the child passenger can be determined to use the safety seat when the human body of the child passenger is detected to be positioned in the safety seat; in the case where it is detected that the human body of the child occupant is not located in the safety seat, it may be determined that the child occupant is not using the safety seat.

Whether children's passenger is located safety seat, and the injury degree to estimating children possesses the great significance, under children do not use safety seat's the condition, compares in using safety seat, and its injury degree often can be more serious, consequently, whether children use safety seat based on children, can estimate children's injury degree comparatively accurately to according to children's injury degree, provide pertinent rescue measure.

In one possible implementation, the determining the state information of the occupant in the cabin based on the detected human face and/or human body includes: and detecting the wearing condition of the safety belt of the passenger corresponding to the detected face and/or human body based on the image information to obtain the using state of the safety belt of the passenger in the vehicle cabin.

The safety belt wearing signal can be obtained through a vehicle bus or a controller of the vehicle, a safety belt wearing condition detector is usually preset in the vehicle, the detector is positioned at a safety belt socket and can detect whether a safety belt plug board is correctly inserted into the socket, and under the condition that the safety belt plug board is correctly inserted into the socket, a passenger is determined to wear the safety belt. Therefore, by reading the seatbelt wearing signal transmitted through the bus or stored in the controller, the seatbelt use state detected by the detector can be acquired.

In addition, the wearing condition of the safety belt of the detected human body can be identified based on the image identification technology, and the using state of the safety belt can be obtained. For example, the acquired image information in the vehicle cabin is input to the trained seat belt wearing condition detection model, and a seat belt wearing detection result of each passenger in the vehicle cabin is obtained.

Whether the passenger correctly wears the safety belt or not has great significance for estimating the injury degree of the passenger, and under the condition that the passenger does not use the safety belt, the injury degree of the passenger is more serious compared with the condition that the passenger uses the safety belt, so that the injury degree of the passenger can be accurately estimated based on whether the passenger uses the safety belt or not, and a targeted rescue measure is provided according to the injury degree of the passenger.

In one possible implementation, the occupant status information includes occupant injury level information; the determining state information of the passengers in the vehicle cabin based on the detected human faces and/or human bodies comprises: detecting a bleeding state of the occupant based on the detected face and body; and determining injury degree information of the passenger according to the bleeding state.

Based on the position of the face of the passenger, which can be obtained by face detection, under the condition that the face is detected, the face of the passenger can be subjected to blood detection to determine the bleeding condition of the passenger in the cabin; the position of the human body of the passenger can be obtained based on human body detection, and when the human body is detected, blood detection can be carried out on the body surface of the passenger to determine the bleeding condition of the passenger in the cabin.

An implementation of specifically performing blood detection may be detection based on color information of blood. Because the color of attachments such as clothes and accessories of the passenger can be similar to the color of blood, whether the passenger bleeds can be further determined according to the shape of the blood flow, and the shape of the blood flow can be obtained according to the shape of the real blood flow in the image.

The blood test can be realized according to a deep neural network, and the neural network for performing the blood test can be a Seq2Seq model based on an attention mechanism, a Tensorflow model and the like. The neural network can be a trained network, and can also be trained by adopting an image data set containing the bleeding condition of the passenger in the image content according to the characteristics of the image information of the bleeding of the passenger, and the neural network is trained by marking the bleeding area in the image data set, so that the accuracy of the neural network is higher when the blood is detected, and the blood on the face and/or the body surface of the passenger can be accurately detected.

After the blood is detected, the area of the blood may be determined, and the severity of bleeding from the occupant injury, which is positively correlated to the sum of the areas of the blood, may be determined based on the area of the blood.

In the disclosed embodiment, based on the detected face and body, the bleeding state of the occupant is detected; and determining injury degree information of the passenger according to the bleeding state. Thus, a targeted rescue resource may be provided based on the determined severity of the injury. For example, in the case of serious blood circulation, it is determined that transfusion rescue is needed, the blood type of the passenger is determined according to the passenger medical record information, and blood of the corresponding blood type is prepared for rescue.

In one possible implementation, after determining the status information of the occupant in the vehicle cabin, the method further comprises: determining needed rescue resource information according to the state information; and sending the rescue resource information to an emergency call center.

The rescue resource information may include the type of medical supplies required for rescue, the number of medical supplies, the professional directions of medical staff, the number of medical staff, and the like. The category of the medical materials can be a certain category of medical materials, and can also be specific medical materials, for example, the medical materials can be a whole category of materials for rescuing the wounded with excessive blood loss, or can also be specific blood of a certain blood type; the number of medical supplies, which may be, for example, the number of ambulances required, the number of stretchers, etc.; the professional direction of the medical personnel may be, for example, respiratory medical personnel, pediatric medical personnel, orthopedic medical personnel, and the like.

The rescue resource information may be determined according to the state information of the passenger, and there may be a plurality of specific ways for determining the rescue resource information, in one possible implementation manner, the determining the required rescue resource information according to the state information includes: determining the type of medical materials required for rescue and/or the professional direction of medical personnel according to at least one item of medical file information, passenger attribute information, the use state of a safety protection device and the information of the injury degree of passengers in the vehicle cabin; and/or determining the quantity of medical supplies and/or the quantity of medical personnel required for rescue according to the quantity information of the passengers in the vehicle cabin.

Based on medical record information of passengers in the vehicle cabin, information such as blood type, past medical history and allergy history of the passengers can be determined, wherein the blood type of blood for transfusion can be determined according to the blood type; the potential diseases of passengers can be determined according to the past medical history, the medical instruments and the professional directions of the needed medical personnel can be determined based on the diseases, for example, if a certain passenger has the past medical history of asthma, oxygen can be needed urgently in case of accident injury, the medical instruments needed by oxygen can be carried, and the professional directions of the medical personnel needed by rescue comprise the respiratory direction; according to the allergy history of the passenger, the method can determine the medicine allergy of the passenger, further determine the medicine category required by the passenger, eliminate the allergic medicine and provide accurate rescue.

Whether the passenger is an old person or a child and the sex of the passenger can be determined based on the passenger attribute information, the professional directions of medical staff required for rescue can be determined for the old person, and the required medical resources comprise medicines which are commonly reserved by the old person; for children, the professional directions of medical personnel needed for rescue may be determined to include pediatric directions.

Based on the information of the injury degree of the passengers, a targeted rescue resource can be provided. For example, in the case of serious blood circulation, it is determined that transfusion rescue is needed, the blood type of the passenger is determined according to the passenger medical record information, and blood of the corresponding blood type is prepared for rescue.

Because the injury severity degree of the passenger can be reflected based on the using state of the safety protection device, and the injury state is often more serious under the condition that the safety protection device is not used, after the injury severity degree of the passenger is obtained based on other factors except the using state of the safety protection device, the passenger can be further upgraded to the higher injury severity degree under the condition that the passenger is determined not to use the safety protection device. And then determining targeted rescue resources based on the upgraded injury severity.

Based on the information of the number of passengers in the cabin, the number of medical supplies and/or the number of medical staff required for rescue can be determined, for example, the number of ambulances, the number of stretchers and the like required for rescue are determined according to the number of passengers; the number of medical personnel can be determined according to the number of the passengers, so that timely treatment on the passengers injured in the vehicle cabin is guaranteed.

In one possible implementation manner, the acquiring image information in a cabin of the vehicle includes: acquiring target image information in a vehicle cabin, which is acquired by a vehicle-mounted camera device, within a preset time period before and after rescue calling information is sent by a vehicle; the performing of the face detection and/or the body detection on the image information includes: and carrying out face detection and/or human body detection on the target image information.

Considering that after the vehicle sends the rescue call information, the vehicle often has an accident, and after the accident, the human body and/or the human face of the passenger can not be collected by the vehicle-mounted camera device due to the fact that the passenger is injured and falls down, the body inclines and the like, and further image processing operations such as human face recognition and the like can not be carried out, therefore, the target image information in the vehicle cabin collected by the vehicle-mounted camera device in the preset time period before the vehicle sends the rescue call information can be obtained. Before the vehicle sends out the rescue call information, the vehicle usually runs normally, at the moment, the body state of the passenger is in a normal state, and then the image information of the human face and/or the human body can be obtained accurately in the target image information in the vehicle cabin collected by the vehicle-mounted camera device, so that the operation of identity recognition and the like on the target image information is facilitated. And the target image information in the preset time period after the accident occurs is subjected to face detection and/or human body detection, so that the determination of state information such as the injury severity and the like can be facilitated.

An application scenario of the embodiment of the present disclosure is explained below. In the application scene, after an accident occurs, rescue calling information is triggered, then image information of passengers in the cabin within 2 minutes before and after the accident occurs is acquired, and it is recognized that two adults and one child are in the automobile, the adults all use safety belts, and the children use safety seats. A passenger has more bleeding, the identity information of the passenger is obtained through identity recognition, and the blood type and the past diseases of the passenger are inquired through a medical interface based on the identity information. After all the information is uploaded to a rescue call center, the rescue call center confirms that transfusion rescue is needed, and prepares transfusion medical equipment and blood of corresponding blood types to go to an accident site for rescue.

It is understood that the above-mentioned method embodiments of the present disclosure can be combined with each other to form a combined embodiment without departing from the logic of the principle, which is limited by the space, and the detailed description of the present disclosure is omitted. Those skilled in the art will appreciate that in the above methods of the specific embodiments, the specific order of execution of the steps should be determined by their function and possibly their inherent logic.

In addition, the present disclosure also provides a device, an electronic device, a computer-readable storage medium, and a program for transmitting occupant information of a vehicle, which can be used to implement any one of the methods for transmitting occupant information of a vehicle provided by the present disclosure, and the corresponding technical solutions and descriptions and corresponding descriptions in the method section are not repeated.

Fig. 2 shows a block diagram of an apparatus for transmitting occupant information to a rescue call center for a vehicle according to an embodiment of the present disclosure, the apparatus including, as shown in fig. 2:

the image information acquiring unit 21 is used for responding to the detection that a vehicle sends rescue call information and acquiring image information in a vehicle cabin of the vehicle;

a detection unit 22, configured to perform face detection and/or human body detection on the image information;

a state information determining unit 23, configured to determine state information of passengers in the cabin based on the detected human face and/or human body, where the state information includes body state information and/or riding state information related to medical assistance requirements;

and the sending unit 24 is used for sending the state information to the rescue call center.

In a possible implementation manner, the state information determining unit 23 includes:

the identity information determining unit is used for identifying the identity of the detected face and determining the identity information of the passenger;

a state information determination subunit configured to determine state information of the occupant based on the identity information.

In one possible implementation, the physical state information related to medical assistance needs includes: medical record information;

the state information determination subunit includes:

and the medical file information determining unit is used for acquiring the medical file information of the passenger based on the identity information.

In one possible implementation, the medical profile information includes at least one of:

blood type, past history, and allergy history.

In one possible implementation, the state information further includes occupant attribute information, and the state information determination unit 23 includes:

an attribute information determination unit for determining occupant attribute information based on the detected face and/or body.

In one possible implementation, the occupant attribute information includes at least one of:

age, sex;

the attribute information determination unit includes:

the age determining unit is used for carrying out age identification on the human face and determining the age of the passenger in the cabin; and/or the presence of a gas in the gas,

and the gender determining unit is used for carrying out gender identification on the human face and determining the gender of the passenger in the vehicle cabin.

In a possible implementation manner, the attribute information determining unit includes:

and the old people and children determining unit is used for determining whether the passengers in the vehicle cabin are old people or children or not based on the ages of the passengers in the vehicle cabin.

In one possible implementation, the apparatus further includes:

a number information determination unit for determining the number information of the passengers in the vehicle cabin based on the detected number information of the human face and/or the human body, and

transmitting the number information of the passengers to a rescue call center;

and/or the presence of a gas in the gas,

a position information determination unit for determining position information of the passenger in the vehicle cabin based on the detected face position and/or human body position information, and

and transmitting the position information of the passenger to a rescue call center.

In a possible implementation manner, the state information determining unit 23 includes: and the safety protection device use state identification unit is used for identifying the use state of the safety protection device in the vehicle for the passenger based on the detected human body to obtain the riding state information of the passenger related to the medical rescue requirement.

In a possible implementation manner, the state information determining unit 23 includes:

a child passenger identification unit for identifying a child passenger in the vehicle cabin based on the detected face;

the safety seat identification unit is used for detecting a safety seat in the vehicle cabin based on the image information;

and the safety seat use state determining unit is used for determining the use state of the safety seat of the child passenger according to the human body detection result of the child passenger and the detection result of the safety seat.

In a possible implementation manner, the state information determining unit 23 includes:

and the safety belt use state determining unit is used for detecting the safety belt wearing condition of the passenger corresponding to the detected human face and/or human body based on the image information to obtain the safety belt use state of the passenger in the vehicle cabin.

In one possible implementation, the occupant status information includes occupant injury level information;

the state information determination unit 23 includes:

a bleeding state detection unit for detecting a bleeding state of the occupant based on the detected face and the human body;

and the injury degree determining unit is used for determining injury degree information of the passenger according to the bleeding state.

In one possible implementation, after determining the status information of the occupant in the vehicle cabin, the apparatus further comprises:

the rescue resource determining unit is used for determining needed rescue resource information according to the state information;

and the rescue resource information sending unit is used for sending the rescue resource information to an emergency call center.

In one possible implementation manner, the rescue resource determining unit includes:

the medical resource type determining unit is used for determining the type of medical materials required for rescue and/or the professional direction of medical personnel according to at least one item of medical file information, passenger attribute information, the using state of a safety protection device and the injury degree information of passengers in the cabin; and/or

And the medical resource quantity determining unit is used for determining the quantity of medical materials and/or the quantity of medical personnel required for rescue according to the quantity information of the passengers in the vehicle cabin.

In one possible implementation manner, the image information obtaining unit 21 includes:

the system comprises a target image information acquisition unit, a vehicle-mounted camera device and a vehicle-mounted display device, wherein the target image information acquisition unit is used for acquiring target image information in a vehicle cabin, which is acquired by the vehicle-mounted camera device, within a preset time period before and after rescue calling information is sent by a vehicle;

the detection unit 22 is configured to perform face detection and/or human body detection on the target image information.

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.

Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the above-mentioned method. The computer readable storage medium may be a volatile or non-volatile computer readable storage medium.

An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

The disclosed embodiments also provide a computer program product comprising computer readable code or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, the processor in the electronic device performs the above method.

The electronic device may be provided as a terminal, server, or other form of device.

Fig. 3 illustrates a block diagram of an electronic device 800 in accordance with an embodiment of the disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like terminal.

Referring to fig. 3, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 800 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the electronic device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the electronic device 800 to perform the above-described methods.

Fig. 4 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure. For example, the electronic device 1900 may be provided as a server. Referring to fig. 4, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.

The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as the Microsoft Server operating system (Windows Server), stored in the memory 1932TM) Apple Inc. of the present application based on the graphic user interface operating System (Mac OS X)TM) Multi-user, multi-process computer operating system (Unix)TM) Free and open native code Unix-like operating System (Linux)TM) Open native code Unix-like operating System (FreeBSD)TM) Or the like.

In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the electronic device 1900 to perform the above-described methods.

The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

25页详细技术资料下载
上一篇:一种医用注射器针头装配设备
下一篇:基于大数据的集中功率预测和气象预警综合系统

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!

技术分类