阅读说明：本技术 车载电子设备及其人机交互方式自适应调整方法 (Vehicle-mounted electronic equipment and man-machine interaction mode self-adaptive adjusting method thereof ) 是由 汤丹扬 于 2019-10-30 设计创作，主要内容包括：一种车载电子设备及其上的人机交互方式自适应调整方法以及服务器。该人机交互方式自适应调整方法包括：根据第一传感器获取的信息确定驾驶员的注意力状态；根据第二传感器获取的信息确定驾驶员的驾驶习惯；以及根据注意力状态与驾驶习惯切换人机交互方式。该服务器可以为该车载电子设备提供该人机交互方式自适应调整方法。本发明的车载电子设备及其上的人机交互方式自适应调整方法能够降低驾驶员的安全隐患。(A vehicle-mounted electronic device, a man-machine interaction mode self-adaptive adjusting method thereof and a server are provided. The self-adaptive adjusting method of the man-machine interaction mode comprises the following steps: determining the attention state of the driver according to the information acquired by the first sensor; determining the driving habits of the driver according to the information acquired by the second sensor; and switching the man-machine interaction mode according to the attention state and the driving habit. The server can provide the man-machine interaction mode self-adaptive adjusting method for the vehicle-mounted electronic equipment. The vehicle-mounted electronic equipment and the man-machine interaction mode self-adaptive adjusting method thereof can reduce the potential safety hazard of a driver.)

1. A man-machine interaction mode self-adaptive adjusting method of vehicle-mounted electronic equipment is characterized by comprising the following steps:

determining the attention state of the driver according to the information acquired by the first sensor;

determining the driving habits of the driver according to the information acquired by the second sensor; and

and switching the man-machine interaction mode according to the attention state and the driving habit.

2. The method of claim 1, wherein the human-machine interaction mode is changed when the attention state and/or the driving habits change.

3. The method of claim 2, wherein the human-machine interaction mode is changed by launching and/or switching one or more of an application, a system service.

4. The method according to claim 1, characterized in that the man-machine interaction mode is switched according to a preset rule with the attention state and the driving habits as input parameters, wherein the preset rule is suitable for being formulated by a driver.

5. The method of claim 1, wherein the in-vehicle electronic device is caused to play music when the driving habit of the driver is determined to be impatient.

6. The method of claim 1, wherein the human-machine interaction mode is determined to be voice interaction when the driving habit of the driver is determined to be stable and the attention state is determined to be an attention focused state.

7. The method of claim 1, wherein when the attentiveness state of the driver is determined to be an inattentive state, the human-machine interaction mode is determined to be pop-window interaction.

8. The method of claim 1, wherein the in-vehicle electronic device comprises an in-vehicle infotainment system, a meter, or a combination thereof.

9. An in-vehicle electronic apparatus, characterized by comprising:

one or more processors; and

a computer-readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to perform the method of any one of claims 1-7.

10. A server comprising a non-transitory computer-readable storage medium having stored thereon a plurality of instructions adapted to be executed by one or more processors of an in-vehicle electronic device, the plurality of instructions, in response to execution by the one or more processors, causing the one or more processors to perform the method of any of claims 1-7.

11. The server of claim 10, wherein the in-vehicle electronic device obtains the plurality of instructions OTA to cause the in-vehicle electronic device to implement the method of any of claims 1-7.

Technical Field

The invention relates to vehicle body electronics, in particular to vehicle-mounted electronic equipment and a man-machine interaction mode self-adaptive adjusting method thereof.

Background

The vehicle-mounted infotainment system and the instrument can provide various information for drivers and passengers, and interact with the drivers and the passengers, such as providing vehicle state information, navigation information, multimedia entertainment, mobile phone interconnection, internet of vehicles, voice assistance and the like. The vehicle passenger cabin develops towards the direction of multi-screening, entertainment and intelligent integration, automobile manufacturers generally hope to use more and larger display screens, various application programs are conveniently preloaded, and the vehicle using experience of drivers and passengers is enriched. But then the driver is required to spend more time using the applications, which also brings more safety hazards. In addition, during the driving of the vehicle, the driver may be tired and distracted, and if the driver needs to operate the infotainment system, the instrument, and the like, a greater potential safety hazard may be brought.

Disclosure of Invention

The invention aims to provide vehicle-mounted electronic equipment and a man-machine interaction mode self-adaptive adjusting method thereof, which can reduce the potential safety hazard of a driver.

In order to solve the above problem, an aspect of the present invention provides a method for adaptively adjusting a human-computer interaction mode of a vehicle-mounted electronic device, including: determining the attention state of the driver according to the information acquired by the first sensor; determining the driving habits of the driver according to the information acquired by the second sensor; and switching the man-machine interaction mode according to the attention state and the driving habit.

Another aspect of the present invention provides an in-vehicle electronic apparatus, including: one or more processors; and a computer-readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to perform a method as described above.

Yet another aspect of the invention provides a server comprising a non-transitory computer-readable storage medium having stored thereon a plurality of instructions adapted to be executed by one or more processors of an in-vehicle electronic device, the plurality of instructions, in response to execution by the one or more processors, causing the one or more processors to perform a method as described above.

Compared with the prior art, the scheme has the following advantages:

the vehicle-mounted electronic equipment and the self-adaptive adjusting method of the man-machine interaction mode of the vehicle-mounted electronic equipment can realize self-adaptive adjustment of the man-machine interaction mode according to the attention state and/or driving habits of a driver, avoid or reduce the operation of the driver on the vehicle-mounted electronic equipment, and improve the safety. In addition, the preset rule can be set by a driver, so that the operation is convenient and the method is more humanized. Finally, the self-adaptive adjustment method for the man-machine interaction mode of the vehicle-mounted electronic equipment can be realized through an application program, and the invention can be realized by the existing vehicle-mounted electronic equipment in a mode of updating and/or installing the application program, and has the advantages of convenient modification and low cost.

Drawings

FIG. 1 illustrates a system block diagram of a vehicle in accordance with one or more embodiments of the invention;

FIG. 2 illustrates a human-computer interaction mode adaptive adjustment method for an in-vehicle electronic device according to one or more embodiments of the invention;

FIG. 3 illustrates a system diagram of an in-vehicle electronic device acquiring an update or application in accordance with one or more embodiments of the invention.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention to those skilled in the art. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. Furthermore, it should be understood that the invention is not limited to the specific embodiments described. Rather, it is contemplated that the invention may be practiced with any combination of the following features and elements, whether or not they relate to different embodiments. Thus, the following aspects, features, embodiments and advantages are merely illustrative and should not be considered elements or limitations of the claims except where explicitly recited in a claim.

FIG. 1 illustrates a system block diagram of a vehicle in accordance with one or more embodiments of the invention. Referring to fig. 1, a vehicle 100 includes an in-vehicle electronic device 110, a first sensor 120, and a second sensor 130. The in-vehicle electronic device 110, the first sensor 120, and the second sensor 130 communicate with each other through the in-vehicle bus 140. In one or more embodiments, the on-board bus 140 includes one or more of a CAN bus, a LIN bus, a FlexRay bus, a MOST bus, and an ethernet. In one or more embodiments, in-vehicle electronic device 110 includes an in-vehicle infotainment system, a meter, or a combination thereof.

In-vehicle electronic device 110 includes one or more processors 111 and computer-readable storage media 112. Computer-readable storage medium 112 is used to store, either volatile or non-volatile, computer instructions that may be read and executed by processor 111 to cause in-vehicle electronic device 110 to perform one or more functions. In one or more embodiments, the processor 111 includes one or more of an X86 processor, an X64 processor, an ARM processor, a MIPS processor, an ASIC, an FPGA, a DSP, or the like. In one or more embodiments, computer-readable Storage medium 112 includes Memory (Memory) and/or Storage (Storage). The Memory illustratively includes volatile storage media such as Random Access Memory (RAM), or the like. The Memory illustratively includes non-volatile storage media such as Read Only Memory (ROM), flash Memory, optical disks, magnetic disks, and the like.

In one or more embodiments, in-vehicle electronic device 110 also includes an Operating System (OS) 113. The operating system 113 is used to manage hardware and software resources of the in-vehicle electronic device 110 and provide general system services for application programs.

In-vehicle electronic device 110 also includes an attention state determination module 114. The attentiveness state determination module 114 is configured to determine the attentiveness state of the driver based on the information obtained by the first sensor 120. In one or more embodiments, the attention state determination module 114 is implemented by one or more of an application, system software, and system services running on the operating system 113. In one or more embodiments, the attention state determination module 114 is implemented directly by the processor 111 executing corresponding computer instructions.

In one or more embodiments, the first sensor 120 includes an image capture device (not shown) for capturing an image of the driver's face. Accordingly, the attentional state determination module 114 determines the attentional state of the driver from the images acquired by the first sensor 120. In one or more embodiments, the attentional state determination module 114 determines the current attentional state of the driver by analyzing the driver's face and/or the driver's gaze location characteristics in the image of the driver's face acquired by the first sensor 120. For example, if the driver stays for a certain period of time while his or her line of sight is deviated from the straight ahead direction, it is determined that the driver is in a state where the driver is likely to be disturbed by the outside and is not focused. For example, if the driver's sight line is directly in front for a long time, it is determined that the driver is in an excessively concentrated state and is likely to be fatigued. It is understood that the first sensor 120 may also include other types of sensors, such as a sensor for monitoring the heartbeat and respiration of the driver, and the invention is not limited thereto.

The in-vehicle electronic device 110 further includes a driving habit determination module 115. The driving habit determination module 115 is configured to determine the driving habit of the driver according to the information acquired by the second sensor 130. In one or more embodiments, the driving habit determination module 115 is implemented by one or more of an application program, system software, and system services running on the operating system 113. In one or more embodiments, the driving habit determination module 115 is implemented directly by the processor 111 executing corresponding computer instructions.

In one or more embodiments, the second sensor 130 includes one or more of a steering wheel angle sensor, a brake pedal position sensor, and an accelerator pedal position sensor. In one or more embodiments, the driving habit determination module 115 determines the driving habit according to one or more of the magnitude of the steering angle of the steering wheel, the frequency of steering angle change, the frequency of pressing the brake pedal, and the frequency of pressing the accelerator pedal. For example, if the rotation angle of the steering wheel is frequently changed and the brake pedal and the accelerator pedal are frequently used, it is determined that the driving habit of the driver is impatient. If the steering wheel is slightly changed in rotation angle and the use frequency of a brake pedal and an accelerator pedal is limited, the driving habit of the driver is determined to be stable. It is understood that the second sensor 130 may also include other sensors, such as a wheel speed sensor, and the like, and the present invention is not limited thereto.

The in-vehicle electronic device 110 further includes a man-machine interaction mode adaptive adjustment module 116. The human-computer interaction mode adaptive adjusting module 116 is configured to switch the human-computer interaction mode according to the attention state determined by the attention state determining module 114 and the driving habit determined by the driving habit determining module 115. In one or more embodiments, the human-machine interaction manner adaptation module 116 is implemented by one or more of an application program, system software, and a system service running on the operating system 113. In one or more embodiments, the human machine interaction manner adaptive adjustment module 116 is directly implemented by the processor 111 executing corresponding computer instructions.

In one or more embodiments, the human-computer interaction mode of the in-vehicle electronic device 110 is changed when the attention state and/or driving habits of the driver change. That is, the man-machine interaction mode of the in-vehicle electronic device 110 changes following the change of the attention state and the driving habit of the driver. In one or more embodiments, the change in the manner of human-computer interaction of in-vehicle electronic device 110 is accomplished by launching and/or switching one or more of an application, a system service, or both.

In one or more embodiments, when the driving habit determination module 115 determines that the driving habit of the driver is impatient, the in-vehicle electronic device 110 may be caused to play music. For example, music playing software is started to play music. Preferably, the music playing software plays relatively soothing music to ease the mood of the driver. It should be noted that playing music is independent of human-computer interaction. That is, while playing music, the in-vehicle electronic device 110 may still interact with the driver in a human-computer interaction manner. Such as switching songs, adjusting music volume, etc., by way of voice interaction.

In one or more embodiments, when the driving habit determination module 115 determines that the driving habit of the driver is stable and the attention state determination module 114 determines that the attention state of the driver is an attention focusing state, the human-computer interaction manner adaptive adjustment module 116 determines that the human-computer interaction manner of the in-vehicle electronic device 110 is voice interaction. For example, the human-machine interaction mode adaptive adjustment module 116 starts voice interaction software or starts a voice interaction service of the system to realize voice interaction. When the attention of the driver is over-concentrated, the driver is in a fatigue-prone state, the over-concentration of the attention of the driver can be relieved by adopting a voice interaction mode, and the fatigue of the driver can also be relieved. It should be noted that "voice interaction" in the context of the present invention includes an interaction mode in which voice interaction is dominant and graphic interaction is subordinate, rather than only voice interaction.

In one or more embodiments, when the attention state determination module 114 determines that the attention state of the driver is the inattentive state, the human-computer interaction manner adaptive adjustment module 116 determines that the human-computer interaction manner of the in-vehicle electronic device 110 is pop-up window interaction. The driver's inattention is usually caused by external disturbance, and the adoption of the mode of pop-up window interaction can attract the driver's attention to the interior of the vehicle or the position right in front of the vehicle, so that the driver can pay more attention to the road condition information right in front of the vehicle. It should be noted that the pop-up window interaction described in the context of the present invention includes an interaction manner in which pop-up window interaction is dominant and voice prompt is a spoke, rather than only pop-up window interaction.

In one or more embodiments, in-vehicle electronic device 110 further includes a preset rule making module 117. The preset rule making module 117 is configured to make a human-computer interaction mode determination rule of the in-vehicle electronic device 110. The preset rule is input by the attention state and driving habit of the driver. In this way, the driver can formulate a man-machine interaction mode according with the preference of the driver through the preset rule formulation module 117. It is understood that the preset rule may have other input parameters, and the present invention is not limited thereto. In one or more embodiments, the preset rule making module 117 may execute the preset rule by displaying the preset rule or the preset rule template, and receiving a modification to the preset rule or the preset rule template. In one or more embodiments, the preset rules are stored in the computer-readable storage medium 112 in the form of a script file.

As described above, the in-vehicle electronic device 110 may adaptively adjust the human-computer interaction mode according to the attention state and/or driving habits of the driver, thereby avoiding or reducing the operations of the driver on the in-vehicle electronic device 110 and increasing the safety. In addition, the preset rule can be set by a driver, so that the operation is convenient and the method is more humanized.

Fig. 2 illustrates a man-machine interaction manner adaptive adjustment method of an in-vehicle electronic device according to one or more embodiments of the invention. The man-machine interaction manner adaptive adjustment method 200 of the vehicle-mounted electronic device can be executed in the vehicle-mounted electronic device 110 shown in fig. 1, for example. The human-computer interaction mode self-adaptive adjusting method 200 of the vehicle-mounted electronic equipment comprises the following steps:

step 210: determining the attention state of the driver according to the information acquired by the first sensor;

step 220: determining the driving habits of the driver according to the information acquired by the second sensor; and

step 230: and switching a man-machine interaction mode according to the attention state and the driving habit.

It should be noted that the sequence of steps shown in fig. 2 is merely exemplary and is not intended to limit the present invention. It is understood that the order of the steps in the method 200 may be arbitrarily adjusted without departing from the spirit and scope of the present invention, for example, step 220 may be performed before step 210, and for example, step 210 and step 220 may be performed simultaneously.

In one or more embodiments, the method 200 is performed at all times during the travel of the vehicle 100. In this way, the man-machine interaction mode can be changed in time when the attention state and/or driving habits of the driver change. In one or more embodiments, the change in human-machine interaction in step 230 is accomplished by launching and/or switching one or more of an application, a system service, etc.

In one or more embodiments, when the driving habit of the driver is determined to be impatient in step 220, the vehicle-mounted electronic device 110 may be made to play music in a man-machine interaction manner. For example, music playing software is started to play music. Preferably, the music playing software plays relatively soothing music to ease the mood of the driver. It should be noted that playing music is independent of human-computer interaction. That is, while playing music, the in-vehicle electronic device 110 may still interact with the driver in a human-computer interaction manner. Such as switching songs, adjusting music volume, etc., by way of voice interaction.

In one or more embodiments, when the driving habit of the driver is determined to be stable in step 210 and the attention state of the driver is determined to be the attention focusing state in step 220, the human-computer interaction mode of the in-vehicle electronic device 110 is determined to be voice interaction in step 230. Step 230 enables voice interaction, for example, by launching voice interaction software or launching a voice interaction service of the system. When the attention of the driver is over-concentrated, the driver is in a fatigue-prone state, the over-concentration of the attention of the driver can be relieved by adopting a voice interaction mode, and the fatigue of the driver can also be relieved.

In one or more embodiments, when it is determined in step 210 that the attention state of the driver is the inattentive state, step 230 determines that the human-computer interaction mode of the in-vehicle electronic device 110 is pop-up window interaction. The driver's inattention is usually caused by external disturbance, and the adoption of the mode of pop-up window interaction can attract the driver's attention to the interior of the vehicle or the position right in front of the vehicle, so that the driver can pay more attention to the road condition information right in front of the vehicle.

It should be noted that the preset rule for switching the man-machine interaction mode according to the attention state and the driving habit can be formulated by the driver to meet the preference of the driver. That is, the preset rule takes the attention state and the driving habit as input parameters and takes a man-machine interaction mode as an output parameter. Of course, the preset rule may have other input parameters and/or output parameters, which is not limited in the present invention.

In one or more embodiments, the method 200 may be implemented by an application. Thus, the present invention can be implemented by installing the application program of the implementation method 200 on the existing vehicle-mounted electronic device, and has the advantages of convenient modification, low modification cost, etc.

FIG. 3 illustrates a system diagram of an in-vehicle electronic device acquiring an update or application in accordance with one or more embodiments of the invention. Referring to FIG. 3, in-vehicle electronic device 110 may communicate with server 300, which may obtain updates or applications from server 300. The aforementioned application of method 200 may be stored in the form of instructions in computer-readable storage medium 310 as part of an update or as a separate application to be provided to in-vehicle electronic device 110. The application of the method 200 may include an attention state determination module 114, a driving habit determination module 115 and a human-machine interaction manner adaptation module 116. The specific implementation and implemented functions of the attention state determining module 114, the driving habit determining module 115 and the man-machine interaction manner adaptive adjusting module 116 are as described above, and will not be described repeatedly here. The computer-readable storage medium 310 is non-volatile and may include, for example, one or more of a solid state disk, a magnetic disk, an optical disk, a magnetic tape, and so forth. After the in-vehicle electronic device 110 acquires the update or application transmitted by the server 300, the acquired update or application may be stored in the computer-readable storage medium 112. The processor 111 in the in-vehicle electronic device 110 may execute an application program stored in the computer-readable storage medium 112 to implement the aforementioned method 200. In this manner, existing in-vehicle electronic devices may implement the present invention by way of over-the-air upgrade (OTA) and/or installation of applications.

Although the present invention has been described with reference to the preferred embodiments, it is not limited thereto. Various changes and modifications within the spirit and scope of the present invention will become apparent to those skilled in the art from this disclosure, and it is intended that the scope of the present invention be defined by the appended claims.