阅读说明：本技术 用于运行用于机动车的显示设备的方法以及机动车 (Method for operating a display device for a motor vehicle and motor vehicle ) 是由 S·格特利歇尔 I·罗茨尔 R·威策莱克 于 2018-06-14 设计创作，主要内容包括：本发明涉及一种用于运行显示设备(34)的方法,该显示设备尤其是用于机动车(10)的显示设备,显示设备包括多个显示面(36、38),为了在第一显示面(36)上选择至少一个显示元素(40),检测用户(26)的非接触式的第一输入操作并且通过用户(26)的非接触式的第二输入操作进行验证；为了将至少一个显示元素(40)从第一显示面(36)在第一显示面(36)之内移动或移动到第二显示面(38)上,检测用户(26)的至少一个非接触式的第三输入操作。本发明还涉及一种具有显示设备(34)的机动车(10),该显示设备具有多个显示面(36、38)、至少一个用于检测非接触式的输入操作的传感器,所述传感器尤其是包括摄像头(12、16),并且显示设备具有控制装置,所述控制装置构成用于执行按照本发明的方法。(The invention relates to a method for operating a display device (34), in particular for a motor vehicle (10), comprising a plurality of display surfaces (36, 38), wherein, for selecting at least one display element (40) on a first display surface (36), a first contactless input operation by a user (26) is detected and verified by a second contactless input operation by the user (26); in order to move at least one display element (40) from the first display surface (36) within the first display surface (36) or onto the second display surface (38), at least one third, contactless input operation by the user (26) is detected. The invention further relates to a motor vehicle (10) having a display device (34) which has a plurality of display surfaces (36, 38), at least one sensor for detecting a contactless input operation, in particular comprising a camera (12, 16), and having a control device which is designed to carry out the method according to the invention.)

1. Method for operating a display device (34), in particular for a motor vehicle (10), comprising a plurality of display surfaces (36, 38), wherein, for selecting at least one display element (40) on a first display surface (36), a first contactless input operation by a user (26) is detected and verified by a second contactless input operation by the user (26); and to move the at least one display element (40) from the first display surface (36) at least once within the first display surface (36) or onto the second display surface (38), at least one contactless third input operation by the user (26) is detected.

2. The method of claim 1, wherein a plurality of contactless input operations are provided, wherein preferably the contactless first, second and third input operations are different from each other and/or selectable and/or changeable by a user (26).

3. The method as claimed in claim 2, wherein the contactless input operation is determined by a parameter characterizing the head (24) of the user (26), or a parameter characterizing the torso of the user (26), or a parameter characterizing the hand (32) and/or at least one finger of the user (26), or a parameter characterizing the mouth of the user (26), the parameter characterizing the head of the user comprising in particular the direction of the line of sight, the eye position, the iris position, the pupil position, the nose position, the head posture, the head position, the head orientation and/or the facial expression of the user (26), the parameter characterizing the torso of the user comprising in particular the body posture, the body position, the body orientation, the shoulder position and/or the shoulder orientation of the user (26), the parameters characterizing the hand and/or at least one finger of the user comprise, in particular, gestures, such as a sweep, an approach, a removal, a finger spread, a finger bend, a finger touch and/or a fist, and/or a finger position and/or a hand (32) position and/or a finger orientation and/or a hand (32) orientation, and the parameters characterizing the mouth of the user comprise, in particular, a lip movement, a sound and/or a voice command.

4. A method as claimed in claim 3, wherein, for detecting a first input operation without contact, at least one parameter characterizing the head (24) of the user (26) is detected, and for verification, at least one parameter characterizing the torso of the user (26) is detected as a second input operation without contact; or, for detecting a first, contactless input operation, at least one variable characterizing the torso of the user (26) is detected, and for verification, at least one variable characterizing the head (24) of the user (26) is detected as a second, contactless input operation.

5. Method according to claim 3 or 4, wherein for detecting the contactless third input operation at least one parameter characterizing a hand (32) or a finger of the user (26) and/or a parameter characterizing a mouth of the user (26) is detected.

6. The method of one of the preceding claims, wherein for detecting the contactless first, second and/or third input operation at least one depth imaging camera (12, 16), in particular a time-of-flight camera, is used.

7. The method as claimed in any of the preceding claims, wherein a monitor and/or a projection surface and/or a head-up display and/or a flexible OLED display and/or a liquid crystal display and/or a light-transmitting fabric and/or a light-transmitting film is used as the display surface (36, 38).

8. The method according to one of the preceding claims, wherein display surfaces (36, 38) which are provided in the dashboard (14) and/or on the windshield (18) and/or in the roof (22) and/or in the central control and/or in other interior trim parts of the motor vehicle (10) are used.

9. The method of any one of the preceding claims, wherein the at least one display element (40, 42, 44) is an icon and/or a menu item and/or the total content of the first display surface (36) and/or a selected partial area of the first display surface (36).

10. The method of any of the above claims, wherein brain activity of the user (26) is detected as a further contactless input operation.

11. The method according to one of the preceding claims, wherein the at least one display element (40) is selected on the first display surface (36) when a first and a second input operation without contact are detected within a first time interval, and/or the at least one selected display element (40) is moved from the first display surface (36) within the first display surface (36) or onto the second display surface (38) when a first and/or a second input operation without contact and a third input operation without contact are detected within a second time interval.

12. The method according to any one of the preceding claims, wherein the movement is cancelled by a contactless fourth input operation of the user (26), preferably different from the contactless first and second and third input operations of the user (26), or by operating an input device, in particular comprising a touch pad.

13. The method according to any one of the preceding claims, wherein the at least one display element (40) is enlarged and/or additional information about the at least one display element (40) is displayed and/or switched into a submenu about the at least one display element (40) when the at least one display element (40) is moved.

14. The method according to one of claims 1 to 12, wherein the at least one display element (40) is zoomed out and/or less information about the at least one display element (40) is displayed and/or the at least one display element (40) is moved away from the direction of the line of sight of the user (26) and/or into the background when the at least one display element (40) is moved.

15. Motor vehicle (10) having a display device (34) with a plurality of display surfaces (36, 38), at least one sensor for detecting a contactless input operation, and having a control device which is designed to carry out the method according to one of the preceding claims.

Technical Field

The invention relates to a method for a display device, in particular for a display device of a motor vehicle, and to a motor vehicle having a control device which is designed for such a method.

Background

In modern motor vehicles, an increasing number of electronic (digital) display surfaces are installed which, on the one hand, are intended to replace conventional analog instruments of the motor vehicle and, on the other hand, can provide additional information, such as map views, operating surfaces for entertainment and telecommunication systems and the like.

It has been found that the operation of such a display surface using conventional input devices, such as buttons, joysticks, touch pads and the like, is very complicated and may therefore lead on the one hand to erroneous inputs on the part of the driver and on the other hand to a high risk of driver distraction.

For this reason, it is desirable to provide a contactless input method that is as simple as possible. A steering device for gesture control according to the direction of the line of sight is thus known, for example, from US9244527B 2. The gaze direction of the user here selects the target device or function, which should be influenced by the subsequent gesture input.

It has been found, however, that pure gesture input can often also result in misoperations. In particular, it may happen that accidental gestures which are not regarded as errors of the operating input are recognized as operating inputs, so that the content of the display surface is undesirably changed by the driver of the motor vehicle. Gesture-based input systems also typically require a large number of different gestures, which are often difficult for a user to remember. This may also lead to erroneous inputs and interference. This can also lead to erroneous inputs and to distraction.

Disclosure of Invention

The object of the invention is therefore to provide a method and a motor vehicle, by means of which the operation of the display screen in the motor vehicle is simplified.

This object is achieved by a method having the features of claim 1 and by a motor vehicle having the features of claim 15. Preferred processes according to the invention are specified in claims 2 to 14.

A method for operating a display device, in particular for a motor vehicle, comprising a plurality of display surfaces is therefore provided, wherein, for selecting at least one display element on a first display surface, a first contactless input operation by a user is detected and verified by a second contactless input operation by the user; and to move the selected at least one display element from the first display surface at least once within the first display surface or onto the second display surface, at least one contactless third input operation by the user is detected.

Verifying the contactless first input operation by the contactless second input operation may ensure that undesired erroneous inputs by the user are reduced or completely avoided. A particularly reliable method for operating a display device is thereby provided.

According to the invention, it is proposed that a plurality of contactless input operations are provided, wherein preferably the contactless first, second and third input operations differ from one another and/or can be selected and/or changed by a user.

The contactless input operation is preferably determined by a parameter characterizing the head of the user, in particular the gaze direction, the eye position, the iris position, the pupil position, the nose position, the head orientation and/or the facial expression of the user, or a parameter characterizing the torso of the user, in particular the body position, the body orientation, the shoulder position and/or the shoulder orientation of the user, or a parameter characterizing the hand and/or at least one finger of the user, in particular a gesture, such as sweeping, approaching, moving away, finger opening, finger bending, finger touching and/or fist making, and/or finger position and/or hand position and/or finger orientation and/or hand orientation, the parameters characterizing the mouth of the user comprise, in particular, lip movements, sounds and/or voice commands.

For detecting a first input operation without contact, at least one parameter characterizing the head of the user can be detected, and for verification, at least one parameter characterizing the torso of the user can be detected as a second input operation without contact; or vice versa.

For detecting the contactless third input operation, at least one variable characterizing the hand or finger of the user and/or a variable characterizing the mouth of the user can be detected.

The selection of the at least one display element on the first display surface as a function of the viewing direction requires minimal user activity and is therefore particularly comfortable.

According to the present invention, gesture control is mainly used to perform a predetermined action, i.e. movement. This makes it possible to do this with a small number of particularly simple gestures which can be easily remembered by the user. Movement over multiple display elements may also be achieved simply by multiple gestures, for example by multiple wiping movements of the hand.

Verification of the first input operation, preferably the direction of the user's gaze, by the user's body position or body orientation as the second input operation may ensure that accidental eye movements (e.g. fast side-looking at the co-driver) are not counted as input operations. This improves the reliability of the operation of the display device.

In a further preferred embodiment of the invention, at least one depth imaging camera, in particular a time-of-flight camera, is used for detecting the contactless first, second and/or third input operation. Such depth imaging cameras provide, in addition to brightness information and/or color information about each pixel point, depth information, i.e. the distance of the object assigned to the respective pixel point from the camera. In a time-of-flight camera, this is achieved by measuring the light running time between the light source, the object and the camera. It goes without saying that other forms of depth imaging cameras, such as stereo cameras, interferometric cameras, triangulation systems or light field cameras, may also be used. By including depth or distance information in the camera image to be evaluated, gestures of the user and body and head gestures or body and head orientations of the user can be detected particularly reliably.

Further preferably, a monitor and/or a projection surface and/or a head-up display and/or a flexible OLED display and/or a liquid crystal display and/or a light-transmitting fabric and/or a light-transmitting film are used as display surface. The display device can thus be adapted without problems to the interior design of the motor vehicle and integrated seamlessly therein. At the same time, it is possible to adapt the individual display surfaces specifically to the requirements of the driver or passenger of the motor vehicle.

Furthermore, it is preferred to use display surfaces which are arranged in the dashboard and/or on the windshield and/or in the roof and/or in the center console and/or in other interior trim parts of the motor vehicle. It is thus ensured, for example, that for every possible direction or orientation of the driver's gaze a display surface is in the area of his gaze, so that all the necessary information can be transmitted to the driver at any time.

In a further preferred embodiment of the invention, the at least one display element is an icon and/or a menu item and/or the total content of the first display area and/or a selected partial area of the first display area. In this way, a plurality of different operating actions can be implemented on the basis of the same operating method, without the user having to remember a special gesture in each case for this purpose. This simplifies the operation of the display device.

It is further preferred that the brain activity of the user and/or the speech input of the user is detected as a further contactless input operation. This can be used not only to further verify the already described operating actions, but also to additionally modify the operating actions.

According to the invention, the at least one display element is preferably selected on the first display area when the first and second contactless input operations are detected within a first time interval, and/or the at least one selected display element is moved from the first display area within the first display area or onto the second display area when the first and/or second and third contactless input operations are detected within a second time interval. This serves to further reduce malfunction.

According to the invention, it is furthermore proposed that the movement is canceled by a contactless fourth input operation by the user, which preferably differs from the first and second and third contactless input operations by the user, or by operating an input device, which in particular comprises a touch panel.

The at least one display element may be enlarged and/or additional information about the at least one display element may be displayed and/or a sub-menu about the at least one display element may be switched into when the at least one display element is moved. Alternatively, the at least one display element may be zoomed out and/or less information about the at least one display element may be displayed and/or moved away from the gaze direction of the user and/or into the background when the at least one display element is moved. This can be implemented in a menu structure, and also scrolling and scrolling between menu levels. By means of the main menu, for example, the navigation information can be displayed as a submenu at a selected position in the motor vehicle. It is also possible that unwanted displays, for example displays relating to a phone book, move during navigation into a background that does not disturb the user.

The invention further relates to a motor vehicle having a display device which has a plurality of display surfaces and has a control device for carrying out a method of the type described.

Drawings

Preferred embodiments of the invention are explained in detail below by way of example with reference to the accompanying drawings, in which:

fig. 1 shows a schematic view of a motor vehicle which forms an exemplary embodiment for carrying out the method according to the invention;

FIG. 2 shows a schematic diagram of the detection of contactless operating actions within the scope of an embodiment of the method according to the invention;

FIG. 3 shows a schematic diagram of the operational acts performed within the scope of an embodiment of a method in accordance with the invention; and

fig. 4 shows a further schematic diagram of the execution of the operational actions within the scope of an embodiment of the method according to the invention.

Detailed Description

A motor vehicle, generally designated 10, comprises a first camera 12, which is arranged in a dashboard 14, and a second camera 16, which is mounted at the transition between a windshield 18 and a roof 20 of the motor vehicle 10. The camera 16 can also be integrated into an interior rear view mirror of the motor vehicle 10.

Furthermore, the motor vehicle 10 comprises a plurality of display devices, not shown in fig. 1, which can be integrated, for example, in the dashboard 14, designed as a head-up display on the windshield 18 or can be mounted on the roof 22 or other interior trim of the motor vehicle 10.

In order to enable contactless control of the display device, the camera 16 is used to observe, for example, the position of the head 24 of a vehicle occupant 26 (in the example shown, the driver of the motor vehicle 10). The camera 16 here detects, for example, both the eyes 28 and the entire head 24 of a vehicle occupant 26. Monitoring of the position of the eye 28 may be accomplished by image recognition of the eye 28 as a whole. However, more elaborate analyses are also possible, in which the position of the pupil or iris of the eye 28 is observed. To determine the position and orientation of head 24, camera 16 may view a particularly easily identifiable portion of the head, such as nose 30 of vehicle occupant 26.

The additional camera 12 in the instrument panel 24 additionally records the position and movement of the hand 32 of the vehicle occupant 26.

The cameras 12, 16 are preferably depth imaging cameras, particularly preferably so-called time-of-flight cameras, which provide distance information about each pixel, so that the image recognition is particularly precise.

The combination of the detection of the head position, the eye position and the gestures of the vehicle occupant 26, as will be explained below with reference to fig. 2 to 4, enables a particularly precise contactless control of the display device of the motor vehicle 10.

Fig. 2 again summarizes how both gestures and body and head gestures or eye gestures of a vehicle occupant 26 are detected by means of the three cameras 12 and 16. It is particularly advantageous for the method to detect all the mentioned parameters here.

Fig. 3 shows how a display device 34 having a first display surface 36 and a second display surface 38 can be operated. On the first display surface 36, first display elements 40, for example icons, are arranged here. The second display surface 38 shows a second display element 42, which may likewise be an icon, be a menu item or the like.

If the vehicle occupant 26 is now to perform an operating action, the vehicle occupant first directs his line of sight to one of the two display surfaces 36, 38, which should be the target of his operating action, for example. Thus, for example, the vehicle occupant may look at the display surface 36 and detect the direction of sight from the eye position of the vehicle occupant using the first camera 16. At the same time, it is checked whether the body position of the vehicle occupant 26 corresponds to the direction of his line of sight in order to verify the identification of the selected display area 36. To this end, the second camera 16 detects the body orientation. If the vehicle occupant 26 now performs a gesture with his hand 32, which can be detected by the third camera 12, a lateral wiping movement between the display surfaces 36, 38 takes place in the example shown, so that the selected display element 40, which is selected and verified by body orientation, is moved from the selected display surface 36 onto the other display surface 38.

Fig. 4 shows further details about this. In this case, the entire content of the display surface 36 is moved in a corresponding manner onto the display surface 38, whereby a new, predefined display element 44 is shown on the now released display surface 36. It need not always be the case that the entire contents of the display surface 36 are moved onto the display surface 38. It is also possible to move only one display element 40, 42, 44 between the display surfaces 36, 38 in the described manner, or to perform other actions with respect to the selected display element 40, 42, 44. For example, a program associated with a single icon may be launched on a newly selected display surface 36, 38 by moving the icon onto the new display surface 36, 38, or similar other operational functions may be performed. It is also conceivable here to select menu items, to adjust slider adjusters (for example volume for entertainment systems), to select from lists (for example lists of telephone numbers for integrated telephones or the like).

For this purpose, other contactless inputs can also be detected and evaluated. It is conceivable, for example, to additionally recognize speech recognition or to recognize the brain activity of the user in the sense of a brain-computer interface.

The features of the invention disclosed in the above description, in the drawings and in the claims may be essential for the implementation of the invention in its various embodiments, both individually and in any combination.

List of reference numerals

Motor vehicle 10

Camera 12

Instrument panel 14

Camera 16

Windshield 18

Vehicle roof 20

Vehicle roof 22

Head 24

Vehicle occupant 26

Eye 28

Nose 30

Hand 32

Display device 34

Display surface 36

Display surface 38

Display element 40

Display element 42

Display element 44