阅读说明：本技术 头戴式显示装置 (Head-mounted display device ) 是由 野野村洋 神田直之 于 2017-08-24 设计创作，主要内容包括：本发明的通过使用者(3)的手势动作进行操作的头戴式显示装置(HMD)(1)包括：用于检测手势操作的距离图像获取单元(106)；获取HMD(1)的位置信息的位置信息获取单元(103)；和与其它HMD(1’)进行通信的通信单元(2)。控制部(205)设定使用者(3)的手势操作有效的操作空间(600)以进行显示,利用通信单元(2)在与其它的HMD(1)之间进行各自的位置信息和操作空间的信息交换,调整本机HMD的操作空间,使得操作空间(600、600’)彼此不重叠。或者,在由距离图像获取单元(106)检测到附近的人(4)时,调整操作空间,使得检测到的人的存在位置与操作空间(600)不重叠。(A head-mounted display device (HMD) (1) that is operated by a gesture motion of a user (3) is provided with: a distance image acquisition unit (106) for detecting a gesture operation; a position information acquisition unit (103) that acquires position information of the HMD (1); and a communication unit (2) that communicates with another HMD (1'). The control unit (205) sets and displays an operation space (600) in which the gesture operation of the user (3) is effective, and exchanges position information and information of the operation space with another HMD (1) by using the communication unit (2), thereby adjusting the operation space of the local HMD so that the operation spaces (600, 600') do not overlap each other. Alternatively, when a nearby person (4) is detected by the range image acquisition unit (106), the operation space is adjusted so that the detected presence position of the person does not overlap with the operation space (600).)

1. A head-mounted display device capable of displaying images of mixed reality and capable of being operated by a gesture motion of a user, comprising:

an image projecting unit for projecting an image;

a see-through lens for displaying the image projected from the image projection unit as a mixed reality object by overlapping the image with a surrounding space;

a distance image acquisition unit for acquiring a distance image to detect a gesture operation of a user;

a position information acquisition unit that acquires position information of the head mounted display device (hereinafter referred to as a local HMD);

a communication unit that communicates with an external terminal via a smartphone or a built-in wireless communication unit; and

a control unit for controlling the image projection operation by the image projection unit based on the gesture operation of the user detected by the distance image acquisition unit,

the control unit sets an operation space in which a gesture operation by a user is effective, displays the operation space as a mixed reality object, communicates with another head-mounted display device (hereinafter referred to as another HMD) by the communication unit, exchanges position information and information of the operation space between the local HMD and the other HMD, and adjusts the operation space of the local HMD so that the operation space of the local HMD and the operation space of the other HMD do not overlap.

2. The head-mounted display device of claim 1, wherein:

the control unit performs adjustment by moving any one of or a combination of the position, size, and shape of the operation space of the local HMD when the operation space of the local HMD overlaps with the operation space of the other HMD.

3. The head-mounted display apparatus of claim 2, wherein:

the control unit sets an operation object and displays the operation object as a mixed reality object so that a user can perform operations of selecting, starting display, and ending display of the image displayed by the image projection unit, and when an operation space of the native HMD is adjusted, the control unit moves or reduces the size of the operation object so that the operation object is positioned in the adjusted operation space.

4. A head-mounted display device capable of displaying images of mixed reality and capable of being operated by a gesture motion of a user, comprising:

an image projecting unit for projecting an image;

a see-through lens for displaying the image projected from the image projection unit as a mixed reality object by overlapping the image with a surrounding space;

a distance image acquisition unit for acquiring a distance image to detect a gesture operation of a user and a person or an object in the vicinity; and

a control unit for controlling the image projection operation by the image projection unit based on the gesture operation of the user detected by the distance image acquisition unit,

the control unit sets an operation space in which gesture operations by a user are effective, displays the operation space as a mixed reality object, and adjusts the operation space so that the presence position of a person or an object detected by the distance image acquisition unit does not overlap the operation space when the person or the object is present in the operation space.

5. The head-mounted display apparatus of claim 4, wherein:

the control unit performs adjustment by any one or a combination of movement of moving the position, reducing the size, and changing the shape of the operation space when the detected person or object is present in the operation space.

6. The head-mounted display apparatus of claim 5, wherein:

the control unit sets an operation object and displays the operation object as a mixed reality object so that a user can perform operations of selecting, starting display, and ending display of the image displayed by the image projection unit, and when the operation space is adjusted, moves or reduces the size of the operation object so that the operation object is positioned in the adjusted operation space.

Technical Field

The present invention relates to a head-mounted display device that displays a mixed reality image and can be operated by a gesture motion of a user.

Background

In recent years, head mounted display devices (hereinafter referred to as HMDs) have been developed which are configured to project a mixed reality image on a portion corresponding to a lens having high transparency by using shapes of glasses and goggles, and to superimpose and display the mixed reality object in a real space, thereby making it possible to make the mixed reality object appear as if the mixed reality object actually exists. Patent document 1 describes a system for displaying a shared virtual object and a human virtual object in a mixed reality environment.

In addition, there is a gesture user interface (gesture UI) that is operated by the movement of the hand of the user in order to perform operations such as content viewing start and content selection using the HMD. The gesture UI enables the HMD operation without holding the operation device with a hand, and is highly convenient. However, in the gesture UI, due to the movement of the body, in a situation where users who operate the HMD are close to each other, there is a concern that the users collide with each other in order to perform the gesture operation. In order to avoid such a collision, patent document 2 describes that the HMD includes a device information notification unit (marker) for specifying the position of the device, and the device is photographed by a camera to detect the distance and direction of the marker, and the operation space of the HMD is adjusted so that the gesture operation spaces of the HMDs do not overlap.

Disclosure of Invention

Technical problem to be solved by the invention

In patent document 1, no consideration is given to avoiding a collision with another person due to a gesture operation. In patent document 2, avoidance of collision with a person who does not use an HMD is not considered. When the method described in patent document 2 is adopted, if the HMD of another user is directed in the opposite direction or a blocking object is present in the middle, the mark provided on the HMD may not be detected by the camera. In this case, the distance and direction of the HMD of another user cannot be known, and there is a possibility of collision. Further, since the adjustment of the gesture operation space is performed only in the present apparatus, the adjustment to the operation space for the user may be too narrow to separate the operation spaces from each other, and the usability may be deteriorated.

An object of the present invention is to provide an HMD that can avoid a physical collision due to a gesture operation not only between users who use the HMD but also between the users who do not use the HMD, and that has an operation space that is convenient for the user to use.

Means for solving the problems

The head-mounted display device of the present invention includes: an image projecting unit for projecting an image; a see-through lens for displaying the image projected from the image projection unit as a mixed reality object by overlapping the image with a surrounding space; a distance image acquisition unit for acquiring a distance image to detect a gesture operation of a user; a position information acquisition unit that acquires position information of a head mounted display device (native HMD); a communication unit that communicates with an external terminal; and a control unit that controls the image projection operation by the image projection unit based on the gesture operation of the user detected by the distance image acquisition unit. The control unit sets an operation space in which a gesture operation by a user is effective, displays the operation space as a mixed reality object, communicates with another head-mounted display device (another-unit HMD) by using a communication means, exchanges position information and operation space information of the local HMD and the other-unit HMD, and adjusts the operation space of the local HMD so that the operation space of the local HMD and the operation space of the other-unit HMD do not overlap.

Further, the head mounted display device of the present invention includes: an image projecting unit for projecting an image; a see-through lens for displaying the image projected from the image projection unit as a mixed reality object by overlapping the image with a surrounding space; a distance image acquisition unit for acquiring a distance image to detect a gesture operation of a user and a person or an object in the vicinity; and a control unit that controls an image projection operation by the image projection unit based on a gesture operation of the user detected by the distance image acquisition unit. The control unit sets an operation space in which gesture operations by a user are effective, displays the operation space as a mixed reality object, and adjusts the operation space so that the presence position of a detected person or object does not overlap the operation space when the person or object detected by the distance image acquisition unit is present in the operation space.

Effects of the invention

According to the present invention, it is possible to provide an HMD having an operation space that is convenient for a user to use, by avoiding not only collision between users using the HMD but also body collision between the user using the HMD and a person not using the HMD due to a gesture operation.

Drawings

Fig. 1 is a diagram showing an external appearance structure of an HMD (example 1).

Fig. 2 is a diagram showing a system configuration of the HMD.

Fig. 3 is a diagram illustrating a position information acquisition function of the HMD.

Fig. 4 is a diagram showing a state in which a mixed reality object is displayed by the HMD.

Fig. 5 is a diagram illustrating various operation methods of the HMD performed by the user.

Fig. 6 is a diagram showing an example of an operation object displayed to an HMD user.

Fig. 7 is a diagram showing a state in which a user performs a gesture operation to view content.

Fig. 8 is a diagram showing a state in which 2 HMD users use the HMD in parallel.

Fig. 9 is a diagram showing a case where the gesture operation space is moved to avoid collision.

Fig. 10 is a diagram showing a case where the gesture operation space is reduced to avoid collision.

Fig. 11 is a diagram showing a case where the gesture operation is switched to the operation of the smartphone.

Fig. 12 is a flowchart showing a method of adjusting an operation space when a 2-position HMD user approaches.

Fig. 13 is a diagram showing a state in which a 1-bit HMD user uses an HMD (embodiment 2).

Fig. 14 is a diagram showing a case where the gesture operation space is reduced to avoid collision.

Fig. 15 is a diagram showing a case where a part of an object is not displayed in order to avoid a collision.

Fig. 16 is a flowchart of a case where the display position of the object is changed by reducing the operation space.

Detailed Description

Hereinafter, embodiments of the present invention will be described with reference to the drawings.