阅读说明：本技术 用于增强现实的光场显示系统和增强现实装置 (Light field display system for augmented reality and augmented reality device ) 是由 陈鼎国 于 2019-09-12 设计创作，主要内容包括：本发明公开了一种光场显示系统和增强现实装置,其中,光场显示系统用于增强现实,包括依次设置的第一图像信息提供装置、第一透镜组、光转向组件、第二透镜组和第二图像信息提供装置,其中,第一图像信息提供装置,用于提供具有第一图像内容的光；第一透镜组,用于接收所述具有第一图像内容的光,并在第一焦平面上形成第一图像；第二图像信息提供装置,用于提供具有第二图像内容的光；第二透镜组,用于接收所述具有第二图像内容的光,并在第二焦平面上形成第二图像；光转向组件,用于将所述第一图像和所述第二图像传送至视窗区域。该系统通过透镜的光学操作可以产生多个焦平面与现实环境相融合,从而实现了增强现实的光场显示。(The invention discloses a light field display system and an augmented reality device, wherein the light field display system is used for augmented reality and comprises a first image information providing device, a first lens group, a light steering component, a second lens group and a second image information providing device which are sequentially arranged, wherein the first image information providing device is used for providing light with first image content; a first lens group for receiving the light having the first image content and forming a first image on a first focal plane; second image information providing means for providing light having second image content; a second lens group for receiving the light having the second image content and forming a second image on a second focal plane; a light turning assembly to transmit the first image and the second image to a viewport region. The system can generate a plurality of focal planes through the optical operation of the lens to be fused with the real environment, thereby realizing the light field display of the augmented reality.)

1. A light field display system for augmented reality, the optical system comprising a first image information providing device, a first lens group, a light turning component, a second lens group and a second image information providing device arranged in sequence,

the first image information providing means for providing light having a first image content;

the first lens group is used for receiving the light with the first image content and forming a first image on a first focal plane;

the second image information providing means for providing light having a second image content;

the second lens group is used for receiving the light with the second image content and forming a second image on a second focal plane;

the light redirecting assembly is configured to transmit the first image and the second image to a viewport region.

2. The light field display system according to claim 1,

the first image information providing apparatus comprises a first microdisplay;

the first lens group comprises one lens or a plurality of lens combinations;

the second image information providing apparatus comprises a second microdisplay;

the second lens group includes one lens or a combination of a plurality of lenses.

3. A light field display system as claimed in claim 2, wherein the light turning assembly comprises a beam splitter and a concave half mirror, wherein,

the light splitter is arranged at a preset angle with an incident light path and used for providing the light of the first image to the concave semi-reflecting mirror;

the concave surface of the concave semi-reflecting mirror faces the light splitter and is used for reflecting a part of incident light of the first image to the window area.

4. A light field display system as claimed in claim 3, characterized in that the light field display system further comprises:

and the light filter is arranged between the first lens group and the light splitter and used for filtering stray light in the light with the first image content.

5. A light field display system for augmented reality is characterized in that the optical system comprises a third image information providing device, a first lens group, a light steering component, a second lens group and an image information time sequence division and division providing device which are arranged in sequence,

the third image information providing means for providing light having image content;

the first lens group and the second lens group are used for receiving the light with the image content and performing optical operation so as to project the light with the image content to the image information time sequence division and labor division providing device

The image information time sequence division and division providing device is used for changing the focal length according to the adjusting signal so as to form a plurality of imaging focal planes;

the image information time sequence division and labor division providing device is also used for reflecting the light with the image content and imaging on a plurality of imaging focal planes through the second lens group respectively so as to provide a plurality of images;

the light turning component is used for transmitting a plurality of images to a window area.

6. A light field display system as claimed in claim 5,

the third image information providing apparatus comprises a third microdisplay;

the first lens group comprises one lens or a plurality of lens combinations;

the image information time sequence division and division providing device comprises a deformable mirror;

the second lens group includes one lens or a combination of a plurality of lenses.

7. The light field display system of claim 5, wherein the light turning assembly comprises:

the polarization beam splitter is arranged at a preset angle with the incident light path;

a polarizer disposed between the first lens group and the polarization beam splitter;

a first 1/4 wave plate disposed between the polarizing beam splitter and the second lens group.

8. A light field display system as claimed in claim 7, further comprising:

a second 1/4 wave plate disposed between the first lens group and the polarizer.

9. A light field display system as claimed in any one of claims 1 to 7 wherein the difference in diopters between the two focal planes is greater than 0.5D.

10. An augmented reality apparatus, comprising:

the light field display system of any one of claims 1-9;

and the controller is used for acquiring image information on different focal planes output by the light field display system so as to perform graphic superposition processing.

Technical Field

The invention relates to the technical field of display, in particular to a light field display system for augmented reality and an augmented reality device.

Background

In the related art, an image enlarged by an augmented reality display device is generated by a combination of a micro display and a lens. The related art discloses a technique of generating a single image by placing a beam splitter and a curved mirror, and further discloses a technique of forming a plurality of images by adding an additional transmission-type variable focus element having a multiplexing function. I.e. creating a perception of variable depth by using multiple planar focusing systems or a flattenable planar focusing system, however, the variable focus element must provide multiple planar images accordingly within one frame time, and image dragging may occur if the response speed of the variable focus element is slow. In order to realize a virtual device combined with a real environment, factors such as optical distance, image magnification and field of view must be considered, and thus an optical system for augmented reality needs to be optimized.

Disclosure of Invention

The present invention is directed to at least one of the problems of the prior art, i.e., the conventional display only presents a two-dimensional single image to the human eye, which is contrary to the visual imaging of the natural scene that the human is looking at ordinarily, and therefore, the human eye is prone to fatigue and discomfort.

Embodiments of the first aspect of the present invention provide a light field display system, which may generate display images of multiple focal planes, thereby implementing light field display for obtaining augmented reality.

The embodiment of the second aspect of the invention provides another design of a light field display system for augmented reality.

The embodiment of the third aspect of the invention provides an augmented reality device.

To solve the above problem, a light field display system according to an embodiment of a first aspect of the present invention is an augmented reality system, including a first image information providing device, a first lens group, a light turning component, a second lens group, and a second image information providing device, which are sequentially arranged, wherein the first image information providing device is configured to provide light with a first image content; the first lens group is used for receiving the light with the first image content and forming a first image on a first focal plane; the second image information providing means for providing light having a second image content; the second lens group is used for receiving the light with the second image content and forming a second image on a second focal plane; the light redirecting assembly is configured to transmit the first image and the second image to a viewport region.

According to the light field display system provided by the embodiment of the invention, the second image information providing device and the second lens group are added, the second image information providing device provides light with second image content, the second lens group performs optical operation to generate a second image on the second focal plane, and then the image on the first focal plane is combined to realize imaging of a plurality of focal planes, namely richer virtual world information is provided, and a basis is provided for realizing augmented reality.

In some embodiments, the first image information providing device comprises a first microdisplay; the first lens group comprises one lens or a plurality of lens combinations; the second image information providing apparatus comprises a second microdisplay; the second lens group includes one lens or a combination of a plurality of lenses.

In some embodiments, the light turning assembly comprises a beam splitter and a concave half mirror, wherein the beam splitter is disposed at a predetermined angle to an incident light path for providing light of the first image to the concave half mirror; the concave surface of the concave semi-reflecting mirror faces the light splitter and is used for reflecting a part of incident light of the first image to the window area.

In some embodiments, the light field display system further comprises: and the light filter is arranged between the first lens group and the light splitter and used for filtering stray light in the light with the first image content.

In some embodiments, the second aspect of the present invention further provides a light field display system for augmented reality, the optical system includes a third image information providing device, a first lens group, a light turning component, a second lens group and an image information time-sequence division and division providing device, which are sequentially arranged, wherein the third image information providing device is used for providing light with image content; the first lens group and the second lens group are used for receiving the light with the image content and performing optical operation so as to project the light with the image content to the image information time sequence division and labor providing device; the image information time sequence division and division providing device is used for changing the focal length according to the adjusting signal so as to form a plurality of imaging focal planes; the image information time sequence division and labor providing device is also used for reflecting the light with the image content and imaging on a plurality of imaging focal planes through the second lens group respectively so as to provide a plurality of images, and the generation of the plurality of images is generated in a time sequence division and labor manner; the light turning component is used for transmitting a plurality of images to a window area.

According to the light field display system provided by the embodiment of the invention, the generation of a plurality of images on a plurality of focal planes is realized through the third image information providing device, the first lens group, the light steering assembly, the second lens group and the image information time sequence division work providing device based on the time sequence division work principle and the image information time sequence division work providing device with the light reflection function, and a basis is provided for realizing augmented reality.

The third image information providing apparatus comprises a third microdisplay; the first lens group comprises one lens or a plurality of lens combinations; the image information time sequence division and division providing device comprises a deformable mirror; the second lens group includes one lens or a combination of a plurality of lenses.

In some embodiments, the light redirecting assembly comprises: the polarization beam splitter is arranged at a preset angle with the incident light path; a polarizer disposed between the first lens group and the polarization beam splitter; a first 1/4 wave plate disposed between the polarizing beam splitter and the second lens group.

In some embodiments, the light field display system further comprises: a second 1/4 wave plate disposed between the first lens group and the polarizer.

In some embodiments, the diopter difference between the two focal planes is greater than 0.5 diopters.

In some embodiments, the first microdisplay comprises one of a micro-OLED, a micro-LED, an LCOS, a DMD, and a MEMS; the second micro display comprises one of a micro OLED and a micro LED; the third microdisplay includes one of a micro-OLED, a micro-LED, LCOS, DMD and MEMS.

In order to solve the above problem, an augmented reality apparatus according to an embodiment of the third aspect of the present invention includes the above light field display system and a controller, where the controller is configured to acquire image information on different focal planes output by the light field display system to perform a graphics overlay process.

According to the augmented reality device provided by the embodiment of the invention, the light field display system of the embodiment is adopted to generate a plurality of images of different focal planes, and the images on the different focal planes are subjected to fusion processing through the controller, so that the supplement of more abundant virtual and real information can be realized, the immersion is improved, the augmented reality effect is realized, and the visual experience and the comfort of a user are greatly improved.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, wherein elements having the same reference numerals are shown as similar elements and wherein:

FIG. 1 is a schematic view of the imaging principle of a light field display system according to one embodiment of the present invention;

FIG. 2 is a schematic view of the imaging principle of a light field display system according to another embodiment of the present invention;

fig. 3 is a block diagram of an augmented reality apparatus according to one embodiment of the present invention.

Reference numerals:

augmented reality device 100

A light field display system 110, a controller 120;

a first image information providing device 10, a first lens group 20, a light turning component 30, a second lens group 40, a second image information providing device 50, ambient incident light 60;

the device comprises a first microdisplay 1, a first lens combination 2, a filter 3, a beam splitter 4, a concave half-reflecting mirror 5, a window area 6, a second microdisplay 7, a second lens combination 8, a third image information providing device 9, a first 1/4 wave plate 13, a polarizer 11, a polarization beam splitter 12, a second 1/4 wave plate 15 and an image information time sequence division multiplexing providing device 14.

Detailed Description

So that the manner in which the features and aspects of the embodiments of the present invention can be understood in detail, a more particular description of the embodiments of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.

A light field display system according to an embodiment of the present invention, which can generate display images of a plurality of focal planes, thereby realizing light field display for obtaining augmented reality, is described below with reference to the drawings.

FIG. 1 is a schematic diagram of the imaging principles of a light field display system according to one embodiment of the present invention.

The light field display system 110 of the embodiment of the invention comprises a first image information providing device 10, a first lens group 20, a light turning component 30, a second lens group 40 and a second image information providing device 50 which are arranged in sequence, wherein the first image information providing device 10 is used for providing light with first image content; a first lens group 20 for receiving light having a first image content and forming a first image on a first focal plane; a second image information providing means 50 for providing light having a second image content; a second lens group 40 for receiving light having a second image content and forming a second image on a second focal plane; a light diverting assembly 30 for conveying the first and second images to the viewing window area 6.

Specifically, the first image information providing device 10 and the second image information providing device 50 each provide light having virtual image information, and perform optical operation through a lens group, for example, focus on a focal plane of an image, so that virtual images on two focal planes can be formed, that is, information of a virtual world is provided, and thus, information of a virtual world can be fused with actual environment information, and complementation of virtual and real information is realized, thereby realizing augmented reality. In the embodiment, the second image information providing device 50 may be a device that directly provides the included image information itself, or may be a device that indirectly obtains the included image information and forms an image on the second focal plane, and may form multi-focal-plane imaging.

According to the light field display system 110 of the embodiment of the present invention, by adding the second image information providing device 50 and the second lens group 40, the second image information providing device 50 provides light with second image content, and the optical operation performed by the second lens group 40 can generate a second image on the second focal plane, so as to combine with the image on the first focal plane, realize imaging of multiple focal planes, realize display of virtual information, provide richer virtual information, and provide a basis for realization of augmented reality.

In an embodiment, as shown in fig. 1, the first image information providing device 10 comprises a first microdisplay 1, the first lens group 20 comprises a lens or a plurality of lens combinations 2, and the light turning component 30 comprises a beam splitter 4 and a concave half mirror 5.

Wherein the beam splitter 4 is arranged at a predetermined angle, for example 45 °, to the first image light incident light path for providing light of the first image with image content provided by the first microdisplay 1 to the concave half mirror 5, the concave surface of the concave half mirror 5 facing the beam splitter 4 for reflecting a part of the incident light of the first image to the viewing window area 6 and filtering another part.

Specifically, as shown in fig. 1, the first Micro display 1 may be a self-luminous display, for example, the first Micro display 1 may include, but is not limited to, one of a Micro OLED (Organic Light Emitting Diode), a Micro LED (Light Emitting Diode), an LCOS (Liquid Crystal On silicon), a DMD (Digital Micro mirror Device, Digital Micro mirror) and a MEMS (Micro-Electro-Mechanical Systems display). The first microdisplay 1 provides a virtual image, i.e. a first image, and transmits light containing the virtual image content to the first lens group 20. The light of the first image can be imaged on the first focal plane by the first lens group 20, and the first image is provided to the window area 6 by the beam splitter 4 and the concave half mirror 5, where a wide view image can be presented to the user.

As shown in fig. 1, the light field display system further includes a filter 3, and the filter 3 is disposed between the first lens group 20 and the beam splitter 4, and is configured to filter stray light in the light with the first image content, so as to make the imaging effect clearer.

Further, as shown in fig. 1, on the other side of the beam splitter 4, the second lens group 40 may include all or part of the first lens group 20, for example, one lens or a plurality of lens assemblies 8, and additional lenses may be added as long as image light can be transmitted to the user's eye, i.e. the window area 6, and the second image information providing device 50 includes a second micro display 7, similar to the imaging principle, the second micro display 7 provides light with second image content, a second image can be formed on a second focal plane through the second lens group 40, and the second image is provided to the window area 6 through the beam splitter 4 for the human eye to watch. In an embodiment, the second micro-display 7 may comprise, but is not limited to, one of a micro OLED, a micro LED. Further, in order to make the images on the two focal planes coincide with each other, the pattern coincidence processing may be performed using an image processing algorithm.

By adopting the above combination of the first image information providing device 10, the first lens group 20, the light diverting assembly 30, the second lens group 40 and the second image information providing device 50, an augmented reality optical display can be realized in which the diopter difference of the two focal planes is greater than 0.5D to facilitate the distinction of image information on different focal planes. Meanwhile, the incident light 60 of the real environment passes through the concave half mirror 5 and the beam splitter 4, and provides the real information to the window region 6 to be fused with the information of the first image and the second image, thereby realizing augmented reality display.

In other embodiments, as shown in fig. 2, the light field display system 110 according to the embodiment of the present invention includes a third image information providing device 9, a first lens group 20, a light turning component 30, a second lens group 40, and an image information time-series division multiplexing providing device 14, which are sequentially arranged, wherein the third image information providing device 9 is used for providing light with image content; the first lens group 20 is for receiving light having image content and performing an optical operation; the image information time-series division multiplexing providing device 14 is used for reflecting the light with the image content to provide the light with a plurality of image contents; the second lens group 40 is for optically operating light having a plurality of image contents to generate a plurality of images on different focal planes; the light redirecting assembly 30 is used to transmit a plurality of images to the viewing window area.

According to the light field display system of the embodiment of the invention, the third image information providing device 9, the first lens group 20, the light steering component 30, the second lens group 40 and the image information time-sequence division and labor providing device 14 are used for generating a plurality of images on a plurality of focal planes based on the time division and labor principle and the image information time-sequence division and labor providing device 14 with the light reflection function, so that a basis is provided for realizing augmented reality.

Specifically, as shown in fig. 2, the third image information providing device 9 may comprise a third micro-display, for example, the third micro-display 9 includes but is not limited to one of a micro-OLED, a micro-LED, an LCOS, a DMD, and a MEMS; the image information time-series division multiplexing providing device 14 may include a deformable mirror 14 such as a deformable thin film mirror device (DMMD), the deformable mirror 14 being configured to reflect light having image content at different mirror positions to provide light having image content with a plurality of focal planes; the light turning assembly 30 may include a polarization beam splitter 12, a polarizer 11, and a first 1/4 wave plate 13, wherein the polarization beam splitter 12 is disposed at a predetermined angle, for example, 45 ° to the incident light path, the polarizer 11 is disposed between the first lens group 20 and the polarization beam splitter 12 for eliminating harmful reflected light, improving the definition and expression of images, and increasing color saturation, and the first 1/4 wave plate 13 is disposed between the polarization beam splitter 12 and the second lens group 40.

Specifically, the light with image content supplied from the third microdisplay 9 is optically operated by the first lens group 20 to project the light with image content supplied from the third microdisplay 9 onto the deformable mirror 14. The polarizer 11 is disposed between the third microdisplay 9 and the polarization beam splitter 12, polarizes the incident light P, and then reaches the deformable mirror 14 through the polarization beam splitter 12, the first 1/4 wave plate 13 and the second lens group 40, wherein, due to the high reflectivity of the deformable mirror 14, the incident light can be reflected via the original incident path after reaching the deformable mirror 14, and after passing through the second lens group 40 and the first 1/4 wave plate 13, the light comes out of the first 1/4 wave plate 13 and becomes S-polarized light, and is deflected by 90 degrees by the polarization beam splitter 12 to reach the viewing window area 6, such as an eyepiece, for being viewed by human eyes. The position of the image imaged to the human eye is determined by the first lens group 20, the second lens group 40, the deformable mirror 14 and the ocular lens 6.

In the embodiment shown in fig. 2, multiple images are produced at different focal planes using the time division principle in combination with a deformable mirror 14 having a high reflectivity. Wherein the second lens group 40 and its surface shape may change from a plane to a concave parabola when a voltage is applied. A change in optical power on the deformable mirror 14 rapidly changes the axial position of the intermediate image of the second lens group 40 and in turn creates a stack of addressable virtual focal planes in the viewing space, which have different distances to the observer, the depth volume of the imaged scene and the separation of the focal planes present on the observer can be controlled by adjusting the voltage on the deformable mirror 14. By synchronizing the voltages applied to the variable mirror 14, multiple focal planes are time-multiplexed for content presented on the third microdisplay 9 and different virtual content can be generated at their correct depth, enabling imaging at different focal planes.

If, for example, the image speed is of a suitable value, e.g. both are driven at 120Hz, the image of the first sub-frame provided by the third microdisplay 9, projected onto the deformable mirror 14 through the first lens group 20 and the second lens group 40, while adjusting the focal length of the deformable mirror 14 to change the focal plane of the reflective imaging, the deformable mirror 14 reflects the image light, the image is projected by the second lens group 40 onto the first imaging focal plane, and, similarly, the image of the second sub-frame provided by the third display 9, projected onto the deformable mirror 14 through the first lens group 20 and the second lens group 40, while adjusting the focal length of deformable mirror 14 to change the focal plane of the reflected image, deformable mirror 14 reflects the image light, projects the image through second lens group 40 onto the second imaging focal plane, the image content of the first subframe and the image content of the second subframe are the same image content. The total time for refreshing each sub-frame of the third microdisplay 9 and projecting by the deformable mirror 14 is 8.3 ms, which is equivalent to half the time for displaying the image of the first focal plane and the other half the time for displaying the image of the second focal plane, i.e. based on time division, the imaging on different focal planes is realized.

Wherein more focal planes may be generated when the frame rate is higher, e.g. if the image rate is increased to e.g. 180Hz or 240Hz, etc., too many focal planes may be formed. Where the diopter difference between any two focal planes should be greater than 0.5D, the magnification is determined by all of the lenses and the deformable mirror 14. Similarly, the incident light 60 in the real environment is finally imaged to the window region 6, for example, an eyepiece, through the optical operation of the polarization beam splitter 12, and is fused with the virtual image information on different focal planes, so as to realize the light field display of the augmented reality. Based on the light field design of this embodiment, the lightweight of augmented reality devices such as head mounted displays, glasses can be improved.

In an embodiment, as shown in FIG. 2, the light field display system 110 further includes a second 1/4 wave plate 15, the second 1/4 wave plate 15 being disposed between the first lens group 20 and the polarizer 11 to ensure that the microdisplay does not reflect stray light.

An augmented reality apparatus according to a third aspect of the present invention is described below with reference to the drawings.

Fig. 3 is a block diagram of an augmented reality apparatus according to an embodiment of the present invention.

As shown in fig. 3, the augmented reality device 100 according to the embodiment of the present invention includes a light field display system 110 and a controller 120, wherein the controller 120 is configured to acquire image information on different focal planes output by the light field display system 110 for performing a graphic superposition process.

According to the augmented reality device 100 of the embodiment of the present invention, the light field display system 110 generates a plurality of different focal planes to realize the augmented reality light field display, and the controller 120 can perform fusion processing on images on different focal planes by using an image processing rendering algorithm, so that the image imaging effect is clearer and more real.

In an embodiment, the augmented reality device 100 may be applied to the augmented reality industry, such as a Head Mounted Display (HMD), glasses, a mobile phone, and the like.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example.

While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.