阅读说明：本技术 可转向中央凹显示器 (Central fovea display can be turned to ) 是由 A·M·伊什 A·J·格罗斯 E·C·N·唐 S·D·德瓦尔德 J·R·*** K·W·金 于 2018-03-27 设计创作，主要内容包括：一种显示系统位于至少20度的可扫描视场内,所述显示系统包括中央凹显示器,所述中央凹显示器具有至少1度的单目视场,所述中央凹显示器是针对用户而定位。在一个实施例中,所述中央凹显示器是针对所述用户的中央凹而定位。(A kind of display system be located at least 20 degree can be in scanning field of view, the display system includes central fovea display, and the central fovea display has at least 1 degree of monocular visual field, and the central fovea display is to be directed to user and position.In one embodiment, the central fovea display is to be directed to the central fovea of the user and position.)

1. a kind of mixed display system, comprising:

Field display, the field display have at least 40 degree of monocular visual field；

Central fovea display, the central fovea display have at least 1 degree of monocular visual field, sweeps positioned at least 20 degree of leap Retouch in visual field, the central fovea display be for the field display the visual field in user and position, to present Mixed display comprising the image data from each of the field display and the central fovea display.

2. mixed display system according to claim 1, further include:

Wherein the central fovea display is implemented in wearable display central fovea display.

3. mixed display system according to claim 1 further includes central fovea location verification device, for verifying in described The physical location of recessed display is entreated, and adjusts central fovea display image data when the physical location is not desired location.

4. mixed display system according to claim 1, further include:

The central fovea display is positioned based on the prediction to the following eye position.

5. mixed display system according to claim 3, further include:

Eye tracker, the eye tracker are used to track position and the orientation of eyes of user；And

Classifies eye movement device, eye motion type, classifies eye movement are used to mention the classifies eye movement device for identification For the prediction for predictably positioning the central fovea display.

6. hybrid system according to claim 1, further include:

Logic is cut off, the cutting logic is used to come from the field display in the position cutting for corresponding to central fovea display image Field show image a part.

7. mixed display system according to claim 6, further include:

Logic is concocted, the blending logic is used to concoct the side that the central fovea shows image and the field shows image intersection Edge.

8. mixed display system according to claim 7, wherein the blending includes one of following or a variety of: Alpha mask, shake blending, staggered pixels, based on color the channel alpha blending, the channel alpha pixel-based concoct, Multiple sampling antialiasing (MSAA) and time-domain filtering blending.

9. mixed display system according to claim 1, wherein the field display is external display, and described mixed Close display system further include:

Synchronous logic, the synchronous logic is for keeping the central fovea display synchronous with the display between the field display.

10. mixed display system according to claim 1, further include:

For the setting element of the central fovea display, the setting element can turn to central fovea display for enabling It is mobile.

11. mixed display system according to claim 10, wherein can setting element include one of following or a variety of: Adjustable reflecting mirror, tunable prism, acousto-optic modulator, adjustable display panel, curved reflector, diffraction element, Yi Jifei Alunite ear reflex device.

12. a kind of display system, comprising:

Central fovea display, the central fovea display have at least 1 degree of monocular visual field, scans view positioned at least 20 degree In, the central fovea display is positioned for user.

13. display system according to claim 12, further include:

Field display, at least 30 degree of the monocular visual field that there is the field display display field to show image, the field display figure As showing that image is Chong Die with central fovea；

So that the combination of the central fovea display and the field display provides the high-resolution of big visual field and perception.

14. display system according to claim 13, further include:

Logic is cut off, the cutting logic is used to show image in the position cutting field for corresponding to the position of central fovea display image A part.

15. display system according to claim 14, further includes blending logic, the blending logic is described for concocting Central fovea shows that image and the field show the edge of image intersection.

16. display system according to claim 15, wherein the blending includes one of following or a variety of: alpha Mask, shake blending, staggered pixels, the channel the alpha blending based on color, the channel alpha pixel-based are concocted, multiple are adopted Sample antialiasing (MSAA) and time-domain filtering blending.

17. display system according to claim 12, further include:

Synchronous logic, the synchronous logic are used to make the central fovea display and provide between the external display that field is shown Display synchronizes.

18. display system according to claim 12, further include:

Eye tracker, the eye tracker are used to track position and the orientation of eyes of user；And

Classifies eye movement device, eye motion type, classifies eye movement are used for pre- the classifies eye movement device for identification Position the central fovea display to the property surveyed.

19. display system according to claim 12 further includes the setting element for the central fovea display, institute Central fovea display can be turned to and move for enabling by stating setting element.

20. display system according to claim 19, wherein the setting element includes one of following or a variety of: can Adjust reflecting mirror, tunable prism, acousto-optic modulator, adjustable display panel, curved reflector, diffraction element, and luxuriant and rich with fragrance alunite Ear reflex device.

Background technique

Near-eye display has the competition requirement for showing image with high-resolution in big visual field (FOV) range.For void Many applications in augmented reality are fitted, visual field should be greater than 90 degree, and it is desirable that binocular visual field would extend over 180 degree.Together When, the resolution ratio of display should with the resolution match of human visual system so that hardly being perceived in virtual image Pixelation.The two requirements are combined in individual system can bring many challenges.In order to avoid there is pixelation, resolution ratio needs For the degree of every pixel about 0.01 to 0.02.In 90 degree of rectangular field ranges, this is equivalent to each eye 4.5k × 4.5k pixel Or it is higher.In panel, drive electronics and the level for rendering pipeline, realize that such resolution ratio can be challenging.

Furthermore it is possible to project the optical system of width FOV image to user with sufficiently high resolution ratio in entire field range System is also difficult to design.Can within the scope of wide visual field to user present high-definition picture, simultaneously reduce rendering, data rate and The system architecture that panel requires will realize new application for enhancing and virtual reality system.

Detailed description of the invention

By way of example, and not limitation the invention is shown in the accompanying drawings, wherein identical appended drawing reference indicates similar Element, and wherein:

Figure 1A shows eyes, and which show central foveas.

Figure 1B shows the visual range of eyes.

Fig. 1 C shows the relationship between distance and visual acuity away from central fovea center.

Fig. 1 D shows exemplary vertical visual field.

Fig. 1 E shows exemplary horizontal visual field.

Fig. 1 F is shown with the first exemplary eyes for staring vector.

Fig. 1 G shows the first exemplary position for turning to central fovea display for staring vector shown for Fig. 1 F.

Fig. 1 H is shown with the second exemplary eyes for staring vector.

Fig. 1 I shows the second exemplary position for turning to central fovea display for staring vector shown for Fig. 1 H.

Fig. 1 J shows one embodiment of binocular display, and which show the central fovea display for being directed to each eye and fields Display.

Fig. 1 K shows one embodiment of binocular display, which show be directed to each eye central fovea display, with And shared field display.

Fig. 2 is the block diagram of one embodiment of system.

Fig. 3 is one embodiment of the movement in movable central recessed display middle high-resolution region over time Diagram.

Fig. 4 A and 4B are the flow charts using one embodiment of display.

Fig. 5 A is the diagram of one embodiment of combining display.

Fig. 5 B is the diagram using one embodiment of the display for amplification of roll-offing.

Fig. 6 is the diagram of one embodiment of combining display.

Fig. 7 is the diagram of one embodiment of combining display.

Fig. 8 is the diagram of one embodiment of combining display.

Fig. 9 is the diagram of one embodiment of combining display.

Figure 10 is the diagram of one embodiment of combining display.

Figure 11 is the diagram of one embodiment of combining display.

Figure 12 is the diagram using one embodiment of time-multiplexed combining display.

Figure 13 A and 13B are the diagrams using one embodiment of time-multiplexed combining display.

Figure 14 A and 14B are the figures using one embodiment of the central fovea display for the waveguide that can be used for above system Show.

Figure 15 A and 15B are the diagrams using one embodiment of the field display for the waveguide that can be used for above system.

Figure 16 A is the diagram of another embodiment of mixed display system.

Figure 16 B is the diagram of another embodiment of mixed display system.

Figure 17 is the flow chart using one embodiment of the central fovea display with external display.

Figure 18 is one embodiment that central fovea display is used in the case where no associated larger display Flow chart.

Figure 19 is the flow chart for concocting the one embodiment at edge of central fovea display.

Figure 20 is the flow chart using one embodiment of classifies eye movement.

Figure 21 is the table of the eye motion of exemplary types.

Figure 22 is the flow chart of one embodiment of intelligent positioning.

Figure 23 is the block diagram of the one embodiment for the computer system that can be used in conjunction with the invention.

Specific embodiment

This application discloses one kind can turn to central fovea display, referred to as central fovea display.In one embodiment, Central fovea display is oriented to provide high-resolution areas locating for the central fovea of user." central fovea " is the retina of eyes In dolly dimple, in the dolly dimple, visual acuity highest.Figure 1A shows eyes, and which show retinas and central fovea. Field of view center focuses in this area, and retinal cones are particularly concentrated on this area.Central fovea center is differentiating with highest for retina The area of rate, but with about 2 degree of visual field.It is shown in Figure 1B from the central recessed area of highest resolution to the remote of lowest resolution The visual acuity area of external zones.Compared to far from 20 degree of central fovea center, the resolution ratio of eyes reduces an almost quantity Grade.Fig. 1 C shows the decline of the acuity based on the distance (eccentricity) away from central fovea center (Snellen fraction (Snellen fraction))。

In one embodiment, system can turn to central fovea display and utilize this point by providing, described to turn to Central fovea display is directed into be aligned with the field of view center of eyes of user or another calculating position.In one embodiment, The field that field display provides low resolution within the scope of larger field shows image.This means that user is in its peripheral vision And the perceptual image in its gaze-direction.In one embodiment, system using central fovea display provide mainly towards with The high-definition picture of the field of view center guidance of family eyes, and provide field in big field range using the second field display and show Diagram picture.This means that user's perceptual image in its peripheral vision and in its gaze-direction.In one embodiment, it is High-definition picture is presented using high pixel density display for each eye within the scope of small field of view for system, and is regarding greatly Lower resolution image is presented in the range of field to fill binocular area and external zones.In one embodiment, central fovea display Resolution ratio is between every 0.2 arc of pixel point and 3 arc of every pixel point between.In one embodiment, the resolution ratio of field display between Between every 1 arc of pixel point and 20 arc of every pixel point.In one embodiment, field display and central fovea display can combine In single variable pixel display.In one embodiment, system for each eye using variable pixel density display with High-definition picture is presented to the central recessed area of each eye within the scope of small field of view, and in big field range present compared with Low-resolution image is to fill binocular area and external zones.In one embodiment, variable pixel density display can be with can The standard indicator of variable density addressing.

Such system produces the perception of the high-definition picture with wide visual field, while needing only to have same high sense Know the pixel quantity of traditional near-eye display of resolution ratio or the sub-fraction for the treatment of capacity.In one embodiment, such system Also the power consumption of rendering system is reduced significantly by reducing rendered pixel quantity.

In one embodiment, the system may include more than two displays.In one embodiment, may exist The resolution ratio of three ranks covers the foveal area, binocular overlapping region and peripheral region of each eye.In a reality It applies in example, can condense together for multiple displays and the video image of resolution ratio.In another embodiment, for more A display and the video image of resolution ratio can be separated.

Fig. 1 D shows exemplary vertical visual field, and which show 55 degree of focal zone or comfort zone and peripheral region.Symbol Number identification region is about 30 degree in the vertical direction.

Fig. 1 E shows exemplary horizontal visual field, and which show 60 degree of focal zones and 30 degree of Symbol recognition area, and Peripheral vision region and 135 degree of full binocular range.In addition to this, there is also monocular range (for right eye and left eyes), and The only ability visible temporo side range when user makes eye migration.

In one embodiment, it can turn in 30 degree of Symbol recognition regions that central fovea display is located at vertically and horizontally. In another embodiment, central fovea display can be turned to and be located at 55 degree vertically and in 60 degree of horizontal focusing region/comfort zones.

Fig. 1 F and 1G show the visual field of the central fovea display for one eye eyeball.In one embodiment, central fovea is aobvious Show that device 110 is oriented centered on staring vector 105.Stare the field of view center that vector limits eyes.

In one embodiment, the visual field of central fovea display 110 is across 1 degree of minimum visual field and crosses over 20 degree most The monocular visual field of big visual field.In one embodiment, the visual field of field display 120 provides the monocular visual field across 40 degree, and It is at most full monocular range.The full monocular range of visual field is generally viewed as towards 60 degree of nose, separate 107 degree of nose, is higher than water Square to 70 degree and it is lower than 80 degree of horizontal direction.

In one embodiment, field display 120 can provide picture number except the range of central fovea display 110 According to.Fig. 1 F provides top view, and which show eyes, and the view of the central fovea display 110 centered on staring vector 105 .Fig. 1 G provides front view, and which show the exemplary positions of the visual field of central fovea display 110.In one embodiment, in Entreat recessed display 110 have between 20 degree and 160 degree it is total can scanning field of view 160, the central fovea display can position In it is described always can be in scanning field of view.As described above, central fovea display 110 has at least 1 degree of monocular visual field.Implement at one In example, central fovea display central fovea 110 has 10 degree of monocular visual field, and the total of central fovea display can scanning field of view 160 be 60 degree.This makes it possible to central fovea display 110 and is located at correct position.

Fig. 1 H and 1I show the view with the central fovea display 110 that user is upward and eyes left and is located at different location .In this configuration as can be seen that the visual field of central fovea display 110 is mobile, and the visual field of field display is aobvious in central fovea Show that the part above and below the visual field of device 110 is uneven.Fig. 1 I shows the exemplary positioning of the visual field of display from front.

The high-resolution with wide visual field is produced using the combined system comprising central fovea display and field display The perception of image, while only needing the pixel quantity of traditional near-eye display and the sub-fraction for the treatment of capacity.In one embodiment In, such system also reduces the power consumption of rendering system by reducing rendered pixel quantity significantly.

In one embodiment, the system may include each eye two or more display.In one embodiment, There may be the resolution ratio of three ranks, cover the foveal area, binocular overlapping region and peripheral region of each eye. In another embodiment, the system only includes that can turn to central fovea display, and field display can be by external system It provides.In another embodiment, the system can be formed only by that can turn to central fovea display, without associated field Display.

Fig. 1 J shows one embodiment of binocular display, and it includes the visual fields and left eye of right eye central fovea display 110A The visual field of central fovea display 110B.For each of right eye 150A and left eye 150B, there is also with larger field Field display, respectively 120A and 120B.In one embodiment, field display visual field 120A, 120B extends at least through poly- Burnt region.

Fig. 1 K shows one embodiment of binocular display, and it includes the visual fields and left eye of right eye central fovea display 110A The visual field of central fovea display 110B.However, in this configuration, the visual field that field display 170 is across user extends single Display.In one embodiment, central fovea display and field display can be integrated into the wearable aobvious of such as goggles Show the display in device.In another embodiment, central fovea display can be a part of wearable device, and field is shown Device is separated display, such as projector or screen.

Fig. 2 shows one embodiment of example optical system 210,280 and associated processing system 238.At one In embodiment, processing system be can be implemented in the computer system comprising processor.In one embodiment, processing system 238 can be a part of display system.In another embodiment, processing system 238 can be long-range.Implement at one In example, optical system 210,280 be can be implemented in the wearable system of such as head-mounted display.Central fovea image is to pass through The eyes that right eye central fovea display 220 and left eye central fovea display 230 are presented to the user, right eye central fovea display 220 Central fovea display is guided with left eye central fovea display 230.In one embodiment, central fovea display 220,230 is main Image is shown towards the field of view center guidance central fovea of eyes of user.In another embodiment, image may be directed to not Same position, as will be described.

The central fovea image of right eye is generated using the first display element 222.In one embodiment, display element is Digital micro-mirror device (DMD).In one embodiment, display element 222 is scanning micro-mirror device.In one embodiment, it shows Show that element 222 is scanning fiber device.In one embodiment, display element is Organic Light Emitting Diode (OLED).At one In embodiment, display element 222 is liquid crystal over silicon (LCOS) panel.In one embodiment, display element 222 is liquid crystal display Device (LCD) panel.In one embodiment, display element 222 is micro- LED or micro- light emitting diode (μ LED) panel.At one In embodiment, display element is scanning laser system.In one embodiment, the system is with off-axis gaussian beam optical element (HOE) hybrid system.In one embodiment, the system includes waveguide.In one embodiment, waveguide is multilayer wave It leads.In one embodiment, display element may include the combination of this class component.Fig. 5 below is discussed in more detail to 16 Display element.

In one embodiment, the first display element 222 is located in the nearly eye device of such as glasses or goggles.

The focus and visual field of central fovea display are arranged using intermediate optical elements 224.Intermediate optical elements 224 can Including but not limited to lens, reflecting mirror and diffraction optical element.In one embodiment, the focus of virtual image is arranged to It is infinitely great.In another embodiment, the focus of virtual image is arranged to be closer to infinity.In one embodiment, empty The focus of quasi- image can change.In one embodiment, two or more cokes that virtual image can have while perceive Away from.

In one embodiment, central fovea shows that image is guided mainly towards the field of view center of eyes of user.In a reality It applies in example, central fovea shows that the visual field (FOV) of image is greater than 1 degree.In one embodiment, central fovea shows that the FOV of image is situated between Between 1 degree and 20 degree.In one embodiment, central fovea shows that image can be greater than 5 degree, to handle the inaccurate of eyes tracking True property provides successfully blending prevent user concocts required area from perceiving, and considers to be directed to various types of eyes Eyeball movement relocates central fovea display the time it takes.

In one embodiment, the system also includes that the field of low resolution shows image, the low resolution Field display image has the visual fields of 20 to 220 degree.

In one embodiment, central fovea shows that image is using one group of one or more complete or partial transparent positioning Element 226 is projected directly on the eyes of user.In one embodiment, setting element 226 include can steering reflection mirror.One In a embodiment, setting element 226 includes curved reflector.In one embodiment, setting element 226 includes Fresnel reflection Device (Fresnel reflector).In one embodiment, setting element 226 includes diffraction element.In one embodiment, Diffraction element is Surface gratings.In one embodiment, diffraction element is volume hologram.In one embodiment, it shows Show that device 220 may include focus actuator 223, focus actuator 223 enables multiple cokes of the display in the same frame Pictorial element is shown away from place.In one embodiment, focus actuator 223 can be optical path length extender, and such as 2016 12 Described in No. 15/236,101 U.S. Patent application that the moon is submitted on the 8th.

For left eye central fovea display 230, there are a similar set of pieces.In one embodiment, right eye central fovea is aobvious Show that device 220 and left eye central fovea display 230 match.In another embodiment, they may include different elements.

In one embodiment, eye tracker 240 tracks user and stares vector, such as the position that eyes are being seen. In one embodiment, eyes tracking system is the eyes tracking system 240 based on camera.In one embodiment, eyes with Track system 240 is the infrared scan laser with receiving sensor.Other eyes followers can be used.Central recessed position Calculator 245 determines the field of view center of user based on the data from eyes tracking system 240.

In one embodiment, setting element 226,236 is adjusted to be used to adjust central fovea display 220,230, it will Central fovea framing is at the field of view center guidance mainly towards eyes of user.In one embodiment, it is reflected by changing The angle that mirror is --- one in setting element 226,236 --- adjusts the direction of image.In one embodiment, by making Change the angle of reflecting mirror with electromagnetic force.In one embodiment, change the angle of reflecting mirror by using electrostatic force.In In one embodiment, change the angle of reflecting mirror by using piezoelectric forces.In one embodiment, adjustable component is image Source or display element 222,232 are moved to position image.In one embodiment, central fovea image is oriented to be directed to The field of view center of eyes of user.In another embodiment, thus it is possible to vary another setting element 226,236, such as turn to member Part 226,236.

Field display 280 is communicated via communication logic 270,290 with processing system 238.In one embodiment, Ke Yicun In multiple displays.Here two field displays: field display 285 and peripheral display 288 are indicated.It can also show additional The resolution ratio of rank.In one embodiment, field display 280 may include by the single field display of the eyes viewing of user 285 or each eye watch a field display.In one embodiment, field display 280 can have variable-resolution.

In one embodiment, when field display 280 is separated system, using synchronization signal generator 292 so that The display of independent central fovea display 210 is synchronous with the display of field display 280.In one embodiment, believed using synchronous Number generator 292 is so that other setting elements of adjustable reflecting mirror or central fovea display are synchronous with field display.This meeting Cause the display synchronous.In one embodiment, field display 280 includes dispenser system 294, dispenser system 294 The edge that edge and field for central fovea to be shown to image show image is concocted, to ensure that transition is smooth.

In one embodiment, the field of low resolution shows that image is to be in using optical system transparent completely or partially Now give user.In one embodiment, this partially transparent system includes waveguide optical system.In one embodiment, this portion Dividing transparent system includes partially reflecting mirror, and the partially reflecting mirror can be flat or have optical power.Implement at one In example, this partially transparent system includes diffraction optical element.In one embodiment, this image is by looking at optical system straight It is presented to the user.In one embodiment, this partially transparent system includes the content for reflecting or scattering light.

In one embodiment of field display 280, using additional display subsystem in mono-vision peripheral view 288 Area in show image.In one embodiment, this subsystem is LED array.In one embodiment, this subsystem is OLED Array.In one embodiment, this display subsystem uses scan laser.In one embodiment, this subsystem uses LCD Panel.In one embodiment, this subsystem does not have intermediate optical elements to manipulate the FOV of image or focus.Implement at one In example, this subsystem has intermediate optical elements.In one embodiment, these intermediate optical elements include microlens array.

It by the image data that central fovea display 210 and field display 280 are shown can be turned to is given birth to by processing system 238 At.In one embodiment, the system includes eye tracker 240.In one embodiment, eye tracker 240 tracks User's stares vector, such as the position that eyes are being seen.In one embodiment, eyes tracking system is the eye based on camera Eyeball tracking system 240.Alternatively, eyes tracking system 240 can be based on infrared laser.245 base of central fovea position calculator The field of view center of user is determined in the data from eyes tracking system 240.

In one embodiment, processing system 238 also includes central fovea location verification device 247, central fovea location verification device The positioning of 247 verifying setting elements 226,236, to ensure that display 220,230 is properly located.In one embodiment, this Comprising the movement according to central fovea display, the field of view center relative to eyes of user reappraises central fovea location of displays. In one embodiment, central fovea location verification device 247, which provides feedback using sensing mechanism, arrived it to verify setting element Target position.In one embodiment, sensing mechanism can be camera.In one embodiment, sensing mechanism can be transmission Device.Sensing mechanism can be the another type of sensor for the position that can determine optical element.In one embodiment, If the physical location of central fovea display is not target position, central fovea location verification device 247 can change display with Correct image data is provided.This situation is more fully hereinafter described.

In one embodiment, classifies eye movement device 260 can be used for predicting staring vector and wherein moving for user It is dynamic.It is recessed aobvious come mobile central with the next position for staring vector based on user that this data can be used in prediction locator 265 Show device 220,230.In one embodiment, intelligent positioner 267 can use such as classifies eye movement and eyes tracking User data comes predictably locating and displaying device 220,230.In one embodiment, in addition intelligent positioner 267 can use The best orientation for display 220,230 is identified about the data for the data that will occur in frame to be shown.At one In embodiment, intelligent positioner 267 can make display 220,230 be located at the not position by staring vector instruction.For example, if Shown frame data only have being intended that for a small amount of related data (such as the butterfly illuminated on dark screen originally) or frame Viewer is set to see specific position.

Processing system 238 can also include cutting logic 250.It cuts off logic 250 and limits central fovea display 220,230 Position, and the display information with cutting is supplied to associated field display 280.Field display 280 render this data with The field for generating low resolution shows image, includes the corresponding part that image is cut off in field display.Which ensure that central fovea It is not interfered between image and field picture.In one embodiment, when there is cutting, dispenser logic 255 is by the side of cutting Edge and central fovea image are concocted to ensure that transition is smooth.In another embodiment, central fovea display can be used for showing Show that sprite, the sprite are relatively bright element of the overlay on the field picture of low resolution.In such cases, it cuts off Logic 250 and dispenser logic 255 are not necessary.In one embodiment, it can according to need selectively activation to cut Disconnected logic 250 and dispenser logic 255.

In one embodiment, the system can make central fovea display 210 synchronous with independent field display 280. In this case, in one embodiment, synchronous logic 272 keeps the display synchronous.In one embodiment, independent Field display 280 is synchronous with other setting elements of adjustable reflecting mirror or central fovea display 210.This can cause described aobvious Show that device is synchronous.Field display 280 can receive location data.In one embodiment, it may not cut off in this case.

In one embodiment, processing system 238 may include the optical distortion system for central fovea display 210 275, optical distortion system 275 has from the center of image to the increased distortion in edge.This intentional distortion will make pixel Increase in the perception size for being moved to edge from the center of central fovea image.This change of perceived resolution will reduce institute The treating capacity needed, because covering the same angular zone that central fovea shows image by may require that less pixel.

Fig. 5 B is shown with the example for increasing and having the fault image of low resolution with optical axis angulation.Optics Distortion can contribute to the blending between central fovea display 210 and field display 280.In another embodiment, Ke Yi Do not have to use the central fovea display 210 comprising optical distortion system 275 in the case where field display.It additionally provides relatively simple Optical design, and save blending processing.

In one embodiment, the high distortion image of variable-resolution has the big ratio between center and edge.This Total FOV of display will very greatly (at most 180 degree).

In one embodiment, logic of roll-offing 277 is provided in the edge of display roll-offs.In one embodiment, it rolls Drop may include resolution ratio and roll-off and (lower resolution ratio towards the edge of display area).In one embodiment, this can pass through The amplification of optical distortion system 275 is implemented.In one embodiment, it roll-offs and roll-offs comprising brightness and/or contrast (towards side Edge dimming and/or contrast).Such roll-off is designed to reduce the mutability at display edge.In one embodiment, Roll-off and can be designed to roll-off into " without (nothing) ", that is, from full brightness/contrast gradually reduce to grey or black or Environmental colors.In one embodiment, when no associated field display, rolling can be used by central fovea display 210 Logic 277 drops.In one embodiment, when, there are when field display, logic of roll-offing 297 can be field display 280 in system A part.

Fig. 3 shows one embodiment of the movement of central fovea image over time when the eye motion of user.It is in office In what time instance, all there is small area, central fovea image is shown to the area.5 degree of high-resolution (in this example) The position of display focuses on the field of view center of user.The field picture of low resolution provides big visual field.But because eyes are in center Relative resolution except concave region is lower, so user will include small high-resolution central fovea image and low point biggish This combination image of the field picture of resolution is perceived as the high-resolution across big visual field.

Fig. 4 A is the flow chart using one embodiment of central fovea display.Process starts at frame 410.In a reality It applies in example, before this process starts, display system is assembled to user.This initial setting up includes to determine interocular distance (IPD) With required any regulation, with ensure user " baseline " display be accurate.

At frame 415, the eyes of user are tracked.In one embodiment, eyes are tracked using IR camera.In a reality It applies in example, eyes track and identify the vector of staring of user, such as the position that user focuses.Eyes tracking can identify left eye and the right side Eye stares vector/angle, and stares center (staring vector export from left-eye/right-eye).Eyes tracking can determine left eye and Position (X, Y, Z) and orientation (rolling, pitching, yaw) of the right eye relative to baseline reference system.In one embodiment, initial Display is assembled to user and establishes baseline reference when establishing the interocular distance, diopter and other related datas of user System.

At frame 420, based on the position for staring vector data and determining central fovea.In one embodiment, central recessed position Coordinate (X, Y, Z) comprising each eye and orientation (rolling, pitching, yaw).

At frame 425, process determines whether that central fovea display should be relocated.This is based on by central fovea display Current location is compared with the desired location for staring vector or central fovea image of user.If their misalignments, system Determination should relocate central fovea display.If central fovea display should be relocated, display is relocated at frame 430 Device.In one embodiment, if central fovea display is mobile more than specific range, display is closed during movement.This Ensure that user will not perceive movement.In one embodiment, the specific range is greater than 0.5 degree.In one embodiment, If moved in user's blink, central fovea display is not closed.Although should be noted that using term " repositioning ", But this is usually not meant to that eyepiece carries out physics movement.In one embodiment, using the reflection for positioning the display Mirror or other optical elements change the centralized positioning of central fovea image.Process then continues to frame 435, regardless of whether again Locating and displaying device.

At frame 435, optionally, system shutdown field display will be located at the portion of the same position with central fovea display Point.This can prevent field display from interfering central fovea display.In one embodiment, cutting is executed at rendering engine.Another In one embodiment, central fovea image can be sprite, or not need the other bright pictorial elements for the cutting that will be removed. In said case, this frame can be skipped.In one embodiment, if eyes of user tracking instruction user's stares from base Line then skips cutting with reference to generally moving.Baseline reference is that the default of user stares position, stares position tracking from this default The movement stared.Mean that system can not determine that user's correctly stares position from substantially moving for baseline reference.In this feelings Under condition, in one embodiment, central fovea image can be abandoned, or can be with temporary close central fovea display.

At frame 440, in one embodiment, the edge between central fovea image and field picture is concocted.Which ensure that field Smooth and not noticeable transition between image and central fovea image.At frame 445, it will be shown in conjunction with central fovea display and field Show that the mixed image of device is shown to user.Process then returnes to frame 410, to continue to track and show.Although should be noted that this theory Bright book has talked about central fovea image and field picture, but the image considered includes the sequential picture of video.

Fig. 4 B is shown when location of displays verifies the physical location of instruction central fovea display and desired location mismatches The one embodiment for the corrective action that can be taken.Process starts at frame 450.

At frame 452, starting central fovea display positioning.In one embodiment, this frame 430 for corresponding to Fig. 4 A.It returns Fig. 4 B is returned to, at frame 454, verifies the physical location of central fovea display.In one embodiment, it is passed using one or more Sensor determines position and the orientation of central fovea display.In one embodiment, sensor may include camera, detection it is adjustable Save the mechanical organ etc. of the position of reflecting mirror or other setting elements.

At frame 456, process determines whether central fovea display correctly positions.Being properly positioned makes at central fovea display In calculating position, central fovea image is displayed for a user in place.If central fovea display correctly positions, in frame Image is shown at 464.In one embodiment, this includes the central fovea image shown comprising in calculating position and associated field Show the mixed image of image.Then process terminates at frame 475.

If process determines that central fovea display does not position correctly, then process proceeds to frame 458 at frame 456.

At frame 458, process determines whether to have sufficient time to relocate central fovea display.This determination is to be based on Mobile distance, movement speed are needed, and until processing system will send the time of next image.In one embodiment In, this determines the eye motion for additionally depending on user.In one embodiment, when being not detected by image, System Priority The mobile central fovea display in user's blink.In one embodiment, it is relocated in the blanking period of display. For example, compared to significant ground and the mobile central fovea display in three dimensions, along a coordinate only once move meeting It takes less time.If there is time enough, then process returns to frame 452, to relocate central fovea display.It is no Then, process proceeds to frame 460.

At frame 460, whether process determines the physical location of central fovea display in the range of desired location.At one In embodiment, under this content context, " in range " means that system can adjust display for difference.If actual bit It sets in range, then process proceeds to frame 462.

At frame 462, central fovea image is adjusted to render in physical location, and show image at frame 464.Example Such as, in one embodiment, if position difference is very small, original calculation central fovea figure can be rendered in the position of mistake Picture, without will cause visual artifact.In another embodiment, adjustable central fovea image is in physical location suitably wash with watercolours Dye.For example, can be cut to central fovea image, lighten, distort, contrast adjustment, chromaticity coordinate (white point) are adjusted, are cut With transverse shift to consider position difference.In one embodiment, the radial position displacement or change that edge can be made to concoct.In In one embodiment, system may be rendered excessively, such as the visual pattern of 5.5 degree of the central fovea display rendering for 5 degree, from And make it possible to shift 0.5 degree without rendering again.

If central fovea display is not in range, at frame 466, in one embodiment, send frame data to Field display is to be rendered.At frame 468, in one embodiment, central fovea image is not shown.In one embodiment, Abandon frame.In another embodiment, temporary close central fovea display.In one embodiment, if eyes of user tracks It indicates that staring for user is moved into too far except baseline reference, is then not considered as central fovea display in range.

At frame 470, rendering field shows image, and cut off without image and without the display of central fovea image or Rendering.At frame 472, display field shows image.Then process terminates.

Fig. 5 A shows one embodiment of display, and it includes central fovea display subsystems 510 and field display subsystem 550.In one embodiment, central fovea display subsystem 510 includes display panel 515 or another image source, and intermediate light Learn device 520.The output of intermediate optics 520 is directed into adjustable reflecting mirror 525, or is directed into its for providing positioning Its element.Image is directed to partially reflecting mirror 530 and curvature portion reflecting mirror 535, partially reflecting mirror by adjustable reflecting mirror 525 530 and curvature portion reflecting mirror 535 towards user 590 navigational figure of eyes.In one embodiment, reflecting mirror is adjusted 525 can be replaced by tunable prism, and wherein prism a surface is mobile to adjust angle, such as from OPTOTUNE^TM's Tunable prism TP-12-16.In one embodiment, reflecting mirror 525 being adjusted can be replaced by acousto-optic modulator and reflecting mirror It changes.In one embodiment, each of these elements can be replaced with similar element, these similar elements make height The selectivity movement of resolution display can be guided to be aligned with the field of view center of eyes of user 590.In one embodiment In, field display subsystem 550 includes projection subsystem 555 and light guide 560.Alternate embodiment can be to field display subsystem 550 Use different projecting methods.

Fig. 5 B shows the one embodiment roll-offed that can be used for concocting central fovea image and field picture.In one embodiment In, systemic resolution roll-offs the edge including amplifying display to show lower resolution data except foveal area.This Also increase visual field.Hardware, software or combination can be used, amplification is provided in various ways.Figure 16 B shows exemplary display 580, which show the distributions of the pixel density when resolution ratio is roll-offed.At center as can be seen that the size of pixel is uniform (by center Polygon 585 is shown).Towards the edge of display area, pixel size becomes larger, and distorts.This can be in left side polygon 595 In find out.Because the distance between pixel edge all increases in the horizontal and vertical directions, in one embodiment, The pixel horizontally and vertically removed from central area more distorts, and bigger, this can be in bottom polygon 1680 Find out.It should be noted that Fig. 5 B shows relatively small display, and the ratio between central polygon 585 and turning polygon 595 It can be in the range of being greater than 1 to less than or equal to 10.

Fig. 6 shows another embodiment of display, and it includes central fovea subsystems 610 and field display subsystem 650.It removes Except described two subsystems, the embodiment of Fig. 6 also includes peripheral vision display 670.In one embodiment, periphery view Feel that display is OLED display.

Fig. 7 shows another embodiment of display, and it includes central fovea display subsystems 710 and field display subsystem 750.In this embodiment, field display subsystem is the OLED 760 with microlens array.

Fig. 8 shows another embodiment of display, and it includes central fovea display subsystems 810 and optional field to show son System 850.In this embodiment, central fovea display subsystem 810 can be implemented in the glasses or goggles worn by user. In one embodiment, optional field display subsystem 850 can be the display screen of such as TV monitor 860.Field display subsystem System 850 can be modular component, can optionally be attached to glasses or goggles.In one embodiment, system can be with Only high-definition picture is provided by central fovea display subsystem 810.When user has available optional field to show subsystem really Unite 850 when, rendering system (not shown) can be communicated with central fovea display subsystem 810 and field display subsystem 850, be provided Wider visual field.In one embodiment, in this configuration, central fovea display subsystem can be provided to more 20 degree of visual fields.

Fig. 9 shows another embodiment of display, and it includes central fovea display subsystems 910 and field display subsystem 950.In this embodiment, central fovea display subsystem 910 includes the light guide 930 with 40 ° to 55 ° of FoV, light guide 930 with Projector 920 couples, and projector 920 is used as display panel, such as OLED micro-display.In one embodiment, display panel 920 only send small image associated with the covering region of central recessed area of user's visual field, without sending complete 40 ° to 55 ° images. The rest part except hot spot of waveguide 930 will be transparent.Except central recessed area, this can be filled with lower resolution The field display 950 of rate, such as OLED display 960.

Figure 10 shows another embodiment of display, and it includes central fovea display subsystems 1010 and field display subsystem 1050.In this embodiment, central fovea display subsystem 1010 include display panel 1015, it is intermediate optics 1020, adjustable Reflecting mirror 1025 is saved, adjustable reflecting mirror 1025 directs light to off-axis gaussian beam optical element (HOE) 1030.HOE 1030 is in the future The eyes of user are directed to from the light of display 1015.The adjustable offer of reflecting mirror 1025 moves so that central fovea shows subsystem System 1010 can be positioned correctly.In one embodiment, field display subsystem 1050 includes projection subsystem 1055 and light guide 1060。

Figure 11 shows another embodiment of display, and it includes central fovea display subsystems 1110 and field display subsystem 1150.In this embodiment, central fovea display subsystem 1110 include display panel 1115, it is intermediate optics 1120, adjustable Reflecting mirror 1125 is saved, adjustable reflecting mirror 1125 directs light to the prism 1130 with embedded partially reflecting mirror.From rib The light of embedded partially reflecting mirror in mirror 1130 is reflected into the eyes of user by curvature portion reflecting mirror 1140.Adjustable reflection The offer of mirror 1125 moves so that central fovea display subsystem 1110 can be positioned correctly.In one embodiment, field is shown Subsystem 1150 includes projection subsystem 1155 and light guide 1160.

Figure 12 shows another embodiment of display, provide spatial reuse high resolution display and low resolution Rate display.In the fig. 12 embodiment, light is provided by single display panel 1210.Single display panel 1210 shows two Separated image: central fovea display portion and field display portion.Central fovea display portion shows intermediate optical device by central fovea Part 1220, adjustable reflecting mirror 1230 and partially reflecting mirror 1240 and curvature portion reflecting mirror 1245.In one embodiment In, reflecting mirror 1240,1245 can be replaced by another mechanism with by light-redirecting.

In one embodiment, the field display image portion from single display panel 1210 divides Receiving yaxd to show intermediate option 1250, field shows that intermediate option 1250 passes them to light guide 1260.This enables single display panel 1210 to utilize sky Between be multiplexed with central fovea display and field display all provides data.In one embodiment, for central fovea display portion and The relative size of image on the display panel 1210 of field display portion is not identical.In one embodiment, display size is identical, But field, which shows that intermediate optics 1250 expand, will act as the image section that field is shown.

Figure 13 A and 13B show one embodiment of time-multiplexed display, and it includes central fovea image and low resolution Field show image.System utilizes single display panel 1310 and color or polarization selective mirror 1325, color or polarization Selective reflecting mirror 1325, which selectively sends data (for central fovea image data) or reflects it to field, shows intermediate light Learn device 1355.Display panel 1310 shows that the field of central fovea image data and low resolution is shown in a time multiplexed fashion Data, such as enable frame with the sufficiently fast speed alternating to generate two groups of images that the mankind perceive.

Figure 13 A shows the optical path of central fovea picture frame.Data by central fovea show intermediate optics 1320, then by Guidance passes through color or Polarization-Sensitive reflecting mirror 1325.The data are reflected by adjustable reflecting mirror 1330.In one embodiment In, image for being directed to the eyes of user by partially reflecting mirror 1340 and curvature portion reflecting mirror 1345.In one embodiment In, additional central fovea shows that intermediate optics 1320 can be located at after color or polarization selective mirror 1325.It can To use the alternative configuration for navigational figure.

Figure 13 B shows the optical path of a display image data.Image data from single panel display 1310 is advanced logical It crosses central fovea and shows intermediate optics 1320, show intermediate light towards field by color or polarization selective mirror 1325 later Learn device reflection.In one embodiment, one or more redirection reflecting mirrors 1350 can be used to guide light.Light is aobvious from field Show that intermediate optics 1355 pass through light guide 1360.Then output passes through curvature portion reflecting mirror 1345 and partially reflecting mirror 1340 It is transmitted to the eyes of user.

By showing between image rapidly switching display in central fovea image and field, system is in a time multiplexed fashion Two images are shown, so that two images are all perceived by the user simultaneously.

Figure 14 A and 14B show one embodiment of the central fovea display subsystem using waveguide.In one embodiment, This configuration of central fovea display subsystem can be used in any of the above described embodiments.In one embodiment, central fovea image Utilize display panel 1410.The output of display panel 1410 passes through optical device 1420.Although optical device 1420 is shown as Single lens, it will be appreciated, however, by one skilled in the art that may include any intermediate optical elements as optical device 1420.Light The output for learning device 1420 is transmitted to steering component 1430, and the output is redirect to light guide input coupler by steering component 1430 In 1440.Steering component 1430 directs light to the appropriate part of light guide input coupler 1440.Then image data passes through light 1450 are led, and is output to the eyes of user by light guide output coupler 1460.Steering component 1430, which correctly guides, to be used for The light for entreating recessed image is adjusted to the eye position of user.

Figure 15 A and 15B show one embodiment that image is shown using the field of multilayer light guide.This stack waveguide can be used In above with respect to configuration described in field display.In this example, there are two waveguides, and there are one for each part of visual field A waveguide.In another embodiment, may exist four stack waveguides.

The output of display panel 1510 passes through optical device 1520.Although optical device 1520 is shown as single lens, It will be appreciated, however, by one skilled in the art that may include any intermediate optical elements as optical device 1520.Optical device 1520 output is transmitted to light guide input coupler 1540,1545.In one embodiment, optical device 1520 be based on color or Polarization is by the data separating from display panel 1510, and one be channeled in light guide input coupler 1540,1545. In this example, top lightguide 1550 is used for the first field of view portion of image, and bottom light guide 1555 is used for the second of image Field of view portion.Output from central fovea light guide 1550,1555 is directed to the eye of user by light guide output coupler 1560,1565 Eyeball.

Figure 16 A shows another embodiment of display, and it includes central fovea display subsystems 1610 and field to show subsystem System 1640.This is configured similarly to above for configuration described in Fig. 5, however, instead of using adjustable reflecting mirror, use is removable Dynamic display panel 1615 to position central fovea display for the eyes of user.Displaceable element for central fovea display subsystem This configuration be substituted in the above system of adjustable reflecting mirror.

Figure 16 B shows another embodiment of display, and it includes central fovea display subsystems 1650 and field to show subsystem System 1690.This is configured similarly to above for configuration described in Fig. 5, however, instead of using adjustable reflecting mirror, use is adjustable Humorous prism 1665 to position central fovea display for the eyes of user.In this embodiment, a surface of tunable prism is moved It moves to adjust angle, to position central fovea image.Tunable prism can be from OPTOTUNE^TMTunable prism TP- 12-16.This configuration of displaceable element for central fovea display subsystem can be used for being replaced with tunable prism 1665 In the above system of adjustable reflecting mirror.In another embodiment, be adjusted reflecting mirror 525 can by acousto-optic modulator and Reflecting mirror replacement.This configuration of displaceable element for central fovea display subsystem has been substituted for adjustable reflection In the above system of mirror.

It should be noted that the configuration that Fig. 5 to 16A is shown is presented with optical device and specified arrangement.However, designing and being not required to Specified arrangement is wanted, and additional optical element can be used in systems.Furthermore, it is possible to hybrid element and make between configuration Element matching.

Figure 17 is the flow chart using one embodiment of the central fovea display with external display.External display It is the display not controlled with central fovea display by same system.For example, external display can be for example virtually existing The optical projection system in other environment that the real cave (VR) or offer field are shown.In one embodiment, in addition to being mentioned by other systems Except the field display of confession, user can also wear augmented reality (AR) or virtual reality (VR) headphone, with environment Interaction is to provide combining display, and wherein AR/VR headphone provides central fovea display.

Process starts at frame 1710.At frame 1715, execute between central fovea display system and outside display system It shakes hands.In one embodiment, it shakes hands and has been determined that two systems can be worked together to provide combination display.In one embodiment In, shaking hands to be included between central fovea display system and field display system is arranged connection.

At frame 1720, synchrodata is set from outside display system.Because central fovea system is designed to It unites fully synchronized, so in one embodiment, this synchronization signal provides frame data.

At frame 1725, the positioning of central fovea display is determined.As described above, this determination can based on user stare to Amount, prediction are stared, or the intelligent positioning based on the data from just shown frame.

At frame 1730, process determines whether that central fovea display should be relocated, to be shown in selected location.Such as Fruit should relocate central fovea display, then positioning is triggered at frame 1735.

At frame 1750, overlay central fovea display, to enhance external display.In one embodiment, because it is external Display is separated, so it does not include cutting logic.In another embodiment, it there may be cutting logic, prevents The a part for the position rendering low-resolution image that system is demonstrated from central fovea display image.

At frame 1760, show that image and field show the edge between image using fuzzy to concoct central fovea.In frame At 1770, the mixed image comprising central fovea image and field picture is shown to user.In this way, when enter the cave VR or When with big visual field but having other display environments of field display, user can have the viewing quality of enhancing.Process is right After be circulated back to frame 1720, to continue the process, until video or it is other display terminate.

Figure 18 is in the case where no associated field display using the stream of one embodiment of central fovea display Cheng Tu.In this case, system only provides central fovea display, without field display as discussed above.However, one In a embodiment, central fovea display can be using blending or amplification to increase visual field.

At frame 1820, process determines the position of central fovea display based on user data or other data.User data It may include and stare vector, predict to stare vector etc..External data may include about by the information for the image data being shown.

At frame 1830, process determines whether that central fovea display should be relocated.It may not be needed as multiple frames again Locating and displaying device, because staring for user is unchanged.If position should be changed, central fovea display is adjusted at frame 1840. In one embodiment, it adjusts may include and can turn to suitable Vitrea eye (eye box) to correct eye position.In one embodiment In, adjust the displacement that may include the central recessed area for making display relative to user's visual field.In one embodiment, if It is mobile to be greater than a certain distance, then central fovea display is closed during movement.In one embodiment, distance is greater than 0.5 degree.In In one embodiment, if user blinks during movement, central fovea display may not be closed.

At frame 1850, central fovea display is set in the appropriate location for user.

At frame 1860, in one embodiment, provides and roll-off in the edge of display.In one embodiment, it rolls Drop roll-offs comprising resolution ratio and (lowers resolution ratio towards the edge of display area).In one embodiment, roll-off comprising brightness and/ Or contrast is roll-offed (towards edge dimming and/or contrast).Such roll-off is designed to reduce the prominent of display end Denaturation.In one embodiment, roll-offing can be designed to roll-off into "None", that is, gradually reduce to ash from full brightness/contrast Color or black or environmental colors.

In one embodiment, resolution ratio is roll-offed including the pixel size for expanding central fovea display edge, with preferable The field of low resolution except ground and foveal area shows image blending.This also increases visual fields.Hardware, soft can be used Part or combination provide amplification in various ways.Fig. 5 B shows exemplary display, which show when resolution ratio is roll-offed pixel it is close The distribution of degree.

At frame 1870, by it is appropriate based on the correct application of gaze angle in image.With staring vector straight forward Change, the distortion across visual field increases.Correction based on gaze angle is using known gaze angle used for positioning, with software Correct any distortion.Process then returnes to frame 1820.In this way, can turn to central fovea display can be used for following use Family stare or other prompts and central fovea can be turned to and show by providing.In one embodiment, central fovea display can provide Variable field of view.

Figure 19 is the flow chart for concocting the one embodiment at edge of central fovea display.Process starts at frame 1910. As discussed above, when central fovea display positions together with field display, the edge between the display is concocted.This is User produces continuous impression.In one embodiment, this process is corresponding to the frame 440 of Fig. 4 and the frame 1760 of Figure 17.

At frame 1920, process identifies the edge of central fovea image.In one embodiment, edge is by central fovea display Available visual field limits.In another embodiment, central fovea display can show the maximum field of view that can be shown less than it Visual field.

At frame 1930, process determines best blending technology, and applies the technology.In one embodiment, skill is concocted Art, which may include, uses blending below: alpha mask (alpha mask) shakes blending, staggered pixels, based on color The blending of the channel alpha, the channel alpha pixel-based blending, the blending of multiple sampling antialiasing (MSAA), time-domain filtering, and/or Other blending technologies.

At frame 1950, process determines whether that other technologies should be applied.If other technologies should be applied, at frame 1960 A kind of technology under selection, and process returns to frame 1940.If other technologies should not be applied, process is tied at frame 1970 Beam.As described above, in one embodiment, showing that the field of image and low resolution shows figure comprising high-resolution central fovea This process is called in the case where each frame superposition of picture.In one embodiment, when central fovea display exhibits are superimposed upon background On sprite or other pictorial elements when, blending may not be applied.

Figure 20 is the flow chart using one embodiment of classifies eye movement.User is predicted using classifies eye movement The Future Positions of eyes are to position central fovea display.Process starts at frame 2010.At frame 2015, determine that 2015 users regard The position of the central recessed area of field.At frame 2020, classify to the eye motion of user.Figure 21 show can identify it is some Exemplary eye motion.Eye motion include watch attentively, blink, it is micro- pan, slowly tracking and quickly movement/pan.In a reality It applies in example, other than eye motion, can also be classified to eye motion using head position to be used to predict purpose. The eye motion of these types is well known in the art.

At frame 2025, process determines the appropriate response to eye motion.The response may include change display Visual field is changed in position, changes resolution ratio, and change depth data (it can depend on 3D and stare vector) changes convergent point.It is described Determination can be based on the follow-up location for staring vector for predicting user according to classifies eye movement.

At frame 2030, process determines whether that central fovea display should be changed.If central fovea display should be changed, Central fovea display is changed at frame 2035.As described above, the change may include and change position, visual field, resolution ratio etc..

At frame 2040, process is based on analysis and determines whether that field display should be changed.If field display should be changed, Change field display at frame 2045.In one embodiment, can be changed by changing resolution ratio, depth data, convergent point etc. Variable field display.In one embodiment, field display can not turn to, but can carry out other changes.

At frame 2050, central fovea is made to show that image and field show the edge blurry between image.At frame 2060, it will mix It closes image and is shown to user.Process then returnes to frame 2015, to continue with next image.It should be noted that implementing at one In example, this process is quickly carried out, so that assessing before each frame is shown each frame.

Figure 22 is the flow chart of one embodiment of intelligent positioning.Process starts at frame 2210.When system is designed to Be not merely based on user stares vector this process when utilizing positioning, can be used.

At frame 2215, the eyes of user are tracked.In one embodiment, the head movement of user can also be tracked.This It is useful for the eye motion for being reflected based on vestibulo-ocular reflection to predict user.It can be moved with headgear combination and eye motion comes Determine position and the orientation of each eye.

At frame 2220, external data is received.This external data, which may include, to use central fovea display with high-resolution What rate was shown highlight element, the position that the eyes of user should be directed to, or another external factor.In one embodiment In, central fovea display can be pointed to the not coherent element stared at vector in user.For example, when there are dark screen and only When having an interested element, high-resolution central fovea display is most preferably deployed at interested element.As another One example if the major part of screen is deliberately fuzzy, but has writing or other fine detail contents there are some Part, then the part may be dispose central fovea display place.The other originals for positioning the display can be used Cause.

At frame 2225, the best orientation for central fovea display is determined based on external data and user data and is matched It sets.As described above, user data includes eyes and the head positioning of user.In one embodiment, external data independently of with Family, and reflect the information about the frame shown.In one embodiment, central fovea display is relocated unless existing External data, otherwise default configuration is the central fovea center for making central fovea display be located at user.However, it is based on external information, It may be for this configuration of certain frames and content changing.

At frame 2230, process determines whether that central fovea display should be changed.Change can be change position, resolution ratio, Focal length etc..If central fovea display should be changed, change display at frame 2235.

At frame 2240, process determines whether that a display portion should be changed.Change, which can be, changes resolution ratio, brightness, right Than degree etc..If a display portion should be changed, change display at frame 2245.

At frame 2250, blending central fovea shows that image and field show the edge between image, and at frame 2255, shows Show combination image.Process then returnes to frame 2215.

Although showing the above process in flow diagram form, it will be appreciated, however, by one skilled in the art that this is in order to simple For the sake of and carry out.Unless there are dependences between various elements, otherwise the order of the element does not need to remain unchanged.For example, The adjusting of central fovea display and field display can be carried out in any order.Eyes and the head of user can continuously be carried out Tracking.System can receive external data when external data can be used, rather than specific time continuously or in the process Receive external data.It is also within the scope of the invention to other such adjustings of flow chart.

Figure 23 is the block diagram of the one embodiment for the computer system that can be used in conjunction with the invention.However, for this It is readily apparent that other alternative systems of various system architectures also can be used for the those of ordinary skill of field.

Data processing system illustrated in fig. 23 includes the bus or other internal communication components 2340 for transmitting information, And it is coupled to bus 2340 to handle the processing unit 2310 of information.Processing unit 2310 can be central processing unit (CPU), digital signal processor (DSP) or another type of processing unit 2310.

In one embodiment, the system also includes and is coupled to bus 2340 to be executed by processor 2310 to store Information and the random access memory of instruction (RAM) or other volatile storages 2320 (referred to as memory).Primary storage Device 2320 can be also used for storage temporary variable or other average informations during processing unit 2310 executes instruction.

In one embodiment, the system also includes be coupled to bus 2340 to store the static state for being used for processor 2310 Information and the read-only memory of instruction (ROM) 2350 and/or static memory 2350.In one embodiment, the system Also include data storage device 2330, such as disk or CD and its corresponding disc driver or flash memory or it is other can The storage device of storing data when not to the system power supply.In one embodiment, data storage device 2330 is coupled to Bus 2340 is to store information and instruction.

The system is also coupled to output device 2370, such as is coupled to bus 2340 by bus 2360 to export The cathode-ray tube (CRT) or liquid crystal display (LCD) of information.It is defeated that output device 2370 can be visual output devices, audio Device and/or tactile output device (such as vibration etc.) out.

Input unit 2375 may be coupled to bus 2360.Input unit 2375 can be alphanumeric input device, example Such as include the keyboard of alphanumeric key and other keys, information and command selection are transmitted to processing unit for allowing users to 2310.It can also include additional user input apparatus 2380.A kind of such user input apparatus 2380 is cursor control device 2380, such as mouse, tracking ball, stylus, cursor direction key or touch screen, user input apparatus 2380 can pass through bus 2360 are coupled to bus 2340, for directional information and command selection to be transmitted to processing unit 2310, and it is aobvious for controlling Movement on showing device 2370.

Another device that can be operatively coupled to computer system 2300 is for accessing distributed system via network The network equipment 2385 of other nodes of system.Communication device 2385 may include many networking peripheral units commercially available in the market Any one of, such as being coupled to Ethernet, token ring, internet or wide area network, personal area network, wireless network or access Those of other methods of other devices device.Communication device 2385 can also be illusory modem connection, or provide Any other mechanism being connect between computer system 2300 and the external world.

It should be noted that any or all component and associated hardware of this system illustrated in fig. 23 can be used for this hair In bright various embodiments.

It will be appreciated by the skilled addressee that the embodiment present invention can be configured in various ways according to particular implementation Specific machine.Implementing control logic or software of the invention can store in main memory 2320, mass storage device 2330 or can be by the other storage mediums locally or remotely accessible of processor 2310.

It will be apparent to those skilled in the art that system as described herein, method and process can To be implemented as being stored in the software executed in main memory 2320 or read-only memory 2350 and by processor 2310.This control Logic or software can also reside on product, and the product includes computer-readable medium, the computer-readable medium tool Have embodiment wherein and can be read by mass storage device 2330 and for making processor 2310 according to methods herein and Instruct the computer readable program code operated.

The present invention can also be embodied in the hand-held or mancarried device of the subset containing above-mentioned computer hardware component. For example, handheld apparatus may be configured to only contain bus 2340, processor 2310 and memory 2350 and/or 2320.

Handheld apparatus may be configured to comprising one group of button or incoming signalling component, and the button can be used in user Or incoming signalling component is selected from one group of available options.These components can be considered as input unit #1 2375 or defeated Enter device #2 2380.Handheld apparatus can be configured to comprising output device 2370, for example, liquid crystal display (LCD) or Matrix of display elements, for showing information to the user of handheld apparatus.Conventional method can be used to implement such hand-held Device.In view of the disclosure of invention provided herein, the present invention is common for this field for the embodiment of such device It is obvious for technical staff.

The present invention can also be embodied in special equipment, and the special equipment includes the son of above-mentioned computer hardware component Collection, such as self-service terminal or vehicle.For example, equipment may include processing unit 2310, data storage device 2330, bus 2340 and memory 2320, without input/output means, or only basic communication agency, such as allow user with basic The small-sized touch screen that mode is communicated with device.In general, device more has specificity, element needed for device operation is fewer.One In a little devices, the communication with user can pass through screen or similar means based on touch.In one embodiment, device can be with Do not there is provided it is any directly input/output signal, but by website or the other of network equipment 2385 can be passed through be based on network Connection configure and access.

Computer system is implemented as it will be appreciated by the skilled addressee that can use according to particular implementation Any configuration of specific machine.Implement control logic or software of the invention can store can it is local by processor 2310 or On any machine readable media of remote access.Machine readable media includes for the form readable with machine (such as computer) Store any mechanism of information.For example, machine readable media include read-only memory (ROM), random access memory (RAM), Magnetic disk storage medium, optical storage media, flash memory device, or can be used for other storage mediums of temporarily or permanently data storage. In one embodiment, control logic may be implemented as can transmitting data, such as electricity, optics, acoustics or other forms Transmitting signal (such as carrier wave, infrared signal, digital signal etc.).

In the foregoing specification, the present invention is described by reference to certain exemplary embodiments of the invention.However, it is aobvious and It is clear to, in the case where the wider spirit and scope of the invention illustrated in not departing from the appended claims, Certain exemplary embodiments can be carry out various modifications and be changed.Therefore, the description and the appended drawings should be considered as it is illustrative and It is unrestricted.