阅读说明：本技术 视野显示系统和移动体 (Visual field display system and moving body ) 是由 川口豊 渡边功 于 2019-05-09 设计创作，主要内容包括：本发明提供视野显示系统和移动体,能够提高视野的可视性。视野显示系统(1)设置于具有驾驶席的飞机等移动体上。该视野显示系统(1)具有：飞行各因素检测部(11),其检测飞机的各因素；以及拍摄部(12),其具有视野拍摄装置(15),该视野拍摄装置(15)在飞行中拍摄至少相当于自驾驶席起的视野的视野图像。此外,具有：信息处理部(14),其将这些来自飞行各因素检测部(11)的各因素信息和来自拍摄部(12)的图像信息相关联而构成飞行信息；以及存储部(3),其存储由信息处理部(14)构成的飞行信息。而且,在飞行中,通过控制部(5)的控制,将实时图像、过去的图像和根据这些实时图像和过去的图像而生成的增强现实图像中的至少一个显示于显示部(4)上。(The present invention provides visual field display system and moving body, can be improved the visuality in the visual field.Visual field display system (1) is set on the moving bodys such as aircraft with driver's seat.The visual field display system (1) includes each factor test section (11) of flight, detects each factor of aircraft；And shoot part (12), with visual field filming apparatus (15), which awing shoots the field-of-view image at least corresponding to the visual field from driver's seat.Furthermore, comprising: these each factor informations from each factor test section (11) of flying and the image information from shoot part (12) are associated and constitute flight information by information treatment part (14)；And storage unit (3), store the flight information being made of information treatment part (14).Moreover, awing, by the control of control unit (5), at least one of realtime graphic, past image and the augmented reality image generated according to these realtime graphics and past image are shown on display unit (4).)

1. a kind of visual field display system, which is the visual field display system of moving body, which, which has, drives Seat, and moved along fixed course, which is characterized in that the visual field display system includes

Mobile each factor test section, detects each factor of moving body；

Shoot part, with visual field filming apparatus, at least shooting is equivalent to from the driving visual field filming apparatus on the move The field-of-view image in the visual field that seat rises；

Information treatment part is shot by each factor information detected by each factor test section of the movement and by the shoot part To image information it is associated and constitute mobile message；

Storage unit stores the mobile message；

Display unit can show image；And

Control unit makes display unit show realtime graphic based on the mobile message in moving process, based on the storage unit institute The past image of the mobile message of storage and the augmented reality image generated according to these realtime graphics and past image At least one of,

The control unit has artificial intelligence, which has learning ability, judged according to acquired mobile message It is shown in the image of the display unit,

The artificial intelligence by the auxiliary information of assisted control and can indicate in the operation information of automated state extremely Few either side is shown in the display unit.

2. visual field display system according to claim 1, which is characterized in that

The visual field display system has weather information acquisition unit, which obtains related with the position of moving body At least any one party in weather information and weather information related with mobile route,

Information treatment part is also associated with the weather information from the weather information acquisition unit and as mobile message.

3. visual field display system according to claim 1 or 2, which is characterized in that

Shoot part has fuselage filming apparatus, which shoots the predetermined portion of moving body.

4. visual field display system according to claim 1 or 2, which is characterized in that

Shoot part has surrounding filming apparatus, around this around filming apparatus shooting moving body.

5. visual field display system according to claim 1 or 2, which is characterized in that

When being moved every time along fixed course, by mobile message savings into storage unit.

6. visual field display system according to claim 1 or 2, which is characterized in that

With mobile message acquisition unit, which obtains mobile message from external information offer portion.

7. a kind of moving body comprising:

Fuselage, with driver's seat；And

Visual field display system described in any one in claim 1~6.

8. moving body according to claim 7, which is characterized in that

It is not provided in driver's seat at least for ensuring the window of field of front vision,

The visual field from driver's seat is ensured using image shown by display unit.

Technical field

The present invention relates to the visual field display system shown using the visual field from driver's seat as image and moving bodys.

Background technique

In the past, for example, the deterioration in the visual field from the driver's seat of the moving bodys such as aircraft in order to prevent, such as 1 institute of patent document Show, it is known to be defrosted by being heated to window, demisting is to improve visual technology.

Patent document 1: Japanese Unexamined Patent Publication 2012-166656 bulletin

It is only to prevent in window upper fogging, therefore, due to dense fog, weather but in the structure of above patent document 1 It is bad equal and lead to that visuality can not be improved under the undesirable situation in the visual field.

Therefore, it is necessary to even if due to dense fog, weather it is bad etc. and cause under the undesirable situation in visual field can be improved view Wild visual technology.

Summary of the invention

The present invention is to be completed in view of such a problem, and its purpose is to provide a kind of visualitys that can be improved the visual field Visual field display system and moving body.

Visual field display system described in 1st aspect is a kind of visual field display system of moving body, which, which has, drives Seat, and moved along fixed course, wherein the visual field display system includes mobile each factor test section, detection moving body Each factor；Shoot part, with visual field filming apparatus, which at least shoots to be equivalent to and drive described on the move Sail the field-of-view image in the visual field that seat rises；Information treatment part believes each factor detected by each factor test section of the movement Breath and the image information taken by the shoot part are associated and constitute mobile message；Storage unit stores the mobile letter Breath；Display unit can show image；And control unit, show that display unit based on the mobile message in moving process Realtime graphic, the past image of the mobile message stored based on the storage unit and according to these real-time images and past Image and at least one of the augmented reality image that generates, the control unit have artificial intelligence, which has Learning ability judges the image that be shown on the display unit, the artificial intelligence energy according to acquired mobile message Enough at least any one party by the operation information of the auxiliary information of assisted control and the automated state of expression are shown in institute It states on display unit.

Visual field display system described in 2nd aspect is in the visual field display system described in the 1st aspect, the visual field display system With weather information acquisition unit, the weather information acquisition unit obtain related with the position of moving body weather information and with move road At least any one party in the related weather information of line, information treatment part are also associated with from described in the weather information acquisition unit Weather information is as mobile message.

Visual field display system described in 3rd aspect is clapped in the visual field display system described in the 1st aspect or the 2nd aspect Portion is taken the photograph with fuselage filming apparatus, which shoots the predetermined portion of moving body.

4th aspect described in visual field display system the 1st aspect to the 3rd aspect in any one described in the visual field show In system, shoot part has surrounding filming apparatus, around this around filming apparatus shooting moving body.

5th aspect described in visual field display system the 1st aspect to the 4th aspect in any one described in the visual field show In system, when being moved every time along fixed course, by mobile message accumulation into storage unit.

6th aspect described in visual field display system the 1st aspect to the 5th aspect in any one described in the visual field show In system, there is mobile message acquisition unit, which obtains mobile message from external information offer portion.

Moving body described in 7th aspect includes fuselage, with driver's seat；And the 1st aspect appointing into the 6th aspect Visual field display system described in meaning one.

Moving body described in 8th aspect is not provided in driver's seat and is at least used in the moving body described in the 7th aspect The window for ensuring field of front vision ensures the visual field from driver's seat using image shown by display unit.

According to the present invention, due to showing at least one of following image, it can be improved the visuality in the visual field, this A little images are the past of realtime graphic, the mobile message stored based on storage unit based on the mobile message in moving process Image and the augmented reality image that is generated according to these realtime graphics and past image.Further, since artificial intelligence energy It is enough by the auxiliary information of assisted control and indicate in the operation information of automated state at least any one be shown in it is aobvious Show in portion, therefore can be realized the automanual manipulation manipulated according to the display and the fully automated manipulation without operator.

Detailed description of the invention

Fig. 1 is the block diagram for showing the structure of visual field display system of the aircraft of an embodiment of the invention.

Fig. 2 is the frame for showing the structure of the variation of visual field display system of the aircraft of an embodiment of the invention Figure.

Label declaration

1: visual field display system；3: storage unit；4: display unit；5: control unit；11: as flying for each factor test section of movement Each factor test section of row；12: shoot part；13: weather information acquisition unit；14: information treatment part；15: visual field filming apparatus；16: Fuselage filming apparatus；17: surrounding filming apparatus；18: artificial intelligence；21: information offer portion.

Specific embodiment

Hereinafter, the structure of a present invention will be described in detail with reference to the accompanying embodiment.

As moving body of the invention aircraft have fuselage, aircraft for example for the purpose of conveying of personnel and cargo etc., It is moved along fixed course flight, which has the cockpit as driver's seat.

The aircraft has visual field display system 1, and the visual field display system 1 is by the visual field from cockpit to have carried out various numbers Image obtained from word processing is shown.

Visual field display system 1 includes message structure portion 2, constitutes the flight information as mobile message；Storage unit 3, Store the flight information being made of the message structure portion 2；Display unit 4, display can be by operator's visuognosiss and based on winged The image of row information；And control unit 5, so that display unit 4 is selectively shown defined image.

The not set window of the cockpit of aircraft, but display unit 4 is provided on the position for be usually provided with window.That is, operator It is the image according to display unit 4 come operating aircraft.

Message structure portion 2 includes each factor test section 11 of flight as each factor test section of movement, utilizes various biographies Sensor obtains each factor of the aircraft in mobile (in-flight)；Shoot part 12 awing shoots defined image；Meteorology letter Acquisition unit 13 is ceased, weather information related with the position of aircraft and weather information related with movement (flight) route are obtained； And information treatment part 14, it will be from these fly each factor test section 11, shoot part 12 and weather information acquisition units 13 Information is suitably associated.

Each factor test section 11 that flies has the air speed inspection of the position detection part 11a of detection position, the speed for detecting fuselage The orientation angles test section 11d of the orientation angles of survey portion 11b, the height detection portion 11c of the height of detection fuselage, detection fuselage, Detect the side tilt angle test section 11f of the inhibition angle detection 11e of the inhibition angle of fuselage and the side tilt angle of detection fuselage Deng.

In addition, position detection part 11a has such as GPS (Global Positioning System: global positioning system) Etc. positioning systems and altimeter etc., detect the flight position of aircraft in-flight at any time.

Shoot part 12 includes visual field filming apparatus 15, and shooting awing is corresponded to from cockpit with the naked eye vision The field-of-view image in the visual field recognized；Fuselage filming apparatus 16 shoots the predetermined portion on the fuselage of aircraft in-flight；With And surrounding filming apparatus 17, it awing shoots around other than the visual field from cockpit.

Visual field filming apparatus 15 is the visible light camera such as digital camera, and the visual field filming apparatus 15 is in cockpit Multiple (such as 2) are respectively arranged at front side portion apart from top to bottomly, make it possible to shoot correspondence centered on the front of fuselage Field-of-view image in the visual field from cockpit.

In addition, the visible light camera in visual field filming apparatus 15 is not only, preferably in combination with such as LIDAR11g (Light Detection and Ranging: optical radar), RADAR11h (Radio Detecting and Ranging: radar) it is such Detection unit of the invisible rays such as electric wave etc. is utilized to use.

Fuselage filming apparatus 16 has the digital camera that be arranged towards each structural element, makes it possible to shoot and for example Front foot, main foot, engine, main wing, aileron, vertical tail, tailplane, passenger accommodation, cargo room such machine such as outer peripheral surface In body can not by 15 visuognosis of visual field filming apparatus to the related fuselage image of regulation structural element.

Surrounding filming apparatus 17 has the digital camera for being set to side-of-body and fuselage afterbody, makes it possible to take Such as surrounding's image in different from the field-of-view image like that direction of the side image and rear images of fuselage.

Weather information acquisition unit 13 is for example, by the measurement of various testers and the handling facility from grounds such as control towers Information etc., for flight position, flight path and suitably obtain weather, wind direction, wind speed, temperature, air pressure and seasonal variations Required weather information when equal flights.

Information treatment part 14 has the computer such as electronic calculator, by will be from each factor test section 11 of flying Each factor information, the image information from shoot part 12 and the weather information from weather information acquisition unit 13 are associated at any time, To constitute the flight information in-flight.

In addition, other than above-mentioned each structural element, being additionally provided with the detection such as various sensors in message structure portion 2 Device suitably obtains information needed for general flight.

Storage unit 3 stores the flight information constituted using information treatment part 14, and flight information is accumulated in each flight, Construct so-called big data related with each factor of flying.Alternatively, it is also possible to be accumulated in external server using by big data Structure.

Display unit 4 is by display devices such as organic electroluminescent (organic EL) displays of such as 4K resolution ratio, 8K resolution ratio It constitutes, is set to the position corresponding to window in common cockpit.Then, it is shown on the display section 4 by the control of control unit 5 Field-of-view image corresponding with flight position in-flight, fuselage image, surrounding image and weather information etc..

In addition, display unit 4 is not only arranged at cockpit, it can also be set to handling facility etc., can be set in cockpit and management The images such as identical field-of-view image are shared in applying.

Control unit 5 has network systems and the artificial intelligence (AI) 18 such as Internet of Things (IoT) system.Moreover, can be according to next Self-information processing unit 14, storage unit 3, ATC acquisition unit 19 information (for example, according to in-flight real-time flight information, tire out Long-pending past flight information (big data)) and information from LIDAR11g and RADAR11h generate fuselage operation signal, and And each structural element (example in operating aircraft as operation object can be controlled by fuselage operating system 20 as needed Such as, head, various gears, brake etc.), the ATC acquisition unit 19 obtains the information from airway traffic control.

In addition, control unit 5 controls display unit 4 by the effect of artificial intelligence 18 so that showing in manipulation more proper When image.That is, using control unit 5 by based on the flight information in-flight sent from information treatment part 14 realtime graphic, With in optimal image (image the etc. when visual field is good) in the past of the past flight information that is stored based on storage unit 3 extremely A few side is shown on display unit 4.

More specifically, by the judgement of the artificial intelligence 18 in control unit 5, suitably display is real-time on the display section 4 Image, storage unit 3 stored it is optimal in the past image, realtime graphic and it is optimal in the past this both sides of image image and It is best in augmented reality (AR) image after being overlapped a part of past image or past image on real-time image Image.Alternatively, it is also possible to be display together in a part of display unit 4 using by the auxiliary informations such as weather information and these images Structure.

Moreover, operator can the image according to display unit 4 confirmation fuselage around situation.In addition, passing through benefit Manually intelligence 18 and IoT system, operator can also carry out the manipulation inputted based on voice, also, management on the ground is set The place of applying also is able to observe that identical image in the case where being also equipped with display unit 4 at handling facility, therefore, can be according to need Carry out the auxiliary of manipulation and manipulation from handling facility.

In addition, constituting big data and accumulating flight information in each flight, artificial intelligence 18 is believed according to the flight Breath is learnt, to also more properly be controlled each structural element using control unit 5 not only to display unit 4.

Then, illustrate the effect and effect of said one embodiment.

When making above-mentioned aircraft flight, firstly, by Real-time image display on display unit 4, being detached from plane track Before plane track, operator carries out fuselage operation while the visuognosis realtime graphic.

After taking off, automatic manipulation is switched to after height, flight position as defined in reaching.In automatic manipulation, Realtime graphic, AR image are shown on display unit 4, operator can be confirmed outer in real time using the field-of-view image of display unit 4 Portion's situation.In addition, operator other than carrying out the confirmation in the visual field, is also carried out respectively in a manner of identical with common confirmation movement Kind confirmation operation.

Alternatively, it is also possible to use following structure etc.: in the case where operator is in the state for being not engaged in manipulation, i.e., Make to be not on that the visual field is bad, also the input of self-test in future unit is neatly used as the judgement material of artificial intelligence 18.

When landing, in instrument landing device (Instrument Landing System:ILS) range hereinafter, in the visual field When good usual, real-time image, AR image are shown on display unit 4, in the undesirable situation in the visual field, by past figure Picture, AR image are shown on display unit 4.In addition, in the case where so-called zero visual field, in ILS range hereinafter, utilizing artificial intelligence 18 in big data from selecting optimized image and to be shown on display unit 4, can include using AR picture construction plane track, other The visual field including airport installation, other moving bodys is simultaneously shown.Specifically, following structure etc. can also be used: aobvious Show in portion 4, the restings such as building is shown using as AR image based on past image, also, artificial intelligence 18 is by coming from The input of LIDAR11g, RADAR11h capture the mobile objects such as other aircrafts on the move, ground equipment and show them Out.

Then, operator carries out fuselage operation while the image to display unit 4 carries out visuognosis.

In this way, in a period of flying to landing from, at any time by the image information as taken by shoot part 12, by flying Each factor information and the weather information as acquired by weather information acquisition unit 13 that each factor test section 11 detects are sent to letter Processing unit 14 is ceased, each information is associated and constitutes flight information, and by flight information storage into storage unit 3.

In addition, in this way, believing in each flight using each factor of the flight for flying to landing from as the flight Breath storage is accumulated into storage unit 3, and as big data.

Moreover, there is visual field display system 1, and in a period of flying to landing from, according to view according to above-mentioned aircraft Realtime graphic, past image and AR image selection are properly shown on display unit 4 by the flying conditions such as wild each factor, therefore i.e. Make also to can be improved the visuality for manipulation in the undesirable situation in the visual field of such as dense fog etc..Therefore, it can reduce usually The deviation in the visual field generated due to meteorological condition etc., further, it is possible to reduce due to flying caused by weather is bad, the visual field is bad Limitation.

Further, since can ensure the visual field from cockpit using image shown by display unit 4, so cockpit can be made Windowlessization, the maintenance of the devices such as maintenance and the scraper plate that is set on window without the window in for example existing aircraft.

Due to visual field display system 1 in each flight by flight information accumulation into storage unit 3, can according to The related big data of the flight information of the accumulation, more appropriate image is shown on display unit 4.

Since control unit 5 has artificial intelligence 18,18 pairs of big datas accumulated of artificial intelligence can be passed through More appropriate image is shown on display unit 4 by habit ability at the time of appropriate.

Further, since flexibly artificial intelligence 18 can be also used to carry out other behaviour with the flight information accumulated The control of the structural element of work, therefore can be realized more stable navigation.

Also, by making artificial intelligence 18 learn the manipulation etc. of operator, artificial intelligence 18 can will carry out manipulation auxiliary The auxiliary information helped is shown on display unit 4, so as to realize the semiautomatic control manipulated according to the display, also, Can finally the fully automated manipulation of artificial intelligence 18 and network implementations without operator (automatic navigation) be utilized.That is, passing through utilization Visual field display system 1 can periodically switch to fully automated manipulation, can aid in and solve that undermanned (pilot is not Foot) the problems such as.

Due in visual field display system 1, additionally it is possible to display unit 4 is set to the handling facility of the grounds such as control tower, because This can share in real time and accurately the flight information centered on the visual field in handling facility and cockpit, can be realized more just When driving, additionally it is possible to when for example urgent etc. at handling facility carry out remote control.

Further, since visual field display system 1 is not only arranged at new fuselage, additionally it is possible to be set to traditional fuselage, therefore Application is good.

In this way, by importing visual field display system 1, can be played in practice from airport travel, take off on the ground, on Play the role of in whole processes of ground traveling after rising, cruise, land and landing defined.

In addition, as described above, nobody full-automatic navigation of the visual field display system 1 with artificial intelligence 18 is by authorities Approved, even full-automatic navigation can also be realized, wherein realize following function: based on by the aobvious of visual field display system 1 Show the semiautomatic control of the manipulation auxiliary of progress, monitor manipulation process to reality and based on the image of visual field display system 1 Existing occupant cultivates function, makes automatically to navigate by water the proof function of obtaining authorities and approve, approves it in the authorities automatically navigated by water So-called visual function for monitoring is carried out to automatic running using visual field display system 1 afterwards, the operation of ground facility is supervised Depending on function for monitoring and ATC communication AIization.

In addition, visual field display system 1 is configured to the movement applied to driver's seat windowlessization in said one embodiment Body, but it is not limited to such structure, it can also be aobvious using being additionally provided in fenestrate driver's seat is arranged relative to window Show that the structure in portion 4 and window play a role as display unit 4 and show the structure etc. of field-of-view image on window.In addition, being capable of benefit In the case where driving moving body with handling facilities such as control towers, display unit 4 can be set in the handling facility.

Control unit 5 is configured to be judged to show image on the display section 4 by artificial intelligence 18, but is not limited to this The structure of sample, can also be using such as flowering structure: not showing the judgement of artificial intelligence 18, but arbitrarily selects display institute by operator The image needed.

In addition, control unit 5 is not limited to the structure with artificial intelligence 18, it can also use and be not provided with artificial intelligence 18 Structure.

Although control unit 5 uses from information treatment part 14 and sends the realtime graphic based on flight information in-flight, and The structure of past image is sent from storage unit 3, but is not limited to such structure, as long as can be by realtime graphic, past Image and at least one of the AR image that is generated according to these real-time images and past image be shown in display unit 4 On structure, such as the structure that can also be also provided by storage unit 3 using realtime graphic.

Although will be from each factor test section 11 of movement, shoot part 12 and weather information acquisition unit 13 in addition, using Information is supplied to information treatment part 14, and the information from ATC acquisition unit 19, LIDAR11g and RADAR11h is supplied to control unit The structure of 5 (artificial intelligence 18), but it is not limited to such structure, as long as will be in each factor of movement using information treatment part 14 12 institute of the location information detected by position detection part 11a and shoot part in each factor information detected in test section 11 The sight field image information taken by visual field filming apparatus 15 in the image information taken is associated and constitutes flight letter The structure of breath, can appropriately respectively change by information treatment part 14 as information associated by flight information and directly it is defeated Enter to the information in control unit 5 (artificial intelligence 18).As long as that is, using information treatment part 14 by sight field image information and position The associated structure of information is obtained from mobile each factor test section 11, shoot part 12, weather information acquisition unit 13, ATC Each information in portion 19, LIDAR11g and RADAR11h at least into any one in information treatment part 14 and control unit 5, and And finally by control unit 5 for the display and various operations in display unit 4.

Artificial intelligence 18 uses the structure controlled according to the information from information treatment part 14, storage unit 3, but not It is defined in such structure.That is, variation that can also be as shown in Figure 2 is such, had using artificial intelligence 18 as mobile letter The structure of the function of acquisition unit is ceased, which obtains flight information from external information offer portion 21.

Information offer portion 21 have can store with collecting via network and the cloud of the services such as information, Yi Jijing are provided The EDGE server being connect by network with cloud.

Moreover, artificial intelligence 18 can be serviced via the EDGE for being set to each ground facility such as each airport, control tower Device and obtain various information from cloud.

Like this, by using the structure that can obtain flight information from external information offer portion 21, even if storage unit 3 The mobile message of itself preparatory not store predetermined also can obtain mobile letter from information offer portion 21 by communication when setting out Breath.In addition, being not only the aircraft itself, additionally it is possible to using from other aircrafts collect come flight information, therefore people can be utilized Work intelligence 18 carries out more appropriate control.In addition, obtaining mobile message using from external information offer portion 21 like this Structure in the case where, it is contemplated that communication barrier etc., can be using defined movement can be obtained via storage devices such as USB The structure etc. of information.

Although aircraft is illustrated as moving body in said one embodiment, as long as moving body is along rule The mobile moving body of fixed line can also be applied to such as electric car, the Shinkansen, straight other than the aircrafts such as passenger plane, cargo aircraft Railway, route car and ship of line electric motor car (LMC) etc. etc..

In addition, being the traveling of speed per hour about 500km (second speed about 140m) in the case where linear motor car.That is, system It is dynamic to need about 150 seconds, 2.5km is travelled until operating and executing, to only clap by the visual field being installed on vehicle Take the photograph the image of device 15, it is possible to can not properly be braked.It is therefore preferable that being configured on the line according between each regulation Every, for example according to every 1km digital camera, night-vision camera are set, to always show front 5km or so on the display section 4 Image.

In addition, being made of in the case where visual field display system 1 is applied to railway, route car information treatment part 14 It is made of in the case where visual field display system 1 is applied to ship information treatment part 14 as the driving information of mobile message Sail information as mobile message.

Also, the fuselage in the present invention indicates the main part of moving body, and in railway, route car etc., fuselage is indicated Vehicle, in ship, fuselage indicates hull.

In addition, the driving expression in the present invention operates the movement of moving body, also comprising manipulation.