Distance measuring system, light receiving module, and method of manufacturing band pass filter
阅读说明:本技术 测距系统、光接收模块以及制造带通滤波器的方法 (Distance measuring system, light receiving module, and method of manufacturing band pass filter ) 是由 横川创造 菊池勇辉 诹访泰介 千代田亮 于 2019-02-19 设计创作,主要内容包括:该测距系统设置有:光源单元,其向物体发射红外光;光接收单元,其接收来自物体的红外光;以及算术处理单元,其基于来自光接收单元的数据获取关于物体的距离信息,其中,包括带通滤波器的光学构件被设置在光接收单元的光接收表面侧,该带通滤波器选择性地透射规定波长范围内的红外光,并且该带通滤波器的光入射表面具有凹形。(This ranging system is provided with: a light source unit that emits infrared light to an object; a light receiving unit that receives infrared light from an object; and an arithmetic processing unit that acquires distance information on the object based on data from the light receiving unit, wherein an optical member including a band-pass filter that selectively transmits infrared light in a prescribed wavelength range and has a light incident surface having a concave shape is provided on a light receiving surface side of the light receiving unit.)
1. A ranging system, comprising:
a light source unit that emits infrared light to a target object;
a light receiving unit that receives the infrared light from the target object; and
an arithmetic processing unit that obtains information on a distance to the target object based on data from the light receiving unit,
wherein an optical member including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range is arranged on a light receiving surface side of the light receiving unit, and
the band pass filter has a concave light incident surface.
2. The ranging system according to claim 1,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter, and
an incident angle of the light at the maximum image height with respect to a light incident surface of the band-pass filter is 10 degrees or less.
3. The ranging system according to claim 1,
the half width of the transmission band of the band-pass filter is 50nm or less.
4. The ranging system according to claim 1,
the band-pass filter comprises
A first filter transparent to light in a predetermined wavelength range of infrared light, an
And a second filter opaque to visible light and transparent to infrared light.
5. The ranging system according to claim 4,
the first filter and the second filter are stacked and formed on one side of a substrate.
6. The ranging system according to claim 4,
the first filter is formed on one surface of the base material, and
the second filter is formed on the other surface of the substrate.
7. The ranging system according to claim 1,
the first filter is arranged on the light incidence surface side, and
the second filter is arranged on the light receiving unit side.
8. The ranging system according to claim 7,
the second filter has a concave shape that mimics the light incident surface.
9. The ranging system according to claim 7,
the second filter has a planar shape.
10. The ranging system according to claim 1,
the second filter is arranged on the light incidence surface side, and
the first filter is arranged on the light receiving unit side.
11. The ranging system according to claim 10,
the first filter has a concave shape that mimics the light incident surface.
12. The ranging system according to claim 1,
the light source unit includes an infrared laser element or an infrared light emitting diode element.
13. The ranging system according to claim 1,
the light source unit emits infrared light having a center wavelength of about 850nm, about 905nm, or about 940 nm.
14. The ranging system according to claim 1,
the arithmetic processing unit obtains distance information based on a time of flight of light reflected from the target object.
15. The ranging system according to claim 1,
the infrared light is emitted to the target object in a predetermined pattern, and
the arithmetic processing unit obtains distance information based on a pattern of light reflected from the target object.
16. A light receiving module comprising:
a light receiving unit that receives infrared light; and
an optical member arranged on a light receiving surface side of the light receiving unit and including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range,
wherein the band pass filter has a concave light incident surface.
17. The light receiving module of claim 16,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter.
18. The light receiving module of claim 17,
an incident angle of the light at the maximum image height with respect to a light incident surface of the band-pass filter is 10 degrees or less.
19. A method of manufacturing a bandpass filter, the method comprising:
forming a band-pass filter layer on a diaphragm that is transparent to at least an infrared light component and undergoes plastic deformation;
placing the diaphragm on which the band-pass filter layer has been formed on a mold in which a recess is formed on one surface and an opening is formed through from the recess to the other surface; and is
Air in the recess is sucked from the other surface through the opening.
20. The method of manufacturing a bandpass filter according to claim 19, the method further comprising:
dividing the diaphragm on which the band-pass filter layer has been formed into a predetermined shape including a concave surface formed by sucking air in the concave portion.
Technical Field
The present disclosure relates to a ranging system, a light receiving module, and a method of manufacturing a band pass filter.
Background
In recent years, a ranging system has been proposed in which information on a distance to a target object is obtained by emitting light to the target object and receiving reflected light (for example, see patent document 1). The configuration of emitting infrared light and receiving reflected light to obtain distance information has advantages, for example, the light source is not very noticeable, and the operation can be performed in parallel with capturing a normal visible light image.
In terms of reducing the interference affecting the measurement, it is preferable to limit the wavelength range of infrared light as the electromagnetic wavelength to be imaged as narrow as possible. For this reason, a band-pass filter transparent only to a specific wavelength band is generally disposed in front of the imaging element.
Reference list
Patent document
Patent document 1: japanese patent application laid-open No. 2017-150893
Disclosure of Invention
Problems to be solved by the invention
In order to cope with the reduction in height of the housing of the electronic apparatus, the light receiving module or the like used in the portable electronic apparatus is forced to have a configuration of an optical system having a so-called pupil correction in which a principal ray angle greatly differs between the center and the periphery of the imaging element. The band characteristic of the band pass filter shifts in the wavelength direction according to the angle of incident light. Therefore, in order to receive the target light without difficulty in the center and the periphery of the light receiving unit including the imaging element and the like, it is necessary to set the bandwidth of the band pass filter to be wider than the normal bandwidth. This results in an increased influence of disturbing light.
Accordingly, an object of the present disclosure is to provide a ranging system, a light receiving module, and a method of manufacturing a band pass filter, which enable setting a narrow bandwidth for the band pass filter and reducing the influence of disturbance light.
Solution to the problem
In order to achieve the above object, a ranging system according to the present disclosure includes:
a light source unit that emits infrared light to a target object;
a light receiving unit that receives infrared light from a target object; and
an arithmetic processing unit that obtains information on a distance to the target object based on the data from the light receiving unit,
wherein an optical member including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range is arranged on a light receiving surface side of the light receiving unit, and
the band-pass filter has a concave light incident surface.
In order to achieve the above object, a light receiving module according to the present disclosure includes:
a light receiving unit that receives infrared light; and
an optical member arranged on a light receiving surface side of the light receiving unit and including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range,
wherein the band pass filter has a concave light incident surface.
In order to achieve the above object, a method of manufacturing a band pass filter according to the present disclosure includes:
forming a band-pass filter layer on a diaphragm that is transparent to at least an infrared light component and undergoes plastic deformation;
placing the diaphragm on which the band-pass filter layer has been formed on a mold in which a recess is formed on one surface and an opening passing from the recess to the other surface is formed; and is
Air in the recess is sucked from the other surface through the opening.
Drawings
Fig. 1 is a schematic diagram showing a basic configuration of a ranging system according to a first embodiment of the present disclosure.
Fig. 2 is a schematic view showing a configuration of an optical member in the distance measuring system of the reference example.
Fig. 3A is a schematic diagram showing a relationship between an image height and an angle with respect to a principal ray angle (CRA) in an optical member of a reference example. Fig. 3B is a schematic diagram showing characteristics of a band-pass filter in the optical member of the reference example.
Fig. 4A is a schematic view showing the configuration of an optical member in the distance measuring system according to the first embodiment. Fig. 4B is a schematic diagram showing the characteristics of the band-pass filter in the optical member according to the first embodiment.
Fig. 5 is a schematic diagram showing the relationship between the wavelength shift and the angle relative to the CRA in the bandpass filter.
Fig. 6A and 6B are schematic diagrams showing the configuration of a band-pass filter. Fig. 6C is a diagram showing the characteristics of the band-pass filter.
Fig. 7A is a schematic diagram showing the characteristics of the first filter. Fig. 7B is a diagram showing the characteristics of the second filter.
Fig. 8 is a diagram showing a configuration example of the first filter, and fig. 8A is a table showing a stacking relationship. Fig. 8B shows the transmission characteristics of the filter.
Fig. 9 is a diagram showing a configuration example of the second filter, and fig. 9A is a table showing a stacking relationship. Fig. 9B shows the transmission characteristics of the filter.
Fig. 10A, 10B, 10C, and 10D are schematic diagrams illustrating a first method of manufacturing a band pass filter.
Fig. 11A, 11B, 11C, and 11D are schematic diagrams illustrating a second method of manufacturing a band pass filter.
Fig. 12A, 12B, and 12C are schematic diagrams showing another configuration example of the band-pass filter.
Fig. 13A, 13B, 13C, and 13D are schematic diagrams illustrating a third method of manufacturing a bandpass filter.
Fig. 14A, 14B, 14C, and 14D are schematic diagrams illustrating a fourth method of manufacturing a band pass filter.
Fig. 15 is a schematic view showing a configuration of a sheet used in a fifth method of manufacturing a band-pass filter.
Fig. 16A, 16B, and 16C are schematic diagrams illustrating vacuum formation in a fifth method of manufacturing a bandpass filter.
Fig. 17 is a schematic view showing a press working in a fifth method of manufacturing a band pass filter.
Fig. 18A and 18B are schematic views showing a method of manufacturing a light receiving module.
Fig. 19A and 19B are schematic diagrams showing the structure of a light receiving module.
Fig. 20 is a schematic view showing the structure of a light receiving module including a lens.
Fig. 21A, 21B, and 21C are schematic diagrams showing the configuration of a semiconductor device used in a ranging system.
Fig. 22 is a schematic diagram showing a first modification of the distance measuring system.
Fig. 23 is a schematic diagram showing a second modification of the distance measuring system.
Fig. 24 is a schematic diagram showing a third modification of the distance measuring system.
Fig. 25 is a schematic view showing a fourth modification of the distance measuring system.
Fig. 26A and 26B are schematic diagrams showing an example of the arrangement of a light receiving unit and a light source unit in a portable electronic apparatus.
Fig. 27 is a block diagram showing an example of a schematic configuration of a vehicle control system.
Fig. 28 is an explanatory view showing an example of the mounting positions of the vehicle exterior information detector and the imaging unit.
Fig. 29 is a diagram showing an example of a schematic configuration of an endoscopic surgery system.
Fig. 30 is a block diagram showing an example of the functional configuration of the camera head and CCU shown in fig. 29.
Detailed Description
The present disclosure will be described below based on embodiments with reference to the accompanying drawings. The present disclosure is not limited to the embodiments, and various numerical values, materials, and the like in the embodiments are examples. In the following description, the same elements or elements having the same function will be denoted by the same reference numerals without redundant description. Note that description will be made in the following order.
1. General description of ranging system and light receiving module according to the present disclosure
2. First embodiment
3. First modification
4. Second modification example
5. Third modification example
6. Fourth modification example
7. First application example
8. Second application example
9. Arrangements of the present disclosure
[ general description of ranging system and light receiving module according to the present disclosure ]
As described above, the ranging system according to the present disclosure includes:
a light source unit that emits infrared light to a target object;
a light receiving unit that receives infrared light from a target object; and
an arithmetic processing unit that obtains information on a distance to the target object based on the data from the light receiving unit,
wherein an optical member including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range is arranged on a light receiving surface side of the light receiving unit, and
the band-pass filter has a concave light incident surface.
The ranging system according to the present disclosure may have a configuration in which,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter, and
the light at the maximum image height has an incident angle of 10 degrees or less with respect to a light incident surface of the band-pass filter.
The ranging system of the present disclosure, including the above-described preferred configuration, may have a configuration in which,
the half width of the transmission band of the band-pass filter is 50nm or less.
The ranging system of the present disclosure, including the various preferred configurations described above, may have a configuration in which,
the band-pass filter comprises
A first filter transparent to light in a predetermined wavelength range of infrared light, an
And a second filter opaque to visible light and transparent to infrared light.
In this case, the mobile station, in the configuration,
the first filter and the second filter may be stacked and formed on one side of the substrate.
Optionally, in a configuration,
the first filter may be formed on one surface of the substrate, and
the second filter may be formed on the other surface of the substrate.
The ranging system of the present disclosure, including the various preferred configurations described above, may have a configuration in which,
the first filter is arranged on the light incidence surface side, and
the second filter is arranged on the light receiving unit side.
In this case, the second filter may have a concave shape imitating the light incident surface in the configuration. Alternatively, the second filter may have a planar shape in configuration.
Optionally, in a configuration,
the second filter may be arranged on the light incident surface side, and
the first filter may be disposed on the light receiving unit side.
In this case, the first filter may have a concave shape imitating the light incident surface in the configuration.
The ranging system of the present disclosure, including the various preferred configurations described above, may have a configuration in which,
the light source unit includes an infrared laser element or an infrared light emitting diode element.
The ranging system of the present disclosure, including the various preferred configurations described above, may have a configuration in which,
the light source unit emits infrared light having a center wavelength of about 850nm, about 905nm, or about 940 nm.
The ranging system of the present disclosure, including the various preferred configurations described above, may have a configuration in which,
the arithmetic processing unit obtains distance information based on a time of flight of light reflected from the target object.
Optionally, in a configuration,
the infrared light may be emitted to the target object in a predetermined pattern, and
the arithmetic processing unit may obtain the distance information based on a pattern of light reflected from the target object.
As described above, the light receiving module according to the present disclosure includes:
a light receiving unit that receives infrared light; and
an optical member arranged on a light receiving surface side of the light receiving unit and including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range,
wherein the band pass filter has a concave light incident surface.
The light receiving module according to the present disclosure may have a configuration in which,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter. In this case, in this configuration, the incident angle of the light at the maximum image height with respect to the light incident surface of the band-pass filter may be 10 degrees or less.
As described above, the method of manufacturing a band pass filter according to the present disclosure includes:
forming a band-pass filter layer on a diaphragm that is transparent to at least an infrared light component and undergoes plastic deformation;
placing the diaphragm on which the band-pass filter layer has been formed on a mold in which a recess is formed on one surface and an opening passing from the recess to the other surface is formed; and is
Air in the recess is sucked from the other surface through the opening.
The method of manufacturing a band pass filter according to the present disclosure may have a configuration in which,
the diaphragm on which the band-pass filter layer has been formed is divided into a predetermined shape including a concave surface formed by sucking air in the concave portion.
In the ranging system and the light receiving module of the present disclosure including the various preferred configurations described above, for example, a photoelectric conversion element or an imaging element (such as a CMOS sensor or a CCD sensor in which pixels including various pixel transistors are arranged in a two-dimensional matrix in a row direction and a column direction) may be used as the light receiving unit.
In the ranging system of the present disclosure including the various preferred configurations described above, it is possible to have a configuration in which an arithmetic processing unit that obtains information on the distance to the target object based on data from the light receiving unit operates based on physical connection by hardware, or operates based on a program. The same applies to a controller or the like controlling the entire ranging system.
[ first embodiment ]
The first embodiment relates to a ranging system and a light receiving module according to the present disclosure.
Fig. 1 is a schematic diagram showing a basic configuration of a ranging system according to a first embodiment of the present disclosure.
The ranging system 1 includes:
a
a
an
An
The
The
The wavelength of the infrared light emitted by the
The
The receiving system 1 may be configured as one unit to be suitable for being built in, for example, a device, or may be configured separately.
The basic configuration of the ranging system 1 has been described above. Next, in order to facilitate understanding of the present disclosure, a reference example of a configuration in which a band-pass filter has a planar light incident surface and a problem thereof will be described.
Fig. 2 is a schematic diagram showing a configuration of an optical member in the ranging system of the reference example.
The optical member 90 of the reference example is different from the
Fig. 3A is a schematic diagram showing a relationship between an image height and an angle with respect to a principal ray angle (CRA) in the optical member of the reference example. Fig. 3B is a schematic diagram showing characteristics of a band-pass filter in the optical member of the reference example.
For example, in the case where the lens is configured to cope with the height reduction, the lens is forced to have a configuration in which the chief ray angle greatly differs between the central portion and the peripheral portion of the
Therefore, the incident angle of light with respect to the band-pass filter 92 also changes by about 30 degrees in the case where light is incident on the central portion of the light-receiving
Therefore, for example, in the case where the reception target is infrared light whose center wavelength is 905nm, it is necessary to set the band center of the band pass filter 92 to a wavelength longer than 905nm in the case where the angle with respect to the CRA is 0. Further, it is also necessary to set the bandwidth so as to transmit 905nm even in the case where the angle with respect to the CRA is 0 to 30 degrees. Therefore, it is necessary to set the bandwidth of the band-pass filter 92 to be wider than the normal bandwidth. This results in an increased influence of disturbances such as those involving ambient light.
The reference example of the configuration in which the band-pass filter has the planar light incident surface and the problem thereof have been described above.
Subsequently, the first embodiment will be described.
Fig. 4A is a schematic diagram showing the configuration of an optical member in the ranging system according to the first embodiment. Fig. 4B is a schematic diagram showing the characteristics of the band-pass filter in the optical member according to the first embodiment.
As shown in fig. 4A, the band-
Therefore, for example, in the case where the reception target is infrared light whose center wavelength is 905nm, the band center of the band-
Fig. 5 is a schematic diagram showing the relationship between the wavelength shift and the angle relative to the CRA in the bandpass filter. More specifically, the shift amount of the value on the short wavelength side and the shift amount of the value on the long wavelength side of the transmission band of the band-
According to fig. 5, the transmission band of the band-
The band-
Fig. 6A and 6B are schematic diagrams showing the configuration of a band-pass filter. Fig. 6C is a diagram showing the band-pass filter characteristics.
Fig. 6A shows a configuration example in which the
Fig. 7A is a schematic diagram showing the characteristics of the first filter. Fig. 7B is a diagram showing the characteristics of the second filter.
The optical filter may be constituted by, for example, a multilayer film in which a high refractive index material and a low refractive index material are appropriately stacked. However, in the case where the optical filter is designed so that the wavelength band including the target light may have the transmission characteristics, even light having, for example, a frequency having a multiplication relation exhibits some transmission characteristics. Therefore, as shown in fig. 7A, the characteristic of the
Fig. 8 is a diagram showing a configuration example of the first filter, and fig. 8A is a table showing a stacking relationship. Fig. 8B shows the transmission characteristics of the filter.
In this example, the
Fig. 9 is a diagram showing a configuration example of the second filter, and fig. 9A is a table showing a stacking relationship. Fig. 9B shows the transmission characteristics of the filter.
In this example, the
Known methods such as CVD, PDV, ALD can be used as a method for forming a multilayer film, and ALD having advantages such as high-precision film formation and good coverage is preferably selected.
The
Fig. 10A, 10B, 10C, and 10D are schematic diagrams illustrating a first method of manufacturing a band pass filter.
A base material 13 (see fig. 10A) composed of a material transparent to infrared light and having a concave surface formed on a surface is prepared, and a
Note that, in the above example, the
Fig. 11A, 11B, 11C, and 11D are schematic diagrams illustrating a second method of manufacturing a band pass filter.
This example is similar to the process flow described with reference to fig. 10 except for the difference that the
In the above configuration, the
Fig. 12A, 12B, and 12C are schematic diagrams showing another configuration example of the band-pass filter.
In fig. 12A and 12B, the
Fig. 13A, 13B, 13C, and 13D are schematic diagrams illustrating a third method of manufacturing a bandpass filter.
A
Note that, in the above example, the
Fig. 14A, 14B, 14C, and 14D are schematic diagrams illustrating a fourth method of manufacturing a band pass filter.
This example is similar to the process flow described with reference to fig. 14 except for the difference that the
Fig. 15, 16A, 16B, 16C, and 17 are drawings illustrating a fifth method of manufacturing a band pass filter.
Fig. 15 is a schematic diagram showing the configuration of the
Note that the antireflection film 12D may be vapor-deposited first on the diaphragm 15A, and then the
Fig. 16A, 16B, and 16C are schematic diagrams illustrating vacuum forming in a fifth method of manufacturing a bandpass filter. A suction die 16 (mold) is prepared, in which a concave portion 16A having a predetermined curvature is formed on one surface, and an
Fig. 17 is a schematic view showing a press working in a fifth method of manufacturing a band pass filter. The
By using the fifth manufacturing method, the band-pass filter layer can be vapor-deposited on the planar film, so that the band-pass filter layer can be vapor-deposited uniformly and the manufacturing cost can be reduced.
The
Fig. 18A and 18B are schematic views illustrating a method of manufacturing a light receiving module. Fig. 19A and 19B are schematic diagrams illustrating the structure of a light receiving module.
A semiconductor wafer 200 having a plurality of imaging elements formed thereon, a wafer-shaped frame 140 having an opening formed therein corresponding to a light receiving surface, and a wafer 120 having a plurality of band-pass filters formed thereon are stacked (see fig. 18A), and then diced and divided into chips having a predetermined shape (see fig. 18B). Fig. 19A shows a cross section of a singulated chip.
In some cases, in configurations, the frame 140 having the opening may be replaced with an adhesive member having no opening. Fig. 19B shows a cross section of a singulated chip having such a configuration.
Fig. 20 shows an example of a light receiving module further including a lens. In this configuration, the chip and the lens manufactured as described above are incorporated in the housing.
The method of manufacturing the light receiving module and the like have been described above.
As described above, the
Subsequently, acquisition of the distance information will be described. In the ranging system 1 shown in fig. 1, the
[ first modification ]
Fig. 22 shows a configuration in which distance information is obtained based on the time of flight of reflected light. In the distance measuring system 1A, the light diffusion member 71 is arranged in front of the
[ second modification ]
Fig. 23 also shows a configuration in which distance information is obtained based on the time of flight of reflected light. In the ranging
[ third modification ]
Fig. 24 shows a configuration in which infrared light is emitted to a target object in a predetermined pattern, and the
[ fourth modification ]
Fig. 25 shows a configuration in which stereoscopic information is also obtained by arranging a plurality of light receiving units at a distance from each other. Note that the configuration may be any one of the following configurations: a configuration of emitting diffused light as in the first modification, a configuration of scanning light from a light source as in the second modification, or a configuration of emitting light in a predetermined pattern as in the third modification. Fig. 26A and 26B are schematic diagrams showing an example of the arrangement of a light receiving unit and a light source unit in the case where the light receiving unit and the light source unit are provided in a portable electronic apparatus.
In the first embodiment, the band of the band-pass filter can be narrowed, and the influence of disturbance light can be reduced. Therefore, high-quality range-finding imaging can be achieved even under external light. Further, by setting the shape of the band pass filter according to the lens module, a light receiving module having excellent wavelength selectivity can be provided.
[ first application example ]
The techniques according to the present disclosure may be applied to a variety of products. For example, the techniques according to the present disclosure may be implemented as a device mounted on any type of moving object, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobile, an airplane, a drone, a ship, a robot, a construction machine, or an agricultural machine (tractor).
Fig. 27 is a block diagram showing a schematic configuration example of a vehicle control system 7000, which vehicle control system 7000 is an example of a moving object control system to which the technique according to the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. In the example shown in fig. 27, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 that connects the plurality of control units may be, for example, a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Local Area Network (LAN), or an in-vehicle communication network conforming to an optional standard such as FlexRay (registered trademark).
Each control unit includes: a microcomputer that performs arithmetic processing according to various programs; a storage unit that stores a program executed by the microcomputer, parameters for various calculations, and the like; and a drive circuit that drives a device on which various controls are performed. Each control unit includes a network interface for performing communication with another control unit via the communication network 7010, and also includes a communication interface for performing wired or wireless communication with devices, sensors, and the like inside or outside the vehicle. Fig. 27 shows a functional configuration of an integrated control unit 7600, which includes a microcomputer 7610, a general-purpose communication interface 7620, an exclusive communication interface 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device interface 7660, an audio/image output unit 7670, an in-vehicle network interface 7680, and a storage unit 7690. In a similar manner, the other control units also include a microcomputer, a communication interface, a storage unit, and the like.
The drive system control unit 7100 controls the operation of devices related to the drive system of the vehicle according to various programs. For example, the drive system control unit 7100 functions as a device for controlling a driving force generating device (such as an internal combustion engine or a drive motor) for generating a driving force of a vehicle, a driving force transmitting mechanism for transmitting the driving force to wheels, a steering mechanism that adjusts a steering angle of the vehicle, a brake device that generates a braking force of the vehicle, and the like. The drive system control unit 7100 may have a function as a device for controlling an anti-lock brake system (ABS), an Electronic Stability Control (ESC), or the like.
The drive system control unit 7100 is connected to a vehicle state detector 7110. The vehicle state detector 7110 includes, for example, a gyro sensor that detects an angular velocity of shaft rotation of the vehicle body; an acceleration sensor that detects an acceleration of the vehicle; or at least one of sensors for detecting an operation amount of an accelerator pedal, an operation amount of a brake pedal, a steering angle of a steering wheel, an engine speed, a wheel rotation speed, and the like. The drive system control unit 7100 performs arithmetic processing using a signal input from the vehicle state detector 7110, and controls an internal combustion engine, a drive motor, an electric power steering device, a brake device, and the like.
The system control unit 7200 controls the operations of various devices mounted on the vehicle body according to various programs. For example, the system control unit 7200 functions as a device for controlling a keyless entry system, a smart key system, a power window device, or various lamps (such as a headlamp, a backlight, a brake lamp, a flasher, or a fog lamp). In this case, radio waves transmitted from the portable device in place of the key or signals from various switches may be input to the body system control unit 7200. The body system control unit 7200 receives input of these radio waves or signals, and controls a door lock device, a power window device, a lamp, and the like of the vehicle.
The battery control unit 7300 controls the secondary battery 7310 as a power source for driving the motor according to various programs. For example, information such as a battery temperature, a battery output voltage, or a battery remaining capacity is input to the battery control unit 7300 from a battery device including the secondary battery 7310. Battery control unit 7300 performs arithmetic processing using these signals, and performs temperature adjustment control of secondary battery 7310 or control of a cooling device or the like included in the battery device.
The off-vehicle information detecting unit 7400 detects information outside the vehicle on which the vehicle control system 7000 is mounted. For example, the vehicle exterior information detecting unit 7400 is connected to at least one of the imaging unit 7410 or the vehicle exterior information detector 7420. The imaging unit 7410 includes at least one of a time-of-flight (ToF) camera, a stereo camera, a monocular camera, an infrared camera, and another camera. The off-vehicle information detector 7420 includes, for example, at least one of an environment sensor for detecting the current weather or climate or an ambient information detection sensor for detecting another vehicle, an obstacle, a pedestrian, or the like in the surroundings of the vehicle on which the vehicle control system 7000 is mounted.
The environmental sensor may be, for example, at least one of a raindrop sensor that detects rainy weather, a fog sensor that detects fog, a sunshine sensor that detects the degree of sunshine, and a snow sensor that detects snowfall. The ambient information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR ("light detection and ranging" or "laser imaging detection and ranging") device. These imaging unit 7410 and off-board information detector 7420 may each be provided as an independent sensor or device, or may be provided as an integrated device including a plurality of sensors or devices.
Here, fig. 28 shows an example of the mounting positions of the imaging unit 7410 and the vehicle exterior information detector 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at least one of a front nose, side mirrors, a rear bumper, a rear door, and a top of a windshield in the vehicle interior of the vehicle 7900. The imaging unit 7910 provided at the front nose of the vehicle interior and the imaging unit 7918 provided at the top of the windshield mainly acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 provided at the side view mirror mainly acquire an image of a side view from the vehicle 7900. The imaging unit 7916 provided at the rear bumper or the rear door mainly acquires an image behind the vehicle 7900. The imaging unit 7918 provided at the top of the windshield inside the vehicle is mainly used to detect a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, and the like.
Note that fig. 28 shows an example of an imaging range of each of the imaging units 7910, 7912, 7914, and 7916. The imaging range a represents an imaging range of the imaging unit 7910 provided at the nose, the imaging ranges b and c represent imaging ranges of the imaging units 7912 and 7914 provided at the side mirrors, respectively, and the imaging range d represents an imaging range of the imaging unit 7916 provided at the rear bumper or the rear door. For example, by superimposing a plurality of image data captured by the imaging units 7910, 7912, 7914, and 7916, an overhead image of the vehicle 7900 viewed from above can be obtained.
The off-vehicle information detectors 7920, 7922, 7924, 7926, 7928, and 7930 disposed at the front, rear, sides, and corners of the vehicle 7900 and at the top of the windshield inside the vehicle may be, for example, ultrasonic sensors or radar devices. The off-vehicle information detectors 7920, 7926 and 7930 disposed at the tops of the front nose, rear bumper, rear door and windshield inside the vehicle 7900 may be, for example, LIDAR devices. These vehicle exterior information detectors 7920 to 7930 are mainly used for detecting a preceding vehicle, a pedestrian, an obstacle, and the like.
Returning to fig. 27, the description will be continued. The vehicle exterior information detecting unit 7400 causes the imaging unit 7410 to capture an image of the outside of the vehicle, and receives the captured image data. Further, the vehicle exterior information detection unit 7400 receives detection information from the connected vehicle exterior information detector 7420. When the vehicle exterior information detector 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the vehicle exterior information detection unit 7400 transmits ultrasonic waves, electromagnetic waves, or the like, and receives information from the received reflected waves. The vehicle exterior information detecting unit 7400 may perform object detection processing or distance detection processing of a person, a car, an obstacle, a sign, a character on a road surface, or the like based on the received information. The vehicle exterior information detecting unit 7400 may perform an environment recognition process for recognizing rainfall, fog, road surface conditions, and the like based on the received information. The vehicle exterior information detecting unit 7400 may calculate a distance to an object outside the vehicle based on the received information.
Further, the vehicle exterior information detecting unit 7400 may perform image recognition processing or distance detection processing for recognizing a person, a car, an obstacle, a sign, a character on a road surface, or the like based on the received image data. The vehicle exterior information detecting unit 7400 may also generate an overhead image or a panoramic image by performing processing such as distortion correction or positioning on the received image data, and generating a composite image from a plurality of pieces of image data captured by different imaging units 7410. The vehicle exterior information detecting unit 7400 may perform viewpoint conversion processing using a plurality of image data captured by different imaging units 7410.
The in-vehicle information detection unit 7500 detects information inside the vehicle. The in-vehicle information detection unit 7500 is connected to a driver state detector 7510 that detects the state of the driver, for example. The driver state detector 7510 may include a camera that captures an image of the driver, a bio sensor that detects bio information of the driver, a microphone that collects sound in the interior of the vehicle, and the like. The biosensor is provided at, for example, a seat surface, a steering wheel, or the like, and detects biological information of an occupant seated on the seat or a driver holding the steering wheel. Based on the detection information input from the driver state detector 7510, the in-vehicle information detection unit 7500 may calculate the degree of fatigue or the degree of concentration of the driver, or determine whether the driver has fallen asleep. The in-vehicle information detection unit 7500 can perform processing such as noise removal processing on the signal of the collected sound.
The integrated control unit 7600 controls the overall operation in the vehicle control system 7000 according to various programs. The integrated control unit 7600 is connected to the input unit 7800. The input unit 7800 includes devices that can be used by the occupant to perform input operations, such as a touch panel, buttons, a microphone, switches, a joystick, and the like. Data obtained by voice recognition of voice input via the microphone may be input to the integrated control unit 7600. The input unit 7800 may be a remote control device using infrared rays or other radio waves, for example, or may be an externally connected device such as a mobile phone or a Personal Digital Assistant (PDA) that may be used to operate the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the occupant may input information through gestures. Alternatively, the data to be input may be obtained by detecting a motion of a wearable appliance worn by the occupant. Further, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the occupant or the like using the above-described input unit 7800, and outputs the input signal to the integrated control unit 7600. Through the operation input unit 7800, the occupant or the like inputs various types of data to the vehicle control system 7000 or gives instructions regarding processing operations.
The storage unit 7690 may include a Read Only Memory (ROM) for storing various programs executed by the microcomputer and a Random Access Memory (RAM) for storing various parameters, calculation results, sensor values, and the like. Further, the storage unit 7690 may include a magnetic storage device such as a Hard Disk Drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.
The universal communication interface 7620 is a universal communication interface that mediates communications with various types of devices present in the external environment 7750. The generic communication interface 7620 may implement a cellular communication protocol such as global system for mobile communications (GSM) (registered trademark), WiMAX, Long Term Evolution (LTE), or LTE-a advanced (LTE-a), or another wireless communication protocol such as wireless LAN (also known as Wi-Fi (registered trademark)) or bluetooth (registered trademark). The generic communication interface 7620 may connect to devices (e.g., application servers or control servers) residing on an external network (e.g., the internet, a cloud network, or an operator private network) via, for example, a base station or access point. Further, the universal communication interface 7620 may be connected to terminals present in the vicinity of the vehicle (e.g., terminals of drivers, pedestrians, or shops, or Machine Type Communication (MTC) terminals), for example, using a point-to-point (P2P) technology.
The proprietary communication interface 7630 is a communication interface that supports communication protocols designed for use in vehicles. The dedicated communication interface 7630 may implement, for example, a standard protocol such as Wireless Access (WAVE) in a vehicular environment, which is a combination of lower IEEE802.11p and upper IEEE1609, Dedicated Short Range Communication (DSRC), or a cellular communication protocol. The dedicated communication interface 7630 generally performs V2X communication, which V2X communication is a concept including at least one of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.
For example, the positioning unit 7640 receives a Global Navigation Satellite System (GNSS) signal from a GNSS satellite (e.g., receives a Global Positioning System (GPS) signal from a GPS satellite), performs positioning, and generates position information including latitude, longitude, and altitude of the vehicle. Note that the positioning unit 7640 may specify the current position by exchanging signals with a wireless access point, or may acquire position information from a terminal such as a mobile phone, PHS, or smart phone having a positioning function.
For example, the beacon receiving unit 7650 receives radio waves or electromagnetic waves transmitted from a wireless station or the like installed on a road to acquire information such as a current location, traffic congestion, traffic halt, or required time. Note that the function of the beacon receiving unit 7650 may be included in the dedicated communication interface 7630 described above.
The in-vehicle device interface 7660 is a communication interface that mediates a connection between the microcomputer 7610 and various types of in-vehicle devices 7760 existing inside the vehicle. The in-vehicle device interface 7660 may establish a wireless connection using a wireless communication protocol such as wireless LAN, bluetooth (registered trademark), Near Field Communication (NFC), or wireless usb (wusb). Further, the in-vehicle device interface 7660 may establish a wired connection such as a Universal Serial Bus (USB), a high-definition multimedia interface (HDMI) (registered trademark), or a mobile high-definition link (MHL) via a connection terminal (not shown) (and a cable, if necessary). The in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device owned by an occupant or an information device carried in or attached to a vehicle. In addition, the in-vehicle device 7760 may include a navigation device that searches for a route to an optional destination. The in-vehicle device interface 7660 exchanges a control signal or a data signal with the in-vehicle device 7760.
The in-vehicle network interface 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network interface 7680 transmits and receives a signal or the like based on a predetermined protocol supported by the communication network 7010.
The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 according to various programs, based on information acquired via at least one of the general communication interface 7620, the special communication interface 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device interface 7660, and the in-vehicle network interface 7680. For example, the microcomputer 7610 may calculate a control target value of a driving force generation device, a steering mechanism, or a brake device based on information acquired from the inside and outside of the vehicle, and output a control command to the drive system control unit 7100. For example, the microcomputer 7610 may perform cooperative control for the purpose of realizing the function of an Advanced Driver Assistance System (ADAS) including collision avoidance or impact mitigation of the vehicle, follow-up running based on the inter-vehicle distance, vehicle speed hold running, vehicle collision warning, vehicle lane departure warning, and the like. Further, the microcomputer 7610 can perform cooperative control for the purpose of automatic operation (i.e., automatic driving without an operation by the driver) or the like by controlling a driving force generation device, a steering mechanism, a brake device, and the like based on information acquired from the periphery of the vehicle.
The microcomputer 7610 may generate information on a three-dimensional distance between the vehicle and an object such as a structure or a person in the periphery of the vehicle based on information acquired via at least one of the general communication interface 7620, the special communication interface 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device interface 7660, and the in-vehicle network interface 7680, and create local map information including information in the periphery of the current position of the vehicle. Further, the microcomputer 7610 can predict a danger such as a vehicle collision, approaching a pedestrian, or the like, or entering a closed road based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal for generating a warning sound or lighting a warning lamp.
The audio/image output unit 7670 transmits at least one of the audio output signal and the image output signal to an output device capable of visually or aurally notifying an occupant in the vehicle or outside the vehicle of information. In the example of fig. 27, an audio speaker 7710, a display unit 7720, and a dashboard 7730 are shown as output devices. The display unit 7720 may include, for example, at least one of an in-vehicle display and a flat-view display. The display unit 7720 may have an Augmented Reality (AR) display function. In addition to these devices, the output device may be another device, such as a headset, a wearable device (such as a glasses-type display worn by the occupant), a projector, or a light. In the case where the output device is a display device, the display device visually displays results obtained from various types of processing performed by the microcomputer 7610 or information received from another control unit in various forms such as text, images, tables, or graphs. Further, in the case where the output device is an audio output device, the audio output device converts an audio signal including reproduced audio data, acoustic data, and the like into an analog signal, and audibly outputs the analog signal.
Note that in the example shown in fig. 27, at least two control units connected via the communication network 7010 may be integrated into one control unit. Alternatively, each control unit may comprise a plurality of control units. Furthermore, the vehicle control system 7000 may comprise a further control unit (not shown). Furthermore, in the above description, some or all of the functions performed by one of the control units may be provided to the other control unit. That is, predetermined arithmetic processing may be performed by any control unit as long as information is transmitted and received via the communication network 7010. Similarly, a sensor or a device connected to any control unit may be connected to another control unit, and a plurality of control units may transmit and receive detection information to and from each other via the communication network 7010.
The technique according to the present disclosure can be applied to an imaging unit such as the vehicle exterior information detection unit in the above-described configuration.
[ second application example ]
The techniques according to the present disclosure may be applied to a variety of products. For example, techniques according to the present disclosure may be applied to endoscopic surgical systems.
Fig. 29 is a diagram showing an example of a schematic configuration of an
In endoscopic surgery, a plurality of tubular fenestration instruments, called trocars 5025 a-5025 d, are used to pierce the abdominal wall, rather than cutting and opening the abdominal wall. Then, the
An image of a surgical site in a body cavity of a
(support arm device)
The
(endoscope)
The
The
The
Note that the
(various devices mounted on the cart)
The CCU5039 is constituted by a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and the like, and integrally controls the operations of the
The CCU5039 controls the
The
The arm control means 5045 is constituted by a processor such as a CPU, for example, and operates according to a predetermined program to control the driving of the arm 5031 supporting the
The
The type of the
Alternatively, the
The treatment
Particular feature configurations of the endoscopic
(support arm device)
The
The
For example, the position and orientation of the
Further, in the case of the force application control, so-called power assist control may be performed in which the arm control means 5045 receives an external force from the user and drives the actuators of the corresponding
Here, generally, the
Note that the
(light source device)
The
Further, the driving of the
Further, the
(Camera head and CCU)
The functions of the
Referring to fig. 30, the
First, a functional configuration of the
The imaging unit 5009 is constituted by an imaging element, and is arranged at a stage subsequent to the lens unit 5007. Observation light having passed through the lens unit 5007 is focused on a light receiving surface of the imaging element, and an image signal corresponding to an observation image is generated by photoelectric conversion. The image signal generated by the imaging unit 5009 is supplied to the communication unit 5013.
As an imaging element included in the imaging unit 5009, for example, a Complementary Metal Oxide Semiconductor (CMOS) type image sensor which has a bayer array and is capable of capturing a color image is used. Note that as the imaging element, an imaging element capable of capturing a high-resolution image of, for example, 4K or higher may be used. An image of the surgical site can be obtained with high resolution, and this allows the
Further, the imaging element included in the imaging unit 5009 has a configuration including a pair of imaging elements, one for acquiring a right-eye image signal supporting 3D display and the other for acquiring a left-eye image signal supporting 3D display. The 3D display allows the
Further, the imaging unit 5009 need not be provided in the
The drive unit 5011 is constituted by an actuator, and the camera head controller 5015 controls the zoom lens and the focus lens of the lens unit 5007 to move by a predetermined distance along the optical axis. With this arrangement, the magnification and focus of the image captured by the imaging unit 5009 can be appropriately adjusted.
The communication unit 5013 is constituted by communication means for transmitting and receiving various types of information to and from the
Further, the communication unit 5013 receives a control signal for controlling driving of the
Note that the above-described imaging conditions such as the frame rate, the exposure value, the magnification, and the focus are automatically set by the controller 5063 of the CCU5039 based on the acquired image signal. That is, the
The camera head controller 5015 controls driving of the
Note that the
Next, a functional configuration of the CCU5039 will be described. The communication unit 5059 is constituted by communication means for transmitting and receiving various types of information to and from the
Further, the communication unit 5059 transmits a control signal for controlling driving of the
The image processing unit 5061 performs various types of image processing on an image signal as raw data transmitted from the
The image processing unit 5061 is constituted by a processor such as a CPU or a GPU, and the above-described image processing and demodulation processing may be performed by a processor operating according to a predetermined program. Note that in the case where the image processing unit 5061 is configured of a plurality of GPUs, the image processing unit 5061 appropriately divides information relating to image signals and performs image processing in parallel by the plurality of GPUs.
The controller 5063 performs various controls related to capturing an image of the surgical site by the
Further, the controller 5063 causes the
The transmission cable 5065 connecting the
Here, in the illustrated example, wired communication is performed using the transmission cable 5065, but wireless communication may be performed between the
Examples of endoscopic
The technique according to the present disclosure can be applied to, for example, a camera head in the above-described configuration.
[ configuration of the present disclosure ]
Note that the present disclosure may also have the following configuration.
[A1]
A ranging system, comprising:
a light source unit that emits infrared light to a target object;
a light receiving unit that receives infrared light from a target object; and
an arithmetic processing unit that obtains information on a distance to the target object based on the data from the light receiving unit,
wherein an optical member including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range is arranged on a light receiving surface side of the light receiving unit, and
the band pass filter has a concave light incident surface.
[A2]
The ranging system according to [ a1], wherein,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter, and
the light at the maximum image height has an incident angle of 10 degrees or less with respect to a light incident surface of the band-pass filter.
[A3]
The ranging system according to [ A1] or [ A2], wherein,
the half width of the transmission band of the band-pass filter is 50nm or less.
[A4]
The ranging system according to any one of [ A1] to [ A3], wherein,
the band-pass filter comprises
A first filter transparent to light in a predetermined wavelength range of infrared light, an
And a second filter opaque to visible light and transparent to infrared light.
[A5]
The ranging system according to [ a4], wherein,
the first filter and the second filter are stacked and formed on one side of the substrate.
[A6]
The ranging system according to [ a4], wherein,
the first filter is formed on one surface of the base material, and
the second filter is formed on the other surface of the substrate.
[A7]
The ranging system according to any one of [ A4] to [ A6], wherein,
the first filter is arranged on the light incidence surface side, and
the second filter is arranged on the light receiving unit side.
[A8]
The ranging system according to [ a7], wherein,
the second filter has a concave shape imitating a light incident surface.
[A9]
The ranging system according to [ a7], wherein,
the second filter has a planar shape.
[A10]
The ranging system according to any one of [ A4] to [ A6], wherein,
the second filter is arranged on the light incidence surface side, and
the first filter is arranged on the light receiving unit side.
[A11]
The ranging system according to [ a10], wherein,
the first filter has a concave shape imitating a light incident surface.
[A12]
The ranging system according to any one of [ A1] to [ A11], wherein,
the light source unit includes an infrared laser element or an infrared light emitting diode element.
[A13]
The ranging system according to any one of [ A1] to [ A12], wherein,
the light source unit emits infrared light having a center wavelength of about 850nm, about 905nm, or about 940 nm.
[A14]
The ranging system according to any one of [ A1] to [ A13], wherein,
the arithmetic processing unit obtains distance information based on a time of flight of light reflected from the target object.
[A15]
The ranging system according to any one of [ A1] to [ A13], wherein,
the infrared light is emitted to the target object in a predetermined pattern, and
the arithmetic processing unit obtains distance information based on a pattern of light reflected from the target object.
[B1]
A light receiving module comprising:
a light receiving unit that receives infrared light; and
an optical member arranged on a light receiving surface side of the light receiving unit and including a band-pass filter selectively transparent to infrared light in a predetermined wavelength range,
wherein the band pass filter has a concave light incident surface.
[B2]
The light receiving module according to [ B1], wherein,
the optical member includes a lens disposed on a light incident surface side of the band-pass filter.
[B3]
The light receiving module according to [ B2], wherein,
the light at the maximum image height has an incident angle of 10 degrees or less with respect to a light incident surface of the band-pass filter.
[B4]
The light receiving module according to any one of [ B1] to [ B3], wherein,
the half width of the transmission band of the band-pass filter is 50nm or less.
[B5]
The light receiving module according to any one of [ B1] to [ B4], wherein,
the band-pass filter comprises
A first filter transparent to light in a predetermined wavelength range of infrared light, an
And a second filter opaque to visible light and transparent to infrared light.
[B6]
The light receiving module according to [ B5], wherein,
the first filter and the second filter are stacked and formed on one side of the substrate.
[B7]
The light receiving module according to [ B5], wherein,
the first filter is formed on one surface of the base material, and
the second filter is formed on the other surface of the substrate.
[B8]
The light receiving module according to any one of [ B5] to [ B7], wherein,
the first filter is arranged on the light incidence surface side, and
the second filter is arranged on the light receiving unit side.
[B9]
The light receiving module according to [ B8], wherein,
the second filter has a concave shape imitating a light incident surface.
[B10]
The light receiving module according to [ B8], wherein,
the second filter has a planar shape.
[B11]
The light receiving module according to any one of [ B5] to [ B7], wherein,
the second filter is arranged on the light incidence surface side, and
the first filter is arranged on the light receiving unit side.
[B12]
The light receiving module according to [ B11], wherein,
the first filter has a concave shape imitating a light incident surface.
List of reference marks
1. 1A, 1B, 1C and 1D ranging system
10. 10A, 10B and 90 optical member
11 lens
12. 92 band-pass filter
12A first filter
12B second filter
12C band pass filter layer
12D antireflection film
13. 13A substrate transparent to infrared light
14A frame
14B adhesive member
15. 15A diaphragm
16 suction mould
16A recess
16B opening
20. 20A and 20B light receiving unit
30. 30A and 30B analog-to-digital conversion units
40. 40A and 40B arithmetic processing unit
50 controller
60 light source driving unit
70 light source unit
71 light diffusing member
72 scanning unit
73 pattern projection unit
80 synthesis processing unit
120 wafer-shaped band-pass filter bank
140 wafer shaped frame
200 wafer-shaped imaging element groups.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:激光雷达测距的多脉冲融合分析