Capsule endoscope with 3D measuring function and corresponding imaging method
阅读说明:本技术 一种具有3d测量功能的胶囊内窥镜及相应成像方法 (Capsule endoscope with 3D measuring function and corresponding imaging method ) 是由 章逸舟 李光元 鲁远甫 焦国华 陈良培 刘鹏 于 2019-12-11 设计创作,主要内容包括:本发明涉及一种胶囊内窥镜,核心为双目成像系统,其采用双物镜单图像传感器的设计。具体地,所述双目成像系统包括棱镜单元以及与所述棱镜单元配合使用的一个图像传感器。所述棱镜单元包括两块相同的45°角斜方棱镜,两块斜方棱镜以相互交错180°的方位关系并排放置并且光路出射面在一个平面内,分别对应所述图像传感器靶面上的两个均分区域。本发明的胶囊内窥镜光学结构紧凑,可实现对病变区的彩色成像,也可以获得3D测量的功能,同时整体制作成本也得到降低。(The invention relates to a capsule endoscope, which is mainly a binocular imaging system and adopts the design of a double-objective lens single-image sensor. Specifically, the binocular imaging system comprises a prism unit and an image sensor used in cooperation with the prism unit. The prism unit comprises two same 45-degree-angle rhombic prisms which are arranged side by side in a staggered 180-degree azimuth relation, and the emergent surfaces of the light paths are in a plane and respectively correspond to two equal division areas on the target surface of the image sensor. The capsule endoscope has compact optical structure, can realize color imaging of a lesion area, can also obtain the function of 3D measurement, and simultaneously reduces the whole manufacturing cost.)
1. A capsule endoscope comprises a capsule shell (1), and a binocular imaging system (2), an illumination module (3), an image acquisition and processing module (4), a battery module (5), a magnetic shield positioning module (6) and a wireless transmitting module (7) which are arranged in the capsule shell (1);
wherein the binocular imaging system (2) comprises a prism unit and one image sensor (27) used in cooperation with the prism unit;
the prism unit comprises two same 45-degree-angle rhombic prisms which are arranged side by side in a direction relationship of 180 degrees in a staggered manner; the light path emergent surfaces of the two rhombic prisms are in one plane and respectively correspond to two equal-dividing areas on the target surface of the image sensor (27).
2. The capsule endoscope of claim 1, wherein: the binocular imaging system (2) further comprises two sets of imaging objective systems, and the two sets of imaging objective systems respectively correspond to the incident surfaces of the two rhombic prisms.
3. The capsule endoscope of claim 2, wherein: the imaging objective system comprises a lens unit and a diaphragm (24).
4. The capsule endoscope of claim 3, wherein: the lens unit comprises a first lens (21), a second lens (22), a third lens (23) and a diaphragm (24); the first lens (21) is a lens with negative diopter, and the curved surface on the object side is concave to the image side, and the curved surface on the image side is concave to the object side; the second lens (22) is a lens with negative diopter, and the curved surface on the object side is concave to the image side, and the curved surface on the image side is concave to the image side; the third lens (23) is a lens with positive diopter, and the curved surface on the object side is concave to the image side, and the curved surface on the image side is concave to the image side.
5. The capsule endoscope of claim 1, wherein: an optical filter (26) is also provided between the prism unit and the image sensor (27).
6. The capsule endoscope of claim 1, wherein: the lighting module (3) has one or more lighting units arranged on the sides of the binocular imaging system (2).
7. A method for three-dimensional imaging using the capsule endoscope of any of claims 1-6, comprising the following operative steps:
the external magnetic control equipment is used for controlling the magnetic shield positioning module (6) in the capsule to enter the gastrointestinal tract and continuously move forwards;
the gastrointestinal tract is illuminated through the illumination module (3), and a lesion area in the intestinal tract is imaged through the binocular imaging system (2); in the imaging process, image signals entering the two rhombic prisms have parallax errors and are imaged to two equally-divided areas on the target surface of one image sensor (27);
the image formed by the image sensor (27) is acquired by the image acquisition and processing module (4).
8. The method of claim 7, wherein: the system is characterized by further comprising an image acquisition and processing module (4) for transmitting the processed image to the wireless transmitting module (7), wherein the wireless transmitting module (7) encodes the processed image and transmits the encoded image to an external receiving device.
9. The method of claim 8, wherein: the receiving device carries out three-dimensional image reconstruction through computer software.
Technical Field
The invention belongs to the technical field of medical instruments, and particularly relates to a capsule endoscope.
Background
The capsule endoscope is a visual medical gastrointestinal examination device in the shape of a capsule. The capsule endoscope enters a human body, and can observe the health conditions of the intestines, the stomach and the esophagus of the human body, thereby helping doctors to diagnose patients. The capsule endoscope has the advantages of no wound, accuracy, reusability and the like which are beyond the traditional flexible gastrointestinal endoscope. At present, the commercialized capsule endoscope mainly integrates a single camera of 2D imaging, the observation endoscope usually has high distortion in order to obtain a larger visual field, and the capsule endoscope is only used for observation rather than measurement for a long time, and the defects make it difficult for doctors to judge the severity of lesion by using the capsule endoscope. In order to improve the accuracy and authenticity of the physician's observation of the lesion, it is highly advantageous to obtain three-dimensional information in the intestines and stomach by capsule endoscopy.
The patent CN107317954A acquires a light field signal of a position scene to be detected through a light field technology, and a light field camera records four-dimensional information of light in a propagation process, so that a 3D state of an observed object can be reconstructed. However, because the light field camera is used for imaging, and the light field camera is composed of the main lens group, the micro lens array and the photosensitive element, the micro lens array is expensive, and the whole set of equipment has very fine manufacturing requirements, so the cost is very high.
Patent CN105996961A discloses a structured light based 3D stereoscopic imaging capsule endoscope system, which generates structured light by a structured light generating module and acquires three-dimensional information by cooperating with an illumination device. However, the 3D imaging band for imaging is formed by filtering white light and using the structured light generating module, and therefore, the color information of the imaging target cannot be accurately reflected, and although 3D measurement can be performed, the important information of the dimension of lacking the color of the lesion area has a great influence on the diagnosis of the doctor.
The virtual reality capsule endoscope of patent CN104720735A simulates the left and right eyes of a human being with two cameras, each including a CCD image sensor and a camera lens. However, since the capsule endoscope has a high requirement on the size, the imaging technology using the dual objective lens and the dual image sensor is very unfavorable for the capsule endoscope to meet the size requirement in application, and is also unfavorable for reducing the cost.
Therefore, the defects of the existing three-dimensional imaging capsule endoscope are high in cost, complex in manufacturing process, difficult to meet size requirements, insufficient in imaging information and the like, and if the defects can be improved, more convenience is brought to doctors for diagnosing pathological changes through the capsule endoscope.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a capsule endoscope with a 3D measurement function for gastrointestinal examination, and the capsule endoscope system realizes the purpose of 3D measurement by using a prism module with special design and a single image sensor with double objective lenses, thereby not only reducing the size space of the system, but also having the 3D measurement function while keeping spectral information.
The capsule endoscope comprises a capsule shell, and a binocular imaging system, an illumination module, an image acquisition and processing module, a battery module, a magnetic cover positioning module and a wireless transmitting module which are arranged in the capsule shell; the binocular imaging system comprises a prism unit and an image sensor matched with the prism unit; the prism unit comprises two same 45-degree-angle rhombic prisms which are arranged side by side in a direction relationship of 180 degrees in a staggered manner; the light path emergent surfaces of the two rhombic prisms are in the same plane and respectively correspond to the two equal division areas on the target surface of the image sensor.
Furthermore, the binocular imaging system further comprises two sets of imaging objective lens systems, and the two sets of imaging objective lens systems respectively correspond to the incident surfaces of the two rhombic prisms. The imaging objective system comprises, for example, a lens unit and a diaphragm. Preferably, the lens unit comprises a first lens, a second lens, a third lens and a diaphragm; the lens is a lens with negative diopter, and the curved surface on one side of the object space is concave to the image space, and the curved surface on one side of the image space is concave to the object space; the second lens is a lens with negative diopter, the curved surface at one side of the object space is concave to the image space, and the curved surface at one side of the image space is concave to the image space; the third lens is a lens with positive diopter, and the curved surface on the object side is concave to the image side, and the curved surface on the image side is concave to the image side.
Further, an optical filter may be further disposed between the prism unit and the image sensor.
Preferably, the illumination module has one or more illumination units, for example using LEDs, arranged to the side of the binocular imaging system.
Meanwhile, the invention also provides a method for performing three-dimensional imaging by using the capsule endoscope, which comprises the following operation steps:
the external magnetic control equipment is used for controlling the magnetic shield positioning module in the capsule to enter the gastrointestinal tract and continuously move forwards;
the gastrointestinal tract is illuminated through the illumination module, and a lesion area in the intestinal tract is imaged through the binocular imaging system; in the imaging process, image signals entering the two rhombic prisms have parallax errors and are imaged to two equally divided areas on the target surface of one image sensor; the image formed by the image sensor is collected by the image collecting and processing module.
Further, the method also comprises the step that the image acquisition and processing module transmits the processed image to the wireless transmitting module, and the wireless transmitting module encodes the processed image and transmits the encoded image to an external receiving device.
Preferably, the receiving means performs three-dimensional image reconstruction by means of computer software.
Compared with the prior art, the capsule endoscope adopting the double-objective single-image sensor has a compact optical structure, can realize color imaging of a lesion area, can also obtain a 3D measurement function, and simultaneously reduces the overall manufacturing cost.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical solutions of the present application more clear and clear, and to implement the technical solutions according to the content of the description, the following detailed description is made with reference to the preferred embodiments of the present application and the accompanying drawings.
Drawings
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings;
FIG. 1 is a binocular stereo imaging principle;
FIG. 2 is a schematic view of a depth calculation;
FIG. 3 is a schematic view of a dual objective single image sensor capsule endoscope of the present invention;
FIG. 4 is a three-dimensional schematic diagram of a cemented prism in a binocular imaging system;
fig. 5 is a diagram of an example dual-objective single-image sensor binocular imaging system.
Reference numerals:
the system comprises a
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, shall fall within the scope of protection of the present invention.
In order to realize stereo measurement, a basic imaging principle is that two optical systems are arranged in a three-dimensional imaging capsule endoscope system and are respectively used for shooting separated images corresponding to a left eye and a right eye, and then three-dimensional reconstruction is carried out through software.
The basic principle of binocular stereo imaging is shown in the attached figure 1 of the specification, wherein two identical cameras are arranged below the figure, and corresponding parameters of the two cameras are respectively marked by
Assuming that the two camera image planes are on the same plane, the Y coordinates of the image points of the object point A on the left and right camera image planes are the same, i.e. v1=vrFrom the trigonometric relationship, one can obtain:
in equation (1), f is the focal length of the two cameras, so the parallax is:
the formula (2) is a basic principle of binocular stereo imaging, and after parallax information is obtained, depth information and three-dimensional information of an image can be obtained according to a projection model.
Meanwhile, after the parallax is acquired, accurate calculation of three-dimensional information can be performed according to parameters obtained after stereo correction, image coordinates of points to be measured and left and right image detectors, such as CCD parallax. Referring to the specification, as shown in FIG. 2, the
Is the center of the left CCD and is,is the center of the right CCD, and the distance between the centers of the cameras is T, xlIs a point to be matched on the left CCD, xrThe matching point on the right CCD. From similar triangles
Can be solved to obtain Z ═ -Tf/xl-xr。
Therefore, under the condition that the T and the f are calibrated and the aberration xl-xr of one point p on the main image is known, the depth information Z can be calculated, and (x, y) can be calculated through calibration information, so that the three-dimensional information (x, y, Z) of the point to be measured can be recovered.
Based on the above three-dimensional imaging working principle, as mentioned above, the conventional capsule endoscope currently acquires two images by using the imaging technology of dual objective lenses and dual image sensors, which is not suitable for the capsule endoscope that originally has a high requirement on size.
The capsule endoscope is structurally shown in the attached figure 3 in the specification, and comprises a
The greatest difference between the present invention and the prior art is the
The
When the capsule endoscope is used, the target area is illuminated by the
In the specific application, after a patient swallows the capsule endoscope, the external magnetic control equipment enters the gastrointestinal tract by controlling the magnetic
The key point of the capsule endoscope is that the 3D measurement is realized by adopting a double-objective lens single-image sensor. Two imaging objective systems with the same optical parameters are used, and two parallel rhombic prisms with 180-degree phase error are arranged behind the imaging objective systems respectively, so that images captured by the two imaging objective systems are imaged to two equally divided areas on the left and right of the target surface of the same image sensor respectively, and are identified by a software algorithm and a three-dimensional image is reconstructed. Compared with the prior art, the capsule endoscope has the advantages that the reflection in the prism is utilized in the imaging light path of the capsule endoscope, and the two images with parallax are obtained by using the image sensor, so that the whole imaging light path is more compact in structure and smaller in caliber, the size of the capsule endoscope is smaller, and the cost is lower. Meanwhile, pictures shot by the binocular imaging system can be color images or monochrome images, and abundant image information is helpful for doctors to distinguish lesion areas.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:一种内窥镜柔性导管的定向弹性偏转结构