阅读说明：本技术 一种自投影式内窥镜装置 (Self-projection endoscope device ) 是由 廖洪恩 崔曦雯 于 2018-06-19 设计创作，主要内容包括：本发明涉及医疗器械技术领域,尤其涉及一种用于微创手术的具备图像增强功能的自投影式内窥镜装置。所述自投影式内窥镜装置,包括内窥镜,内窥镜的壳体前端设有用于采集病灶的术中影像的电荷藕合器件,还包括设于壳体上的投影系统,投影系统包括激光器和扫描振镜,激光器投射的激光内容为含有病灶的术前影像像素,激光器可将激光发射至所述扫描振镜,扫描振镜可通过不断振动将激光合成为术前影像,并可将术前影像投射至壳体的后端外,并使术前影像与术中影像相叠加。本发明可将术前影像与术中影像相叠加,从而可获取增强现实融合后的术区场景,不仅可以实现多源信息融合、自然原位的显示效果,而且没有传统眼镜设备带来的观看疲劳等问题。(The invention relates to the technical field of medical instruments, in particular to a self-projection endoscope device with an image enhancement function for minimally invasive surgery. From projection endoscope device, including the endoscope, the casing front end of endoscope is equipped with the electric charge coupling device who is used for gathering the image in the art of focus, still including locating the projection system on the casing, projection system includes laser instrument and scanning galvanometer, and the laser content that the laser instrument throws is the preoperative image pixel that contains the focus, and the laser instrument can with laser emission extremely scanning galvanometer, scanning galvanometer accessible constantly vibrate with laser synthesis preoperative image, and can throw preoperative image outside the rear end of casing to make preoperative image and image overlap mutually in the art. The invention can superpose the images before the operation and the images during the operation, thereby obtaining the scene of the operation area after augmented reality fusion, not only realizing the display effects of multi-source information fusion and natural in-situ, but also having no problems of watching fatigue and the like caused by the traditional glasses equipment.)

1. The utility model provides a from projection formula endoscope device, includes the endoscope, the casing front end of endoscope is equipped with the CCD that is used for gathering the image in the art of focus, its characterized in that still including locating projection system on the casing, projection system includes laser instrument and scanning galvanometer, the laser content that the laser instrument throws is for containing the preoperative image pixel of focus, the laser instrument can with laser emission to scanning galvanometer, scanning galvanometer accessible continuous vibration will laser synthesis becomes image before the art to can with before the image before the projection outside the rear end of casing, and make before the art image with image in the art superpose.

2. The self-projection endoscope apparatus according to claim 1, wherein the projection system further comprises a first tube and a reflector, the first tube is axially disposed in the housing, the laser is disposed on an outer wall of the housing, the outer wall is provided with a light hole, and the reflector is disposed on an inner wall of the first tube; the scanning galvanometer outputs the preoperative image to the reflector through the light hole, and the reflector can reflect the preoperative image to the outside of the rear end of the first lens tube and enable the preoperative image to be superposed with the intraoperative image.

3. The self-projecting endoscopic device of claim 2 wherein a side of the first lens tube abuts a side of the housing where the laser is located.

4. The self-projecting endoscopic device of claim 2 wherein the intraoperative image passes axially through the first tube, the mirror being angled with respect to the inner wall of the first tube such that the preoperative image and the intraoperative image are on the same central axis.

5. The self-projecting endoscope apparatus according to claim 2, wherein said scanning galvanometer is disposed at the aperture of said light-transmissive hole, said scanning galvanometer and laser being located on the same side of said housing.

6. The self-projecting endoscopic device of claim 1 wherein the projection system further comprises a second lens tube and a mirror disposed within the second lens tube; a third lens tube is arranged in the shell, the intraoperative image axially penetrates through the third lens tube, and the second lens tube and the third lens tube are parallel and are arranged along the axial direction of the shell; the laser device can emit the laser to the reflecting mirror, and can reflect the laser to the scanning galvanometer through the reflecting mirror, and then can synthesize the laser into the preoperative image through the scanning galvanometer, and the scanning galvanometer can output the preoperative image to the outside of the rear end of the second lens tube, and enable the preoperative image and the intraoperative image to be superposed.

7. The self-projecting endoscope apparatus according to claim 6, wherein said laser is disposed within said second tube, and said scanning galvanometer and said mirror are disposed on opposite inner walls of said second tube, respectively.

8. The self-projecting endoscopic device of claim 7 wherein the angle between the reflector and the inner wall of the second tube is such that the preoperative image and the intraoperative image are superimposed;

and/or the laser is positioned at the front end of the shell.

9. The self-projection endoscope apparatus according to any of claims 2 to 8, characterized in that the reflector is a half mirror;

and/or the scanning galvanometer is an MEMS scanning galvanometer;

and/or the laser emitting port of the laser faces the rear end of the shell.

10. The self-projecting endoscopic device according to any of claims 2 to 8, wherein the preoperative image is fused and registered before being embedded in the projection system, the fused and registered manner comprising the following steps:

collecting an image of a focus part before an operation, and drawing the image into an image model in a surface drawing mode;

in the operation process, the position and the posture of the endoscope are tracked through an electromagnetic tracking device to determine the relative position relation between the endoscope and the image model, so that the intra-operation image of the endoscope and the image model at the corresponding position are fused and registered, and the pre-operation image at the corresponding position is obtained after fusion and registration.

Technical Field

The invention relates to the technical field of medical instruments, in particular to a self-projection endoscope device with an image enhancement function for minimally invasive surgery.

Background

The endoscope is mainly applied to minimally invasive surgery and used for observing pathological changes of internal organs of a human body and can also be used for performing some minimally invasive surgical operations. In the practical application of an endoscope, the field area is limited due to the serious limitation of the illumination range and the visual angle of the optical fiber, and the information in the operation is difficult to be completely and comprehensively acquired; in the actual operation, the visual field is complex and seriously affected by water flow, flotage and tissue deformation, doctors need strong experience to correspond the actual visual field to the anatomical structure and preoperative lesion diagnosis, and the incompatibility problem of hands and eyes during the operation also restricts the efficiency and safety of the operation. In addition, these defects of the endoscope also have a certain influence on the development and application of the robot-assisted surgery technology. Common methods of improvement include: operating area reconstruction is carried out by only depending on endoscope movement; exposure compensation image enhancement is also realized through two adjacent frames of endoscope images; some researchers have also proposed applying virtual reality techniques to endoscopic surgery to enhance the immersive experience of the scene by wearing 3D glasses, hopefully solving the hand-eye coordination problem and fusing preoperative multi-modal image information.

In the above method, the operation of the operation region reconstruction method is time-consuming and has limited quality; the imaging quality is not fundamentally improved by relying on a plurality of images to realize effect enhancement; the existing virtual reality assisted surgery technology is greatly influenced by the comfort and the effect of an observation tool and is difficult to popularize in a short time.

Disclosure of Invention

Technical problem to be solved

The invention provides a self-projection endoscope device with an image enhancement function for minimally invasive surgery, which can superpose preoperative images and intraoperative images in a self-projection mode, provide image effect compensation for an observation area and enhance the visual field image quality.

(II) technical scheme

In order to solve the above technical problem, the present invention provides a self-projection endoscope apparatus, including an endoscope, a ccd disposed at a front end of a housing of the endoscope for collecting an intra-operative image of a lesion, and a projection system disposed on the housing, where the projection system includes a laser and a scanning galvanometer, a content of laser projected by the laser is a preoperative image pixel including the lesion, the laser can emit the laser to the scanning galvanometer, and the scanning galvanometer can continuously vibrate to synthesize the laser into the preoperative image, project the preoperative image out of a rear end of the housing, and superimpose the preoperative image and the intra-operative image.

The intraoperative image in the invention refers to an image of a lesion position acquired by a charge coupled device in an operation process.

Furthermore, the projection system also comprises a first mirror tube and a reflector, the first mirror tube is axially arranged in the shell, the laser is arranged on the outer wall of the shell, a light-transmitting hole is formed in the outer wall, and the reflector is arranged on the inner wall of the first mirror tube; the scanning galvanometer outputs the preoperative image to the reflector through the light hole, and the reflector can reflect the preoperative image to the outside of the rear end of the first lens tube and enable the preoperative image to be superposed with the intraoperative image.

Furthermore, one side of the first mirror tube is attached to one side, provided with the laser, of the shell.

Furthermore, the image during operation axially passes through the first lens tube, and the angle between the reflector and the inner wall of the first lens tube can enable the image before operation and the image during operation to be on the same central axis.

Preferably, the included angle between the reflector and the inner wall of the first mirror tube is 45 degrees. The included angle may ensure that the preoperative image and the intraoperative image are on the same central axis.

Further, the scanning galvanometer is arranged in the hole opening of the light hole, and the scanning galvanometer and the laser are located on the same side of the shell.

Furthermore, the projection system also comprises a second mirror tube and a reflector arranged in the second mirror tube; a third lens tube is arranged in the shell, the intraoperative image axially penetrates through the third lens tube, and the second lens tube and the third lens tube are parallel and are arranged along the axial direction of the shell; the laser device can emit the laser to the reflecting mirror, and can reflect the laser to the scanning galvanometer through the reflecting mirror, and then can synthesize the laser into the preoperative image through the scanning galvanometer, and the scanning galvanometer can output the preoperative image to the outside of the rear end of the second lens tube, and enable the preoperative image and the intraoperative image to be superposed.

Furthermore, the laser is arranged in the second mirror tube, and the scanning galvanometer and the reflector are respectively arranged on the opposite inner walls of the second mirror tube.

Furthermore, the included angle between the reflector and the inner wall of the second lens tube can enable the preoperative image and the intraoperative image to be superposed;

and/or the laser is positioned at the front end of the shell.

Further, the reflector is a half-transmitting half-reflecting mirror;

and/or the scanning galvanometer is an MEMS scanning galvanometer;

and/or the laser emitting port of the laser faces the rear end of the shell.

Preferably, an illumination fiber bundle is axially arranged in the shell.

Further, the preoperative image is fused and registered before being embedded in the projection system, and the fusion and registration method comprises the following steps:

collecting an image of a focus part before an operation, and drawing the image into an image model in a surface drawing mode;

in the operation process, the position and the posture of the endoscope are tracked through an electromagnetic tracking device to determine the relative position relation between the endoscope and the image model, so that the intra-operation image of the endoscope and the image model at the corresponding position are fused and registered, and the pre-operation image at the corresponding position is obtained after fusion and registration.

(III) advantageous effects

The technical scheme of the invention has the following beneficial effects:

1. the endoscope device can superpose the preoperative image and the intraoperative image in a projection mode through the projection system, so that an augmented reality fused operative area scene can be obtained; the fused scene can realize the display effects of multi-source information fusion and natural in-situ, and the problems of watching fatigue and the like caused by the traditional glasses equipment are avoided; the projected preoperative image enhances the brightness of an observation area in the intraoperative image, deepens the boundary of an anatomical area, enables the intraoperative position to be easier to identify, is simple in instrument positioning, reduces the dependence on experience and skill of doctors, and enhances the operation efficiency and safety.

2. The method comprises the steps of firstly carrying out fusion registration on collected preoperative images before the preoperative images are internally arranged in a projection system, namely collecting images of focus parts preoperatively, and drawing the images into an image model in a surface drawing mode; in the operation process, the position and the posture of the endoscope are tracked through an electromagnetic tracking device to determine the relative position relation between the endoscope and the image model, so that the intra-operation image of the endoscope and the image model at the corresponding position are fused and registered, and the pre-operation image at the corresponding position is obtained after fusion and registration. The preoperative image model can be further divided into anatomical structures and established into a biomechanical model through the fusion registration, so that when the intraoperative region deforms, the image model can be correspondingly deformed and shifted and adjusted according to the intraoperative image of the endoscope, and real-time image fusion and guidance which are suitable for deformation and face the whole operation process are achieved.

Drawings

Fig. 1 is a schematic structural view of a self-projection endoscope apparatus according to embodiment 1 of the present invention;

FIG. 2 is a cross-sectional view of a self-projection endoscope apparatus according to embodiment 1 of the present invention;

FIG. 3 is a schematic structural view of a self-projection endoscope apparatus according to embodiment 2 of the present invention;

FIG. 4 is a cross-sectional view of a self-projecting endoscope apparatus according to embodiment 2 of the present invention;

wherein, 1, a shell; 2. an interface for mounting a CCD; 3. a laser; 4. scanning a galvanometer; 5. a first mirror tube; 6. a mirror; 7. a light-transmitting hole; 8. a second lens tube; 9. a third lens tube; 10. illuminating the fiber bundle; 11. an illumination fiber optic interface.

Detailed Description

The embodiments of the present invention will be described in further detail with reference to the drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

In the description of the present invention, "a plurality" means two or more unless otherwise specified. The terms "upper", "lower", "left", "right", "inner", "outer", "front", "rear", "head", "tail", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are only for convenience in describing and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be construed as limiting the invention. Furthermore, the terms "first," "second," "third," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; may be directly connected or indirectly connected through an intermediate. The specific meaning of the above terms in the present invention can be understood as appropriate by those of ordinary skill in the art.

The present invention provides two self-projecting endoscope apparatuses, which have the same structure: all include the endoscope, the casing 1 front end of endoscope is equipped with the electric charge coupling device (not shown in the figure) that is used for gathering the image in the art of focus, self-projection formula endoscope device is still including locating the projection system on casing 1, projection system includes laser 3 and scanning galvanometer 4, the laser content that laser 3 throws is the preoperative image pixel that contains the focus, laser 3 can be with laser emission to scanning galvanometer 4, scanning galvanometer 4 accessible constantly vibrates to synthesize the preoperative image with laser, and can throw preoperative image outside the rear end of casing 1, and make preoperative image and image stack mutually in the art.

As for the two types of self-projection endoscope apparatuses described above, the following embodiments 1 and 2 each provide a projection system having a different structure.