阅读说明：本技术 一种多模显像设备、系统 (Multimode imaging equipment and system ) 是由 王璐瑶 张鹏 杨魁 焦路成 温小梅 望翱宇 刘梦娇 卢桂池 张泉 许浒 于 2020-11-18 设计创作，主要内容包括：本发明公开了一种多模显像设备、系统,包括设备壳体,设备壳体上设有伽马探测器模块,伽马探测器模块位于待检物体正上方；光学成像模块；设于设备壳体上、用以转换光学成像模块发出的光线的方向以对待检物体照明并转换待检物体发出的光线的方向以被光学成像模块获取得到光学图像的转向镜组。该设备将伽马探测器模块和光学成像模块集成与设备壳体上,能够对同一位置的待检物体的伽马射线和光学信息进行采集,以得到待检物体的伽马图像和二维光学图像；当需要单独使用光学成像模块时,能够实现荧光显像模块和设备壳体的快速分离,便于分别单独使用光学成像模块或伽马探测器模块,由此以满足不同场合的显像需要,提高装置的适应性。(The invention discloses multimode imaging equipment and a multimode imaging system, which comprise an equipment shell, wherein a gamma detector module is arranged on the equipment shell and is positioned right above an object to be detected; an optical imaging module; the steering lens group is arranged on the equipment shell and used for converting the direction of the light emitted by the optical imaging module so as to illuminate the object to be detected and converting the direction of the light emitted by the object to be detected so as to obtain an optical image by the optical imaging module. The equipment integrates a gamma detector module and an optical imaging module on an equipment shell, and can acquire gamma rays and optical information of an object to be detected at the same position to obtain a gamma image and a two-dimensional optical image of the object to be detected; when the optical imaging module is required to be used independently, the fluorescent imaging module and the equipment shell can be separated quickly, the optical imaging module or the gamma detector module can be conveniently and independently used respectively, therefore, the imaging requirements of different occasions are met, and the adaptability of the device is improved.)

1. The multimode display device is characterized by comprising a device shell, wherein the device shell is provided with:

the gamma detector module is used for detecting gamma rays emitted from an object to be detected containing radioactive nuclides or radioactive compounds so as to carry out gamma image imaging on the object to be detected, and the gamma detector module is positioned right above the object to be detected;

the optical imaging module is used for acquiring optical information of an object to be detected;

the steering mirror group is arranged on the equipment shell and used for converting the direction of light emitted by the optical imaging module so as to illuminate the object to be detected and converting the direction of the light emitted by the object to be detected so as to be acquired by the optical imaging module to obtain an optical image.

2. The multimodal visualization apparatus as recited in claim 1, wherein the steering mirror group comprises:

the horizontal lens is arranged on the lower bottom surface of the equipment shell;

a vertical lens disposed adjacent to one side of the optical imaging module;

and the reflecting mirror is arranged at a preset angle with the horizontal lens.

3. The multi-mode visualization device according to claim 2, wherein the device housing comprises:

the horizontal lens mounting hole is formed in the lower bottom surface of the equipment shell, and a mounting boss used for supporting the horizontal lens is arranged on the horizontal lens mounting hole;

and/or a vertical lens mounting groove provided on a vertical sidewall of the device housing;

and/or, with the lateral wall detachable fixed connection's of equipment casing fretwork mounting bracket, the fretwork mounting bracket includes two parallel arrangement in order to form the fretwork frame of spacing cavity, the speculum slides in from outside to inside spacing cavity is fixed.

4. The multi-mode imaging apparatus according to claim 1, wherein the optical imaging module is removably and fixedly attached to the apparatus housing.

5. The multi-mode visualization device according to claim 4, wherein the device housing further comprises:

the fixing part is used for fixing the optical imaging module and comprises an inserting hole used for being in contact with the outer wall of the optical imaging module for limiting, and a damping piece used for being in contact with the outer wall of the optical imaging module to increase friction resistance is arranged on the inner wall of the inserting hole.

6. The multi-mode imaging apparatus according to claim 5, wherein the damping member is a damping rubber strip.

7. The apparatus according to claim 6, wherein the fixing portion further comprises a limiting hole extending through a wall thickness of the fixing portion; be equipped with the joint arch on optical imaging module's the outer wall, the bellied one end of joint with optical imaging module is fixed, the other end is for taking place elastic deformation's free end, the bellied surface of joint be equipped with can with spacing hole complex fixture block, with when optical imaging module pegs graft, the compression the free end until the fixture block with spacing hole cooperation realizes the joint.

8. The multimode visualization device of claim 1, wherein the optical imaging module is disposed in a direction perpendicular to the gamma detector module.

9. Multimode imaging device according to any of claims 1 to 8, characterized in that the optical imaging module is a NIR-I fluorescence imaging and/or white light imaging module.

10. A multimodal imaging system comprising an upper computer, a display device and the multimodal imaging apparatus of any one of claims 1 to 9;

the upper computer is used for controlling a gamma detector module and an optical imaging module of the multi-mode imaging device to perform data acquisition and image processing, and the optical imaging module and the gamma detector module are respectively connected with the upper computer;

the upper computer is connected with the display device to send the generated gamma image and the two-dimensional optical image of the object to be detected to the display device for displaying.

11. The multimodal visualization system of claim 10, wherein the multimodal visualization device is a handheld device or can be fixed to a mechanical connection arm of a medical trolley for visualization of an operative field.

Technical Field

The invention relates to the technical field of medical imaging, in particular to a multimode imaging device for open type molecular imaging surgery and a multimode imaging system comprising the multimode imaging device.

Background

Gamma and Near-infrared (NIR) fluorescence imaging techniques are widely used in surgical navigation. In recent years, from the perspective of the clinical trend of precise surgery, clinical experts have raised the need for gamma and NIR fluorescence multi-mode complementary intraoperative navigation, particularly for intraoperative real-time, accurate sentinel lymph node localization applications. In recent years, a great deal of research shows that the gamma-fluorescence combined imaging has unique application value in SLN positioning compared with a single mode or European and American accepted nuclide + blue staining combination.

Currently, clinical research work based on gamma-fluorescence combined imaging is mostly performed by means of separate imaging with two devices. The method has many limitations, except occupying more operating room space and doctor time, the main problems are that the combined imaging is not simultaneous and the angle and the Field of view (Field of view, abbreviated as FOV) are inconsistent, when the same sample is imaged, the sample needs to be respectively placed into a gamma developing device and a fluorescence developing device, the operation is complicated, the operation is inconvenient for a user, and the position of the sample is deviated, which is not favorable for locating the focus.

In view of the above, it is an urgent need to solve the problem of the prior art to provide a multi-mode imaging apparatus capable of simultaneously performing gamma imaging and optical imaging with the same FOV while maintaining the flexibility of single-mode use.

Disclosure of Invention

In view of the above, a first object of the present invention is to provide a multi-mode imaging apparatus for performing gamma-optical imaging on an object to be inspected by accurately integrating gamma imaging and optical imaging, and a second object of the present invention is to provide a multi-mode imaging system including the multi-mode imaging apparatus.

In order to achieve the first object, the invention provides the following technical scheme:

a multimode video display device comprises a device shell, wherein the device shell is provided with:

the gamma detector module is used for detecting gamma rays emitted from an object to be detected containing radioactive nuclides or radioactive compounds so as to carry out gamma image imaging on the object to be detected, and the gamma detector module is positioned right above the object to be detected;

the optical imaging module is used for acquiring optical information of an object to be detected;

the steering mirror group is arranged on the equipment shell and used for converting the direction of light emitted by the optical imaging module so as to illuminate the object to be detected and converting the direction of the light emitted by the object to be detected so as to be acquired by the optical imaging module to obtain an optical image.

Preferably, the steering mirror group comprises:

the horizontal lens is arranged on the lower bottom surface of the equipment shell;

a vertical lens disposed adjacent to one side of the optical imaging module;

and the reflecting mirror is arranged at a preset angle with the horizontal lens.

Preferably, the apparatus housing comprises:

the horizontal lens mounting hole is formed in the lower bottom surface of the equipment shell, and a mounting boss used for supporting the horizontal lens is arranged on the horizontal lens mounting hole;

and/or a vertical lens mounting groove provided on a vertical sidewall of the device housing;

and/or, with the lateral wall detachable fixed connection's of equipment casing fretwork mounting bracket, the fretwork mounting bracket includes two parallel arrangement in order to form the fretwork frame of spacing cavity, the speculum slides in from outside to inside spacing cavity is fixed.

Preferably, the optical imaging module is detachably and fixedly connected with the device housing.

Preferably, the device housing further comprises:

the fixing part is used for fixing the optical imaging module and comprises an inserting hole used for being in contact with the outer wall of the optical imaging module for limiting, and a damping piece used for being in contact with the outer wall of the optical imaging module to increase friction resistance is arranged on the inner wall of the inserting hole.

Preferably, the damping member is a damping rubber strip.

Preferably, the fixing part further comprises a limiting hole penetrating through the wall thickness of the fixing part; be equipped with the joint arch on optical imaging module's the outer wall, the bellied one end of joint with optical imaging module is fixed, the other end is for taking place elastic deformation's free end, the bellied surface of joint be equipped with can with spacing hole complex fixture block, with when optical imaging module pegs graft, the compression the free end until the fixture block with spacing hole cooperation realizes the joint.

Preferably, the optical imaging module is disposed in a direction perpendicular to the gamma detector module.

Preferably, the optical imaging module is an NIR-I fluorescence imaging and/or white light imaging module.

The invention provides multimode display equipment, which comprises an equipment shell, wherein the equipment shell is provided with: the gamma detector module is used for detecting gamma rays emitted from an object to be detected containing radioactive nuclides or radioactive compounds so as to carry out gamma image development on the object to be detected, and is positioned right above the object to be detected; the optical imaging module is used for acquiring optical information of an object to be detected; the steering lens group is arranged on the equipment shell and used for converting the direction of the light emitted by the optical imaging module so as to illuminate the object to be detected and converting the direction of the light emitted by the object to be detected so as to obtain an optical image by the optical imaging module.

Compared with the prior art, the multimode display equipment provided by the invention has the following technical effects:

firstly, the gamma detector module and the optical imaging module are accurately integrated together through the equipment shell, the consistency of an imaging FOV is achieved, the multimode imaging equipment can simultaneously carry out multimode imaging including gamma imaging, fluorescence imaging and/or white light imaging on an object to be detected at the same position, key instrument support is provided for open molecular imaging operation navigation such as sentinel lymph node positioning, the success rate of an operation is greatly improved, the survival quality of a patient is improved, and the practice of accurate surgery and individualized medical treatment is assisted;

the second, through detachable fixed connection design for the optics imaging module of equipment can plug, makes things convenient for the operation personnel to choose gamma video picture and fluorescence/white light video picture to carry out the monomodal use for use according to the application scene, from this with the video picture needs that satisfy different occasions, improves the adaptability of device.

In order to achieve the second object, the present invention further provides a multi-mode imaging system, including an upper computer, a display device and the multi-mode imaging apparatus according to any one of the above embodiments;

the upper computer is used for controlling a gamma detector module and an optical imaging module of the multi-mode imaging device to perform data acquisition and image processing, and the optical imaging module and the gamma detector module are respectively connected with the upper computer;

the upper computer is connected with the display device to send the generated gamma image and the two-dimensional optical image of the object to be detected to the display device for displaying.

Preferably, the multi-mode imaging device is a handheld device or can be fixed with a mechanical connecting arm of a medical trolley to perform imaging observation on the operation area.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of a multi-mode imaging system according to an embodiment of the present invention;

fig. 2 is a schematic diagram of an axial structure of a multi-mode imaging device according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a plug-in structure of an optical imaging module and a mounting portion according to an embodiment of the present invention;

FIG. 4 is a schematic view of a disassembled structure of an optical imaging module and a mounting portion according to an embodiment of the present invention;

FIG. 5 is a schematic view of a mounting structure of a damping member according to an embodiment of the present invention;

fig. 6 is a schematic front view of fig. 2.

The drawings are numbered as follows:

the device comprises an optical imaging module 1, a gamma detector module 2, an upper computer 3, a display device 4, a reflector 51, a horizontal lens 52, a vertical lens 53, an equipment shell 6, a fixing part 61, a plug hole 611 and a damping rubber strip 612.

Detailed Description

The embodiment of the invention discloses a multimode imaging device, which integrates gamma imaging and fluorescence and/or white light imaging, and can simultaneously carry out gamma imaging and fluorescence and/or white light imaging on an object to be detected by the multimode imaging device.

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 2-6, fig. 2 is a schematic axial view of a multi-mode imaging device according to an embodiment of the present invention; fig. 3 is a schematic diagram of a plug-in structure of an optical imaging module and a mounting portion according to an embodiment of the present invention; FIG. 4 is a schematic view of a disassembled structure of an optical imaging module and a mounting portion according to an embodiment of the present invention; FIG. 5 is a schematic view of a mounting structure of a damping member according to an embodiment of the present invention; fig. 6 is a schematic front view of fig. 2.

In one embodiment, the present invention provides a multi-mode imaging device comprising: the equipment shell 6 comprises a first split body and a second split body which are symmetrically arranged along a central line, and the first split body and the second split body are detachably and fixedly connected, such as fixed through a threaded fastener.

The equipment shell 6 is provided with:

and a gamma detector module 2 for reconstructing a gamma image by detecting gamma rays emitted from an object to be inspected containing a radionuclide or a radioactive compound to image the object to be inspected. A gamma detector module 2 based on a scintillation crystal comprises a collimator, a scintillation crystal, an optical multiplier, electronic circuits and the like. The specific structure and connection relationship of the gamma detector module 2 can refer to the prior art, and are not described herein again. In one embodiment, the gamma detector module 2 is located directly above the object to be inspected and detects gamma rays emanating from the object to be inspected.

An optical imaging module 1 for collecting optical information of an object to be inspected; optical information such as a two-dimensional optical image. A typical fluorescence and/or white light imaging module 1 includes a fluorescence light source, a white light source, a dichroic mirror, a plurality of lenses, a fluorescence camera, a white light camera, and the like, and the specific structure and connection relationship thereof can refer to the prior art. Preferably, the optical imaging module 1 is a fluorescence and/or white light imaging module.

The device housing 6 is provided with a steering lens group for converting the direction of the light emitted by the optical imaging module 1 to illuminate the object to be inspected and converting the direction of the light emitted by the object to be inspected to obtain an optical image by the optical imaging module 1. Preferably, the steering mirror group converts the horizontal light emitted by the optical imaging module 1 into vertical light to illuminate the object to be detected, converts the vertical fluorescent and/or white light emitted by the object to be detected into horizontal light, and then obtains the horizontal light by the fluorescent and/or white light camera in the optical imaging module 1 to obtain a fluorescent and/or white light image.

In this specific embodiment, the upper computer 3 is connected to the gamma detector module 2 and the optical imaging module 1, respectively, to perform data acquisition control, information acquisition, image reconstruction, and preprocessing, and the upper computer 3 sends the obtained gamma image and optical image to the display device 4 for display.

Compared with the prior art, the multimode display equipment provided by the invention has the following technical effects:

the gamma detector module 2 and the optical imaging module 1 are integrated on the equipment shell 6, so that the consistency of the imaging FOV is realized, and the gamma imaging state and the fluorescence and/or white light imaging state of the object to be detected at the same position can be simultaneously obtained through the multi-mode imaging equipment;

second, when needs exclusive use optical imaging module 1, can realize optical imaging module 1 and equipment casing 6's quick separation, make things convenient for the operation personnel exclusive use optical imaging module 1 to develop alone, be convenient for respectively exclusive use optical imaging module 1 or gamma detector module 2, in order to satisfy the development needs of different occasions from this, improve the adaptability of device.

In particular, in order to optimize the spatial structure of the device housing 6 and make it compact, the steering mirror group may be composed of one or several lenses, and a mirror 51.

In this embodiment, the steering lens group includes:

a horizontal lens 52 provided on the lower bottom surface of the apparatus case 6;

a vertical lens 53 disposed near one side of the optical imaging module 1;

a mirror 51 disposed at a predetermined angle to the horizontal lens 52. The horizontal light emitted by the optical imaging module 1 is irradiated to the object to be detected through the vertical lens 53, the reflecting mirror 51 and the horizontal lens 52, and the vertical fluorescent/white light emitted by the object to be detected enters the optical imaging module 1 through the horizontal lens 52, the reflecting mirror 51 and the vertical lens 53. Wherein the preset angle is typically set to 45 °. Preferably, in another embodiment, the steering mirror group can be only arranged as the reflecting mirror 51, and the two-dimensional optical image of the object to be inspected can be acquired by arranging the angle between the reflecting mirror 51 and the optical imaging module 1 and the object to be inspected.

It will be appreciated that in the above described embodiment, the optical imaging module 1 is preferably arranged in a horizontal orientation for ease of positioning during use. More preferably, when gamma imaging and optical imaging can be simultaneously imaged to the same object to be examined, in order to guarantee the uniformity of imaging FOV, optical imaging module 1 is arranged along the direction perpendicular to gamma detector module 2, so that the device is compact in space structure, small in occupied placement space and high in space utilization rate. In other embodiments, the position relationship between the optical imaging module and the gamma detector module can be set according to the requirement, and will not be described herein.

Further, in order to mount the steering mirror group, the apparatus housing 6 includes:

a horizontal lens 52 mounting hole arranged on the lower bottom surface of the device shell 6, wherein a mounting boss for supporting the horizontal lens 52 is arranged on the horizontal lens 52 mounting hole;

and/or, a vertical lens 53 mounting groove provided on a vertical sidewall of the device housing 6; the horizontal lens 52 is a hollow through hole penetrating the wall thickness direction of the device case 6. The circumferential inner wall of the mounting hole of the horizontal lens 52 is provided with a mounting boss which is arranged in a surrounding manner, and the upper surface of the mounting boss is in contact with and limited by the lower surface of the horizontal lens 52 so as to be convenient to disassemble and assemble when the horizontal lens 52 needs to be replaced. In another embodiment, the mounting groove of the vertical lens 53 is arranged along the vertical direction, for example, a limiting cavity is arranged on the vertical sidewall, and the vertical lens 53 is mounted in an inserting manner.

And/or, the hollow mounting rack is fixedly connected with the side wall of the equipment shell 6 in a detachable mode, the hollow mounting rack comprises two hollow frames which are arranged in parallel to form a limiting cavity, and the reflector 51 slides into the limiting cavity from outside to inside to be fixed. Furthermore, in order to mount the reflector 51, a limiting cavity is formed by two hollow frames arranged in parallel, it can be understood that the bottom edge of each hollow frame is sealed to prevent the reflector 51 from sliding off, preferably, only one entrance is provided, and the edges of the other hollow frames are sealed.

In this embodiment, in order to facilitate the individual use of the optical imaging module 1, the optical imaging module 1 is detachably and fixedly connected to the apparatus housing 6. Such as a plug-in connection, screw fastening, etc., thereby facilitating the separation of the optical imaging module 1 from the device housing 6. When the optical imaging function is needed to be used independently, the direction F in the figure 4 is pulled out, and the object to be detected can be imaged independently according to the requirement of a user. The multi-mode simultaneous imaging state can be restored by direct insertion. Thereby adapting to more occasions to ensure the flexibility of the application of the equipment.

Further, in order to ensure the degree of stability of the optical imaging module 1 and the apparatus housing 6 when connected, the apparatus housing 6 further includes:

the fixing portion 61 is used for fixing the optical imaging module 1, the fixing portion 61 includes an insertion hole 611 used for contacting and limiting with the outer wall of the optical imaging module 1, and a damping member used for contacting with the outer wall of the optical imaging module 1 to increase frictional resistance is arranged on the inner wall of the insertion hole 611.

The damping member causes the fixing portion 61 and the optical imaging module 1 to be interference-fitted to achieve insertion. The shape of the insertion hole 611 is set according to the shape of the optical imaging module 1, such as a circular hole, a square hole, or an elliptical hole. The fixing portion 61 is preferably provided integrally with the device case 6 to facilitate the production process. The damping members are preferably disposed in a direction parallel to the axis of the insertion hole 611 and uniformly disposed along the inner wall of the insertion hole 611. Specifically, the damping member is a damping rubber strip 612. The damping rubber strip 612 is in a long strip shape, the damping rubber strip 612 and the insertion hole 611 are preferably arranged in an adhesion mode, the contact area between the damping rubber strip 612 and the optical imaging module 1 is increased through the arrangement of the damping piece, the friction resistance is increased, and the insertion stability is improved.

Furthermore, the fixing portion 61 further includes a limiting hole penetrating the wall thickness of the fixing portion 61; be equipped with the joint arch on optical imaging module 1's the outer wall, the bellied one end of joint is fixed with optical imaging module 1, the other end is for can taking place elastic deformation's free end, the bellied surface of joint be equipped with can with spacing hole complex fixture block to at optical imaging module 1 grafting in-process, the compression free end realizes the joint until fixture block and spacing hole cooperation.

When using, compressible free end makes it take place elastic deformation, and the protruding inner wall contact installation with spliced eye 611 of joint, inserts to spacing downthehole realization joint when the fixture block removes to spacing hole department in the installation, and free end compresses tightly fixture block and spacing hole through elasticity this moment for the fixed position of module in spliced eye 611 should be shaped.

Wherein the vertical lens 53 is provided on the fixing portion 61 to be close to the optical imaging module 1.

The device enables an operator to simultaneously carry out gamma imaging and fluorescence and/or white light imaging on the object to be detected at the same position in the using process, can quickly and accurately position sentinel lymph nodes through combined imaging, provides more accurate open type operation navigation for doctors, can also independently use the optical imaging module 1 or the gamma detector module 2, can be suitable for various occasions, and has a simple structure, and is convenient for batch production.

As shown in fig. 1, fig. 1 is a schematic structural diagram of a multi-mode imaging device according to an embodiment of the present invention. Based on the multi-mode display device provided in the above embodiment, the present invention further provides a multi-mode display system, which includes an upper computer 3, a display device 4 and the multi-mode display device of any one of the above embodiments; the upper computer 3 is used for controlling the gamma detector module 2 and the optical imaging module 1 of the multimode imaging equipment to carry out data acquisition and image processing, and the optical imaging module 1 and the gamma detector module 2 are respectively connected with the upper computer 3; the upper computer 3 is connected with the display device 4 to send the generated gamma image and the two-dimensional optical image of the object to be detected to the display device 4 for displaying.

Preferably, the multimode imaging device can be applied to the operation area in a handheld mode for visualization observation; in order to facilitate the single-hand operation of doctors, the device can be accurately positioned in the operation area for stable observation and can also be fixed on a mechanical connecting arm.

In the above embodiment, the gamma detector module 2 and the optical imaging module 1 are respectively provided with a communication line to connect the upper computer 3, and the upper computer 3 can be set as an industrial personal computer, a desktop computer, or the like. In order to facilitate the observation of the gamma imaging state and the optical imaging state respectively, the gamma detector module 2 and the optical imaging module 1 of the multi-mode imaging device can be connected with a display device 4 through an upper computer 3 respectively so as to facilitate the independent observation of the gamma image and the fluorescence and/or white light image of the object to be detected at the same position; the gamma detector module 2 and the optical imaging module 1 can also be connected with the same display device 4 through the upper computer 3 so as to observe the gamma image and the fluorescence and/or white light image of the object to be detected at the same position at the same time.

Since the multi-mode display system employs the multi-mode display device in the above embodiment, please refer to the above embodiment for the advantageous effect of the multi-mode display system.

The device and the system provided by the invention can assist the practice of precise surgery and individualized medical treatment, and have certain economic and social significance.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.