阅读说明：本技术 基于fpm的显微成像系统 (FPM-based microscopic imaging system ) 是由 戴琼海 张雅琳 范静涛 于 2019-08-12 设计创作，主要内容包括：本发明公开了一种基于FPM的显微成像系统,包括：数字微反射镜和微透镜阵列；激光器,用于发射光线到所述数字微反射镜,使得所述数字微反射镜反射光线到所述透镜阵列；照明物镜,用于在所述微透镜阵列将平面波转换为球面波,并透射光线至所述照明物镜后,将所述球面波转换为平面波,并照射至放置在载物孔上的成像物体进行成像。根据本发明实施例的系统,可以利用数字微反射镜和微透镜阵列的配合实现不同角度照明待测样本,使成像仪器获取低分辨率图像,随后利用FPM算法进行迭代重建,提高图像分辨率,相当于高倍物镜的分辨率且具有更宽的视场,提高系统的能量,降低信噪比,提升成像速度。(The invention discloses a micro-imaging system based on FPM, comprising: a digital micromirror and a microlens array; a laser for emitting light to the digital micro-mirror so that the digital micro-mirror reflects the light to the lens array; and the illumination objective lens is used for converting the plane wave into the spherical wave in the micro lens array, transmitting light to the illumination objective lens, converting the spherical wave into the plane wave, and irradiating an imaging object placed on the object carrying hole for imaging. According to the system provided by the embodiment of the invention, the digital micro-mirror and the micro-lens array are matched to realize illumination of the sample to be measured at different angles, so that the imaging instrument acquires a low-resolution image, and then the FPM algorithm is used for iterative reconstruction, thereby improving the image resolution, being equivalent to the resolution of a high-power objective lens and having a wider field of view, improving the energy of the system, reducing the signal-to-noise ratio and improving the imaging speed.)

1. An FPM-based microscopy imaging system, comprising:

A digital micromirror and a microlens array;

A laser for emitting light to the digital micro-mirror so that the digital micro-mirror reflects the light to the lens array; and

And the illumination objective lens is used for converting the plane waves into spherical waves by the micro-lens array, transmitting light rays to the illumination objective lens, converting the spherical waves into the plane waves, irradiating the plane waves to an imaging object placed on the object carrying hole, and performing iterative reconstruction by using an FPM algorithm to obtain an imaging result.

2. The system of claim 1, further comprising:

And the beam expander is used for expanding the emitted light and irradiating the emitted light to the digital micro-reflector.

3. the system of claim 1, wherein the laser is a monochromatic laser.

4. The system of claim 1, wherein the micromirror block of the digital micromirror faces the laser at 12 ° pitch or faces away from the laser at 12 °.

5. the system of claim 4, wherein the microlens array is divided into n blocks.

6. The system of claim 5, wherein the center of each microlens of the microlens array corresponds to the center position of each of the n zones.

7. The system according to claim 5 or 6, wherein the n blocks correspond to n angles of parallel light irradiated to the imaging object, respectively.

8. The system of claim 1, wherein a back focal plane of the microlens array coincides with a front focal plane of the illumination objective, and the imaging subject coincides with a back focal plane of the illumination objective.

9. The system of claim 1, wherein the center of the object-carrying aperture coincides with the center of the imaging subject for illuminating light at different angles to the imaging subject.

10. The system of claim 1, wherein the center point of the imaged object is on the same axis as the center of the illumination objective and the center of the microlens array.

Technical Field

the invention relates to the technical field of microscopic imaging, in particular to a microscopic imaging system based on FPM.

Background

Disclosure of Invention

the present invention is directed to solving, at least to some extent, one of the technical problems in the related art.

Therefore, the invention aims to provide a micro-imaging system based on FPM, which has the characteristics of high illumination energy and signal-to-noise ratio and can be suitable for a micro-illumination system matched with the micro-imaging system based on FPM.

In order to achieve the above object, an embodiment of the present invention provides a FPM-based microscopic imaging system, including: a digital micromirror and a microlens array; a laser for emitting light to the digital micro-mirror so that the digital micro-mirror reflects the light to the lens array; and the illumination objective lens is used for converting the plane waves into spherical waves by the micro-lens array, transmitting light rays to the illumination objective lens, converting the spherical waves into the plane waves, irradiating the plane waves to an imaging object placed on the object carrying hole, and performing iterative reconstruction by using an FPM algorithm to obtain an imaging result.

the FPM-based microscopic imaging system can realize illumination of a sample to be detected at different angles by using the cooperation of the digital micro-mirror and the micro-lens array, so that an imaging instrument acquires a low-resolution image, then iterative reconstruction is performed by using an FPM algorithm, the image resolution is improved, the FPM-based microscopic imaging system is equivalent to the resolution of a high-power objective lens and has a wider field of view, the energy of the system is improved, the signal-to-noise ratio is reduced, the imaging speed is improved, and the FPM-based microscopic imaging system has the characteristics of high illumination energy and signal-to-noise ratio and is suitable for a microscopic illumination system matched.

In addition, the FPM-based microscopy imaging system according to the above embodiment of the present invention may also have the following additional technical features:

further, in an embodiment of the present invention, the method further includes: and the beam expander is used for expanding the emitted light and irradiating the emitted light to the digital micro-reflector.

Optionally, in one embodiment of the invention, the laser is a monochromatic laser.

Optionally, in one embodiment of the invention, the micromirror block of the digital micromirror is tilted 12 ° facing the laser, or 12 ° back facing the laser.

Alternatively, in one embodiment of the present invention, the microlens array may be divided into n blocks.

In an embodiment of the present invention, a center of each microlens of the microlens array corresponds to a center position of each of the n blocks, respectively.

Further, in one embodiment of the present invention, the n blocks correspond to n angles of parallel light irradiated to the imaging object, respectively.

further, in one embodiment of the present invention, a back focal plane of the microlens array coincides with a front focal plane of the illumination objective, and the imaging object coincides with a back focal plane of the illumination objective.

Further, in one embodiment of the present invention, the center of the object carrying hole coincides with the center of the imaging object for illuminating light rays to the imaging object at different angles.

In addition, in one embodiment of the present invention, the center point of the imaging object is on the same axis as the center of the illumination objective and the center of the microlens array.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

Fig. 1 is a schematic structural diagram of an FPM-based microscopy imaging system according to an embodiment of the present invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.

The following describes a proposed FPM-based microscopic imaging system according to an embodiment of the present invention with reference to the accompanying drawings

Fig. 1 is a schematic structural diagram of an FPM-based microscopy imaging system according to an embodiment of the present invention.

As shown in fig. 1, the FPM-based microscopy imaging system includes: digital micro-mirror 100, micro-lens array 200, laser 300 and illumination objective 400.

Wherein the laser 300 emits light to the digital micro-mirrors 100 such that the digital micro-mirrors 100 reflect the light to the lens array. The illumination objective lens 400 converts the plane waves into spherical waves in the micro lens array 200, transmits light to the illumination objective lens 400, converts the spherical waves into the plane waves, and irradiates an imaging object placed on the object carrying hole, so that iterative reconstruction is performed by using an FPM algorithm to obtain an imaging result. The system provided by the embodiment of the invention has the characteristics of high illumination energy and signal-to-noise ratio, and is suitable for a micro-illumination system matched with a micro-imaging system based on FPM.

Further, in an embodiment of the present invention, the system of the embodiment of the present invention further includes: a beam expander 500500. Wherein, the beam expander 500 expands and irradiates the emitted light to the digital micromirror 100.

Specifically, the light emitted from the optical device passes through the beam expander 500 to the digital micromirror 100; the digital micromirror 100 reflects light to the lens array; the micro lens array 200 converts the plane wave into a spherical wave, collects energy and transmits light to the illumination objective 400, thereby increasing illumination energy of the single-path direction light; the illumination objective lens 400 converts spherical waves into plane waves, and irradiates an object placed on the object hole for imaging.

The system of the embodiment of the invention can realize a plurality of low-resolution images under different angles of illumination, then utilizes the FPM algorithm to carry out iterative reconstruction, can improve the image resolution, is equivalent to the resolution of a high-power objective lens and has a wider field of view, utilizes the cooperation of the digital micro-mirror 100 and the micro-lens array 200 to improve the energy of light in each path of direction, reduces the signal-to-noise ratio and improves the imaging speed.

Alternatively, in one embodiment of the present invention, the laser 300 may be a monochromatic laser 300, for example, the wavelength of the laser 300 may be 532nm, and the magnification of the beam expander 500 is 5-10.

Alternatively, in one embodiment of the present invention, the micromirror block of the digital micromirror 100 faces the laser 300 at 12 degrees in elevation, or faces the laser 300 at 12 degrees in elevation, and the microlens array 200 may be divided into n blocks, for example, the digital micromirror 100 is a 1920 × 1200 array with a total size of 102mm × 83mm, and each digital micromirror 100 is 10.8 μm × 10.8 μm in size

Further, in an embodiment of the present invention, the center of each microlens of the microlens array 200 corresponds to the center position of each of the n blocks, respectively. For example, the microlens array 200 may be a custom aluminum alloy based microlens array 200 with a magnification of 10 x the illumination objective 400 and a numerical aperture of 0.16, wherein the specimen 700 is placed on a stage 600 with an object aperture.

It is understood that the micromirror block in the digital micromirror 100 faces the laser 300 by 12 ° or faces away from the laser 300 by 12 °, the entire microlens array 200 may be divided into n blocks, and the center of each microlens in the microlens array 200 corresponds to the center position of each block of the n blocks, respectively.

Further, in one embodiment of the present invention, the n blocks correspond to n angles of parallel light irradiated to the imaging object, respectively. That is, the n blocks correspond to n angles of parallel light irradiated to the sample 700, respectively.

further, in one embodiment of the present invention, the back focal plane of the microlens array 200 coincides with the front focal plane of the illumination objective 400, and the imaged object coincides with the back focal plane of the illumination objective 400. It will be appreciated that the back focal plane of the microlens array 200 coincides with the front focal plane of the illumination objective 400. The illuminated sample 700 coincides with the back focal plane of the illumination objective 400.

Further, in one embodiment of the present invention, the center of the carrier hole coincides with the center of the imaging object for illuminating light to the imaging object at different angles. It will be appreciated that the center of the carrier aperture coincides with the center of the sample 700 for illuminating light at different angles to the sample 700.

In addition, in one embodiment of the present invention, the center point of the imaged object is on the same axis as the center of the illumination objective 400 and the center of the microlens array 200. That is, the center point of the imaged object is on the same axis as the center of the illumination objective lens 400 and the center of the entire microlens array 200.

specifically, light emitted by the laser 300 is incident on the digital micromirror 100 through the beam expander, the digital micromirror 100 is programmed to form n blocks, the n blocks correspond to each lens in the microlens array 200 respectively, the programmed digital micromirror 100 is regulated and controlled in sequence, so that the light passing through one block in the digital micromirror is reflected to the corresponding lens in the microlens array 200, the light passes through the microlens array 200 and is projected to the illumination objective 400, the light passes through the illumination objective 400 and is irradiated to the sample 700 at different angles, the imaging instrument is enabled to obtain a low-resolution image, iterative reconstruction is performed by using the FPM algorithm, the image resolution can be improved, and the image resolution is equivalent to the resolution of a high-power objective and has a wider field of view. The system can improve the energy of the directional light illumination system, reduce the signal to noise ratio and improve the imaging speed.

The imaging principle of the system of the embodiment of the present invention is described in detail below.

step S1: emitting light from a light source of laser 300 to digital micromirror 100;

Step S2: programming digital micro-mirror 100 (which may include digital micro-mirror base 101 and digital micro-mirror support 102) into n blocks, one for each lens in micro-lens array 200;

Step S3: by regulating and controlling the programmed digital micro-mirror 100, light passing through one block in the digital micro-mirror is reflected to the corresponding lens in the micro-lens array 200;

step S4: the light is projected to the illumination objective 400 through the microlens array 200;

Step S5: the light passes through the illumination objective 400 and is irradiated onto the sample 700 at an angle, so that the imaging instrument acquires a low-resolution image;

step S6: repeating the step S3, by sequentially adjusting the programmed digital micromirrors 100, so that the light passing through each block in the digital micromirrors is respectively reflected to the corresponding lens in the microlens array 200, and repeating the step S4;

Step S7: the light rays respectively irradiate onto the sample 700 at different angles through the illumination objective 400, and the imaging instrument acquires a plurality of low-resolution images through the imaging objective 800;

Step S8: and performing iterative reconstruction by using an FPM algorithm, improving the image resolution and acquiring a high-resolution image.

The wavelength of a light source of the laser 300 is 532nm, the output power is 4-6w, the diameter of a light beam is 3mm, and the magnification of the beam expander 500 is multiplied by 5. The digital micro-mirrors 100 are a high-reflection aluminum micro-mirror array, each micro-mirror can be controlled to face towards the light source 12 degrees or face away from the light source 12 degrees under the action of a micro hinge, the selected digital micro-mirrors 100 are 1920 × 1200 arrays, the total size of the micro-mirrors is 102mm × 83mm, the size of each micro-mirror is 10.8 μm × 10.8 μm, the digital micro-mirrors 100 are programmed to form 64 blocks, each block is 240 × 150 arrays, corresponding to 64 micro-lenses, and the center of each lens corresponds to the center of each block of the digital micro-mirrors 100. The illumination objective 400 has a magnification × 10 and a numerical aperture of 0.16.

Every 240 × 150 reflectors in the digital micro-reflectors 100 are set as a block, the micro-reflectors in the block are in positions facing the light source, other reflectors are in positions facing away from the light source, and the exposure is in the best state through light source adjustment to acquire images. And sequentially setting the position of each block reflector facing the light source, thus finishing the acquisition of 64 images, performing iterative reconstruction by using an FPM algorithm, improving the image resolution and acquiring a high-resolution image.

In summary, the FPM-based microscopic imaging system according to the embodiment of the present invention can utilize the cooperation of the digital micro-mirror and the micro-lens array to realize illumination of a sample to be measured at different angles, so that an imaging instrument acquires a low resolution image, and then performs iterative reconstruction by using the FPM algorithm, thereby improving the image resolution, which is equivalent to the resolution of a high power objective lens and has a wider field of view, improving the energy of the system, reducing the signal-to-noise ratio, and increasing the imaging speed.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "N" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more N executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of implementing the embodiments of the present invention.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or N wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.