阅读说明：本技术 血管减影图像的显示方法及图形用户界面装置 (Display method of blood vessel subtraction image and graphical user interface device ) 是由 张丽娅 方建国 解毅 孙赫熠 于 2018-07-24 设计创作，主要内容包括：本申请提供了一种血管减影图像的显示方法及图形用户界面装置。该显示方法包括在第一显示区域上显示被检测对象的参考图像；在进行血管造影的过程中,在第二显示区域上显示被检测对象的实时减影图像,并在第三显示区域上显示与实时减影图像相对应的实时透视图像,以形成第一显示状态；以及基于参考图像切换信号切换第一显示区域上显示的图像。(The application provides a display method of a blood vessel subtraction image and a graphical user interface device. The display method includes displaying a reference image of a detected object on a first display area; in the process of carrying out angiography, displaying a real-time subtraction image of the detected object on the second display area, and displaying a real-time perspective image corresponding to the real-time subtraction image on the third display area to form a first display state; and switching the image displayed on the first display region based on the reference image switching signal.)

1. A method of displaying a vessel subtraction image, comprising:

displaying a reference image of the detected object on the first display area;

in the process of angiography, displaying a real-time subtraction image of the detected object on a second display area, and displaying a real-time perspective image corresponding to the real-time subtraction image on a third display area to form a first display state; and

switching an image displayed on the first display area based on a reference image switching signal.

2. The display method according to claim 1, wherein the reference image is selected from at least one image among images displayed on the second display region.

3. The display method according to claim 2, wherein the reference image is automatically copied onto the first display region or is copied onto the first display region based on a screen switching signal.

4. The display method according to claim 1, wherein the third display region is displayed on a corner of the first display region.

5. The display method according to claim 1, wherein the switching the image displayed on the first display region based on the reference image switching signal includes:

and in the process of angiography, the third display area is closed based on the reference image switching signal, and the real-time perspective image is displayed on the first display area to form a second display state.

6. The display method according to claim 5, wherein the first display state and the second display state are alternately switched based on the reference image switching signal during angiography.

7. The display method according to claim 1 or 5, comprising:

and after the angiography process is finished, closing the third display area, displaying the reference image in the first display area, and playing back a set of all real-time subtraction images displayed in the angiography process in the second display area to form a third display state.

8. The display method of claim 7, wherein the playing back the set of all real-time subtracted images displayed during an angiogram in the second display region comprises automatically playing back the set of real-time subtracted images in the second display region or playing back the set of real-time subtracted images in the second display region based on a playback control signal.

9. The display method according to claim 7, wherein the switching the image displayed on the first display region based on the reference image switching signal includes:

and displaying a set of real-time perspective images corresponding to the set of real-time subtraction images on the first display area based on the reference image switching signal to form a fourth display state after the angiography process is finished.

10. The display method according to claim 9, wherein the third display state and the fourth display state are alternately switched based on the reference image switching signal after an end of an angiography procedure.

11. A graphical user interface device, comprising:

a display unit which comprises a first display area, a second display area and a third display area, wherein in a first display state, the first display area is configured to display a reference image of a detected object, the second display area is configured to display a real-time subtraction image of the detected object, and the third display area is configured to display a real-time perspective image corresponding to the real-time subtraction image; and

an operation unit connected with the display unit, and the operation unit or the display unit is configured to transmit a reference image switching signal to switch an image displayed on the first display region.

12. A gui arrangement according to claim 11, wherein the third display area is located at a certain corner of the first display area.

13. The graphical user interface device as set forth in claim 11 wherein the reference image is selected from at least one of the images displayed on the second display area.

14. The gui apparatus of claim 13, wherein the reference image is automatically copied onto the first display region, or is copied onto the first display region based on a screen switching signal transmitted from the display unit or the operation unit.

15. The graphical user interface device of claim 11, wherein the display unit is in a second display state, the third display region is closed, the live perspective image is displayed on the first display region, and the live subtraction image is displayed on the second display region.

16. The gui apparatus of claim 15, wherein the operation unit or the display unit is configured to transmit the reference image switching signal to alternately switch the first display state and the second display state during angiography.

17. The graphical user interface device of claim 11, wherein in a third display state, the third display region is closed, the reference image is displayed on the first display region, and a set of all real-time subtraction images displayed during angiography is played back in the second display region.

18. The graphical user interface device of claim 17, wherein the set of real-time subtraction images is automatically played back in the second display region or played back in the second display region based on a playback control signal transmitted by the display unit or the operation unit.

19. The graphical user interface device of claim 17, wherein the display unit, in a fourth display state, the third display region is closed, the set of real-time subtracted images is played back in the second display region, and the set of real-time perspective images corresponding to the set of real-time subtracted images is displayed on the first display region.

20. The graphical user interface device of claim 19, wherein the operation unit or the display unit is configured to send the reference image switching signal to alternately switch the third display state and the fourth display state after an angiography procedure is ended.

Technical Field

The invention relates to the field of medical detection, in particular to a display method of a blood vessel subtraction image and a graphical user interface device.

Background

Vascular disease is one of the major diseases that seriously affect human health, and obtaining accurate images of the blood vessels of patients is of great significance for diagnosis and treatment. Angiography (DSA) is a diagnostic technique currently developed for the more mature vascular diseases. The angiography technique may be applied in a C-arm system, a Computed Tomography (CT) system, a Magnetic Resonance Imaging (MRI) system, and the like.

In a C-arm system, a perspective image of a detected object can be obtained by an X-ray imaging method, and a subtraction image of a blood vessel is obtained based on a subtraction algorithm, generally, a display of the C-arm system includes a left screen and a right screen which are equal in size, and during or after the angiography of the blood vessel, the real-time subtraction image of the blood vessel is generally required to be displayed on the left screen, and a corresponding perspective image is displayed on the right screen, so that a user can conveniently perform related comparison. However, in practical applications, sometimes the real-time subtraction image needs to be compared with a reference image (for example, a blood vessel subtraction image before the same detected object) to determine whether the blood vessel of the detected object has changed. Sometimes it is also often necessary to compare the real-time subtraction image with both the reference image and the fluoroscopic image. Sometimes, it is often necessary to play back a movie (cine) saved during the previous subtraction of the blood vessel image.

Disclosure of Invention

The invention provides a display method of a blood vessel subtraction image and a graphical user interface device.

An exemplary embodiment of the present invention provides a display method of a blood vessel subtraction image, the display method including displaying a reference image of a detected object on a first display area; in the process of angiography, displaying a real-time subtraction image of the detected object on a second display area, and displaying a real-time perspective image corresponding to the real-time subtraction image on a third display area to form a first display state; and switching the image displayed on the first display region based on a reference image switching signal.

Exemplary embodiments of the present invention also provide a graphic user interface device including a display unit and an operation unit. The display unit comprises a first display area, a second display area and a third display area, and the display unit has a first display state, in the first display state, the first display area is configured to display a reference image of a detected object, the second display area is used to display a real-time subtraction image of the detected object, and the third display area is used to display a real-time perspective image corresponding to the real-time subtraction image. The operation unit is connected with the display unit, and the operation unit or the display unit is configured to send a reference image switching signal to switch the image displayed on the first display area.

Other features and aspects will become apparent from the following detailed description, the accompanying drawings, and the claims.

Drawings

The invention may be better understood by describing exemplary embodiments thereof in conjunction with the following drawings, in which:

FIG. 1 is a schematic view of an imaging system according to some embodiments of the invention;

fig. 2 is a schematic view according to a first display state of a display unit in the imaging system shown in fig. 1;

fig. 3 is a schematic view according to a second display state of the display unit in the imaging system shown in fig. 1;

fig. 4 is a schematic view according to a third display state of the display unit in the imaging system shown in fig. 1;

fig. 5 is a schematic view according to a fourth display state of the display unit in the imaging system shown in fig. 1;

fig. 6 is a flowchart showing a display method of a blood vessel subtraction image according to the first embodiment of the present invention;

fig. 7 is a flowchart showing a display method of a blood vessel subtraction image according to a second embodiment of the present invention; and

fig. 8 is a flowchart showing a method of displaying a blood vessel subtraction image according to a third embodiment of the present invention.

Detailed Description

While specific embodiments of the invention will be described below, it should be noted that in the course of the detailed description of these embodiments, in order to provide a concise and concise description, all features of an actual implementation may not be described in detail. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions are made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.

Unless otherwise defined, technical or scientific terms used in the claims and the specification should have the ordinary meaning as understood by those of ordinary skill in the art to which the invention belongs. The use of "first," "second," and similar terms in the description and claims of the present application do not denote any order, quantity, or importance, but rather the terms are used to distinguish one element from another. The terms "a" or "an," and the like, do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprise" or "comprises", and the like, means that the element or item listed before "comprises" or "comprising" covers the element or item listed after "comprising" or "comprises" and its equivalent, and does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, nor are they restricted to direct or indirect connections.

Although in the present description the display method and graphical user interface device are applied in a C-arm imaging system, it should be noted that from the perspective of a person of ordinary skill in this or a related art, such description should not be construed as limiting the present invention to a C-arm imaging system, and indeed, the display method and graphical user interface device described herein may be applied reasonably in other related applications, such as CT systems, MRI systems, etc.

FIG. 1 illustrates a schematic diagram of an imaging system 10 according to some embodiments of the invention. As shown in FIG. 1, the imaging system 10 includes an X-ray source 21 for emitting X-rays, a detector 22 for detecting an attenuated X-ray signal passing through a subject, and a graphical user interface device 30. The X-ray source 21 and the detector 22 are connected via a C-arm unit 25. The detected object includes a human body or any object that can be imaged. The detector 22 comprises a semiconductor image sensor, such as a transistor using amorphous silicon or a cesium iodide phosphor (scintillator) on a photodiode array, a Charge-coupled device (CCD) sensor or other detector that can convert X-rays directly into a digital signal. Fig. 1 shows only a planar configuration of the detector 22, however, it will be appreciated by those skilled in the art that the detector 22 may be provided as a curved surface or other suitable shape.

The graphical user interface device 30 comprises a display unit 42 and an operating unit 40 connected to the display unit 42. As shown in fig. 1, the display unit 42 includes a first display area 101, a second display area 102 and a third display area 103, in some embodiments, the first display area 101 is adjacent to the second display area 102 and has the same size, the third display area 103 is located at a certain corner of the first display area 101, preferably, the third display area 103 is located at the upper right corner of the first display area 101, and in other embodiments, the third display area 103 may be located at any suitable position in the display unit 42. In some embodiments, the display unit 42 includes two displays placed left and right, the first display region 101 being located in one display, the second display region 102 and the third display region 103 being located in the other display. In another embodiment, the display unit 42 comprises one display, and the three display areas may be located in the same display. The three display areas on the display unit 42 may be configured to display different images, for example, simultaneously displaying a real-time subtraction image, a reference image, a real-time perspective image, and/or other types of images, to facilitate comparison of conditions of the detected object, such as blood vessels, for more effective diagnosis and/or treatment, providing a reference to the user during the procedure. In some embodiments, the display unit 42 may be, for example, a computer screen, a monitor, a flat panel screen, a plasma screen, or any other known type of display device.

In some embodiments, the operation unit 40 or the display unit 42 is configured to send a reference image switching signal to switch the image displayed on the first display region 101 on the display unit 42, for example, to zoom the image on the third display region to be displayed on the first display region, etc., so that the user can make a comparison between different images as desired. In some embodiments, the operation unit 40 or the display unit 42 includes an image switching module (e.g., a switching key), and each time the switching key is pressed, which is equivalent to sending a reference image switching signal to the display unit, the image displayed on the first display region is switched once, that is, the display state is switched once, and when the switching key is pressed repeatedly, the image displayed on the first display region 101 is switched repeatedly. In some embodiments, the operation unit 40 may be provided on the display unit 42 to facilitate control of the display unit 42. In some embodiments, the operating unit 40 may include some form of operator interface such as a keyboard, mouse, voice-activated controller, or any other suitable input device.

In some embodiments, graphical user interface device 30 further includes a computer 36 and a storage unit 38. A computer 36 is connected to the C-arm unit 25 for controlling operations such as the movement and/or rotation of the X-ray source 21 and the detector 22. The computer 36 is further connected to an image reconstruction unit or image processing unit (not shown) for receiving a fluoroscopic image reconstructed based on projection data transmitted from the detector 22, a subtraction image obtained by performing subtraction or the like on the fluoroscopic image, or the like. The computer 36 is further connected to a storage unit 38 for storing said fluoroscopic and/or subtraction images and/or movies (cine) recorded during the radiography, etc. The computer 36 is further connected to a display unit 42 and presents the fluoroscopic image and/or the subtraction image to the user via the display unit 42. The computer 36 is further connected to an operation unit 40 for receiving commands, control signals or scanning parameters etc. transmitted by a user for controlling one or more of the units or modules of the C-arm unit 25, the display unit 42, the storage unit 38 etc. to perform the relevant operations.

Although only one operation unit 40 is shown in fig. 1, a plurality of operation units may be connected to the computer 36, for example, for inputting or outputting system parameters, requesting examination and/or viewing of images, operating display parameters of the display unit, and the like. Moreover, in certain embodiments, system 10 may be connected to one or more display units, printers, workstations, and/or the like, located locally or remotely, via one or more configurable wired and/or wireless networks, such as the internet and/or a virtual private network.

FIG. 2 illustrates a first display state 110 of the display unit 42 according to 10 in the imaging system shown in FIG. 1; FIG. 3 illustrates a second display state 120 according to the display unit 42 shown in FIG. 1; FIG. 4 illustrates a third display state 130 according to the display unit 42 shown in FIG. 1; fig. 5 shows a fourth display state 140 according to the display unit 42 shown in fig. 1. As shown in fig. 2-5, the first display state 110 and the second display state 120 are two display states of the display unit 42 during angiography; the third display state 130 and the fourth display state 140 are two display states of the display unit 42 after the end of the angiographic procedure. The relevant images with the clock as the detected object are only exemplarily shown in fig. 2 to 5, and from the perspective of a person of ordinary skill in the art or the relevant field, such descriptions should not be construed as limiting the detected object of the present invention to only a static object, but the detected object may also be a human body or other objects that can be imaged.

As shown in fig. 2, in the first display state 110, the first display area 101 is configured to display the reference image 51 of the detected object, the second display area 102 is configured to display the live-subtraction image 52 of the detected object, and the third display area 103 is configured to display the live-perspective image 53 corresponding to the live-subtraction image 52. In some embodiments, the real-time fluoroscopic image includes an image obtained by image reconstruction based on projection data of a region of interest of the detected object, or an image obtained by preprocessing the reconstructed image. In some embodiments, the real-time subtraction image 52 is obtained by subtracting a mask (mask) from the real-time perspective image obtained by the imaging system 10 based on a subtraction algorithm, and in the actual application process, the influence of soft tissue and bone can be effectively eliminated by subtraction, and only the blood vessel image is retained.

In some embodiments, the user may select at least one image among the images displayed on the second display area 102 as the reference image 51. In some embodiments, the images displayed in the second display region 102 include the Last Image (Last Image Hold, LIH) displayed in the second display region at the end of the Last angiography, images manually saved by the physician and saved in the storage unit during the angiography, a set of real-time subtraction images (e.g., movies) automatically played back in the second display region after the end of the Last angiography, a set of recorded real-time subtraction images (e.g., movies) saved during the previous angiography, and so on. In some embodiments, during playback of the set of real-time subtraction images, playback of the set of real-time subtraction images may be paused based on a playback pause signal sent by the operating unit or the display unit, with the currently displayed image on the second display region defaulting to the selected reference image.

In some embodiments, the display unit 42 may be configured to automatically copy the selected reference image in the second display region 102 into the first display region 101. In other embodiments, the display unit is configured to copy the reference image onto the first display region 101 based on the screen switching signal transmitted by the display unit 42 or the operation unit 40. In some embodiments, at least one of the display unit and the operation unit may include a screen switching module, for example, a switching key 104 on the display unit 42 as shown in fig. 2, and the reference image selected in the second display region 102 may be copied into the first display region 101 whenever the switching key 104 is pressed.

As shown in fig. 3, in the second display state 120, the third display region 103 is closed, the live perspective image 53 is displayed on the first display region 101, and the live subtraction image 52 is displayed on the second display region. For convenience of description and clarity of display, the display unit 42 shown in fig. 2 and 3 only exemplarily shows a subtraction image and a perspective image at a certain time, however, it should be understood by those skilled in the art that in the first display state and the second display state, the images displayed on the display area are changed in real time according to the cycle time of image acquisition, and it should not be understood that the first display state and the second display state are only limited to the state of displaying a static image at a certain time.

During the angiographic procedure, the display unit 42 may be switched between a first display state 110, as shown in fig. 2, and a second display state 120, as shown in fig. 3, to meet different contrast requirements. In some embodiments, the operation unit or the display unit is configured to transmit a reference image switching signal to alternately switch the first display state 110 and the second display state 120 during the angiography.

As shown in fig. 4, in the third display state 130, the third display region 103 is closed, the reference image 51 is displayed on the first display region 101, and the set 54 of all real-time subtraction images displayed during angiography is played back in the second display region 102. In some embodiments, the set of real-time subtracted images 54 is a movie and is played back on the second display region 102 in the periodic time and order of image acquisition.

In some embodiments, the second display region 102 is configured to automatically playback the set of real-time subtracted images directly after the end of the angiographic procedure. In other embodiments, after the angiography procedure is finished, the second display region 102 still displays the last subtraction image in the angiography procedure, and may play back the set of real-time subtraction images based on a playback control signal transmitted by the display unit or the operation unit.

As shown in fig. 5, in the fourth display state 140, the third display region 103 is closed, the set of real-time subtracted images 54 is played back in the second display region 102, and the set of real-time fluoroscopic images 55 corresponding to the set of real-time subtracted images 54 is displayed on the first display region. In some embodiments, in the fourth display state 140, at any one time, the live perspective image 55 displayed by the first display region always corresponds to the live subtraction image 54 displayed by the second display region in a one-to-one correspondence, that is, when the second display region displays the subtraction image of the 90 th frame, the first display region also displays the perspective image of the 90 th frame. For convenience of description and clarity of display, the subtraction image and the perspective image at a certain time are only exemplarily shown on the display unit 42 shown in fig. 4 and 5, however, it should be understood by those skilled in the art that in the third display state and the fourth display state, the images displayed in the first display region 101 and/or the second display region 102 are changed in real time according to a specific time and sequence, and it should not be understood that the third display state and the fourth display state are limited to the state of displaying a static image at a certain time.

After the end of the angiographic procedure, the display unit 42 may be switched between the third display state 130, as shown in fig. 4, and the fourth display state 140, as shown in fig. 5, to meet different contrast requirements. In some embodiments, the operation unit 40 or the display unit 42 is configured to send a reference image switching signal to alternately switch the third display state 130 and the fourth display state 140 after the end of the angiography procedure.

Fig. 6 shows a flowchart of a method 200 for displaying a blood vessel subtraction image according to a first embodiment of the present invention. As shown in fig. 6, the display method 200 includes steps 210, 220 and 230.

In step 210, a reference image of the detected object is displayed on the first display area. In some embodiments, the reference image is selected from at least one of the images displayed on the second display region. In some embodiments, the images displayed in the second display region include the Last Image (Last Image Hold, LIH) displayed in the second display region at the end of the Last angiography, images manually saved by the physician and saved in the storage unit during the angiography, a set of real-time subtraction images (e.g., movies) automatically played back in the second display region after the end of the Last angiography, a set of recorded real-time subtraction images (e.g., movies) saved during the previous angiography, and so on. In some embodiments, during playback of the set of real-time subtracted images, the current playback may be paused based on a playback pause signal, which corresponds to selecting the image currently displayed in the second display region as the reference image. In some embodiments, the reference image may be set to be automatically copied onto the first display region, or the reference image may be copied onto the first display region based on a screen switching signal.

In step 220, during the angiography, a real-time subtraction image of the detected object is displayed on the second display region, and a real-time perspective image corresponding to the real-time subtraction image is displayed on the third display region to form a first display state. In some embodiments, the real-time subtraction image is obtained by subtracting a mask from a real-time perspective image obtained by an imaging system based on a subtraction algorithm, and in the actual application process, the influence of soft tissues and bones can be effectively eliminated by subtraction, and only the blood vessel image is reserved. In some embodiments, the images in the second display region and the third display region are varied in real time according to the cycle time of image acquisition, and those skilled in the art will understand that the first display state should not be limited to a state in which a static image at a certain time is displayed.

In step 230, the image displayed on the first display region is switched based on the reference image switching signal.

In some embodiments, step 230 includes the steps of:

in step 231, during the angiography, the third display area is turned off based on the reference image switching signal, and the real-time fluoroscopic image is displayed on the first display area to form a second display state. In some embodiments, the images in the first display region and the second display region are varied in real time according to the cycle time of image acquisition, and those skilled in the art will appreciate that the second display state should not be limited to a state in which a static image at a certain time is displayed.

In step 232, the first display state and the second display state are alternately switched based on the reference image switching signal during the angiography.

Fig. 7 shows a flowchart of a method 300 for displaying a blood vessel subtraction image according to a second embodiment of the present invention. As shown in fig. 7, unlike the display method 200 shown in fig. 6, in the display method 300, the step 330 of switching the image displayed on the first display region based on the reference image switching signal is different from the step 230 shown in fig. 2, and between the steps 220 and 330, the step 340 is included:

in step 340, after the angiography procedure is finished, the third display region is closed, the reference image is displayed in the first display region, and the set of all real-time subtraction images displayed during the angiography procedure is played back in the second display region to form a third display state. In some embodiments, the set of real-time subtraction images is a playback in the periodic time and order of image acquisition. In some embodiments, the second display region is configured to automatically playback the set of real-time subtraction images during the angiographic procedure when the angiographic procedure is over. In further embodiments, the second display region is configured to display a last subtraction image during the contrast process and to play back the set of real-time subtraction images in accordance with the playback control signal. In some embodiments, the images in the second display region are all varied in real time according to the cycle time of image acquisition, and those skilled in the art will appreciate that the third display state should not be limited to a state in which a static image at a certain time is displayed.

In some embodiments, step 330 comprises:

in step 331, after the end of the angiography procedure, a set of real-time fluoroscopic images corresponding to the set of real-time subtraction images is displayed on the first display area based on the reference image switching signal to form a fourth display state. In some embodiments, at any one time, the real-time fluoroscopic image displayed on the first display region always has a one-to-one correspondence with the real-time subtraction image displayed on the second display region. In some embodiments, the images in the first display region and the second display region are varied in real time according to the cycle time of image acquisition, and those skilled in the art will understand that the fourth display state should not be limited to a state in which a static image at a certain time is displayed.

In step 332, after the end of the angiography procedure, the third display state and the fourth display state are alternately switched based on the reference image switching signal.

Fig. 8 shows a flowchart of a method 400 for displaying a blood vessel subtraction image according to a third embodiment of the present invention. As shown in fig. 8, the display method 400 of fig. 8 is a combination of the display method 200 shown in fig. 6 and the display method 300 shown in fig. 7, and the step 430 of switching the image displayed on the first display region based on the reference image switching signal in fig. 8 includes the steps 230 and 330.

The vessel subtraction image display method provided by the application can display different images in three display areas of a display unit, for example, simultaneously display a real-time subtraction image, a reference image, a real-time perspective image and/or other types of images, so as to facilitate comparison of conditions of a detected object, such as a vessel, for more effective diagnosis and/or treatment, and provide reference for a user during a surgical procedure. Further, the display method proposed by the present application may switch the image in the first display region, so that the image on the third display region may be enlarged onto the first display region for related comparison, for example, as needed.

As used herein, the term "computer" may include any processor-based or microprocessor-based system including systems using microcontrollers, Reduced Instruction Set Computers (RISC), Application Specific Integrated Circuits (ASICs), logic circuits, and any other circuit or processor capable of executing the functions described herein. The above examples are exemplary only, and are thus not intended to limit in any way the definition and/or meaning of the term "computer".

Some exemplary embodiments have been described above, however, it should be understood that various modifications may be made. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in the described systems, architectures, devices, or circuits are combined in a different manner and/or replaced or supplemented by additional components or their equivalents. Accordingly, other embodiments are within the scope of the following claims.