阅读说明：本技术 手术图像处理设备、图像处理方法和手术系统 (Operative image processing equipment, image processing method and surgery systems ) 是由 白木寿一 宫井岳志 高桥健治 于 2018-03-16 设计创作，主要内容包括：该技术涉及：手术图像处理设备,其允许容易地比较软件更新之前和之后的图像；图像处理方法以及手术系统。图像处理单元通过软件对手术部位图像执行图像处理。显示控制单元控制经过图像处理的手术部位图像的显示。图像处理单元生成更新前处理图像和更新后处理图像,所述更新前处理图像是在软件更新之前经过图像处理的手术部位图像,所述更新后处理图像是在软件更新之后经过图像处理的手术部位图像。显示控制单元控制更新前处理图像和更新后处理图像中的至少一个的至少一部分的显示。该技术可应用于内窥镜手术系统的CCU。(The technology is related to: operative image processing equipment, allows the image before and after easily comparison software updates；Image processing method and surgery systems.Image processing unit executes image procossing to operation station diagram picture by software.The display of the operative site image of image procossing is passed through in display control unit control.Image processing unit, which generates to update pre-treatment image and update, post-processes image, the pre-treatment image that updates is the operative site image for passing through image procossing before software upgrading, and the post-processing image that updates is the operative site image for passing through image procossing after software upgrading.Display control unit control updates pre-treatment image and updates at least part of display for post-processing at least one of image.The technology can be applied to the CCU of endoscope surgery system.)

1. a kind of operative image processing equipment, comprising:

Image processing part, by software by image processing application in operative site image；And

Display control section, control apply the display of the operative site image of described image processing, wherein

Described image processing unit, which is generated, is applied to the operation by that will update the described image processing established before the software Position image and the update pre-treatment image that obtains and by the way that the described image processing application established after the software will be updated Image is post-processed in the update that the operative site image obtains, and

The display control section controls at least one of the update pre-treatment image and update post-processing image extremely At least part of display.

2. operative image processing equipment according to claim 1, wherein

Described image processing unit is established after handling and updating the software for the described image established before updating the software Described image processing execute concurrently with each other.

3. operative image processing equipment according to claim 1, wherein

The display control section makes the update pre-treatment image and update post-processing image be simultaneously displayed on a screen In.

4. operative image processing equipment according to claim 3, wherein

The display control section adjusts the update pre-treatment image depending on the user's operation and update post-processing image exists Display size in the screen.

5. operative image processing equipment according to claim 1, wherein

The display control section makes the update pre-treatment image and update post-processing image be shown in different displays and set It is standby upper.

6. operative image processing equipment according to claim 1, wherein

The display control section makes one be easily selected by a user in the update pre-treatment image and the update post-processing image Display.

7. operative image processing equipment according to claim 1, wherein

The display control section post-processes the update pre-treatment image and the update for each pixel with estimated rate Image is added each other to be shown.

8. operative image processing equipment according to claim 1, wherein

The display control section by it is described update pre-treatment image first area and except the first area described in The second area for updating post-processing image is synthesized each other to be shown.

9. operative image processing equipment according to claim 8, wherein

The first area is the region formed and screen is divided into left and right two parts, and

The second area is another region formed and screen is divided into left and right two parts.

10. operative image processing equipment according to claim 8, wherein

The first area be include screen center central area, and

The second area is the peripheral region being located at except the central area in the screen.

11. operative image processing equipment according to claim 8, wherein

Boundary between the first area and the second area is determined by the operation of user.

12. operative image processing equipment according to claim 1, further includes:

Difference calculation part calculates the difference updated between pre-treatment image and the update post-processing image, wherein

In the case where the difference is greater than predetermined value, the display of the information of described display control section control notice such case.

13. operative image processing equipment according to claim 1, further includes:

Scene detection portion, the predetermined scene in detection image, wherein

The display control section, which makes to be directed in the update pre-treatment image and update post-processing image by user, to be detected One display of the scene selection arrived.

14. operative image processing equipment according to claim 13, further includes:

Feature amount extraction module extracts the characteristic quantity of detected scene；And

Recording control part by extracted characteristic quantity and indicates in the update pre-treatment image and update post-processing image The one selection information selected by user for detected scene is interrelated, and by extracted characteristic quantity and described Information is selected to record wherein as historical information.

15. operative image processing equipment according to claim 14, further includes:

Study portion is based on the historical information, learns the user for detected for each characteristic quantity of the scene Scene select the updates pre-treatment image and the update to post-process which of image.

16. operative image processing equipment according to claim 15, further includes:

Reference portion, referring to the learning outcome for the characteristic quantity for corresponding to the predetermined scene detected in another image, wherein

Learning outcome of the display control section based on institute's reference shows institute for the predetermined scene in another image It states and updates pre-treatment image or update post-processing image.

17. a kind of image processing method executed by operative image processing equipment, the operative image processing equipment include:

Image processing part, by software by image processing application in operative site image；And

Display control section, control apply described image processing the operative site image display, the method includes with Lower step:

It generates and is obtained by the way that the described image established before updating software processing is applied to the operative site image Update pre-treatment image and be applied to the operative site by the way that the described image established after software processing will be updated Image and obtain update post-processing image；And

Control the update pre-treatment image and at least part of display for updating at least one of post-processing image.

18. a kind of surgery systems, comprising:

Surgical imaging device obtains operative site image；And

Operative image processing equipment, comprising:

Image processing part, by software by image processing application in the operative site image；And

Display control section, control apply the display of the operative site image of described image processing, wherein

Described image processing unit, which is generated, is applied to the operation by that will update the described image processing established before the software Position image and the update pre-treatment image that obtains and by the way that the described image processing application established after the software will be updated Image is post-processed in the update that the operative site image obtains, and

The display control section controls at least one of the update pre-treatment image and update post-processing image extremely At least part of display.

Technical field

This technology is related to operative image processing equipment, image processing method and surgery systems, and more particularly, to energy Operative image processing equipment, image processing method and the operation for the image that enough easily comparison softwares obtain before and after updating System.

Background technique

In endoscope surgery system, various types of image procossings are applied to the signal of endoscopic imaging.Pass through software These image procossings are realized, and processor (for example, GPU) is operated according to preset program, thereby executing these image procossings.

PTL 1 discloses a kind of endoscopic system, executes maintenance by communication line, for example, software upgrading.

According to the above-mentioned update of software, any update and any addition of image procossing can be easily performed.

[reference listing]

[patent document]

[PTL 1]

Japanese patent application publication No. 2009-226169

Summary of the invention

[technical problem]

However, in the case where executing any update or any addition of image procossing by software upgrading, image matter It measures and changes between the image that can be obtained before and after software upgrading.In this case, doctor may want to scheme As the image that image and the picture quality variation obtained before mass change obtains later is compared to each other.

This technology is conceived in view of above situation, and promote the image obtained before software upgrading and software more The image obtained after new is easy to be compared to each other.

[issue-resolution]

The operative image processing equipment of this technology includes: image processing part, by software by image processing application in hand Art position image；And display control section, control apply the display of the operative site image of image procossing, wherein described Image processing part generates the update by obtaining the image processing application established before updating software in operative site image Pre-treatment image and the image processing application by that will update software foundation later are after the update that operative site image obtains Image is handled, and display control section control updates at least the one of at least one of pre-treatment image and update post-processing image Partial display.

Difference calculation part can also be set in operative image processing equipment, calculated after updating pre-treatment image and updating Handle the difference between image, wherein in the case where difference is greater than predetermined value, the display control section control can be promoted logical Know the display of the information of the situation.

Can also in operative image processing equipment scene set test section, the predetermined scene in detection image, and The display control section can be promoted to be directed to the scene detected and show on it and update pre-treatment image and update post-processing figure One selected by user as in.

Feature amount extraction module can also be set in operative image processing equipment, extract the feature of the scene detected Amount；And recording control part, for the scene detected by extracted characteristic quantity and instruction update pre-treatment image and more One selection information selected by user is interrelated in new post-processing image, and by extracted characteristic quantity and selects information Wherein as historical information record.

Study portion can also be set in operative image processing equipment, based on historical information study for each of scene Characteristic quantity user updates pre-treatment image for the scene selection of detection and updates which of post-processing image.

Reference portion can also be set in operative image processing equipment, detected in another image referring to corresponding to The learning outcome of the characteristic quantity of predetermined scene, and the learning outcome based on institute's reference in the display control section can be promoted, It shows to update pre-treatment image or update on it for the predetermined scene in another image and post-processes image.

The image processing method of this technology is executed by operative image processing equipment, operative image processing equipment includes: image Processing unit, by software by image processing application in operative site image；And display control section, control apply image The display of the operative site image of processing, the described method comprises the following steps: generate by that will update the figure established before software The update pre-treatment image obtained as processing is applied to operative site image and the image established later by the way that software will be updated The update that processing is applied to operative site image and obtains post-processes image；And it controls after updating pre-treatment image or updating Manage at least part of display of at least one of image.

The surgery systems of this technology include: surgical imaging device, obtain operative site image；And operative image processing Equipment, comprising: image processing part, by software by image processing application in operative site image；And display control section, Control applies the display of the operative site image of image procossing, wherein described image processing unit is generated by that will update software Update pre-treatment image that the image processing application established before is obtained in operative site image and by will update software it The image processing application established afterwards post-processes image, and the display control section control in the update that operative site image obtains System updates pre-treatment image or updates at least part of display for post-processing at least one of image.

In this technique, it generates by obtaining the image processing application established before updating software in operative site image The update pre-treatment image and the image processing application by that will update software foundation later taken is obtained in operative site image Update post-process image；And control at least one at least one of updating pre-treatment image or updating post-processing image The display divided.

[advantageous effects of invention]

According to this technology, the image that can be obtained before easily comparison software updates and the figure obtained after software upgrading Picture.Said effect is not necessarily restrictive, and any effect described herein may be implemented.

Detailed description of the invention

Fig. 1 is the diagram for describing the example of illustrative arrangement of endoscope surgery system；

Fig. 2 is the block diagram for describing the example of functional configuration of camera and CCU；

Fig. 3 is the block diagram for describing the exemplary functions configuration of the image processing equipment of first embodiment；

Fig. 4 is the flow chart for explaining the display processing of operative site image；

Fig. 5 is to describe the exemplary display diagram for updating pre-treatment image and updating post-processing image；

Fig. 6 is to describe the exemplary display diagram for updating pre-treatment image and updating post-processing image；

Fig. 7 is to describe the exemplary display diagram for updating pre-treatment image and updating post-processing image；

Fig. 8 is to describe the exemplary display diagram for updating pre-treatment image and updating post-processing image；

Fig. 9 is the block diagram for describing the exemplary functions configuration of the image processing equipment of second embodiment；

Figure 10 is the block diagram for describing the exemplary functions configuration of the image processing equipment of third embodiment；

Figure 11 is the flow chart for explaining the display processing of operative site image；

Figure 12 is to describe the exemplary display diagram for updating pre-treatment image and updating post-processing image；

Figure 13 is the block diagram for describing the exemplary functions configuration of the image processing equipment of the 4th embodiment；

Figure 14 is the flow chart for explaining the display processing of operative site image；

Figure 15 is the block diagram for describing the exemplary functions configuration of the image processing equipment of the 5th embodiment；

Figure 16 is the flow chart for explaining the display processing of operative site image.

Specific embodiment

The form for realizing the disclosure is described below (hereinafter, each form is referred to as " embodiment ").In addition, will It is described in the following order.

1. the general introduction of endoscope surgery system

2. software upgrading

3. first embodiment

4. second embodiment

5. third embodiment

6. the 4th embodiment

7. the 5th embodiment

<general introductions of 1. endoscope surgery systems>

First by description using the general introduction of the endoscope surgery system of this technology.

Fig. 1 is the reality for describing the illustrative arrangement for the endoscope surgery system 100 that can be applied to according to the technology of the disclosure The diagram of example.

Fig. 1 is depicted operator (doctor) 167 and is executed using endoscope surgery system 100 to the patient 171 on hospital bed 169 The state of operation.Endoscope surgery system 100 includes endoscope 101, other surgical instruments 117, the support for supporting endoscope 101 Arm equipment 127 and the cart 137 for being equipped with the various types equipment for performing the operation in Microendoscopic thereon.

In the operation of Microendoscopic, multiple cylindrical aperture utensils are each known as " trochar ", and 125a to 125d is pierced through Into stomach wall, rather than abdomen is opened by open abdomen.Hereafter, the lens barrel 103 of endoscope 101 and other surgical devices Tool 117 is inserted into the body cavity of patient 171 from trochar 125a to 125d.In the example of fig. 1, pneumoperitoneum pipe 119, energy treatment tool 121 and pliers 123 as other surgical instruments 117 insertion patient 171 body cavity in.Energy treatment tool 121 is using high frequency Electric current or ultrasonic activation carry out the treatment tool of tissue cutting and removing, blood vessel sealing etc..However, discribed surgical instrument 117 be absolutely an example, and usually various types of surgical instruments used in the operation of Microendoscopic are (for example, tweezer Son and retractor) it may be used as surgical instrument 117.

The image for the endoceliac operative site of patient 171 being imaged by endoscope 101 is shown in display equipment 141.Behaviour Author 167 executes and such as cuts affected part using energy treatment tool 121 and pliers 123, observation in real time is shown on showing equipment 141 The processes such as the image of the operative site shown.In addition, during operation, pneumoperitoneum pipe 119, energy dispose work although being not shown Tool 121 and pliers 123 are held by operator 167, assistant etc..

Support arm equipment 127 includes the arm 131 extended from base portion 129.Arm 131 include joint portion 133a, 133b and 133c and connecting rod 135a and 135b, and driven by the control of arm control equipment 145.Endoscope 101 is supported by arm 131, And its position and posture are controlled by arm 131.Stablizing for 101 position of endoscope is achieved in fix.

(imaging is set camera 105 of the endoscope 101 including lens barrel 103 and the cardinal extremity for being connected to lens barrel 103 It is standby), lens barrel 103 from its top there is the region of predetermined length to be inserted into the body cavity of patient 171.In the example of fig. 1, Endoscope 101 is portrayed as its so-called rigid mirror construction by including rigid lens lens barrel 103, but endoscope 101 can also be by So-called flexible mirror construction including flexible lens lens barrel 103.

The top of lens barrel 103 is arranged in the opening that object lens are installed therein.Light source equipment 143 is connected to endoscope 101, and the light beam generated by light source equipment 143 is directed to the top of lens barrel 103 by beam director, light beam guidance Device extends to the inside of lens barrel 103, and the light beam exposed to by object lens it is to be seen right in the body cavity of patient 171 As.In addition, endoscope 101 is also possible to forward sight endoscope, or it can be preceding strabismus endoscope or side view endoscope.

Optical system and image-forming component are arranged inside camera 105, and the reflected beams from object to be seen (are seen Examine light beam) it is converged on image-forming component by optical system.Light beam is observed by image-forming component photoelectric conversion, corresponds to observation to generate The electric signal of light beam corresponds to the picture signal of observation image.Picture signal is as original data transmissions to camera control list Member (CCU) 139.By suitably driving optical system, promote the function of camera 105 installation and adjustment magnifying power and focal length on it Energy.

In addition, can be set on camera 105 to cope with such as stereoscopic viewing (3D display), multiple image-forming components. In this case, multiple relay optical systems are arranged inside lens barrel 103, will observe light beam and be directed to multiple imagings Each of element.

Various types of equipment are installed on cart 137.

CCU 139 includes CPU (central processing unit), GPU (graphics processing unit) and GPGPU (logical based on GPU With calculating) etc., and the usually control endoscope 101 of CCU 139 and the operation for showing equipment 141.More specifically, for from camera shooting First 105 received picture signal, the various types of image procossings of application of CCU 139 show image to be based on picture signal, for example, Development treatment (demosaicing processing).CCU 139 provides the picture signal for applying image procossing to display equipment 141.In addition, CCU 139 sends control signal to camera 105, to control its driving.It may include relevant to image-forming condition for controlling signal Information, for example, magnifying power and focal length.

Show that equipment 141 according to the control from CCU 139, is believed based on the image for being applied image procossing by CCU 139 Number image is shown on it.Support high-resolution (for example, the 4K (quantity 3,840 of horizontal direction pixel × hang down in endoscope 101 Quantity 2,160 of the histogram to pixel) or 8K (quantity 4,320 of quantity 7,680 × vertical direction pixel of horizontal direction pixel)) In the case where imaging and/or in the case that endoscope 101 supports Three-dimensional Display, can the display equipment that show of high-resolution with/ Or the display equipment of each Three-dimensional Display of the above can be supported to may be used as display equipment 141.In display equipment 141 Hold high-resolution (for example, 4K or 8K) imaging in the case where, can by using have 55 inches or it is larger sized display set The standby feeling of immersion that enhancing is obtained as display equipment 141.Furthermore, it is possible to which setting has different clarity and difference depending on the application Multiple display equipment 141 of size.

Light source equipment 143 includes light source, for example, LED (light emitting diode), and by operation image areas when uses Illumination beam is supplied to endoscope 101.

It includes processor that arm, which controls equipment 145, for example, CPU, and by according to the predetermined control based on preset program operation The driving of the arm 131 of method control support arm equipment 127 processed.

Input equipment 147 is the input interface of endoscope surgery system 100.User can be executed by input equipment 147 To the input of input and the instruction of the various types information of endoscope surgery system 100.For example, user passes through input equipment 147 Input relevant to operation various types of information (for example, biological information of patient) and relevant with the operating method of operation Information.In addition, for example, user by input equipment 147 input for drive arm 131 instruction, change endoscope 101 at Instruction, the instruction of driving energy treatment tool 121 etc. of the condition (for example, the type of illumination beam, magnifying power and focal length) of picture.

The type of input equipment 147 is unrestricted, and input equipment 147 can be any kind of known input and set It is standby.For example, mouse, keyboard, touch panel, switch, floor push 157, bar etc. can be used as input equipment 147.In touch panel In the case where input equipment 147, touch panel be can be set on the display surface of display equipment 141.

In addition, input equipment 147 can be attached to the device of user, for example, glasses type wearable device or HMD (head Head mounted displays).In this case, any gesture or sight of the user detected according to each of these equipment come Execute various types of inputs.In addition, input equipment 147 can also include the camera for being able to detect any movement of user, with Various types of inputs are executed according to any posture of the user detected from the video image of camera imaging or sight.This Outside, input equipment 147 can also include microphone, which can pick up the sound of user, to use through microphone Sound executes various types of inputs.

Input equipment 147 is configured to input various types of information with cordless as described above, thus The user (for example, operator 167) for especially belonging to cleaning region can operate in a non contact fashion belongs to non-clean region Device.In addition, user can also operate these in the case where unclamping from the surgical instrument that user holds not by his/her hand Device, to improve the convenience of user.

Treatment tool controls the driving that equipment 149 controls energy treatment tool 121, for burning or incised tissue, sealing Blood vessel etc..Pneumoperitoneum equipment 151 is supplied gas in the body cavity of patient 171 by pneumoperitoneum pipe 119, to expand its body cavity, purpose It is to ensure that the visual field that endoscope 101 uses and the working space for ensuring operator.Logger 153 is to be able to record and operation phase The equipment for the various types of information closed.Printer 155 is can be with various types of formats such as text, image or figure The equipment for printing various types of information relevant to operation.

Next, by the function of camera 105 and CCU 139 that endoscope 101 is more fully described referring to Fig. 2.Fig. 2 is Describe the block diagram of the example of camera 105 and the functional configuration of CCU 139.

As shown in Fig. 2, camera 105 includes lens unit 107, imaging section 109, driving portion 111, communication unit 113 and takes the photograph As head control unit 115, as its function.In addition, CCU 139 includes communication unit 159, image processing part 161 and control unit 163, As its function.Camera 105 and CCU139 are two-way by transmission cable 165 and are communicably connected to each other.

The functional configuration of camera 105 will be described first.Lens unit 107 is the interconnecting piece that lens barrel 103 is arranged in Optical system in point.Light beam is directed into camera 105 from introducing from the top of lens barrel 103, and enters lens Unit 107.Lens unit 107 is made of the combination including zoom lens and multiple lens of condenser lens.Lens unit 107 is adjusted Its whole optical characteristics, so that on the light receiving surface for the image-forming component that observation light beam is focused at imaging section 109.In addition, zoom lens It is configured as that it is position-movable on optical axis with condenser lens, for adjusting the multiplying power and focus of image.

Imaging section 109 includes image-forming component, and is arranged in the rear class of lens unit 107.Have already passed through lens unit 107 observation light beam is gathered on the light receiving surface of image-forming component, and is generated by photoelectric conversion and corresponded to observation image Picture signal.The picture signal that imaging section 109 generates is supplied to communication unit 113.

The image-forming component for capableing of colour imaging with bayer arrangement is (for example, CMOS (complementary metal oxide semiconductor) Imaging sensor) it is used as the image-forming component for constituting imaging section 109.Furthermore it is possible to support high-resolution (for example, 4K or more high score Resolution) image imaging image-forming component may be used as image-forming component.Because the figure of operative site can be obtained with high-resolution Picture so the state of operative site can be understood in detail in operator 167, therefore can perform the operation more stablely.

In addition, constituting the image-forming component of imaging section 109 can be adapted to be including a pair of of image-forming component, to obtain respectively pair It should be in the right eye of Three-dimensional Display and the picture signal of left eye.Three-dimensional Display is executed, operator 167 is more accurately understood The depth of each in-vivo tissue in operative site.In addition, in the case where imaging section 109 is configured to more plate forms, lens list Multiple systems of member 107 also both correspond to image-forming component setting.

In addition, imaging section 109 may not necessarily be arranged on camera 105.For example, imaging section 109 can be in lens barrel In 103 after object lens.

Driving portion 111 includes actuator, and according to the control from camera control unit 115, by lens unit 107 Zoom lens and condenser lens move preset distance along optical axis.Thus, it is possible to suitably adjust the figure being imaged by imaging section 109 The multiplying power and focus of picture.

Communication unit 113 includes the communication equipment that various types of information are sent or received from CCU 139 to CCU 139.It is logical Letter portion 113 is by transmission cable 165 using the picture signal obtained from imaging section 109 as original data transmissions to CCU 139.This When, in order to show the image of operative site, it is preferable to use optic communication image signal transmission with low latency.This is because in hand During art, operator 167 observes the state of operative site using image to execute operation, it is therefore desirable to as far as possible in real time Ground shows the moving image of operative site, safer and more reliable to perform the operation.In the case where executing optic communication, by electric signal The photoelectric conversion module for being converted into optical signal is arranged in communication unit 113.Picture signal is converted into light letter by photoelectric conversion module Number, CCU139 is then transferred to by transmission cable 165.

In addition, communication unit 113 receives control signal from CCU 139, to control the driving of camera 105.Control signal packet Include information relevant to image-forming condition, for example, the information of the frame per second of specified image, the information of specified imaging exposure value and/ Or specified image multiplying power and focus information.The control signal received is supplied to camera control by communication unit 113 Portion 115.In addition, optic communication can be used also to transmit in the control signal from CCU139.In this case, optical signal is turned The photoelectric conversion module for changing electric signal into is arranged in communication unit 113, and controls the signal module that is photoelectrically converted and be converted into electricity Hereafter signal is supplied to camera control unit 115.

In addition, above-mentioned image-forming condition is arranged based on the picture signal of acquisition in the control unit 163 of CCU 139 automatically, for example, frame Rate, exposure value, magnifying power and focus.In brief, so-called AE (automatic exposure) function, so-called AF (automatic to focus) function With so-called AWB (automatic white balance) function mounting on endoscope 101.

Camera control unit 115 is based on controlling camera shooting by the received control signal from CCU 139 of communication unit 113 First 105 driving.For example, information and/or the specified Imagewise exposure of frame per second of the camera control unit 115 based on specified image Information control the driving of the image-forming component of imaging section 109.In addition, for example, camera control unit 115 is based on specified image The magnifying power of picture and the information of focus, by driving portion 111, suitably the zoom lens of mobile lens unit 107 and focusing are saturating Mirror.Camera control unit 115 can also be included therein the function of storage information to identify lens barrel 103 and camera 105 Each of.

In addition, by the way that the configuration setting of such as lens unit 107 and imaging section 109 etc is high in air-tightness and waterproofness Sealing structure in, the tolerance that handle any high pressure sterilization can be provided to camera 105.

Next, the functional configuration that CCU 139 will be described.Communication unit 159 include sent to camera 105/from camera 105 receive the communication equipment of various types of information.Communication unit 159 is transmitted by the reception of transmission cable 165 from camera 105 Picture signal.About this point, picture signal is advantageously also able to use optic communication to transmit, as described above.In such case Under, in order to support optic communication, photoelectric conversion module is set in communication unit 159, which converts optical signals into Electric signal.The picture signal that communication unit 159 will convert into electric signal is supplied to image processing part 161.

In addition, the control signal for controlling the driving of camera 105 is transferred to camera 105 by communication unit 159.It can also make With optic communication come transmission of control signals.

161 pairs of the image processing part picture signals as the initial data sent from camera 105 are using various types of Image procossing.Image procossing includes various types of known signal processing, for example, development treatment, image quality improvement processing (frequency Band emphasizes processing, super-resolution processing, NR (noise reduction) processing, camera shake correction processing etc.) and/or enhanced processing (electronics change Coke processing).In addition, image processing part 161 executes detection processing to picture signal, to execute AE, AF and AWB.

Image processing part 161 includes processor, for example, CPU, GPU or GPGPU, and at above-mentioned image procossing and detection The fact that operated by processor according to preset program is managed to execute.In addition, including multiple in image processing part 161 In the case where GPU, image processing part 161 suitably divides information relevant to picture signal, and using these multiple GPU that This is performed in parallel image procossing.

Control unit 163 executes relevant various to the imaging of operative site and its display of image to endoscope 101 The control of type.For example, control unit 163 generates control signal to control the driving of camera 105.About this point, it is being imaged For condition in situation input by user, control unit 163 generates control signal based on the input of user.In addition, AE function, AF function and AWB function mounting are on endoscope 101, detection that control unit 163 is executed according to image processing part 161 The result of processing suitably calculates optimum exposure value, pinpointed focus and best white balance, to generate control signal.

In addition, control unit 163 promotes to show the image letter that equipment 141 applies image procossing based on image processing part 161 The image of operative site number is shown on it.At this point, control unit 163 identifies operation using various types of image recognition technologys Various types of objects in the image of position.For example, control unit 163 can be by each of including in detection operative site image The edge shape of object and color identify surgical instrument 117, for example, pliers 123, specific intracorporeal site, any bleeding, making With the mist etc. generated during energy treatment tool 121.When control unit 163 promotes to show that equipment 141 shows operative site on it Image when, control unit 163 promotes to show that equipment 141 shows that various types of operations are supported to believe on it using recognition result Breath, by the information superposition on the image of operative site.Operation supports information superposition to show, to be presented to operator 167, thus Operation can be safer and be more reliably carried out.

It is the electric signal for supporting any electrical signal communication by camera 105 and CCU 139 transmission cable 165 being connected to each other Cable, the optical fiber or these composite cable for supporting optic communication.

In this example, it is communicated using transmission cable 165 by wired execution, and between camera 105 and CCU 139 Communication can be executed wirelessly.In the case that communication between the two wirelessly executes, transmission cable 165 does not need to be laid on hand On the floor of art room, therefore it can solve the case where any movement of medical worker in operating room is by the obstruction of transmission cable 165.

<2. software upgrading>

To it is above-mentioned related, in above-mentioned endoscope surgery system, various types of image processing applications in by endoscope at The image of picture.These image procossings are by software realization, and these image procossings are pre- by processor (for example, GPU) basis The fact that program is operated is determined to execute.

According to the update of software (SW), any update and any addition of image procossing can be easily performed.

On the other hand, by updating any update or any addition of the SW to execute image procossing, image Picture quality can before the update and update after between change.In this case, doctor may want to compare The image after image and picture quality variation before picture quality variation.In addition, there is also this variations of picture quality Doctor is influenced during operation to the risk of the diagnosis of surgical instrument and operation.

For example, in the case where any update for executing SW to add camera shake correction processing thereto, in many feelings Under condition, the image stabilization of operative site and its visuality raising.

On the other hand, when needing the removing of fast operating operation instrument, since camera shake correction is handled, from The waiting time for being imaged onto display increases, and the operation of surgical instrument may seem to be delayed by.In addition, resolution ratio may be by It decreases in geometric transformation (for example, affine transformation), therefore, it is difficult to see micro-assembly robot, for example, blood vessel and nerve.

In addition, in the case where executing SW update to add gray level correction processing thereto, for the light from light source Beam is difficult to the low grayscale portion reached, and visuality can be improved.However, in the part with intermediate grey scales, contrast drop It is low, and be likely difficult to see micro-assembly robot, for example, blood vessel and nerve.

In addition, being highlighted micro-assembly robot, example in the case where execution SW update emphasizes processing to add structure thereto Such as, blood vessel and nerve, and it is possible thereby to improve the visuality of the part, while may also according to circumstances be difficult to see that the portion Point.

In the case where being difficult to see that operative site by the execution that SW updates as described above, operator also needs executing The image that SW is obtained before updating.

Therefore, it is described below an embodiment, which makes even if after updating SW, also can be more It is simply compared to each other between the image newly obtained before SW and after update SW, and influence doctor can also be avoided to exist Any risk of diagnosis and the operation of opponent's art instrument during operation.

<3. first embodiment>

(exemplary configuration of image processing equipment)

Firstly, by the exemplary configuration referring to Fig. 3 description according to the image processing equipment of the first embodiment of this technology.

Image processing equipment 201 in Fig. 3 corresponds to above-mentioned CCU 139, and by image processing application in for example from taking the photograph Display equipment 202 is output to as the picture signal (input picture) of the operative site image of first 105 input, and by its result.

Show that equipment 202 corresponds to above-mentioned display equipment 141, and based on the image exported from image processing equipment 201 Signal shows image on it.

Image processing equipment 201 includes image processing part 211 and display control section 212.

Image processing part 211 corresponds to above-mentioned image processing part 161, and to the picture signal of input picture using various The image procossing of type.These image procossings are realized by software (SW), and processor (for example, GPU) is according to preset program Operation, thereby executing these image procossings.

The fact that SW of these image procossings is for example, by installing preset program from recording medium is realized to update.This Outside, such program can be installed by network (for example, internet).

Image processing part 211 includes image processing part 222 before image processing part 221 after software upgrading and software upgrading.

The output of image processing part 221 passes through to the image procossing established after the update of input picture application software after software upgrading The picture signal for the update post-processing image that (that is, by image procossing of the software realization of latest edition) obtains.

The output of image processing part 222 is by applying at the image established before software upgrading input picture before software upgrading Manage the picture signal for the update pre-treatment image that (that is, by image procossing of the software realization of previous version) obtains.

The case where image processing part 222 is made of two GPU before image processing part 221 and software upgrading after software upgrading Under, image processing part 222 can (i.e. simultaneously) be held concurrently with each other before image processing part 221 and software upgrading after software upgrading The image procossing established after row software upgrading and the image procossing established before software upgrading.

In addition, image processing part 222 can also be by a GPU before image processing part 221 and software upgrading after software upgrading It constitutes, with the image procossing for serially executing the image procossing established after software upgrading and being established before software upgrading.

Display control section 212 is based on from image processing part 211 (after image processing unit 221 and the preceding image procossing of update Portion 222) output picture signal, promote display equipment 202 on show update post-processing image or update before handle image in At least part of at least one.It is shown in display equipment 202 in addition, display control section 212 controls depending on the user's operation Show update post-processing image and updates pre-treatment image.

(process of operative site image display processing)

Next, by the stream of the operative site image display processing executed referring to Fig. 4 description by image processing equipment 201 Journey.When the operative site image (moving image) by obtaining to operation image areas is inputted from endoscope 101 (camera 105) When into image processing equipment 201, start the processing in Fig. 4.

Image processing part 221 is by the image procossing established after software upgrading (by latest edition after step S21, software upgrading The image procossing of this software realization) it is applied to the operative site image of input.

Image processing part 222 is by the image procossing established before software upgrading (by previous version before step S22, software upgrading The image procossing of this software realization) it is applied to the operative site image of input.

Assuming that the processing of step S21 and S22 parallel execution simultaneously, but these processing can serially be held as described above Row.Before applying the picture signal for updating the update post-processing image for the image procossing established after software and applying update software The picture signal of the update pre-treatment image of the image procossing of foundation is output to display control section 212.

In step S23, display control section 212 is based on image before the image processing part 221 after software upgrading and software upgrading The picture signal that processing unit 222 exports promotes processing figure before showing update post-processing image in display equipment 202 and updating Picture.

According to above-mentioned processing, changes the image obtained after picture quality from there through the update of software and thus scheme The image that image quality amount obtains before changing is shown, as the image for the operative site that endoscope 101 is imaged, therefore, using interior These images can be easily compared to each other by the operator that sight glass 101 executes operation.As a result, it is possible to reduce being drawn by software upgrading Rise image change influence doctor during operation to the diagnosis of surgical instrument and operation a possibility that.

About the above content, the update post-processing image that description is shown in display equipment 202 and processing figure before update The exemplary display of picture.

(exemplary display 1)

Fig. 5 depicts the first exemplary display for updating pre-treatment image and updating post-processing image.

Fig. 5 is depicted while being shown the shape for updating post-processing image 251 and updating pre-treatment image 252 on one screen State.The update post-processing image 251 shown in screen upper left corner area is shown as being greater than to be shown in upper right comer region Image.Therefore, before can easily updating post-processing image 251 using the operator that endoscope 101 executes operation and update Processing image 252 is mutually compared.

In addition, in the example of fig. 5, the display of update post-processing image 251 and update pre-treatment image 252 in screen Size can be adapted to be according to the operation of user (operator) and adjust.Post-processing figure is updated more specifically, wherein showing As 251 region and wherein show and update the region of pre-treatment image 252 and be adapted to be in screen and exchange each other.

It, can be with other than updating post-processing image 251 and updating pre-treatment image 252 in addition, in the example of fig. 5 Display is adapted to be by the image procossing established after updating software and the image procossing established before updating software Each in change parameter and multiple updates post-processing image and multiple update pre-treatment images for obtaining.

(exemplary display 2)

Fig. 6 depicts the second exemplary display for updating pre-treatment image and updating post-processing image.

Fig. 6 depicts display update post-processing image 251 and updates in pre-treatment image 252 and selected by user (operator) One state.In the example in fig.6, display equipment 202 is adapted to be shows update pre-treatment image on it first 252.Therefore, user can be to avoid because the picture quality of image is due to the time point for starting display operative site image changes It is puzzled.Then, depending on the user's operation, it updates pre-treatment image 252 and updates post-processing image 251 by mutual switching display.

In addition, the item for the handover operation that operator can be immediately performed on hand is arranged in the user interface for switching display On mesh, for example, the camera 105 or surgical instrument 117 of endoscope 101.

(exemplary display 3)

Fig. 7 depicts the exemplary display of third for updating post-processing image and updating pre-treatment image.

Fig. 7, which depicts update post-processing image 251 and updates pre-treatment image 252, to be shown as each pixel with pre- The state that fixed-ratio is added each other.In the example of figure 7, the pixel value of each pixel is by that will update pre-treatment image 252 The value and each pixel by the way that post-processing image 251 will be updated that the pixel value of each pixel is obtained multiplied by predetermined value α (α < 1) The output image 261 of the summation of value that is obtained multiplied by predetermined value (1- α) of pixel value it is shown.

It is adjusted in addition, value α can be adapted to be through the operation of user (operator).

(exemplary display 4)

Fig. 8 depicts the 4th exemplary display for updating post-processing image and updating pre-treatment image.

Fig. 8 depict update post-processing image 251 in first area and update pre-treatment image 252 in first area it Outer second area is shown as the state synthesized each other.

In the example of the A of Fig. 8, in the right area formed and screen is divided into right area and left area In D1, the image for updating part corresponding with region D1 in post-processing image 251 is shown first, and by dividing screen In the left area D2 formed for right area and left area, display updates corresponding with region D2 in pre-treatment image 252 Part image.Assuming that by the operation of user (operator) come the width w of adjustment region D1, in other words, region D1 and region Boundary between D2.In addition, the image shown in region D1 and region D2 can be adapted to be by the operation of user each other Exchange.

In addition, in the example of the B of Fig. 8, in the region for including screen center, more specifically, being with screen center In the border circular areas D3 at center, display updates the image of part corresponding with region D3 in post-processing image 251, and in screen In be located at region D3 except peripheral region D4 in, display update pre-treatment image 252 in part corresponding with region D4 figure Picture.Assuming that by the operation of user (operator) come the radius r of adjustment region D3, in other words, the side between region D3 and region D4 Boundary.In addition, the image shown in region D3 and region D4 can be adapted to be and exchange each other by the operation of user.In addition, The shape of region D3 is not limited to circle, but can be other shapes, for example, rectangle.

<4. second embodiment>

(exemplary configuration of image processing equipment)

Fig. 9 depicts the exemplary configuration of the image processing equipment of the second embodiment according to this technology.

Image processing equipment 271 in Fig. 9 exports image processing application in the picture signal of input picture, and by result To display each of equipment 202-1 and 202-2.

Display equipment 202-1 and 202-2, which are based on, inputs picture signal therein from image processing equipment 201 to show figure Picture.

Image processing equipment 271 includes image processing part 211 and display control section 281.

In Fig. 9, image processing part 211 has configuration same as shown in Figure 3, therefore no longer describes.

Display control section 281 is based on from image processing part 211 (after software upgrading before image processing part 221 and software upgrading Image processing part 222) output picture signal, promote show that update post-processes image on display equipment 202-1, and promote It is shown on display equipment 202-2 and updates pre-treatment image.

Using this configuration, using endoscope 101 execute operation operator can also easily by these images each other It is compared, because the image that is obtained after picture quality is changed by the update of software and thus changing in picture quality The image obtained before is shown as the image for the operative site being imaged by endoscope 101.

<5. third embodiment>

(exemplary configuration of image processing equipment)

Figure 10 depicts the exemplary configuration of the image processing equipment of the third embodiment according to this technology.

Image processing equipment 301 in Figure 10 includes image processing part 311 and display control section 312.

Image processing part 311 includes image processing part 322 and poor before image processing part 321, software upgrading after software upgrading It is worth calculation part 323.

Similar to image processing part 221 after the software upgrading in Fig. 3, the output of image processing part 321 passes through after software upgrading The picture signal for the update post-processing image that the image processing application established after software upgrading is obtained in input picture.

Similar to image processing part 222 before the software upgrading in Fig. 3, the output of image processing part 322 passes through before software upgrading The picture signal for the update pre-treatment image that the image processing application established before software upgrading is obtained in input picture.

Difference calculation part 323, which calculates, to be updated pre-treatment image and updates the difference between post-processing image, and is tied calculating Fruit is supplied to display control section 312.

Display control section 312 is based on from image processing part 311 (after software upgrading before image processing part 321 and software upgrading Image processing part 322) output picture signal, promote display equipment 202 on show update post-processing image or update before locate Manage at least part of at least one of image.

In addition, display control section 312 includes OSD processing unit 331.OSD processing unit 331 is according to from image processing part 311 The calculated result of (difference calculation part 323) OSD of execution information in the screen of display equipment 202 is shown.

(process of operative site image display processing)

Next, the operative site image that the flow chart description in referring to Fig.1 1 is executed by image processing equipment 301 is shown Show the process of processing.When the operative site image (moving image) obtained and to operation image areas (is taken the photograph from endoscope 101 As head 105) when being input in image processing equipment 301, start the processing in Figure 11.

Image processing part 321 is by the image procossing established after software upgrading (by latest edition after step S31, software upgrading The image procossing of this software realization) it is applied to the operative site image of input.

Image processing part 322 is by the image procossing established before software upgrading (by previous version before step S32, software upgrading The image procossing of this software realization) it is applied to the operative site image of input.

Assuming that the processing parallel execution simultaneously in step S31 and S32, but these processing can serially be held as described above Row.It is established before updating software using the picture signal and application for the update post-processing image for updating the image procossing established after software The picture signal of update pre-treatment image of image procossing be output to display control section 312 and difference calculation part 323.

In addition, at this time, it is assumed that display control section 312 is based on the image letter that image processing part 321 exports after software upgrading Number, promote only to show update post-processing image in display equipment 202.

In step S33, difference calculation part 323 calculates the difference updated between pre-treatment image and update post-processing image. More specifically, difference calculation part 323 calculates the pixel value for updating pre-treatment image and updating each pixel between post-processing image Difference, and to difference sum.Calculated result is provided to display control section 312.

In step S34, display control section 312 determines whether difference is big based on the calculated result from difference calculation part 323 In predetermined value.

In the case where determining difference no more than predetermined value, the processing of step S34 is repeated, and in display equipment 202 Continuously display update post-processing image.

On the other hand, in the case where determining that difference is greater than predetermined value, processing step proceeds to step S35.

It is shown in the OSD of step S35,331 execution information of OSD processing unit of display control section 312, which notifies difference Greater than predetermined value.For example, as shown on the left of Figure 12, update post-processing figure that OSD processing unit 331 is shown in display device 202 As the upper OSD for executing notice image 361 shows that the notice image notification difference is greater than predetermined value.Therefore, user can be in user The picture quality difference for updating post-processing image and updating between pre-treatment image is recognized in currently watched scene to exist.

In the screen of display equipment 202, user then executes predetermined operation, for example, to the notice image 361 to be touched A part execute predetermined operation, and select display pattern with will update post-processing image and update pre-treatment image mutually compare Compared with selection screen thus show.As shown in the right side of Figure 12, the display of display control section 312 is provided with button 381 to 384 Selection screen, to select any one of four kinds of display patterns.For example, being executed in each of four kinds of display patterns Above-mentioned example shows that 1 shows to described in exemplary display each of 4.

According to above-mentioned processing, changed by software upgrading the image obtained after picture quality and picture quality by It, can be with using the operator that endoscope 101 executes operation in the biggish situation of difference between this image obtained before changing These images are promoted to show with desired display format, to be easily mutually compared these images.

<6. the 4th embodiment>

(exemplary configuration of image processing equipment)

Figure 13 depicts the exemplary configuration of the image processing equipment of the 4th embodiment according to this technology.

Image processing equipment 401 in Figure 13 include image processing part 411, display control section 412, scene detection portion 413, Feature amount extraction module 414, recording control part 415, historical information record portion 416, study portion 417 and learning information record portion 418.

Image processing part 411 includes image processing part 422 before image processing part 421 after software upgrading and software upgrading.

Similar to image processing part 221 after the software upgrading in Fig. 3, the output of image processing part 421 passes through after software upgrading The picture signal for the update post-processing image that the image processing application established after software upgrading is obtained in input picture.

Similar to image processing part 222 before the software upgrading in Fig. 3, the output of image processing part 422 passes through before software upgrading The picture signal for the update pre-treatment image that the image processing application established before software upgrading is obtained in input picture.

Display control section 412 is based on from image processing part 411 (after software upgrading before image processing part 421 and software upgrading Image processing part 422) output picture signal, promote show equipment 202 show on it update post-processing image and update before One selected by user is handled in image.

In addition, display control section 412 includes OSD processing unit 431.OSD processing unit 431 is in the screen of display equipment 202 It is shown according to the OSD that the importance mark from the scene detection portion 413 being described later on carries out information.

Detect the scene in input picture with high different degree in scene detection portion 413.Tool is detected in scene test section 413 In the case where the scene for having high different degree, scene detection portion 413 by indicate the scene be have high different degree scene it is important Property mark is supplied to display control section 412 and feature amount extraction module 414.

Feature amount extraction module 414 is detected in the input image based on the importance mark from scene detection portion 413, extraction The characteristic quantity of the scene with high different degree arrived, and this feature amount is supplied to recording control part 415.

Recording control part 415 believes the characteristic quantity from feature amount extraction module 414 and the selection from display control section 412 Manner of breathing mutual correlation, and be recorded in historical information record portion 416 as historical information.Selection information is that instruction user is directed to Which in post-processing image and update pre-treatment image the scene selection with high different degree detected in input picture update One information.

Study portion 417 learns to use based on the historical information being recorded in historical information record portion 416, for each characteristic quantity Family updates post-processing image for the scene selection with high different degree detected in input picture and updates pre-treatment image Which of.It is recorded in learning information record portion 418 by the learning outcome that study obtains.

(process of operative site image display processing)

The operative site image executed referring next to the flow chart description in Figure 14 by image processing equipment 401 is shown The process of processing.When the operative site image (moving image) obtained and to operation image areas (is imaged from endoscope 101 It is first when 105) being input in image processing equipment 401, start the processing in Figure 14.

Image processing part 421 is by the image procossing established after software upgrading (by latest edition after step S41, software upgrading The image procossing of this software realization) it is applied to input picture.

Image processing part 422 is by the image procossing established before software upgrading (by previous version before step S42, software upgrading The image procossing of this software realization) it is applied to input picture.

Assuming that the processing parallel execution simultaneously in step S41 and S42, but these processing can serially be held as described above Row.Before applying the picture signal for updating the update post-processing image for the image procossing established after software and applying update software The picture signal of the update pre-treatment image of the image procossing of foundation is output to display control section 412.

In addition, at this time, it is assumed that display control section 412 is promoted based on the picture signal exported from image processing part 411 aobvious Show and shows update post-processing image and update pre-treatment image in equipment 202.

In step S43, scene detection portion 413 determines whether scene detection portion 413 detects there is Gao Chong in input picture Any scene to be spent.Scene with high different degree is defined as the scene such as executing the cutting of tissue, remove, and These are detected based on shape, color of operative site of surgical instrument described in input picture (operative site image) etc. Scape.

In the case where scene test section 413 determines and do not detect the scene with any high different degree, step is repeated The processing of S43, and continuously display update post-processing image in display equipment 202 and handle image before updating.

On the other hand, in the case where scene test section 413 confirmly detects the scene with high different degree, scene detection Importance mark is supplied to display control section 412 and feature amount extraction module 414 by portion 413, and processing step proceeds to step S44。

In step S44, feature amount extraction module 414 is being inputted based on the importance mark from scene detection portion 413, extraction The characteristic quantity of the scene with high different degree detected in image, and this feature amount is supplied to recording control part 415.Have The characteristic quantity of the scene of high different degree is defined as the shape of the surgical instrument according to the standard for being used as detection scene, operative site Color etc. information.

In step S45, the OSD processing unit 431 of display control section 412 is based on the importance mark from scene detection portion 413 Will, executing instruction the scene shown at this time is that there is the OSD of the information of scene of high different degree to show.

In addition, the processing of step S44 and step S45 parallel can also execute.

When execute OSD display when, image processing equipment 401 next make user selection to show update pre-treatment image and Update which of post-processing image.When user selects to update pre-treatment image or update post-processing image, processing step Proceed to step S46.

In step S46, display control section 412 promotes after showing that equipment 202 only shows update pre-treatment image and updates One selected by user is managed in image.At this point, instruction is updated pre-treatment image and updates post-processing figure by display control section 412 The selection information of (one shown in display equipment 202) one selected by user as in is supplied to recording control part 415.

In step S47, recording control part 415 is by the characteristic quantity from feature amount extraction module 414 and comes from display control section 412 selection information is interrelated, and is recorded in historical information record portion 416 as historical information.

In step S48, study portion 417 is based on the historical information being recorded in historical information record portion 416, for each spy Sign amount study user, which is directed to the scene selection with high different degree detected in the input image and updates, post-processes image and more Which of new pre-treatment image.In this case, learn user using machine learning more to pass through for each characteristic quantity It often selects which of to update post-processing image and update pre-treatment image.

According to above-mentioned processing, can easily be compared using the operator that endoscope 101 executes operation logical in picture quality It crosses software upgrading and changes the image obtained later and the image obtained before thus picture quality changes, so that selection more has The image of benefit promotes to show the image.Furthermore, it is possible to learn to pass through soft the scene with high different degree in picture quality Part updates and changes which kind of display format pair of the image and the image obtained before thus picture quality changes that obtain later Operator is more advantageous.

<7. the 5th embodiment>

(exemplary configuration of image processing equipment)

Figure 15 depicts the exemplary configuration of the image processing equipment of the 5th embodiment according to this technology.

Image processing equipment 501 in Figure 15 is directed in the operative site image newly inputted using above-mentioned learning outcome to be had The scene of high different degree selects to update post-processing image and updates more favorable image in pre-treatment image for operator automatically, And keep the image shown.

Image processing equipment 501 is mentioned including image processing part 411, display control section 412, scene detection portion 413, characteristic quantity Take portion 414, learning information record portion 418 and learning information reference portion 511.

In Figure 15, image processing part 411, display control section 412, scene detection portion 413,414 and of feature amount extraction module Learning information record portion 418 is identical as configuration shown in Figure 13 respectively, therefore no longer describes.

Referring to portion 511, the reference from the learning information being recorded in learning information record portion 418 corresponds to learning information The learning information of the characteristic quantity of the scene with high different degree detected in the input picture newly inputted.Study based on reference Selection information relevant to characteristic quantity is supplied to display control section 412 referring to portion 511 by information, learning information.

(process of operative site image display processing)

The operative site image executed referring next to the flow chart description in Figure 16 by image processing equipment 501 is shown The process of processing.When the operative site image (moving image) obtained and to operation image areas (is imaged from endoscope 101 It is first when 105) being input in image processing equipment 501, start the processing in Figure 16.

In addition, the processing of step S51 to S54 is substantially similar to the processing of step S41 to S44 in Figure 15 in Figure 16, because This is no longer described.

In step S54, when extracting the characteristic quantity of the scene with high different degree detected in the input image, the spy Sign amount is supplied to learning information reference portion 511.

In step S55, learning information is joined from the learning information being recorded in learning information record portion 418 referring to portion 511 According to the learning information for corresponding to the characteristic quantity from feature amount extraction module 414.511 study based on reference of learning information reference portion Selection information relevant to the characteristic quantity from feature amount extraction module 414 is supplied to display control section 412 by information.

In step S56, display control section 412 is promoted only based on the selection information from learning information reference portion 511 aobvious Show the image for showing in equipment 202 and updating and being indicated in post-processing image and update pre-treatment image by selection information.

It is logical picture quality can be shown in based on learning outcome for the scene with high different degree according to above-mentioned processing It crosses software upgrading and the image that obtains after changing and more has in the image of acquisition to operator before thus changing picture quality The image of benefit.

The example for being applied to endoscope surgery system according to the technology of the disclosure is described above, and according to the disclosure The system that can be applied to of technology be not limited to examples detailed above.For example, can be applied to check in flexibility according to the technology of the disclosure Endoscope system and micrurgy system.

In addition, the embodiment of this technology is not limited to above embodiment, and can be in the main points for not departing from this technology In the range of various changes are carried out to it.

In addition, this technology can use following configuration.

(1) a kind of operative image processing equipment, comprising:

Image processing part, by software by image processing application in operative site image；And

Display control section, control apply the display of the operative site image of image procossing, wherein

Described image processing unit is generated by that will update the image processing application established before software in operative site image And the update pre-treatment image obtained and the image processing application by that will update software foundation later are in operative site image The update of acquisition post-processes image, and

The display control section control, which updates pre-treatment image or updates, post-processes at least the one of at least one of image Partial display.

(2) the operative image processing equipment according to above-mentioned (1), wherein

Described image processing unit makes at the image procossing established before updating software and the image established after software upgrading Reason executes concurrently with each other.

(3) the operative image processing equipment according to above-mentioned (1) or (2), wherein

The display control section promotes to update pre-treatment image and update post-processing image to be simultaneously displayed in a screen.

(4) the operative image processing equipment according to above-mentioned (3), wherein

The display control section adjusts to update pre-treatment image in screen and update depending on the user's operation post-processes image Display size.

(5) the operative image processing equipment according to above-mentioned (1) or (2), wherein

The display control section promotes to update pre-treatment image and update post-processing image to show in different display equipment Show.

(6) the operative image processing equipment according to above-mentioned (1) or (2), wherein

The display control section promotes to update pre-treatment image and updates a quilt selected by user in post-processing image Display.

(7) the operative image processing equipment according to above-mentioned (1) or (2), wherein

The display control section will update pre-treatment image for each pixel with estimated rate and update post-processing image It is added each other, to be shown.

(8) the operative image processing equipment according to above-mentioned (1) or (2), wherein

The display control section by update pre-treatment image first area and update post-processing image first area it Outer second area synthesizes each other, to be shown.

(9) the operative image processing equipment according to above-mentioned (8), wherein

The first area is the region formed and screen is divided into left and right two parts, and

The second area is another region formed and screen is divided into left and right two parts.

(10) the operative image processing equipment according to above-mentioned (8), wherein

The first area be include the screen center central area, and

The second area is the peripheral region being located at except the central area in the screen.

(11) the operative image processing equipment according to any one of above-mentioned (8) to (10), wherein

Boundary between the first area and the second area is determined by the operation of user.

(12) the operative image processing equipment according to above-mentioned (1) or (2), further includes:

Difference calculation part calculates the difference updated between pre-treatment image and update post-processing image, wherein

In the case where difference is greater than predetermined value, the display control section control notifies the display of the information of the situation.

(13) the operative image processing equipment according to above-mentioned (1) or (2), further includes:

Scene detection portion, the predetermined scene in detection image, wherein

The display control section promotes to update pre-treatment image and update user in post-processing image to be directed to the field detected One of scape selection is shown.

(14) the operative image processing equipment according to above-mentioned (13), further includes:

Feature amount extraction module extracts the characteristic quantity of the scene detected；And

Recording control part, for the scene detected by extracted characteristic quantity and instruction update pre-treatment image and more User selected one selection information is interrelated in new post-processing image, and by extracted characteristic quantity and selects information Wherein as historical information record.

(15) the operative image processing equipment according to above-mentioned (14), further includes:

Study portion, each characteristic quantity user based on historical information study for scene update detection scene selection Which of pre-treatment image and update post-processing image.

(16) the operative image processing equipment according to above-mentioned (15), further includes:

Reference portion, reference correspond to the learning outcome of the characteristic quantity of the predetermined scene detected in another image, In,

Learning outcome of the display control section based on institute's reference promotes display more for the predetermined scene in another image New pre-treatment image updates post-processing image.

(17) a kind of image processing method executed by operative image processing equipment, the operative image processing equipment include

Image processing part, by software by image processing application in operative site image；And

Display control section, control apply the display of the operative site image of image procossing, and the method includes following Step:

It generates by the way that the image processing application established before software will be updated before the update that operative site image obtains Handle image and by the way that the image processing application established after software will be updated after the update that operative site image obtains Manage image；And

Control updates pre-treatment image or updates at least part of display for post-processing at least one of image.

(18) a kind of surgery systems, comprising:

Surgical imaging device obtains operative site image；And

Operative image processing equipment, including

Image processing part, by software by image processing application in operative site image；And

Display control section, control apply the display of the operative site image of image procossing, wherein

Described image processing unit is generated by that will update the image processing application established before software in operative site image And the update pre-treatment image obtained and the image processing application by that will update software foundation later are in operative site image The update of acquisition post-processes image, and

The display control section control, which updates pre-treatment image or updates, post-processes at least the one of at least one of image Partial display.

[reference signs list]

Image processing part after 201 image processing equipments, 211 image processing parts, 212 display control sections, 221 software upgradings, Image processing part, 281 display control sections, 301 image processing equipments, 311 image processing parts, 312 display controls before 222 software upgradings Image processing part, 323 difference calculation parts, 331OSD processing before image processing part, 322 software upgradings after portion processed, 321 software upgradings Portion, 401 image processing equipments, 411 image processing parts, 412 display control sections, 413 scene detection portions, 414 feature amount extraction modules, Image after 415 recording control parts, 416 historical information record portions, 417 study portions, 418 learning information record portions, 421 software upgradings Image processing part, 431OSD processing unit, 511 learning information reference portions before processing unit, 422 software upgradings.