阅读说明：本技术 扫描引导提供方法及用于其的图像处理装置 (Scan guide providing method and image processing apparatus used for the same ) 是由 金偰豪 于 2020-03-03 设计创作，主要内容包括：本发明公开扫描引导提供方法及用于其的图像处理装置。一实施例的扫描引导提供方法包括：将提供口腔扫描仪的扫描策略的引导扫描路径显示于扫描画面的步骤；根据引导扫描路径,跟踪通过口腔扫描仪实际扫描的用户扫描路径的步骤；以及与引导扫描路径一同显示跟踪到的用户扫描路径的步骤。(The invention discloses a scan guide providing method and an image processing apparatus used for the same. The scan guidance providing method of an embodiment includes: displaying a guide scanning path providing a scanning strategy of the oral scanner on a scanning picture; tracking a user scanning path actually scanned by the oral scanner according to the guide scanning path; and a step of displaying the tracked user scan path together with the guide scan path.)

1. A scan guidance providing method, characterized by comprising the steps of:

displaying a guide scanning path providing a scanning strategy of the oral scanner on a scanning picture;

tracking a user scanning path actually scanned by the oral scanner according to the guide scanning path; and

the tracked user scan path is displayed along with the guide scan path.

2. The scan guidance providing method according to claim 1, wherein in the step of displaying the guidance scan path on the scan screen, a guidance scan path preset according to a manufacturer of the oral scanner is displayed on the screen.

3. The scan guidance providing method according to claim 1, wherein in the step of displaying the guidance scan path on the scan screen, the guidance scan path is rotated by a user operation or the guidance scan path is moved to the same viewpoint as a position actually photographed by the oral scanner and displayed on the screen.

4. The scan guidance providing method according to claim 1, wherein in the step of displaying the guidance scan path on the scan screen, the guidance scan path is rotated in real time in synchronization with a position actually photographed by the oral scanner and displayed on the screen.

5. The scan guidance providing method of claim 1, wherein the step of tracking the scan path of the user comprises the steps of:

reconstructing a 2D image obtained by scanning of an oral scanner to generate a depth image;

connecting the central points or main points of all objects forming the depth image; and

intersection points from the center points or principal points of the respective objects to surface positions of the 3D objects are detected, and the detected intersection points are connected to generate a user scan path.

6. The scan guidance providing method of claim 5, wherein the step of tracking the user scan path further comprises the step of connecting points formed with a predetermined distance from the detected crossing point to correct the user scan path.

7. The scan guidance providing method according to claim 1, wherein in the step of tracking the user scan path, center points of respective objects of a 3D image obtained by scanning of the oral scanner are connected to generate the user scan path.

8. The scan guidance providing method according to claim 1, wherein in the step of displaying together with the guidance scan path, the user scan path is displayed in match with the guidance scan path after matching a ratio of the tracked user scan path with a ratio of the guidance scan path.

9. The scan guidance providing method according to claim 1, further comprising the step of displaying the user scan path in image data actually scanned by the oral scanner.

10. The scan guidance providing method according to claim 1, further comprising the steps of:

providing a user interface for user setting whether to display or not to display the scan guide; and

a user interface for user setting of transparency of the scan guide is provided.

11. The scan guidance providing method according to claim 1, further comprising the steps of:

comparing and analyzing the user scanning path and the guide scanning path; and

providing at least one of the results of the comparative analysis and a warning signal generated based on the results of the comparative analysis.

12. An image processing apparatus characterized by comprising:

a data acquisition unit for acquiring image data of an interior of an oral cavity or an oral cavity model of a user from an oral cavity scanner;

an output unit for displaying the image data acquired from the oral scanner and a guidance scan path providing a scan strategy of the oral scanner on a screen; and

and a control unit that receives the image data acquired by the data acquisition unit, performs image processing, and provides a guidance scan path to the output unit.

13. The image processing apparatus according to claim 12, wherein the output unit rotates the guide scanning path by a user operation, or moves the guide scanning path to the same viewpoint as a position actually photographed by the oral scanner, and displays the guide scanning path on the screen.

14. The image processing apparatus according to claim 12, wherein the output unit rotates the guidance scanning path in real time in synchronization with a position actually captured by the oral scanner and displays the guidance scanning path on the screen.

15. The image processing apparatus according to claim 12, wherein the output section displays, on the screen, a user interface for user setting whether or not to display the scan guide and a user interface for user setting of transparency of the scan guide.

16. The image processing apparatus according to claim 12,

the control part tracks the user scanning path actually scanned by the oral cavity scanner according to the guide scanning path, matches the tracked user scanning path with the guide scanning path to form a picture,

the output unit displays the user scanning path on the screen together with the guidance scanning path.

17. The image processing apparatus according to claim 16,

the control section reconstructs a 2D image obtained by scanning of the oral scanner to generate a depth image,

the control section connects the center points or principal points of the respective objects constituting the depth image,

the control unit detects intersection points from the center points or principal points of the respective objects to the surface positions of the 3D objects, and connects the detected intersection points to generate a user scanning path.

18. The image processing apparatus according to claim 17, wherein the control section connects points formed with a predetermined distance from the detected intersection point to correct the user scanning path.

19. The image processing apparatus according to claim 16, wherein the control unit connects center points of the respective objects of the 3D image obtained by the scanning of the oral scanner to generate the user scanning path.

20. The image processing apparatus according to claim 16, wherein the control unit matches the user scanning path with the guide scanning path after matching the ratio of the tracked user scanning path with the ratio of the guide scanning path.

21. The image processing apparatus according to claim 16, wherein the output section displays the user scanning path in the image data actually scanned by the oral scanner.

22. The image processing apparatus according to claim 16, wherein the control section compares and analyzes the user scanning path and the guidance scanning path, and provides at least one of a result of the comparison and analysis and a warning signal generated based on the result of the comparison and analysis.

Technical Field

The present invention relates to an oral scanner and an image processing technique for scanning.

Background

A scan guide for accurately photographing teeth by the oral scanner may be provided. However, such scanning guidance is provided through a separate file or web page. Therefore, the user may not know whether the scan guide exists without looking at the product specification. Even if the scanning guide is known, it is not possible to confirm whether the person is normally photographed according to the scanning guide.

Disclosure of Invention

Technical problem

According to an embodiment, a scan guide providing method and an image processing apparatus for the same are provided, in which scan guide is provided through a scan screen, and whether a user performs shooting according to the scan guide can be confirmed.

Technical scheme

The scan guidance providing method of an embodiment includes: displaying a guide scanning path providing a scanning strategy of the oral scanner on a scanning picture; tracking a user scanning path actually scanned by the oral scanner according to the guide scanning path; and displaying the tracked user scanning path together with the guide scanning path.

In the step of displaying the guidance scan path on the scan screen, guidance scan paths preset according to different manufacturers of the oral scanner may be displayed on the screen.

In the step of displaying the guidance scan path on the scan screen, the guidance scan path may be rotated by a user operation or may be moved to the same viewpoint as a position actually photographed by the oral scanner to be displayed on the screen.

In the step of displaying the guidance scan path on the scan screen, the guidance scan path may be rotated in real time in synchronization with a position actually photographed by the oral scanner and displayed on the screen.

The step of tracking the user scan path may comprise: a step of reconstructing a 2D image obtained by scanning with an oral scanner to generate a depth image; connecting the central points or principal points of the objects constituting the depth image; and detecting intersection points from the center points or principal points of the respective objects to surface positions of the 3D objects, and connecting the detected intersection points to generate a user scanning path. At this time, the step of tracking the user scan path may further include the step of connecting points formed with a predetermined distance from the detected crossing point to correct the user scan path.

In the step of tracking the user scan path, center points of respective objects of a 3D image obtained by scanning of the oral scanner may be connected to generate the user scan path.

In the step of displaying together with the guide scan path, the user scan path may be displayed in match with the guide scan path after the scale of the tracked user scan path is matched with the scale of the guide scan path.

The scan guidance providing method may further include the step of displaying the user scan path in the image data actually scanned by the oral scanner.

The scan guidance providing method may further include: a step of providing a user interface for user setting whether to display or not to display the scan guide; a step of providing a user interface for user setting of transparency of the scanning guide.

The scan guidance providing method may further include: comparing and analyzing the user scanning path and the guide scanning path; providing at least one of a comparative analysis result and a warning signal generated based on the comparative analysis result.

An image processing apparatus of another embodiment includes: a data acquisition unit for acquiring image data of an interior of an oral cavity or an oral cavity model of a user from an oral cavity scanner; an output unit for displaying the image data acquired from the oral scanner and a guidance scan path providing a scan strategy of the oral scanner on a screen; and a control unit that receives the image data acquired by the data acquisition unit, performs image processing, and provides a guidance scan path to the output unit.

The output unit may rotate the guide scanning path by a user operation, or may move the guide scanning path to the same viewpoint as the position actually photographed by the oral scanner and display it on the screen.

The output unit can display the scan path on the screen by rotating the guide scan path in real time in synchronization with the position actually photographed by the oral scanner.

The output unit may display a user interface for user setting whether to display or not to display the scan guide and a user interface for user setting of transparency of the scan guide on the screen.

The control unit may track a user scanning path actually scanned by the oral scanner according to the guidance scanning path, and the output unit may display the user scanning path on the screen together with the guidance scanning path.

The control unit may reconstruct a 2D image obtained by scanning of the oral scanner to generate a depth image, may connect center points or principal points of respective objects constituting the depth image, may detect intersection points from the center points or principal points of the respective objects to surface positions of the 3D objects, and may connect the detected intersection points to generate a user scanning path. In this case, the control unit may connect points formed with a predetermined distance from the detected intersection point to correct the user scanning path.

The control unit may generate the user scanning path by connecting center points of respective objects of the 3D image obtained by the scanning of the oral scanner. The control unit may match the user scanning path with the guide scanning path after matching the ratio of the tracked user scanning path with the ratio of the guide scanning path.

The output part may display the user scanning path in the image data actually scanned by the oral scanner. The control part can compare and analyze the user scanning path and the guide scanning path, and provide at least one of a result of the comparison and analysis and a warning signal generated according to the result of the comparison and analysis.

Effects of the invention

According to the scan guidance providing method and the image processing apparatus for the same of the embodiment, by providing the scan guidance providing the scan strategy using the oral scanner in the scan screen of the scan program, the user can confirm the guidance scan path through the program.

Further, the user scan path following the real-time scan direction is displayed together with the image data being photographed in the guide scan path, and it is possible to confirm whether or not the user is normally photographed along the guide scan path. Thus, more accurate scan image data can be acquired. Further, the present invention is also applicable to scan training by an oral scanner.

Drawings

Fig. 1 is a diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

Fig. 2 and 3 are diagrams showing a configuration of a scan guide screen and a setting screen according to an embodiment of the present invention.

Fig. 4 and 5 are diagrams illustrating scan guidance on/off functions according to various embodiments of the present invention.

FIG. 6 is a diagram showing a screen for tracking a user scan path according to an embodiment of the present invention.

Fig. 7 is a diagram showing a program screen for explaining an algorithm for tracking a user scan path according to an embodiment of the present invention.

Fig. 8 is a diagram showing a scan screen for comparing the tracked user scan path and the guidance scan path and outputting the same according to the embodiment of the present invention.

Fig. 9 is a diagram showing that the user scan path and the guidance scan path of each user do not match.

Fig. 10 is a diagram showing a screen for matching a user scan path and a guidance scan path according to an embodiment of the present invention.

Fig. 11 is a diagram showing a screen for comparing a user scan path and a guidance scan path according to an embodiment of the present invention.

Fig. 12 is a flowchart illustrating a scan guidance providing method according to an embodiment of the present invention.

Detailed Description

The advantages and features of the present invention and methods of accomplishing the same will become apparent by reference to the following detailed description of various embodiments taken in conjunction with the accompanying drawings.

However, the present invention is not limited to the embodiments disclosed below, and can be implemented in various forms different from each other, but the embodiments are provided to make the disclosure of the present invention complete, so as to make a person skilled in the art to which the present invention pertains fully understand the scope of the present invention, and the present invention is defined only in the scope of the claims of the present invention. Like reference numerals refer to like elements throughout the specification.

In describing the embodiments of the present invention, when it is judged that a detailed description of a known function or structure may unnecessarily obscure the present invention, a detailed description thereof will be omitted, and a plurality of terms described later are terms defined in consideration of functions in the embodiments of the present invention, which may be different according to the intention of a user, an operator, a convention, or the like. And therefore its definition should be based on the contents throughout the present specification.

Various combinations of the blocks of the block diagrams and the steps of the flowcharts shown in the attached figures can also be executed by using various computer program instructions (execution engines) which can be loaded on a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus, so that the instructions executed by the processor of the computer or other programmable data processing apparatus create means for executing the functions described in the blocks of the block diagrams or the steps of the flowcharts.

These computer program instructions may also be stored in a computer usable or computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer usable or computer-readable memory produce an article of manufacture including instruction means that implement the function specified in the block diagrams or flowchart block or blocks.

Further, since the plurality of computer program instructions may be loaded on a computer or other programmable data processing apparatus, the plurality of instructions generated by executing a series of a plurality of operation steps on the computer or other programmable data processing apparatus and executing the computer or other programmable data processing apparatus in computer-executed steps may provide a plurality of steps for executing a plurality of functions described in each block of the block diagrams and each step of the flowcharts.

Also, each block or step may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s), it being noted that, in some alternative implementations, the functions noted in the blocks or steps may occur out of the order. For example, two blocks or steps shown in succession may, in fact, be executed substantially concurrently, and the blocks or steps may sometimes be executed in the reverse order, depending upon the functionality involved.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention illustrated below can be modified in various forms, and the scope of the present invention is not limited to the embodiments described in detail below.

The embodiments of the present invention will serve to provide a more complete understanding of the present invention to those skilled in the art to which the present invention pertains.

Fig. 1 is a diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

The image processing apparatus 1 is an electronic apparatus that can execute an image processing program. The image processing program of an embodiment performs image processing on image data acquired by the oral scanner, and guides a scanning strategy for accurately photographing teeth by the oral scanner. The electronic devices include computers, notebook computers, portable computers, Tablet computers, smart phones, mobile phones, Personal Media Players (PMP), Personal Digital Assistants (PDA), and the like. The image processing program includes a scanner program, a CAD program, and the like. Also, it is applicable to procedures for other conventional medical image processing besides oral cavity scanning. Further, it can be used for scan training using an oral scanner.

The oral scanner scans the inside of the oral cavity of the user to acquire image data of the inside of the oral cavity. The image processing apparatus 1 receives image data from the oral scanner via the data acquisition unit 10, and processes the image data acquired by the oral scanner using the control unit 14. And, a scanning strategy for accurately photographing teeth by the oral scanner is guided. After the oral scanner can drive the internally illuminated light source to output light, the interior of the user's mouth or the model of the mouth can be illuminated by the light shining outward along the light path. The light reflected from the inside of the mouth or the mouth phantom reaches the image sensor of the mouth scanner again along the light path, whereby the image data of the inside of the mouth or the mouth phantom can be acquired.

Hereinafter, the configuration of the image processing apparatus having the above-described features will be described with reference to the configuration of fig. 1.

Referring to fig. 1, an image processing apparatus 1 according to an embodiment includes a data acquisition unit 10, a storage unit 12, a control unit 14, an input unit 16, and an output unit 18.

The data acquisition unit 10 acquires image data captured by the oral scanner. The oral Scanner may be a 3D Scanner (3D Scanner) that scans a plaster model that is generated to mimic the patient's oral cavity, or an Intra-oral 3D Scanner (3D Intra-oral Scanner) that scans the interior of the patient's oral cavity. The acquired image data may be stored in the storage unit 12. The storage section 12 stores information necessary for executing the operation of the image processing apparatus 1 and information generated according to the execution operation, so that the control section 14 provides the information when requested.

The control unit 14 receives the image data acquired by the data acquisition unit 10 from the oral scanner, performs image processing, and guides a scanning strategy for accurately imaging the teeth by the oral scanner. For example, a guidance scan path providing a scan strategy of the oral scanner is displayed on the guidance screen. The guide scan path may be preset according to different manufacturers of the oral scanners. In this case, the user can confirm whether the user normally takes the image in accordance with the guidance while confirming the guidance scan path on the screen by displaying the guidance scan path on the screen of the image processing program, instead of providing the guidance scan path on a separate file or web page.

The control section 14 of an embodiment tracks the user scan path to provide to the output section 18. The user scanning path is a path actually scanned in real time when the user starts scanning through the oral scanner according to the guide scanning path. The control unit 14 tracks the user scanning path, and configures a scanning guidance screen by matching the tracked user scanning path with the guidance scanning path. At this time, the output unit 18 can display the user scanning route on the scanning guide screen together with the guide scanning route. For example, the guidance scan path and the user scan path are displayed on the tooth model data so as to overlap each other.

As an example of the user scan path tracking method, the control unit 14 reconstructs a 2D image obtained by scanning with an oral scanner to generate a depth image (depth image), and connects the center point or principal point of each object constituting the depth image.

Then, intersection points from the center points or principal points of the respective objects to the surface positions of the 3D objects are detected, and the detected intersection points are connected to generate a user scanning path.

Further, the user scan path can be corrected by connecting points formed at a predetermined distance from the detected intersection point. Referring to fig. 7, an embodiment related thereto will be described later. As another example, the control unit 14 may generate the user scanning path by connecting center points of respective objects of a 3D image obtained by scanning with the oral scanner.

In the image processing for simultaneously displaying the user scanning path and the guide scanning path, for example, the control unit 14 matches the user scanning path with the guide scanning path after matching the ratio of the tracked user scanning path with the ratio of the guide scanning path. The following description will be made of an embodiment related thereto with reference to fig. 9 and 10. The control unit 14 compares the user scanning route and the guidance scanning route, and provides at least one of a comparison analysis result and a warning signal generated based on the comparison analysis result. For example, when the user scan path deviates from the guide scan path by a large amount, a warning signal may be generated to make the user recognize it.

The output unit 18 can variously display the scan guide screen. For example, the output unit 18 may display the guidance scan path on the scan guidance screen by the user operating to rotate the guidance scan path or moving the guidance scan path to the same viewpoint as the position actually photographed by the oral scanner. The output unit 18 can also rotate the guide scanning path in real time in synchronization with the position actually imaged by the oral scanner and display the guide scanning path on the scanning guide screen. As another example, the output unit 18 may display a user interface for user setting whether to display or not to display the scan guide on the screen, and the input unit 16 may allow the user to set whether to display or not to display the scan guide. As another example, a user interface for user setting of transparency of the scan guide may be displayed on the screen, and whether the transparency of the scan guide is set by the user through the input unit 16. The output section 18 may display the user scanning path in real time in the image data actually scanned by the oral scanner. The input unit 16 receives various user instructions through an image processing program.

Fig. 2 and 3 are views showing a configuration and setting screen of a scan guide screen according to an embodiment of the present invention, and more specifically, fig. 2 is a view showing a two-dimensional scan guide screen, and fig. 3 is a view showing a three-dimensional scan guide screen.

Referring to fig. 2 and 3, the scanning program displays a guide scanning path 200 providing a scanning strategy through the scanning guide screen 2 so that the user can accurately photograph teeth through the oral scanner before and during the user starts scanning. At this time, the guidance scan path 200 displays a path in predetermined tooth model data. The scan strategy provided by the pilot scan path 200 includes a scan start point, a scan direction, a scan order, and the like. The guide scan path 200 may be provided in a 2D or 3D image, and may also be provided in an animation. The user scans according to the guided scan path 200.

The scan guide frame 2 can be disposed at one of four corners of the scan process. The user can move the scanning guidance screen 2 to a desired position. For example, the position of the scan guide screen 2 is freely moved by a Drag and Hold (Drag and Hold) function.

As shown in fig. 2, the 2D scan guide screen 2 is basically a top view (top view) and can be displayed while being converted to another view (view). As shown in fig. 3, the guide scan path 200 of the 3D scan guide screen 2 may be rotated by a user input on the drawing or moved to the same viewpoint as the position actually photographed by the oral scanner to be displayed. Also, the 3D scanning guide screen 2 can be displayed by rotating the guide scanning path in real time in synchronization with the position actually photographed by the oral scanner.

Fig. 4 and 5 are diagrams illustrating scan guidance on/off functions according to various embodiments of the present invention.

Referring to fig. 4 and 5, the user may not need to display the scan guidance screen 2 in the scan program. In this case, as shown in fig. 4, the scan guide screen may be turned on/off through the setting window 510 of the separate option menu 500. As another example, as shown in fig. 5, a user interface capable of handling an on/off function in real time, for example, a setting window 600 including a button in the form of a check box, may be provided on the scan screen to allow the user to turn on/off the scan guide screen. Further, a user interface for setting the transparency of the guidance scan path 200 for scanning the guidance screen 2 can be displayed on the screen, and the transparency of the scan guidance can be set by the user. This is the case when the user wants to see the guide scan path 200, but wants to see the tooth model clearly, and can be achieved by adjusting the transparency.

FIG. 6 is a diagram showing a screen for tracking a user scan path according to an embodiment of the present invention.

Referring to fig. 6, the scanning path taken by the user can be tracked in real time while scanning and displayed on the scan guide screen 2, and the image data actually scanned can be displayed.

Fig. 7 is a diagram showing a program screen for explaining an algorithm for tracking a user scan path according to an embodiment of the present invention.

Referring to fig. 1 and 7, the image processing apparatus 1 may track a user scan path using a method of selecting an image center tracking path to display on a screen. For example, as shown in fig. 7, the center points of the depth images 810 are connected. The depth image 810 is an image having a height (Z value), and may be obtained based on various Reconstruction (Reconstruction) algorithms for a 2D image. The 3D object may be derived using the depth image 810. When the resolution of the oral scanner camera is 640 × 480, each depth image Cutout (CUT) with overlapping regions has a size of 640 × 480. The 320 × 240 points 821, 822, 823, 824, and 830, which are the cut centers (or principal points) of the respective depth images obtained after the reconstruction, are sequentially connected. Next, for 3D representation, the intersection 840 of the surface positions of the 3D object is retrieved from the cut center points 821, 822, 823, and 824, and the retrieved intersection is sequentially connected to generate a user scan path 850. At this time, depending on the position of the detected point, when the cross-site is connected, a situation may arise where the object is crossed (e.g., the cross-site connects the user scan path 850 of fig. 1, 2). Thus, the user scan path (e.g., 860 of FIG. 1 connected at a cross-point) may be corrected for a predetermined distance, e.g., 5 mm. In the example of fig. 7, a plurality of dots (points) are displayed together, but when the program is actually implemented, only the lines may be output without outputting the dots.

Fig. 8 is a diagram showing a scan screen for comparing the tracked user scan path and the guidance scan path and outputting the same according to the embodiment of the present invention.

Referring to fig. 1 and 8, the image processing apparatus 1 displays the user scan path 210 and the guide scan path 200 together in the dental model data on the scan guide screen 2. At this time, since the user scanning path 210 and the guide scanning path 200 are displayed to be overlapped, the user can confirm whether the user scans the guide scanning path 200 accurately in real time while comparing the user scanning path 210 with the guide scanning path 200.

The image processing apparatus 1 of an embodiment may compare the analysis user scan path 210 and the guidance scan path 200 to provide the comparison analysis result to the user. For example, the distance between the point of the user scan path 210 and the point of the guidance scan path 200 that match each other with reference to a predetermined point of the tooth model data is calculated and displayed. Further, the image processing apparatus 1 may output a warning signal relating to the result of the comparative analysis. For example, when the calculated distance is equal to or more than a preset distance, it is determined that scanning is abnormal, and the user is warned of the abnormality. The warning signal may use conventional notification techniques such as alarms, pop-up menu displays, and the like.

Fig. 9 is a diagram showing that the user scan path and the guidance scan path of each user do not match.

Referring to fig. 9, the size of the total arch (fullarch), the size of each individual tooth, the arrangement of teeth, and the like are different from person to person, and thus the ratio of the scanning path may be different. For example, as shown in fig. 9, the ratio of the user scanning path formed in the adult full arch teeth is different from the ratio of the user scanning path formed in the infant full arch teeth (smaller in size than the adult full arch teeth), and therefore, the ratio is not consistent with the guide scanning path. Therefore, a work of making the ratio uniform is required.

Fig. 10 is a diagram showing a screen for matching a user scan path and a guidance scan path according to an embodiment of the present invention.

Referring to fig. 1 and 10, in order to solve the above-described problem of the scale inconsistency with reference to fig. 9, it is assumed that the user starts scanning at the same position as the starting point proposed in the guidance scan path. The image processing apparatus 1 of an embodiment adjusts the scale for the form in which the scale is uniform so that the vertical and horizontal lengths and the ratio of the user scanning path are uniform with the guide scanning path. For example, the reduced user scan path is generated by reducing the Scale (Scale Down) of the user scan path formed in the full arch teeth of an adult. The user scan path formed on the child's full arch teeth is enlarged in Scale (Scale Up) to generate an enlarged user scan path. As the scale of the user scanning path 210 generated by the scale up/down processing of the user scanning path coincides with the guidance scanning path 200, matching can be performed within the scanning guidance screen 2.

Fig. 11 is a diagram showing a screen for comparing a user scan path and a guidance scan path according to an embodiment of the present invention.

Referring to fig. 1 and 11, the image processing apparatus 1 displays a guide scan path 200 for scanning on the guide scan screen 2 (part (a)), and when a user starts scanning on the guide scan path 200, displays a user scan path 210 generated by scanning on the guide scan screen 2 together with the guide scan path 200 (parts (b) and (c)). Part (b) of fig. 11 shows a case where the user normally photographs the guide scan path 200, and part (c) of fig. 11 shows a case where the user scan path 210 is far away from the guide scan path 200.

Fig. 12 is a flowchart illustrating a scan guidance providing method according to an embodiment of the present invention.

Referring to fig. 1 and 12, the image processing apparatus 1 displays a guidance scan path providing a scan strategy of the oral scanner on a scan screen (S1210). In the step of displaying the guidance scan path on the scan screen (S1210), the image processing apparatus 1 may display the guidance scan path preset by a different manufacturer of the oral scanner on the screen. The image processing apparatus 1 can display the guidance scan path on the screen by the user operating to rotate the guidance scan path or move the guidance scan path to the same viewpoint as the position actually photographed by the oral scanner. As another example, the image processing apparatus 1 may rotate the guide scanning path in real time in synchronization with the position actually captured by the oral scanner and display the guide scanning path on the screen. Further, the image processing apparatus 1 may provide a user interface for user setting whether to display or not to display the scan guide, a user interface for user setting of transparency of the scan guide, and the like to the screen.

Next, when the scanning is started (step S1220), the image processing apparatus 1 tracks the user scanning path actually scanned by the oral scanner according to the guide scanning path (step S1230).

In the user scan path tracking step (S1230), the image processing apparatus 1 of an embodiment tracks the user scan path using the image center or principal point. For example, the image processing apparatus 1 reconstructs a 2D image obtained by scanning with an oral scanner to generate a depth image, and connects the center points or principal points of the respective objects constituting the depth image. Then, intersection points from the center points or principal points of the respective objects to the surface positions of the 3D objects are detected, and the detected intersection points are connected to generate a user scanning path. In this case, the user scan path may be corrected by connecting points formed at a predetermined distance from the detected intersection point. As another example, the image processing apparatus 1 may generate the user scanning path by connecting center points of respective objects of a 3D image obtained by scanning with the oral scanner.

Next, the image processing apparatus 1 displays the tracked user scan path together with the guide scan path (step S1240). In the step of displaying together with the guide scan path (S1240), the image processing apparatus 1 of an embodiment matches the user scan path to the guide scan path to display after matching the user scan path to the guide scan path by the image processing. The image processing apparatus 1 may display the user scanning path in the image data actually scanned by the oral scanner.

Further, the image processing apparatus 1 may compare and analyze the user scanning path and the guidance scanning path, and provide at least one of a comparison analysis result and a warning signal.

The present invention has been examined above centering on the embodiments. It will be appreciated by those skilled in the art that the present invention can be embodied in modified forms without departing from the essential characteristics thereof. The disclosed embodiments are therefore to be considered in all respects as illustrative and not restrictive. The scope of the invention is indicated in the claims of the patent application, rather than the foregoing description, and all differences within the scope and range of equivalents thereof are intended to be embraced therein.