阅读说明：本技术 眼底检查系统 (Fundus inspection system ) 是由 韩宇星 陈明强 胡丁山 张大磊 于 2020-06-05 设计创作，主要内容包括：本发明提供一种眼底检查系统,包括用户终端,用于发送个人信息和相机序列号；服务器,用于接收所述人信息和相机序列号,并根据所述相机序列号向眼底相机发送启动指令；眼底相机,用于在接收到所述启动指令后进入工作状态,以使用户操控拍摄其眼底照片；所述服务器还用于关联存储所述眼底照片和所述个人信息。(The invention provides a fundus inspection system, which comprises a user terminal, a camera serial number and a camera serial number, wherein the user terminal is used for sending personal information and the camera serial number; the server is used for receiving the person information and the camera serial number and sending a starting instruction to the fundus camera according to the camera serial number; the fundus camera is used for entering a working state after receiving the starting instruction so as to enable a user to control and shoot fundus pictures; the server is also used for storing the fundus picture and the personal information in a correlated mode.)

1. A fundus inspection system, comprising:

a user terminal for transmitting personal information and a camera serial number;

the server is used for receiving the person information and the camera serial number and sending a starting instruction to the fundus camera according to the camera serial number;

the fundus camera is used for entering a working state after receiving the starting instruction so as to enable a user to control and shoot fundus pictures; the server is also used for storing the fundus picture and the personal information in a correlated mode.

2. A system according to claim 1, wherein the fundus camera is provided with sensing means for sensing manipulation information resulting from user manipulation of the fundus camera.

3. The system of claim 2, wherein the fundus camera is configured to transmit the manipulation information;

the server is used for receiving the control information to monitor whether the operation of the fundus camera by the user is correct or not, and sending corresponding prompt information to the fundus camera when the operation is judged to be wrong.

4. The system as claimed in claim 3, wherein the fundus camera is provided with a voice playing device for playing voice according to the prompt information to guide the user to correctly operate the fundus camera.

5. The system as claimed in claim 1, wherein the fundus camera is provided with a voice playing device for playing voice to guide a user to operate the fundus camera according to a set flow.

6. The system of claim 3, wherein the sensing device comprises a light sensor for sensing ambient light to generate ambient light intensity information; and the server judges whether the environment where the eye fundus camera is located can take the eye fundus picture or not according to the light intensity information.

7. The system of claim 3, wherein the sensing device comprises a distance measuring device for detecting a distance between an eyeball of the user and the lens to generate distance information; the server judges whether the fundus camera can take a fundus picture or not according to the distance information.

8. The system of claim 1, wherein the personal information includes medical history information and/or symptom information;

the server detects the fundus picture according to the medical history information and/or the symptom information to obtain a detection result;

the user terminal is used for obtaining the detection result.

9. The system according to claim 1 or 8, wherein the server is configured to determine the photographing quality of the fundus picture, and send a prompt message to the user terminal to prompt a user to re-operate the fundus camera to take a fundus picture thereof when it is determined that the photographing quality does not meet a preset standard.

10. The system according to any one of claims 1 to 9, wherein the fundus camera is provided with a two-dimensional code for representing the camera serial number; the user terminal is used for scanning the two-dimensional code to obtain the camera serial number.

Technical Field

The invention relates to the field of ophthalmic medical instruments, in particular to a fundus inspection system.

Background

The fundus picture is an important image means for observing retina and diagnosing fundus diseases, and doctors can analyze and judge the severity of various diseases according to the fundus picture. The fundus camera for taking the fundus picture has a complex structure, comprises optical elements such as a lens group for imaging, an image processing module, a data communication module and the like, and needs to be transmitted to a computer for storage and display after the user fundus picture is taken. The fundus camera needs to be matched with a computer for use, so that the fundus camera can be called a fundus examination system, the application scene of the system is generally limited in medical institutions at present, for example, fundus photographing and examination can be realized through an information system of a hospital, and professional medical staff is needed to assist patients in photographing.

In order to improve the convenience of fundus examination, the prior art proposes to improve the structure of a fundus camera to miniaturize the fundus camera as much as possible, and proposes a plurality of technical schemes (automatic alignment) for automatically searching the pupil position by a lens, so that the shooting process is smoother, the shot fundus picture is clearer, and the like. However, the prior art ignores the problem of human-computer interaction, the fundus camera is not a common electronic device in daily life, and the camera is not suitable for arranging a display screen and a plurality of interaction devices to optimize the interactivity. Although having a lightweight structure and an automatic alignment function, the user is generally unaware of how to take a picture when facing the fundus camera, and even cannot activate the camera. Therefore, the existing fundus examination system is still difficult to be separated from a medical institution, so that the fundus picture is inconvenient to be shot by a user, the fundus picture of the user cannot be obtained in time, and the human-computer interaction performance needs to be improved.

Disclosure of Invention

In view of the above, the present invention provides a fundus inspection system, comprising:

a user terminal for transmitting personal information and a camera serial number;

the server is used for receiving the person information and the camera serial number and sending a starting instruction to the fundus camera according to the camera serial number;

the fundus camera is used for entering a working state after receiving the starting instruction so as to enable a user to control and shoot fundus pictures; the server is also used for storing the fundus picture and the personal information in a correlated mode.

Optionally, the fundus camera is provided with sensing means for sensing manipulation information resulting from manipulation of the fundus camera by a user.

Optionally, the fundus camera is used to send the manipulation information;

the server is used for receiving the control information to monitor whether the operation of the fundus camera by the user is correct or not, and sending corresponding prompt information to the fundus camera when the operation is judged to be wrong.

Optionally, the fundus camera is provided with a voice playing device for playing voice according to the prompt information so as to guide a user to correctly control the fundus camera.

Optionally, the fundus camera is provided with a voice playing device for playing voice to guide a user to control the fundus camera according to a set flow.

Optionally, the sensing device includes a light sensor for sensing ambient light to generate ambient light intensity information; and the server judges whether the environment where the eye fundus camera is located can take the eye fundus picture or not according to the light intensity information.

Optionally, the sensing device includes a distance measuring device, configured to detect a distance between an eyeball of the user and the lens to generate distance information; the server judges whether the fundus camera can take a fundus picture or not according to the distance information.

Optionally, the personal information comprises medical history information and/or symptom information;

the server detects the fundus picture according to the medical history information and/or the symptom information to obtain a detection result;

the user terminal is used for obtaining the detection result.

Optionally, the server is configured to determine the photographing quality of the fundus picture, and send a prompt message to the user terminal when it is determined that the photographing quality does not meet a preset standard, so as to prompt the user to re-operate the fundus camera to take the fundus picture thereof.

Optionally, the fundus camera is provided with a two-dimensional code for representing the camera serial number; the user terminal is used for scanning the two-dimensional code to obtain the camera serial number.

According to the fundus examination system provided by the invention, a user can use the personal terminal to confirm personal information and the camera serial number and then send the personal information and the camera serial number to the remote server, the server wakes up the fundus camera to enter a working state by sending a starting instruction, a taken fundus picture is stored in the server, and the user can use the personal terminal to obtain the fundus picture of the user. The system converts the operation of the user on the eye fundus camera into the operation on the personal terminal, thereby reducing the difficulty of man-machine interaction and avoiding overhigh cost caused by arranging too many interaction devices in the eye fundus camera. As a service manufacturer, the fundus cameras can be deployed at a plurality of places, all the fundus cameras can be served simultaneously by deploying a small amount of server equipment remotely, professional medical staff do not need to intervene in a photographing scene, the system can be separated from a medical institution to be managed and used by ordinary staff, and popularization of examination on fundus health is facilitated.

The server in the fundus examination system provided by the invention can detect the fundus picture to obtain the detection result about the disease, and the user can check the fundus picture and the detection result through the personal terminal, so that the user can know the eye health state of the user efficiently and timely, the convenience of ophthalmic examination is improved, and the detection result can be referred by medical staff, thereby saving the medical cost.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic view of a fundus inspection system in an embodiment of the present invention;

FIG. 2 is a timing diagram of a fundus inspection system according to an embodiment of the present invention;

FIG. 3 is a timing chart of another fundus inspection system in an embodiment of the present invention.

Detailed Description

The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.

As shown in fig. 1, an embodiment of the present invention provides a fundus inspection system, which includes a user terminal 1, a server 2, and a plurality of fundus cameras 3, wherein the user terminal 1 may be a portable mobile device, such as a personal smart phone; the server 2 is a dedicated device deployed by a service provider, and the server is a general term for a service device deployed remotely, and it should be understood by those skilled in the art that in practical applications, a variety of servers, such as an IOT (Internet of things) server, a data storage server, and the like, need to be set according to applications, so that the server may be understood as a server or a cluster formed by a plurality of servers. The server 2 is connected to the terminal 1 and each fundus camera 3 through the internet. The fundus camera 3 is an electronic apparatus having an optical element, an imaging device, and a communication device. The system can adopt a self-photographing type fundus camera disclosed in Chinese patent document CN209826671U, so that a user can take self-photographing fundus pictures by holding or wearing the system.

The user terminal 1 is used to transmit personal information and a camera serial number. When a user needs to take a fundus picture, the user operates the smart phone of the user to fill in or confirm personal information. Specifically, a user needs to register when using the system for the first time, and fills personal information in an interactive interface provided by the system and submits the personal information to the server 2 to establish a personal account; when the system is used again, the individual account can be selected in the system, which is equivalent to sending the individual information.

The camera serial number may be manually entered by the user or its unique serial number may be obtained from the fundus camera 3 by near field communication techniques such as radio frequency identification. Preferably, the fundus camera 3 of the present embodiment is provided with a two-dimensional code including a camera serial number. The user terminal 1 can parse and send the camera serial number to the server by scanning the two-dimensional code. Therefore, the personal information and the camera serial number can be transmitted based on the existing mobile phone application program with two-dimensional code scanning.

The personal information may include, for example, basic information such as a user name, an age, a gender, and the like, and may further include a unique identity to ensure identity uniqueness, and specifically, the identity may be assigned to the user according to a registration sequence when the user registers.

The server 2 is configured to receive the personal information and the camera serial number transmitted from the user terminal 1 and transmit a start instruction to the fundus camera 3 based on the camera serial number. Specifically, an IOT server may be used in practical applications, a plurality of fundus cameras 3 may be connected and managed at the same time, the server 2 stores therein a correspondence relationship between the serial number of each fundus camera 3 and information such as its IP address and physical address, and when receiving a fundus examination request corresponding to the personal information and the camera serial number transmitted from the user terminal 1, the server 2 may determine which fundus camera 3 in the network should be started up and transmit a start instruction thereto based on the camera serial number transmitted from the user.

The fundus camera 3 is used for entering a working state after receiving the starting instruction so as to enable a user to control and take fundus pictures. This is a remote wake-up process, where the user activates the fundus camera indirectly through the smartphone and server, rather than operating the fundus camera directly. According to the camera structure of the present embodiment, the user can take a picture of the fundus by himself after the camera is started, and then the fundus camera 3 transmits the picture of the fundus to the server 2. Of course, the present invention is not limited to the use of a self-photographing type fundus camera, and is applicable to the use of a large-sized fundus camera having a more complicated structure, or a fundus camera that requires others to hold to photograph a patient.

The server 2, after receiving the fundus picture, stores it in an account registered by the user, that is, stores the fundus picture and the personal information in association with each other. In practical application, the data storage server can be used, a user can access the server 2 to view the fundus picture of the user by using any terminal, and the server 2 can also actively send the fundus picture to the user terminal 1.

As shown in fig. 2, when the user uses the present system of the present embodiment, each device performs operations including:

S1A, user terminal 1 obtains personal information and camera serial number;

S2A, the user terminal 1 sends the personal information and the camera serial number to the server 2;

S3A, the server 2 sends a start instruction to the fundus camera 3 according to the camera serial number;

S4A, the fundus camera 3 enters a working state after receiving the starting instruction, and a fundus picture is taken;

S5A, the fundus camera 3 sends the fundus picture to the server 2;

S6A, the server 2 transmits the fundus picture to the user terminal 1, or stored in a user account in the server 2.

According to the fundus inspection system provided by the embodiment of the invention, a user can use the personal terminal to confirm personal information and the camera serial number and then send the personal information and the camera serial number to the remote server, the server wakes up the fundus camera to enter a working state by sending a starting instruction, a taken fundus picture is stored in the server, and the user can use the personal terminal to obtain the fundus picture of the user. The system converts the operation of the user on the eye fundus camera into the operation on the personal terminal, thereby reducing the difficulty of man-machine interaction and avoiding overhigh cost caused by arranging too many interaction devices in the eye fundus camera. As a service manufacturer, the fundus cameras can be deployed at a plurality of places, all the fundus cameras can be served simultaneously by deploying a small amount of server equipment remotely, professional medical staff do not need to intervene in a photographing scene, the system can be separated from a medical institution to be managed and used by ordinary staff, and popularization of examination on fundus health is facilitated.

For the self-timer type fundus camera, after being remotely started by the server 2, the user may also be given more prompts in step S4A to ensure that the photographing process is smoothly performed. In a preferred embodiment, the fundus camera 3 is provided with a voice playing device for playing voice to guide the user to manipulate the fundus camera 3 according to the set flow. Specifically, the boot process of the present embodiment includes: step S4a1 of prompting the user to place the fundus camera 3 in a darkroom or at no light; step S4A2, prompting a user to place eyes in a shooting position, and simultaneously amplifying eye sockets by using two hands to expose eyeball in front of a shooting opening to the maximum extent; step S4A3, prompting a user to rotate the eyeball according to the direction of the light source in the camera; in step S4a4, after taking a fundus picture of one eye is completed, the user is prompted to switch to the other eye.

Further, in order to ensure that the user can correctly manipulate the fundus camera 3 for self-photographing, the fundus camera 3 is also provided with a sensing device in a preferred embodiment to sense manipulation information generated by the user's manipulation of the fundus camera 3. For example, a light sensor for sensing ambient light to generate ambient light intensity information, which can be changed by a user's manipulation since the fundus camera 3 can be moved by the user, and/or a distance measuring device may be provided, and the ambient light intensity information is regarded as a kind of manipulation information.

The distance measuring device is used for detecting the distance between the eyeball of a user (a shot object) and the lens (the ocular lens of the eye ground camera) and generating distance information according to the distance, and specifically can be an infrared distance measuring device or a shooting distance measuring device, and the distance information is generated by detecting the distance between the eye and the ocular lens at a shooting position (near the ocular lens) of the eye ground camera 3. Since the user can adjust the positional relationship with the fundus camera 3 by himself, the distance information is regarded as a kind of manipulation information.

The fundus camera 3 can automatically judge whether the above-mentioned ambient light intensity information and distance information meet the set standard, and control the prompting process according to the above-mentioned information. Specifically, for example, in the step S4a1, the light sensor is activated and it is determined whether the ambient light intensity information is smaller than the set intensity value, when the ambient light intensity information is smaller than the set intensity value, the step S4a2 is executed to determine that the current environment meets the shooting requirement, otherwise, the step S4a1 is stopped, and the user is continuously prompted to adjust the shooting environment; for example, in step S4a2, the distance measuring device is activated to determine whether the distance information is between the upper threshold and the lower threshold, that is, whether the distance between the eye and the eyepiece is too close or too far, and when the distance information is between the upper threshold and the lower threshold, the current distance is considered to be in accordance with the shooting requirement, step S4A3 may be executed, otherwise, the step S4a2 is stopped, and the user is prompted to change the distance between the eye and the eyepiece.

In a preferred embodiment, the above-described operation of determining the environment and the distance is performed by the server 2, that is, the fundus camera 3 is used only to acquire the manipulation information and transmit it to the server 2. The server 2 determines from the light intensity information whether the environment in which the fundus camera 3 is located can take a fundus picture, and determines from the distance information whether the fundus camera 3 can take a fundus picture. Performing the calculation remotely by the server 2 reduces the amount of calculation of the fundus camera 3, whereby it is possible to reduce the cost of the fundus camera 3 and improve portability.

The embodiment of the invention provides another fundus examination system which comprises a user terminal 1, a server 2 and a plurality of fundus cameras 3, and the fundus examination system is added with a function of detecting fundus pictures on the basis of the system of the embodiment. Specifically, after receiving the fundus picture, the server 2 of the present embodiment uses the trained machine learning model to identify (including classification, segmentation, and regression) the fundus picture, obtain a detection result, and store the detection result in an account registered by the user, where the detection result may be a segmentation result of an object of interest in the fundus picture, a classification result of a category to which the fundus picture belongs (for example, belonging to health or a certain disease), or a regression prediction result of a relevant body index of the fundus picture (for example, age, diopter, and the like). The user can use any terminal to access the server 2 to check the detection result of the user, and the server 2 can also actively send the detection result to the user terminal 1.

In order to make the detection performed by the server 2 more targeted, the personal information transmitted or confirmed by the user terminal 1 of the present embodiment includes medical history information and/or symptom information. Specifically, the medical history information includes several questions and options-whether there is diabetes, whether there is hypertension, whether there is cardiovascular and cerebrovascular disease, whether there is high myopia, whether there is history of eye surgery; symptom information includes several questions and options-whether vision is degraded, whether there is edema in the eyes, whether there is bleeding in the eyes, whether there is a symptom of a fissure.

When the server 2 receives the information, the detection mode of the fundus picture is determined according to the information, for example, the detection area is determined, or a suitable machine learning model is selected to detect the fundus picture, so that the detection result is more accurate. The reason for this is that, in order to comprehensively detect various possible fundus diseases, a service manufacturer may train a plurality of models for different disease types and a plurality of models for different regions of the fundus oculi, and at the same time, the service manufacturer may train a multi-disease identification model for some common ocular diseases, for example, a machine learning model disclosed in chinese patent document CN108596895A may realize multi-disease detection. The advantages of a plurality of models are different, for example, some models have more detailed identification aiming at the characteristics of diabetic retinopathy, and the severity grade of the pathological changes can be detected; some models are more comprehensive, and can screen various fundus diseases simultaneously; some models only detect the optic disc region and only identify glaucoma. In this case, the detection efficiency using all models for each fundus picture of the user is low, so the embodiment represents the actual situation of the user by the medical history information and/or symptom information, and the server selects a part of models for the actual situation of the user to recognize the fundus picture thereof, thereby improving the detection efficiency.

For example, when the personal information of the user shows that the user does not have any medical history or symptoms, a plurality of disease identification models can be used for roughly detecting some common disease features, and the detection by using a model for a certain disease is not needed; for example, when the user has diabetes mellitus in personal information, the fundus picture can be detected by using a model special for detecting characteristics of diabetic retinopathy, so that the detection result is more detailed.

The above example is only for clearly explaining how the server 2 performs the targeted detection, and is not limited to the model selection logic, and other selection strategies may be set in practical application.

In an alternative embodiment, the server 2 may further determine the photographing quality of the fundus picture, for example, the server 2 may perform stain/bright spot detection, exposure detection, sharpness detection, light leakage detection, local shadow detection, and the like on the fundus picture by using an image detection method disclosed in chinese patent document CN108346149A, and send a prompt message to the user terminal 1 when it is determined that the photographing quality does not meet the preset standard, so as to prompt the user to operate the fundus camera 3 again to take the fundus picture thereof.

As shown in fig. 3, when the user uses the present system of the present embodiment, each device performs operations including:

S1B, user terminal 1 obtains personal information and camera serial number;

S2B, the user terminal 1 sends the personal information and the camera serial number to the server 2;

S3B, the server 2 sends a start instruction to the fundus camera 3 according to the camera serial number;

S4B, the fundus camera 3 enters a working state after receiving the starting instruction, and a fundus picture is taken;

S5B, the fundus camera 3 sends the fundus picture to the server 2;

S6B, the server 2 detects the fundus picture to obtain the detection result, and the detection in the step comprises the detection of the fundus disease and the detection of the fundus picture quality.

S7B, the server 2 transmits the fundus picture and the detection result to the user terminal 1, or stored in a user account in the server 2.

The server in the fundus examination system provided by the embodiment of the invention detects the fundus picture to obtain the detection result about the disease, and the user can check the fundus picture and the detection result through the personal terminal, so that the user can efficiently and timely know the eye health state of the user, the convenience of ophthalmic examination is improved, and the detection result can be referred by medical staff, thereby saving the medical cost.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.