Detailed Description
In the following embodiments, the color fundus image and the color fundus image to be measured refer to color images of the corresponding human fundus taken without applying fluorescent agent. The fluorescence fundus map refers to an image of the corresponding human fundus taken with a fluorescent agent applied.
FIG. 1 shows a schematic diagram of an apparatus for acquiring a fluorescence fundus image according to an embodiment of the present invention. Referring to fig. 1, the apparatus 100 for obtaining a fluorescence fundus image at least has an input unit 110, a storage unit 120 and a processing unit 130.
The input unit 110 receives a color fundus image to be measured. In one embodiment of the present invention, the input unit 110 can be implemented as a fundus camera, i.e., a color fundus image to be measured is received by taking a picture of the fundus of the subject. In another embodiment of the present invention, the input unit 110 may be implemented by a connection port for receiving digital data transmission, such as an RS-232 interface supporting various types of communication protocols, a Universal Serial Bus (USB), a Wireless fidelity (WiFi), an RJ45 interface, etc., but the present invention is not limited thereto. That is, the apparatus 100 for acquiring a fluorescence fundus map may directly photograph or indirectly receive a color fundus map to be measured through transmission through the input unit 110, and the present invention is not limited thereto.
The storage unit 120 is used for storing various data and program codes required for the operation of the apparatus 100 for obtaining a fluorescence fundus map. Specifically, the storage unit 120 stores a fundus image map conversion model having parameters for converting a color fundus map into a corresponding fluorescence fundus map. In an embodiment of the invention, the hardware of the storage unit 120 may be various types of nonvolatile memories, such as storage devices of Hard Disk Drives (HDDs) and solid-state drives (SSDs), but the invention is not limited thereto.
The processing unit 130 is connected to the input unit 110 and the storage unit 120, and is configured to perform various operations required by the apparatus 100 for obtaining a fluorescence fundus map. The detailed operation will be described later. In an embodiment of the invention, the Processing Unit 130 is, for example, a Central Processing Unit (CPU), a Microprocessor (Microprocessor), a Digital Signal Processor (DSP), a Programmable controller, a Programmable Logic Device (PLD), or other similar devices or combinations thereof, but the invention is not limited thereto.
FIG. 2 is a flow chart illustrating a method for obtaining a fluorescence fundus image according to an embodiment of the present invention. Referring to fig. 2, the method for obtaining a fluorescence fundus image according to this embodiment is at least applicable to the apparatus 100 for obtaining a fluorescence fundus image shown in fig. 1, but is not limited thereto. Details of the method to acquire a fluorescence fundus image will be explained below by means of fig. 1 and 2.
In step S210, the color fundus map to be tested is received by the input unit 110. Specifically, as described above, the input unit 110 may receive a color fundus image to be diagnosed by photographing a human fundus or by transmitting the color fundus image to be diagnosed.
In step S220, the color chart feature of the color eye-bottom chart to be measured is obtained by the processing unit 130. It should be noted that, in an embodiment of the present invention, in order to obtain the color map features quickly and accurately, the processing unit 130 further performs a pre-processing procedure on the color fundus map to be measured. For example, the pre-processing procedure is at least one of a gray-scale processing, an eye positioning and an image enhancement.
The gray scale processing is to convert an image into gray scales so that the image features after the pixels are converted can be highlighted. The eyeball positioning is to identify the position of the eyeball of the user so as to filter out the range which does not belong to the eyeground. The image enhancement is, for example, to smooth an image using a gaussian filter.
In step S230, the processing unit 130 encodes the color map features of the color fundus map to be measured according to the fundus image map conversion model in the storage unit 120 to convert the color fundus map to be measured into a fluorescence fundus map to be measured. Since the fundus image map conversion model has parameters and rules for converting the color fundus map into the fluorescence fundus map, the processing unit 130 can encode the color map features of the color fundus map to be detected according to the fundus image map conversion model, thereby outputting the corresponding fluorescence fundus map.
In step S240, a fluorescence fundus image is output by the processing unit 130. Therefore, the medical staff can judge whether the fundus of the detected person corresponds to the fundus situation of the potential disease or not through the output fluorescent fundus picture, and then treat the detected person.
It should be noted that, in some embodiments of the present invention, the storage unit 120 can further store fluorescence map features related to diseases. Therefore, when acquiring the fluorescence map feature of the fluorescence map, the processing unit 130 can automatically determine the disease information corresponding to the fluorescence map according to the fluorescence map feature.
Fig. 3 is a flowchart illustrating a method for obtaining an eye fundus image map conversion model according to an embodiment of the present invention. A method for acquiring a fundus image conversion model will be described below with reference to fig. 1 and 3.
In step S310, the color fundus map and the corresponding fluorescence fundus map are received by the input unit 110. Specifically, the color fundus image and the fluorescence fundus image received by the input unit 110 are measurement results corresponding to the same subject. That is, both the color fundus image and the fluorescence fundus image are actually detected historically.
In step S320, the color map features in the color fundus map are acquired by the processing unit 130, and the color map features of the color fundus map are encoded to convert the color fundus map into an estimated fluorescence fundus map. In an embodiment of the present invention, the processing unit 130 encodes the color map feature of the color eye-bottom map according to an auto-encoder (auto encoder), but the present invention is not limited thereto.
In addition, in order to reduce the time consumed by encoding, the processing unit 130 also performs a preprocessing procedure on the color eye-bottom map. The content of the preprocessing procedure has been described above, and is not described herein again.
In step S330, the estimated fluorescence image characteristics in the fluorescence fundus map and the fluorescence image characteristics of the fluorescence fundus map are compared by the processing unit 130 to obtain difference characteristic information, and the fundus image map conversion model is trained according to the difference characteristic information.
That is, since the color fundus image and the fluorescence fundus image correspond to the same examinee, the fundus images generated by the same examinee who receives any test will be the same theoretically without considering various external factors such as the degree of image recognition, the fineness of the camera, and the like. Therefore, through the fundus image conversion model, the estimated fluorescence fundus image generated after the color fundus image is coded should have the same fluorescence image characteristics as the fluorescence fundus image. Therefore, the processing unit 130 may determine the difference between the fluorescence fundus image and the fluorescence fundus image to acquire difference feature information, and train and adjust the fundus image map conversion model by adjusting the error caused by encoding according to the difference feature information.
It is worth mentioning that in the initial stage of training the fundus image map conversion model, the parameters and rules of the fundus image map conversion model in the color fundus map and the fluorescence fundus map are not clear, so that the difference between the converted estimated fluorescence fundus map and the fluorescence fundus map is large. At this time, the processing unit 130 performs encoding in a small scale, for example, encoding based on color image features or an area. In the later period of training, the processing unit 130 can encode in a large scale manner, for example, the entire color fundus map, to improve the learning efficiency, because the parameters and rules between the color fundus map and the fluorescence fundus map are clear. Although the invention is not limited thereto.
In summary, the method for acquiring a fluorescence fundus map and the apparatus for acquiring a fluorescence fundus map of the present invention can convert the color fundus map to be measured into a fluorescence fundus map by means of encoding. Therefore, a testee can obtain a corresponding fluorescence fundus image only by shooting the color fundus image to be tested, and the testee does not need to go through a lengthy fluorescence fundus photographing program and endure discomfort caused by a fluorescent agent.
Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention.