CN111481164B - Method and device for acquiring fluorescence fundus picture - Google Patents

Method and device for acquiring fluorescence fundus picture Download PDF

Info

Publication number
CN111481164B
CN111481164B CN201910071313.9A CN201910071313A CN111481164B CN 111481164 B CN111481164 B CN 111481164B CN 201910071313 A CN201910071313 A CN 201910071313A CN 111481164 B CN111481164 B CN 111481164B
Authority
CN
China
Prior art keywords
image
fundus
color
fluorescence
map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910071313.9A
Other languages
Chinese (zh)
Other versions
CN111481164A (en
Inventor
陈名科
蔡金翰
谢易庭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xie Yiting
Acer Inc
Original Assignee
Acer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Acer Inc filed Critical Acer Inc
Priority to CN201910071313.9A priority Critical patent/CN111481164B/en
Publication of CN111481164A publication Critical patent/CN111481164A/en
Application granted granted Critical
Publication of CN111481164B publication Critical patent/CN111481164B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The method for acquiring a fluorescence fundus image of the invention comprises the following steps: receiving a color eye fundus picture to be detected; acquiring color image characteristics of a color eye background image to be detected; coding the color image characteristics of the color eye fundus map to be detected according to the eye fundus image map conversion model, and converting the color eye fundus map to be detected into a fluorescence eye fundus map to be detected; and outputting a fluorescence fundus map.

Description

Method and device for acquiring fluorescence fundus picture
Technical Field
The present invention relates to human body detection technology, and particularly to a method and apparatus for obtaining a fluorescence fundus image.
Background
Fluorescent fundus photography is used to examine vascular lesions behind the eye, such as diabetic retinopathy, vascular occlusive changes, macular lesions, and the like. Although fluorescence fundus photography is the most accurate method for diagnosing vascular lesions at the present stage, the examinee needs to wait for the mydriatic agent and the fluorescent agent to perform fluorescence fundus photography after the human body exerts the effect due to the assistance of the mydriatic agent and the fluorescent agent, so that the time required for each examination is quite long. Moreover, due to the chemical action of fluorescent agents, the subject is accompanied by the risk of nausea, vomiting, allergy, and even anaphylactic shock, and therefore, although the accuracy of fluorescence fundus photography is high, it is not the first choice for ophthalmic examination. Therefore, how to provide accurate image analysis while avoiding the lingering and uncomfortable condition of the subject is a subject of the skilled person.
Disclosure of Invention
The invention provides a method and a device for acquiring a fluorescence fundus image, which are used for converting a color fundus image into the fluorescence fundus image so that a testee does not need to experience long-term and uncomfortable situations of fluorescence fundus photography.
The method for acquiring a fluorescence fundus image of the invention comprises the following steps: receiving a color fundus picture to be detected; acquiring color image characteristics of a color eye background image to be detected; coding the color image characteristics of the color eye fundus picture to be detected according to the eye fundus image picture conversion model so as to convert the color eye fundus picture to be detected into a fluorescence eye fundus picture to be detected; and outputting a fluorescence fundus map.
The device for acquiring a fluorescence fundus map of the invention has an input unit, a storage unit and a processing unit. The input unit receives a color fundus picture to be tested. The storage unit stores an eye fundus image map conversion model. The processing unit is connected with the input unit and the storage unit. The processing unit also acquires the color image characteristics of the color eye fundus picture to be detected, codes the color image characteristics of the color eye fundus picture to be detected according to the eye fundus image picture conversion model, converts the color eye fundus picture to be detected into a fluorescence eye fundus picture to be detected, and outputs the fluorescence eye fundus picture.
Based on the above, the method for acquiring a fluorescence fundus map and the device for acquiring a fluorescence fundus map of the present invention can convert the color fundus map to be measured into a fluorescence fundus map by means of coding. Therefore, a testee can obtain a corresponding fluorescence fundus image only by shooting the color fundus image to be tested, and the testee does not need to go through a lengthy fluorescence fundus photographing procedure and does not need to bear discomfort caused by a fluorescent agent.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
FIG. 1 shows a schematic diagram of an apparatus for obtaining a fluorescence fundus image according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a method for obtaining a fluorescence fundus image according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a method for obtaining an eye fundus image map conversion model according to an embodiment of the present invention.
The reference numbers illustrate:
100: device for acquiring fluorescent fundus picture
110: input unit
120: memory cell
130: processing unit
S210-S240, S310-S330: step (ii) of
Detailed Description
In the following embodiments, the color fundus image and the color fundus image to be measured refer to color images of the corresponding human fundus taken without applying fluorescent agent. The fluorescence fundus map refers to an image of the corresponding human fundus taken with a fluorescent agent applied.
FIG. 1 shows a schematic diagram of an apparatus for acquiring a fluorescence fundus image according to an embodiment of the present invention. Referring to fig. 1, the apparatus 100 for obtaining a fluorescence fundus image at least has an input unit 110, a storage unit 120 and a processing unit 130.
The input unit 110 receives a color fundus image to be measured. In one embodiment of the present invention, the input unit 110 can be implemented as a fundus camera, i.e., a color fundus image to be measured is received by taking a picture of the fundus of the subject. In another embodiment of the present invention, the input unit 110 may be implemented by a connection port for receiving digital data transmission, such as an RS-232 interface supporting various types of communication protocols, a Universal Serial Bus (USB), a Wireless fidelity (WiFi), an RJ45 interface, etc., but the present invention is not limited thereto. That is, the apparatus 100 for acquiring a fluorescence fundus map may directly photograph or indirectly receive a color fundus map to be measured through transmission through the input unit 110, and the present invention is not limited thereto.
The storage unit 120 is used for storing various data and program codes required for the operation of the apparatus 100 for obtaining a fluorescence fundus map. Specifically, the storage unit 120 stores a fundus image map conversion model having parameters for converting a color fundus map into a corresponding fluorescence fundus map. In an embodiment of the invention, the hardware of the storage unit 120 may be various types of nonvolatile memories, such as storage devices of Hard Disk Drives (HDDs) and solid-state drives (SSDs), but the invention is not limited thereto.
The processing unit 130 is connected to the input unit 110 and the storage unit 120, and is configured to perform various operations required by the apparatus 100 for obtaining a fluorescence fundus map. The detailed operation will be described later. In an embodiment of the invention, the Processing Unit 130 is, for example, a Central Processing Unit (CPU), a Microprocessor (Microprocessor), a Digital Signal Processor (DSP), a Programmable controller, a Programmable Logic Device (PLD), or other similar devices or combinations thereof, but the invention is not limited thereto.
FIG. 2 is a flow chart illustrating a method for obtaining a fluorescence fundus image according to an embodiment of the present invention. Referring to fig. 2, the method for obtaining a fluorescence fundus image according to this embodiment is at least applicable to the apparatus 100 for obtaining a fluorescence fundus image shown in fig. 1, but is not limited thereto. Details of the method to acquire a fluorescence fundus image will be explained below by means of fig. 1 and 2.
In step S210, the color fundus map to be tested is received by the input unit 110. Specifically, as described above, the input unit 110 may receive a color fundus image to be diagnosed by photographing a human fundus or by transmitting the color fundus image to be diagnosed.
In step S220, the color chart feature of the color eye-bottom chart to be measured is obtained by the processing unit 130. It should be noted that, in an embodiment of the present invention, in order to obtain the color map features quickly and accurately, the processing unit 130 further performs a pre-processing procedure on the color fundus map to be measured. For example, the pre-processing procedure is at least one of a gray-scale processing, an eye positioning and an image enhancement.
The gray scale processing is to convert an image into gray scales so that the image features after the pixels are converted can be highlighted. The eyeball positioning is to identify the position of the eyeball of the user so as to filter out the range which does not belong to the eyeground. The image enhancement is, for example, to smooth an image using a gaussian filter.
In step S230, the processing unit 130 encodes the color map features of the color fundus map to be measured according to the fundus image map conversion model in the storage unit 120 to convert the color fundus map to be measured into a fluorescence fundus map to be measured. Since the fundus image map conversion model has parameters and rules for converting the color fundus map into the fluorescence fundus map, the processing unit 130 can encode the color map features of the color fundus map to be detected according to the fundus image map conversion model, thereby outputting the corresponding fluorescence fundus map.
In step S240, a fluorescence fundus image is output by the processing unit 130. Therefore, the medical staff can judge whether the fundus of the detected person corresponds to the fundus situation of the potential disease or not through the output fluorescent fundus picture, and then treat the detected person.
It should be noted that, in some embodiments of the present invention, the storage unit 120 can further store fluorescence map features related to diseases. Therefore, when acquiring the fluorescence map feature of the fluorescence map, the processing unit 130 can automatically determine the disease information corresponding to the fluorescence map according to the fluorescence map feature.
Fig. 3 is a flowchart illustrating a method for obtaining an eye fundus image map conversion model according to an embodiment of the present invention. A method for acquiring a fundus image conversion model will be described below with reference to fig. 1 and 3.
In step S310, the color fundus map and the corresponding fluorescence fundus map are received by the input unit 110. Specifically, the color fundus image and the fluorescence fundus image received by the input unit 110 are measurement results corresponding to the same subject. That is, both the color fundus image and the fluorescence fundus image are actually detected historically.
In step S320, the color map features in the color fundus map are acquired by the processing unit 130, and the color map features of the color fundus map are encoded to convert the color fundus map into an estimated fluorescence fundus map. In an embodiment of the present invention, the processing unit 130 encodes the color map feature of the color eye-bottom map according to an auto-encoder (auto encoder), but the present invention is not limited thereto.
In addition, in order to reduce the time consumed by encoding, the processing unit 130 also performs a preprocessing procedure on the color eye-bottom map. The content of the preprocessing procedure has been described above, and is not described herein again.
In step S330, the estimated fluorescence image characteristics in the fluorescence fundus map and the fluorescence image characteristics of the fluorescence fundus map are compared by the processing unit 130 to obtain difference characteristic information, and the fundus image map conversion model is trained according to the difference characteristic information.
That is, since the color fundus image and the fluorescence fundus image correspond to the same examinee, the fundus images generated by the same examinee who receives any test will be the same theoretically without considering various external factors such as the degree of image recognition, the fineness of the camera, and the like. Therefore, through the fundus image conversion model, the estimated fluorescence fundus image generated after the color fundus image is coded should have the same fluorescence image characteristics as the fluorescence fundus image. Therefore, the processing unit 130 may determine the difference between the fluorescence fundus image and the fluorescence fundus image to acquire difference feature information, and train and adjust the fundus image map conversion model by adjusting the error caused by encoding according to the difference feature information.
It is worth mentioning that in the initial stage of training the fundus image map conversion model, the parameters and rules of the fundus image map conversion model in the color fundus map and the fluorescence fundus map are not clear, so that the difference between the converted estimated fluorescence fundus map and the fluorescence fundus map is large. At this time, the processing unit 130 performs encoding in a small scale, for example, encoding based on color image features or an area. In the later period of training, the processing unit 130 can encode in a large scale manner, for example, the entire color fundus map, to improve the learning efficiency, because the parameters and rules between the color fundus map and the fluorescence fundus map are clear. Although the invention is not limited thereto.
In summary, the method for acquiring a fluorescence fundus map and the apparatus for acquiring a fluorescence fundus map of the present invention can convert the color fundus map to be measured into a fluorescence fundus map by means of encoding. Therefore, a testee can obtain a corresponding fluorescence fundus image only by shooting the color fundus image to be tested, and the testee does not need to go through a lengthy fluorescence fundus photographing program and endure discomfort caused by a fluorescent agent.
Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention.

Claims (8)

1. A method to acquire a fluorescence fundus map, comprising:
receiving a color eye fundus picture to be detected;
acquiring color image characteristics of the color eye background image to be detected;
coding the color image characteristics of the color eye-fundus picture to be detected according to an eye fundus image picture conversion model so as to convert the color eye-fundus picture to be detected into a fluorescence eye-fundus picture to be detected, wherein the coding of the color image characteristics of the color eye-fundus picture to be detected according to the eye fundus image picture conversion model so as to convert the color eye-fundus picture to be detected into the fluorescence eye-fundus picture to be detected comprises the following steps:
receiving a color fundus map and a corresponding fluorescence fundus map;
acquiring color image features in the color eye fundus image;
coding the color image characteristics of the color fundus image to convert the color fundus image into an estimated fluorescence fundus image;
comparing the fluorescent image characteristics in the estimated fluorescent fundus image with the fluorescent image characteristics of the fluorescent fundus image to acquire difference characteristic information; and
training the fundus image map conversion model according to the difference characteristic information; and
and outputting the fluorescence fundus map.
2. The method of claim 1, wherein the step of encoding the color map features comprises:
and coding the color image characteristics of the color eye bottom image according to a self-coding network.
3. The method for acquiring a fluorescence fundus map of claim 1, further comprising:
and executing a preprocessing program on at least one of the color eye base image to be detected and the color eye base image, wherein the preprocessing program comprises at least one of gray scale processing, eyeball positioning and image enhancement.
4. The method for acquiring a fluorescence fundus map of claim 1, further comprising:
and acquiring the fluorescence image characteristics of the fluorescence fundus image, and judging the corresponding disease information of the fluorescence fundus image according to the fluorescence image characteristics.
5. An apparatus for acquiring a fluorescence fundus image, comprising:
the input unit is used for receiving the color eye fundus diagram to be detected;
a storage unit which stores the fundus image conversion model; and
a processing unit connected to the input unit and the storage unit, wherein,
the processing unit further acquires color image features of the color fundus image to be detected, encodes the color image features of the color fundus image to be detected according to the fundus image conversion model, and converts the color fundus image to be detected into a fluorescence fundus image to be detected, wherein the input unit further receives the color fundus image and a corresponding fluorescence fundus image, the processing unit further acquires color image features in the color fundus image, encodes color image features of the color fundus image, so as to convert the color fundus image into an estimated fluorescence fundus image, the processing unit further compares fluorescence image features in the estimated fluorescence fundus image with fluorescence image features of the fluorescence fundus image, so as to acquire difference feature information, and trains the fundus image conversion model according to the difference feature information,
wherein the processing unit outputs the fluorescence fundus map.
6. The apparatus for acquiring a fluorescence fundus image of claim 5, wherein,
the processing unit encodes the color image features of the color eye-bottom image according to a self-encoding network.
7. The apparatus for acquiring a fluorescence fundus image of claim 5, wherein,
the processing unit further executes a preprocessing program on at least one of the color eye fundus image to be detected and the color eye fundus image, wherein the preprocessing program comprises at least one of gray scale processing, eyeball positioning and image strengthening.
8. The apparatus for acquiring a fluorescence fundus image of claim 5, wherein,
the processing unit also acquires the fluorescence image characteristics of the fluorescence fundus image and judges the corresponding disease information of the fluorescence fundus image according to the fluorescence image characteristics.
CN201910071313.9A 2019-01-25 2019-01-25 Method and device for acquiring fluorescence fundus picture Active CN111481164B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910071313.9A CN111481164B (en) 2019-01-25 2019-01-25 Method and device for acquiring fluorescence fundus picture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910071313.9A CN111481164B (en) 2019-01-25 2019-01-25 Method and device for acquiring fluorescence fundus picture

Publications (2)

Publication Number Publication Date
CN111481164A CN111481164A (en) 2020-08-04
CN111481164B true CN111481164B (en) 2023-04-07

Family

ID=71793801

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910071313.9A Active CN111481164B (en) 2019-01-25 2019-01-25 Method and device for acquiring fluorescence fundus picture

Country Status (1)

Country Link
CN (1) CN111481164B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI796784B (en) * 2021-09-09 2023-03-21 宏碁智醫股份有限公司 Method and apparatus for compensating image segmentation line

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002045328A (en) * 2000-08-01 2002-02-12 Fuji Photo Film Co Ltd Device displaying fluorescent diagnostic image
JP2003283850A (en) * 2002-03-20 2003-10-03 Seiko Epson Corp Color conversion apparatus, color conversion method, color conversion program, medium recorded with color conversion program, color conversion table creating method, color conversion table creating apparatus, color conversion table creating program, medium recorded with color conversion table creating program, color conversion table, and medium recorded with data of color conversion table
JP2004122690A (en) * 2002-10-04 2004-04-22 Mitsubishi Chemicals Corp Production method for fluorescent printed matter, fluorescent printed matter, image forming material and authenticity detecting method
JP2012105233A (en) * 2010-11-15 2012-05-31 Konica Minolta Business Technologies Inc Color conversion method, color conversion device and image formation system
JP2016209147A (en) * 2015-04-30 2016-12-15 株式会社ニデック Fundus image processing device and fundus image processing program

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6615063B1 (en) * 2000-11-27 2003-09-02 The General Hospital Corporation Fluorescence-mediated molecular tomography
JP3731814B2 (en) * 2001-05-07 2006-01-05 富士写真フイルム株式会社 Fluorescent image display device
JP4526322B2 (en) * 2004-08-06 2010-08-18 オリンパス株式会社 Endoscope device
JP5065786B2 (en) * 2007-07-19 2012-11-07 株式会社ニデック Fundus photographing device
CN102163103B (en) * 2010-02-22 2014-09-17 宏碁股份有限公司 Touch input method and touch input device
JP5981213B2 (en) * 2012-02-28 2016-08-31 株式会社トプコン Fundus observation device
CN104036521A (en) * 2014-07-03 2014-09-10 重庆大学 Novel retina eye fundus image segmenting method
CN104299242B (en) * 2014-10-31 2017-11-07 中南大学 Fluoroscopic visualization eye fundus image extracting method based on NGC ACM
WO2016190607A1 (en) * 2015-05-22 2016-12-01 고려대학교 산학협력단 Smart glasses system for providing surgery assisting image and method for providing surgery assisting image by using smart glasses
US10674982B2 (en) * 2015-08-06 2020-06-09 Covidien Lp System and method for local three dimensional volume reconstruction using a standard fluoroscope
CN106190099A (en) * 2016-07-05 2016-12-07 太仓市东明化工有限公司 A kind of glo-stick fluorescent agent

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002045328A (en) * 2000-08-01 2002-02-12 Fuji Photo Film Co Ltd Device displaying fluorescent diagnostic image
JP2003283850A (en) * 2002-03-20 2003-10-03 Seiko Epson Corp Color conversion apparatus, color conversion method, color conversion program, medium recorded with color conversion program, color conversion table creating method, color conversion table creating apparatus, color conversion table creating program, medium recorded with color conversion table creating program, color conversion table, and medium recorded with data of color conversion table
JP2004122690A (en) * 2002-10-04 2004-04-22 Mitsubishi Chemicals Corp Production method for fluorescent printed matter, fluorescent printed matter, image forming material and authenticity detecting method
JP2012105233A (en) * 2010-11-15 2012-05-31 Konica Minolta Business Technologies Inc Color conversion method, color conversion device and image formation system
JP2016209147A (en) * 2015-04-30 2016-12-15 株式会社ニデック Fundus image processing device and fundus image processing program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
颜色迁移在荧光薄片图像分析中的应用;朱峰等;《计算机与数字工程》(第01期);115-118+138 *

Also Published As

Publication number Publication date
CN111481164A (en) 2020-08-04

Similar Documents

Publication Publication Date Title
US20200160999A1 (en) Diagnosis assistance system and control method thereof
DE102007010757B4 (en) Hand-held diagnostic systems and methods of using the same
KR101978548B1 (en) Server and method for diagnosing dizziness using eye movement measurement, and storage medium storin the same
US11213256B2 (en) Biological image processing method and biological information detection device
JP7270686B2 (en) Image processing system and image processing method
US20150172681A1 (en) Medical image compression system and method using visually lossless compression
KR102306279B1 (en) Method for facilitating diagnosis of fundus image, apparatus therefor and system including the same
CN111481164B (en) Method and device for acquiring fluorescence fundus picture
EP3924935A1 (en) Processing fundus images using machine learning models to generate blood-related predictions
CN113749642A (en) Method, system, medium and terminal for quantifying degree of skin flushing response
CN112465789A (en) Detection method and system for retinopathy plus disease of premature infant
WO2019073962A1 (en) Image processing device and program
JP2021520982A (en) Methods and systems for image collection and dimensional analysis for medical diagnostics
CN111899848B (en) Image recognition method and device
CN116919639A (en) Visual cleaning method and system and visual cleaner thereof
US11055846B2 (en) Method for obtaining a fluorescent fundus image and a device thereof
US8116545B2 (en) Method and system for analysis of bone density
JP2020010804A (en) Medical image diagnosis support apparatus, program, and medical image diagnosis support method
CN113409921A (en) Medical imaging apparatus, system and method
CN111513673B (en) Image-based growth state monitoring method, device, equipment and storage medium
JP6774520B2 (en) Rupture risk assessment method, assessment device and program for angioma
KR20170098481A (en) Parameter auto setting for portable ultrasound device
CN215954839U (en) Medical imaging device and system
KR102566442B1 (en) Apparatus and method for choroidal stroma analysis using optical coherence tomography
JP6021404B2 (en) VISION EVALUATION DEVICE, VISION EVALUATION METHOD, AND PROGRAM

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210804

Address after: The new Taiwan Chinese Taiwan New Taipei City Xizhi District Five Road No. 88 8 floor

Applicant after: Acer Inc.

Applicant after: Xie Yiting

Address before: The new Taiwan Chinese Taiwan New Taipei City Xizhi District Five Road No. 88 8 floor

Applicant before: Acer Inc.

CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Chen Mingke

Inventor after: Cai Jinhan

Inventor after: Xie Yiting

Inventor before: Chen Mingke

Inventor before: Cai Jinhan

GR01 Patent grant
GR01 Patent grant