CN115480385A - Surgical microscope system and imaging method thereof - Google Patents
Surgical microscope system and imaging method thereof Download PDFInfo
- Publication number
- CN115480385A CN115480385A CN202110598286.8A CN202110598286A CN115480385A CN 115480385 A CN115480385 A CN 115480385A CN 202110598286 A CN202110598286 A CN 202110598286A CN 115480385 A CN115480385 A CN 115480385A
- Authority
- CN
- China
- Prior art keywords
- image information
- image
- visual field
- different
- imaged
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 43
- 230000000007 visual effect Effects 0.000 claims abstract description 60
- 238000012545 processing Methods 0.000 claims abstract description 35
- 238000005286 illumination Methods 0.000 claims abstract description 24
- 238000007499 fusion processing Methods 0.000 claims abstract description 9
- 230000003287 optical effect Effects 0.000 claims description 41
- 230000004927 fusion Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 14
- 238000000034 method Methods 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 14
- 230000000694 effects Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 239000002872 contrast media Substances 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000000799 fluorescence microscopy Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Microscoopes, Condenser (AREA)
Abstract
The invention discloses a surgical microscope system and an imaging method thereof, wherein the surgical microscope system comprises: the system comprises an illumination light source, an image processing device, an image display device and a plurality of image acquisition devices; the illumination light source is used for illuminating a region to be imaged so that the region to be imaged generates a light signal; the image acquisition devices are used for acquiring image information of different visual field ranges, different resolutions and different wavelengths of an area to be imaged and transmitting the image information to the image processing device; the image processing device is connected with each image acquisition device and is used for carrying out fusion processing on the image information acquired by each image acquisition device to obtain fused image information; and the image display device is connected with the image processing device and is used for displaying the fused image information. The invention can obtain the image information with large visual field range and ultrahigh resolution of the region to be imaged, is applied to the operation visual field region, and can obtain more accurate and clearer medical image information.
Description
Technical Field
The invention relates to the field of medical equipment, in particular to an operation microscope system and an imaging method thereof.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
An operating microscope, as a modern piece of medical equipment, is essential for the surgeon. Different magnifications are selected according to actual needs, and a magnified view of the operation visual field can be provided, so that a doctor can operate on a structure which is hardly visible to the naked eye, particularly for neurosurgery (for example, treatment of fine structures such as capillaries or nerves). Since the light source is incorporated directly inside the surgical microscope, the surgical microscope may also provide good surgical field illumination.
However, the currently commonly used operation microscope can provide morphological observation assistance for the surgeon, but is limited by the resolution, size, etc. of the acquisition camera, and cannot provide imaging effect with both large visual field and ultrahigh resolution. And the imaging with large visual field and ultrahigh resolution has very important significance for neurosurgery operations. Currently, some surgical microscope devices used in clinical practice cannot provide high resolution in case of providing a large field of view, and the field of view is greatly limited in case of providing high resolution. Although a high-performance camera with a large target surface and a small-sized pixel unit can provide a large-field high-resolution imaging effect to a certain extent, the high-performance camera is extremely expensive and cannot be widely used in the market.
Therefore, how to provide an operation display microscope with both a large visual field and ultrahigh resolution is an urgent technical problem to be solved in the field.
Disclosure of Invention
The embodiment of the invention provides an operation microscope system, which is used for solving the technical problem that the existing operation microscope cannot give consideration to both large visual field and ultrahigh resolution, and comprises: the system comprises an illumination light source, an image processing device, an image display device and a plurality of image acquisition devices; the illumination light source is used for illuminating a region to be imaged so that the region to be imaged generates a light signal; the image acquisition devices are used for acquiring image information of different visual field ranges, different resolutions and different wavelengths of an area to be imaged and transmitting the image information to the image processing device; the image processing device is connected with each image acquisition device and is used for carrying out fusion processing on the image information acquired by each image acquisition device to obtain fused image information; and the image display device is connected with the image processing device and is used for displaying the fused image information.
The embodiment of the invention also provides an imaging method of the surgical microscope system, which is used for solving the technical problem that the existing surgical microscope cannot give consideration to both large visual field and ultrahigh resolution, and comprises the following steps: acquiring image information of different visual field ranges, different resolutions and different wavelengths of an area to be imaged; carrying out fusion processing on image information of different visual field ranges, different resolutions and different wavelengths of an operation area of a region to be imaged to obtain fused image information; and displaying the fused image information.
The embodiment of the invention also provides computer equipment for solving the technical problem that the existing operation microscope cannot give consideration to both a large visual field and ultrahigh resolution.
The embodiment of the invention also provides a computer readable storage medium, which is used for solving the technical problem that the existing operation microscope cannot give consideration to both a large visual field and ultrahigh resolution, and the computer readable storage medium stores a computer program for executing the imaging method of the operation microscope system.
In the embodiment of the invention, the area to be imaged is irradiated by the illumination light source to generate optical signals in the area to be imaged, then the image information with different visual field ranges, different resolutions and different wavelengths in the area to be imaged is acquired by the plurality of image acquisition devices and is transmitted to the image processing device connected with each image acquisition device, so that the image processing device performs fusion processing on the image information acquired by each image acquisition device to obtain fused image information, and finally the fused image information is displayed by the image display device.
In the embodiment of the invention, a plurality of image acquisition devices are used for acquiring the image information of the to-be-imaged area with different visual field ranges, different optical wavelengths and different resolutions, the acquired image information is fused, the image information with the large visual field range and the ultrahigh resolution of the to-be-imaged area can be obtained, and the embodiment of the invention is applied to the operation visual field area, so that more accurate and clearer medical image information can be obtained.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts. In the drawings:
FIG. 1 is a schematic view of a surgical microscope system provided in an embodiment of the present invention;
fig. 2 is a schematic connection diagram of an illumination light source and an image acquisition device provided in an embodiment of the present invention;
fig. 3 is a schematic connection diagram of an image capturing camera, an image processing device, and an image display device provided in an embodiment of the present invention;
fig. 4 is a schematic diagram of an implementation of a surgical microscope system provided in an embodiment of the present invention;
FIG. 5 is a schematic illustration of an imaging result of a surgical microscope provided in an embodiment of the present invention;
FIG. 6 is a flow chart of an imaging method of a surgical microscope system provided in an embodiment of the present invention;
fig. 7 is a schematic diagram of a computer device provided in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention are further described in detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
An embodiment of the present invention provides an operating microscope system, and fig. 1 is a schematic diagram of an operating microscope system provided in an embodiment of the present invention, and as shown in fig. 1, the mobile phone microscope system includes: an illumination light source 1, an image processing device 2, an image display device 3, a plurality of image capturing devices 4 (fig. 1 shows three image capturing devices);
the device comprises an illumination light source 1, a light source module and a control module, wherein the illumination light source 1 is used for irradiating a region 5 to be imaged so that the region 5 to be imaged generates a light signal; the image acquisition devices 4 are used for acquiring image information of the to-be-imaged area 5 in different view ranges, different resolutions and different wavelengths and transmitting the image information to the image processing device 2; the image processing device 2 is connected with each image acquisition device 4 and is used for carrying out fusion processing on the image information acquired by each image acquisition device 4 to obtain fused image information; the image display device 3 is connected to the image processing device 2 and displays the fused video information.
It should be noted that the region to be imaged in the embodiment of the present invention may be, but is not limited to, an operation visual field region. The image processing apparatus 2 in the embodiment of the present invention may be, but is not limited to, a computer; the image display device 3 in the embodiment of the present invention may be a display.
It should be noted that, in the surgical microscope system provided in the embodiment of the present invention, the number of the image capturing devices is not limited, the field of view and the resolution of each camera can be configured according to actual requirements, and a plurality of image capturing devices can simultaneously capture images of a certain region to be imaged (the focal points of the plurality of image capturing devices are on the same straight line), or according to actual requirements, only some of the image capturing devices are used to capture images of the region to be imaged.
For example, if an operator only needs to view a certain local area, a camera with a small visual field range and a large resolution may be used to image the local area; if an operator needs to check a high-resolution image of the whole operation visual field area, a camera with a small visual field range and a large resolution and a camera with a large visual field and a small resolution can be called to simultaneously image the operation visual field area, then imaging results of the cameras are fused, and finally an image with a large visual field range and a large resolution is obtained.
Because in the prior art, few cameras can obtain images with large visual field range and large resolution, when the imaging device is used for imaging, a plurality of cameras with different visual field ranges and different resolutions are used for image acquisition, so that the images with large visual field range and large resolution of an area to be imaged can be obtained, and the configuration requirements on the cameras are low.
As shown in fig. 2, in an embodiment, in the surgical microscope system provided in the embodiment of the present invention, each image capturing device 4 includes: a filter 401, a focusing lens 402, and an image capturing camera 403. In this embodiment, the optical filter 401 is configured to filter an optical signal generated in a region to be imaged to obtain an optical signal with a target wavelength; a focusing lens 402 disposed between the optical filter and the image capturing camera, for focusing the optical signal of the target wavelength filtered by the optical filter to the image capturing camera; the image capturing camera 403 is configured to capture an optical signal with a target wavelength, and convert the captured optical signal into an electrical signal to obtain corresponding image information.
Alternatively, the connection relationship between the image capturing camera and the image processing device (e.g., a computer) and the image display device (e.g., a display) is as shown in fig. 3.
Fig. 4 is a schematic diagram of a specific implementation of a surgical microscope system provided in an embodiment of the present invention, and as shown in fig. 4, in an embodiment, the surgical microscope system provided in the embodiment of the present invention further includes: a zoom objective 6 and a beam splitter 7. In this embodiment, the zoom objective 6 is configured to collect optical signals generated by regions to be imaged in different view ranges; and the spectroscope 7 is arranged corresponding to the zoom objective 6 and is used for performing light splitting on the optical signal collected by the zoom objective 6 to obtain multiple paths of optical signals, wherein each path of optical signal is collected by one image collection device 4.
In the embodiment of the invention, the imaging with different resolutions and different light wavelengths can be carried out aiming at the same observation area by the plurality of light splitting systems and the plurality of image acquisition units; by utilizing the post-stage computer image fusion technology, the imaging information of different resolutions in the same region or the imaging information of different resolutions in different regions can be combined, so that the intelligent fusion of real-time medical images is realized, and a more accurate and clearer operation imaging effect is provided for doctors. In the embodiment of the invention, a plurality of spectroscopes are utilized in an imaging light path of a microscope to perform light splitting on scattered light or fluorescence signals from an operation observation area, a plurality of cameras are used for collecting a plurality of image information in real time together, and then the images are intelligently processed and fused, so that the respective performance advantages of the cameras with different imaging visual fields and different resolution capacities can be combined, and the ultrahigh-resolution real-time medical image effect is realized on the premise of observing and imaging in a large visual field.
The surgical field shown in fig. 4 refers to the target area observed by the surgeon using an operating microscope, and the size of the field is determined by the microscope parameters; an illumination source for providing a laser or LED source of monochromatic and polychromatic illumination for illuminating the surgical field or exciting a contrast agent for fluorescence imaging; the zoom objective lens is used for collecting scattered light or fluorescence signals from an operation visual field area, and can provide a wide-range zooming function and an optical zooming function; the spectroscope is used for performing light splitting on scattered light or fluorescence signals from an operation visual field area, and the light splitting can be performed according to proportion, and can also be performed selectively according to parameters such as polarization, wavelength and the like of signal light; the filter is used for filtering interference signals, only allows optical signals with target wavelengths to pass through, and can be a narrow-band filter, a long-pass filter or a short-pass filter; the focusing lens is used for focusing scattered light or fluorescence signals from the operation visual field area through the optical filter onto a rear camera target surface, and the scattered light or fluorescence signals are matched with the working wavelength to carry out achromatic design; the camera is used for collecting scattered light or fluorescence signals from the operation visual field area and converting the light signals into corresponding electric signals (the microscope system related to the embodiment of the invention comprises a plurality of cameras with different models, different parameters, different wavelength sensitivities, different target surface sizes and different pixel numbers and sizes); the computer is used for integrating scattered light or fluorescence signals of an operation visual field area collected by the camera, analyzing, processing and fusing original image data by using an image processing algorithm and a program so as to obtain final real-time medical image data, and transmitting the data to the display; the display is used for displaying a real-time medical image obtained by a final multi-camera image acquisition and image fusion technology-based surgical microscope system, and the display can be a computer display screen, an external display device or a projection device, but is not limited thereto.
The operation microscope system provided by the embodiment of the invention can realize image acquisition based on multiple cameras, scattered light or fluorescence signals emitted by an area to be imaged (an operation visual field area) are acquired by the zoom objective lens, then the optical signals are divided into multiple paths through the spectroscope, the optical signals of each path are filtered by the optical filter, and then are converged on the image acquisition camera by the focusing lens. In the process, different optical filters, focusing lenses and image acquisition cameras are selected according to optical signals with different wavelengths, so that only fluorescence signals with specific wavelengths can pass through the optical filters, the fluorescence signals are collected by the image acquisition unit, and the collected fluorescence signals with different wavelengths are transmitted to a computer.
The computer carries out intelligent analysis and integration processing on the image according to scattered light or fluorescence signals collected by the image collecting unit, is equipped with mature image processing and image fusion software, and uses an optimized processing program accelerated by a GPU to realize the effect of large-field high-resolution imaging. The image processing process can be a complex image fusion process for images with different resolutions, different wavelengths and different visual field ranges from different image acquisition devices. For example, image data acquired by a high-resolution camera is adopted for a certain small and fine area, and then image data acquired by a low-resolution large-field-of-view camera is combined, so that a real-time medical image result with both large field of view and local ultrahigh resolution is finally obtained. The final real-time image is output to a computer or other connected display device.
It should be noted that, after the data information obtained by the original multi-camera-based image acquisition is analyzed, processed and fused by the computer, a final real-time medical image is formed and finally displayed on the display.
Alternatively, the illumination light source 1 in the embodiment of the present invention may be a single-color LED or a single-color laser, or may also be a multi-color LED or a multi-color laser.
Under the scattered light wide field imaging mode, the illumination light source can start a white light LED; in the narrow-band imaging mode, the illumination light source can start a monochromatic LED or a monochromatic laser, and the illumination light source provides a light source with narrow spectral width so as to implement narrow-band imaging and achieve high imaging quality; in the fluorescence imaging mode, the illumination light source can start monochromatic laser or LED light sources with different wavelengths according to different fluorescence contrast agents used by doctors, and the monochromatic laser or LED light sources are used for exciting the contrast agents to emit fluorescence.
Fig. 5 is a schematic diagram of an imaging result of an operating microscope provided in an embodiment of the present invention, as shown in fig. 5, for a certain operating field area 5, three images corresponding to the operating field area 5 can be obtained by using the operating microscope system provided in the embodiment of the present invention (taking an operating microscope system with three cameras as an example), in fig. 5, icons 403a, 403b, and 403c respectively represent images acquired by three cameras with different field ranges and different resolutions, and it can be seen that the field range of 403a is minimum, but the resolution is maximum; 403c has the largest field of view but the smallest resolution; 403b has a field of view range and a resolution between 403a and 403 c. In specific implementation, the operation visual field area to be observed is determined according to the image acquired by the camera with the maximum visual field range, the images acquired by different cameras are fused, and therefore the three cameras can acquire the image with the large visual field range and the large resolution in the operation visual field area.
Based on the same inventive concept, the embodiment of the present invention further provides an imaging method of a surgical microscope system, which can be applied to, but not limited to, the surgical microscope system. As described in the examples below. Because the principle of solving the problems by the method is similar to that of the surgical microscope system, the implementation of the method can be referred to that of the surgical microscope system, and repeated parts are not described again.
Fig. 6 is a flowchart of an imaging method of a surgical microscope system according to an embodiment of the present invention, as shown in fig. 6, including the following steps:
s601, collecting image information of different visual field ranges, different resolutions and different wavelengths of an area to be imaged;
s602, carrying out fusion processing on image information of different visual field ranges, different resolutions and different wavelengths of an operation area of a region to be imaged to obtain fused image information;
and S603, displaying the fused image information.
In order to obtain image information with a large viewing range and a large resolution, in an embodiment, the step S602 may be implemented by: acquiring first image information and second image information of a target area, wherein the first image information is image information with a large visual field range and small resolution, and the second image information is image information with a small visual field range and large resolution; and fusing the first image information and the second image information to obtain third image information with a large visual field range and a large resolution.
It should be noted that the imaging method according to the embodiment of the present invention is intended to protect a camera using different parameter information (different view ranges, different resolutions, and different wavelengths), collect a plurality of images of a region to be imaged, and then obtain an image with a large view range and a large resolution by image fusion. When fusing images, one skilled in the art can select different image fusion algorithms according to the specific application scenario, including but not limited to: the method comprises the steps of image fusion based on spatial domain superposition, image fusion based on frequency domain (namely converting images in the spatial domain into the frequency domain, converting the images into the spatial domain after image fusion), and image fusion by using an image fusion model obtained by machine learning training.
In order to implement fast fusion of image information, in an embodiment, in the imaging method of the surgical microscope system provided in the embodiment of the present invention, an image fusion model may be trained in advance through machine learning, so that when the first image information and the second image information are fused, the first image information and the second image information are input into the image fusion model trained in advance, and third image information with a large field range and a large resolution is output.
The operating microscope system and the imaging method based on the multi-camera image acquisition and image fusion technology provided by the embodiment of the invention can adopt a plurality of image acquisition cameras with different parameters at the same time, and then combine the image processing and fusion technology to realize the medical image effect with a large visual field and ultrahigh resolution. The operation microscope system mainly comprises an illumination light source, a zoom objective, a light splitting unit, a filter, a focusing lens, an image acquisition unit and a computer. The illumination light source irradiates an operation area, reflected light or fluorescence signals of the operation area sequentially pass through the zoom objective lens, the light splitting unit, the filter and the focusing lens to the image acquisition unit, the image acquisition unit acquires images of the operation area and transmits the images to the computer, and the computer integrates imaging data and displays the imaging data. The light splitting unit comprises a plurality of light splitters, and scattered light of the operation area is mapped to different image acquisition units through multiple light splitting; the filter is used for the scattered light or the fluorescence signals with different wavelengths and can selectively filter the scattered light or the fluorescence signals with different wavelengths; the focusing lens is matched with corresponding optical wavelength for achromatization, and the focal length of the focusing lens is matched with the parameters of a rear image acquisition camera; the image acquisition unit can be a camera or a photon counter, and the plurality of image acquirers can be different models, different parameters, different frequency sensitivities and different resolutions. In addition, the image acquisition and image fusion method is mainly based on image information of different observation areas, different optical wavelengths and different resolutions acquired by multiple cameras, and then a plurality of original images are processed and further fused by using an image processing algorithm and software, so that a medical image effect with a large visual field, ultrahigh resolution, more accuracy and more clarity is obtained.
Based on the same inventive concept, an embodiment of the present invention further provides a computer device, so as to solve the technical problem that the existing surgical microscope cannot consider both a large field of view and an ultra-high resolution, and fig. 7 is a schematic diagram of a computer device provided in an embodiment of the present invention, where the computer device 70 includes a memory 701, a processor 702, and a computer program stored in the memory 701 and capable of running on the processor 702, and when the processor 702 executes the computer program, the imaging method of the surgical microscope system is implemented.
Based on the same inventive concept, the embodiment of the present invention further provides a computer readable storage medium, so as to solve the technical problem that the existing surgical microscope cannot give consideration to both a large field of view and an ultra-high resolution, where the computer readable storage medium stores a computer program for executing the imaging method of the surgical microscope system.
In summary, according to the imaging method, the imaging device, the computer device, and the computer readable storage medium of the surgical microscope system provided in the embodiments of the present invention, first, the illumination light source is used to illuminate the region to be imaged, so that the region to be imaged generates an optical signal, then, the image information of the region to be imaged with different visual field ranges, different resolutions, and different wavelengths is collected by the multiple image collection devices, and is transmitted to the image processing device connected to each image collection device, so that the image processing device performs fusion processing on the image information collected by each image collection device, so as to obtain fused image information, and finally, the image display device displays the fused image information.
In the embodiment of the invention, a plurality of image acquisition devices are used for acquiring the image information of the to-be-imaged area with different visual field ranges, different optical wavelengths and different resolutions, the acquired image information is fused, the image information with the large visual field range and the ultrahigh resolution of the to-be-imaged area can be obtained, and the embodiment of the invention is applied to the operation visual field area, so that more accurate and clearer medical image information can be obtained.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, and it should be understood that the above-mentioned embodiments are only examples of the present invention and should not be used to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A surgical microscope system, comprising: the system comprises an illumination light source, an image processing device, an image display device and a plurality of image acquisition devices;
the illumination light source is used for illuminating a region to be imaged so that the region to be imaged generates a light signal;
the image acquisition devices are used for acquiring image information of the to-be-imaged area in different visual field ranges, different resolutions and different wavelengths and transmitting the image information to the image processing device;
the image processing device is connected with each image acquisition device and is used for carrying out fusion processing on the image information acquired by each image acquisition device to obtain fused image information;
and the image display device is connected with the image processing device and is used for displaying the fused image information.
2. The surgical microscope system of claim 1, wherein each of the image acquisition devices comprises: the device comprises an optical filter, a focusing lens and an image acquisition camera;
the optical filter is used for filtering optical signals generated in the area to be imaged to obtain optical signals with target wavelengths;
the focusing lens is arranged between the optical filter and the image acquisition camera and used for focusing the optical signal with the target wavelength filtered by the optical filter to the image acquisition camera;
and the image acquisition camera is used for acquiring the optical signal of the target wavelength and converting the acquired optical signal into an electric signal to obtain corresponding image information.
3. The surgical microscope system of claim 2, further comprising: a zoom objective lens and a spectroscope;
the zoom objective lens is used for collecting optical signals generated by areas to be imaged under different visual field ranges;
the spectroscope is arranged corresponding to the zoom objective lens and is used for performing light splitting on the optical signal collected by the zoom objective lens to obtain multiple paths of optical signals, wherein each path of optical signal is collected by one image collecting device.
4. The surgical microscope system according to any one of claims 1 to 3, wherein the illumination light source is a monochromatic LED or a monochromatic laser.
5. The surgical microscope system according to any one of claims 1 to 3, wherein the illumination light source is a multi-color LED or a multi-color laser.
6. A method of imaging a surgical microscope system, comprising:
acquiring image information of different visual field ranges, different resolutions and different wavelengths of an area to be imaged;
fusing image information of different visual field ranges, different resolutions and different wavelengths of an operation area of a region to be imaged to obtain fused image information;
and displaying the fused image information.
7. The imaging method according to claim 6, wherein the fusing processing of the image information with different view ranges, different resolutions, and different wavelengths to obtain fused image information comprises:
acquiring first image information and second image information of a target area, wherein the first image information is image information with a large visual field range and small resolution, and the second image information is image information with a small visual field range and large resolution;
and fusing the first image information and the second image information to obtain third image information with a large visual field range and a large resolution.
8. The imaging method of claim 7, wherein fusing the first image information and the second image information to obtain large-field-of-view, large-resolution image information comprises:
and inputting the first image information and the second image information into a pre-trained image fusion model, and outputting third image information with a large visual field range and a large resolution.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the imaging method of the surgical microscope system according to any one of claims 6 to 8 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the imaging method of the surgical microscope system according to any one of claims 6 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110598286.8A CN115480385A (en) | 2021-05-31 | 2021-05-31 | Surgical microscope system and imaging method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110598286.8A CN115480385A (en) | 2021-05-31 | 2021-05-31 | Surgical microscope system and imaging method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115480385A true CN115480385A (en) | 2022-12-16 |
Family
ID=84419682
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110598286.8A Pending CN115480385A (en) | 2021-05-31 | 2021-05-31 | Surgical microscope system and imaging method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115480385A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117572625A (en) * | 2024-01-15 | 2024-02-20 | 深圳安侣医学科技有限公司 | Multipath microscopic imaging device and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100194873A1 (en) * | 2007-07-19 | 2010-08-05 | Viereck Friedrich W | Method and device for microscopically examining a sample, computer program and computer program product |
| CN102809429A (en) * | 2012-07-26 | 2012-12-05 | 中国科学院自动化研究所 | Multi-spectral imaging system and multi-spectral imaging method based on double cameras |
| CN105122113A (en) * | 2013-04-19 | 2015-12-02 | 美国樱花检验仪器株式会社 | Method for generating a composite image of an object body consisting of a plurality of sub-images |
| CN107518879A (en) * | 2017-10-11 | 2017-12-29 | 北京数字精准医疗科技有限公司 | A kind of fluoroscopic imaging device and method |
| CN109167924A (en) * | 2018-10-24 | 2019-01-08 | 清华-伯克利深圳学院筹备办公室 | Video imaging method, system, equipment and storage medium based on Hybrid camera |
| CN110200707A (en) * | 2019-06-28 | 2019-09-06 | 上海德芬生物科技有限公司 | A kind of operating microscope system and imaging method showing blood flow information |
| CN111045202A (en) * | 2019-12-31 | 2020-04-21 | 浙江未来技术研究院(嘉兴) | Operating microscope |
-
2021
- 2021-05-31 CN CN202110598286.8A patent/CN115480385A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100194873A1 (en) * | 2007-07-19 | 2010-08-05 | Viereck Friedrich W | Method and device for microscopically examining a sample, computer program and computer program product |
| CN102809429A (en) * | 2012-07-26 | 2012-12-05 | 中国科学院自动化研究所 | Multi-spectral imaging system and multi-spectral imaging method based on double cameras |
| CN105122113A (en) * | 2013-04-19 | 2015-12-02 | 美国樱花检验仪器株式会社 | Method for generating a composite image of an object body consisting of a plurality of sub-images |
| CN107518879A (en) * | 2017-10-11 | 2017-12-29 | 北京数字精准医疗科技有限公司 | A kind of fluoroscopic imaging device and method |
| CN109167924A (en) * | 2018-10-24 | 2019-01-08 | 清华-伯克利深圳学院筹备办公室 | Video imaging method, system, equipment and storage medium based on Hybrid camera |
| CN110200707A (en) * | 2019-06-28 | 2019-09-06 | 上海德芬生物科技有限公司 | A kind of operating microscope system and imaging method showing blood flow information |
| CN111045202A (en) * | 2019-12-31 | 2020-04-21 | 浙江未来技术研究院(嘉兴) | Operating microscope |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117572625A (en) * | 2024-01-15 | 2024-02-20 | 深圳安侣医学科技有限公司 | Multipath microscopic imaging device and method |
| CN117572625B (en) * | 2024-01-15 | 2024-09-17 | 深圳安侣医学科技有限公司 | Multipath microscopic imaging device and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210021795A1 (en) | Medical inspection apparatus, such as a microscope or endoscope using pseudocolors | |
| JP6947841B2 (en) | Augmented reality microscope for pathology | |
| CN110269700B (en) | Augmented reality surgical microscope and microscopy method | |
| US12130418B2 (en) | Microscope system | |
| JP5562683B2 (en) | Fluorescence observation equipment | |
| JP6893896B2 (en) | Medicine-How to activate an optical display system | |
| US20220247981A1 (en) | Signal processing device, signal processing method, image capture device, and medical image capture device | |
| JP6745508B2 (en) | Image processing system, image processing device, projection device, and projection method | |
| JP2021510850A (en) | High spatial resolution time-resolved imaging method | |
| WO2021208603A1 (en) | Microscope autofocusing method, microscope system, medical device, and storage medium | |
| CN105424189A (en) | Scanning type multifunctional microscopic-spectral imaging method | |
| CN115480385A (en) | Surgical microscope system and imaging method thereof | |
| JP6859554B2 (en) | Observation aids, information processing methods, and programs | |
| US8867815B2 (en) | Sample identification device and sample identification method | |
| US20180003557A1 (en) | Speckle imaging device, speckle imaging system, and speckle imaging method | |
| WO2017217325A1 (en) | Data recovery device, microscope system, and data recovery method | |
| US20200074628A1 (en) | Image processing apparatus, imaging system, image processing method and computer readable recoding medium | |
| CN212415706U (en) | Reality augmented microscope | |
| US11378515B2 (en) | Image processing device, imaging system, actuation method of image processing device, and computer-readable recording medium | |
| JP7322683B2 (en) | IMAGE PROCESSING METHOD, IMAGE GENERATING DEVICE AND IMAGE PROCESSING SYSTEM | |
| EP4006615A1 (en) | Imaging system | |
| JP2018205567A (en) | Light field microscope, and observation method | |
| WO2023189393A1 (en) | Biological sample observation system, information processing device, and image generation method | |
| EP3889886A1 (en) | Systems, methods and computer programs for a microscope system and for determining a transformation function | |
| EP3961285A1 (en) | Microscope, microscope system and method for imaging an object using a microscope |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |