JP2012185442A - Microscope device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain spectral information in shorter time.SOLUTION: A stage 102 holds a specimen. A first imaging portion 108 is equipped with an imaging element, and images a partial image of the specimen 101 according to incident light. A color sensor 111 obtains the spectral information of the incident light. A half mirror 107 makes light from the specimen 101 incident to the first imaging portion 108 and the color sensor 111. A stage driving portion 103 moves the stage 102 in three-dimensional directions. An imaging control portion 112 controls the stage driving portion 103 to move the specimen 101 in a parallel direction with the imaging surface of the imaging element so as to provide a margin portion which is a part where the partial image overlaps another partial image imaged by the first imaging portion 108, controls the color sensor 111 to obtain the spectral information even while the specimen 101 is being moved, and controls the first imaging portion 108 to image the partial image after the specimen 101 has been moved.

Description

  The present invention relates to a microscope apparatus.

  A virtual slide device that digitally images a slide image of a pathological specimen is known (see, for example, Patent Document 1).

  FIG. 7 is a schematic diagram showing a configuration of a conventionally known virtual slide device. In the illustrated example, the virtual slide apparatus 1000 includes a stage 1002 on which the sample 1001 is placed, and a stage driving unit 1003 that drives the stage 1002 in the horizontal direction and the optical axis direction. The microscope apparatus 1000 also includes a light source 1004 that illuminates the sample 1001, an objective lens 1005 that is configured by a plurality of lenses so as to face the sample 1001, and an imaging unit 1006 that captures an image of the sample 1001. . In addition, when the microscope apparatus 1000 combines a plurality of images to generate a single image, the combination information includes information for specifying an adjacent image and information for specifying an area to be overlapped with the adjacent image. A combination information generation unit 1007 for generating the image, an image file generation unit 1008 for storing a plurality of images and the combination information in one file, and an imaging control unit 1009 for controlling the stage driving unit 1003 and the imaging unit 1006. And.

  Next, a method for imaging the sample 1001 using the virtual slide apparatus 1000 will be described. Light from the light source 1004 passes through a predetermined region of the sample 1001 placed on the stage 1002 and the objective lens 1005 and enters the imaging unit 1006. The imaging unit 1006 photoelectrically converts incident light and captures a high-magnification image of a predetermined area of the sample 1001. Subsequently, the stage drive unit 1003 has a stage 1002 (so that the imaging unit 1006 can capture a high-magnification image of an area adjacent to the predetermined area and has a marginal part that overlaps the image of the adjacent predetermined area. The sample 1001) is moved in the horizontal direction. Note that the imaging control unit 1009 controls the imaging unit 1006 and the stage driving unit 1003. The imaging unit 1006 and the stage driving unit 1003 repeatedly perform the above processing under the control of the imaging control unit 1009, so that the imaging unit 1006 captures a high-magnification image having a margin for each predetermined region of the sample 1001.

  After the imaging unit 1006 has captured high-magnification images of all predetermined areas of the sample 1001, the bonding information generation unit 1007 recognizes and recognizes adjacent high-magnification images and margins of each high-magnification image. Bonding information is generated based on the result. Subsequently, the image file generation unit 1008 stores the combination information generated by the combination information generation unit 1007 and a plurality of high-magnification images captured by the imaging unit 1006 in one file. A reproduction unit (not shown) combines a plurality of high-magnification images stored in one file based on the bonding information, generates a single high-magnification image showing the entire sample 1001, and displays it on a liquid crystal display or the like. To do. By performing the above-described processing, the virtual slide apparatus 1000 can generate a high-magnification image of the entire sample 1001.

  Also, a method is known in which a spectrum of an object is measured at multiple points using a small spectrometer attached to an RGB camera, and the color reproducibility from an RGB image is improved using the information (for example, see Non-Patent Document 1). ). If a conventionally known method for improving color reproducibility is applied to a conventionally known virtual slide apparatus 1000, a high-magnification image of the entire sample 1001 can be generated while improving color reproducibility.

JP 2006-292999 A

Kunihiko Ietomi, Yuri Murakami, Masahiro Yamaguchi, Nagaaki Oyama, “Experimental Evaluation of Color Estimation Method for Color Images Using Multi-point Measurement Spectral Information”, Proceedings of the 54th Joint Conference on Applied Physics, p. 1071

  However, in the conventionally known method for acquiring (measuring) the spectrum of a subject, it is necessary to acquire a plurality of points of spectrum information for one RGB image, so that it takes time to acquire the spectrum information. There is. In addition, when the virtual slide apparatus 1000 captures a plurality of partial images and joins the partial images to generate one whole image, the method of acquiring a plurality of points of spectral information for each partial image is used. However, there is a problem that it takes time to obtain the spectrum information of the entire image.

  The present invention has been made to solve the above-described problem, and an object thereof is to provide a microscope apparatus that can acquire spectrum information in a shorter time.

  The present invention includes a stage that holds a sample, an imaging device, an imaging unit that captures a partial image of the sample according to incident light, a color sensor that acquires spectral information of incident light, and the sample. An optical system that makes the light incident on the imaging unit and the color sensor, a transport unit that moves the stage in a three-dimensional direction, and a marginal part that overlaps with other partial images captured by the imaging unit. The conveyance unit is controlled to move the sample in a direction parallel to the imaging surface of the imaging element so that the sample exists, and the color sensor is controlled to acquire the spectral information even while the sample is moving. And an imaging control unit that controls the imaging unit so as to capture the partial image after the sample is moved.

  Further, the present invention includes an area determination unit that determines whether or not a spectral change amount in each partial image area, which is an area in which the imaging unit captures the partial image, is greater than or equal to a predetermined value. The control unit controls the color sensor so as to acquire the spectral information only in the partial image region in which the spectral change amount is a predetermined value or more when acquiring the spectral information even while the sample is moving. This is a microscope apparatus.

  The present invention further includes an entire image capturing unit that captures an entire image of the sample, and the region determination unit uses the entire image captured by the entire image capturing unit to use a spectrum in each partial image region. It is a microscope apparatus characterized by determining whether or not the amount of change is equal to or greater than a predetermined value.

  In the microscope apparatus of the present invention, the imaging control unit controls the color sensor to acquire the spectral information even when the imaging unit images a partial region.

  In the microscope apparatus of the present invention, the imaging control unit controls the color sensor so as to acquire the spectral information even when imaging a partial image region in which the spectral change amount is a predetermined value or more. Features.

  Further, the present invention generates the entire image by pasting the partial images, and uses only the spectral information acquired in the partial image region where the spectral change amount is a predetermined value or more. A microscope apparatus including an entire image generation unit that performs color correction of an entire image.

  According to the present invention, the imaging unit includes an imaging device and captures a partial image of the sample according to the incident light. In addition, the color sensor acquires spectral information of incident light. The transport unit moves the stage holding the sample in the three-dimensional direction. In addition, the imaging control unit controls the transport unit to move the sample in a direction parallel to the imaging surface of the imaging element so that there is a marginal part that overlaps with other partial images captured by the imaging unit. The color sensor is controlled so as to acquire the spectral information even during the movement of the sample, and the imaging unit is controlled so as to take a partial image after the movement of the sample. Thereby, since the spectrum information can be acquired even while the stage is moving, the spectrum information can be acquired in a shorter time.

It is the schematic which showed the structure of the microscope apparatus in the 1st Embodiment of this invention. In the 1st Embodiment of this invention, it is the schematic which showed the partial image area which a 1st imaging part images a partial image, and the whole image area where a 2nd imaging part images a whole image. In the first embodiment of the present invention, a partial image region with a large amount of spectral change, a partial image region with a small amount of spectral change, a region in which a color sensor acquires spectral information, and a timing at which the color sensor acquires spectral information It is the schematic which showed these. It is the flowchart which showed the operation | movement procedure of the microscope apparatus in the 1st Embodiment of this invention. In the second embodiment of the present invention, a partial image region having a large amount of spectral change, a partial image region having a small amount of spectral change, a region in which a color sensor acquires spectral information, and a timing at which the color sensor acquires spectral information It is the schematic which showed these. It is the flowchart which showed the operation | movement procedure of the microscope apparatus in the 2nd Embodiment of this invention. It is the schematic which showed the structure of the conventionally known virtual slide apparatus.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram illustrating a configuration of a microscope apparatus 1 according to the present embodiment. In the illustrated example, the microscope apparatus 1 includes a stage 102, a stage driving unit 103 (conveying unit), a light source 104, a first objective lens 105, a second objective lens 106, and a half mirror 107 (optical system). ), A first imaging unit 108 (imaging unit) provided with an imaging device, a second imaging unit 109 (overall image imaging unit) provided with an imaging device, a visual field region changing unit 110, a color sensor 111, The imaging control unit 112, the whole image generation unit 113, and the region determination unit 114 are provided.

  The stage 102 is a stage for placing a sample 101 on which a sample (subject, imaging object) is placed on a slide glass. Based on the control of the imaging control unit 112, the stage driving unit 103 sets the stage 102 in a horizontal direction and a vertical direction with respect to the imaging surface of the imaging element included in the first imaging unit 108 and the imaging element included in the second imaging unit 109. Drive in any direction (three-dimensional direction). The light source 104 generates light that irradiates the sample 101.

  The first objective lens 105 is an objective lens used for enlarging and capturing a partial image of the sample 101, and is an objective lens having a magnification ratio higher than that of the second objective lens 106. The second objective lens 106 is an objective lens that is used to capture the entire image of the sample 101, and is an objective lens that has a lower magnification than the first objective lens 105. Further, at one point, either the first objective lens 105 or the second objective lens 106 can be disposed so as to face the sample 101. When arranged so as to face the sample 101, the first objective lens 105 and the second objective lens 106 condense the light beam from a predetermined region of the sample 101, and the condensed light to the half mirror 107. Irradiate. The half mirror 107 reflects a part of the light from the first objective lens 105 or the second objective lens 106 in the direction of the visual field region changing unit 110 and transmits a part thereof.

  The first image capturing unit 108 includes an image sensor having a larger number of pixels than the image sensor included in the second image capturing unit 109. The first image capturing unit 108 performs high-resolution conversion by photoelectric conversion into an electrical signal corresponding to the intensity of received light. Take an image. The second image pickup unit 109 includes an image pickup element having a smaller number of pixels than the image pickup element included in the first image pickup unit 108. The second image pickup unit 109 performs low-resolution conversion by photoelectric conversion into an electric signal corresponding to the intensity of received light. Take an image. In addition, at a temporary point, either the first imaging unit 108 or the second imaging unit 109 can be arranged at a position where the light transmitted by the half mirror 107 is received. In the present embodiment, when the first objective lens 105 is disposed so as to face the sample 101, the first imaging unit 108 is disposed at a position for receiving the light transmitted by the half mirror 107. Further, when the second objective lens 106 is disposed so as to face the sample 101, the second imaging unit 109 is disposed at a position for receiving the light transmitted through the half mirror 107. Accordingly, the first imaging unit 108 can capture a partial image of the sample 101 with high resolution, and the second imaging unit 109 can capture the entire image of the sample 102 with low resolution.

  The field-of-view area changing unit 110 is disposed between the half mirror 107 and the color sensor 111, and blocks the light of a part of the light from the half mirror 107 and transmits the light of the part of the area. . The light transmitted through the visual field region changing unit 110 is incident on the color sensor 111. Further, the visual field region changing unit 110 can change a region that blocks light out of the light from the half mirror 107. That is, the visual field region changing unit 110 can change the visual field range of the color sensor 111.

  The color sensor 111 detects spectral information of light transmitted through the visual field region changing unit 110 out of light from the sample 101. The imaging control unit 112 controls the stage driving unit 103, the first objective lens 105, the second objective lens 106, the first imaging unit 108, the second imaging unit 109, and the color sensor 111. To obtain an image and spectral information of the sample 101.

  The whole image generation unit 113 recognizes adjacent partial images for each of the plurality of partial images captured by the first imaging unit 108, and further recognizes and recognizes a marginal portion between the adjacent partial images. Based on the above, all the partial images are pasted together to generate one whole image. The entire image generation unit 113 performs color correction on the generated entire image based on the spectrum information acquired by the color sensor 111. Note that the entire image generation unit 113 may perform color correction of each partial image based on the spectrum information acquired by the color sensor 111, and then generate the entire image by pasting the partial images after color correction. Good. The region determination unit 114 determines a region where the amount of change in spectrum is large and a region where the amount of change in spectrum is small.

  Next, a partial image area where the first imaging unit 108 captures a partial image and a whole image area where the second imaging unit 109 captures an entire image will be described. FIG. 2 is a schematic diagram illustrating a partial image area in which the first imaging unit 108 captures a partial image and an entire image area in which the second imaging unit 109 captures an entire image in the present embodiment. In the illustrated example, partial image areas 201 to 215 captured by the first imaging unit 108 and an entire image area 301 captured by the second imaging unit 109 are illustrated. In this case, the first imaging unit 108 can capture all the partial image areas 201 to 215 of the sample 101 by performing the imaging 15 times. In addition, the second imaging unit 109 can capture the entire image area 301 of the sample 101 with a single imaging. Further, when the partial image areas 201 to 215 are combined, an entire image area 301 is obtained.

  In the example illustrated in FIG. 2, the margin is not illustrated, but the partial image captured by the first imaging unit 108 includes the margin. For example, when the first imaging unit 108 captures a partial image of the partial image region 201, the partial image including an image of a region around the partial image region 201 illustrated is captured. Similarly, when imaging the other partial image areas 202 to 215, the first imaging unit 108 captures a partial image including an image of the area around the partial image areas 202 to 215.

  Next, the area | region where the color sensor 111 in this embodiment acquires spectrum information is demonstrated. When the change amount of the spectrum is small in one partial image region, it is considered that the spectral information of any region of the partial image region is almost the same. Further, when the amount of change in spectrum is large in one partial image region, it is considered that the spectrum information varies greatly depending on the region in the partial image region. Accordingly, in a partial image region having a small spectrum change amount (partial image region having a small spectrum change amount) in one partial image region, the color sensor 111 acquires spectral information of one region in the partial image region. . In a partial image region having a large spectrum change amount (partial image region having a large spectrum change amount) in one partial image region, the color sensor 111 acquires spectral information of a plurality of regions in the partial image region. .

  Next, a method for determining a partial image region having a large spectral change amount and a partial image region having a small spectral change amount will be described. In the present embodiment, the area determination unit 114 calculates the variance value of the pixel value for each partial image area using the pixel value of one whole image captured by the second imaging unit 109, and sets the calculated variance value. Based on this, a partial image region having a large spectrum change amount and a partial image region having a small spectrum change amount are determined. For example, the variance value of the pixel value of the R pixel that detects red, the variance value of the pixel value of the G pixel that detects green, and the variance value of the pixel value of the B pixel that detects blue are calculated. A threshold value in which at least one of the calculated dispersion value of the R pixel value, the dispersion value of the G pixel value, and the dispersion value of the B pixel value is predetermined. In the above case, it is determined that the partial image region has a large spectrum change amount. Moreover, when all the dispersion values are less than a predetermined threshold value among the dispersion value of the calculated pixel value of the R pixel, the dispersion value of the pixel value of the G pixel, and the dispersion value of the pixel value of the B pixel, It is determined that the partial image region has a small amount of spectrum change.

  Further, when the color sensor 111 acquires spectral information of a plurality of regions in the partial image region, the spectral information is acquired while the stage 102 is moving, thereby shortening the acquisition time of the spectral information. FIG. 3 shows a partial image region having a large spectral change amount, a partial image region having a small spectral change amount, a region where the color sensor 111 acquires spectral information, and the color sensor 111 acquiring spectral information in this embodiment. It is the schematic which showed timing.

  In the illustrated example, partial image areas 201 to 205 are shown among the partial image areas shown in FIG. The partial image areas 201, 203, and 204 are partial image areas having a large spectrum change amount. The partial image areas 202 and 205 are partial image areas having a small spectrum change amount. Further, the partial image areas 201, 203, and 204 each include four areas 310 where the color sensor 111 acquires spectral information while the stage 102 is moving, and the stage 102 is stopped (during partial image capturing). ) Includes one region 311 from which the color sensor 111 obtains spectral information. Each of the partial image areas 202 and 205 includes one area 311 in which the color sensor 111 acquires spectral information while the stage 102 is stopped (during partial image capturing).

  As described above, the color sensor 111 according to the present embodiment acquires the spectral information of one area in the partial image area in the partial image area where the spectral change amount is small, and the partial image area in the partial image area where the spectral change amount is large. Spectral information of a plurality of regions is acquired. Further, when the color sensor 111 acquires spectrum information of a plurality of regions in the partial image region, the color sensor 111 also acquires the spectrum information while the stage 102 is moving. Therefore, even when the color sensor 111 acquires spectral information of a plurality of regions, the acquisition time of spectral information can be shortened.

Next, an imaging procedure of the sample 101 by the microscope apparatus 1 will be described. FIG. 4 is a flowchart showing an operation procedure of the microscope apparatus 1 in the present embodiment.
(Step S101) The imaging control unit 112 arranges the second objective lens 106 at a position facing the sample 101, arranges the second imaging unit 109 at a position to receive the light transmitted by the half mirror 107, and The entire image of the sample 101 is captured using the second objective lens 106 and the second imaging unit 109. Thereafter, the process proceeds to step S102.
(Step S102) The region determination unit 114 uses the entire image of the sample 101 captured by the second imaging unit 109 in the process of step S101, and a partial image region having a large spectral change amount and a partial image having a small spectral change amount. Determine the area. Thereafter, the process proceeds to step S103.

(Step S103) The imaging control unit 112 arranges the first objective lens 105 at a position facing the sample 101, and arranges the first imaging unit 108 at a position for receiving the light transmitted by the half mirror 107. Thereafter, the process proceeds to step S104.
(Step S <b> 104) The imaging control unit 112 determines whether or not the first imaging unit 108 has captured partial images of all partial image regions of the sample 101. If the imaging control unit 112 determines that the first imaging unit 108 has captured partial images of all the partial image regions of the sample 101, the process proceeds to step S107. Otherwise, the process proceeds to step S105. move on.

  (Step S105) The imaging control unit 112 controls the stage driving unit 103 so that the first imaging unit 108 can capture a partial image of a partial image area that has not yet been captured, and the stage 102 (sample 101). Move horizontally. In addition, the imaging control unit 112 causes the color sensor 111 to acquire spectral information when a partial image region having a large spectral change amount passes on the optical axis of the first objective lens 105 while the stage 102 is moving. The color sensor 111 acquires spectrum information based on the control of the imaging control unit 112, and outputs the acquired spectrum information to the entire image generation unit 113. Note that the region in which the color sensor 111 acquires spectrum information at this time is, for example, the region 310 illustrated in FIG. The entire image generation unit 114 stores spectrum information output from the color sensor 111. Thereafter, the process proceeds to step S106.

  (Step S106) The imaging control unit 112 causes the first imaging unit 108 to capture a partial image in the partial image region, and causes the color sensor 111 to acquire spectral information. The first imaging unit 108 captures a partial image and outputs the captured partial image to the entire image generation unit 113. Further, the color sensor 111 acquires spectrum information and outputs the acquired spectrum information to the entire image generation unit 113. In addition, the area | region where the color sensor 111 acquires spectrum information at this time is the area | region 311 shown in FIG. 3, for example. The whole image generation unit 113 stores the partial image output from the first imaging unit 109 and the spectrum information output from the color sensor 111. Thereafter, the process returns to step S104.

  (Step S107) The entire image generating unit 113 generates one entire image by pasting the partial images stored in the process of Step S106. In addition, the entire image generation unit 113 performs color correction of the generated entire image using the spectrum information stored in the processes of steps S105 and S106. Thereafter, the process ends. For example, the entire image generation unit 113 calculates an average value of the spectrum information stored in the processes of Step S105 and Step S106, and performs color correction of the entire image using the calculated average value. The overall image generation unit 113 performs color correction of each partial image using the spectrum information acquired in each partial image region, and then generates a whole image by pasting the partial images after color correction. Also good.

  As described above, according to the present embodiment, the stage 102 on which the sample 101 is placed is moved for alignment of the sample 101 before capturing the partial image. However, in the color sensor 111, the stage 102 moves. Multi-spectral spectral information is acquired even during Therefore, even when acquiring multi-region spectrum information, the spectrum information can be acquired in a shorter time.

  Further, when the amount of change in the spectrum is small in one partial image region, it is considered that the spectral information of any region of the partial image region is almost the same. Further, when the amount of change in spectrum is large in one partial image region, it is considered that the spectrum information varies greatly depending on the region in the partial image region. Therefore, according to the present embodiment, in the partial image region where the amount of change in spectrum is small, the spectral information of one region in the partial image region is acquired. Further, in the partial image region where the amount of spectrum change is large, spectral information of a plurality of regions in the partial image region is acquired. Therefore, more accurate spectrum information can be acquired while reducing the number of regions from which spectrum information is acquired.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. The configuration of the microscope apparatus 1 in the present embodiment is the same as the configuration of the microscope apparatus 1 in the first embodiment. The difference between this embodiment and the first embodiment is that in this embodiment, spectrum information is acquired only in a partial image region having a large amount of spectrum change, and spectrum information acquired in a partial image region having a large amount of spectrum change is obtained. In other words, color correction is performed on the entire image generated by pasting the partial images.

  Next, the area | region where the color sensor 111 in this embodiment acquires spectrum information is demonstrated. In general, an image obtained by imaging the sample 101 includes an imaging object and a background. Further, when the imaging object and the background are different in color, if the imaging object is included in the image, the amount of change in the spectrum in the image increases. Therefore, there is a high possibility that the imaging target is included in the partial image region having a large spectrum change amount. Therefore, in the present embodiment, spectral information is acquired only in a partial image region having a large amount of spectrum change, and color correction is performed on the entire image generated by pasting the partial images using the acquired spectral information. Color correction suitable for the object to be imaged can be performed. Furthermore, since spectrum information is acquired only in the partial image region having a large amount of spectrum change, and spectrum information is not acquired in the partial image region having a small amount of spectrum change, the time required for acquiring the spectrum information can be further reduced. it can.

  Next, the area | region and timing which acquire spectrum information are demonstrated. FIG. 5 shows a partial image region with a large amount of spectral change, a partial image region with a small amount of spectral change, a region where the color sensor 111 acquires spectral information, and the color sensor 111 acquires spectral information in this embodiment. It is the schematic which showed timing.

  In the illustrated example, partial image areas 201 to 205 are shown among the partial image areas shown in FIG. 2 in the first embodiment. The partial image areas 201, 203, and 204 are partial image areas having a large spectrum change amount. The partial image areas 202 and 205 are partial image areas having a small spectrum change amount. The partial image areas 201, 203, and 204 each include four areas 310 where the color sensor 111 acquires spectral information while the stage 102 is moving, and the stage 102 is stopped (partial image imaging). 1) each includes a region 311 for acquiring spectrum information. In addition, since the spectrum information is not acquired in the partial image region where the spectrum change amount is small, the partial image regions 202 and 205 do not include a region for acquiring the spectrum information.

  As described above, the color sensor 111 according to the present embodiment does not acquire the spectrum information in the partial image region where the spectral change amount is small, and in the partial image region where the spectral change amount is large, the spectral information of a plurality of regions in the partial image region. To get. Therefore, the time required for acquiring the spectrum information can be further reduced. Further, when the color sensor 111 acquires spectrum information of a plurality of regions in the partial image region, the color sensor 111 also acquires the spectrum information while the stage 102 is moving. Therefore, even when the color sensor 111 acquires spectral information of a plurality of regions, the acquisition time of spectral information can be shortened.

  Next, an imaging procedure of the sample 101 by the microscope apparatus 1 will be described. FIG. 6 is a flowchart showing an operation procedure of the microscope apparatus 1 in the present embodiment. The processing from step S201 to step S204 is the same processing as the processing from step S101 to step S104 in the first embodiment.

  (Step S205) The imaging control unit 112 controls the stage driving unit 103 so that the first imaging unit 108 can capture a partial image of a partial image area that has not yet been captured, so that the stage 102 (sample 101) is placed. Move horizontally. In addition, the imaging control unit 112 causes the color sensor 111 to acquire spectral information when a partial image region having a large spectral change amount passes on the optical axis of the first objective lens 105 while the stage 102 is moving. The color sensor 111 acquires spectrum information based on the control of the imaging control unit 112, and outputs the acquired spectrum information to the entire image generation unit 113. Note that the region in which the color sensor 111 acquires spectrum information at this time is, for example, the region 310 illustrated in FIG. The entire image generation unit 114 stores spectrum information output from the color sensor 111. Thereafter, the process proceeds to step S206.

  (Step S206) The imaging control unit 112 causes the second imaging unit 109 to capture a partial image in the partial image region. At this time, if the partial image region for capturing the partial image is a partial image region with a large amount of spectral change, the imaging control unit 112 causes the color sensor 111 to acquire spectral information. The second imaging unit 109 captures a partial image and outputs the captured partial image to the entire image generation unit 113. In addition, the color sensor 111 acquires spectral information when the partial image region in which the second imaging unit 109 captures a partial image is a partial image region having a large amount of spectral change, and the acquired spectral information is used as the entire image generation unit. 113 for output. Note that the region in which the color sensor 111 acquires spectrum information at this time is, for example, the region 311 shown in FIG. The whole image generation unit 113 stores the partial image output from the second imaging unit 109 and the spectrum information output from the color sensor 111. Thereafter, the process returns to step S204.

  (Step S207) The entire image generation unit 113 combines the partial images stored in the process of step S206 to generate one entire image. In addition, the entire image generation unit 113 performs color correction on the generated entire image using the spectrum information stored in the processes of steps S205 and S206. Thereafter, the process ends. For example, the entire image generation unit 113 calculates an average value of the spectrum information stored in the processes of Step S205 and Step S206, and performs color correction of the generated entire image using the calculated average value.

  As described above, generally, an image obtained by imaging the sample 101 includes an imaging object and a background. Further, when the imaging object and the background are different in color, if the imaging object is included in the image, the amount of change in the spectrum in the image increases. Therefore, there is a high possibility that the imaging target is included in the partial image region having a large spectrum change amount. Therefore, in the present embodiment, spectral information is acquired only from a partial image region having a large amount of spectrum change, and color correction is performed on the entire image generated by pasting the partial images using the acquired spectral information. Therefore, it is possible to acquire the spectral information of the imaging object more accurately. Furthermore, since spectrum information is acquired only in the partial image region having a large amount of spectrum change, and spectrum information is not acquired in the partial image region having a small amount of spectrum change, the time required for acquiring the spectrum information can be further reduced. it can.

  The first embodiment and the second embodiment of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and does not depart from the gist of the present invention. Range design etc. are also included.

  For example, in the first embodiment and the second embodiment described above, the first imaging unit 108 and the second imaging unit 109 are separately provided, and the first imaging unit 108 captures a partial image. The second imaging unit 109 captures the entire image, but the present invention is not limited to this. For example, the first imaging unit 108 may capture both the entire image and the partial image.

  In the first embodiment and the second embodiment described above, the spectrum information of four regions is acquired as the spectrum information acquired during the movement of the stage 102, but the present invention is not limited to this. For example, instead of acquiring spectral information of four regions, spectral information of one or more regions may be acquired.

  DESCRIPTION OF SYMBOLS 1 ... Microscope apparatus, 101 ... Sample, 102 ... Stage, 103 ... Stage drive part, 104 ... Light source, 105 ... 1st objective lens, 106 ... 2nd Objective lens 107 ... Half mirror 108 ... First imaging unit 109 ... Second imaging unit 110 ... Field of view region changing unit 111 ... Color sensor 112 ... Imaging control unit, 113 ... Whole image generation unit, 114 ... Area determination unit

Claims (6)

A stage for holding the sample;
An imaging unit that includes an imaging element and captures a partial image of the sample according to incident light;
A color sensor that acquires spectral information of incident light;
An optical system that makes light from the sample incident on the imaging unit and the color sensor;
A transport unit for moving the stage in a three-dimensional direction;
Controlling the transport unit to move the sample in a direction parallel to the imaging surface of the imaging element so that there is a marginal part that overlaps with another partial image captured by the imaging unit; An imaging control unit that controls the color sensor to acquire the spectral information even during movement of the sample, and controls the imaging unit to capture the partial image after movement of the sample;
A microscope apparatus comprising: A region determination unit that determines whether or not a spectral change amount in each partial image region, which is a region in which the imaging unit captures the partial image, is greater than or equal to a predetermined value;
When the spectral information is acquired even while the sample is moving, the imaging control unit acquires the spectral information only in the partial image region where the spectral change amount is a predetermined value or more. The microscope apparatus according to claim 1, wherein the microscope apparatus is controlled. An overall image capturing unit that captures an entire image of the sample;
The region determination unit determines whether or not a spectral change amount in each partial image region is equal to or greater than a predetermined value by using the entire image captured by the entire image capturing unit. Item 3. The microscope apparatus according to Item 2. The microscope apparatus according to claim 1, wherein the imaging control unit controls the color sensor so that the spectral information is acquired even when the imaging unit images a partial region. The said imaging control part controls the said color sensor so that the said spectral information may be acquired also when imaging the partial image area where the said spectrum variation | change_quantity is more than predetermined value. Microscope device. The partial images are pasted together to generate a single whole image, and color correction of the generated whole image is performed using only the spectral information acquired in the partial image region in which the spectral change amount is a predetermined value or more. The microscope apparatus according to claim 5, further comprising: an entire image generation unit to perform.

Images