JP5977663B2 - Microscope imaging device - Google Patents

Description

  The present invention relates to a microscope imaging apparatus.

Conventionally, when a so-called live observation is performed by displaying a captured image on a monitor in an imaging apparatus for a microscope, the frame rate of the displayed image is not sufficient for operations on the microscope, that is, operations such as focusing. In some cases, the observation operation with a microscope may be hindered. If the frame rate is insufficient, the follow-up time until the microscope observation operation is reflected on the live image is delayed, which hinders the observation operation in which the focus cannot be adjusted during the live observation. . For this reason, the frame rate of the microscope is about 15 fps or more in live observation.
By the way, the frame rate is proportional to the drive frequency for driving the image sensor, and the frame rate increases as the drive frequency increases. When the frame rate is fast, the observation operation as described above can be performed smoothly, but the imaging apparatus has problems such as an increase in heat generation, an increase in power consumption, and an increase in noise in the image.

In order to solve such a problem, for example, in Patent Document 1, a temperature sensor is provided, and, for example, the image sensor is operated at a relatively low clock frequency when the temperature is high, depending on the temperature measured by the temperature sensor. Thus, it is disclosed that power consumption and noise are reduced by changing a clock frequency for operating the image sensor.
Further, for example, in Patent Document 2, the operation is performed at a high speed close to full frame processing only when the power is turned on or when the imaging environment is changed, and the frame processing speed is decreased when automatic control such as iris control is stabilized. Switching is disclosed.
Further, Patent Document 3 discloses that when the brightness of a subject is insufficient, autofocus is performed by reducing the drive speed of the CCD imager, and the frame rate is changed in conjunction with the shutter button. Yes.

JP 2008-118263 A JP 2003-179820 A JP 2001-257931 A

  However, the conventional techniques described above have the following problems. In other words, the technique disclosed in Patent Document 1 requires a temperature sensor, which increases the size of the imaging device. In the technique disclosed in Patent Document 2, since the frame rate of the image sensor itself is not changed, the power consumption reduction effect of the image sensor itself and the reduction of image noise superimposed on the output image from the image sensor cannot be expected. Further, in Patent Document 2, since a so-called CMOS sensor is targeted as an image pickup element, it cannot necessarily be applied to other image pickup elements. In the technique disclosed in Patent Document 3, since the frame rate is changed in conjunction with the shutter button, a processing time for changing the frame rate is required at the time of imaging, and there is a possibility of missing a photo opportunity.

  The present invention has been made in view of the above problems, and an object thereof is to reduce power consumption and improve the quality of an acquired image while maintaining observation performance.

In order to achieve the above object, the present invention provides the following means.
The present invention provides an image sensor that captures an image of a subject to acquire an image, a drive circuit that drives the image sensor, a clock generation unit that generates a clock frequency to be supplied to the drive circuit, and an image captured by the image sensor A region-of-interest setting unit that sets a region of interest for an image to be processed, and a clock changing unit that changes a clock frequency generated by the clock generation unit according to the size of the region of interest set by the region of interest. Provided is an imaging apparatus for a microscope.

  According to the present invention, a predetermined clock frequency is supplied from the clock generation unit to the drive circuit, and the image pickup device is driven by the drive circuit, thereby capturing an image of the subject and acquiring the image. In this case, when a region of interest, which is an arbitrary region among images that can be acquired by the image sensor, is set, the image sensor at the same clock frequency as the clock frequency used when the image of the entire region is acquired by the image sensor. There is no need to drive. Thus, the imaging element can be driven based on the clock frequency corresponding to the size of the region of interest by changing the clock frequency generated by the clock generation means according to the set size of the region of interest. Therefore, for example, the imaging element is not driven by a clock frequency that is too high for the size of the image to be acquired, so that power consumption can be increased and noise in the image can be reduced. And since the power consumption does not increase, it is not necessary to make the device compatible with the power consumption, so that the imaging device can be miniaturized and the noise of the image is reduced, so that the operability of the microscope or the imaging device is improved. improves.

The microscope applied to the imaging device for a microscope according to the invention includes a microscope observation state grasping unit that grasps an observation state of the microscope, and the clock changing unit changes the clock according to the result of the microscope observation state grasping unit. It is preferable to change the frequency.
In the above invention, the clock changing unit sets a clock frequency lower than a predetermined clock frequency when the microscope observation state grasping unit determines that the microscope is in the process of operation.
By doing so, when the need for so-called live observation is low, power consumption is reduced by lowering the clock frequency, so that operability is improved.

In the above invention, the clock changing means sets a clock frequency lower than a predetermined clock frequency when the microscope observation state grasping unit determines that the observation state of the microscope is unchanged for a predetermined period.
In this way, for example, the clock frequency can be increased during so-called live observation, and the clock frequency can be decreased during observations other than live observation. Can be optimized.

  According to the present invention, while maintaining the observation performance, the power consumption can be reduced and the image quality of the acquired image can be improved.

1 is a block diagram illustrating a schematic configuration of a microscope imaging system to which a microscope imaging apparatus according to a first embodiment of the present invention is applied. It is a block diagram which shows schematic structure of the camera head of the imaging device for microscopes concerning the 1st Embodiment of this invention. It is a schematic block diagram which shows the interface of the operation part of the imaging device for microscopes concerning the 1st Embodiment of this invention. It is a block diagram which shows schematic structure of the operation part of the imaging device for microscopes concerning the 1st Embodiment of this invention. It is a block diagram showing a schematic structure of a display part of an imaging device for microscopes concerning a 1st embodiment of the present invention. 1 is a reference diagram illustrating a schematic configuration of a microscope revolver in a microscope imaging system to which a microscope imaging apparatus according to a first embodiment of the present invention is applied. 1 is a reference diagram illustrating a schematic configuration of a microscope in a microscope imaging system to which a microscope imaging apparatus according to a first embodiment of the present invention is applied. FIG. 5 is a reference diagram for explaining the operation of a photographing pixel range setting unit in the microscope imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a reference diagram for explaining the operation of a photographing pixel range setting unit in the microscope imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a reference diagram for explaining the operation of a photographing pixel range setting unit in the microscope imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a reference diagram for explaining the operation of a photographing pixel range setting unit in the microscope imaging apparatus according to the first embodiment of the present invention. It is a block diagram which shows the structure of the ROI speed setting part in the imaging device for microscopes concerning the 1st Embodiment of this invention. It is a flowchart which shows the effect | action in the imaging device for microscopes of the 1st Embodiment of this invention. It is a flowchart which shows the effect | action in the imaging device for microscopes of the 2nd Embodiment of this invention. It is a flowchart which shows the effect | action in the imaging device for microscopes of the 3rd Embodiment of this invention. It is a block diagram showing a schematic structure of a microscope observation state grasping part of an imaging device for microscopes concerning a modification of a 3rd embodiment of the present invention. It is a flowchart which shows the effect | action in the imaging device for microscopes which concerns on the modification of the 3rd Embodiment of this invention. It is a block diagram which shows schematic structure of the operation part of the imaging device for microscopes concerning the 3rd Embodiment of this invention.

(First embodiment)
The microscope imaging apparatus according to the first embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 shows a schematic configuration of a microscope imaging system to which a microscope imaging apparatus 10 is applied. The microscope imaging system includes a microscope main body 1 and a microscope imaging device 10.
The microscope imaging apparatus 10 includes a camera head 2 and an operation display unit 6 that operates the camera head 2 and displays a captured image.

  The camera head 2 is disposed on the optical path of light emitted from the microscope main body 1 to be described later, and drives the image pickup element 20 and the image pickup element 20 that photoelectrically converts the sample image from the microscope main body 1 as shown in FIG. An imaging element driving circuit 21 (driving circuit) to be controlled, a clock 22 (clock generating means) for determining a driving frequency of the imaging element driving circuit 21, and a clock frequency setting unit 24 (clock changing means) for variably controlling the frequency of the clock 22 ), An image processing unit 23 that performs processing for reproducing an image signal from the image sensor 20 via the image sensor drive circuit 21 as an image, and a range in which the number of pixels of the image sensor 20 is the maximum number of pixels. A shooting pixel range setting unit 25 (region of interest setting unit) that sets the range of the image to be captured and the number of pixels in the image sensor. For example, a CCD can be applied to the image sensor 20 in the present embodiment. The microscope imaging apparatus 10 continuously reproduces the sample image according to the number of pixels and the image position specified by the imaging pixel range setting unit 25, thereby obtaining a current sample image in real time, which will be described later. It is possible to perform so-called live observation displayed on 41 (see FIG. 5).

As shown in FIG. 1, the operation display unit 6 includes an operation unit 4 that operates the camera head 2 and a display unit 5 that displays a sample image acquired by the camera head 2, and a memory device that stores the sample image. 34 (see FIG. 4) is connected.
As shown in FIG. 3, a power supply sw (switch: hereinafter abbreviated as “sw”) 60 for turning on / off the power source, a shooting operation mode for performing a shooting operation, and a shot image are reproduced on the interface of the operation unit 4. A mode sw32 for selecting at least three modes such as a reproduction mode and a PC mode enabling control by an external PC, and an exposure correction sw33 for setting an exposure correction value are provided. In addition, the operation unit 4 is provided with various controls sw for the camera head 2 and the display unit 5 (for example, left selection sw61 and right selection sw62).

  In addition, the operation unit 4 is provided with sw for performing a desired operation on the camera head 2 and the display unit 5 such as EXPOSEsw 31 when photographing. Thereby, the camera head 2 and the display part 5 perform predetermined operation | movement according to the operation, when a user operates each of these sw.

  The electric circuit of the operation unit 4 has a configuration as shown in FIG. That is, various operations of the user are performed by a central processing circuit, a ROM storing a program for causing the central processing circuit to perform various control processes described later, and work for the central processing circuit to execute the program. When a sample image is displayed on the display unit 5 after being analyzed and processed by a control circuit (hereinafter referred to as CPU) 201 including a RAM or the like used as a storage area for display, display data is written into the display RAM 200. In the case of control related to shooting, control related to shooting such as exposure time is performed on the camera head 2 via the camera head connector 203.

  The number of pixels and the imaging position (coordinates and sizes for imaging the total number of pixels of the image sensor as a two-dimensional space) in live image display and still image shooting (recording to removable media 35 described later) are also connected from the CPU 201 to the camera head connector. Control is performed via the photographing pixel range setting unit 25 in the camera head 2 via 203.

  When recording the digital image data from the image processing unit 23 on the removable medium 35, the CPU 201 performs a process of sending the image data to the memory read / write unit 36 in a predetermined file format. In the present embodiment, it is assumed that the well-known MS-DOS (registered trademark) FAT (File Allocation Table) file system is used to manage data files in the removable medium 35.

  As shown in FIG. 1, the display unit 5 displays the sample image acquired by the camera head 2 and also displays each imaging setting performed by the operation unit 4. Further, the camera head 2 and the operation display unit 6 are connected by a cable 7 so that electrical signals can be transmitted and received between them. The operation display unit 6 is connected to the camera head 2 within a range depending on the length of the cable 7. Even if they are set apart, the camera head 2 can take a picture.

  The operation unit 4 and the display unit 5 are fixed at a fixed angle. When the operation display unit 6 is installed on a desk, the operation unit 4 is almost horizontal with the desk, and the display unit 5 is 0 to 90 ° with the desk. The angle is easy for the user to operate within the range, for example, about 90 °. Here, the 0 ° state means that the operation unit 4 and the display unit 5 are in a horizontal state, that is, various sws such as the image display panel 41 (see FIG. 5) and the mode sw32 of the operation unit 4 are arranged on the same plane. Show things. A communication terminal 37 for external control such as a PC is connected to the PC 100 via the cable 101. Furthermore, the microscope main body 1 and the operation unit 4 of the microscope imaging apparatus 10 are connected by a microscope-camera connection cable 207 so that electrical signals can be transmitted and received.

  As shown in FIG. 4, the memory device 34 includes, for example, a removable removable medium 35 such as an SD card widely used in a PC or the like, and a memory read / write unit 36 that can write and read a captured image on the removable medium 35. Is included. Further, the electric circuit of the operation unit 4 is equipped with a communication terminal 37 for accessing the memory device 34 or performing various sw controls installed in the operation unit 4 remotely by a PC or the like.

  The communication terminal 37 is connected to the CPU 201 via the communication means 38, and enables communication between the PC 100 and the microscope imaging apparatus 10 via the communication cable 101 (see FIG. 1). Further, the electric circuit of the operation unit 4 includes a symbol string ROM 63 for storing symbol string font data such as characters, numbers, and various symbols used for writing the symbol string in the image, and a photographed image-symbol that combines the photographed image and the symbol string. It has a synthesizer 64. The electric circuit of the operation unit 4 includes an observation image-symbol string combiner 65 that synthesizes a symbol string with the observation image, and an ROI speed setting unit 66 described later.

  The microscope connection connector 208 is connected to the CPU 201 via the microscope communication unit 209, and enables electrical communication with the microscope main body 1 through the microscope-camera connection cable 207.

  As shown in FIG. 5, the display unit 5 includes an image display panel 41 that displays a specimen image acquired by the camera head 2 and a reproduction image of an image stored in the memory device 34, an exposure time at the time of shooting, and an exposure. An information display panel 42 that displays shooting information such as correction and playback information such as an image file at the time of playback is provided. The display unit 5 also includes a D / A converter 43 that converts a digital image data signal into an analog signal, which is necessary when displaying the digital image data from the display RAM 200.

  Returning to FIG. 1, the microscope body 1 includes a stage 51 for placing the specimen 50 and finely adjusting the specimen observation position, objective lenses 52 </ b> A and 52 </ b> B for observing the specimen 50, and an eyepiece that the user looks into. 54 etc. The objective lenses 52A and 52B are supported by a revolver 53 having a rotation mechanism that can be installed and changed inside and outside the optical path. That is, the revolver 53 can support a plurality of objective lenses 52A and 52B and install one of them in the optical path. In FIG. 1, the objective lens 52A is in the optical path, and the objective lens 52B is outside the optical path.

  As shown in FIG. 6, the revolver 53 can connect six objective lenses. The revolver 53 can support, for example, a plurality of 6 types of objective lenses having different magnifications such as 2 ×, 4 ×, 10 ×, 20 ×, 40 ×, and 100 ×. Any one of the objective lenses can be installed in the optical path as required by the rotation operation of the revolver 53 as necessary, such as an observation specimen.

  The revolver 53 is provided with a revolver hole position sensor so as to be able to determine which objective lens is present in the optical path among the respective objective lenses. This revolver hole position sensor is provided for each of the revolver holes so that it can be determined whether any of the holes of the revolver 53 to which the six objective lenses are attached (portions where the objective lenses are connected) is present in the optical path. Equipped with.

  In FIG. 6, the objective lens 52A is in the optical path, but this revolver hole sensor is a revolver hole position sensor 54A. Right next to this is an objective lens 52B outside the optical path, and a revolver hole position sensor 54B correspondingly. Similarly, revolver hole position sensors 54C, 54D, 54E, 54F are equipped as position sensors for the respective revolver holes (objective lenses 52C, 52D, 52E, 52F).

  FIG. 7 shows the electrical structure of the microscope body 1. As described above, the revolver hole position sensors 54A, 54B, 4C, 54D, 54E, and 54F are provided in each of the six holes to which the objective lens of the revolver 53 is attached. When one of the objective lenses attached to the revolver 53 is in the optical path, the revolver hole position sensor corresponding to the revolver hole is in close proximity to the revolver hole position determination sensor 301 in the optical path. The revolver hole position sensor 54 and the revolver hole position determination sensor 301 in the optical path constitute a microscope observation state grasping unit.

  As a result, the revolver hole position determination sensor 301 in the optical path can determine the type of the revolver hole position sensor that is in close proximity to each other, and therefore can determine which revolver hole position sensor is in close proximity to. The optical path revolver hole position determination sensor 301 can convert the determination result into a communication command by the optical path revolver hole position transmitter 302 and send it to the operation unit 4 via the connection connector 303. Further, the state where none of the revolver hole position sensors is in close proximity to the revolver hole position determination sensor 301 in the optical path is a case where the objective lens is not correctly in the optical path, and also in this state, the revolver hole position transmitter 302 in the optical path. Thus, the communication command can be sent to the operation unit 4. The case where the objective lens is not correctly in the optical path is assumed to be during replacement of the objective lens during rotation of the revolver.

  Returning to FIG. 1, the sample image from the microscope main body 1 is imaged on the imaging device 20 (see FIG. 2) through the imaging lens 55. As a result, the sample image of the sample 50 is converted into an electrical signal by the imaging device 20 as described above, and predetermined image processing is performed by the image processing unit 23 to generate a reproducible digital image data signal of the sample. The update interval of the image data is an update interval of the image data output from the image sensor 20, and a numerical value indicating how many updates are made per second is called a frame rate. Image data is output from the image sensor 20 in synchronism with the operation of the image sensor drive circuit 21 in a cycle that matches the frequency from the clock 22. Therefore, the frame rate is determined according to the frequency setting of the clock frequency setting unit 24. For example, if the imaging device 20 has 1600 × 1200 pixels, when the frequency setting of the clock frequency setting unit 24 is 36 MHz, the frame rate is 15 fps, and when the frequency setting of the clock frequency setting unit 24 is 72 MHz, the frame rate is The rate is 30 fps.

  This digital image data signal is stored in the display RAM 200 via the cable 7 and the CPU 201. The stored digital image data signal is transmitted to the display unit 5, converted into an analog signal by the D / A converter 43, and displayed on the image display panel 41. By continuously performing this operation, it is possible to form a moving image (display update of about 10 to 30 images per second. One image is called one frame). Therefore, since a moving image can be displayed in real time, it is referred to as a live image. Note that this live image is not recorded on the removable medium 35 described below unless there is a user's recording instruction (pressing EXPOSEsw31).

When an image is displayed on the image display panel 41, at least one of the shooting mode and the reproduction mode can be set by the user's selection by the mode sw32.
When the shooting mode is selected, the camera head 2 can be set to at least two modes of “live image state” and “shooting state (rec view)”. In the “live image state” in which the mode sw32 is in the shooting mode, the camera head 2 can capture a dynamic image of the microscope specimen 50 in real time and display this image on the image display panel 41 in real time. .

  In the “shooting state (rec view)” when the mode sw is the shooting mode, the electronic shutter (not shown) of the image sensor 20 is opened and closed according to an appropriate exposure time by pressing the EXPOSEsw 31 by the user. 2 can be taken as a still image of a micrograph of a sample in a stopped state. The captured image at this time is displayed on the image display panel 41, and information such as the shooting conditions is displayed on the information display panel 42, respectively. Further, the digital image data can be recorded and saved as a captured image on the removable medium 35 by the memory device 34. The display of the still image on the image display panel 41 in the “shooting state (rec view)” is turned off after a predetermined time and becomes the “live image state”. The fixed time is, for example, until the completion of recording and saving of the captured image on the removable medium 35, or 10 seconds after the user presses the EXPOSEsw31.

  At this time, if the information writing setting (not shown) is set to “ON”, a desired symbol string such as the shooting date and time is overwritten on the image data. That is, the photographed image data is subjected to predetermined image processing by the CPU 201 when the user presses the shutter sw31. Thereafter, the photographed image data overwrites the symbol string selected by the user in the symbol string data stored in the symbol string ROM 63 to the lower right position of the image data in the photographed image-symbol string synthesizer 64, and the memory device 34 is recorded on the removable medium 35. On the image display panel 41, the currently selected symbol string is displayed on the “observation state” image. That is, the observation image from the camera head 2 is input to the display RAM 200 after the symbol string is overwritten to the lower right position of the observation data by the observation image-symbol string combiner 65. For this reason, the scale is also displayed on the live image.

If the information writing setting is set to “OFF”, either an “observation state” image on the image display panel 41 or an image recorded on the taken removable media 35 (an image shot with “OFF”), either Needless to say, the symbol string is not overwritten.
Measurement drawing is also executed in conjunction with scale writing. That is, when the scale writing is set to “ON”, the measurement drawing is also superimposed on the photographed image via the photographed image-symbol string synthesizer 64 and recorded on the removable medium 35.

  When the playback mode is selected, the captured image recorded on the removable medium 35 by the memory device 34 is read out via the memory read / write unit 36 and displayed on the image display panel 41, and playback image information such as a playback file name is displayed. Is displayed on the information display panel 42. When the left selection sw61 or the right selection sw62 is pressed in this state, among the files recorded on the removable medium 35, files that can be displayed as images on the image display panel 41 are sequentially displayed.

  At this time, an image is displayed on the image display panel 41 together with a symbol string written at the time of shooting (in the case of an image shot with the scale set to “ON”). For example, when a live image in the state of FIG. 9 is taken, an image including a scale display and a measurement result similar to FIG. 9 is displayed as a reproduced image.

  On the other hand, when the PC mode is selected by the mode sw32, the PC controls operations that are possible in the above-described shooting mode or playback mode. Further, the image stored in the removable medium 35 in the memory device 34 is stored in the memory device on the PC 100 side, the image in the memory device 34 is displayed on the PC screen, or the display unit 5 displays the image. The contents can be displayed on the PC screen. At this time, when an image stored in the removable medium 35 is displayed on the PC, the image is displayed together with a symbol string written at the time of shooting (in the case of an image shot with the scale set to “ON”).

  Further, even when the removable medium 35 is removed from the microscope imaging apparatus 10 and the image in the removable medium 35 is read out by the PC and displayed, the image is displayed together with the symbol string written at the time of shooting.

Next, the photographing pixel range setting unit 25 will be described.
The shooting pixel range setting unit 25 sets a region of interest of an arbitrary size for an image captured by the image sensor 20. Hereinafter, for example, as illustrated in FIG. 8, it is assumed that all pixels of the image sensor 20 are 1600 × 1200 pixels.

  The coordinates of all the pixels are assumed to be upper left (1, 1) and lower right (1600, 1200). As shown in FIG. 9, a pixel number setting item 94 that can be displayed and set on the operation display unit 6 by a user operation is shown. A pixel number selection sub-item MENU (pixel setting unit) 91 can select the number of pixels of 1600 × 1200 and 800 × 600. In FIG. 9, 1600 × 1200 is selected (bold and underlined). In this case, 1600 × 1200 setting information set in the pixel number selection small item MENU 91 is sent to the imaging pixel range setting unit 25, so that the operation state of the image sensor 20 becomes the designated state. That is, the entire number of pixels 1600 × 1200 in FIG. 8 is imaged and used for live images and still images.

  When 800 × 600 is selected, so-called interlaced scanning is performed. In the interlaced scanning, the imaging range is the same as all pixels and the number of pixels is reduced. In FIG. 8, the coordinates (1,1), (3,1), (5,1),... (1599,1) are taken in the horizontal direction, and the vertical direction is also (1,1). 1), (1,3),..., (1,1199).

  In this way, the number of pixels to be imaged is 800 × 600, while the imaging range is the entire area of the image sensor 20, that is, the coordinates (1, 1) to (1600, 1200) in FIG.

  In this case, since the number of pixels is reduced to ¼ compared with 1600 × 1200 pixel imaging, there is an advantage that the still image file size can be reduced. In addition, since the number of pixels read from the image sensor 20 is ¼ compared to all pixels 1600 × 1200, the reading speed (frame rate) can be improved.

  However, since the CCD generally cannot perform interlaced image pickup on the horizontal side, it often includes a process of thinning out by one in the image processing unit 23 downstream from the image sensor 20. In this case, since the number of calling pixels from the CCD is not reduced, the reduction in the number of pixels on the horizontal side does not result from the improvement in the frame rate.

Therefore, for the sake of simplicity, it is assumed that the relationship between the number of pixels to be imaged and the frame rate is inversely proportional to the ratio of the number of pixels to the pixels on the vertical side among all pixels.
In this case, if the frame rate is 1600 × 1200 pixels, for example, 15 fps (Frame Per Second), the number of vertical pixels is halved at 800 × 600, so the frame rate is twice that of all pixels 15 fps. A certain 30 fps is possible.

Next, the ROI setting switching unit 91b in FIG. 9 will be described. ROI is designation of a user's desired pixel coordinate range. In FIG. 9, “ROI OFF” is selected, and the setting in the above-mentioned pixel number selection small item MENU 91 is valid.
When “ROI setting” is selected, an image can be selected as shown in FIG. 10 and FIG. 8 show the same total pixel space, but the user can freely change the ROI area 93 indicated by the dotted line in the total pixel space in units of one pixel by operating the operation unit 4 (not shown). Can be set.

For example, when ROI is performed with an area of coordinates (1000, 500) to (1200, 700) as shown in FIG. 10, that is, the upper left start point (1000, 500) of the image with 200 × 200 pixels, ROI setting is performed here. The switching unit 91b is set to “ROI ON”. Then, this coordinate information is sent to the imaging pixel range setting unit 25, so that the operation state of the image sensor 20 becomes the designated state. That is, as shown in FIG. 11, imaging with 200 × 200 pixels at the upper left starting point (1000, 500) is employed for a live image or a still image.
In this case, the image displayed on the image display panel 41 has the position and range shown in FIG.

  In addition, in the case of 200 × 200 ROI with respect to all the pixels 1600 × 1200, since the vertical side pixel is 1/6, the frame rate is 90 fps, which is six times 15 fps (Note: ROI speed setting unit 66 described later) Frame rate value without impact).

FIG. 12 shows the internal structure of the ROI speed setting unit 66. The ROI speed setting unit 66 optimizes the frame rate at the time of ROI by resetting the optimal frequency of the clock 22 according to the ROI size set at that time.
In other words, when the number of pixels is large, the clock is advanced so that the frame rate is optimal for observation such as 30 fps, and when the number of pixels is small, the clock is delayed so that the frame rate is not inadvertently increased too quickly, such as 100 fps. .
Specifically:

The ROI speed setting unit 66 includes an ROI size holding RAM 66a, a clock frequency holding RAM 66b, an ROI speed determining unit 66c, and an ROI speed changing unit 66d.
The ROI size holding RAM 66a holds the ROI setting state at the ROI setting selection switching 91b. Here, the setting state when the ROI is turned off or when the ROI is turned on, for example, the area of the above-mentioned coordinates (1000, 500) to (1200, 700), that is, the ROI with 200 × 200 pixels at the upper left starting point (1000, 500). The setting state such as is retained.

  The clock frequency holding RAM 66b holds the frequency set by the clock frequency setting unit 24, for example, 72 MHz. The ROI speed determination unit 66c calculates the frame rate from the number of pixels held in the ROI size holding RAM 66a and the clock state held in the clock frequency holding RAM 66b.

As described above, for example, in the case of 72 MHz (30 fps when all pixels are 1600 × 1200) with an ROI of 200 × 200 pixels, 180 fps.
The ROI speed changing unit 66d adjusts the clock so that the frame rate value calculated by the ROI speed determining unit 66c is optimized. Specifically, the clock is changed by the clock frequency setting unit 24 via the CPU 201. The clock frequency setting unit 24 outputs the change result to the clock 22 and supplies the imaging device drive circuit 21 with a clock frequency according to the frame rate changed by the clock 22.

The ROI speed changing unit 66d changes the clock based on the following determination.
That is, assuming that the number of pixels on the vertical side of the number of pixels held in the ROI size holding RAM 66a is V, the frequency held in the clock frequency holding RAM 66b is f, and the frame rate is R.
R = kf / V (1)
However, k is a constant determined from the image sensor performance, and in this example, k = 500.

here,
R = kf / V ≦ 40 [fps] (2)
F is variable so that
When V = 200 (the number of pixels is 200 × 200),
R = 500xf / 200 = 2.5f
Because
f ≦ 40 / 2.5 = 16 [MHz] (3)
It becomes.

Therefore, the ROI speed changing unit 66d instructs the clock frequency setting unit 24 to 16 MHz via the CPU 201. As a result, the frame rate at the time of ROI with 200 × 200 pixels is 40 fps.
However, in this example, since the frequency corresponding to “f” has been described as two choices of 36 MHz and 72 MHz, the ROI speed changing unit 66d sets the f value in the range of 0 to 36 MHz = 36 MHz, otherwise Control such as 72 MHz may be included.

Hereinafter, the operation of the microscope imaging apparatus 10 configured as described above will be described with reference to the flowchart of FIG.
The power is turned on with the power SW 60 of the microscope imaging apparatus 10 turned on (step S11). Next, when the ROI operation instruction (step S12) is executed by the user, ROI setting is performed on the position and the image size according to the operation instruction (step S13). This operation is performed by the photographing pixel range setting unit 25 described above. Next, the necessity of clock change is confirmed (step S14), and the clock is changed when necessary (step S15). This operation is performed by the ROI speed setting unit 66. The ROI setting depends on the user's operation, but as described above, it is assumed that the number of pixels is 200 × 200 at the upper left starting point (1000, 500) as shown in FIG. In this way, an optimal clock state is automatically selected according to the state of the ROI, and live display becomes possible.

  As described above, according to the microscope imaging apparatus according to the present embodiment, an optimal clock frequency corresponding to the observation state in the microscope is generated, and the imaging device is driven according to the generated clock frequency. Increase and noise generation in the image can be prevented. As a result, it is not necessary to make the device compatible with enormous power consumption, and the size of the device can be reduced. In addition, the occurrence of noise in the image can be prevented, so that the operability is improved.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described.
In the first embodiment described above, when the region of interest is set, the clock frequency is changed according to the size of the region of interest. In the present embodiment, in addition to the change of the clock frequency in the first embodiment, the clock is changed as necessary during the operation process for the microscope. Specifically, the clock frequency is reduced during the operation process for the microscope.

Specifically, the clock frequency changing operation in the present embodiment will be described with reference to the flowchart of FIG.
In step S21, the revolver information is input to the CPU 201 through the revolver hole position determination sensor 301 in the optical path in the microscope main body 1 after the live image display state with the power on. In step S22, if the objective lens is not correctly in the optical path based on the revolver information, the process proceeds to step S23 as the microscope is being operated, and the clock low speed setting is changed. Here, the change to the clock low speed setting means a change lower than the current state. For this reason, if the setting state by the clock frequency setting unit 24 is 72 MHz, it is changed to 36 MHz.

  In step S22, it is confirmed again whether the microscope operation processing is being performed after the clock frequency is changed. If the processing is still in progress, the clock frequency is changed again. However, in this embodiment, since the clock frequency is selected from 36 MHz and 72 MHz, if it is changed to 36 MHz once, it cannot be further reduced. In that case, it may be maintained (36 MHz).

When it is confirmed again whether the microscope operation process is being performed after the clock frequency is changed (step S22), if the microscope operation process is not being performed, the revolver information is sent to the CPU 201 through the revolver hole position determination sensor 301 in the optical path in the microscope body 1. If any objective lens is in the optical path, the process proceeds to step S24, and the clock high speed setting is changed.
In this case, the change to the clock high speed setting means an increase change from the current state. . Therefore, if the setting state by the clock frequency setting unit 24 is a 36 MHz state, it is changed to 72 MHz.

  In this way, when the operation process for the microscope is being performed, the clock frequency is controlled to be lowered, and when the operation process for the microscope is not being performed, the clock frequency is controlled to be increased. In this embodiment, the change of the objective lens is described, but other changes, for example, a microscope operation such as a microscope diaphragm operation, a stage operation, and an observation method switching operation may be included. The operation unit of the microscope may be electrically controlled.

  According to the present embodiment, in addition to the above-described effects, the operability is improved because the power consumption is reduced by the reduction of the clock frequency when the necessity for live observation such as during the operation of the microscope is low. In addition, if the operation unit of the microscope is electrically controlled, the electric control unit operates. That is, the power consumption upper limit of the microscope system is reduced by reducing the power consumption due to the camera clock reduction with respect to the power consumption increase of the microscope system. You can also.

(Third embodiment)
In this embodiment, when the change of the operation state with respect to the microscope has not occurred for a certain period, control is performed so as to reduce the clock frequency.
As shown in FIG. 18, the operation unit 4 according to the present embodiment is further provided with a microscope observation state grasping unit 67 in addition to the microscope imaging apparatuses according to the first and second embodiments described above. Is different.
The microscope observation state grasping unit 67 stores the microscope communication performed by the CPU main body 1 and the CPU 201 such as the objective lens change notification in the above-described second embodiment together with the communication occurrence time, so that the microscope operation state and the operation change time are stored. Can grasp the target interval.

Specifically, the clock frequency changing operation in the present embodiment will be described with reference to the flowchart of FIG.
In step S31, the power is turned on, and in step S32, a live image display state with a clock frequency of 72 MHz is set. If an operation on the microscope occurs during this time, the process proceeds to step S33, and the operation interval (no operation time) is notified to the CPU 201 by the microscope observation state grasping unit 67.
If it is determined in step S34 that 60 s has elapsed after the operation, the process proceeds to step S35, and control is performed to decrease the clock frequency.

  For example, when the frequency was 72 MHz after the microscope operation, the clock frequency is changed to 36 MHz when 60 seconds have elapsed after the operation. In this way, it is possible to control the clock to be lowered after the observation operation after the microscope operation is completed. Note that the time of 60 s after the operation may be changed by a MENU operation (not shown) in the operation unit 4.

  According to the microscope imaging apparatus according to the present embodiment configured as described above, the clock frequency is optimized according to the observation, for example, the clock frequency is increased during microscope observation and the clock frequency is decreased otherwise. Therefore, operability is improved.

(Modification of the third embodiment)
In the third embodiment described above, when the clock control is performed according to the change of the image, the time that becomes the clock change timing after the operation is set to a constant value such as 60 s. However, in this modification, this timing is changed to the image change. Control accordingly.

In this modification, a microscope observation state grasping unit 67 is provided, and the microscope observation state grasping unit 67 includes an in-observation determination unit 67b.
FIG. 16 shows a schematic configuration of the in-observation determination unit 67b. The observation determining unit 67b compares the image stored in the RAM with the N frame holding RAM 67c and the N + 1 frame holding RAM 67d that can alternately copy the image via the CPU 201 frame by frame, and determines whether there is any change. And a change determination unit 67e that can be determined. If the change determination unit 67e compares the images in the N frame holding RAM 67c and the N + 1 frame holding RAM 67d and determines that the images are the same, the change determination unit 67e notifies the microscope observation state grasping unit 67 that there is no image change, and the difference between the images. If it is determined that there is an image difference, the microscopic observation state grasping unit 67 is notified of “there is an image difference”.

  Here, the image change means that an observation image captured by the image sensor 20 is input to the CPU 201 and the in-observation determination unit 67 via the image processing unit 23 and the like, and via the camera head-operation display unit connection cable 7. This is a change in image information. An image at a certain time (this is N frame) is stored in the N frame holding RAM 67c, and the next frame image, that is, an N + 1 frame image is stored in the N + 1 frame holding RAM 67d. In this case, the image in the N frame holding RAM 67c is different from the image in the N + 1 frame holding RAM 67d.

  As an image difference detection method, after calculating the image luminance average values of the two images of the N frame holding RAM 67c and the N + 1 frame holding RAM 67d, and subtracting them, if 0, , “No image change”, “other than 0” means “image difference exists”, luminance value calculation for each pixel constituting the image, subtraction for each pixel, and if all pixels are 0, “image” There is a method of “no change” (in consideration of the noise component, not only the subtraction result 0 but also about 0, for example, when the luminance value is 255 gradations, less than 10 may be “no image change”).

Specifically, the clock frequency changing operation in this modification will be described with reference to the flowchart of FIG.
When the power is turned on in step S41, a live image display state is obtained at a clock frequency of 72 MHz in step S42. In step S43, if it is determined that a microscope operation has occurred during this time, the process proceeds to step S44, and the observation-in-progress determination unit 67b in the microscope observation state grasping unit 67 determines whether observation is in progress. When “no image change” is determined by the during-observation determination unit 67b (“Yes” in step S44), the process proceeds to step S45, and control is performed to decrease the clock frequency.
In this case, with respect to the third embodiment, the clock can be controlled to be lowered after the point in time when the observation operation of the microscope is completed more accurately.

As described above, various modifications can be made without departing from the scope of the present invention.
For example, although each embodiment has been described with the clock frequency being two choices of 36 MHz and 72 MHz, the types of the clock frequency and the changeable frequency may be different.

2 Camera Head 4 Operation Unit 5 Display Unit 10 Microscope Imaging Device 20 Image Sensor 22 Clock (Clock Generation Unit)
24 Clock frequency setting section (clock changing means)
25 Shooting pixel range setting section (region of interest setting means)

Claims (4)

An image sensor that captures an image of a subject and obtains the image;
A drive circuit for driving the image sensor;
Clock generation means for generating a clock frequency to be supplied to the drive circuit;
A region-of-interest setting means for setting a region of interest for an image captured by the image sensor;
Clock changing means for changing the clock frequency generated by the clock generating means in accordance with the size of the region of interest set by the region of interest;
A microscope imaging apparatus comprising: The microscope applied to the microscope imaging apparatus according to claim 1 includes a microscope observation state grasping unit for grasping an observation state of the microscope,
The microscope imaging apparatus according to claim 1, wherein the clock changing unit changes a clock frequency according to a result of the microscope observation state grasping unit.   3. The microscope imaging apparatus according to claim 2, wherein the clock changing unit sets a clock frequency lower than a predetermined clock frequency when the microscope observation state grasping unit determines that the microscope is being operated.   4. The microscope according to claim 2, wherein the clock changing unit sets a clock frequency lower than a predetermined clock frequency when the observation state of the microscope is determined to be unchanged for a predetermined period by the microscope observation state grasping unit. Imaging device.

Images