JP2023075680A - Optical apparatus, imaging system, and method for calculating correction amount in imaging system - Google Patents

Abstract

To provide an imaging device that reduces steep changes in an imaging range caused by updating an offset for a shake detection signal.SOLUTION: A second optical apparatus constituting part of an imaging system is capable of attaching a first optical apparatus including first shake detection means 125/134 for detecting a shake, offset value setting means 1261/1331, and shake correction means. The second optical apparatus includes second shake detection means 134/125 for detecting a shake and offset correction amount calculation means 1332/1267 for calculating an offset correction amount based on a detection result of the second shake detection means. When a first mode for performing continuous shooting is set, the offset correction amount calculation means 1332/1267 selects a calculation method to be used for calculating the offset correction amount from a plurality of calculation methods, based on information received from the first optical apparatus and indicating timing of updating an offset value set in the offset value setting means, and calculates the offset correction amount.SELECTED DRAWING: Figure 2

Description

The present invention relates to a technique for correcting image blurring of an imaging device, and more particularly to image blurring correction during continuous shooting.

2. Description of the Related Art There is a function of generating a panorama image using an imaging device equipped with an image blur correction device. When using this function to generate a panorama image, the photographer performs continuous shooting while panning at an arbitrary speed. The image pickup apparatus corrects the amount of image blurring corresponding to the panning motion and camera shake of the photographer during each exposure period during continuous shooting by image blur correction means, and obtains a panoramic image by synthesizing these photographed images (hereinafter referred to as this The shooting method is referred to as panorama shooting).

In order to obtain an image in which the panning motion and camera shake are accurately corrected using this panorama shooting function, it is required to accurately calculate the offset component of the shake detection signal used to calculate the image shake correction value.

Japanese Unexamined Patent Application Publication No. 2002-200001 discloses a function of correcting the output of a shake detection means provided in a lens device using a shake detection means provided in an imaging apparatus main body in order to accurately correct camera shake. In the image pickup apparatus disclosed in Patent Document 1, when the accuracy of the second shake detection means included in the image pickup apparatus is higher than that of the first shake detection means included in the lens device, the detection result of the second shake detection means A correction amount of the first detection signal detected by the first shake detection means is calculated based on. Then, it is proposed to perform image blur correction using the result of correcting the first detection signal with the calculated correction amount.

With the configuration as described above, it is possible to improve the image blur correction performance against the influence of the performance difference between the shake detection means provided in the lens device and the main body of the imaging device.

JP 2020-91355 A

However, depending on the shake detection means of the lens device or the imaging device, the estimated value of the offset component for the shake detection signal is updated (hereinafter referred to as "offset update") during continuous shooting, resulting in sharp fluctuations in the shooting range. I have something to do.

For example, some shake detection means have a large error in the shake detection signal after the imaging apparatus is started, depending on the operation and handling of the photographer. When such a detection means is used, an offset update to the shake detection signal may be performed after the shake detection signal has an arbitrary error. At that time, as in the prior art disclosed in the above-mentioned Patent Document 1, if image blur correction is performed using the correction amount of one shake detection signal based on the other shake detection signal, the offset component can be estimated. A sharp change in the value may cause a sharp change in the imaging range.

In particular, in panoramic photography, the continuous shooting time is often long, and there is a high possibility that the offset will be updated during continuous shooting, so countermeasures are required.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide an image pickup apparatus that reduces sharp changes in the image pickup range caused by the offset update of the shake detection signal.

An optical apparatus as one aspect of the present invention configures an imaging system capable of continuous shooting, and includes first shake detection means for detecting shake, offset value setting means, and the first shake detected by the first shake detection means. A first optical device comprising: a first communication means; a second optical apparatus comprising: second communication means for receiving information indicating update timing of the offset value set in the offset value setting means from the first communication means; and detecting shake. offset correction based on the second shake detection means, the information indicating the update timing of the offset value received by the second communication means, and the second shake detection signal detected by the second shake detection means; and offset correction amount calculation means for calculating the offset correction amount, and when a first mode in which continuous shooting is performed is set, the offset correction amount calculation means performs the first calculation method and the first calculation method. selects a calculation method used for calculating the offset correction amount from a plurality of calculation methods including a different second calculation method, based on information indicating update timing of the offset value; , the offset correction amount is calculated based on the selected calculation method.

Other aspects of the present invention will be clarified in the embodiments described below.

According to the present invention, when the offset component included in the detection result of the shake detection means is estimated, and the image blur correction is performed using the detection result and the estimation result, a steep image caused by updating the offset to the shake detection signal is corrected. Angular misalignment can be reduced.

Block diagram showing a configuration example of an imaging device 3 is a block diagram showing a configuration example related to image blur correction control in the first embodiment; FIG. Flowchart related to image stabilization settings for panorama shooting Diagram for explaining the exposure timing and the position of the image stabilization lens during panorama shooting Flowchart relating to calculation of offset correction amount of lens shake detection signal (A) A diagram explaining a method of calculating the offset correction amount on the lens side when it is not the offset update timing (B) A diagram explaining a method of calculating the offset correction amount on the lens side when it is the offset update timing Diagram related to shake offset correction amount calculation timing during panorama shooting FIG. 5 is a block diagram showing a configuration example related to image blur correction control according to the second embodiment; Flowchart relating to calculation of offset correction amount for camera shake detection signal (A) A diagram explaining a calculation method of the offset correction amount on the camera side when it is not the offset update timing (B) A diagram explaining a calculation method of the offset correction on the camera side when it is the offset update timing

Preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.

It should be noted that the following embodiments do not limit the invention according to the scope of claims.

Although multiple features are described in the embodiments, not all of these multiple features are essential to the invention, and multiple features may be combined arbitrarily.

Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and duplicate descriptions are omitted.

(First embodiment)
In the present embodiment, a method for acquiring the shake correction amount during panorama shooting will be described. FIG. 1 is a block diagram showing the configuration of an imaging device (imaging system) that is an embodiment of the imaging device (imaging system) of the present invention. The imaging apparatus of this embodiment is a lens-interchangeable imaging apparatus, and is composed of an imaging apparatus main body (hereinafter referred to as a camera main body) 1 and a lens device 2 that can be attached to the camera main body. The lens device 2 has an imaging optical system 200 . The imaging optical system 200 has a zoom lens 101 , an image blur correction lens 102 , a focus lens 103 and a diaphragm 104 . The zoom lens 101 moves in the optical axis direction to optically change the focal length of a photographing optical system (photographing lens) 200 that forms a subject image, thereby changing the photographing angle of view. The image blur correction lens 102 moves in a direction perpendicular to the optical axis, thereby optically correcting image blur caused by shake of the imaging device. The focus lens 103 optically adjusts the focus position by moving in the optical axis direction. A diaphragm 104 and a shutter 105 can adjust the amount of light by opening and closing, and are used for exposure control.

A diaphragm driver 120 and a shutter driver 135 drive the diaphragm 104 and the shutter 105 . A zoom lens driving unit 124 drives the zoom lens 101 to change the angle of view. A zoom lens control unit 127 performs position control of the zoom lens 101 according to a zoom operation instruction from the operation unit 114 . A focus lens driving unit 121 drives the focus lens 103 .

Light that has passed through the imaging optical system 200 is received by an imaging device 106 using a CCD (charge-coupled device), a CMOS sensor (complementary metal oxide semiconductor), or the like, and is converted from optical signals to electrical signals. The AD converter 107 performs noise removal processing, gain adjustment processing, and AD conversion processing on the imaging signal read out from the imaging element 106 .

The timing generator 108 controls the driving timing of the image sensor 106 and the output timing of the AD converter 107 according to the command from the camera control unit 115 . The image processing circuit 109 applies pixel interpolation processing, color conversion processing, and the like to the output from the AD converter 107 , and then sends the processed image data to the internal memory 110 .

In the panorama shooting function, the image processing circuit 109 performs processing for creating panorama image data from a plurality of images. Specifically, it includes a positioning circuit for a plurality of consecutively shot images, a geometric transformation circuit for cylindrical coordinate transformation and lens distortion correction, a synthesizing circuit for trimming and synthesizing processing, and the like. Since the operation of each circuit is known, detailed description thereof will be omitted.

A display unit 111 displays image data held in the internal memory 110 as well as shooting information and the like. A compression/decompression processing unit 112 performs compression processing or decompression processing on the data stored in the internal memory 110 according to the image format.

A storage memory 113 stores various data such as parameters. The operation unit 114 is a user interface for the user to perform various menu operations and mode switching operations.

The camera control unit 115 is composed of an arithmetic unit such as a CPU (Central Processing Unit), and executes various control programs stored in the internal memory 110 according to user's operations through the operation unit 114 . The control program is, for example, a program for performing zoom control, image blur correction control, automatic exposure control, automatic focus adjustment control, and processing for detecting the face of a subject.

In the case of a lens-interchangeable camera, the camera-side communication section 140 and the lens-side communication section 128 perform information transmission between the camera and the lens.

A luminance signal detection unit 137 detects a signal read from the image sensor 106 in a photographing preparation state (a so-called live view state) and passed through the AD converter 107 as luminance of an object and a scene. The exposure control unit 136 calculates the exposure value (aperture value and shutter speed) based on the luminance information obtained by the luminance signal detection unit 137, and sends the calculation result to the camera side communication unit 140 and the lens side communication unit 128. and to the aperture driving unit 120 and the shutter driving unit 135. At the same time, the exposure control unit 136 also performs control for amplifying the imaging signal read out from the imaging device 106 . Thereby, automatic exposure control (AE control) is performed.

The evaluation value calculation unit 138 extracts a specific frequency component from the luminance information obtained by the luminance signal detection unit 137, and then calculates a contrast evaluation value based thereon. The focus lens control unit 139 instructs the focus lens driving unit 121 via the camera side communication unit 140 and the lens side communication unit 128 to drive the focus lens 103 over a predetermined range with a predetermined driving amount. At the same time, an evaluation value, which is the calculation result of the evaluation value calculator 138 at each focus lens position, is acquired. As a result, the defocus amount in the contrast AF method is calculated from the focus lens position at which the change curve of the contrast evaluation value reaches the peak, and the focus lens drive unit 128 is notified of the defocus amount. Automatic focus control (AF control) is performed to focus the light flux on the surface of the image sensor 106 by driving the focus lens drive unit 128 to the defocus position. Although the contrast AF method has been described here, a phase difference AF method may also be used. Since the content of the phase difference AF method is already known, it will be omitted.

Shake detectors (134, 125) detect shakes and shakes applied to the imaging device. Aside from the camera-side vibration detection section 134 arranged on the camera side, a lens-side vibration detection section 125 is also arranged on the lens side to detect the vibration of the vibration applied to the lens. A gyro sensor, which is an angular velocity sensor, is generally used as a sensor for detecting vibration, and detects the angular velocity of vibration.

The image blur correction lens vibration reduction control unit 126 suppresses vibration using the image blur correction lens based on the vibration detection signal detected by the lens side vibration detection unit 125, the camera side vibration detection unit 134, or both. Calculate the amount of correction. Then, based on the calculated lens shake correction amount and the position of the image blur correction lens 102 detected by the image blur correction lens position detection unit 123, a drive signal for the image blur correction lens is transmitted to the image blur correction lens drive unit 122. By doing so, image stabilization by the image stabilization lens is controlled. The image blur correction lens drive unit 122 drives the image blur correction lens in a direction perpendicular to the optical axis based on the image blur correction lens drive signal received from the image blur correction lens vibration reduction control unit 126 . The details of the method of controlling vibration reduction using the image blur correction lens will be described later.

The image stabilization control unit 133 performs image sensor shake correction for suppressing shake using the image sensor based on shake detection signals detected by the camera side shake detection unit 134, the lens side shake detection unit 125, or both. Calculate quantity. Then, based on the calculated correction amount and the position of the image pickup device 106 detected by the image pickup device position detection unit 132, a drive signal for the image pickup device is sent to the image pickup device drive unit 130, thereby controlling image stabilization by the image pickup device. do. The image pickup device drive unit 130 drives the image pickup device 106 in a direction perpendicular to the optical axis based on the image pickup device drive signal received from the image stabilization control unit 133 . However, in the present embodiment, it is assumed that during panorama shooting, image stabilization by the image pickup device is stopped by fixing the reference position of the image pickup device, and vibration during panorama shooting is corrected using an image blur correction lens. Therefore, the details of the image stabilization control method using the imaging element are omitted. The reference position may be any position, for example, the center position of the movable range of the image sensor, the position where the center of the effective area overlaps with the optical axis of the imaging optical system provided in the lens device, or other position. location is fine. The motion vector detection unit 131 calculates the correlation value between the current frame and the previous frame for each block obtained by dividing the frame by the block matching method. After that, the block of the previous frame with the smallest calculation result is searched, and deviations of other blocks with respect to that block are detected as motion vectors.

FIG. 2 is a block diagram showing a configuration example of the image blur correction lens stabilization control unit 126 and the imaging stabilization control unit 133 in this embodiment.

First, the configuration of the image blur correction lens anti-vibration control unit 126 on the lens device side will be described. The image blur correction lens vibration reduction control unit 126 has a lens offset determination unit 1261 that determines an estimated offset value (hereinafter referred to as an offset value) included in the lens shake detection signal from the lens side shake detection unit. The lens offset determination unit 1261 is a setting unit that determines an offset value based on the lens shake detection signal from the lens side shake detection unit 125 and holds the offset value to set the offset value. This offset value is updated when a predetermined condition is satisfied after activation, and the offset value is not updated until the predetermined condition is satisfied. After startup, the offset value is not updated until the update conditions are satisfied, and an arbitrary initial value is set. As a method of determining the offset value, for example, the value α1 indicated by the current gyro detection result is held as a temporary offset value, and the difference (α2- A process for judging arbitrary stability is performed for α1). Filtering or the like may be used to determine stability. This is performed every time the detection result of the gyro is obtained, and if an arbitrary stability condition is satisfied within a predetermined period, it is determined that the update condition is satisfied, and the provisional offset value α1 is determined and set as the offset value. If any stability condition is not satisfied for a predetermined period of time, the value indicated by the gyro detection result at another timing is used to similarly determine the offset value. Also, by performing this periodically, the offset value is updated. The offset update timing notification unit 1262 detects the timing when the lens offset determination unit 1261 determines the offset value and updates (reflects) the offset value. Then, the timing (update timing of the offset value) is notified to the camera body 1 side via the lens side communication section 128 and the camera side communication section 140 .

An integration/LPF unit 1263 is an integrator or an LPF (low-pass filter) for increasing the dimension of the lens shake detection signal indicating the angular velocity to the shake angle by one. In this block diagram, the integration/LPF unit 1263 subtracts the offset value determined by the lens offset determination unit 1261 and the lens offset correction amount described later from the lens shake detection signal detected by the lens shake detection unit. Then, the corrected lens shake signal is input. Then, the corrected lens shake signal is integrated or LPF-processed to generate a lens shake angle signal.

A shake correction amount calculation unit 1264 calculates a lens shake correction amount that is corrected by image stabilization by the image blur correction lens 102 by integrating gains related to zoom magnification (focal length) and object distance with respect to the lens shake angle signal. I do.

The position control unit 1265 performs PID control (ratio control, integral control, and fine control). The deviation between the target position and the current position is converted into an image blur correction lens driving signal and input to the image blur correction lens driving section 122 . The current position is the detection result of the image blur correction lens position detector 123 . Since PID control is a common technique, detailed description is omitted. The image blur correction lens drive unit 122 is an actuator such as a voice coil motor or an ultrasonic motor, and drives (displaces) the image blur correction lens 102 according to an image blur correction lens drive signal input from the position control unit 1265 . Next, the imaging stabilization control unit 133 on the imaging apparatus main body side will be described. As described above, the image stabilization control block 133 can perform image blur correction using the image sensor by driving the image sensor 106, but stops image shake correction during panorama shooting. Therefore, here, from the lens shake detection signal that is the output of the lens side shake detection unit 125, the lens offset correction amount involved in obtaining the corrected lens shake signal that is the signal that is input to the integration/LPF unit. The functional blocks involved in the calculation will be explained.

The camera offset determination unit 1331 calculates an estimated value of the offset included in the output signal of the shake detection unit on the camera side (hereinafter, offset (called a value) is determined and held. Thereby, the offset value on the camera side can be set. Instead of determining the offset value of the camera based on the difference or the like, the camera offset determination unit 1331 may hold the value determined in the process before shipping the camera as the offset value of the camera. For example, the stationary output may be measured in a process before shipping, and the stationary output may be stored in a memory of the camera body as an offset value on the camera side. By subtracting the offset value on the camera side held by the camera offset determination unit 1331 from the camera shake detection signal detected by the camera shake detection unit 134 using the subtracter, the offset component included in the camera shake detection signal is obtained. remove and obtain the camera shake signal. In this embodiment, it is assumed that the offset value is obtained with higher accuracy than the offset determination unit 1261 on the lens side.

The lens offset correction amount calculation unit 1332 is a block that calculates the lens offset correction amount for correcting the current offset value on the lens side that is determined by the lens offset determination unit and used for the lens shake detection signal. The lens offset correction amount calculation unit 1332 changes the calculation method of the lens offset correction amount depending on whether it is the timing when the offset value on the lens side is updated. Whether or not it is the offset update timing is determined based on the output from the offset update timing notification section 1262 received via the lens side communication section 128 and the camera side communication section 140 .

The lens offset correction amount calculation unit 1332 calculates the lens offset correction amount based on the uncorrected camera shake signal at the timing when the offset value on the lens side is updated. A camera shake signal before correction refers to an output signal of a subtracter that subtracts an offset value on the camera side from a camera shake detection signal. On the other hand, the lens offset correction amount calculation unit 1332 performs processing for calculating the offset correction amount from the uncorrected lens shake signal and the camera shake signal when the offset value on the lens side is not updated. A method for calculating the lens offset correction amount will be described later in detail. The lens shake signal before correction is a signal obtained by subtracting the offset value determined by the lens offset determination unit 1261 from the lens shake detection signal detected by the lens shake detection unit 125 .

In this way, the offset component included in the lens shake detection signal that is the output of the lens shake detection unit 125 is the set value of the lens offset determination unit 1261 and the correction amount of the lens offset value determined by the lens offset correction amount calculation unit 1332. is removed by

Next, the process of changing the setting of the image blur correction control during panorama shooting in this embodiment will be described with reference to FIG.

First, in step S301, it is determined whether or not the power of the camera is ON. If the power is ON (step S301, Yes), the process proceeds to step S302. If the power is OFF (step S301, No), the process of changing the image blur correction setting is terminated.

In step S302, the shooting mode setting of the imaging device is confirmed. If the panorama shooting mode is set here (step S302, Yes), the process proceeds to step S303.

In step S303, pan control in image blur correction control is disabled. Pan control refers to control that weakens the effect of image blur correction control when panning by the photographer is detected, in order to allow an intentional change in the imaging range accompanying panning. In panorama photography, a photographer performs panning to perform exposure (continuous photography) a plurality of times while changing the photography range, and synthesizes the exposures to generate a composite image (panoramic image). Therefore, if the image blur correction is not performed or the effect is weakened, depending on the exposure time and panning amount, the change in the shooting range due to panning performed during one exposure may cause image blur in the generated panorama image. It may appear. Therefore, in the present embodiment, the pan control is disabled in order to correct as much as possible the amount of change in the photographing range that accompanies panning during one exposure by image blur correction. After the process of step S303 is completed, the process proceeds to step S304.

In step S304, the LPF is set so that the integration characteristic of the integration/LPF unit 1263 during exposure becomes a complete integration or a characteristic close to it. The reason is that, as described in step S303, the amount of change in the photographing range due to panning during exposure by the photographer is corrected by image blur correction as much as possible.

In addition, in this step, during the non-exposed period between multiple exposures (referred to as inter-frame), the image stabilization lens is moved to the center position of the movable range (centering), and during the non-exposed period It is fixed at that position and set so that image blur correction is not performed. This is achieved by setting the amount of lens shake correction between frames to be fixed at zero.

FIG. 4 shows the positional relationship between the exposure timing and the image blur correction lens during panorama shooting that can be realized by changing the settings in steps S303 and S304. A description of FIG. 4 is provided below.

In FIG. 4, the horizontal axis represents time, and the vertical axis represents exposure timing and the position of the image blur correction lens 102 in continuous shooting for panorama shooting.

In FIG. 4, first, from time t1 to time t2, from time t4 to time t5, and from time t7 to time t8 are respective exposure periods, during which all changes in the photographing range due to camera shake and panning are corrected. Assuming that the panning direction in which the imaging apparatus is shaken is constant, the position of the image blur correction lens 102 increases monotonically.

After each exposure is completed, centering processing is performed from time t2 to time t3, from time t5 to time t6, and from time t8 to time t9 to return the image blur correction lens 102 moved toward the movable end during exposure to the center. This reduces the risk that the image blur correction lens 102 will hit the movable end at the start of the next exposure and the image blur cannot be corrected. During the centering process, the moving image blur correction lens 102 causes a variation in the shooting range, so it is desirable to display the live view display in blackout or the immediately preceding captured image.

Each time from time t3 to time t4, from time t6 to time t7, and from time t9 to time t10 from the end of the centering process to the start of the next exposure is an exposure waiting period. During this time, the image blur correction lens 102 is fixed at the center and waits for stabilization of blur correction control.

By performing the above control, it is possible to realize driving of the image blur correction lens 102 suitable for panoramic photography. The description of FIG. 4 is finished above, and the description of the flowchart of FIG. 3 is returned to.

After the process of step S304 is completed, the process proceeds to step S305. In step S305, processing is performed to enable default communication (referred to as panorama control communication) for performing image blur correction control during panorama shooting.

Here, the panorama control communication process will be explained using FIG.

FIG. 5 shows the relationship between the lens device and the imaging apparatus main body performed by the image stabilization lens stabilization control unit 126 and the imaging stabilization control unit 133 before the start of shooting or between exposures during continuous shooting. Communication processing and arithmetic processing are represented.

First, processing performed by the image blur correction lens image stabilization control unit 126 will be described. In step S501, a pre-correction lens shake signal is generated by subtracting the set value of the lens offset determination unit 1261 from the lens shake detection signal acquired by the shake detection unit 125 on the lens side. After step S501 ends, the process proceeds to step S502.

In step S502, the uncorrected lens shake signal obtained in step S501 and information indicating the offset update timing indicating whether or not the offset value on the lens side from the offset update timing notification unit 1262 is updated are received. , the lens-side communication means 128 and the camera-side communication section 140 to transmit to the camera side. After completing the process of step S502, the process proceeds to step S503.

In step S503, the lens offset correction amount transmitted from the camera body in step S515, which will be described later, is received and used to calculate the lens shake correction amount as the correction amount for the uncorrected lens shake detection signal used in the next exposure. Specifically, as described above, the set value of the lens offset determination unit 1261 and the received lens offset correction amount are subtracted from the lens shake detection signal acquired from the shake detection unit 125 on the lens side. As a result, the corrected lens shake signal is acquired, the corrected lens shake signal is converted into a lens angle signal, and the lens shake correction amount is calculated. When the process of step S503 ends, the panorama control communication ends.

Next, the processing on the imaging device main body side will be described. This processing is performed by the imaging stabilization control unit 133 . First, in step S511, a camera shake signal is generated by subtracting the set value of the camera offset determination unit 1331 from the camera shake detection signal acquired by the camera-side shake detection unit 134. FIG.

After the process of step S511 is completed, the process of acquiring the information indicating the lens shake signal before correction and the offset update timing transmitted by the lens apparatus in step S502 is performed in step S512. After the process of step S512 is completed, the process of step S513 is performed.

In step S513, the information indicating the offset update timing acquired in step S512 is referenced to determine whether or not the lens offset is updated. If it is not the lens offset update timing (S513, No), the process proceeds to step S516, and the lens offset correction amount calculation unit 1332 calculates the lens offset correction amount based on the difference between the lens shake signal before correction and the camera shake signal. decide.

On the other hand, if it is the lens offset update timing (S513, Yes), the process proceeds to step S514, and the lens offset correction amount calculation unit 1332 determines the lens offset correction amount based on the camera shake signal.

After completing the process of step S514 or step S516, the process advances to step S515 to transmit the lens offset correction amount obtained in each step to the lens apparatus.

When the process of step S515 ends, the panorama control communication process on the camera side ends.

According to the flow described above, it is possible to set an appropriate lens offset correction amount before the start of exposure according to the update timing of the offset value on the lens side. If the lens offset correction amount set here is not updated by the start of the next exposure period, it will be used to calculate the shake correction amount during the next exposure period. A detailed method for acquiring the correction amount of the lens offset correction amount obtained in steps S414 and S416 will be described later.

The description of FIG. 5 is finished above, and the description of FIG. 3 is returned to. When step S305 ends, the process of changing the image blur correction setting when the panorama shooting mode is set ends. In this panorama control communication, when the panorama shooting mode is set, the panorama control communication in step S305 is repeated at a predetermined cycle even after the end of the image blur correction setting change process.

Processing when the panorama shooting mode is not set will be described. In step S302, if the mode is set to other than the panorama shooting mode (step S302, No), the process proceeds to step S306, and processing to enable pan control is performed. This is because in applications other than panorama shooting, it is considered better to weaken the image blur correction in order to follow the change in the shooting range intended by the photographer due to panning. After completing the process of step S306, the process proceeds to step S307.

In step S307, the integration characteristic of the integration/LPF unit 1263 during exposure is set. The integration characteristic is appropriately set according to the current shooting mode and shooting settings. Also, immediately after switching from panorama shooting mode to another mode, if the setting for the amount of correction between frames is set to 0, cancel the setting and adjust to the current shooting mode and shooting settings. to set the anti-shake control between frames as appropriate.

After completing the process of step S307, the process proceeds to step S308.

In step S308, processing for terminating default communication for image blur correction during panorama shooting is performed. If the default communication for panorama shooting has not already been performed, nothing needs to be done. When step S308 ends, the image blur correction setting change processing ends.

Next, calculation processing of the lens offset correction amount performed by the lens offset correction amount calculation unit 1332 in steps S514 and S516 will be described with reference to FIG.

FIG. 6 is a diagram showing the relationship between the lens offset correction amount set in steps S514 and S515 and the blurring amount at the next exposure.

In FIGS. 6A and 6B, the horizontal axis indicates time, and the vertical axis indicates the strength of the lens shake signal and camera shake signal before correction. 6A corresponds to the calculation of the lens offset correction amount in step S516, and FIG. 6B corresponds to the calculation of the lens offset correction amount in step S514. As a premise, under the conditions of the present embodiment, it is assumed that the camera shake signal has less offset shift (the influence of the offset included in the shake signal) than the lens shake signal before correction.

The lens offset correction amount calculated in step S516 will be described below with reference to FIG. A broken line L1 indicates a lens shake signal before correction, and a broken line L2 indicates a camera shake signal. The lens shake signal before correction indicated by the dashed line L1 is obtained by subtracting the set value of the lens offset determination unit 1261 from the output of the lens side shake detection unit 125 . Similarly, the camera shake signal indicated by the dashed line L2 is obtained by subtracting the set value of the camera offset determination unit 1331 from the output of the camera side shake detection unit 134 .

Let ω(t) be a shake signal to be subjected to image shake correction. It is assumed that the accuracy of the offset value on the camera side is high, and the error between ω(t) and the camera shake detection signal is suppressed within a predetermined range and can be ignored. Referring to FIG. 6A, the shake signal ω(t) to be subjected to image shake correction can be formulated as follows using the uncorrected lens shake signal ωLexp during exposure.
ω(t)=ωLexp(t)−(ωL−ωc) Equation (1)

This is represented by a solid line L3.

Here, ωL is a lens shake signal before correction, ωc is a camera shake signal, and data before the exposure start time Texp in time series are used. As described above, in the present embodiment, the lens offset correction amount is ωL-ωc. Therefore, the lens offset correction amount calculation unit 1332 subtracts the camera shake signal ωc from the uncorrected lens shake signal ωL acquired from the lens device side via the camera side communication unit 140, thereby calculating the lens offset correction amount. get. As long as the value is close to ωL−ωc, the offset correction amount may be a value obtained by finely adjusting ωL−ωc by using an adjustment value according to the configuration of the imaging device.

Next, the lens offset correction amount calculated in step S514 will be described with reference to FIG. 6B.

A broken line L4 indicates a lens shake signal before correction, and a broken line L5 indicates a camera shake signal. The lens shake signal before correction indicated by the dashed line L4 is obtained by subtracting the set value of the lens offset determination unit 1261 from the output of the lens side shake detection unit 125 . Similarly, the camera shake signal indicated by the dashed line L2 is obtained by subtracting the value of the camera offset determination unit 1331 from the output of the camera side shake detection unit 134 .

It is assumed that the set value (offset value) is updated by the lens offset determination unit 1261 at time Tf. The timing at which the offset value on the lens side is updated is hereinafter referred to as update timing. The uncorrected lens shake signal indicated by the dashed line L4 is abruptly returned to near 0 at time Tf, which is the update timing. As exemplified in the description of the lens offset determination unit 1261, the offset value is 0 when the offset value is subtracted from the current (Tf) lens shake detection signal based on the lens shake detection signal for a certain period. This is because it is set to a value close to that. This occurs when a predetermined lens-side offset value update condition is met. The calculation method of formula (1) can also be applied near time Tf, which is the update timing. It may become stable. As a result, it may not be possible to accurately correct the amount of change in the imaging range due to camera shake or panning with the offset correction amount obtained by equation (1).

Therefore, in this embodiment, when the setting value of the lens offset determination unit 1261 is updated, the shake signal ω(t) to be subjected to image shake correction is obtained using the following equation (2).

From FIG. 6B, the shake signal ω(t) to be subjected to image shake correction can be formulated as follows using the uncorrected lens shake signal ωLexp during exposure.
ω(t)=ωLexp(t)+ωc Equation (2)

This is represented by a solid line L6.

Here, ωc is a camera shake signal, and data prior to the exposure start time Texp in time series is used. From the above, the offset correction amount on the lens side is assumed to be -ωc. As in step S516, a finely adjusted value of -ωc may be used as the offset correction amount.

In this way, by obtaining the offset correction amount on the lens side based on the camera shake signal instead of the difference between the lens shake signal before correction and the camera shake signal, the offset value on the lens side is updated at the timing when the offset value on the lens side is updated. Even if there is, image blurring can be reduced with high accuracy.

Further, it is considered that the magnitude of image blur caused by offset update depends on the amount of change in the lens shake signal before correction before and after the offset update and the magnitude of the difference (ωL−ωc) from the camera shake signal. Therefore, whether or not to apply equation (2) when updating the offset is determined based on the magnitude of the lens shake signal at the start of shooting, the magnitude of the lens shake signal during shooting, the magnitude of the camera shake signal during shooting, and the like. It shall be acceptable.

FIG. 7 is a diagram showing the relationship between the exposure timing and the communication timing for calculating the offset correction amount and for notifying the calculated offset correction amount in the panorama control communication according to the present embodiment.

FIG. 7 shows an example in which five images are taken by panorama shooting and then panorama synthesized. A period during which the imaging readout timing is High outside the panorama shooting period indicates a live view image readout period. In FIG. 7, after the readout of the live view image is performed twice, the readout for panorama shooting is performed five times.

During live view, the calculation of the lens offset correction amount by the lens offset correction amount calculation unit 1332 and the communication for notifying the calculated offset correction amount are performed at regular intervals. Then, in order to calculate the offset correction amount on the lens side, lens offset update information and time-series synchronized lens shake signal and camera shake signal before correction are also acquired at a constant cycle. During the live view period before exposure, the lens offset correction amount calculation unit 1332 calculates the lens offset correction amount using Equation (1) described above.

When the first exposure in panorama shooting starts, the lens device determines the offset value on the lens side set in the lens offset determination unit 1261 just before the start of exposure and the offset value sent from the camera side before the start of exposure. A corrected lens shake signal is acquired using the latest value of the offset correction amount and the lens shake detection signal during the exposure period. Then, based on this, the amount of lens shake correction is calculated, and image blur correction using the image blur correction lens is performed. After the first exposure is completed, communication is started again. Then, the lens offset correction amount calculation unit 1332 of the camera body 1 acquires the lens offset update information, the lens shake detection signal before correction and the camera shake detection signal synchronized in time series, and calculates the offset correction amount on the lens side. is calculated and a process of notifying the lens apparatus 2 is performed. This processing is performed between frames, and the timing of execution may be determined according to the communication cycle between the lens device and the camera body or the continuous shooting interval of panorama shooting, and may be performed multiple times during one frame. FIG. 7 basically shows an example in which this process is performed three times between frames.

Calculation processing of the offset correction amount before exposure and between frames is performed using the above formulas (1) and (2), and the lens offset update information received from the lens is updated when the offset value on the lens side is updated. , the offset correction value is calculated using equation (2). The timing at which the offset correction value is calculated using Equation (2) is indicated by * in FIG.

At the timing when the offset value on the lens side is updated, the number of communications between frames and the number of calculations of the offset correction amount may be changed from the timing when the offset value is not updated. In this embodiment, in order to fix the offset correction amount on the lens side determined at the timing indicated by * (method of formula (2)) until the next exposure starts, the offset correction amount on the lens side after this is fixed. I am trying to stop calculation and update.

Conversely, the number of times of communication may be increased. Depending on the number of communications, the lens offset correction amount is calculated using the camera side shake detection signal near the lens offset update timing in chronological order, or the lens side offset correction amount is calculated using the camera side shake detection signal close to the next exposure. can be calculated or selected.

In this embodiment, the method of calculating and acquiring the offset correction amount when the panorama mode is set has been described, but the imaging apparatus of this embodiment can also shoot in modes other than the panorama mode. For example, it is possible to operate in a general single-shot mode in which when the release button is pressed once, one exposure is performed and one image is acquired. In this case, there is little possibility that a slight shift in the shooting range between continuous shots will become a problem, so there is no need to change the calculation method of the offset correction amount depending on whether it is time to update the offset value. For example, the method of equation (1) may always be selected to calculate the offset correction amount. In addition, even in a mode that does not synthesize images obtained by continuous shooting, there is a lower possibility that a slight shift in the shooting range will cause a problem than in a mode that stitches and synthesizes a plurality of images, such as the panorama mode. Therefore, it is not necessary to change the calculation method of the offset correction amount depending on whether it is the update timing of the offset value or not, as in the single shooting mode. For example, the method (1) is always selected to calculate the offset correction amount. good too.

Further, when the calculation method of the offset correction amount is not changed in accordance with the update timing of the offset value in this way, the lens device 2 side including the offset value setting means transmits the update timing of the offset value to the camera body 1 side. You don't have to. However, in a form in which information about the shooting mode of the camera body 1 cannot be acquired, the update timing of the offset value may always be transmitted regardless of the shooting mode.

(Second embodiment)
An imaging apparatus according to a second embodiment of the present invention will be described below. The imaging apparatus of this embodiment is basically the same as that of the first embodiment, except that the roles of the camera body 1 and the lens apparatus 2 in the image blur correction processing when the panorama mode is set are opposite to those of the first embodiment. It is the same as the first embodiment. That is, in the panorama mode, the camera body side moves the imaging element to correct image blur, sets the offset value, and transmits information indicating the update timing of the offset value to the lens device. Then, based on the information indicating the update timing received from the camera body side, the lens device side selects a suitable calculation method from a plurality of calculation methods, calculates the offset correction amount, and transmits it to the camera body side.

Details of the present embodiment will be described below. Since the configuration of the imaging apparatus of this embodiment is the same as that of FIG. 1, detailed description thereof will be omitted. In FIG. 1, the image pickup device driving unit 130 optically corrects image blur by moving the image pickup device 106 in a direction perpendicular to the optical axis. As described in the first embodiment, the image stabilization control unit 133 calculates an image blur correction amount for suppressing shake. Then, an image pickup device drive signal based on the calculated image shake correction amount and the position of the image pickup device 106 detected by the image pickup device position detection unit 132 is transmitted to the image pickup device drive unit 130, thereby controlling image stabilization by the image pickup device. do. Further, in this embodiment, the image sensor 106 is used to correct vibration during panorama shooting, and the vibration correction by the image blur correction lens is stopped by fixing the image blur correction lens 102 at the reference position. . The reference position may be any position, for example, the center position of the movable range, or the position where the optical axis of the photographing optical system coincides with the center of the mount of the camera body.

FIG. 8 is a block diagram showing a configuration example of the image blur correction lens stabilization control unit 126 and the imaging stabilization control unit 133 in this embodiment. As described above, the camera body side sets the offset value and notifies the other side of the update timing of the offset value, and the lens device side calculates the offset correction amount. First, the configuration of the imaging stabilization control unit 133 on the camera body side will be described. The configuration of the imaging stabilization control unit 133 of this embodiment is basically the same as the configuration of the lens stabilization control unit 126 of the first embodiment. The imaging stabilization control unit 133 has a camera offset determination unit 1331 that determines the offset value included in the camera shake detection signal from the camera side shake detection unit 134 . The camera offset determination unit 1331 is a setting unit that determines an offset value based on the camera shake detection signal from the camera-side shake detection unit 125 and holds the offset value to set the offset value. This offset value is updated when a predetermined condition is satisfied after activation, and the offset value is not updated until the predetermined condition is satisfied. After startup, the offset value is not updated until the update conditions are met, and an arbitrary initial value is set. Since the method of determining the offset value is the same as in the first embodiment, the description is omitted.

The offset update timing notification unit 1337 detects the timing when the camera offset determination unit 1331 determines the offset value and updates the offset value, and transmits the timing to the lens via the camera side communication unit 140 and the lens side communication unit 128. Notify the device.

Like the integration/LPF unit 1263, the integration/LPF unit 1334 is an integrator or LPF for increasing the dimension of the shake detection signal indicating the angular velocity to the shake angle by one. The camera shake detection signal itself detected by the camera shake detection unit 134 is input to the integration/LPF unit 1334, but the corrected camera shake detection signal is input. In this block diagram, the camera shake detection signal after correction means the offset value determined by the camera offset determination unit 1331 from the camera shake detection signal detected by the camera shake detection unit 134, and the camera offset correction amount described later. is the subtracted signal. A camera shake angle signal is generated by integrating or LPF-processing the corrected lens shake signal.

A shake correction amount calculation unit 1335 calculates a camera shake correction amount that is corrected by image stabilization by the image sensor 106 by multiplying the camera shake angle signal by gains related to the zoom magnification and the object distance.

The position control unit 1336 performs PID control (ratio control, integral control, fine control). The deviation between the target position and the current position is converted into an imaging device driving signal and input to the imaging device driving section 130 . The current position is the detection result of the image sensor position detection section 132 . Since PID control is a common technique, detailed description is omitted.

The image pickup device driving unit 132 drives (displaces) the image pickup device 106 according to the image pickup device drive signal.

Next, the image blur correction lens anti-vibration control unit 126 on the lens device side will be described. The image blur correction control block 133 can perform image blur correction using an image sensor by driving the image blur correction lens 102, but stops image blur correction during panorama shooting. Therefore, the control block for driving the image blur correction lens 102 is omitted in FIG. 8, and the functional block related to the calculation of the offset correction amount involved in obtaining the camera shake signal after correction will be described. However, as in the block diagram shown in FIG. 2, an integration/LPF unit 1263 that converts an angular velocity signal into an angle signal, a shake correction amount calculation unit 1264 that calculates the amount of shake correction to be corrected by the image blur correction lens, and PID control. may be provided with a position control unit 1265 for performing

Based on the difference between the lens shake detection signal from the lens shake detection unit 125 and the motion vector, the lens offset determination unit 1261 determines an estimated offset value (hereinafter referred to as offset value) is determined and held. This sets the offset value on the lens side. Similar to the camera offset determination unit 1331 of the first embodiment, the lens offset determination unit 1261, instead of determining the offset value on the lens side based on the difference or the like, applies the value determined in the process before shipping the camera to the camera side. may be held as an offset value of . A subtractor subtracts the lens-side offset value held by the lens offset determination unit 1261 from the lens shake detection signal detected by the lens-side shake detection unit 125, thereby subtracting the offset component included in the lens shake detection signal. to obtain the lens shake signal. In this embodiment, it is assumed that the offset value is obtained with higher accuracy than the offset determination unit 13311 on the camera side.

The camera offset correction amount calculation unit 1267 is a block that calculates the camera offset correction amount for correcting the current offset value on the camera side that is determined by the camera offset determination unit and used for the camera shake detection signal. The camera offset correction amount calculation unit 1267 changes the calculation method of the camera offset correction amount depending on whether or not the offset value on the camera side is updated. Whether or not it is the offset update timing is determined based on the output from the offset update timing notification unit 11337 .

The camera offset correction amount calculation unit 1267 calculates the lens shake amount signal before correction (the output signal of the subtractor that subtracts the lens offset value from the lens shake detection signal) when the offset value on the camera side is updated. The amount of offset correction is calculated based on. On the other hand, the camera offset correction amount calculation unit 1267h calculates the offset correction amount from the lens shake signal and the uncorrected camera shake signal when it is not the timing when the offset value on the camera side is updated. A method for calculating the camera offset correction amount will be described later in detail. Note that the camera shake signal before correction is a signal obtained by subtracting the offset value determined by the lens offset determination unit 1261 from the lens shake detection signal detected by the lens shake detection unit 125 .

In this way, the offset component included in the camera shake detection signal that is the output of the camera shake detection unit 134 is the offset value on the lens side determined by the lens offset determination unit 1261 provided on the lens side, and the lens offset correction amount calculation value provided on the camera side. It is removed by the lens offset correction amount, which is the correction amount of the lens offset value determined in section 1332 .

The setting change processing for image blur correction control during panorama shooting is the same as in the first embodiment and has been described with reference to FIG. 3, so description thereof will be omitted. Also, the positional relationship between the exposure timing and the image sensor during panorama shooting has been described with reference to FIG. The description is omitted because it is the same.

FIG. 9 shows a flow of communication processing at the time of panorama shooting related to calculation of the camera offset correction amount. This flow also basically corresponds to the flow shown in FIG. 5 in which the roles of the lens device 2 and the camera body 1 are interchanged. FIG. 9 also shows the relationship between the lens device and the imaging apparatus main body performed by the image stabilization lens stabilization control unit 126 and the imaging stabilization control unit 133 before the start of shooting or between exposures during continuous shooting. Communication processing and arithmetic processing are represented.

First, the processing performed by the imaging stabilization control unit 133 will be described. In step S901, a pre-correction camera shake signal is generated by subtracting the set value of the camera offset determination unit 1331 from the camera shake detection signal acquired by the shake detection unit 134 on the camera side. After step S901 ends, the process proceeds to step S902.

In step S902, the uncorrected camera shake signal obtained in step S901 and information indicating the offset update timing indicating whether or not the offset value on the camera side from the offset update timing notification unit 1337 is updated are received. , the camera-side communication means 140 and the lens-side communication section 128 to transmit to the lens apparatus. After the process of step S902 is completed, the process proceeds to step S903.

In step S903, the camera offset correction amount transmitted from the lens apparatus in step S915, which will be described later, is received, and is used to calculate the correction amount of the image sensor as the correction amount for the uncorrected camera shake detection signal used in the next exposure. Specifically, as described above, the set value of the camera offset determination unit 1331 and the received camera offset correction amount are subtracted from the camera shake detection signal acquired by the shake detection unit 134 on the camera side. As a result, the corrected camera shake signal is obtained, the corrected camera shake signal is converted into a camera angle signal, and the camera shake correction amount is calculated. When the process of step S903 ends, the panorama control communication process ends.

Next, processing on the lens device side will be described. This processing is performed by the image blur correction lens vibration reduction control unit 126 .

First, in step S911, the set value of the lens offset determination unit 1261 is subtracted from the lens shake detection signal acquired by the lens side shake detection unit 125 to generate a lens shake signal. After the processing in step S911 is completed, in step S912, processing for acquiring the uncorrected camera shake signal transmitted by the camera main body in step S902 and information indicating the offset update timing is performed. After the process of step S912 is completed, the process of step S913 is performed.

In step S913, the information indicating the offset update timing acquired in step S912 is referred to, and it is determined whether or not the camera offset is updated.

If it is not the camera offset update timing (S913, No), the process proceeds to step S916, and the camera offset correction amount calculation unit 1267 calculates the camera offset correction amount based on the difference between the uncorrected camera shake signal and the lens shake signal. decide.

On the other hand, if it is the camera offset update timing (S913, Yes), the process proceeds to step S914, and the camera offset correction amount calculation unit 1267 determines the camera offset correction amount based on the lens shake signal.

After completing the processing in step S914 or step S916, the process advances to step S915 to transmit the camera offset correction amount obtained in each step to the camera body.

When the process of step S915 ends, the panorama control communication process on the lens side ends.

According to the above flow, it is possible to set an appropriate camera offset correction amount before the start of exposure according to the update timing of the offset value on the camera side. If the camera offset correction amount set here is not updated by the start of the next exposure period, it will be used to calculate the shake correction amount during the next exposure period. Next, calculation processing of the camera offset correction amount performed by the camera offset correction amount calculation unit 1267 in steps S914 and S916 will be described with reference to FIG. The calculation process of the camera offset correction amount is also basically performed by replacing the role of the camera body and the role of the lens apparatus in the calculation process of the lens offset correction amount in the first embodiment.

FIG. 10 is a diagram showing the relationship between the camera offset correction amount and the blur amount at the next exposure.

In FIGS. 10A and 10B, the horizontal axis represents time, and the vertical axis represents the intensity of the lens shake signal and the uncorrected camera shake signal. 10A corresponds to the calculation of the camera offset correction amount in step S916, and FIG. 10B corresponds to the calculation of the camera offset correction amount in step S914. As a premise, under the conditions of the present embodiment, it is assumed that the lens shake signal has less offset shift (the influence of the offset included in the shake signal) than the camera shake signal before correction.

The lens offset correction amount calculated in step S916 will be described below with reference to FIG.

A broken line L7 indicates a camera shake signal before correction, and a broken line L8 indicates a lens shake signal. The camera shake signal before correction indicated by broken line L7 is obtained by subtracting the set value of camera offset determination unit 1331 from the output of camera side shake detection unit 134 . Similarly, the lens shake signal indicated by the dashed line L8 is obtained by subtracting the value of the lens offset determination unit 1261 from the output of the lens side shake detection unit 125. FIG.

Let ω(t) be a shake signal to be subjected to image shake correction. It is assumed that the accuracy of the offset value on the lens side is high, and the error between ω(t) and the camera shake detection signal is suppressed within a predetermined range and can be ignored. Referring to FIG. 10A, a shake signal ω(t) to be subjected to image shake correction can be formulated as follows using the uncorrected camera shake signal ωcexp during exposure.
ω(t)=ωcexp(t)−(ωc−ωL) Equation (3)

This is represented by a solid line L9.

Here, ωL is a lens shake signal, ωc is a camera shake signal before correction, and data before the exposure start time Texp in time series are used. As described above, in the present embodiment, the camera offset correction amount is ωc−ωL. Therefore, the camera offset correction amount calculation unit 1267 subtracts the lens shake signal ωL from the uncorrected camera shake signal ωc acquired from the camera body side via the lens side communication unit 128, thereby calculating the camera offset correction amount. get. As long as the value is close to ωc−ωL, the offset correction amount may be a value obtained by finely adjusting ωc−ωL by using an adjustment value associated with the configuration of the imaging device.

Next, the camera offset correction amount calculated in step S914 will be described with reference to FIG. 10B.

A broken line L10 indicates a camera shake signal before correction, and a broken line L11 indicates a lens shake signal. The uncorrected camera shake signal indicated by the dashed line L10 is obtained by subtracting the set value of the camera offset determination unit 1331 from the output of the camera side shake detection unit 134 . Similarly, the lens shake signal indicated by the dashed line L11 is obtained by subtracting the value of the lens offset determination unit 1261 from the output of the lens side shake detection unit 125. FIG.

Assume that the camera offset determination unit 1331 updates the offset value at time Tf. The uncorrected camera shake signal indicated by broken line L8 is abruptly returned to near 0 at time Tf, which is the update timing. This is because, as in the first embodiment, the value obtained by subtracting the offset value from the current (Tf) lens shake detection signal is set to be close to 0 as the offset value. This occurs when a predetermined camera-side offset value update condition is met. The calculation method of formula (3) can be applied even near time Tf, which is the update timing. can be As a result, it may not be possible to accurately correct the amount of change in the shooting range due to camera shake or panning with the offset correction amount obtained by Equation (3).

Therefore, in this embodiment, when the setting value of the camera offset determination unit 1331 is updated, the shake signal ω(t) to be subjected to image shake correction is obtained using the following equation (4).

From FIG. 10B, ω(t) can be formulated as follows using the uncorrected camera shake signal ωcexp during exposure.
ω(t)=ωcexp(t)+ωL Expression (4)

This is represented by a solid line L12.

Here, ωL is a lens shake signal, and data prior to the exposure start time Texp in chronological order is used. From the above, the offset correction amount on the camera side is assumed to be -ωL. As in step S916, a finely adjusted value of -ωL may be used as the offset correction amount.

In this way, by obtaining the offset correction amount on the camera side based on the lens shake signal instead of the difference between the camera shake signal and the lens shake signal before correction, even when the offset value on the camera side is updated, Image blur can be reduced (corrected) with high accuracy.

Further, the magnitude of image blur caused by offset update is considered to depend on the amount of change in the uncorrected camera shake signal before and after the offset update and the magnitude of the difference (ωc−ωL) from the lens shake signal. Therefore, whether or not to apply equation (4) when updating the offset is determined based on the magnitude of the camera shake signal at the start of shooting, the magnitude of the lens shake signal during shooting, the magnitude of the camera shake signal during shooting, and the like. shall be good.

As described above, the present invention can also be applied to an imaging system in which the roles of the lens device and camera body are reversed from those of the first embodiment. Since the lens device and the camera body are optical instruments, the first and second embodiments comprise the first optical instrument having the shake detection means and the shake detection means, and the shake detection signal is transmitted from the first optical instrument. and a second optical device in which an offset value included in is highly accurate. Then, a correction amount for obtaining the shake amount to be corrected by the first optical device based on the information of the shake detection signal of the shake detection means provided in the second optical device and the offset value of the shake detection signal. (offset correction amount) can be acquired. At this time, by changing the calculation method for acquiring the offset correction amount in accordance with the update timing of the offset value of the first optical device, even when continuous shooting is performed before and after the update timing, continuous shooting can be performed. The shooting range is less likely to change between exposures.

Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist.

For example, the side on which the offset correction amount is calculated (the lens device in the first embodiment and the camera body in the second embodiment) subtracts the offset value from the shake detection signal, which is the detection result of the shake detection means. , sent the shake signal before correction to the other party. However, the detection result of the shake detection means and the offset value may be transmitted. The side that calculates the received offset correction amount may subtract the offset value from the shake detection signal as necessary.

Also, in the case of a combination of a lens device capable of correcting image blur by displacement of the image blur correction lens and a camera body capable of correcting image blur by displacement of the image pickup device, even in panorama shooting mode, the image blur correction lens and the imaging Image blur correction may be performed by displacing both the element. In this case, the configuration of the image blur correction lens stabilization control unit 126 is the configuration of the first embodiment (FIG. 2), and the configuration of the imaging stabilization control unit 133 is the configuration of the second embodiment (FIG. 8). However, the one with the higher accuracy of the offset value does not have the offset update timing notification unit, and instead has a calculation unit (camera offset correction amount calculation unit 1267 or lens offset correction amount calculation unit 1332) that calculates the offset correction amount of the other party. Prepare. For example, if the camera body side has higher accuracy, the camera offset determination unit 1331 determines the camera offset value based on the difference between the motion vector and the camera shake detection result, as in the first embodiment. At times other than the offset update timing on the lens side, by subtracting the camera shake amount obtained by subtracting the camera offset value based on the difference from the camera shake detection signal from the lens shake amount before correction, the lens offset correction amount is calculated. calculate. Also, at the offset update timing on the lens side, the lens offset correction amount calculator 1332 sets the lens shake amount before correction as the lens offset correction amount. A shake correction amount calculation unit 1335 on the camera side calculates an amount of shake correction to be corrected on the camera side based on the camera shake amount from which the camera offset value has been subtracted. On the other hand, the shake correction amount calculation unit 1264 on the lens side calculates the shake correction amount to be corrected on the lens side based on a signal obtained by subtracting the offset value and the offset correction amount from the lens shake detection signal.

Further, in the first and second embodiments, the offset correction amount calculation unit is provided in the one having the higher accuracy of the offset value, and the offset correction amount calculation unit calculates the offset correction amount of the other party. However, the offset correction amount calculator may be provided for the one with the lower accuracy of the offset value. For example, when the precision of the offset value is higher on the camera body side as in the first embodiment, the lens offset correction amount calculation unit 1332 may be provided inside the image blur correction lens vibration reduction control unit 126 . The method of calculating the lens offset correction amount is the same as in the first embodiment. The correction signal is received from within the lens system.

125 lens-side shake detection unit 134 camera-side shake detection unit 1261 lens offset determination unit 1262 offset update timing notification unit 1331 camera offset determination unit 1332 lens offset correction amount calculation unit

Claims (20)

Configure an imaging system capable of continuous shooting,
first shake detection means for detecting shake; offset value setting means; and based on the first shake detection signal detected by the first shake detection means and the offset value set by the offset value setting means A second optical device to which the first optical device can be attached, comprising a blur correction means for correcting image blur by using a second optical device, and a first communication means,
a second communication means for receiving information indicating update timing of the offset value set in the offset value setting means from the first communication means;
a second shake detection means for detecting shake;
Offset correction amount calculation for calculating an offset correction amount based on the information indicating the update timing of the offset value received by the second communication means and the second shake detection signal detected by the second shake detection means. comprising means and
When the first mode for continuous shooting is set,
The offset correction amount calculation means includes:
Used for calculating the offset correction amount based on information indicating update timing of the offset value from a plurality of calculation methods including a first calculation method and a second calculation method different from the first calculation method Select the calculation method,
The second optical apparatus, wherein the offset correction amount is calculated based on the selected calculation method between each exposure period of the continuous shooting. The offset correction amount calculation means includes:
selecting the first calculation method when it is determined that it is time to update the offset value based on the information indicating the update timing of the offset value;
2. The second optical instrument according to claim 1, wherein the second calculation method is selected when it is not determined that the offset value is updated. The first calculation method is
A method of calculating the offset correction amount based on the second shake detection signal,
The second calculation method is
The method of calculating the offset correction amount based on the first shake detection signal, the second shake detection signal, and the offset value set by the offset value setting means. Item 3. The second optical instrument according to item 2. The second communication means is
receiving information corresponding to a signal obtained by subtracting the offset value from the first shake detection signal;
In the second calculation method, the offset correction amount calculation means calculates the offset based on the second shake detection signal and information corresponding to a signal obtained by subtracting the offset value from the first shake detection signal. 4. The second optical instrument according to claim 3, wherein the correction amount is calculated. If the first mode is not set,
5. The offset correction amount calculation means according to claim 1, wherein the offset correction amount calculation means does not change the calculation method of the offset correction amount based on the information indicating the update timing of the offset value. Imaging device. 6. The second mode according to any one of claims 1 to 5, wherein the first mode is a mode for obtaining a composite image by synthesizing a plurality of images obtained by continuous shooting. optics. 7. The second optical apparatus according to claim 6, wherein said first mode is a mode for obtaining said composite image by stitching a plurality of images obtained by continuous shooting. The offset correction amount calculation means includes:
Based on the information indicating the update timing of the offset value, when it is determined that the offset value is updated and when it is not determined that the offset value is updated 8. The second optical apparatus according to any one of claims 1 to 7, wherein the number of calculations of the offset correction amount is changed in a period between exposure periods in photographing. The offset correction amount calculation means includes:
Detection result of the first shake detection means before the start of exposure in the first mode, detection result of the second shake detection means before the start of exposure, detection of the first shake detection means during the exposure period 9. The second method according to any one of claims 1 to 8, wherein said calculation method is selected based on at least one of a result and a detection result of said second shake detection means during said exposure period. optics. The first optical device is a lens device having a photographing optical system,
The shake correcting means has an image shake correcting lens that constitutes the imaging optical system and an actuator that moves the image shake correcting lens,
10. The second optical device according to any one of claims 1 to 9, wherein the second optical device is an image pickup device that includes an image pickup device and is capable of performing continuous photographing in the first mode. 2 optics. The first optical device is an imaging device that includes an imaging element and is capable of performing continuous shooting in the first mode,
The shake correcting means has an image sensor and an actuator for moving the image sensor,
10. The second optical device according to any one of claims 1 to 9, wherein the second optical device is a lens device having a photographing optical system. Configure an imaging system capable of continuous shooting,
A second optical device equipped with second shake detection means for detecting shake, offset correction amount calculation means, and second communication means for transmitting the offset correction amount calculated by the offset correction amount calculation means A first possible optical instrument comprising:
a first detection means for detecting vibration;
offset value setting means;
a first communication means for receiving the offset correction amount;
image based on the first shake detection signal detected by the first detection means, the offset value set by the offset value setting means, and the offset correction amount received from the first communication means; image blur correction amount calculation means for calculating a blur correction amount;
image blur control means for controlling the image blur correction means based on the image blur correction amount calculated by the image blur correction amount calculation means;
When the first mode for continuous shooting is set,
The first communication means is
information indicating update timing of the offset value set in the offset value setting means;
A first optical instrument, wherein information based on the first shake detection signal and the offset value is transmitted to the second communication means. The first communication means is
Information indicating a result of subtracting the offset value from the first shake detection signal is transmitted to the second communication means as information based on the first shake detection signal and the offset value. 13. A first optical instrument according to claim 12. The first communication means is
Information indicating the first shake detection signal and information indicating the offset value are transmitted to the second communication means as information based on the first shake detection signal and the offset value. 13. A first optical instrument according to claim 12. the first mode is set;
The image blur correction amount calculation means includes:
When the first communication means transmits information indicating that it is time to update the offset value to the second optical device,
The shake detected by the first detection means during exposure in the first mode, the offset value set by the offset value setting means, and the shake detected by the second detection means before exposure. calculating the image blur correction amount based on,
When the first communication means does not transmit information indicating that it is time to update the offset value to the second optical device,
The shake detected by the first detection means during exposure in the first mode, the offset value set by the offset value setting means, and the shake detected by the first detection means before exposure. 15. The first optical system according to claim 13 or 14, wherein the image blur correction amount is calculated based on , and the shake detected by the second detection means before exposure. device. 16. The first method according to any one of claims 13 to 15, wherein the image blur control means stops the image blur correction means at a reference position between each exposure period of the continuous shooting. optics. The first optical device is a lens device having a photographing optical system,
The shake correcting means has an image shake correcting lens that constitutes the imaging optical system and an actuator that moves the image shake correcting lens,
17. The second optical device according to any one of claims 1 to 16, wherein the second optical device is an imaging device that includes an imaging element and is capable of performing continuous shooting in the first mode. 1 optics. The first optical device is an imaging device that includes an imaging element and is capable of performing continuous shooting in the first mode,
The shake correcting means has an image sensor and an actuator for moving the image sensor,
18. The first optical device according to any one of claims 13 to 17, wherein the second optical device is a lens device having a photographing optical system. An imaging system capable of continuous shooting,
a first shake detection means for detecting shake;
offset value setting means;
shake correction means for correcting image shake based on the first shake detection signal detected by the first shake detection means and the offset value set by the offset value setting means;
a first optical instrument having a first communication means;
a second shake detection means for detecting shake;
a second optical device having a second communication means capable of communicating with the first communication means;
and offset correction amount calculation means,
When the first mode for continuous shooting is set,
The offset correction amount calculation means includes:
From a plurality of calculation methods including a first calculation method and a second calculation method different from the first calculation method, the offset correction is performed based on the relationship with the update timing of the set value by the offset value setting means Select the calculation method used to calculate the amount,
An imaging system, wherein the offset correction amount is calculated based on the selected calculation method between each exposure period of the continuous shooting. first shake detection means for detecting shake; offset value setting means; and based on the first shake detection signal detected by the first shake detection means and the offset value set by the offset value setting means a first optical device having a blur correction means for correcting image blur by
A method for calculating a correction amount in an imaging system capable of continuous shooting, comprising a second optical device having a second shake detection means for detecting shake, comprising:
When the first mode for continuous shooting is set,
a step of acquiring information on the update timing of the set value by the offset value setting means;
From a plurality of calculation methods including a first calculation method and a second calculation method different from the first calculation method, the offset correction is performed based on the relationship with the update timing of the set value by the offset value setting means selecting a calculation method to be used for calculating the amount;
calculating the correction amount of the offset value set in the offset value setting means based on the selected calculation method between each exposure period of the continuous shooting. calculation method.

Images