JP2017038281A - Imaging device and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress image quality deterioration by correcting the distortion of an image captured using an electronic shutter.SOLUTION: The image pickup device of an imaging device reads the signal of each pixel by XY address system. The imaging device performs shooting preparation processing according to the operation instruction of a user (S301), and performs past shooting by using an electronic shutter (S302). In the past shooting, the image before shutter release is acquired using an electronic shutter. Thereafter, shooting is performed using a mechanical shutter (S307, S308), and development processing (S310) is performed after exposure end (S309). In the image correction processing (S311), the past shooting image captured using the electronic shutter is corrected, based on the image captured using the mechanical shutter, thus removing the rolling distortion of the image.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a technique for correcting distortion of an image taken using an electronic shutter.

  As shutters of image pickup apparatuses such as digital cameras, there are an electronic shutter by electric control of an image pickup element and a mechanical shutter by driving a shutter mechanism, and there are apparatuses using both of them. An image sensor that reads out the signal of each pixel using an XY address method, such as a CMOS (complementary metal oxide semiconductor) sensor, has an electronic shutter function called a rolling shutter, and sequentially scans two-dimensionally arranged pixels row by row. To read the signal. In the case of shooting using a rolling shutter, the timing of exposure start and exposure completion is shifted for each row of pixels by sequential scanning. Therefore, distortion of the entire image due to camera shake and distortion of a moving subject image (called rolling distortion or rolling shutter distortion) can occur due to a shift in the exposure period for each row of pixels.

  Patent Document 1 discloses a technique for avoiding the occurrence of rolling distortion during photographing by using an electronic shutter and a mechanical shutter in combination. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for shooting using a mechanical shutter under shooting conditions in which rolling distortion occurs by switching between an electronic shutter and a mechanical shutter according to the shooting conditions.

JP 2006-191236 A JP 2006-345317 A

By the way, with a digital camera equipped with a past shooting function, in order not to miss the shutter chance, not only the shot image at the time of release but also the image while the user presses the shutter button halfway is continuously shot and recorded. Is done. During past photography, it is also necessary to display a through image on the electronic viewfinder. For this reason, the mechanical shutter cannot be used, and the photographing is performed using only the electronic shutter. In this case, rolling distortion caused by camera shake or subject blur (moving subject blur) may occur in a past photographed image acquired by a digital camera equipped with a CMOS sensor. It is not preferable that rolling distortion occurs in an image photographed by a past photographing function for not missing a photo opportunity.
An object of the present invention is to correct image distortion using an electronic shutter to suppress image quality degradation.

  An apparatus according to an embodiment of the present invention is an imaging apparatus including an electronic shutter unit that is controlled by an imaging element and a mechanical shutter that blocks incident light on a light receiving surface of the imaging element, and uses the electronic shutter unit. An acquisition means for acquiring each data of the captured first image and the second image captured using the mechanical shutter, and correcting the distortion of the first image using the second image. It has a correction means.

  According to the present invention, it is possible to correct a distortion of an image captured using an electronic shutter and suppress deterioration in image quality.

1 is an external view of a digital camera according to an embodiment of the present invention. It is a block diagram which shows the structural example of the digital camera which concerns on embodiment of this invention. It is a flowchart of the imaging | photography process of the digital camera which concerns on 1st Embodiment of this invention. It is a flowchart of the image correction process shown in S311 of FIG. It is a flowchart of the image correction process of the digital camera which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a picked-up image in order to demonstrate a moving body detection and image correction process. It is a figure which shows the example of a picked-up image in order to demonstrate camera shake detection and an image correction process.

Preferred embodiments of the present invention will be described below with reference to the drawings. As a matter common to each embodiment, after describing the configuration and operation of an imaging device equipped with an imaging device that reads out pixel signals by an XY address method such as a CMOS sensor, each implementation will be described with reference to FIGS. A form is demonstrated.
FIG. 1 is an external view of a digital camera 100 as an example of an imaging apparatus of the present invention. The positional relationship of each part will be described with the subject side as the front side. FIG. 1 is a view showing the digital camera 100 from the back side.

  The display unit 28 is a display device that displays images and various types of information, and is disposed on the back side of the digital camera 100. A release button 61 provided on the upper surface of the camera is an operation member for the user to instruct the shooting timing. The power switch 72 is a push button for switching between power on and power off. The mode switch 60 is an operation member for switching various modes, and is disposed on the back surface of the digital camera 100. The controller wheel 73 is an operation member that can be rotated. As described above, the operation unit 70 includes operation members such as various switches, buttons, and a touch panel that receive various operations from the user.

  The connector 112 is a connection part between an external device such as a personal computer or a printer and the digital camera 100. The digital camera 100 is electrically connected to an external device using a connection cable 111. The recording medium 200 is an information recording medium such as a memory card or a hard disk. The recording medium 200 is stored in the digital camera 100 through the recording medium slot 201, and recording and reproduction are performed by communicating with a control unit of the digital camera 100. A lid 202 is an opening / closing lid for the recording medium slot 201. FIG. 1 shows a state in which the lid 202 is opened and a part of the recording medium 200 is taken out from the recording medium slot 201 and exposed.

FIG. 2 is a block diagram illustrating a configuration example of the digital camera 100. As an example, an apparatus will be described in which a lens unit constituting an imaging optical system is integrated with a camera body unit.
The taking lens 103 is a lens group including a zoom lens and a focus lens, and is simply shown as a single lens in FIG. The barrier 102 covers the components of the imaging optical system, thereby preventing the photographing lens 103, the shutter 101, and the imaging unit 22 from being contaminated. The shutter 101 is a mechanical shutter that has a diaphragm function and blocks incident light on the imaging surface (the light receiving surface of the imaging device). The imaging unit 22 includes an imaging element configured by a CMOS element or the like, and converts an optical image formed by the photographing lens 103 into an electrical signal. The A / D converter 23 converts the analog signal output from the imaging unit 22 into a digital signal.

  The image processing unit 24 performs pixel interpolation processing, resizing processing, color conversion processing, and the like on the output data of the A / D converter 23 or the data from the memory control unit 15. In addition, the image processing unit 24 performs predetermined arithmetic processing using the captured image data. Based on the calculation result, the system control unit 50 performs exposure control and distance measurement control. Thereby, TTL (through the lens) AF (automatic focus adjustment) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. The image processing unit 24 further performs TTL AWB (auto white balance) processing based on the calculation result by performing predetermined calculation processing using the captured image data. Furthermore, the image processing unit 24 performs a motion vector calculation process between images with different imaging times and a movement amount calculation process for each line between images.

  The output data of the A / D converter 23 is directly written into the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 stores image data acquired by the imaging unit 22 and converted into digital data by the A / D converter 23 and image data to be displayed on the display unit 28. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and moving image and audio data over a predetermined time. The memory 32 also serves as an image display memory (video memory). The D / A converter 13 converts the digital data for image display stored in the memory 32 into an analog signal and outputs it to the display unit 28. The display image data written in the memory 32 is output via the D / A converter 13 and displayed on the display unit 28. The display unit 28 includes an LCD (liquid crystal display device) and the like, and performs image display according to an analog signal from the D / A converter 13. The digital signal once A / D converted by the A / D converter 23 and stored in the memory 32 is converted to an analog signal by the D / A converter 13 and then sequentially transferred to the display unit 28 to display an image. The Thereby, an electronic viewfinder function is realized, and through image display (live view display) is performed.

  The nonvolatile memory 56 is an electrically erasable and storable storage medium such as an EEPROM (Electrically Erasable Programmable Read-Only Memory) or the like. The nonvolatile memory 56 stores constants, programs and the like for operating the system control unit 50. A program here is a computer program for performing the process shown in the flowchart mentioned later in this embodiment.

  The system control unit 50 is a central unit that controls the entire digital camera 100. The system control unit 50 executes each program described later by executing a program stored in the nonvolatile memory 56. The system memory 52 is a RAM (Random Access Memory). In the system memory 52, constants and variables for operation of the system control unit 50 are stored, and a program read from the nonvolatile memory 56 is developed. The system control unit 50 performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, and the like. The system timer 53 is a timer unit that measures the time used for various controls.

  The operation unit 70 for inputting various operation instructions to the system control unit 50 includes, for example, a mode switch 60, a release button 61, and a controller wheel 73. The mode change switch 60 is used for switching various modes. The various modes include, for example, a still image recording mode, a moving image shooting mode, a playback mode, and the like. Modes included in the still image recording mode include an auto shooting mode, an auto scene discrimination mode, a manual mode, various scene modes for shooting settings for each shooting scene, a program AE mode, a custom mode, and the like. In addition, the scene mode includes a portrait shooting mode specialized in shooting a person by blurring the background to make the person stand up.

  The first shutter switch 62 is turned on by a so-called half-press (shooting preparation instruction) operation during the operation of the release button 61, and the first shutter switch signal SW1 is generated. The first shutter switch signal SW1 starts operations such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 64 is turned on upon completion of the operation of the release button 61, that is, a so-called full press (shooting instruction) operation, and a second shutter switch signal SW2 is generated. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of imaging processes from reading the signal from the imaging unit 22 to writing the image data to the recording medium 200.

  The controller wheel 73 (see FIG. 1) is used together with direction buttons to indicate selection items. An electrical pulse signal is generated in accordance with the rotation operation amount of the controller wheel 73, and the system control unit 50 controls each part of the digital camera 100 based on the pulse signal. For example, there is a dial operation member that generates a pulse signal by rotating the controller wheel 73 itself according to the rotation operation of the user. In addition, there is an operation member made of a touch sensor, and the controller wheel 73 itself does not rotate, and there is a member (so-called touch wheel) that detects a rotation operation of a user's finger on the controller wheel 73.

  The power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is installed, the type of battery, and the remaining battery level. The power control unit 80 controls the DC-DC converter according to the detection result and the instruction from the system control unit 50, and controls power supply to each unit including the recording medium 200. The power supply unit 30 includes a primary battery, a secondary battery, an AC adapter, or the like. The recording medium I / F unit 18 is an interface unit that transmits and receives data to and from the recording medium 200. The recording medium 200 is a recording medium for recording captured image data, and includes a semiconductor memory, an optical disk, a magnetic disk, or the like.

  The communication unit 54 transmits and receives video signals, audio signals, and the like by wireless communication or connection using a wired cable. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 transmits image data (including a through image) imaged by the imaging unit 22 and image data recorded on the recording medium 200 to an external device, and receives image data and other various information from the external device. Can be received.

  The posture detection unit 55 detects the posture of the digital camera 100 with respect to the direction of gravity using an acceleration sensor, a gyro sensor, or the like. Based on the posture detection result, it is possible to determine whether the image captured by the imaging unit 22 is an image captured by holding the digital camera 100 horizontally or an image captured by holding the digital camera 100 vertically. The system control unit 50 can add orientation information corresponding to the detection result of the posture detection unit 55 to the file of the image captured by the imaging unit 22, or can rotate and record the image.

  The digital camera 100 can shoot using central one-point AF and face AF. Central one-point AF is to perform AF on one central position in the shooting screen. Face AF is to perform AF on the face in the shooting screen detected by the face detection function.

  The outline of the face detection function will be described. The system control unit 50 sends image data to be detected to the image processing unit 24. The image processing unit 24 detects edge components by applying band pass filters in the horizontal direction and the vertical direction to the acquired image data. Pattern matching is performed on the detected edge components, and processing for extracting a candidate group of eyes, nose, mouth, and ears is performed. The system control unit 50 determines that an eye pair satisfying a preset condition (for example, distance between two eyes, inclination, etc.) from the extracted eye candidate group and has an eye pair Narrow down as the only candidate group. Then, the system control unit 50 associates the narrowed-down eye candidate group with other portions (nose, mouth, ears) that form the corresponding face, and passes a preset non-face condition filter. Detect faces. The system control unit 50 outputs face detection information and stores a feature quantity such as the number of faces in the system memory 52. In addition, subject detection information can be acquired by extracting feature amounts of image data by image analysis of image data displayed in live view or reproduced. The subject detection information includes various information such as red-eye determination, eye detection, eye-brow detection, smile detection, and person detection.

[First embodiment]
Hereinafter, a first embodiment of the present invention will be described. In the present embodiment, an example of processing for correcting an image continuously captured using an electronic shutter (hereinafter referred to as a past captured image) based on an image captured using a mechanical shutter will be described.
FIG. 3 is a flowchart illustrating the shooting process of the digital camera 100 according to the first embodiment. The following processing is realized by the CPU (central processing unit) of the system control unit 50 expanding and executing the program stored in the nonvolatile memory 56 in the system memory 52. The shooting process shown in the flowchart is executed in accordance with a shooting instruction by the operation of the release button 61 performed by the user during the operation of the digital camera 100.

  In S300, the system control unit 50 determines whether or not the user performs a half-press operation on the release button 61 and the first shutter switch signal SW1 is turned on. If the SW1 signal is an ON signal, the process proceeds to S301. If the SW1 signal is an OFF signal, the determination process of S300 is repeated. In step S301, the system control unit 50 performs shooting preparation processing. The focus lens included in the photographing lens 103 is moved to a position where the subject is in focus in the AF process, and an appropriate exposure value and exposure time are set by the diaphragm included in the shutter 101 in the AE process.

  In S302, the system control unit 50 starts past shooting processing, and images are continuously shot while the user presses the release button 61 halfway, and recording processing is performed. During past photography, it is also necessary to display a through image as an electronic viewfinder. For this reason, the mechanical shutter cannot be used, and photographing using the electronic shutter of the image sensor is performed. The past photographed image data is temporarily stored in the memory 32 and then processed together with the actual photographed image in the processing after S311 described later. Hereinafter, shooting for recording a shot image is referred to as “main shooting” in order to distinguish it from past shooting. The actual captured image is an image in which data is recorded on the recording medium 200 by a recording process after the second shutter switch 64 is turned on.

  Next, in S303, the system control unit 50 determines whether or not the user has fully pressed the release button 61 and the second shutter switch signal SW2 is turned on. If the SW2 signal is an ON signal, the process proceeds to S306, and if the SW2 signal is an OFF signal, the process proceeds to S304. In S304, the system control unit 50 determines whether or not the release button 61 is released by the user and the SW1 signal becomes an OFF signal. If the SW1 signal is an OFF signal, the process proceeds to S305. If the SW1 signal is an ON signal, the process returns to S303.

  In step S305, the system control unit 50 stops the past shooting process, and then ends the shooting process. In step S306, the system control unit 50 stops the past photographing process, and then starts exposure for main photographing in the next step S307. In S308, the shutter 101 is driven according to the exposure time determined in the shooting preparation process in S301, and the imaging unit 22 is shielded from light. In step S309, the charge accumulation is finished, and the exposure for the main photographing is finished. In step S310, the system control unit 50 performs development processing. In the development process, after the charge accumulated in the imaging unit 22 is read out, the A / D converter 23 performs an A / D conversion process, and then the image processing unit 24 performs various image processes to obtain image data. Generated.

  In step S <b> 311, the system control unit 50 corrects the past captured image captured using the electronic shutter based on the actual captured image captured using the shutter 101. Details of the image correction processing will be described later. In step S <b> 312, the system control unit 50 encodes past captured image data and actual captured image data and records the encoded image data on the recording medium 200. Thus, a series of shooting processes of the digital camera 100 is completed.

  Next, the image correction process shown in S311 of FIG. 3 will be described with reference to FIG. FIG. 4 is a flowchart showing an example of image correction processing of the digital camera 100 in the present embodiment. In past shooting, the pre-release image is shot and recorded using an electronic shutter. However, in an imaging device equipped with a CMOS sensor, rolling distortion occurs due to motion blur and camera shake in the past shot image. Concerned. Therefore, processing for motion blur detection and correction and camera shake detection and correction is performed.

  In S400, the system control unit 50 performs a moving object detection process. In the moving object detection process, a moving object is detected based on the past photographed image and the main photographed image. The system control unit 50 causes the image processing unit 24 to divide a past photographed image photographed using an electronic shutter into a plurality of areas. Then, the past captured image included in each divided area is compared with the actual captured image captured using the mechanical shutter, and a motion vector between the images is calculated for each area. Based on the calculated motion vector, the presence or absence of a moving object can be detected. For example, among the motion vectors calculated in each area, motion vectors having similar sizes and orientations are grouped to determine a dominant motion vector in the image. When a plurality of areas having vectors whose sizes and directions are clearly different from the determined motion vector are present in a lump, it can be determined that a moving object exists in the area. This will be specifically described with reference to FIG. FIG. 6A illustrates a past photographed image, and shows a moving object image 601 in which rolling distortion has occurred and a background image 602. FIG. 6B illustrates the actual captured image, and FIG. 6C illustrates the moving object detection result.

  In S401 of FIG. 4, the system control unit 50 performs camera shake detection processing. In the camera shake detection process, camera shake is detected from the past photographed image and the main photographed image. The system control unit 50 uses the image processing unit 24 to calculate a movement amount for each line of the past photographed image photographed using the electronic shutter with reference to the main photographed image photographed using the mechanical shutter. At this time, the area determined as a moving body in S400 is excluded from the calculation of the movement amount. The presence or absence of camera shake can be detected based on the calculated movement amount for each line. This will be specifically described with reference to FIG. FIG. 7A illustrates a past photographed image (a tower image 701 tilted to the left), and FIG. 7B illustrates a main photographed image (a tower image 702 not tilted). FIG. 7C illustrates the calculation result of the movement amount (see arrow) for each line by the camera shake detection process.

  In step S402, the system control unit 50 determines whether camera shake has occurred in the captured image based on the result of the camera shake detection process in step S401. If camera shake has occurred in the captured image, the process proceeds to S403. If camera blur has not occurred in the captured image, the process proceeds to S404. In step S403, the system control unit 50 corrects the past photographed image for each line using the plurality of movement amounts calculated in step S401. The plurality of movement amounts are movement amounts for each line of the past photographed image with the main photographed image photographed using the mechanical shutter as a reference. By the camera shake correction process in S403, rolling distortion caused by camera shake occurring in the past photographed image is corrected (see FIG. 7D).

  Next, in S404, the system control unit 50 determines whether there is a moving object image in the captured image, based on the result of the moving object detection process in S400. As a result of the determination, if it is determined that there is a moving object image in the captured image, the process proceeds to S405, and if it is determined that there is no moving object image in the captured image, the image correction process ends.

  In step S405, the system control unit 50 performs moving body blurring (image blurring) correction processing. For the moving object detected in S400, the moving object image of the past photographed image in which the rolling distortion is corrected is corrected based on the moving object image cut out from the main photographed image photographed using the mechanical shutter. The system control unit 50 uses the image processing unit 24 as a reference for the moving body image included in the actual captured image captured using the mechanical shutter, and for each line of the moving body image included in the past captured image in which the rolling distortion is corrected. The amount of movement is calculated. Note that it is conceivable that the orientation and shape of the subject have changed between the two images. Therefore, the amount of movement obtained for each line is not used as a correction amount as it is, but the amount of movement obtained for each line is applied with a low-pass filter in the direction across the lines. The smoothed amount of movement is used as the correction amount. FIG. 6D illustrates a past photographed image after correction. The moving body image 601 of the past photographed image acquired using the electronic shutter has rolling distortion caused by moving body blur, but the rolling distortion is removed by moving body blur correction. By the moving body blur correction process of S405, it is possible to correct the rolling distortion caused by the moving body blur that has occurred in the moving body image of the past photographed image.

According to the present embodiment, a past photographed image photographed using an electronic shutter can be corrected based on a main photographed image photographed using a mechanical shutter.
In addition, although the example which detects a camera shake from a past photography image and a real photography image was demonstrated in S401 of FIG. 4, it is good also as a structure which detects a camera shake using an acceleration sensor etc. FIG. By doing in this way, the camera shake detection time when there is no camera shake can be reduced, and the response of the camera process can be improved.

  In addition to a rolling shutter function that sequentially scans pixels arranged two-dimensionally for each line, an imaging element that has a global shutter function that simultaneously scans all lines may be used. This image pickup device has, as electronic shutter means, first shutter means for sequentially scanning each pixel row by row, and second shutter means for simultaneously scanning each pixel. That is, the first shutter means is a rolling shutter, and reading is performed with a time difference for each pixel row from the reset operation of the image sensor (rolling operation). The second shutter means is a global shutter. After the first photographing using the first shutter means, the second photographing using the second shutter means is performed. In the above description, the same effect as described above can be obtained by using a global shutter instead of the mechanical shutter. By doing so, the mechanical shutter can be reduced, and the cost of the camera can be reduced.

  In the present embodiment, the past shooting has been described as an example of shooting using the electronic shutter. In addition, it is also possible to shoot and combine multiple images, such as HDR (High Dynamic Range) shooting that captures images with a wide dynamic range by combining multiple images taken with different exposures. The present invention is applicable. For example, in the case of HDR shooting, in the above description, an image in which exposure is changed from proper exposure is set as an image shot using an electronic shutter. Rolling distortion that occurs in an image captured using an electronic shutter can be corrected based on a properly exposed image captured using a mechanical shutter. By doing in this way, it is possible to shorten the HDR imaging time compared to the case where all images are captured using the mechanical shutter.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the present embodiment, whether or not to correct the past shot image is switched according to the determination result of the shooting mode and the camera shake amount. In addition, in this embodiment, about the structure similar to the case of 1st Embodiment, those detailed description is abbreviate | omitted by using the code | symbol already used.

  FIG. 5 is a flowchart illustrating an image correction process of the digital camera 100 according to this embodiment. The following processing is realized by the CPU of the system control unit 50 developing the program stored in the nonvolatile memory 56 in the system memory 52 and executing it. Note that the processing of S500 to S502, S504, S506, and S507 shown in FIG. 5 is the same as S400 to S402, S403, S404, and S405 of FIG. 4 described in the first embodiment. The differences will be mainly described below.

  When it is determined in S502 of FIG. 5 that there is camera shake and the process proceeds to S503, the system control unit 50 compares the camera shake amount detected in the camera shake detection process of S501 with a predetermined value. The predetermined value is a preset camera shake amount threshold, and the system control unit 50 determines whether or not the camera shake amount is equal to or greater than a predetermined value. If the camera shake amount is smaller than the predetermined value, the process proceeds to S504. If the camera shake amount is equal to or larger than the predetermined amount, the process proceeds to S505. That is, when the camera shake amount of the digital camera 100 is equal to or greater than the threshold value, the camera shake correction in S504 is not performed. This is because when the digital camera 100 is shaken greatly during past shooting, there is a high possibility that the past shooting image shot using the electronic shutter is different from the main shooting image shot using the mechanical shutter. .

  In step S505 in FIG. 5, the system control unit 50 determines whether the shooting mode of the digital camera 100 is the portrait shooting mode. If the shooting mode is the portrait shooting mode, the image correction process is terminated. If the shooting mode is not the portrait shooting mode, the process proceeds to S506. That is, when the shooting mode is the portrait shooting mode, the moving body blur correction in S507 is not performed. In this way, when the person who is the subject in the portrait shooting mode moves, it is possible to prevent the person image from being unnaturally corrected due to erroneous correction or overcorrection.

According to the present embodiment, it is possible to switch whether or not to correct a past shot image according to the shooting mode and the camera shake amount.
In S505 of FIG. 5, the example in which it is determined whether or not the shooting mode of the digital camera 100 is the portrait shooting mode has been described. However, the present invention is not limited to this, and when the shooting mode is an auto scene determination mode for automatically determining a shooting scene, it may be determined whether or not the scene determination result is portrait shooting. In this way, even when the shooting mode is the auto scene discrimination mode, it is possible to prevent the person image from being unnaturally corrected when the person who is the subject moves. Further, it is possible to perform a process for determining whether or not the detected subject is a person so that the moving body blur correction is not performed when the subject person moves. Thereby, it is possible to prevent the human image from being unnaturally corrected.

  As described above, according to the present invention, it is possible to correct rolling distortion occurring in an image captured using an electronic shutter, based on an image captured using a mechanical shutter or a global shutter.

[Other embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

22 imaging unit 24 image processing unit 50 system control unit 61 release button 101 shutter 200 recording medium

Claims (12)

An image pickup apparatus comprising electronic shutter means by control of an image pickup device and a mechanical shutter that blocks incident light on a light receiving surface of the image pickup device,
Obtaining means for obtaining data of a first image photographed using the electronic shutter means and a second image photographed using the mechanical shutter;
An image pickup apparatus comprising correction means for correcting distortion of the first image using the second image. The image sensor reads out the signal of each pixel by the XY address method,
The imaging apparatus according to claim 1, wherein the electronic shutter unit sequentially scans the pixels for each row. Instruction means for instructing the timing of shooting;
Recording means for recording data of the second image photographed in accordance with an instruction of the instruction means;
The imaging apparatus according to claim 1, wherein the first image is captured continuously before an instruction from the instruction unit.   4. The correction unit according to claim 1, wherein the correction unit corrects distortion of the first image by calculating a movement amount for each row between the images of the first and second images. 5. The imaging device according to item. Detecting means for detecting a moving object by calculating a motion vector between the images of the first and second images;
5. The correction unit corrects the moving body image detected from the first image using the moving body image detected from the second image. 6. The imaging apparatus according to item 1.   The imaging apparatus according to claim 1, wherein the correction unit determines a shooting mode and determines whether or not to correct distortion of the first image. It has a discriminating means for discriminating the shooting scene,
The imaging apparatus according to claim 1, wherein the correction unit determines whether to correct distortion of the first image according to a determination result by the determination unit. A determination means for determining a subject;
The imaging apparatus according to claim 1, wherein the correction unit determines whether to correct distortion of the first image according to a determination result by the determination unit. Comprising a blur detection means for detecting the blur amount of the imaging device;
9. The correction unit according to claim 1, wherein the correction unit acquires the blur amount detected by the blur detection unit, and corrects the distortion of the first image when the blur amount is smaller than a threshold value. The imaging apparatus according to item 1. An image pickup apparatus having an electronic shutter means and having an image pickup element that reads out a signal of each pixel by an XY address method,
The electronic shutter means is a first shutter means for sequentially scanning the pixels for each row, and a second shutter means for simultaneously scanning the pixels.
An image pickup apparatus comprising: a correction unit that corrects distortion of an image acquired by photographing with the first shutter unit using an image acquired by photographing with the second shutter unit. A control method executed by an image pickup apparatus including an electronic shutter means by control of an image pickup device and a mechanical shutter that blocks incident light on a light receiving surface of the image pickup device,
An acquisition step of acquiring each data of a first image photographed using the electronic shutter means and a second image photographed using the mechanical shutter;
An image pickup apparatus control method comprising: a correction step of correcting distortion of the first image using the second image. An image sensor that reads out the signal of each pixel by an XY address method is provided, and as an electronic shutter means, a first shutter means that sequentially scans each pixel of the image sensor for each row, and a second that simultaneously scans each pixel A control method executed by an imaging apparatus having shutter means,
Performing a first photographing using the first shutter means;
Performing second imaging using the second shutter means;
A method for controlling an imaging apparatus, comprising: correcting distortion of an image acquired by the first imaging using an image acquired by the second imaging.