JP2014230018A - Photographing device, imaging system, control method of imaging device, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device capable of acquiring a panoramic photograph having correct exposure in the whole image, by reducing discomfort at the coupling portion.SOLUTION: An imaging device capable of generating a panoramic image from a plurality of images including a first image and a second image, has signal processing means for processing an image signal, control means for controlling the signal processing means, and storage means for storing a first image captured by first exposure and second exposure, and a second image captured by first exposure and third exposure. The control means calculates a fourth exposure which is determined correct for the entirety of a plurality of images by using the first exposure and third exposure. The signal processing means generates a panoramic image by coupling a first image of fourth exposure and a second image of fourth exposure.

Description

  The present invention relates to an imaging apparatus capable of panoramic photography.

  Conventionally, an imaging device (digital camera) capable of panoramic photography is known. The first image is taken to prevent panoramic scenes having different brightness and colors from being constructed in adjacent photographed images by reducing the photographing conditions of each photographed image (to reduce the sense of incongruity at the combined portion of the photographed images). A method has been proposed in which the second and subsequent images are taken according to the conditions.

  In Patent Document 1, in panoramic shooting, automatic exposure control and automatic white balance processing are performed in the first shooting, and automatic exposure control and automatic white balance control are not performed in the second and subsequent shootings. An imaging apparatus that performs photographing and recording with the same control as the eyes is disclosed.

JP 2001-117186 A

  However, in the configuration of Patent Document 1, when the exposure of the first sheet is different from the appropriate exposure of an image to be captured thereafter, the panoramic photograph may be too bright or too dark as a whole.

  On the other hand, there is also a method of adjusting each captured image by capturing each image with appropriate exposure and increasing the gain for each captured image. However, an image obtained by increasing the gain may cause overexposure or underexposure, and an appropriate exposure may not be obtained (dynamic range is impaired).

  Therefore, the present invention provides an imaging device, an imaging system, an imaging device control method, a program, and a storage medium that can reduce a sense of incongruity at a coupling portion and can acquire a panoramic photograph having appropriate exposure in the entire image.

  An imaging apparatus according to one aspect of the present invention is an imaging apparatus capable of generating a panoramic image from a plurality of images including a first image and a second image, and includes a signal processing unit that processes an image signal, and the signal Control means for controlling the processing means, storage means for storing a first image photographed with the first exposure and the second exposure, and a second image photographed with the first exposure and the third exposure And the control means calculates a fourth exposure determined to be appropriate for the whole of the plurality of images using the first exposure and the third exposure, and the signal processing means Combines the first image of the fourth exposure and the second image of the fourth exposure to generate the panoramic image.

  An imaging system according to another aspect of the present invention includes the imaging device and the lens that is detachable from the imaging device.

  An imaging apparatus control method according to another aspect of the present invention is an imaging apparatus control method capable of generating a panoramic image from a plurality of images including a first image and a second image. Photographing the first image with a second exposure and storing the first image; photographing the second image with the first exposure and the third exposure; Storing, a step of calculating a fourth exposure determined to be appropriate for the whole of the plurality of images using the first exposure and the third exposure, and a step of calculating the fourth exposure Combining the first image and the second image of the fourth exposure to generate the panoramic image.

  A program according to another aspect of the present invention is configured to cause a computer to execute the control method of the imaging apparatus.

  A storage medium according to another aspect of the present invention stores the program.

  Other objects and features of the present invention are illustrated in the following examples.

  According to the present invention, it is possible to provide an imaging device, an imaging system, an imaging device control method, a program, and a storage medium that can reduce a sense of incongruity at a coupling portion and can acquire a panoramic photograph having an appropriate exposure for the entire image. Can do.

It is a block diagram which shows the structure of the imaging device in each Example. It is a conceptual diagram of the panoramic imaging process in each embodiment. It is a conceptual diagram of the panoramic imaging process in each embodiment. 6 is a flowchart of a panoramic photographing process in each embodiment. It is a flowchart of the panoramic image creation process in each embodiment. 10 is a flowchart of image synthesis processing with proper exposure in Embodiment 3.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, with reference to FIG. 1, the structure of the imaging device in this embodiment is demonstrated. As will be described later, the imaging apparatus according to the present exemplary embodiment is an imaging apparatus that can generate a panoramic image from a plurality of images including a first image and a second image. FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 100 (single-lens reflex digital camera) according to the present embodiment.

  In FIG. 1, reference numeral 101 denotes a photographing lens (lens unit). Reference numeral 102 denotes an AF (autofocus) drive unit. The AF driving unit 102 includes, for example, a DC motor or a stepping motor, and focuses by changing the focus lens position of the photographing lens 101 based on the control of the microcomputer 123 (control means). Reference numeral 103 denotes a zoom drive unit. The zoom drive unit 103 includes, for example, a DC motor or a stepping motor, and changes the focal length of the photographic lens 101 by changing the zoom lens position of the photographic lens 101 based on the control of the microcomputer 123. . Reference numeral 104 denotes an aperture. Reference numeral 105 denotes an aperture driving unit. The diaphragm driving unit 105 drives the diaphragm 104. The driving amount of the diaphragm 104 is calculated by the microcomputer 123, and the diaphragm driving unit 105 changes the optical diaphragm value.

  Reference numeral 106 denotes a main mirror for switching the light beam incident from the photographing lens 101 between the viewfinder side and the image sensor side. The main mirror 106 is usually arranged so as to guide the light beam to the viewfinder (that is, to reflect the light beam incident from the photographing lens 101). On the other hand, at the time of photographing, the main mirror 106 jumps upward so as to guide the light beam to the image sensor 112 and retracts from the photographing optical path. In addition, the main mirror 106 is a half mirror so that a central portion thereof can transmit a part of the light beam. The light beam (a part of the light beam) transmitted through the main mirror 106 enters a sensor for performing focus detection, as will be described later.

  Reference numeral 107 denotes a sub mirror for reflecting the light beam transmitted through the main mirror 106 and guiding it to a sensor (disposed in the focus detection circuit 109) for performing focus detection. Reference numeral 108 denotes a pentaprism that constitutes a finder. In addition to the pentaprism 108, the finder includes a focus plate, an eyepiece lens (not shown), and the like. Reference numeral 109 denotes a focus detection circuit. The light beam transmitted through the central portion of the main mirror 106 and reflected by the sub mirror 107 reaches a sensor (a sensor for performing photoelectric conversion) disposed inside the focus detection circuit 109. The defocus amount to be used for the focus calculation is obtained by calculating the sensor output. The microcomputer 123 evaluates the calculation result and instructs the AF driving unit 102 to drive the photographing lens 101 (focus lens).

  Reference numeral 110 denotes a focal plane shutter. Reference numeral 111 denotes a shutter drive circuit that drives the focal plane shutter 110. The opening time of the focal plane shutter 110 is controlled by the microcomputer 123. Reference numeral 112 denotes an image sensor. The image sensor 112 includes a CCD sensor, a CMOS sensor, and the like. The image sensor 112 photoelectrically converts a subject image (optical image) formed by the photographing lens 101 and converts it into an electrical signal (analog signal).

  Reference numeral 113 denotes a clamp circuit. Reference numeral 114 denotes an AGC circuit. The clamp circuit 113 and the AGC circuit 114 perform basic analog signal processing before A / D conversion is performed on the analog signal output from the image sensor 112. The clamp level of the clamp circuit 113 and the AGC reference level of the AGC circuit 114 are changed by the microcomputer 123. Reference numeral 115 denotes an A / D converter. The A / D converter 115 converts an analog signal from the image sensor 112 into a digital signal.

  Reference numeral 116 denotes a signal processing circuit (signal processing means) that processes image signals and audio signals, and is realized by a logic device such as a gate array. Reference numeral 117 denotes an EVF (electronic viewfinder) drive circuit. Reference numeral 118 denotes an EVF monitor. Reference numeral 119 denotes a memory controller. Reference numeral 120 denotes a memory. Reference numeral 121 denotes an external interface that can be connected to an external device such as a computer. Reference numeral 122 denotes a buffer memory.

  The signal processing circuit 116 performs filter processing, color conversion processing, and gamma processing on the digitized image data (output signal of the A / D converter 115), and also performs image compression processing such as JPEG. To the memory controller 119. In addition, the signal processing circuit 116 performs compression processing on audio data (audio signal) input from the microphone 132 or the audio line input unit 133 via the A / D converter 134 and outputs the compressed data to the memory controller 119.

  The signal processing circuit 116 can also output image data (image signal) from the image sensor 112 and, conversely, image data input from the memory controller 119 to the EVF monitor 118 through the EVF drive circuit 117. Switching between these functions is performed according to instructions from the microcomputer 123. The signal processing circuit 116 outputs information such as exposure information and white balance of the signal from the image sensor 112 to the microcomputer 123 as necessary. The microcomputer 123 instructs gain adjustment and white balance adjustment based on these pieces of information.

  In the case of the continuous shooting operation, the signal processing circuit 116 temporarily stores the shooting data in the buffer memory 122 as an unprocessed image, reads the unprocessed image data via the memory controller 119, and performs image processing and compression processing. . The number of continuous images taken depends on the size of the buffer memory 122. The signal processing circuit 116 can also output audio data from the microphone 132 or the audio line input unit 133 to the speaker 136 via the D / A converter 135.

  The memory controller 119 stores unprocessed digital image data and audio data input from the signal processing circuit 116 in the buffer memory 122, and stores processed digital image and audio data in the memory 120. Conversely, the memory controller 119 outputs image data and audio data from the buffer memory 122 and the memory 120 to the signal processing circuit 116. The memory 120 may be configured to be removable from the imaging device 100. The memory controller 119 can output images and sounds stored in the memory 120 via an external interface 121 that can be connected to an external device such as a computer.

  Reference numeral 123 denotes a microcomputer. Reference numeral 124 denotes an operation member. The operation member 124 transmits the state of the operation member 124 to the microcomputer 123. The microcomputer 123 controls each part of the imaging device 100 in accordance with a change in the state of the operation member 124. Reference numeral 125 denotes a first switch (hereinafter referred to as “SW1”). Reference numeral 126 denotes a second switch (hereinafter referred to as “SW2”). The switches SW1 and SW2 are switches that are turned on or off by operating the release button, and are each one of the input switches of the operation member 124. When only the switch SW1 is on, the release button is half pressed. In this state, the microcomputer 123 controls the autofocus operation and the photometry operation. When the switches SW1 and SW2 are both on, the release button is fully pressed. In this state, photographing is performed and a photographed image is recorded. Further, the continuous shooting operation is performed while the switches SW1 and SW2 are kept on. In addition, switches (not shown) such as an ISO setting button, an image size setting button, an image quality setting button, and an information display button are connected to the operation member 124, and the operation member 124 detects the state of each switch.

  Reference numeral 127 denotes a liquid crystal driving circuit. Reference numeral 128 denotes an external liquid crystal display member. Reference numeral 129 denotes an in-finder liquid crystal display member. The liquid crystal driving circuit 127 drives the external liquid crystal display member 128 or the in-finder liquid crystal display member 129 in accordance with the display content command of the microcomputer 123. The finder liquid crystal display member 129 is provided with a backlight (not shown) such as an LED, and the backlight is also driven by the liquid crystal drive circuit 127. The microcomputer 123 can shoot by checking the capacity of the memory 120 via the memory controller 119 based on predicted value data corresponding to ISO sensitivity, image size, image quality, etc. set before shooting. The remaining number can be calculated. The remaining number that can be photographed can be displayed on the external liquid crystal display member 128 or the finder liquid crystal display member 129 as necessary.

  Reference numeral 130 denotes a nonvolatile memory (EEPROM). The nonvolatile memory 130 can store data even when the imaging apparatus 100 is not turned on. Reference numeral 131 denotes a power supply unit. The power supply unit 131 supplies power necessary for components such as each IC and drive system of the imaging apparatus 100.

  Reference numeral 132 denotes a microphone. Reference numeral 133 denotes an audio line input unit. Reference numeral 134 denotes an A / D converter. The A / D converter 134 converts the analog signal output from the microphone 132 or the audio line input unit 133 into a digital signal. Reference numeral 135 denotes a D / A converter. The D / A converter 135 converts the digital signal into an analog output signal. Reference numeral 136 denotes a speaker.

  In the present embodiment, the photographing lens 101 is configured integrally with the imaging device 100, but is not limited to this. The present embodiment can also be applied to an imaging system configured by attaching a photographic lens 101 (lens device) that can be attached to and detached from the imaging device 100 to the imaging device 100 (imaging device body).

  Next, with reference to FIG. 2, FIG. 3a, and FIG. 3b, a panorama shooting process and a panorama image creation process (a control method of the imaging apparatus 100) according to the first embodiment of the present invention will be described. FIG. 2 is a conceptual diagram of panorama shooting processing in the present embodiment. FIG. 3A is a flowchart of the panorama shooting process in the present embodiment. FIG. 3B is a flowchart of the panoramic image creation process in the present embodiment. 3a and 3b are executed based on a command from the microcomputer 123 (control means) (control of the signal processing circuit 116).

  In the present embodiment, the operator operates the operation member 124 of the imaging apparatus 100 (camera) to set the imaging apparatus 100 to the panoramic shooting mode. Then, the microcomputer 123 starts the control shown in the flowcharts of FIGS. 3a and 3b.

  First, in step S101 of FIG. 3A, the microcomputer 123 determines whether or not the release SW (both switches SW1 and SW2) of the operation member 124 of the imaging apparatus 100 is on. The microcomputer 123 repeats this determination until the release SW is turned on. On the other hand, if the release SW is on, the process proceeds to step S102.

  In step S102, the imaging apparatus 100 measures the optimum exposure (first exposure) in the scene based on the instruction of the microcomputer 123, and takes an image 211 with the optimum exposure (first exposure). First image) is taken. Further, the imaging apparatus 100 captures an overexposed image 212 and an underexposed image 213 (a first image captured with the second exposure). Here, the first exposure is a first appropriate exposure that is determined to be appropriate for the first image. The second exposure is exposure determined to be underexposed or overexposed as the first image. As described above, in the present embodiment, a total of three images are captured as different first exposure images and stored in the buffer memory 122 (storage means). In these examples, “optimal” means that these images include an exposure that is evaluated as appropriate (appropriate exposure), and is not necessarily limited to the optimal exposure.

  In the present embodiment, the first image is an image that is first captured in order to generate a panoramic image. Further, in this embodiment, as the first image, the overexposed image 212 and the underexposed image 213 are taken as the first image taken with the appropriate exposure and the second exposure. You may comprise so that only an image may be image | photographed.

  Subsequently, in step S103, the microcomputer 123 determines whether or not the release SW (both switches SW1 and SW2) of the operation member 124 is on. This determination is repeated until the release SW is turned on. On the other hand, if the release SW is on, the process proceeds to step S104.

  In step S104, the microcomputer 123 measures the optimum exposure (appropriate exposure) of the second image (at least one image taken after the first image to generate a panoramic image). Then, the microcomputer 123 sets the appropriate exposure (first exposure) image 221 of the first image (first image) and the appropriate exposure of the second image as the second captured image (second image). An image 222 of (third exposure) is taken (FIG. 2a). Step S104 is repeated for the number of images (number of shooting times) necessary to generate a panoramic image. For example, when there is a third captured image, the microcomputer 123 sets the first exposure (first exposure) image 231 as the third captured image (second image). Then, an image 232 having a proper exposure (third exposure) of the third image is taken (FIG. 2a). These images are stored in the buffer memory 122 (storage means). In the present embodiment, the third exposure is a second appropriate exposure that is determined to be appropriate as the second image (at least one image taken after the first image).

  Subsequently, in step S105, the microcomputer 123 determines whether or not panoramic shooting has been completed. If panoramic shooting has not been completed yet, the process returns to step S103, and steps S103 to S105 are repeated. On the other hand, when panoramic shooting is completed, the process proceeds to step S106. In step S <b> 106, the microcomputer 123 creates a panorama image and records the created panorama image in the memory 120. Details of the panorama image creation process will be described later. Then, the panorama shooting process ends.

  Next, with reference to the flowchart of FIG. 3B, the panoramic image creation process (step S106 in FIG. 3A) in the present embodiment will be described in detail. First, in step S201, the microcomputer 123 is optimal as a whole when creating a panoramic image from the average value of optimum exposure (appropriate exposure) in all captured scenes (all captured images for generating a panoramic image). Find the exposure (appropriate exposure). In other words, the microcomputer 123 uses the first exposure (appropriate exposure of the first captured image) and the third exposure (appropriate exposure of the second and subsequent captured images) to properly adjust the entire plurality of images. A fourth exposure that is determined to be present is calculated. In the present embodiment, the fourth exposure is an average value of the first exposure and the third exposure. Subsequently, in step S202, the processes in steps S203 to S207 are repeated for the number of times of photographing. Thereafter, the process proceeds to step S208.

  In step S203, the microcomputer 123 has the same exposure as the optimum exposure (fourth exposure) obtained in step S201 on the nth image (first exposure and third exposure images). It is determined whether there is an image. If there is an image with the same exposure as the optimum exposure, the process proceeds to step S207. For example, in this embodiment, as shown in FIG. 2b, the optimal exposure (fourth exposure) calculated in step S201 is an overexposed image 212 (image 311) with respect to the first captured image. The exposure is the same. The fourth exposure is the same as the appropriate exposure (third exposure) of the third image 232 (image 331) for the third captured image. As described above, in the present embodiment, for the first and third captured images, since the image with the appropriate exposure has already been captured and stored, the process proceeds to step S207.

  On the other hand, if there is no image with the same exposure as the optimum exposure, the process proceeds to step S204. In step S204, the microcomputer 123 is the same as the optimum exposure (fourth exposure) obtained in step S202 during the exposure (first exposure and third exposure) of the nth image. It is determined whether there is an exposed image. If there is an image having the same exposure as the optimal exposure, the process proceeds to step S205. On the other hand, if there is no image with the same exposure as the optimum exposure, the process proceeds to step S206. In step S205, the microcomputer 123 synthesizes an image 321 having the same exposure as the optimum exposure obtained in step S202 from the two images (for example, using addition average synthesis). For example, in this embodiment, as shown in FIGS. 2a and 2b, the appropriate exposure (fourth exposure) of the plurality of images is the exposure (first exposure) of the image 221 with respect to the second shot image and the image. This is an exposure between 222 exposures (third exposure). Therefore, for the second captured image, the images 221 and 222 are combined to generate a fourth exposure image 321. Then, the process proceeds to step S207.

  In step S206, the microcomputer 123 gains up the exposure image (first exposure or third exposure image) close to the optimum exposure (fourth exposure), and obtains the optimum exposure obtained in step S202. An image having the same exposure as (fourth exposure) is generated. Then, the process proceeds to step S207.

  In step S <b> 207, the microcomputer 123 selects the designated image as a panoramic image at the n-th shooting, and stores it in the buffer memory 122. Subsequently, in step S208, as shown in FIG. 2b, panorama images are created by connecting (combining) the images 311 321 331 stored in step S207. That is, the signal processing circuit 116 combines the first image of the fourth exposure and the second image of the fourth exposure to generate a panoramic image. Then, the panoramic image creation process of the present embodiment ends.

  As described above, in this embodiment, the signal processing circuit 116 determines that the first exposure or the third exposure stored in the buffer memory 122 when the fourth exposure is the same as the first exposure or the third exposure. A panoramic image is generated using the second image. Further, the signal processing circuit 116, when the fourth exposure is an exposure between the first exposure and the third exposure, stores the first exposure and the second image of the third exposure stored in the buffer memory. Are combined to generate a second image of the fourth exposure. At this time, the signal processing circuit 116 performs, for example, addition average synthesis on the second image of the first exposure and the third exposure. In addition, when the fourth exposure is not between the first exposure and the third exposure, the signal processing circuit 116 increases the gain of the second image of the first exposure or the third exposure, and A second image of 4 exposures is generated.

  According to the present embodiment, at the time of panorama shooting, a plurality of exposure images are shot for each shooting, and after all the images have been shot, an overall exposure image is created and connected (combined) as a whole. Thereby, it is possible to provide a panoramic photograph with a proper exposure as a whole, with less uncomfortable feeling at the coupling portion and less dynamic range loss.

  Next, a panoramic image creation process according to the second embodiment of the present invention will be described. In this embodiment, an image with the optimum exposure (appropriate exposure) created in step S205 of FIG. 3b is created by using high dynamic range synthesis (HDR synthesis), and the addition average synthesis of the two images is performed. This is different from the first embodiment in which an image with optimum exposure is used. That is, the signal processing circuit 116 performs high dynamic range synthesis on the first image and the second image of the third exposure in step S205 of FIG. 3b.

  According to the present embodiment, at the time of panorama shooting, a plurality of exposure images are shot for each shooting, and after all the images have been shot, an overall exposure image is created and connected (combined) as a whole. As a result, it is possible to provide a panoramic photograph with a proper exposure as a whole, with less uncomfortable feeling at the joint and less dynamic range loss.

  Next, with reference to FIG. 3c, a panoramic image creation process according to the third embodiment of the present invention will be described. In this embodiment, the image with the optimum exposure (appropriate exposure) created in step S205 of FIG. 3b is either an average-average composition or a high dynamic range composition (HDR composition) depending on the shooting scene (by scene analysis processing). This is different from the first and second embodiments in that it is selected and created.

  FIG. 3C is a flowchart of the proper exposure image composition processing (step S205 in FIG. 3B) in this embodiment. Each step in FIG. 3C is executed based on a command from the microcomputer 123 (control means) (control of the signal processing circuit 116). First, in step S301, the microcomputer 123 performs scene analysis (photographing scene analysis processing) of the photographed image. Subsequently, in step S302, the microcomputer 123 determines whether the scene of the photographed image is a scene that places importance on the appearance of the subject as a result of the photographing scene analysis process in step S301. If the scene emphasizes the appearance of the subject, the process proceeds to step S303. On the other hand, if the scene does not place importance on the appearance of the subject, the process proceeds to step S304.

  In step S303, the microcomputer 123 generates an image having the same exposure as the optimal exposure from the two images using high dynamic range composition (HDR composition). Then, the optimal exposure image composition processing is terminated. On the other hand, in step S304, the microcomputer 123 generates an image having the same exposure as the optimal exposure from the two images by using addition average synthesis. Then, the optimal exposure image composition processing is terminated.

  According to the present embodiment, the optimal exposure image composition processing method is changed according to the shooting scene. As a result, it is possible to provide a panoramic photograph with a proper exposure as a whole, with less uncomfortable feeling at the combined portion of the panoramic image and less dynamic range loss.

(Other embodiments)
The object of the present invention can also be achieved as follows. That is, a storage medium in which a program code of software in which a procedure for realizing the functions of the above-described embodiments is described is recorded is supplied to the system or apparatus. A computer (or CPU, MPU, etc.) of the system or apparatus reads out and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium and program storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD-R, magnetic tape, nonvolatile memory card, ROM, or the like can also be used.

  Further, by making the program code read by the computer executable, the functions of the above-described embodiments are realized. Furthermore, when the OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, the following cases are also included. First, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

  Further, the present invention is not limited to a device mainly intended for shooting such as a digital camera, and includes an imaging device such as a mobile phone, a personal computer (laptop type, desktop type, tablet type, etc.), a game machine, or the like. Applicable to any device to be connected. Therefore, the “imaging device” in this specification is intended to include any electronic device having an imaging function.

  According to each embodiment, there are provided an imaging device, an imaging system, an imaging device control method, a program, and a storage medium that can reduce a sense of incongruity at a coupling portion and can obtain a panoramic photograph having appropriate exposure in the entire image. Can do.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

100 Imaging Device 116 Signal Processing Circuit 122 Buffer Memory 123 Microcomputer

Claims (15)

An imaging device capable of generating a panoramic image from a plurality of images including a first image and a second image,
Signal processing means for processing image signals;
Control means for controlling the signal processing means;
Storage means for storing a first image photographed with the first exposure and the second exposure and a second image photographed with the first exposure and the third exposure;
The control means calculates a fourth exposure determined to be appropriate for the whole of the plurality of images using the first exposure and the third exposure,
The image processing apparatus, wherein the signal processing unit combines the first image with the fourth exposure and the second image with the fourth exposure to generate the panoramic image. The first image is an image that was first taken to generate the panoramic image;
The imaging apparatus according to claim 1, wherein the second image is at least one image taken after the first image in order to generate the panoramic image. The first exposure is a first appropriate exposure determined to be appropriate as the first image,
The imaging apparatus according to claim 1, wherein the second exposure is an exposure determined to be underexposed or overexposed as the first image.   4. The image pickup apparatus according to claim 1, wherein the third exposure is a second appropriate exposure that is determined to be appropriate as the second image. 5.   5. The imaging apparatus according to claim 1, wherein the fourth exposure is an average value of the first exposure and the third exposure. 6.   When the fourth exposure is the same as the first exposure or the third exposure, the signal processing means is configured to store the first exposure or the third exposure stored in the storage means. The imaging apparatus according to claim 1, wherein the panoramic image is generated using two images.   The signal processing means, when the fourth exposure is an exposure between the first exposure and the third exposure, the first exposure and the third exposure stored in the storage means. The imaging apparatus according to claim 1, wherein the second image of the fourth exposure is generated by combining the second images.   8. The imaging according to claim 7, wherein the signal processing unit performs addition average synthesis on the second image of the first exposure and the third exposure stored in the storage unit. 9. apparatus.   The said signal processing means performs high dynamic range composition with respect to the said 2nd image of the said 1st exposure and the said 3rd exposure memorize | stored in the said memory | storage means. Imaging device. The control means determines whether to emphasize the appearance of the subject by performing a shooting scene analysis process,
The signal processing means includes
When it is determined that importance is placed on the appearance of the subject, high dynamic range composition is performed on the second image of the first exposure and the third exposure stored in the storage unit;
When it is determined that importance is not given to the appearance of the subject, addition average composition is performed on the second image of the first exposure and the third exposure stored in the storage unit. The imaging device according to claim 7.   The signal processing means gains the first exposure or the second image of the third exposure when the fourth exposure is not an exposure between the first exposure and the third exposure. The imaging apparatus according to claim 1, wherein the second image of the fourth exposure is generated. A lens device;
An imaging system comprising: the imaging device according to claim 1. An imaging apparatus control method capable of generating a panoramic image from a plurality of images including a first image and a second image,
Photographing the first image with a first exposure and a second exposure and storing the first image;
Photographing the second image with the first exposure and the third exposure and storing the second image;
Calculating a fourth exposure determined to be appropriate for the whole of the plurality of images using the first exposure and the third exposure;
And a step of generating the panoramic image by combining the first image of the fourth exposure and the second image of the fourth exposure.   14. A program configured to cause a computer to execute the control method for an imaging apparatus according to claim 13.   15. A storage medium storing the program according to claim 14.