JP2011238979A - Compound-eye imaging device and imaging method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simultaneously take a panoramic image and a zoom-up image of a main subject in the panoramic image.SOLUTION: A compound-eye imaging device comprises a first imaging unit which takes images of subjects at predetermined time intervals when the compound-eye imaging device is swung for main photographing and a second imaging unit which takes zoom-up images of a main subject in the images of the subjects while the compound-eye imaging device is swung. A plurality of continuous images of the subjects taken by the first imaging unit in the main photographing are composed to generate the panoramic image in the compound-eye imaging device. A position of the main subject is obtained from the images of the subjects taken when the compound-eye imaging device is swung at a preparation stage just before the main photographing to predict the position of the main subject for when the main photographing is performed from the position (S5). The second imaging unit 2 is controlled on the basis of the predicted position to take the zoom-up image of the main subject (S9).

Description

  The present invention relates to a compound-eye imaging device and a photographing method thereof, and more particularly, to take a panoramic image with one photographing unit by swinging the compound-eye imaging device by hand, and simultaneously at a high resolution of a main subject in the panoramic image with another photographing unit. The present invention relates to a photographing method for photographing an image (zoomed up image).

  Stereo cameras having two image pickup units provided in parallel have become commercially available, and anyone can easily take a stereoscopic image of a subject. When such compound eye imaging devices having a plurality of imaging units become widespread, there is a demand for taking a panoramic image with one imaging unit and taking a zoom-up image of a main subject in the panoramic image with another imaging unit. come.

  As cameras that can capture both wide-angle images and zoom-up images, for example, those described in Patent Documents 1 and 2 below are known. The camera described in Patent Document 1 is a surveillance camera, and an omnidirectional camera capable of capturing an omnidirectional image and a zoom-up camera are linked to each other, and when a moving object is present in the omnidirectional image, a zoom-up image of the moving object can be captured. I am doing so.

  The video conference camera described in Patent Document 2 is also provided with a wide-angle image capturing camera and a zoom-up camera so that an arbitrary subject in the wide-angle image can be photographed with the zoom-up camera by remote control.

  However, since the cameras described in Patent Documents 1 and 2 are cameras that fix a wide-angle image, the position of the main subject in the wide-angle image can be easily calculated. It is also easy to zoom up.

  On the other hand, when photographing with a hand-held portable compound eye imaging device, if the compound eye imaging device is fixed and photographed, a wide-angle image (panoramic image) is photographed with one of the plurality of imaging units. It is not possible.

  In order to capture a panoramic image, the user can swing the compound-eye imaging device by hand, acquire a plurality of continuous images during the swing, and paste these together to obtain a panoramic image.

  When taking a panoramic image in this way, a zoomed-up image of the main subject in the panoramic image is taken by another imaging unit, but the position of the main subject in the panoramic image is calculated during the swing. Therefore, the main subject (zooming operation or AF operation) cannot be performed in time by the zoom-up imaging unit.

JP 2007-36756 A JP 2000-32319 A

  An object of the present invention is to take a panoramic image with one imaging unit by swinging (rotating in a horizontal direction) a portable compound-eye imaging device, and to take a zoom-up image of a main subject in the panoramic image with another imaging unit. An object of the present invention is to provide an imaging method that can be used and a compound eye imaging device that implements the imaging method.

The compound eye imaging device of the present invention includes a first imaging unit and a second imaging unit,
The position of the main subject in the plurality of images is obtained from a plurality of consecutive images photographed by the first imaging unit when the compound-eye imaging device is rotated in the horizontal direction at the preparation stage before the main photographing. The position of the main subject when the main shooting is performed is predicted from the position, and when the compound eye imaging device is rotated in the horizontal direction when the main shooting is performed, a plurality of sheets that are continuous with the first imaging unit Control means for controlling the second imaging unit based on the predicted position and causing the second imaging unit to capture a zoomed-up image of the main subject;
Panoramic image synthesizing means for generating a panoramic image by synthesizing a plurality of continuous images captured by the first imaging unit during the main photographing.

The imaging method of the compound-eye imaging device of the present invention includes a first imaging unit and a second imaging unit, and generates a panoramic image by synthesizing a plurality of consecutive images captured by either imaging unit. An imaging method for an imaging apparatus,
The position of the main subject in the plurality of images is obtained from a plurality of consecutive images photographed by the first imaging unit when the compound-eye imaging device is rotated in the horizontal direction at the preparation stage before the main photographing. The position of the main subject when the main shooting is performed is predicted from the position, and when the compound eye imaging device is rotated in the horizontal direction when the main shooting is performed, a plurality of sheets that are continuous with the first imaging unit And the second imaging unit is controlled based on the predicted position so that the zoom-up image of the main subject is captured by the second imaging unit.

  According to the present invention, it is possible to simultaneously capture both a panoramic image and a zoomed-up image of a main subject in the panoramic image.

1 is an external perspective view of a compound eye imaging apparatus according to an embodiment of the present invention. It is a functional block diagram of the compound eye imaging device shown in FIG. It is a flowchart which shows the process sequence of the imaging | photography method which concerns on one Embodiment of this invention. It is explanatory drawing of the swing imaging | photography for panoramic image imaging | photography. FIG. 5 is a diagram illustrating a series of images taken in the swing of FIG. 4. It is a figure which shows the coordinate position of the main to-be-photographed object in each image shown in FIG. 6 is a zoomed-up image of the face of the main subject shown in FIG. It is a figure which shows an example of the guide display when performing swing imaging | photography. It is explanatory drawing of another embodiment of this invention. It is a flowchart which shows the process sequence of the imaging | photography method of another embodiment of this invention. It is explanatory drawing of another embodiment of this invention. It is a figure which shows the close-up image of the main subject image | photographed in embodiment of FIG. It is explanatory drawing of another embodiment of this invention. It is a flowchart which shows the process sequence of the imaging | photography method of another embodiment of this invention.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is an external perspective view of a compound eye imaging apparatus (stereo camera in the present embodiment). The stereo camera 10 is provided on a box-shaped housing 11, a right-eye imaging unit 12 </ b> R and a left-eye imaging unit 12 </ b> L provided side by side in front of the housing 11, and a front left shoulder portion of the housing 11. The flashlight 13 includes a power switch 14, a shutter button 15, and a mode selection dial 16 provided at appropriate positions on the upper surface of the housing 11.

  A liquid crystal display screen (monitor) 29 shown in FIG. 2 is provided on the back side of the housing 11 and a through image, a mode selection screen, a menu screen, a guide display described later, and the like are displayed.

  The imaging unit 12R includes a photographing lens 21R at the front, and the imaging unit 12L includes a photographing lens 21L at the front. An angle at which the optical axis 22R of the photographic lens 21R and the optical axis 22L of the photographic lens 21L intersect is called a convergence angle, and an actuator that controls the direction in which each of the imaging units 12R and 12L faces so that the convergence angle becomes a target value ( Lens control units 30L and 30R), which will be described later, are built in the stereo camera 10.

  The photographing lenses 21R and 21L can independently adjust the focus position and the zoom magnification. However, in the stereo photographing mode, the photographing lenses 21R and 21L are interlocked and controlled by the above-described actuators so that a stereoscopic image of the subject is obtained. Can be taken.

  Hereinafter, in this embodiment, a shooting method when shooting a panoramic image of a subject through the taking lens 21L and shooting a zoomed-up image of a main subject in the panoramic image through the taking lens 21R instead of a stereoscopic image will be described.

  FIG. 2 is an internal functional diagram of the stereo camera 10 shown in FIG. A solid-state image sensor 23L is disposed on the back of the photographic lens 21L, and a solid-state image sensor 23R is disposed on the back of the photographic lens 21R. The output signals of the solid-state image sensors 23L and 23R are connected to AFE (analog front end) circuits 24L and 24R, respectively, and the outputs of the AFE circuits 24L and 24R are connected to the bus 25.

  A CPU (system control unit) 26, a memory 27, an angular velocity sensor 28, and a liquid crystal display screen 29 are connected to the bus 25. The CPU 26 incorporates a DSP (digital signal processor) function for performing known image processing such as offset processing, gamma correction processing, RGB / YC conversion processing, and synchronization processing, and a clock function 26a.

  Lens control units 30L and 30R are connected to the CPU 26. The lens control unit 30L controls the focal position of the photographing lens 21L, the zoom magnification control, and the direction of the optical axis 22L in accordance with instructions from the CPU 26, and the lens control unit. 30R controls the focal position of the taking lens 21R, the zoom magnification control, and the direction of the optical axis 22R independently of the taking lens 21L according to an instruction from the CPU 26. At the time of stereo photographing, the lens control units 30L and 30R control the photographic lenses 21L and 21R to be linked to the same focal position at the same magnification according to an instruction from the CPU 26, and control the convergence angles of the optical axes 22L and 22R.

  3 uses the stereo camera 10 shown in FIG. 1 to take a panoramic image of a main subject (in this example, a person) by swinging, and at the same time, a zoom-up image of the main subject in the panoramic image (in this example, the face of a person's face). It is a flowchart which shows the imaging | photography method when image | photographing a zoom-up image.

  In the present embodiment, the preparatory shooting is performed at the preparation stage immediately before performing the main shooting. In this preparatory shooting, swing shooting (continuous shooting at a predetermined time interval) is performed at a wide angle angle of view using one of the imaging units (in this example, the shooting lens 21L and the solid-state imaging device 23L). Here, “swing” means, for example, that a user who takes a picture rotates the compound eye imaging apparatus held in his / her hand so as to draw an arc in the horizontal direction.

  Therefore, first, preparation for preparatory shooting (wide-angle setting of the taking lens, AF setting, etc.) is performed in step S1, and it is determined whether or not preparatory shooting has been started in step S2. If not, the process returns to step S1. If started, the process proceeds to step S3. In step S <b> 3, a plurality of captured continuous images are stored in the internal memory 27.

  FIG. 4 is an explanatory diagram of the preparation shooting. When shooting a subject image including the person 35, the camera user swings the stereo camera 10 and performs shooting in the continuous shooting mode (or moving image shooting mode). By this swing photographing, a plurality of continuous images are photographed at predetermined time intervals.

  FIG. 5 is a diagram illustrating a plurality of continuous images. A plurality of continuous images of the first 37, the second 38, the third 39, the fourth 40,... Are taken and stored in the internal memory 27 of FIG. The coordinate position of the person image 35a in each image gradually changes.

  FIG. 6 is a diagram illustrating position coordinates of a face image (zoom-up target image in this example) in the person image 35a. The coordinates are (x1, y1) for the first image and the coordinates (x2, y2) for the second image. Calculated. Assuming that the angular velocity at the time of swing is φ (including multiple directions) and the shooting time interval is t, the face motion prediction, the position where the face is detected (swing direction), and the elapsed time since the preparation shooting, The real-time position (position at the time of actual photographing) can be predicted.

Each evaluation value for the horizontal directions X1, X2,..., X (N−1)
X1 = f (x2-x1) / g (t, φ2-φ1)
X2 = f (x3-x2) / g (t, φ3-φ1)
...
And the motion of the face position can be predicted as “movement speed = distance / time”.

  The distance Z to the face can be calculated from the face area m. The distance Z can be used for focus control. Similarly, the vertical evaluation values Y1, Y2,..., Y (N-1) are obtained, and the zoom magnification is determined within a range in which the face image is not cut off when the face image is zoomed up from m and Y. The reason why the evaluation value Y is used for determining the zoom-up magnification is that it is difficult to capture the face image in the upper and lower middle of the screen.

  Returning to FIG. 3, in step S4 after step S3, it is determined whether or not a face image is detected in the captured image. If no face image is detected, the direction of the optical axis 22L when swinging is bad and it can be determined that the face image did not enter the captured image. The warning is notified by the screen display, and the process returns to step S1.

  If a face image is detected as a result of the determination in step S4, the process proceeds to step S5, where the position and size of the detected face image and the main subject may be moving, so motion prediction is performed, and the same The position of the face image in the case of shooting at an angle of view (later actual shooting) is predicted and calculated. This prediction calculation is continuously repeated until the actual photographing is completed, and the position of the face image is predicted in consideration of the elapsed time from the time when the preliminary photographing is performed.

  In the next step S6, the start angle of view is displayed on the liquid crystal display screen 29 as a guide. For example, a through image (wide-angle image) at the start of main shooting is displayed on the right half of the screen 29, and a wide-angle image at the time of preparation shooting disclosure (at the start of swing) is displayed on the left half of the screen 29 to prepare for main shooting. Start swinging from the same place as shooting.

  The guide display is not limited to this example, and other forms are possible. For example, the image at the start of the preparatory shooting is displayed on the screen 29 in a semi-transparent state, the through image at the start of the main shooting is also displayed in a semi-transparent state, and the user can align the images so that they match. good. You may display the arrow which shows the direction made to swing.

  In the next step S7, it is determined whether or not the main photographing is started. If not, the process returns to step S6. When the main shooting is started, the process proceeds to step S8, and one of the imaging units (in this example, the shooting lens 21L and the solid-state imaging device 23L) performs panoramic image swing shooting with a wide angle setting.

  The other imaging unit (photographing lens 21R, solid-state imaging device 23R) performs AF setting and zoom setting in accordance with the face position and face size of the main subject, and the optical axis is determined by the detection result of the angular velocity sensor 28. At the timing when the position facing 22R comes to the predicted position of the face image, shooting is performed with the face zoomed up to the limit where the face does not protrude from the angle of view (step S9), and this process ends.

  As a result, as shown in FIG. 7, a zoom-up image of the main subject 35 can be taken by the other imaging unit. The CPU 26 processes the zoomed-up image data and saves it on an external recording medium (not shown in FIG. 2), and also combines a series of continuous wide-angle image data to synthesize a panoramic image and saves it on the recording medium. To do.

  In the above-described embodiment, the “face” image is acquired as a zoom-up image. However, the image is not limited to the face, and may be an individual or an object registered in advance. Further, when a moving object is detected, a zoom-up image of the moving object may be taken.

  FIG. 8 is a diagram for explaining another embodiment of the guide display in step S6. For example, singular points may be extracted from an image obtained at the time of preparatory shooting and guidance may be performed. For example, when a certain star image 42 is extracted during the preparatory shooting, this is displayed on the guide screen, and the star image 43 of this singular point image is displayed on the screen during the main shooting, so that the user can start swinging during the main shooting. You can know the position.

  FIG. 9 is an explanatory diagram of another embodiment of the present invention. In the embodiment described with reference to FIG. 3, the swing direction during the preparatory shooting and the swing shooting direction during the main shooting are the same. However, as shown in FIG. 9, the time lag from the preparation shooting to the main shooting can be shortened by making the swing direction from the end of the swing to the main shooting in the reverse direction with respect to the direction swung during the preparation shooting. It is possible to reduce the deviation of the position prediction of the face image.

  Whether or not shooting is performed by the method of FIG. 10 may be determined by a setting by the user, or the stereo camera 10 may automatically determine and display the instruction on the display screen 29.

  FIG. 10 is a flowchart illustrating a processing procedure of an imaging method according to another embodiment of the present invention. The present embodiment is basically the same as the embodiment of FIG. 3 except that step S1a is performed instead of step S1 of FIG. In step S1 of FIG. 3, the setting is made so that a wide-angle image is taken with a single eye. However, in step S1a of the present embodiment, each imaging unit of the compound eye is set to a wide angle, and a preparatory shooting is performed with a compound eye to perform a stereoscopic image. The point of shooting is different.

  Since the preparatory shooting is a three-dimensional image shooting, the position and motion of the main subject can be predicted in 3D, and the position prediction and distance prediction accuracy can be improved.

  FIG. 11 is an explanatory diagram of still another embodiment of the present invention. When a plurality of main subjects 45, 46, and 47 are present in the panoramic image, if each main subject 45, 46, and 47 is included in a predetermined range and close to each other, individual high-resolution shooting (zoom-up shooting) is performed. ) May not be in time for optimal focus adjustment for each main subject.

  In such a case, the zoomed-in images 45a, 46a, 47a of the main subjects 45, 46, 47 are matched with the average focus position 48 of the main subjects 45, 46, 47 as shown in FIG. Take an image. As a result, it is possible to reduce the blurring of the zoomed-up image. Similarly, there may be insufficient time for changing the zoom-up magnification. In this case, a zoom-up image of each main subject is captured at the same zoom-up magnification.

  FIG. 13 is an explanatory diagram of still another embodiment of the present invention. In the embodiment of FIG. 11, zoomed-in images of the three main subjects 45, 46, 47 are taken using the average focus position 48 of the main subjects 45, 46, 47. However, there are cases where each zoom-up operation is not in time. In such a case, a zoom-up image is captured only for the main subject 46 having the largest size face image among the main subjects 45, 46, and 47.

  As a result, a high-resolution image of the main subject 46 can be captured under optimum conditions for focusing. Note that the main subject for shooting the zoom-up image may be determined by size, but for example, the zoom-up image may be shot with priority given to objects, persons, and objects registered in the camera 10 in advance.

  FIG. 14 is a flowchart showing a processing procedure of an imaging method according to still another embodiment of the present invention. The processing procedure of the present embodiment is basically the same as the processing procedure of the embodiment shown in FIG. 3, and the difference is that step S9a is performed instead of step S9.

  When taking a zoom-up image of the main subject, the camera may automatically determine and execute the necessity of flash emission. However, while one imaging unit is flashing and taking a zoomed-up image, the other imaging unit is taking a panoramic image by swinging using a wide-angle lens.

  In other words, the wide-angle image captured by swinging when flash emission is performed is an image with flash emission, and the wide-angle images connected before and after the image are images without flash emission. For this reason, when a panoramic image is synthesized using an image emitted with flash light, only a part of the panoramic image becomes an abnormally exposed image, resulting in a sense of incongruity.

  Therefore, in step S9a of this embodiment, the wide-angle image acquired at the time of flash emission is not used for panorama synthesis, but panorama synthesis is performed using the preceding and subsequent wide-angle images without flash emission. As a result, a panoramic image without a sense of incongruity and a zoomed-up image of the main subject can be obtained.

The compound-eye imaging device and imaging method thereof according to the embodiments described above include a first imaging unit and a second imaging unit, and a panoramic image is synthesized by combining a plurality of continuous images captured by either imaging unit. A compound eye imaging device for generating
The position of the main subject in the plurality of images is obtained from a plurality of consecutive images photographed by the first imaging unit when the compound-eye imaging device is swung in the preparatory stage before the main photographing, and the position And predicting the position of the main subject when the main photographing is performed, and causing the first imaging unit to photograph a plurality of continuous images when the compound-eye imaging device is swung when performing the main photographing. The second imaging unit is controlled based on the predicted position, and the zoom-up image of the main subject is photographed by the second imaging unit.

  In addition, the compound-eye imaging apparatus and the imaging method thereof according to the embodiment are characterized by instructing the main imaging to trace the same swing start position and swing direction as the swing in the preparation stage.

  In addition, the compound-eye imaging device and the imaging method thereof according to the embodiment are characterized by giving an instruction to perform the swing of the main imaging in a direction opposite to the swing of the preparation stage.

  In the compound eye imaging device and the imaging method thereof according to the embodiment, when imaging is performed in the preparation stage, a stereoscopic image is captured by the first imaging unit and the second imaging unit, and the main subject is detected from the stereoscopic image. It is characterized by predicting the position.

  In addition, in the compound-eye imaging device and the imaging method thereof according to the embodiment, when there are a plurality of the main subjects within a predetermined range, the focus position is aligned with the average position of each main subject, and each of the main subjects at the focus position. A zoom-up image is taken.

  In addition, the compound-eye imaging apparatus and imaging method thereof according to the embodiment are characterized in that, when there are a plurality of the main subjects within a predetermined range, each of the main subjects is captured as a zoom-up image with the same magnification.

  In addition, the compound-eye imaging device and the imaging method thereof according to the embodiment are characterized in that when there are a plurality of the main subjects within a predetermined range, one of the main subjects is selected and a zoom-up image is captured. .

  In addition, the compound-eye imaging device and the imaging method thereof according to the embodiment do not use the image captured by the first imaging unit at the time of flash emission when flash emission is performed during zoom-up imaging of the main subject. The panoramic image is synthesized.

  According to the compound eye imaging apparatus and the imaging method of the embodiment, it is possible to simultaneously capture a panoramic image and a zoomed-up image in which the main subject in the panorama image is in focus, and the usability of the compound eye imaging apparatus is improved. .

  According to the compound eye imaging device and the imaging method thereof according to the present invention, since a panoramic image and a zoomed-in image of the main subject can be acquired simultaneously, a user-friendly compound eye imaging device can be provided, and a variety of usage forms such as a stereo camera can be provided. This is useful.

DESCRIPTION OF SYMBOLS 10 Compound eye imaging device 15 Release button 21L, 21R Shooting lens 23L, 23R Solid-state image sensor 26 System controller (CPU)
26a Clock function 27 Memory 28 Angular velocity sensor 29 Display screen 30L, 30R Lens control unit 35, 45, 46, 47 Main subject 35a, 45a, 46a, 47a Main subject image

Claims (16)

A first imaging unit and a second imaging unit;
The position of the main subject in the plurality of images is obtained from a plurality of consecutive images photographed by the first imaging unit when the compound-eye imaging device is rotated in the horizontal direction at the preparation stage before the main photographing. The position of the main subject when the main shooting is performed is predicted from the position, and when the compound eye imaging device is rotated in the horizontal direction when the main shooting is performed, a plurality of sheets that are continuous with the first imaging unit Control means for controlling the second imaging unit based on the predicted position and causing the second imaging unit to capture a zoomed-up image of the main subject;
A compound-eye imaging apparatus comprising: a panoramic image synthesizing unit that generates a panoramic image by synthesizing a plurality of consecutive images captured by the first imaging unit during the main photographing.   2. The compound eye imaging apparatus according to claim 1, further comprising guide display means for instructing tracing of the same rotation start position and rotation direction as the horizontal rotation in the preparation stage in the main photographing.   The compound-eye imaging apparatus according to claim 1, wherein the compound-eye imaging apparatus performs an instruction to perform the rotation of the main photographing in a direction opposite to the rotation in the horizontal direction in the preparation stage.   The compound eye imaging device according to any one of claims 1 to 3, wherein the first imaging unit and the second imaging unit capture a stereoscopic image when capturing in the preparation stage, A compound-eye imaging apparatus that predicts the position of the main subject from the stereoscopic image.   5. The compound-eye imaging device according to claim 1, wherein when a plurality of the main subjects exist within a predetermined range, the focal position is adjusted to an average position of each main subject. A compound-eye imaging apparatus that captures a zoom-up image of each of the main subjects at a focal position.   6. The compound-eye imaging apparatus according to claim 1, wherein when there are a plurality of main subjects within a predetermined range, each of the main subjects is used as a zoom-up image with the same magnification. A compound eye imaging device for photographing.   5. The compound-eye imaging apparatus according to claim 1, wherein when there are a plurality of the main subjects within a predetermined range, one of the main subjects is selected and a zoom-up image is selected. Compound eye imaging device.   8. The compound-eye imaging apparatus according to claim 1, wherein when the flash emission is performed during zoom-up shooting of the main subject, the first imaging unit performs the flash emission. A compound-eye imaging device that synthesizes the panoramic image without using a photographed image. An imaging method of a compound eye imaging device that includes a first imaging unit and a second imaging unit, and generates a panoramic image by synthesizing a plurality of continuous images captured by any one imaging unit,
The position of the main subject in the plurality of images is obtained from a plurality of consecutive images photographed by the first imaging unit when the compound-eye imaging device is rotated in the horizontal direction at the preparation stage before the main photographing. The position of the main subject when the main shooting is performed is predicted from the position, and when the compound eye imaging device is rotated in the horizontal direction when the main shooting is performed, a plurality of sheets that are continuous with the first imaging unit And a second imaging unit that controls the second imaging unit based on the predicted position and causes the second imaging unit to capture a zoom-up image of the main subject. The imaging method of the compound eye imaging apparatus according to claim 9, wherein the main imaging is instructed to trace the same rotation start position and rotation direction as the horizontal rotation in the preparation stage.   The imaging method of the compound-eye imaging device according to claim 9, wherein the imaging method of the compound-eye imaging device performs an instruction to perform the horizontal rotation of the main imaging in a direction opposite to the horizontal rotation in the preparation stage. .   12. The imaging method of the compound eye imaging device according to claim 9, wherein a stereoscopic image is captured by the first imaging unit and the second imaging unit when imaging is performed in the preparation stage. An imaging method of a compound eye imaging apparatus that captures an image and predicts the position of the main subject from the stereoscopic image.   The imaging method of the compound eye imaging device according to any one of claims 9 to 12, wherein when there are a plurality of the main subjects within a predetermined range, a focal position is set at an average position of each main subject. And taking a zoomed-up image of each of the main subjects at the focal position.   The imaging method of the compound eye imaging device according to any one of claims 9 to 13, wherein when there are a plurality of the main subjects within a predetermined range, each of the main subjects is zoomed at the same magnification. An imaging method of a compound eye imaging device that captures an up-image.   The imaging method of the compound eye imaging device according to any one of claims 9 to 12, wherein when there are a plurality of the main subjects within a predetermined range, one of the main subjects is selected. An imaging method of a compound eye imaging apparatus that captures a zoom-up image.   The imaging method of the compound eye imaging device according to any one of claims 9 to 15, wherein when the flash emission is performed during zoom-up imaging of the main subject, the first emission is performed when the flash is emitted. An imaging method for a compound-eye imaging apparatus that synthesizes the panoramic image without using an image captured by an imaging unit.

Images