JP3054146B1 - Panoramic image device - Google Patents

Abstract

A panoramic image apparatus capable of conveniently and effectively taking an image having a 360-degree field of view. A panoramic image device is disclosed. It uses a hyperbolic convex mirror (11) to reflect an image from a 360 degree field of view to a camera (12). Hyperbolic convex mirror, hyperbolic equations ^{(y 2 / B 2) -} (x 2 / A 2) = have a curved surface according to l. The camera has a lens facing the hyperbolic convex mirror.
The camera is located where its optical center coincides with the focal point corresponding to that of the hyperbolic convex mirror, thereby taking an annular image reflected from the hyperbolic convex mirror. A computer (13) is provided for mapping the annular image to a spherical, cylindrical or cubic coordinate system;
Thereby, the annular image is further changed to a plane image displayed based on a specific observation angle.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a panoramic image apparatus, and more particularly, to a panoramic image system that uses a hyperbolic convex mirror to reflect an image from a 360 degree field of view to a camera.

[0002]

2. Description of the Related Art Panoramic imaging devices are commonly used in surveillance systems, video conferencing or virtual reality to convey images to a user from a 360 degree field of view. One of the conventional panoramic image devices uses a rotatable camera for taking a 360-degree image. In another example, there are multiple cameras that take images so that the fields of view overlap and then combine them to form a panoramic image. However, the use of a rotatable camera can only take an instantaneous image from a particular field of view at a time. further,
The rotating mechanism for driving the rotatable camera requires a significant power source and is easily broken due to the weight of the mechanism and the camera. On the other hand, the use of multiple cameras is expensive. Further, it is difficult to integrate images taken by different cameras to create a panoramic image. Eventually, optical elements that take an image with a 360 degree field of view and thereby form a panoramic image are possible. Unfortunately, images taken with optical elements are usually smeared and distorted. Therefore, there is a need here for an improved panoramic image device.

[0003]

SUMMARY OF THE INVENTION The object of the present invention is to
An object of the present invention is to provide a panoramic image apparatus which can conveniently and effectively take an image having a 0 degree field of view.

[0004]

To achieve this object, a panoramic image apparatus according to the present invention comprises a hyperbolic convex mirror, a camera and a computer. The hyperbolic convex mirror, hyperbolic equations (y ² / B ²⁾ - has a curved surface according to ^{(x 2 / A 2) =} 1. The camera has a lens facing the hyperbolic convex mirror. The camera is located where its optical center overlaps a focal point corresponding to the focal point of the hyperbolic convex mirror. The computer displays the annular image in a polar coordinate system,
It maps to a cylindrical or cubic coordinate system, and is further connected to the camera to convert the annular image to a planar image for display based on a particular viewing angle.

[0005] Other objects, advantages and novel features of the present invention will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Referring to FIG. 1, a panoramic image apparatus according to the present invention utilizes a hyperbolic convex mirror 11 for reflecting a 360-degree image with respect to a camera 12. Camera 1
2 is arranged so that its lens faces the reflecting surface of the hyperbolic convex mirror 11. Therefore, the camera 12
As shown in FIG. 2A, an annular image 21 including all objects is captured from a 360-degree field of view. Ring image 2
The shape of the object in 1 is annularly distorted, so that the annular image 21 is not distorted to change it into a linear panoramic image 23 as shown in FIG. 2B to be displayed. In order to do so, a computer 13 is connected to the camera 12, wherein the shape of the object is no longer distorted. 3A and 3B show an example of an annular image and an example of a corresponding image after removing distortion.

The curved surface of the hyperbolic convex mirror 11 follows the hyperbolic equation (y ² / B ² ) − (x ² / A ² ) = 1. Referring to FIG. 4, the hyperbola is characterized by reflecting light substantially passing through the first focal point 41 and reaching the corresponding second focal point 42. Therefore, the camera 12 has its optical center
When positioned to be at the focal point 42 of the object, the objects in the resulting panoramic image are not distorted because they are viewed from the same viewpoint.

Referring again to FIG. 2A, when using the camera 12 to take the annular image from the hyperbolic convex mirror 11, the camera 12 is actually a circular image including an internal image 22 and an internal image. An annular image 21 surrounding the image 22 is taken. The internal image 22 is a reflection image of the camera 12 itself. The annular image 21 is a desired reflection image from a 360-degree field of view. Therefore, the annular image 21 must be sharp, while the sharpness of the internal image 22 is not important. The hyperbola has a high curvature at its center (as a curve),
It also has a low curvature on its outer part, so that the image reflected by its outer part is sharp and the image reflected by its inner part is blurred. In other words, the hyperbolic convex mirror 11 allows the camera 12 to take a sharp annular image 21 containing the object from a 360 degree field of view.

Referring to FIG. 5, the dimensions of the preferred embodiment of the present invention are shown. The hyperbolic convex mirror 11 has a diameter 51 of 30 mm, a height 52 of 15.82 mm, and an observation angle 5 of 73 degrees.
3 range. The corresponding hyperbolic equation (y ² /
For the parameter B ² )-(x ² / A ² ) = 1, A is 19.36 mm and B is 25 mm.

An annular image 21 taken by the camera 12
Must be processed by the computer 13 in order to eliminate distortion, which turns the annular image 21 into an image having a geometrically correct shape. To achieve this, one must find the relationship between any point in the annular image 21 and a coordinate system such as spherical, cylindrical, or cubic coordinates, thereby creating an annular shape. Is mapped to a specific coordinate system. For example, taking a spherical coordinate system, when the user determines a desired viewing angle, the annular image 21 mapped to the spherical coordinates is (quick image).
It can be changed to a plane image according to a known panoramic display method (such as Quick-Time VR). A in FIG.
And B show how to map the annular image onto a spherical coordinate system. Considering the unit spheres collected at the observation point (view point) (0, C), the horizontal angle φ and the elevation angle / depression angle θ of the spherical coordinates
Given that we want to know its location in the annular image (see FIG. 6B). Annular image 21
Can be represented by polar coordinates (see FIG. 6A),
Also, since the value of the horizontal angle φ of the spherical coordinates is equal to that of the annular image 21 in the spherical coordinates, only the elevation angle / depression angle θ has to be considered. That is. The key to performing the mapping is between a given elevation / depression angle θ and the corresponding pixel location d (d is the distance between the corresponding pixel and the center of the annular image). Is to know the relationship. Here, it is assumed that the line K = FP has an elevation angle / depression angle θ. Since the line K passes through (0, C) and has a slope of tan θ, K can be expressed as follows.

K : y = Tx + c Here, T = tan θ.

P is a contact point between K and the hyperbolic equation. Here, if P = (Px, Py), Px = (-A ² TC + A ² BS) / (A ²
T ² -B ² ) and Py = (− B ² C + A ² BTS) / (A ² T ² -B ² ). Here, S = (T ² +1) ^1/2 .

When P is known, a line L is obtained by connecting P and (0, -C). The desired d can be obtained from the intersection of L and y = -Cf. Here, f is the focus of the camera 12. After the calculation, d = f (−A ² TC + A ² BS) / W is obtained. Where W = (A ²
T ² C-2B ² C + A ² BTS).

When the mapping relation is found, a circular image 2
1 can be converted to the spherical coordinate system. Then
Known panoramic display methods for image conversion between planar coordinates and spherical coordinates can be applied to obtain a desired panoramic image.

Although the present invention has been described with reference to preferred embodiments thereof, many other possible modifications and variations are possible without departing from the spirit and scope of the invention as set forth in the appended claims.

[Brief description of the drawings]

FIG. 1 is a schematic diagram of a panoramic image device according to the present invention.

FIG. 2A is a schematic diagram of an annular image taken by a camera reflected from a hyperbolic convex mirror of a panoramic imager, and B is obtained by performing a distortion removal process on the annular image of A. It is a schematic diagram of the obtained linear panoramic image.

FIG. 3A is an example of an annular image, and B is a linear panoramic image obtained by performing a distortion removing process on the annular image of A.

FIG. 4 shows the reflection of light substantially through a hyperbolic first focus to a corresponding second focus.

FIG. 5 shows the dimensions of a hyperbolic convex mirror according to the invention.

FIG. 6A is polar coordinates for an annular image, and B shows the relationship between elevation / depression angles of spherical coordinates and pixels of the annular image.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 Hyperbolic convex mirror 12 Camera 13 Computer 21 Circular image (annular image) 23 Linear panoramic image 41, 42 1st focus and 2nd focus

────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP-A-10-206939 (JP, A) JP-A-61-107340 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G03B 37/00-37/06 H04N 5/225

Claims (3)

(57) [Claims] 1. A panoramic image apparatus, comprising: a first focus; a second focus corresponding to the first focus and the first focus;
Hyperbolic equation with two focal points (y ² / B ² )
a hyperbolic convex mirror having a curvature according to (x ² / A ² ) = 1, and a camera having a lens opposite to the hyperbolic convex mirror, the optical center of which overlaps the second focal point, whereby the hyperbolic convex mirror A camera arranged at a location where the reflected circular image is taken, and for mapping the circular image to a predetermined coordinate system in order to change the circular image into a plane image displayed based on a specific observation angle. And a computer connected to said camera. 2. The method according to claim 1, wherein the predetermined coordinate system is a polar coordinate system,
The annular image mapped to the polar coordinate system is changed to a plane image according to a panoramic display method, the predetermined coordinate system is formed of a cubic coordinate system, and the annular image is represented by a formula d = f (-A ² TC + A ²
BS) / W, where d is the distance between the pixel and the center of the annular image, C ² = A ² + B ² , f is the focus of the camera, and S ² = T ² +1, W = (A ² T ² C-2B ² C + A ² BTS), T = tan θ, and θ is the elevation angle / depression angle of the polar coordinate system, d = f (−A The panoramic image device according to claim 1, wherein the panoramic image device can be mapped to the polar coordinate system according to ² TC + A ² BS) / W. 3. The method according to claim 1, wherein the predetermined coordinate system is a cylindrical coordinate system, and the annular image mapped on the cubic coordinate system is converted into a plane according to a panoramic display method, and the annular image mapped on the cylindrical coordinate system is formed. The image is converted to a planar image according to the panoramic display method, wherein the hyperbolic convex mirror has a diameter of 30 mm, 15.8
2mm height, and has a range of 73 degrees of the viewing angle, also, the hyperbolic equation ^{(y 2 / B 2) -} (x 2 / A 2) = 1 is 19.36Mm A
2. The panoramic imaging device according to claim 1, wherein the panoramic image device has a B of 25 mm.