JP3194790B2 - Gaze direction detection device - Google Patents
Gaze direction detection deviceInfo
- Publication number
- JP3194790B2 JP3194790B2 JP15799092A JP15799092A JP3194790B2 JP 3194790 B2 JP3194790 B2 JP 3194790B2 JP 15799092 A JP15799092 A JP 15799092A JP 15799092 A JP15799092 A JP 15799092A JP 3194790 B2 JP3194790 B2 JP 3194790B2
- Authority
- JP
- Japan
- Prior art keywords
- light
- eyeball
- cornea
- line
- center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B2213/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B2213/02—Viewfinders
- G03B2213/025—Sightline detection
Landscapes
- Focusing (AREA)
- Automatic Focus Adjustment (AREA)
- Eye Examination Apparatus (AREA)
Description
【0001】[0001]
【産業上の利用分野】本発明は、視線の方向を検出する
視線方向検出装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a gaze direction detecting device for detecting a gaze direction.
【0002】[0002]
【従来の技術】近時、生体の視線方向を検出し、その視
線方向に応じて各種の制御が行なわれるようになってき
ている。2. Description of the Related Art Recently, the gaze direction of a living body has been detected, and various controls have been performed in accordance with the gaze direction.
【0003】たとえば、自動焦点カメラでは、ファイン
ダー内に複数の合焦ゾーンを設け、被写体のファインダ
ー内での被写体の位置に対応して、合焦ゾーンを選択す
ることにより、構図に制限を受けることなく、目的とす
る被写体に焦点を合わせて撮影できるようにしている。
このような場合、合焦ゾーンの選択切換に当たって、フ
ァイダー内における撮影者の視線方向を検出して、その
視線が向いた合焦ゾーンを選択すれば、手動による切換
操作を要することなく、撮影対象の被写体に対応した合
焦ゾーンを自動的に選択することができる。For example, in an autofocus camera, the composition is restricted by providing a plurality of focusing zones in a viewfinder and selecting a focusing zone according to the position of the subject in the viewfinder. Instead, it is possible to focus on the target subject and shoot.
In such a case, when the selection of the focusing zone is switched, the direction of the line of sight of the photographer in the viewfinder is detected, and the focusing zone to which the line of sight is directed is selected. The focus zone corresponding to the subject can be automatically selected.
【0004】このような用途に用いられる従来の視線方
向検出装置としては、たとえば図5で示すように、赤外
光を発するLED等の発光素子11により、眼球の虹彩12
と鞏膜13との境界部である虹彩輪部12a を照明し、反射
光を2つの光検出素子14a ,14b で捕らえ、これら両光
検出素子14a ,14b からの出力信号の強度差に基づいて
水平方向の視線方向検出を行なうものがある。As a conventional gaze direction detecting device used for such an application, for example, as shown in FIG. 5, an iris 12 of an eyeball is formed by a light emitting element 11 such as an LED emitting infrared light.
The iris 12a, which is the boundary between the iris and the sclera 13, is illuminated, the reflected light is captured by the two photodetectors 14a and 14b, and the reflected light is leveled based on the intensity difference between the output signals from the two photodetectors 14a and 14b. There is one that detects the direction of the line of sight.
【0005】この図5に示す視線方向検出装置は、虹彩
12と鞏膜13との光反射率の違いを利用したものであり、
図5のように視線が概ね正面にあれば、2つの光検出素
子14a ,14b の出力強度はほぼ等しく、また、たとえば
図6に示すように視線が左方向を向いている場合は、光
検出素子14a の出力が光検出素子14b より大きくなり、
さらに視線が右を向いた場合は、反対に、光検出素子14
b の出力が光検出素子14a より大きくなる。すなわち、
両光検出素子14a ,14b の出力差を検出することにより
水平方向の視線方向検出を行なっている。The gaze direction detecting device shown in FIG.
It utilizes the difference in light reflectance between 12 and sclera 13,
When the line of sight is substantially in front as shown in FIG. 5, the output intensities of the two photodetectors 14a and 14b are substantially equal. For example, when the line of sight is directed to the left as shown in FIG. The output of the element 14a becomes larger than that of the photodetector 14b,
If the line of sight further turns right, on the contrary,
The output of b becomes larger than that of the photodetector 14a. That is,
The detection of the horizontal line-of-sight direction is performed by detecting the output difference between the two light detection elements 14a and 14b.
【0006】しかし、両光検出素子14a ,14b の出力差
を検出するには、前述のように虹彩輪部12a を照明する
必要があるため、ある程度広い範囲を照明しなければな
らない。このため、眼の瞼や睫の影響を受けてしまい、
十分に精度良く反射光の強度差検出を行なうことができ
ない。However, in order to detect the output difference between the two photodetectors 14a and 14b, it is necessary to illuminate the iris ring portion 12a as described above. For this reason, it is affected by eyelids and eyelashes,
It is not possible to detect the intensity difference of the reflected light with sufficient accuracy.
【0007】また、他の従来技術としてはたとえば特開
昭61−172552号公報で示すように、眼球の一部
を平行光で照明し、平行光によって発生する角膜前面か
らの反射像である第1プルキンエ像と瞳中心の位置とか
ら、視線方向を検出するものや、たとえば特開平2−5
号公報で示すように、第1プルキンエ像と目の眼底から
の反射光との受光出力から視線方向を検出するもの等が
知られている。As another prior art, for example, as disclosed in Japanese Patent Application Laid-Open No. Sho 61-172552, a part of an eyeball is illuminated with parallel light and a reflected image generated from the front surface of the cornea generated by the parallel light. One that detects the direction of the line of sight from one Purkinje image and the position of the center of the pupil;
As disclosed in Japanese Unexamined Patent Application Publication No. H11-107, there is known an apparatus that detects a line-of-sight direction from a light reception output of a first Purkinje image and light reflected from the fundus of the eye.
【0008】以下、角膜からの反射像である第1プルキ
ンエ像について説明する。通常、凸面鏡を平行光で照明
すると、光学的に無限の距離にある光学像が凸面鏡の表
面とその曲率中心との中点に光点となって現れる。目の
角膜においても平行光線を照射すると、角膜の形状およ
び角膜表面の鏡面反射により、同様に光点を形成する。
そして、この光点が第1プルキンエ像である。Hereinafter, the first Purkinje image which is a reflection image from the cornea will be described. Normally, when a convex mirror is illuminated with parallel light, an optical image at an optically infinite distance appears as a light spot at the midpoint between the surface of the convex mirror and its center of curvature. When the cornea of the eye is irradiated with parallel rays, a light spot is similarly formed due to the shape of the cornea and the specular reflection of the corneal surface.
This light spot is the first Purkinje image.
【0009】この関係を図7により説明する。図7にお
いて16は角膜で、この角膜16の曲率中心をCcとする。ま
た、17は眼球で、この眼球17の回転中心をCrとする。ま
た、これら角膜16の曲率中心Ccと眼球17の回転中心Crと
の距離をdcとする。そして、図7において、破線は視線
が正面にあるときの角膜16および眼球17の状態を示し、
実線は視線が右に角度θ傾いたときの角膜16および眼球
17の状態を示している。This relationship will be described with reference to FIG. In FIG. 7, reference numeral 16 denotes a cornea, and the center of curvature of the cornea 16 is denoted by Cc. Reference numeral 17 denotes an eyeball, and the center of rotation of the eyeball 17 is Cr. The distance between the center of curvature Cc of the cornea 16 and the center of rotation Cr of the eyeball 17 is defined as dc. And, in FIG. 7, the broken line indicates the state of the cornea 16 and the eyeball 17 when the line of sight is in front,
The solid lines show the cornea 16 and the eyeball when the line of sight is inclined to the right by the angle θ.
17 state is shown.
【0010】ここで、眼球17の正面に位置する図示しな
い基準光源からの平行光は、視線が正面を向いている場
合は、角膜16の曲率中心Ccと角膜16表面の反射点Icとを
結ぶ直線の中点PIに第1プルキンエ像18が観測される。
これに対し、前述のように眼球17が角度θだけ右に回転
すると、角膜16の曲率中心CcはCc1 の位置に移動し、角
膜16の表面の入射平行光線の反射点Ic1 との中点PI1 に
第1プルキンエ像18が移動する。すなわち、第1プルキ
ンエ像18は、眼球17の回転方向と同じ方向に移動するこ
ととなる。Here, the parallel light from the reference light source (not shown) located in front of the eyeball 17 connects the center of curvature Cc of the cornea 16 and the reflection point Ic on the surface of the cornea 16 when the line of sight is facing the front. The first Purkinje image 18 is observed at the midpoint PI of the straight line.
In contrast, when the eye 17 as described above is rotated to the right by the angle theta, the center of curvature Cc of the cornea 16 is moved to the position of Cc 1, in a reflecting point Ic 1 of incident parallel light rays on the surface of the cornea 16 the first Purkinje image 18 is moved to the point PI 1. That is, the first Purkinje image 18 moves in the same direction as the rotation direction of the eyeball 17.
【0011】一方、眼球17を正面から見たときの第1プ
ルキンエ像18の水平方向の移動距離L1は次式で得られ
る。On the other hand, the horizontal movement distance L1 of the first Purkinje image 18 when the eyeball 17 is viewed from the front is obtained by the following equation.
【0012】[0012]
【式1】 このように、眼球17の角膜16を平行光で照明し、この照
明によって生じる第1プルキンエ像18の位置の変化を検
出すれば、視線の方向を検出することができる。しか
し、実際には、角膜16の曲率中心Ccと眼球17の回転中心
Crの距離dcそのものが僅かであることから、視軸の角度
変化に対する第1プルキンエ像18の移動量は、式1から
明らかなように極僅かであり、頭の僅かな移動等がある
と、頭の僅かな移動と視線方向の移動とを判別がするこ
とができない。(Equation 1) Thus, by illuminating the cornea 16 of the eyeball 17 with parallel light and detecting a change in the position of the first Purkinje image 18 caused by the illumination, the direction of the line of sight can be detected. However, in practice, the center of curvature Cc of the cornea 16 and the center of rotation of the eyeball 17
Since the distance dc of Cr itself is small, the amount of movement of the first Purkinje image 18 with respect to the change in the visual axis angle is extremely small as is apparent from Equation 1, and if there is a slight movement of the head, A slight movement of the head and a movement in the line of sight cannot be distinguished.
【0013】そこで、このような問題を解決すべく、特
開昭61−172552号公報記載の構成では、瞳孔中
心位置を検出し、また、特開平2−5号公報記載の構成
では、目の眼底からの反射光を測定している。In order to solve such a problem, the configuration described in Japanese Patent Application Laid-Open No. 61-172552 detects the center of the pupil, and the configuration described in Japanese Patent Application Laid-Open No. The reflected light from the fundus is measured.
【0014】しかし、特開昭61−172552号公報
および特開平2−5号公報記載の構成では、それぞれ角
膜16からの反射像である第1プルキンエ像18を利用して
いるため、照明光として瞳をカバーできるような広いビ
ーム径の平行光が必要となる。このため、照明光学系と
してレンズを含む複雑な光学部品が必要となる。また、
反射像である第1プルキンエ像18を光検出器上に結像さ
せる必要があるため、検出光学系が必要となり、装置全
体の小型化および軽量化が困難である。また、前述した
ように、もともと第1プルキンエ像18の視線方向変化に
対する位置変化量が僅かであるため、特開昭61−17
2552号公報および特開平2−5号公報記載の構成で
説明したような構成としても、十分な精度を得ることは
難しい。However, in the configurations described in Japanese Patent Application Laid-Open Nos. 61-172552 and 2-5, since the first Purkinje image 18 which is a reflection image from the cornea 16 is used, illumination light is used. Parallel light with a wide beam diameter that can cover the pupil is required. For this reason, a complicated optical component including a lens is required as an illumination optical system. Also,
Since it is necessary to form the first Purkinje image 18 as a reflection image on the photodetector, a detection optical system is required, and it is difficult to reduce the size and weight of the entire apparatus. Also, as described above, since the amount of change in the position of the first Purkinje image 18 with respect to the line-of-sight direction is originally small,
It is difficult to obtain sufficient accuracy even with the configuration described in Japanese Patent Application Laid-Open No. 2552 and Japanese Patent Application Laid-Open No. 2-5-5.
【0015】[0015]
【発明が解決しようとする課題】このように、虹彩12と
鞏膜13との光反射率の違いを利用して視線方向を検出す
るものは、眼の瞼や睫の影響により、十分に精度良く検
出を行なうことができず、また、第1プルキンエ像18を
利用するものでは、装置全体の小型化および軽量化が困
難であるとともに十分な精度を得難い等の問題点を有し
ている。As described above, the method of detecting the direction of the line of sight using the difference in the light reflectance between the iris 12 and the sclera 13 is sufficiently accurate due to the influence of the eyelids and eyelashes. In the case where detection cannot be performed and the first Purkinje image 18 is used, there are problems that it is difficult to reduce the size and weight of the entire apparatus and to obtain sufficient accuracy.
【0016】本発明の目的は、複雑な光学系を必要とせ
ず小型軽量に構成でき、しかも高い検出精度を得ること
ができる視線方向検出装置を提供することにある。An object of the present invention is to provide a line-of-sight direction detecting device which can be made compact and lightweight without requiring a complicated optical system, and which can obtain high detection accuracy.
【0017】[0017]
【課題を解決するための手段】本発明による視線方向検
出装置は、眼球の中心部に向かって、前記眼球の瞳の大
きさに比して十分に細い概平行光線を発する光源装置
と、前記概平行光線の前記眼球の角膜からの反射光を受
光し、前記眼球の中心部に対する受光位置の関係を2次
元で検出する光検出装置と、この光検出装置の受光位置
を基に角膜からの反射角を求める制御回路とを備えたも
のである。A gaze direction detecting apparatus according to the present invention comprises: a light source device for emitting substantially parallel light rays toward a center of an eyeball, the light being sufficiently thin compared to the size of a pupil of the eyeball; The reflected light from the cornea of the eyeball of the substantially parallel light ray is received, and the relation of the light receiving position with respect to the center of the eyeball is quadratic.
Photodetector to detect the light source and the light receiving position of this photodetector
And a control circuit for calculating the angle of reflection from the cornea based on the
【0018】[0018]
【作用】本発明では、眼球の中心部に対して細い光束の
概平行光線を照射し、眼球の角膜表面からの反射光を受
光し、この反射光の受光位置を2次元で測定し、制御回
路でこの受光位置から反射角を検出する。この角膜表面
の反射角と眼球の回転角、すなわち視線の方向とは所定
の関係が成り立つので、この反射角から視線方向を検出
する。In the present invention, by irradiating the approximate parallel light of a narrow light beam with respect to the center of the eye, receiving light reflected from the corneal surface of the eye, measuring the receiving position of the reflected light in two dimensions, the control Times
The reflection angle is detected from the light receiving position on the road . Since a predetermined relationship is established between the angle of reflection of the corneal surface and the angle of rotation of the eyeball, that is, the direction of the line of sight, the line of sight is detected from the angle of reflection.
【0019】[0019]
【実施例】以下、本発明の視線方向検出装置の一実施例
を図面を参照して説明する。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the gaze direction detecting apparatus according to the present invention will be described below with reference to the drawings.
【0020】図1ないし図4において、21は光源装置
で、この光源装置21は眼球17の中心部に向かって、眼球
17の瞳の大きさに比して十分に細い概平行光線Bを発す
る。この光源装置21は、赤外光を照射するLED等によ
る光源22を有し、この光源22の前面側には光源22からの
光を概平行光線Bにするためのレンズ23が設けられてい
る。また、このレンズ23の出射側にはスリット板24が、
眼球17の瞳の大きさに比して十分に細い概平行光線を得
るように設けられている。In FIGS. 1 to 4, reference numeral 21 denotes a light source device.
It emits a substantially parallel light beam B which is sufficiently thin compared to the size of the pupil of the seventeen. The light source device 21 has a light source 22 such as an LED that irradiates infrared light, and a lens 23 for converting light from the light source 22 into a substantially parallel light beam B is provided on the front side of the light source 22. . Further, a slit plate 24 is provided on the emission side of the lens 23,
It is provided so as to obtain a substantially parallel light beam which is sufficiently thin compared to the size of the pupil of the eyeball 17.
【0021】そして、視線の水平方向であるX方向およ
び垂直方向であるY方向の変化を捕えるべく、X方向用
のスリット24X およびY方向用のスリット24Y が形成さ
れている。また、これら各スリット24X ,24Y の幅寸法
は、瞳の大きさに比して十分に細い値に設定されてい
る。したがって、この光源装置21は、光源22からの光を
レンズ23で概平行光線Bとした後、スリット板24のスリ
ット24X ,24Y により、眼球17の瞳の大きさに比して十
分に細いX方向用およびY方向用のスリット状の平行な
光線となり、眼球17の中心部に向かって照射される。A slit 24X for the X direction and a slit 24Y for the Y direction are formed to capture changes in the X direction, which is the horizontal direction of the line of sight, and the Y direction, which is the vertical direction. Further, the width dimension of each of the slits 24X and 24Y is set to a value sufficiently smaller than the size of the pupil. Therefore, in the light source device 21, after the light from the light source 22 is converted into the substantially parallel light beam B by the lens 23, the X, which is sufficiently smaller than the size of the pupil of the eyeball 17, is formed by the slits 24X and 24Y of the slit plate 24. It becomes a slit-shaped parallel light beam for the direction and for the Y direction, and is emitted toward the center of the eyeball 17.
【0022】また、26は光検出装置で、この光検出装置
26は、光源装置21により眼球17の中心部に向かって発せ
られ、眼球17の角膜16の表面で反射されたスリット光な
どの概平行光線Bを受光し、眼球17の中心部に対する受
光位置関係を検出する。そして、この光検出装置26は、
X方向の受光位置を検出する光位置検出装置としてのP
SD26X と、Y方向の受光位置を検出する光位置検出装
置としてのPSD26Yとで構成される。Reference numeral 26 denotes a light detecting device.
26 receives the substantially parallel light rays B such as slit light emitted from the light source device 21 toward the center of the eyeball 17 and reflected on the surface of the cornea 16 of the eyeball 17, and receives light relative to the center of the eyeball 17. Is detected. And this light detection device 26
P as a light position detecting device for detecting a light receiving position in the X direction
It comprises an SD 26X and a PSD 26Y as an optical position detecting device for detecting a light receiving position in the Y direction.
【0023】一方、制御回路は図2に示すように、光源
22は、LEDドライバ31に接続され、このLEDドライ
バ31により発光制御される。また、X方向用PSD26X
およびY方向用PSD26Y は切換スイッチ32に接続さ
れ、X方向用PSD26X およびY方向用PSD26Y の出
力はこの切換スイッチ32により時分割に切換えるように
して、後続回路を1組にしている。すなわち、X方向用
PSD26X およびY方向用PSD26Y の出力は、切換ス
イッチ32により時分割に切換えられ、切換スイッチ32に
接続された信号処理回路33を経て、さらにこの信号処理
回路33に接続された角度検出回路34に入力され、受光位
置を基に角膜16からの反射角αを求める。On the other hand, as shown in FIG.
The LED 22 is connected to an LED driver 31, and the LED driver 31 controls light emission. Also, PSD26X for X direction
The PSD 26Y for the Y direction and the PSD 26Y for the Y direction are connected to a switch 32, and the outputs of the PSD 26X for the X direction and the PSD 26Y for the Y direction are switched in a time division manner by the switch 32, thereby forming a set of subsequent circuits. That is, the outputs of the X-direction PSD 26X and the Y-direction PSD 26Y are time-divisionally switched by the changeover switch 32, passed through the signal processing circuit 33 connected to the changeover switch 32, and further connected to the signal processing circuit 33. Input to the detection circuit 34, the reflection angle α from the cornea 16 is obtained based on the light receiving position.
【0024】ここで、眼球17の回転中心Crに対して細い
概平行光線Bを照射した場合、眼球17がたとえば図3に
示す実線で示すように右に角度θ回転していると、細い
概平行光線Bの一部は角膜16の表面の反射点Rpにおい
て、眼球17の回転方向とは反対方向に角度αで反射す
る。そして、回転角θでの角膜16の曲率中心をCc1 、こ
の曲率中心Cc1 と眼球17の回転中心Crとの距離をdc、回
転角θでの角膜16の曲率中心Cc1 と反射点Rpとの距離を
rcとし、正弦定理を適用すると、視線方向である眼球17
の回転角θと反射角αとの間には、以下に示す式2に基
づき式3の関係が成り立つ。Here, in the case where the thin approximately parallel ray B is applied to the rotation center Cr of the eyeball 17, if the eyeball 17 is rotated to the right by an angle θ as shown by a solid line in FIG. A part of the parallel light beam B is reflected at a reflection point Rp on the surface of the cornea 16 at an angle α in a direction opposite to the rotation direction of the eyeball 17. The center of curvature of the cornea 16 at the rotation angle θ is Cc1, the distance between the center of curvature Cc1 and the center of rotation Cr of the eyeball 17 is dc, and the distance between the center of curvature Cc1 of the cornea 16 at the rotation angle θ and the reflection point Rp. To
rc and applying the sine theorem, the eyeball 17
The relationship of Expression 3 is established between the rotation angle θ and the reflection angle α based on Expression 2 shown below.
【0025】[0025]
【式2】 (Equation 2)
【0026】[0026]
【式3】 したがって、反射角αを検出することにより、式3の関
係から、視線の方向の角度θを求めることができる。(Equation 3) Therefore, by detecting the reflection angle α, the angle θ in the direction of the line of sight can be obtained from the relationship of Expression 3.
【0027】そして、たとえば図3に示すように、光源
装置21により眼球17の中心部に向かって発せられた、十
分に細いX方向およびY方向のスリット状の概平行光線
Bは、眼球17の角膜16の表面で反射される。そして、反
射光は光検出装置26のX方向用PSD26X およびY方向
用PSD26Y により受光され、眼球17の中心部に対する
X方向およびY方向の受光位置が検出される。そして、
図3の破線で示すように、視線が正面を向いていれば、
反射光の受光位置は、PSD26X およびPSD26Y の各
中心位置となる。これに対し、図3の実線で示すよう
に、視線が右に角度θ向いていると、反射光は左方向に
反射角αで反射されるため、受光位置はX方向用PSD
26X の左位置となる。したがって、この受光位置を検出
することにより反射角αが求められ、さらに、この反射
角αから式3の関係により視線の方向θが求められる。For example, as shown in FIG. 3, a sufficiently narrow slit-like substantially parallel light beam B in the X and Y directions emitted from the light source device 21 toward the center of the eyeball 17 The light is reflected by the surface of the cornea 16. The reflected light is received by the PSD 26X for the X direction and the PSD 26Y for the Y direction of the photodetector 26, and the light receiving position in the X direction and the Y direction with respect to the center of the eyeball 17 is detected. And
As shown by the broken line in FIG. 3, if the line of sight is facing the front,
The light receiving position of the reflected light is the central position of PSD26X and PSD26Y. On the other hand, as shown by the solid line in FIG. 3, when the line of sight is directed to the right angle θ, the reflected light is reflected to the left at the reflection angle α, so that the light receiving position is the X-direction PSD.
26X left position. Accordingly, by detecting the light receiving position, the reflection angle α is obtained, and further, the direction of the line of sight θ is obtained from the reflection angle α by the relationship of Expression 3.
【0028】なお、水平方向であるX方向について説明
したが、垂直方向であるY方向についても同様であり、
Y方向用PSD26Y への受光位置により角膜16からの反
射角が求まり、この反射角から視線方向が求まる。Although the description has been given of the X direction which is the horizontal direction, the same applies to the Y direction which is the vertical direction.
The reflection angle from the cornea 16 is determined by the light receiving position on the Y-direction PSD 26Y, and the line-of-sight direction is determined from the reflection angle.
【0029】ここで、図1に示す視線方向検出装置は、
眼球17の角膜16の表面からの反射光を受光し、その受光
位置から反射角αを求め、この反射角αから視線方向θ
を検出するようにしたので、従来のように反射像を結像
させる必要はなく、結像光学系のような複雑な構成が不
要となり、装置全体を小型軽量化することができる。ま
た、入射方向と反射方向との成す角度の変化は、たとえ
ば視線方向θの5°の変化に対して反射角αは、およそ
8°となり、変化幅が拡大する。すなわち、従来の第1
プルキンエ像を用いた場合のように僅かな変化を検出す
るのではなく、拡大された十分大きな変化幅を検出する
ので検出精度は大幅に向上する。Here, the gaze direction detecting device shown in FIG.
The reflected light from the surface of the cornea 16 of the eyeball 17 is received, the reflection angle α is obtained from the light receiving position, and the line-of-sight direction θ is obtained from the reflection angle α.
Is detected, it is not necessary to form a reflected image as in the related art, and a complicated configuration such as an imaging optical system is not required, and the entire apparatus can be reduced in size and weight. In addition, the change in the angle between the incident direction and the reflection direction is, for example, a change in the line-of-sight direction θ of 5 °, the reflection angle α is about 8 °, and the change width is increased. That is, the conventional first
Rather than detecting a small change as in the case of using a Purkinje image, the detection accuracy is greatly improved because an enlarged and sufficiently large change width is detected.
【0030】また、眼球17への照射光として十分に細い
スリット状平行光線を用いているので、瞼や睫等による
影響を避けることができ、確実な視線方向検出を行なう
ことができる。Further, since a sufficiently narrow slit-like parallel light beam is used as the irradiation light to the eyeball 17, the influence of the eyelids, eyelashes and the like can be avoided, and the gaze direction can be reliably detected.
【0031】次に、図4を参照して、35mmコンパクト
カメラあるいは小型ビデオムービーカメラ等のファィン
ダーへの応用を考えて構成したものを説明する。Next, with reference to FIG. 4, a description will be given of an image pickup apparatus designed for application to a finder such as a 35 mm compact camera or a small video movie camera.
【0032】この図4に示す装置は、スリット板24を経
たスリット光である概平行光線Bをハーフミラー28によ
り眼球17の角膜16に導いている。この場合、X方向用の
PSD26X およびY方向用PSD26Y からなる光検出装
置26は、ハーフミラー28と角膜16との間に設置すること
ができる。The device shown in FIG. 4 guides a substantially parallel light beam B, which is a slit light beam passing through a slit plate 24, to a cornea 16 of an eyeball 17 by a half mirror 28. In this case, the light detecting device 26 including the PSD 26X for the X direction and the PSD 26Y for the Y direction can be installed between the half mirror 28 and the cornea 16.
【0033】このように構成しても、十分に細いX方向
およびY方向の概平行光線Bは、ハフミラー28を介して
眼球17の中心部に向かって発せられる。そして、この概
平行光線Bは、眼球17の角膜16表面で反射され、反射光
は、ハーフミラー28との間に設けられた光検出装置26の
X方向用PSD26X およびY方向用PSD26Y により受
光され、眼球17の中心部に対するX方向およびY方向の
受光位置が検出される。したがって、この受光位置から
反射角αが求められ、さらに、この反射角αから視線の
方向θが求められる。Even with such a configuration, substantially parallel light beams B in the X and Y directions which are sufficiently thin are emitted toward the center of the eyeball 17 via the Hough mirror 28. The substantially parallel light beam B is reflected on the surface of the cornea 16 of the eyeball 17, and the reflected light is received by the X-direction PSD 26X and the Y-direction PSD 26Y of the photodetector 26 provided between the half mirror 28. The light receiving positions in the X and Y directions with respect to the center of the eyeball 17 are detected. Therefore, the reflection angle α is determined from the light receiving position, and the line-of-sight direction θ is determined from the reflection angle α.
【0034】なお、上記実施例では、光源22としてLE
Dを示したが、LEDの他の光源を用いてもよい。In the above embodiment, the light source 22 is LE
Although D is shown, other light sources of LEDs may be used.
【0035】また、X方向およびY方向の双方を検出す
るようにしているが、どちらか一方の方向を検出するよ
うにしてもよい。Although both the X direction and the Y direction are detected, either one of the directions may be detected.
【0036】さらに、スリット板24には、XおよびY方
向用の互いに直交する2つのスリット24X ,24Y を形成
したが、斜め方向の1本のスリット等を用いて両方向の
検出を行なってもよい。また、スリット板24の代りに、
複数のピンホールを有するピンホール板を用いてもよ
い。Further, the slit plate 24 is formed with two slits 24X and 24Y orthogonal to each other for the X and Y directions, but the detection in both directions may be performed by using one diagonal slit or the like. . Also, instead of slit plate 24,
A pinhole plate having a plurality of pinholes may be used.
【0037】またさらに、光検出装置26として用いられ
る光位置検出装置はPSDに限らず、CCDラインセン
サやフォトセルアレイ、CCD撮像素子等の2次元のセ
ンサを用いてもよい。Further, the light position detecting device used as the light detecting device 26 is not limited to the PSD, but may be a two-dimensional sensor such as a CCD line sensor, a photocell array, or a CCD image pickup device.
【0038】[0038]
【発明の効果】本発明の視線方向検出装置によれば、角
膜表面での反射角から視線方向を2次元で検出するよう
にしたので、光の位置を検出する1次元のセンサを組合
せあるいは2次元のセンサを設ければ良く、従来のよう
に反射像を結像させる結像光学系のような複雑な構成が
不要となり、装置全体を小型軽量化することができる。
また、入射方向と反射方向との成す角度の変化について
は、視線方向の変化に対して反射角は変化幅が拡大する
ため、従来の第1プルキンエ像を用いた場合のように僅
かな変化を検出するのではなく、拡大された十分大きな
変化幅を検出することが可能になり検出精度は大幅に向
上する。According to the gaze direction detecting device of the present invention, the gaze direction is detected two-dimensionally from the angle of reflection on the corneal surface, so that a one-dimensional sensor for detecting the position of light is combined.
Or a two-dimensional sensor may be provided, and a complicated configuration such as an imaging optical system for forming a reflected image as in the related art is not required, and the entire apparatus can be reduced in size and weight.
Also, the change in the angle between the incident direction and the reflected direction
Changes the range of reflection angle with respect to changes in the line of sight
Therefore, instead of detecting the small changes as in the case of using the conventional first Purkinje image, the detection accuracy becomes possible to detect that expanded sufficiently large change width is greatly improved.
【図1】本発明の視線方向検出装置の一実施例を示す斜
視図である。FIG. 1 is a perspective view showing an embodiment of a gaze direction detecting device according to the present invention.
【図2】同上回路構成を示すブロック図である。FIG. 2 is a block diagram showing a circuit configuration of the same.
【図3】同上動作原理を示す説明図である。FIG. 3 is an explanatory diagram showing an operation principle of the embodiment.
【図4】他の実施例の視線方向検出装置を示す説明図で
ある。FIG. 4 is an explanatory diagram showing a gaze direction detecting device according to another embodiment.
【図5】従来の視線方向検出装置の一状態を示す説明図
である。FIG. 5 is an explanatory diagram showing one state of a conventional gaze direction detecting device.
【図6】同上別の状態を示す説明図である。FIG. 6 is an explanatory diagram showing another state of the above.
【図7】従来の第1プルキンエ像を用いた場合の検出原
理を示す説明図である。FIG. 7 is an explanatory diagram showing a detection principle when a conventional first Purkinje image is used.
16 角膜 17 眼球 21 光源装置 26 光検出装置33 制御回路を構成する信号処理回路 34 光検出装置を構成する角度検出回路 16 Cornea 17 Eyeball 21 Light source device 26 Light detection device 33 Signal processing circuit constituting control circuit 34 Angle detection circuit constituting light detection device
───────────────────────────────────────────────────── フロントページの続き (58)調査した分野(Int.Cl.7,DB名) A61B 3/113 G02B 7/28 ──────────────────────────────────────────────────続 き Continued on front page (58) Field surveyed (Int.Cl. 7 , DB name) A61B 3/113 G02B 7/28
Claims (1)
の大きさに比して十分に細い概平行光線を発する光源装
置と、 前記概平行光線の前記眼球の角膜からの反射光を受光
し、前記眼球の中心部に対する受光位置の関係を2次元
で検出する光検出装置と、 この光検出装置の受光位置を基に角膜からの反射角を求
める制御回路と を備えたことを特徴とする視線方向検出
装置。1. A light source device that emits substantially parallel light rays, which are sufficiently thin compared to the size of the pupil of the eyeball, toward the center of the eyeball, and reflects the reflected light of the substantially parallel light rays from the cornea of the eyeball. The two-dimensional relationship between the light receiving position and the center of the eyeball
A light detecting device, the angle of reflection from the cornea based on the light receiving position of the photodetector determined for detecting in
Gaze direction detecting apparatus characterized by comprising a Mel control circuit.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP15799092A JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP15799092A JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Publications (2)
Publication Number | Publication Date |
---|---|
JPH05344954A JPH05344954A (en) | 1993-12-27 |
JP3194790B2 true JP3194790B2 (en) | 2001-08-06 |
Family
ID=15661837
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP15799092A Expired - Fee Related JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Country Status (1)
Country | Link |
---|---|
JP (1) | JP3194790B2 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102227284B1 (en) | 2014-01-16 | 2021-03-12 | 삼성전자주식회사 | Dispaly apparatus and controlling method thereof |
JP2019215305A (en) * | 2018-06-14 | 2019-12-19 | ソニー株式会社 | Eyeball detection apparatus and image display device |
CN112869701B (en) * | 2021-01-11 | 2024-03-29 | 上海微创医疗机器人(集团)股份有限公司 | Sight line detection method, surgical robot system, control method, and storage medium |
-
1992
- 1992-06-17 JP JP15799092A patent/JP3194790B2/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
JPH05344954A (en) | 1993-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5225862A (en) | Visual axis detector using plural reflected image of a light source | |
US7533990B2 (en) | Ophthalmologic apparatus | |
JP3166179B2 (en) | Eye gaze detection device | |
JPH0566133B2 (en) | ||
US20080151189A1 (en) | Ophthalmologic apparatus | |
JPH06505657A (en) | Target movement compensation for laser surgical systems | |
US20040165099A1 (en) | Digital camera autofocus using eye focus measurement | |
US4511227A (en) | Ophthalmic apparatus having means for automatic detection of appropriate position of eye to be examined | |
EP0392742B1 (en) | Ophthalmological measurement method and apparatus | |
US5469234A (en) | Method of detecting eye component information for determining sight axis direction, and sight axis direction detection apparatus | |
BR9408338A (en) | Equipment for examining the fundus of an eye and for detecting an ocular light pattern reflected by the fund Equipment for positionalizing the fundus of an eye for examination and detection of an ocular light pattern reflected by the fund visual axis method for positioning the bottom of an eye having a visual axis for examination by a radiation beam using equipment to focus an image of an object through a lens on a focal plane having the | |
JP2676870B2 (en) | Optical device having gazing point detection means | |
US6304723B1 (en) | Retinal camera | |
US4494868A (en) | Rangefinder device with focused elongated light source | |
JP2939988B2 (en) | Eye gaze detection device | |
JP3194790B2 (en) | Gaze direction detection device | |
JP2000116602A (en) | Retinal camera | |
JP2812421B2 (en) | Corneal cell imaging device | |
JPH0975308A (en) | Corneal endothelial cell photographing device | |
JP2754663B2 (en) | Gaze detection method and gaze detection device | |
JPH0984760A (en) | Positioning detection device for ophthalmic equipment | |
JP2939982B2 (en) | Eye gaze detection device | |
JPS6260645B2 (en) | ||
JPH0643893B2 (en) | Distance measuring device | |
SU935072A1 (en) | Method of registering operator eye motions |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
R360 | Written notification for declining of transfer of rights |
Free format text: JAPANESE INTERMEDIATE CODE: R360 |
|
R360 | Written notification for declining of transfer of rights |
Free format text: JAPANESE INTERMEDIATE CODE: R360 |
|
R371 | Transfer withdrawn |
Free format text: JAPANESE INTERMEDIATE CODE: R371 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
LAPS | Cancellation because of no payment of annual fees |