JP2018205648A5 - - Google Patents

Download PDF

Info

Publication number
JP2018205648A5
JP2018205648A5 JP2017113870A JP2017113870A JP2018205648A5 JP 2018205648 A5 JP2018205648 A5 JP 2018205648A5 JP 2017113870 A JP2017113870 A JP 2017113870A JP 2017113870 A JP2017113870 A JP 2017113870A JP 2018205648 A5 JP2018205648 A5 JP 2018205648A5
Authority
JP
Japan
Prior art keywords
area
line
moving body
sight input
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2017113870A
Other languages
Japanese (ja)
Other versions
JP6991746B2 (en
JP2018205648A (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2017113870A priority Critical patent/JP6991746B2/en
Priority claimed from JP2017113870A external-priority patent/JP6991746B2/en
Publication of JP2018205648A publication Critical patent/JP2018205648A/en
Publication of JP2018205648A5 publication Critical patent/JP2018205648A5/ja
Application granted granted Critical
Publication of JP6991746B2 publication Critical patent/JP6991746B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

上記の目的を達成するために、本発明に係る画像処理装置は、撮像データに基づく複数のフレーム画像を取得する取得段と、視線入力情報を取得する視線入力手段と前記視線入力情報か前記複数のフレーム画像内の注目領域を決定する注目領域決定段と前記複数のフレーム画像で、動体に対応する動体領域を検出する動体検出手段と前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御手段と、を備えることを特徴とする。 To achieve the above object, an image processing apparatus according to the present invention includes an acquisition means to acquire a plurality of frame images based on the imaging data, the sight line input means to obtain the line of sight input information, the visual axis input information and attention region determining means to determine a region of interest in broadcast or found within the plurality of frame images, in said plurality of frame images, the moving object detection means to detect a moving object region corresponding to the moving object, and the frame image And a display control unit that displays the attention area in the frame image and the moving body area in the frame image on a display unit .

また、本発明に係る画像処理装置は、撮像データに基づく複数のフレーム画像を取得する取得手段と、視線入力情報を取得する視線入力手段と、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定手段と、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出手段と、前記動体検出手段により検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾手段と、を備えることを特徴とする。Further, the image processing apparatus according to the present invention includes an acquisition unit that acquires a plurality of frame images based on imaged data, a line-of-sight input unit that acquires line-of-sight input information, and a focus in the plurality of frame images from the line-of-sight input information. Based on the attention area determining means for determining an area, the moving body detecting means for detecting a moving body area corresponding to a moving body in the plurality of frame images, and the moving body area and the attention area detected by the moving body detecting means Tracking means for determining the area as the main subject area and tracking the main subject area.

また、本発明に係る画像処理装置の制御方法は、撮像データに基づく複数のフレーム画像を取得する取得ステップと、視線入力情報を取得する視線入力ステップと、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御ステップと、を備えることを特徴とする。Further, the control method of the image processing device according to the present invention includes an acquisition step of acquiring a plurality of frame images based on imaged data, a line-of-sight input step of acquiring line-of-sight input information, and the plurality of frame images from the line-of-sight input information. A region of interest determining step of determining a region of interest, a moving body detection step of detecting a moving body region corresponding to a moving body in the plurality of frame images, the frame image, and the region of interest in the frame image, A display control step of displaying the moving object area in the frame image on a display unit.

また、本発明に係る画像処理装置の制御方法は、撮像データに基づく複数のフレーム画像を取得する取得ステップと、視線入力情報を取得する視線入力ステップと、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、前記動体検出ステップにて検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾ステップと、を備えることを特徴とする。Further, the control method of the image processing device according to the present invention includes an acquisition step of acquiring a plurality of frame images based on imaged data, a line-of-sight input step of acquiring line-of-sight input information, and the plurality of frame images from the line-of-sight input information. An attention area determining step for determining an attention area in the moving body, a moving body detecting step for detecting a moving body area corresponding to a moving body in the plurality of frame images, the moving body area detected in the moving body detecting step and the attention A tracking step of determining a region based on the region and the main subject region and tracking the main subject region.

Claims (12)

撮像データに基づく複数のフレーム画像を取得する取得段と
視線入力情報を取得する視線入力手段と
前記視線入力情報か前記複数のフレーム画像内の注目領域を決定する注目領域決定段と
前記複数のフレーム画像で、動体に対応する動体領域を検出する動体検出手段と
前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御手段と、
を備えることを特徴とする画像処理装置。
An acquisition means to acquire a plurality of frame images based on the captured data,
And line-of-sight input means to get the line-of-sight input information,
And attention region determining means to determine a region of interest of the eye control information or we said plurality of frame images,
In said plurality of frame images, the moving object detection means to detect a moving object region corresponding to the moving object,
Display control means for displaying the frame image, the attention area in the frame image, and the moving body area in the frame image on a display unit;
An image processing apparatus comprising:
前記動体検出手段により検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾手段と
をさらに備えることを特徴とする画像処理装置。
Tracking means for determining an area based on the moving body area detected by the moving body detection means and the attention area as a main subject area, and for tracking the main subject area .
An image processing apparatus further comprising:
前記追尾手段は、前記注目領域と前記動体領域との距離が第1の閾値内にあるフレーム数が所定数続いた場合、該動体領域を前記主被写体領域として決定することを特徴とする請求項2に記載の画像処理装置。 The tracking unit determines the moving object area as the main subject area when a predetermined number of frames in which the distance between the attention area and the moving object area is within a first threshold value continues. 2. The image processing device according to item 2. 前記追尾手段は、前記主被写体領域として決定した領域よりも前記注目領域の近くに存在する前記動体領域と、前記注目領域との距離が第2の閾値内にあるフレーム数が所定数続いた場合、該動体領域を新たな主被写体領域として決定することを特徴とする請求項3に記載の画像処理装置。In the case where the tracking unit continues for a predetermined number of frames, the distance between the attention area and the moving body area that is closer to the attention area than the area determined as the main subject area continues within a second threshold value. The image processing apparatus according to claim 3, wherein the moving body area is determined as a new main subject area. 撮像データに基づく複数のフレーム画像を取得する取得手段と、An acquisition means for acquiring a plurality of frame images based on the imaged data,
視線入力情報を取得する視線入力手段と、A line-of-sight input means for obtaining line-of-sight input information,
前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定手段と、Attention area determining means for determining attention areas in the plurality of frame images from the line-of-sight input information,
前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出手段と、A moving body detecting unit that detects a moving body region corresponding to a moving body in the plurality of frame images;
前記動体検出手段により検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾手段と、Tracking means for determining an area based on the moving body area detected by the moving body detection means and the attention area as a main subject area, and for tracking the main subject area,
を備えることを特徴とする画像処理装置。An image processing apparatus comprising:
レンズを介して入力された光束から前記撮像データを生成する撮像手段を備えることを特徴とする請求項1乃至5のいずれか1項に記載の画像処理装置。The image processing apparatus according to claim 1, further comprising an image pickup unit that generates the image pickup data from a light beam input via a lens. 前記視線入力手段は、ユーザーの視線方向を一定周期で検出するセンサを備えることを特徴とする請求項1乃至6のいずれか1項に記載の画像処理装置。7. The image processing apparatus according to claim 1, wherein the line-of-sight input means includes a sensor that detects the line-of-sight direction of the user at a constant cycle. 前記視線入力手段は、前記センサから得た前記センサ上の座標を前記撮像データ上の座標に変換し前記視線入力情報として取得することを特徴とする請求項7に記載の画像処理装置。The image processing apparatus according to claim 7, wherein the line-of-sight input means converts the coordinates on the sensor obtained from the sensor into coordinates on the imaging data and acquires the information as the line-of-sight input information. 前記視線入力手段は、前記視線入力情報を必要とするモードへの変更がなされたことに応じて、前記視線入力情報の取得を開始することを特徴とする請求項1乃至8のいずれか1項に記載の画像処理装置。9. The line-of-sight input means starts acquisition of the line-of-sight input information in response to a change to a mode requiring the line-of-sight input information. The image processing device according to 1. 前記視線入力手段が取得する前記視線入力情報はRAMに複数蓄積されることを特徴とする請求項1乃至9のいずれか1項に記載の画像処理装置。10. The image processing apparatus according to claim 1, wherein a plurality of pieces of the line-of-sight input information acquired by the line-of-sight input unit are stored in a RAM. 撮像データに基づく複数のフレーム画像を取得する取得ステップと、An acquisition step of acquiring a plurality of frame images based on the imaging data,
視線入力情報を取得する視線入力ステップと、A line-of-sight input step of acquiring line-of-sight input information,
前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、An attention area determining step of determining attention areas in the plurality of frame images from the line-of-sight input information,
前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、A moving body detecting step of detecting a moving body region corresponding to a moving body in the plurality of frame images;
前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御ステップと、A display control step of displaying the frame image, the attention area in the frame image, and the moving body area in the frame image on a display unit;
を備えることを特徴とする画像処理装置の制御方法。A method for controlling an image processing apparatus, comprising:
撮像データに基づく複数のフレーム画像を取得する取得ステップと、An acquisition step of acquiring a plurality of frame images based on the imaging data,
視線入力情報を取得する視線入力ステップと、A line-of-sight input step of acquiring line-of-sight input information,
前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、An attention area determining step of determining attention areas in the plurality of frame images from the line-of-sight input information,
前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、A moving body detecting step of detecting a moving body region corresponding to a moving body in the plurality of frame images;
前記動体検出ステップにて検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾ステップと、A tracking step of determining an area based on the moving body area and the attention area detected in the moving body detection step as a main subject area, and tracking the main subject area,
を備えることを特徴とする画像処理装置の制御方法。A method for controlling an image processing apparatus, comprising:
JP2017113870A 2017-06-09 2017-06-09 Imaging device Active JP6991746B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2017113870A JP6991746B2 (en) 2017-06-09 2017-06-09 Imaging device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017113870A JP6991746B2 (en) 2017-06-09 2017-06-09 Imaging device

Publications (3)

Publication Number Publication Date
JP2018205648A JP2018205648A (en) 2018-12-27
JP2018205648A5 true JP2018205648A5 (en) 2020-07-27
JP6991746B2 JP6991746B2 (en) 2022-01-13

Family

ID=64957083

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017113870A Active JP6991746B2 (en) 2017-06-09 2017-06-09 Imaging device

Country Status (1)

Country Link
JP (1) JP6991746B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7379028B2 (en) 2019-09-06 2023-11-14 キヤノン株式会社 Electronic devices, control methods for electronic devices, programs and storage media
JP7497196B2 (en) 2020-04-10 2024-06-10 キヤノン株式会社 Display device, control method thereof, program, and storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7301615B2 (en) * 2019-06-17 2023-07-03 キヤノン株式会社 Electronic equipment and its control method
JP7433788B2 (en) * 2019-07-03 2024-02-20 キヤノン株式会社 Control device, imaging device, control method, program
JP7358130B2 (en) * 2019-09-12 2023-10-10 キヤノン株式会社 Electronic equipment and its control method
JP2023003735A (en) 2021-06-24 2023-01-17 キヤノン株式会社 Line-of-sight detection apparatus, imaging apparatus, line-of-sight detection method, program, and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3163668B2 (en) * 1991-08-27 2001-05-08 株式会社ニコン Subject recognition device and camera
JPH05304631A (en) * 1991-12-09 1993-11-16 Canon Inc Image pickup device
JP2001116985A (en) 1999-10-21 2001-04-27 Canon Inc Camera with subject recognizing function and subject recognizing method
KR20140102443A (en) 2013-02-14 2014-08-22 삼성전자주식회사 Object tracking method using camera and camera system for object tracking
CN103516985A (en) 2013-09-18 2014-01-15 上海鼎为软件技术有限公司 Mobile terminal and image acquisition method thereof
JP6405765B2 (en) 2014-07-22 2018-10-17 サクサ株式会社 Imaging apparatus and determination method
JP2017034569A (en) 2015-08-05 2017-02-09 キヤノン株式会社 Imaging apparatus and control method therefor

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7379028B2 (en) 2019-09-06 2023-11-14 キヤノン株式会社 Electronic devices, control methods for electronic devices, programs and storage media
JP7497196B2 (en) 2020-04-10 2024-06-10 キヤノン株式会社 Display device, control method thereof, program, and storage medium

Similar Documents

Publication Publication Date Title
JP2018205648A5 (en)
CN108370438B (en) Range gated depth camera assembly
JP2021106418A5 (en) Image processing equipment, imaging equipment, control methods, programs and storage media
TW200642445A (en) Imaging device and method, computer program product on computer-readable medium, and imaging system
JP2016520891A5 (en)
US9729782B2 (en) System and method for intelligent camera control
US20160165129A1 (en) Image Processing Method
KR20120057033A (en) Gaze tracking system and method for controlling internet protocol tv at a distance
JP2017129567A5 (en)
KR20150085710A (en) Dispaly apparatus and controlling method thereof
IL300597A (en) Systems and methods for eye examination
JP2012042833A5 (en)
CN104603838B (en) Apparatus and method for monitoring object from captured image
JP2020516326A5 (en)
JP2017028511A5 (en)
JP2017092592A5 (en) TRACKING CONTROL DEVICE, TRACKING CONTROL METHOD, AND IMAGING DEVICE
JP2018129659A5 (en)
US9363427B2 (en) Device and method for calibrating a temporal contrast sensor with a frame-based camera sensor
JP2019078843A5 (en)
JP2015094899A5 (en)
JP2018004918A5 (en)
KR101523046B1 (en) Distance measurement apparatus of an image processing-based
KR20140014870A (en) Gaze tracking apparatus and method
JP2013218177A5 (en)
JP2016197179A5 (en)