Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency

Eunji Chong, Nataniel Ruiz, Yongxin Wang, Yun Zhang, Agata Rozga, James M. Rehg

Type: Book-Chapter

Publication Date: 2018-01-01

Citations: 118

DOI: https://doi.org/10.1007/978-3-030-01228-1_24

View Publication

Download PDF

Locations

Lecture notes in computer science - View
arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency	2018	Eunji Chong Nataniel Ruiz Yongxin Wang Yun Zhang Agata Rozga James M. Rehg
+ PDF Chat	Attention Flow: End-to-End Joint Attention Estimation	2020	Ömer Sümer Peter Gerjets Ulrich Trautwein Enkelejda Kasneci
+	Discovery and usage of joint attention in images	2018	Daniel Harari Joshua B. Tenenbaum Shimon Ullman
+	Human Attention Estimation for Natural Images: An Automatic Gaze Refinement Approach	2016	Jinsoo Choi Tae-Hyun Oh In So Kweon
+ PDF Chat	ViTGaze: Gaze Following with Interaction Features in Vision Transformers	2024	Yuehao Song Xinggang Wang Jingfeng Yao Wenyu Liu Jinglin Zhang Xiangmin Xu
+ PDF Chat	Predicting Gaze in Egocentric Video by Learning Task-Dependent Attention Transition	2018	Yifei Huang Minjie Cai Zhenqiang Li Yoichi Sato
+	GASP: Gated Attention for Saliency Prediction	2021	Fares Abawi Tom Weber Stefan Wermter
+	Discovery and usage of joint attention in images.	2018	Daniel Harari Joshua B. Tenenbaum Shimon Ullman
+ PDF Chat	Automatic Gaze Analysis: A Survey of Deep Learning Based Approaches	2023	Shreya Ghosh Abhinav Dhall Munawar Hayat Jarrod Knibbe Qiang Ji
+	Seeing with Humans: Gaze-Assisted Neural Image Captioning	2016	Yusuke Sugano Andreas Bulling
+	Automatic Gaze Analysis: A Survey of Deep Learning based Approaches	2021	Shreya Ghosh Abhinav Dhall Munawar Hayat Jarrod Knibbe Qiang Ji
+ PDF Chat	Boosting Gaze Object Prediction via Pixel-level Supervision from Vision Foundation Model	2024	Jin Yang Lei Zhang Yan Shi Bin Fan Binglu Wang
+ PDF Chat	Digging Deeper Into Egocentric Gaze Prediction	2019	Hamed R. Tavakoli Esa Rahtu Juho Kannala Ali Borji
+	GazeGAN: A Generative Adversarial Saliency Model based on Invariance Analysis of Human Gaze During Scene Free Viewing.	2019	Zhaohui Che Ali Borji Guangtao Zhai Xiongkuo Min Guodong Guo Patrick Le Callet
+	Following Gaze Across Views.	2016	Adrià Recasens Carl Vondrick Aditya Khosla Antonio Torralba
+	4D Attention: Comprehensive Framework for Spatio-Temporal Gaze Mapping	2021	Shuji Oishi Kenji Koide Masashi Yokozuka Atsuhiko Banno
+	Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models	2022	Karan Uppal Jaeah Kim Shashank Kumar Singh
+	In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation	2022	Bolin Lai Miao Liu Fiona Ryan James M. Rehg
+	Following Gaze Across Views	2016	Adrià Recasens Carl Vondrick Aditya Khosla Antonio Torralba
+	Unsupervised Gaze Prediction in Egocentric Videos by Energy-based Surprise Modeling	2021	Sathyanarayanan N. Aakur Arunkumar Bagavathi

Works That Cite This (39)

Action	Title	Year	Authors
+ PDF Chat	Towards End-to-End Video-Based Eye-Tracking	2020	Seonwook Park Emre Aksan Xucong Zhang Otmar Hilliges
+ PDF Chat	LAEO-Net: Revisiting People Looking at Each Other in Videos	2019	Manuel J. Marín‐Jiménez Vicky Kalogeiton Pablo Medina-Suarez Andrew Zisserman
+	Utilising Visual Attention Cues for Vehicle Detection and Tracking	2022	Feiyan Hu G. Venkatesh Noel E. O’Connor Alan F. Smeaton Suzanne Little
+ PDF Chat	LAEO-Net++: Revisiting People Looking at Each Other in Videos	2020	Manuel J. Marín‐Jiménez Vicky Kalogeiton Pablo Medina-Suarez Andrew Zisserman
+ PDF Chat	Utilising Visual Attention Cues for Vehicle Detection and Tracking	2021	Feiyan Hu G. Venkatesh Noel E. O’Connor Alan F. Smeaton Suzanne Little
+ PDF Chat	Evaluating data-driven co-speech gestures of embodied conversational agents through real-time interaction	2022	Yuan He André Pereira Taras Kucherenko
+ PDF Chat	Learning Video-Independent Eye Contact Segmentation from In-the-Wild Videos	2023	Tianyi Wu Yusuke Sugano
+ PDF Chat	Appearance-based Gaze Estimation with Deep Learning: A Review and Benchmark	2024	Yihua Cheng Haofei Wang Yiwei Bao Feng Lu
+ PDF Chat	SalGaze: Personalizing Gaze Estimation using Visual Saliency	2019	Zhuoqing Chang J. Matías Di Martino Qiang Qiu Steven Espinosa Guillermo Sapiro
+ PDF Chat	Detecting Attended Visual Targets in Video	2020	Eunji Chong Yongxin Wang Nataniel Ruiz James M. Rehg

Works Cited by This (10)

Action	Title	Year	Authors
+ PDF Chat	Rendering of Eyes for Eye-Shape Registration and Gaze Estimation	2015	Erroll Wood Tadas Baltruaitis Xucong Zhang Yusuke Sugano Peter Robinson Andreas Bulling
+ PDF Chat	The Secrets of Salient Object Segmentation	2014	Yin Li Xiaodi Hou Christof Koch James M. Rehg Alan Yuille
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+ PDF Chat	Subjects and Their Objects: Localizing Interactees for a Person-Centric View of Importance	2016	Chao-Yeh Chen Kristen Grauman
+ PDF Chat	It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation	2017	Xucong Zhang Yusuke Sugano Mario Fritz Andreas Bulling
+ PDF Chat	Detecting Gaze Towards Eyes in Natural Social Interactions and Its Use in Child Assessment	2017	Eunji Chong Katha Chanda Zhefan Ye Audrey Southerland Nataniel Ruiz Rebecca Jones Agata Rozga James M. Rehg
+	Rendering of Eyes for Eye-Shape Registration and Gaze Estimation	2015	Erroll Wood Tadas Baltrušaitis Xucong Zhang Yusuke Sugano Peter Robinson Andreas Bulling
+	Visual Saliency Based on Multiscale Deep Features	2015	Guanbin Li Yizhou Yu
+ PDF Chat	Salient Object Detection: A Benchmark	2015	Ali Borji Ming‐Ming Cheng Huaizu Jiang Jia Li
+ PDF Chat	Appearance-based gaze estimation in the wild	2015	Xucong Zhang Yusuke Sugano Mario Fritz Andreas Bulling