Generation and Comprehension of Unambiguous Object Descriptions

Junhua Mao, Jonathan Huang, Alexander Toshev, Oana Camburu, Alan Yuille, Kevin Murphy

Type: Preprint

Publication Date: 2015-01-01

Citations: 108

DOI: https://doi.org/10.48550/arxiv.1511.02283

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Generation and Comprehension of Unambiguous Object Descriptions	2016	Junhua Mao Jonathan Huang Alexander Toshev Oana Camburu Alan Yuille Kevin Murphy
+	DisCLIP: Open-Vocabulary Referring Expression Generation	2023	Lior Bracha Eitan Shaar Aviv Shamsian Ethan Fetaya Gal Chechik
+	Describing Natural Images Containing Novel Objects with Knowledge Guided Assitance	2017	Aditya Mogadala Umanga Bista Lexing Xie Achim Rettinger
+	Referring Expression Object Segmentation with Caption-Aware Consistency	2019	Yi–Wen Chen Yi Hsuan Tsai Tiantian Wang Yen‐Yu Lin Ming Yang
+	HL Dataset: Visually-grounded Description of Scenes, Actions and Rationales	2023	Michele Cafagna Kees van Deemter Albert Gatt
+ PDF Chat	Comprehension-Guided Referring Expressions	2017	Ruotian Luo Gregory Shakhnarovich
+	Paying Attention to Descriptions Generated by Image Captioning Models	2017	Hamed R. Tavakoli Rakshith Shetty Ali Borji Jorma Laaksonen
+	Paying Attention to Descriptions Generated by Image Captioning Models	2017	Hamed R. Tavakoli Rakshith Shetty Ali Borji Jorma Laaksonen
+	HL Dataset: Visually-grounded Description of Scenes, Actions and Rationales	2023	Michele Cafagna Kees van Deemter Albert Gatt
+ PDF Chat	Paying Attention to Descriptions Generated by Image Captioning Models	2017	Hamed R. Tavakoliy Rakshith Shetty Ali Borji Jorma Laaksonen
+ PDF Chat	CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentation	2024	Kalliopi Basioti Mohamed Abbas Abdelsalam Federico Fancellu Vladimir Pavlović Afsaneh Fazly
+	Comprehension-guided referring expressions	2017	Ruotian Luo Gregory Shakhnarovich
+ PDF Chat	Intention Oriented Image Captions With Guiding Objects	2019	Yue Zheng Yali Li Shengjin Wang
+	Intention Oriented Image Captions with Guiding Objects	2018	Yue Zheng Yali Li Shengjin Wang
+	Human-like Controllable Image Captioning with Verb-specific Semantic Roles	2021	Long Chen Zhihong Jiang Jun Xiao Wei Liu
+ PDF Chat	Text-Guided Attention Model for Image Captioning	2017	Jonghwan Mun Minsu Cho Bohyung Han
+	Text-guided Attention Model for Image Captioning	2016	Jonghwan Mun Minsu Cho Bohyung Han
+	Modeling Context in Referring Expressions	2016	Licheng Yu Patrick Poirson Shan Yang Alexander C. Berg Tamara L. Berg
+	OBJ2TEXT: Generating Visually Descriptive Language from Object Layouts	2017	Xuwang Yin Vicente Ordóñez
+	SynthRef: Generation of Synthetic Referring Expressions for Object Segmentation	2021	Ioannis Kazakos Carles Ventura Míriam Bellver Carina Silberer Xavier Giró-i-Nieto

Works That Cite This (74)

Action	Title	Year	Authors
+ PDF Chat	Video as Conditional Graph Hierarchy for Multi-Granular Question Answering	2022	Junbin Xiao Angela Yao Zhiyuan Liu Yicong Li Wei Ji Tat‐Seng Chua
+	Deconfounded Image Captioning: A Causal Retrospect	2020	Xu Yang Hanwang Zhang Jianfei Cai
+	Interactive Visual Grounding of Referring Expressions for Human-Robot Interaction	2018	Mohit Shridhar David Hsu
+ PDF Chat	Graph-Structured Referring Expression Reasoning in the Wild	2020	Sibei Yang Guanbin Li Yizhou Yu
+	Natural Language Object Retrieval	2015	Ronghang Hu Huazhe Xu Marcus Rohrbach Jiashi Feng Kate Saenko Trevor Darrell
+ PDF Chat	Expressing Visual Relationships via Language	2019	Hao Tan Franck Dernoncourt Zhe Lin Trung Bui Mohit Bansal
+	Look Before You Leap: Learning Landmark Features for One-Stage Visual Grounding	2021	Binbin Huang Dongze Lian Weixin Luo Shenghua Gao
+	What is Learned in Visually Grounded Neural Syntax Acquisition	2020	Noriyuki Kojima Hadar Averbuch‐Elor Alexander M. Rush Yoav Artzi
+ PDF Chat	Video Object Grounding Using Semantic Roles in Language Description	2020	Arka Sadhu Kan Chen Ram Nevatia
+	Words Aren’t Enough, Their Order Matters: On the Robustness of Grounding Visual Referring Expressions	2020	Arjun Akula Spandana Gella Yaser Al-Onaizan Song‐Chun Zhu Siva Reddy

Works Cited by This (20)

Action	Title	Year	Authors
+	Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models	2014	Ryan Kiros Ruslan Salakhutdinov Richard S. Zemel
+ PDF Chat	LSTM: A Search Space Odyssey	2016	Klaus Greff Rupesh K. Srivastava Jan Koutník Bas R. Steunebrink Jürgen Schmidhuber
+	Exploring Nearest Neighbor Approaches for Image Captioning	2015	Jacob Devlin Saurabh Gupta Ross Girshick Margaret Mitchell C. Lawrence Zitnick
+ PDF Chat	Show and tell: A neural image caption generator	2015	Oriol Vinyals Alexander Toshev Samy Bengio Dumitru Erhan
+ PDF Chat	Deep visual-semantic alignments for generating image descriptions	2015	Andrej Karpathy Li Fei-Fei
+ PDF Chat	From captions to visual concepts and back	2015	Hao Fang Saurabh Gupta Forrest Iandola Rupesh K. Srivastava Li Deng Piotr Dollár Jianfeng Gao Xiaodong He Margaret Mitchell John Platt
+ PDF Chat	Long-term recurrent convolutional networks for visual recognition and description	2015	Jeff Donahue Lisa Anne Hendricks Sergio Guadarrama Marcus Rohrbach Subhashini Venugopalan Trevor Darrell Kate Saenko
+ PDF Chat	CIDEr: Consensus-based image description evaluation	2015	Ramakrishna Vedantam C. Lawrence Zitnick Devi Parikh
+ PDF Chat	ImageSpirit	2014	Ming‐Ming Cheng Shuai Zheng Wen-Yan Lin Vibhav Vineet Paul Sturgess Nigel Crook Niloy J. Mitra Philip H. S. Torr
+ PDF Chat	Scalable Object Detection Using Deep Neural Networks	2014	Dumitru Erhan Christian Szegedy Alexander Toshev Dragomir Anguelov