Improved Zero-Shot Classification by Adapting VLMs with Text Descriptions

Oindrila Saha, Grant Van Horn, Subhransu Maji

Type: Preprint

Publication Date: 2024-01-01

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2401.02460

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	LaFTer: Label-Free Tuning of Zero-shot Classifier using Language and Unlabeled Image Collections	2023	M. Jehanzeb Mirza Leonid Karlinsky Wei Lin Mateusz Koziński Horst Possegger Rogério Feris Horst Bischof
+	Follow-Up Differential Descriptions: Language Models Resolve Ambiguities for Image Classification	2023	Reza Esfandiarpoor Stephen H. Bach
+	What does a platypus look like? Generating customized prompts for zero-shot image classification	2022	Sarah I. Pratt Rosanne Liu Ali Farhadi
+ PDF Chat	What does a platypus look like? Generating customized prompts for zero-shot image classification	2023	Sarah I. Pratt Ian Covert Rosanne Liu Ali Farhadi
+	AutoCLIP: Auto-tuning Zero-Shot Classifiers for Vision-Language Models	2023	Jan Hendrik Metzen Piyapat Saranrittichai Chaithanya Kumar Mummadi
+	Challenges of Zero-Shot Recognition with Vision-Language Models: Granularity and Correctness	2023	Zhenlin Xu Yi Zhu Tiffany Deng Abhay Mittal Yanbei Chen Manchen Wang Paolo Favaro Joseph Tighe Davide Modolo
+	Prompting Scientific Names for Zero-Shot Species Recognition	2023	Shubham Parashar Zhiqiu Lin Yanan Li Shu Kong
+	ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization	2020	Tzuf Paz-Argaman Yuval Atzmon Gal Chechik Reut Tsarfaty
+	ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization	2020	Tzuf Paz-Argaman Yuval Atzmon Gal Chechik Reut Tsarfaty
+	ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization	2020	Tzuf Paz-Argaman Reut Tsarfaty Gal Chechik Yuval Atzmon
+	Learning Deep Representations of Fine-grained Visual Descriptions	2016	Scott Reed Zeynep Akata Bernt Schiele Honglak Lee
+	Learning Deep Representations of Fine-grained Visual Descriptions	2016	Scott Reed Zeynep Akata Bernt Schiele Honglak Lee
+	Large Language Models are Good Prompt Learners for Low-Shot Image Classification	2023	Zhaoheng Zheng Jingmin Wei Xuefeng Hu Haidong Zhu Ram Nevatia
+ PDF Chat	Prompting Scientific Names for Zero-Shot Species Recognition	2023	Shubham Parashar Zhiqiu Lin Yanan Li Shu Kong
+	A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision	2021	Ajinkya Tejankar Maziar Sanjabi Bichen Wu Saining Xie Madian Khabsa Hamed Pirsiavash Hamed Firooz
+ PDF Chat	CLIP meets DINO for Tuning Zero-Shot Classifier using Unlabeled Image Collections	2024	Mohamed A. Imam Rufael Fedaku Marew Jameel Hassan Mustansar Fiaz Alham Fikri Aji Hisham Cholakkal
+	Visual Classification via Description from Large Language Models	2022	Sachit Menon Carl Vondrick
+	Exploiting Category Names for Few-Shot Classification with Vision-Language Models	2022	Taihong Xiao Zirui Wang Liangliang Cao Jiahui Yu Shengyang Dai Ming–Hsuan Yang
+ PDF Chat	Grounding Descriptions in Images informs Zero-Shot Visual Recognition	2024	Shaunak Halbe Junjiao Tian K. J. Joseph James Smith Katherine Stevo Vineeth N Balasubramanian Zsolt Kira
+	GIST: Generating Image-Specific Text for Fine-grained Object Classification	2023	Emily Mu Kathleen M. Lewis Adrian V. Dalca John V. Guttag

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors