Long-tail Recognition via Compositional Knowledge Transfer

Type: Article

Publication Date: 2022-06-01

Citations: 25

DOI: https://doi.org/10.1109/cvpr52688.2022.00681

Abstract

In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes’ few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common classes to semantically similar, and yet data-hungry, rare classes in order to obtain stronger tail class representations. We leverage the fact that class prototypes and learned cosine classifiers provide two different, complementary representations of class cluster centres in feature space, and use an attention mechanism to select and recompose learned classifier features from common classes to obtain higher quality rare class representations. Our knowledge transfer process is training free, reducing overfitting risks, and can afford continual extension of classifiers to new classes. Experiments show that our approach can achieve significant performance boosts on rare classes while maintaining robust common class performance, outperforming directly comparable state-of-the-art models

Locations

  • arXiv (Cornell University) - View - PDF
  • 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - View

Similar Works

Action Title Year Authors
+ Long-tail Recognition via Compositional Knowledge Transfer 2021 Sarah Parisot
Pedro M. Esperança
Steven McDonagh
Tamás J. Madarász
Yongxin Yang
Zhenguo Li
+ Long-tailed Recognition by Learning from Latent Categories 2022 Weide Liu
Zhonghua Wu
Yiming Wang
Henghui Ding
Fayao Liu
Jie Lin
Guosheng Lin
+ From Generalized zero-shot learning to long-tail with class descriptors 2020 Dvir Samuel
Yuval Atzmon
Gal Chechik
+ PDF Chat From generalized zero-shot learning to long-tail with class descriptors 2021 Dvir Samuel
Yuval Atzmon
Gal Chechik
+ LCReg: Long-Tailed Image Classification with Latent Categories based Recognition 2023 Weide Liu
Zhonghua Wu
Yiming Wang
Henghui Ding
Fayao Liu
Jie Lin
Guosheng Lin
+ PDF Chat Compositional Prototypical Networks for Few-Shot Classification 2023 Qiang Lyu
Weiqiang Wang
+ Compositional Prototypical Networks for Few-Shot Classification 2023 Qiang Lyu
Weiqiang Wang
+ Compositional Fine-Grained Low-Shot Learning 2021 Dat Huynh
Ehsan Elhamifar
+ Boosted Zero-Shot Learning with Semantic Correlation Regularization 2017 Te Pi
Xi Li
Zhongfei Zhang
+ Boosted Zero-Shot Learning with Semantic Correlation Regularization 2017 Te Pi
Xi Li
Zhongfei
Zhang
+ Learning Adaptive Classifiers Synthesis for Generalized Few-Shot Learning 2019 Han-Jia Ye
Hexiang Hu
De‐Chuan Zhan
+ Long-tail learning with class descriptors 2020 Dvir Samuel
Yuval Atzmon
Gal Chechik
+ Transferrable Feature and Projection Learning with Class Hierarchy for Zero-Shot Learning 2018 Aoxue Li
Zhiwu Lu
Jiechao Guan
Tao Xiang
Liwei Wang
Ji-Rong Wen
+ PDF Chat Like Humans to Few-Shot Learning through Knowledge Permeation of Vision and Text 2024 Yuyu Jia
Qing Zhou
Wei Huang
Junyu Gao
Qi Wang
+ Exploring Category-correlated Feature for Few-shot Image Classification 2021 Jing Xu
Xinglin Pan
Xu Luo
Wenjie Pei
Zenglin Xu
+ PDF Chat Exploring Category-correlated Feature for Few-shot Image Classification 2021 Jing Xu
Xinglin Pan
Xu Luo
Wenjie Pei
Zenglin Xu
+ GistNet: a Geometric Structure Transfer Network for Long-Tailed Recognition 2021 Bo Liu
Haoxiang Li
Hao Kang
Gang Hua
Nuno Vasconcelos
+ A Study on Representation Transfer for Few-Shot Learning 2022 Chun-Nam Yu
Yi Xie
+ PDF Chat Multi-cue Zero-Shot Learning with Strong Supervision 2016 Zeynep Akata
Mateusz Malinowski
Mario Fritz
Bernt Schiele
+ Multi-Cue Zero-Shot Learning with Strong Supervision 2016 Zeynep Akata
Mateusz Malinowski
Mario Fritz
Bernt Schiele