Knowledge Concentration: Learning 100K Object Classifiers in a Single CNN

Jiyang Gao, Zijian Guo, Zhen Li, Ram Nevatia

Type: Preprint

Publication Date: 2017-01-01

Citations: 25

DOI: https://doi.org/10.48550/arxiv.1711.07607

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Feature Matters: A Stage-by-Stage Approach for Knowledge Transfer.	2018	Mengya Gao Yujun Shen Quanquan Li Chen Change Loy Xiaoou Tang
+	Beyond Classification: Knowledge Distillation using Multi-Object Impressions	2021	Gaurav Kumar Nayak Monish Keswani Sharan Seshadri Anirban Chakraborty
+	Beyond Classification: Knowledge Distillation using Multi-Object Impressions.	2021	Gaurav Kumar Nayak Monish Keswani Sharan Seshadri Anirban Chakraborty
+	An Embarrassingly Simple Approach for Knowledge Distillation	2018	Mengya Gao Yujun Shen Quanquan Li Junjie Yan Liang Wan Dahua Lin Chen Change Loy Xiaoou Tang
+	An Embarrassingly Simple Approach for Knowledge Distillation	2018	Mengya Gao Yujun Shen Quanquan Li Junjie Yan Liang Wan Dahua Lin Chen Change Loy Xiaoou Tang
+	Distilling Object Detectors With Global Knowledge	2022	Sanli Tang Zhongyu Zhang Zhanzhan Cheng Jing Lü Yunlu Xu Yi Niu Fan He
+ PDF Chat	Distilling Knowledge via Knowledge Review	2021	Pengguang Chen Shu Liu Hengshuang Zhao Jiaya Jia
+	HEAD: HEtero-Assists Distillation for Heterogeneous Object Detectors	2022	Luting Wang Xiaojie Li Yue Liao Zeren Jiang Jianlong Wu Fei Wang Qian Chen Si Liu
+	Instance-Conditional Knowledge Distillation for Object Detection	2021	Zijian Kang Peizhen Zhang Xiangyu Zhang Jian Sun Nanning Zheng
+ PDF Chat	Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation	2022	Gang Li Xiang Li Yujie Wang Shanshan Zhang Yichao Wu Liang Ding
+	Hybrid Knowledge Routed Modules for Large-scale Object Detection	2018	Chenhan Jiang Hang Xu Xiangdan Liang Liang Lin
+	Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation	2022	Zengyu Qiu Xinzhu Ma Kun‐Lin Yang Liu Chun-ya Jun Hou Shuai Yi Wanli Ouyang
+ PDF Chat	Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitation	2021	Gang Li Xiang Li Yujie Wang Shanshan Zhang Yichao Wu Liang Ding
+	Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitation	2021	Gang Li Xiang Li Yujie Wang Shanshan Zhang Yichao Wu Liang Ding
+ PDF Chat	Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation	2021	Mingi Ji Seungjae Shin Seunghyun Hwang Gibeom Park Il‐Chul Moon
+	Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation	2021	Mingi Ji Seungjae Shin Seunghyun Hwang Gibeom Park Il‐Chul Moon
+	Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation	2023	Shengcao Cao Mengtian Li James Hays Deva Ramanan Yixiong Wang Liang-Yan Gui
+	Localization Distillation for Object Detection	2022	Zhaohui Zheng Rongguang Ye Ping Wang Jun Wang Dongwei Ren Wangmeng Zuo
+ PDF Chat	Localization Distillation for Dense Object Detection	2022	Zhaohui Zheng Rongguang Ye Ping Wang Dongwei Ren Wangmeng Zuo Qibin Hou Ming‐Ming Cheng
+ PDF Chat	Frequency Attention for Knowledge Distillation	2024	Cuong The Pham Van Anh Nguyen Trung Le Dinh Phung Gustavo Carneiro Thanh-Toan Do

Works That Cite This (20)

Action	Title	Year	Authors
+	FSD50K: an Open Dataset of Human-Labeled Sound Events	2020	Eduardo Fonseca Xavier Favory Jordi Pons Frederic Font Xavier Serra
+	Improving Multi-Person Pose Estimation using Label Correction	2018	Naoki Kato Tianqi Li Kohei Nishino Yusuke Uchida
+ PDF Chat	Learning Metrics From Teachers: Compact Networks for Image Embedding	2019	Lu Yu Vacit Oguz Yazici Xialei Liu Joost van de Weijer Yongmei Cheng Arnau Ramisa
+	Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers	2019	Jingwen Ye Xinchao Wang Yixin Ji Kairi Ou Mingli Song
+	Learning Metrics from Teachers: Compact Networks for Image Embedding	2019	Lu Yu Vacit Oguz Yazici Xialei Liu Joost van de Weijer Yongmei Cheng Arnau Ramisa
+ PDF Chat	Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN	2020	Jingwen Ye Yixin Ji Xinchao Wang Xin Gao Mingli Song
+	Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers	2019	Jingwen Ye Xinchao Wang Yixin Ji Kairi Ou Mingli Song
+ PDF Chat	Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks	2021	Lin Wang Kuk‐Jin Yoon
+ PDF Chat	FSD50K: An Open Dataset of Human-Labeled Sound Events	2021	Eduardo Fonseca Xavier Favory Jordi Pons Frederic Font Xavier Serra
+	Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN	2020	Jingwen Ye Yixin Ji Xinchao Wang Xin Gao Mingli Song

Works Cited by This (14)

Action	Title	Year	Authors
+	Very Deep Convolutional Networks for Large-Scale Image Recognition	2014	Karen Simonyan Andrew Zisserman
+	FitNets: Hints for Thin Deep Nets	2014	Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang Carlo Gatta Yoshua Bengio
+	Distilling the Knowledge in a Neural Network	2015	Geoffrey E. Hinton Oriol Vinyals Jay B. Dean
+	HD-CNN: Hierarchical Deep Convolutional Neural Network for Large Scale Visual Recognition	2014	Zhicheng Yan Hao Zhang Robinson Piramuthu Vignesh Jagadeesh Dennis DeCoste Di Wei Yizhou Yu
+	Fine-grained Categorization and Dataset Bootstrapping using Deep Metric Learning with Humans in the Loop	2015	Yin Cui Feng Zhou Yuanqing Lin Serge Belongie
+	Densely Connected Convolutional Networks	2016	Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger
+	Revisiting Unreasonable Effectiveness of Data in Deep Learning Era	2017	Chen Sun Abhinav Shrivastava Saurabh Singh Abhinav Gupta
+	Rethinking the Inception Architecture for Computer Vision	2015	Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Zbigniew Wojna
+	Deep Residual Learning for Image Recognition	2015	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	How transferable are features in deep neural networks	2014	Jason Yosinski Jeff Clune Yoshua Bengio Hod Lipson