EdgeViTs: Competing Light-Weight CNNs on Mobile Devices with Vision Transformers

Junting Pan, Adrian Bulat, Fuwen Tan, Xiatian Zhu, Łukasz Dudziak, Hongsheng Li, Georgios Tzimiropoulos, Brais Martínez

Type: Book-Chapter

Publication Date: 2022-01-01

Citations: 123

DOI: https://doi.org/10.1007/978-3-031-20083-0_18

View Publication

Download PDF

Locations

Lecture notes in computer science - View
arXiv (Cornell University) - View - PDF
Queen Mary Research Online (Queen Mary University of London) - View - PDF

Similar Works

Action	Title	Year	Authors
+ PDF Chat	EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications	2023	Muhammad Maaz Abdelrahman Shaker Hisham Cholakkal Salman Khan Syed Waqas Zamir Rao Muhammad Anwer Fahad Shahbaz Khan
+	EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers	2022	Junting Pan Adrian Bulat Fuwen Tan Xiatian Zhu Łukasz Dudziak Hongsheng Li Georgios Tzimiropoulos Brais Martínez
+	EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications	2022	Muhammad Maaz Abdelrahman Shaker Hisham Cholakkal Salman Khan Syed Waqas Zamir Rao Muhammad Anwer Fahad Shahbaz Khan
+	MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer	2021	Sachin Mehta Mohammad Rastegari
+	MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer	2021	Sachin Mehta Mohammad Rastegari
+	Vision Transformers for Mobile Applications: A Short Survey	2023	Nahid Alam Steven Kolawole Simardeep Sethi Nishant Bansali Karina Nguyen
+	MoCoViT: Mobile Convolutional Vision Transformer	2022	Hailong Ma Xin Xia Xing Wang Xuefeng Xiao Jiashi Li Min Zheng
+	SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device	2023	Weiran Gou Ziyao Yi Yan Xiang Shaoqing Li Zibin Liu Dehui Kong Ke Xu
+	RepViT: Revisiting Mobile CNN From ViT Perspective	2023	Ao Wang Hui Chen Zijia Lin Hengjun Pu Guiguang Ding
+	ExMobileViT: Lightweight Classifier Extension for Mobile Vision Transformer	2023	Gyeongdong Yang Yungwook Kwon Hyunjin Kim
+ PDF Chat	iFormer: Integrating ConvNet and Transformer for Mobile Application	2025	Chuanyang Zheng
+ PDF Chat	ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices	2023	Chen Tang Li Lyna Zhang Huiqiang Jiang Jiahang Xu Ting Cao Quanlu Zhang Yuqing Yang Zhi Wang Mao Yang
+	MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Features	2022	Shakti N. Wadekar Abhishek Chaurasia
+	Separable Self-attention for Mobile Vision Transformers	2022	Sachin Mehta Mohammad Rastegari
+	Rethinking Vision Transformers for MobileNet Size and Speed	2022	Yanyu Li Hu Ju Wen Yang Georgios Evangelidis Kamyar Salahi Yanzhi Wang Sergey Tulyakov Jian Ren
+	HyT-NAS: Hybrid Transformers Neural Architecture Search for Edge Devices	2023	Lotfi Abdelkrim Mecharbat Hadjer Benmeziane Hamza Ouranoughi Smaïl Niar
+	MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications	2017	Andrew Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto Hartwig Adam
+	MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications	2017	Andrew Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto Hartwig Adam
+	ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices	2023	Chen Tang Li Lyna Zhang Huiqiang Jiang Jiahang Xu Ting Cao Quanlu Zhang Yuqing Yang Zhi Wang Mao Yang
+	Deep Learning on Edge TPUs	2021	Andreas M. Kist

Works That Cite This (33)

Action	Title	Year	Authors
+ PDF Chat	Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review	2023	Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha Yong Yue Eng Gee Lim Hyungjoon Seo Ka Lok Man Xiaohui Zhu
+ PDF Chat	A Robust Adversary Detection-Deactivation Method for Metaverse-Oriented Collaborative Deep Learning	2023	Pengfei Li Zhibo Zhang Ameena Saad Al‐Sumaiti Naoufel Werghi Chan Yeob Yeun
+ PDF Chat	Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks	2023	Jierun Chen Shiu-hong Kao Hao He Weipeng Zhuo Wen Song Chul‐Ho Lee S.-H. Gary Chan
+	Deeply Supervised Skin Lesions Diagnosis with Stage and Branch Attention	2022	Wei Dai Rui Liu Tianyi Wu Min Wang Jianqin Yin Jun Liu
+ PDF Chat	Rethinking Vision Transformers for MobileNet Size and Speed	2023	Yanyu Li Hu Ju Yang Wen Georgios Evangelidis Kamyar Salahi Yanzhi Wang Sergey Tulyakov Jian Ren
+ PDF Chat	Omni Aggregation Networks for Lightweight Image Super-Resolution	2023	Hang Wang Xuanhong Chen Bingbing Ni Yutian Liu Jinfan Liu
+ PDF Chat	EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention	2023	Xinyu Liu Houwen Peng Ningxin Zheng Yuqing Yang Han Hu Yixuan Yuan
+ PDF Chat	TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models	2023	Sucheng Ren Fangyun Wei Zheng Zhang Han Hu
+ PDF Chat	Dynamic Perceiver for Efficient Visual Recognition	2023	Yizeng Han Dongchen Han Zeyu Liu Yulin Wang Xuran Pan Yifan Pu Chao Deng Junlan Feng Shiji Song Gao Huang
+	Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review	2023	Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha Yong Yue Eng Gee Lim Hyungjoon Seo Ka Lok Man Xiaohui Zhu

Works Cited by This (30)

Action	Title	Year	Authors
+ PDF Chat	ImageNet Large Scale Visual Recognition Challenge	2015	Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael S. Bernstein
+ PDF Chat	Rethinking the Inception Architecture for Computer Vision	2016	Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jon Shlens Zbigniew Wojna
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+ PDF Chat	Feature Pyramid Networks for Object Detection	2017	Tsung-Yi Lin Piotr Dollár Ross Girshick Kaiming He Bharath Hariharan Serge Belongie
+ PDF Chat	ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design	2018	Ningning Ma Xiangyu Zhang Hai-Tao Zheng Jian Sun
+ PDF Chat	Panoptic Feature Pyramid Networks	2019	Alexander Kirillov Ross Girshick Kaiming He Piotr Dollár
+ PDF Chat	Learning Efficient Convolutional Networks through Network Slimming	2017	Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang
+ PDF Chat	Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference	2018	Benoit Jacob Skirmantas Kligys Bo Chen Menglong Zhu Matthew F. Tang Andrew Howard Hartwig Adam Dmitry Kalenichenko
+ PDF Chat	ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices	2018	Xiangyu Zhang Xinyu Zhou Mengxiao Lin Jian Sun
+ PDF Chat	MobileNetV2: Inverted Residuals and Linear Bottlenecks	2018	Mark Sandler Andrew Howard Menglong Zhu Andrey Zhmoginov Liang-Chieh Chen