Optimizing DNNs With Partially Equivalent Transformations and Automated Corrections

Haojie Wang, Jidong Zhai, Mingyu Gao, Feng Zhang, Tuowei Wang, Zixuan Ma, Shizhi Tang, Liyan Zheng, Wen Wang, Kaiyuan Rong

Type: Article

Publication Date: 2023-08-28

Citations: 1

DOI: https://doi.org/10.1109/tc.2023.3307795

View Publication

Locations

IEEE Transactions on Computers - View

Similar Works

Action	Title	Year	Authors
+	OLLIE: Derivation-based Tensor Program Optimizer	2022	Zheng Liyan Haojie Wang Jidong Zhai Muyan Hu Zixuan Ma Tuowei Wang Shizhi Tang Lei Xie Kezhao Huang Zhihao Jia
+	Fasor: A Fast Tensor Program Optimization Framework for Efficient DNN Deployment	2024	Hanxian Huang Xin Chen Jishen Zhao
+	SoD <sup>2</sup> : Statically Optimizing Dynamic Deep Neural Network Execution	2024	Wei Niu Gagan Agrawal Bin Ren
+ PDF Chat	A Multi-Level Superoptimizer for Tensor Programs	2024	Mengdi Wu Xinhao Cheng Oded Padon Zhihao Jia
+ PDF Chat	Ansor : Generating High-Performance Tensor Programs for Deep Learning	2020	Lianmin Zheng Chengfan Jia Minmin Sun Wu Zhao Cody Hao Yu Ameer Haj-Ali Yida Wang Jun Yang Danyang Zhuo Koushik Sen
+	Ansor: Generating high-performance tensor programs for deep learning	2020	Lianmin Zheng Chengfan Jia Minmin Sun Wu Zhao Cody Hao Yu Ameer Haj-Ali Yida Wang Jun Yang Danyang Zhuo Koushik Sen
+	Ansor: Generating High-Performance Tensor Programs for Deep Learning	2020	Lianmin Zheng Chengfan Jia Minmin Sun Zhao Wu Cody Hao Yu Ameer Haj-Ali Yida Wang Jun Yang Danyang Zhuo Koushik Sen
+ PDF Chat	DNNFusion: accelerating deep neural networks execution with advanced operator fusion	2021	Wei Niu Jiexiong Guan Yanzhi Wang Gagan Agrawal Bin Ren
+	A Swap Dominated Tensor Re-Generation Strategy for Training Deep Learning Models	2022	Lijie Wen Zan Zong Lin Li Leilei Lin
+	Transfer-Tuning: Reusing Auto-Schedules for Efficient Tensor Program Code Generation	2022	Perry Gibson José Cano
+ PDF Chat	Optimal Kernel Orchestration for Tensor Programs with Korch	2024	Muyan Hu Ashwin Venkatram S. Biswas Balamurugan Marimuthu Bohan Hou G. Oliaro Haojie Wang Liyan Zheng Xupeng Miao Jidong Zhai
+	Optimizing Deep Learning Inference via Global Analysis and Tensor Expressions	2024	Chunwei Xia Jiacheng Zhao Q.X. Sun Zheng Wang Yuan Wen Teng Yu Xiaobing Feng Huimin Cui
+	TFLMS: Large Model Support in TensorFlow by Graph Rewriting	2018	Tung D. Le Haruki Imai Yasushi Negishi Kiyokuni Kawachiya
+ PDF Chat	Neural architecture search as program transformation exploration	2021	Jack Turner Elliot J. Crowley Michael O’Boyle
+	TeMCO: Tensor Memory Compiler Optimization across Tensor Decompositions in Deep Learning Inference	2024	Seungbin Song J. Lee H. K. Jeong H. Kwon Shinnung Jeong Jaeho Lee Hanjun Kim
+	Evolutionary Algorithm with Non-parametric Surrogate Model for Tensor Program optimization	2020	Ioannis Gatopoulos Romain Lepert Auke Wiggers Giovanni Mariani Jakub M. Tomczak
+ PDF Chat	OpEvo: An Evolutionary Method for Tensor Operator Optimization	2021	Xiaotian Gao Wei Cui Lintao Zhang Mao Yang
+	Transfer Learning Across Heterogeneous Features For Efficient Tensor Program Generation	2023	Gaurav Verma Siddhisanket Raskar Zhen Xie Abid M Malik Murali Emani Barbara Chapman
+	Transfer Learning Across Heterogeneous Features For Efficient Tensor Program Generation	2023	Gaurav Verma Siddhisanket Raskar Zhen Xie Abid M. Malik Murali Emani Barbara Chapman
+	PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR	2023	Zixuan Ma Haojie Wang Jingze Xing Liyan Zheng Chen Zhang Huanqi Cao Kezhao Huang Shizhi Tang Penghan Wang Jidong Zhai

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (20)

Action	Title	Year	Authors
+	Probabilistic algorithms for sparse polynomials	1979	Richard Zippel
+	Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions	2018	Nicolas Vasilache Oleksandr Zinenko Theodoros Theodoridis Priya Goyal Zachary DeVito William S. Moses Sven Verdoolaege Andrew Adams Albert Cohen
+	Ansor: Generating high-performance tensor programs for deep learning	2020	Lianmin Zheng Chengfan Jia Minmin Sun Wu Zhao Cody Hao Yu Ameer Haj-Ali Yida Wang Jun Yang Danyang Zhuo Koushik Sen
+ PDF Chat	Going deeper with convolutions	2015	Christian Szegedy Wei Liu Yangqing Jia Pierre Sermanet Scott Reed Dragomir Anguelov Dumitru Erhan Vincent Vanhoucke Andrew Rabinovich
+ PDF Chat	Fast Algorithms for Convolutional Neural Networks	2016	Andrew Lavin Scott Gray
+ PDF Chat	Rethinking the Inception Architecture for Computer Vision	2016	Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jon Shlens Zbigniew Wojna
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	TVM: End-to-End Optimization Stack for Deep Learning	2018	Tianqi Chen Thierry Moreau Ziheng Jiang Haichen Shen Eddie Yan Leyuan Wang Yuwei Hu Luís Ceze Carlos Guestrin Arvind Krishnamurthy
+	Learning to Optimize Tensor Programs	2018	Tianqi Chen Lianmin Zheng Eddie Yan Ziheng Jiang Thierry Moreau Luís Ceze Carlos Guestrin Arvind Krishnamurthy
+	Optimizing CNN Model Inference on CPUs	2018	Yizhi Liu Yao Wang Ruofei Yu Mu Li Vin Sharma Yida Wang