Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation
Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation
Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and efficiency of existing NAS solutions are unclear, with some recent works going so far as to suggest that many existing …