Expectation-Maximization Attention Networks for Semantic Segmentation
Expectation-Maximization Attention Networks for Semantic Segmentation
Self-attention mechanism has been widely used for various tasks. It is designed to compute the representation of each position by a weighted sum of the features at all positions. Thus, it can capture long-range relations for computer vision tasks. However, it is computationally consuming. Since the attention maps are computed …