MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classification

Type: Article

Publication Date: 2017-10-05

Citations: 210

DOI: https://doi.org/10.1109/lgrs.2017.2752750

Abstract

With the development of deep learning, supervised learning has frequently been adopted to classify remotely sensed images using convolutional networks. However, due to the limited amount of labeled data available, supervised learning is often difficult to carry out. Therefore, we proposed an unsupervised model called multiple-layer feature-matching generative adversarial networks (MARTA GANs) to learn a representation using only unlabeled data. MARTA GANs consists of both a generative model G and a discriminative model D. We treat D as a feature extractor. To fit the complex properties of remote sensing data, we use a fusion layer to merge the mid-level and global features. G can produce numerous images that are similar to the training data; therefore, D can learn better representations of remotely sensed images using the training data provided by G. The classification results on two widely used remote sensing image databases show that the proposed method significantly improves the classification performance compared with other state-of-the-art methods.

Locations

  • IEEE Geoscience and Remote Sensing Letters - View
  • arXiv (Cornell University) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ PDF Chat Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities 2020 Gong Cheng
Xingxing Xie
Junwei Han
Lei Guo
Gui-Song Xia
+ PDF Chat DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval 2020 Yun Cao
Yuebin Wang
Junhuan Peng
Liqiang Zhang
Linlin Xu
Kai Yan
Lihua Li
+ State-of-the-art and gaps for deep learning on limited training data in remote sensing 2018 John Ball
Derek T. Anderson
Pan Wei
+ PDF Chat State-of-the-Art and Gaps for Deep Learning on Limited Training Data in Remote Sensing 2018 John Ball
Derek T. Anderson
Pan Wei
+ A Unified GAN Framework Regarding Manifold Alignment for Remote Sensing Images Generation 2023 Xingzhe Su
Wenwen Qiang
Zeen Song
Hang Gao
Fengge Wu
Changwen Zheng
+ PDF Chat SiftingGAN: Generating and Sifting Labeled Samples to Improve the Remote Sensing Image Scene Classification Baseline <i>In Vitro</i> 2019 DongAo Ma
Ping Tang
Lijun Zhao
+ PDF Chat Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution 2022 Sen Jia
Zhihao Wang
Qingquan Li
Xiuping Jia
Meng Xu
+ Deep Unsupervised Representation Learning for Remote Sensing Images. 2016 Daoyu Lin
+ S2-cGAN: Self-Supervised Adversarial Representation Learning for Binary Change Detection in Multispectral Images 2020 Jose Luis Holgado Alvarez
Mahdyar Ravanbakhsh
Begüm Demir
+ S2-cGAN: Self-Supervised Adversarial Representation Learning for Binary Change Detection in Multispectral Images 2020 Jose Luis Holgado Alvarez
Mahdyar Ravanbakhsh
Begüm Demir
+ Supervised and Contrastive Self-Supervised In-Domain Representation Learning for Dense Prediction Problems in Remote Sensing 2023 Ali Ghanbarzade
Hossein Soleimani
+ Multi-Attention Generative Adversarial Network for Remote Sensing Image Super-Resolution 2021 Meng Xu
Zhihao Wang
Jiasong Zhu
Xiuping Jia
Sen Jia
+ A Dual Attentive Generative Adversarial Network for Remote Sensing Image Change Detection 2023 Luyi Qiu
Xiaofeng Zhang
ChaoChen Gu
and ShanYing Zhu
+ Representation Learning for Remote Sensing: An Unsupervised Sensor Fusion Approach 2019 Aidan M. Swope
Xander Rudelis
Kyle Story
+ PDF Chat Generative Adversarial Networks and Conditional Random Fields for Hyperspectral Image Classification 2019 Zilong Zhong
Jonathan Li
David A. Clausi
Alexander Wong
+ Representation Learning for Remote Sensing: An Unsupervised Sensor Fusion Approach 2021 Aidan M. Swope
Xander Rudelis
Kyle Story
+ PDF Chat Generative Adversarial Networks and Probabilistic Graph Models for Hyperspectral Image Classification 2018 Zilong Zhong
Jonathan Li
+ Generative Adversarial Networks and Probabilistic Graph Models for Hyperspectral Image Classification 2018 Zilong Zhong
Jonathan Li
+ In-domain representation learning for remote sensing 2019 Maxim Neumann
André Susano Pinto
Xiaohua Zhai
Neil Houlsby
+ Artificial Generation of Big Data for Improving Image Classification: A Generative Adversarial Network Approach on SAR Data 2017 Dimitrios Marmanis
Wei Yao
Fathalrahman Adam
Mihai Datcu
Peter Reinartz
Konrad Schindler
Jan Dirk Wegner
Uwe Stilla

Works That Cite This (39)

Action Title Year Authors
+ PDF Chat Vehicle detection of multi-source remote sensing data using active fine-tuning network 2020 Xin Wu
Wei Li
Danfeng Hong
Jiaojiao Tian
Ran Tao
Qian Du
+ PDF Chat Deep Learning Approach for Building Detection in Satellite Multispectral Imagery 2018 Geesara Kulathunga
Ilya Afanasyev
+ PDF Chat DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval 2020 Yun Cao
Yuebin Wang
Junhuan Peng
Liqiang Zhang
Linlin Xu
Kai Yan
Lihua Li
+ Generative Adversarial Networks for Classification 2017 Steven A. Israel
J. Goldstein
Jeffrey S. Klein
James Talamonti
Franklin Tanner
Shane Zabel
Philip Andrew Sallee
Lisa A. McCoy
+ PDF Chat A Review of Generative Adversarial Networks (GANs) and Its Applications in a Wide Variety of Disciplines: From Medical to Remote Sensing 2023 Ankan Dash
Junyi Ye
Guiling Wang
+ In-domain representation learning for remote sensing 2019 Maxim Neumann
André Susano Pinto
Xiaohua Zhai
Neil Houlsby
+ Artificial Generation of Big Data for Improving Image Classification: A Generative Adversarial Network Approach on SAR Data 2017 Dimitrios Marmanis
Wei Yao
Fathalrahman Adam
Mihai Datcu
Peter Reinartz
Konrad Schindler
Jan Dirk Wegner
Uwe Stilla
+ Mixture of Spectral Generative Adversarial Networks for Imbalanced Hyperspectral Image Classification 2020 Tanmoy Dam
Sreenatha G. Anavatti
Hussein A. Abbass
+ PDF Chat SiftingGAN: Generating and Sifting Labeled Samples to Improve the Remote Sensing Image Scene Classification Baseline <i>In Vitro</i> 2019 DongAo Ma
Ping Tang
Lijun Zhao
+ PDF Chat Balance Scene Learning Mechanism for Offshore and Inshore Ship Detection in SAR Images 2020 Tianwen Zhang
Xiaoling Zhang
Jun Shi
Shunjun Wei
Jianguo Wang
Jianwei Li
Hao Su
Yue Zhou

Works Cited by This (13)

Action Title Year Authors
+ k-Sparse Autoencoders 2013 Alireza Makhzani
Brendan J. Frey
+ Merger-driven Fueling of Active Galactic Nuclei: Six Dual and Offset Active Galactic Nuclei Discovered with Chandra and Hubble Space Telescope Observations 2015 Julia M. Comerford
D. Pooley
R. Scott Barrows
Jenny E. Greene
Nadia L. Zakamska
G. M. Madejski
Michael C. Cooper
+ PDF Chat Learning to generate chairs with convolutional neural networks 2015 Alexey Dosovitskiy
Jost Tobias Springenberg
Thomas Brox
+ Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks 2015 Alec Radford
Luke Metz
Soumith Chintala
+ PDF Chat Towards better exploiting convolutional neural networks for remote sensing scene classification 2016 Keiller Nogueira
Otávio A. B. Penatti
Jefersson A. dos Santos
+ TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems 2016 Martı́n Abadi
Ashish Agarwal
Paul Barham
Eugene Brevdo
Zhifeng Chen
Craig Citro
Gregory S. Corrado
Andy Davis
Jay B. Dean
Matthieu Devin
+ InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets 2016 Xi Chen
Yan Duan
Rein Houthooft
John Schulman
Ilya Sutskever
Pieter Abbeel
+ Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift 2015 Sergey Ioffe
Christian Szegedy
+ Efficient Estimation of Word Representations in Vector Space 2013 Tomáš Mikolov
Kai Chen
Greg S. Corrado
Jay B. Dean
+ Improved Techniques for Training GANs 2016 Tim Salimans
Ian Goodfellow
Wojciech Zaremba
Vicki Cheung
Alec Radford
Xi Chen