Bi-Classifier Determinacy Maximization for Unsupervised Domain Adaptation

Type: Article

Publication Date: 2021-05-18

Citations: 84

DOI: https://doi.org/10.1609/aaai.v35i10.17027

Abstract

Unsupervised domain adaptation challenges the problem of transferring knowledge from a well-labelled source domain to an unlabelled target domain. Recently, adversarial learning with bi-classifier has been proven effective in pushing cross-domain distributions close. Prior approaches typically leverage the disagreement between bi-classifier to learn transferable representations, however, they often neglect the classifier determinacy in the target domain, which could result in a lack of feature discriminability. In this paper, we present a simple yet effective method, namely Bi-Classifier Determinacy Maximization (BCDM), to tackle this problem. Motivated by the observation that target samples cannot always be separated distinctly by the decision boundary, here in the proposed BCDM, we design a novel classifier determinacy disparity (CDD) metric, which formulates classifier discrepancy as the class relevance of distinct target predictions and implicitly introduces constraint on the target feature discriminability. To this end, the BCDM can generate discriminative representations by encouraging target predictive outputs to be consistent and determined, meanwhile, preserve the diversity of predictions in an adversarial manner. Furthermore, the properties of CDD as well as the theoretical guarantees of BCDM's generalization bound are both elaborated. Extensive experiments show that BCDM compares favorably against the existing state-of-the-art domain adaptation methods.

Locations

  • Proceedings of the AAAI Conference on Artificial Intelligence - View - PDF
  • arXiv (Cornell University) - View - PDF
  • Edinburgh Research Explorer (University of Edinburgh) - View - PDF
  • Edinburgh Research Explorer (University of Edinburgh) - View - PDF

Similar Works

Action Title Year Authors
+ Bi-Classifier Determinacy Maximization for Unsupervised Domain Adaptation 2020 Shuang Li
Fangrui Lv
Binhui Xie
Chi Harold Liu
Jian Liang
Chen Qin
+ PDF Chat Bi-Discriminator Domain Adversarial Neural Networks With Class-Level Gradient Alignment 2024 Chuang Zhao
Hongke Zhao
Hengshu Zhu
Zhenya Huang
Nan Feng
Enhong Chen
Hui Xiong
+ PDF Chat Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation 2021 Zhekai Du
Jingjing Li
Hongzu Su
Lei Zhu
Ke Lü
+ Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation 2021 Zhekai Du
Jingjing Li
Hongzu Su
Lei Zhu
Ke Lü
+ PDF Chat Crucial Semantic Classifier-based Adversarial Learning for Unsupervised Domain Adaptation 2023 Yumin Zhang
Yajun Gao
Hongliu Li
Ating Yin
Duzhen Zhang
Xiuyi Chen
+ Crucial Semantic Classifier-based Adversarial Learning for Unsupervised Domain Adaptation 2023 Yumin Zhang
Yajun Gao
Hongliu Li
Ating Yin
Duzhen Zhang
Xiuyi Chen
+ Opposite Structure Learning for Semi-supervised Domain Adaptation 2020 Can Qin
Lichen Wang
Qianqian Ma
Yu Yin
Huan Wang
Yun Fu
+ PDF Chat Contradictory Structure Learning for Semi-supervised Domain Adaptation 2021 Can Qin
Lichen Wang
Qianqian Ma
Yu Yin
Huan Wang
Yun Fu
+ Contradictory Structure Learning for Semi-supervised Domain Adaptation 2020 Can Qin
Lichen Wang
Qianqian Ma
Yu Yin
Huan Wang
Yun Fu
+ Bi-discriminator Domain Adversarial Neural Networks with Class-Level Gradient Alignment 2023 Chuang Zhao
Zhao Hongke
Hengshu Zhu
Zhenya Huang
Nan Feng
Enhong Chen
Hui Xiong
+ Domain Agnostic Prototypical Distribution for Unsupervised Model Adaptation 2020 Mohammad Rostami
Aram Galstyan
+ Bridging Theory and Algorithm for Domain Adaptation 2019 Yuchen Zhang
Tianle Liu
Mingsheng Long
Michael I. Jordan
+ Adversarial Open Set Domain Adaptation Based on Mutual Information 2020 Tasfia Shermin
Guojun Lu
Ferdous Sohel
Shyh Wei Teng
Manzur Murshed
+ Self-adaptive Re-weighted Adversarial Domain Adaptation 2020 Shanshan Wang
Lei Zhang
+ Self-adaptive Re-weighted Adversarial Domain Adaptation 2020 Shanshan Wang
Lei Zhang
+ MiniMax Entropy Network: Learning Category-Invariant Features for Domain Adaptation 2019 Chaofan Tao
Fengmao Lv
Lixin Duan
Min Wu
+ A Balanced and Uncertainty-aware Approach for Partial Domain Adaptation 2020 Jian Liang
Yunbo Wang
Dapeng Hu
Ran He
Jiashi Feng
+ PDF Chat Unsupervised Multi-Class Domain Adaptation: Theory, Algorithms, and Practice 2020 Yabin Zhang
Bin Deng
Hui Tang
Lei Zhang
Kui Jia
+ Boosting Unsupervised Domain Adaptation with Soft Pseudo-label and Curriculum Learning 2021 Shengjia Zhang
Tiancheng Lin
Yi Xu
+ Maximum Classifier Discrepancy for Unsupervised Domain Adaptation 2017 Kuniaki Saito
Kohei Watanabe
Yoshitaka Ushiku
Tatsuya Harada

Works That Cite This (16)

Action Title Year Authors
+ PDF Chat Causality Inspired Representation Learning for Domain Generalization 2022 Fangrui Lv
Jian Liang
Shuang Li
Bin Zang
Chi Harold Liu
Ziteng Wang
Di Liu
+ PDF Chat Active Learning for Domain Adaptation: An Energy-Based Approach 2022 Binhui Xie
Longhui Yuan
Shuang Li
Chi Harold Liu
Xinjing Cheng
Guoren Wang
+ PDF Chat Correspondence-Free Domain Alignment for Unsupervised Cross-Domain Image Retrieval 2023 Xu Wang
Dezhong Peng
Ming Yan
Peng Hu
+ PDF Chat Minimizing Maximum Model Discrepancy for Transferable Black-box Targeted Attacks 2023 Anqi Zhao
Tong Chu
Yahao Liu
Wen Li
Jingjing Li
Lixin Duan
+ WUDA: Unsupervised Domain Adaptation Based on Weak Source Domain Labels 2023 Shengjie Liu
Chuang Zhu
Yuan Li
Wenqi Tang
+ Exploiting Both Domain-specific and Invariant Knowledge via a Win-win Transformer for Unsupervised Domain Adaptation 2021 Wenxuan Ma
Jinming Zhang
Shuang Li
Chi Harold Liu
Yulin Wang
Wei Li
+ PDF Chat Semantic Concentration for Domain Adaptation 2021 Shuang Li
Mixue Xie
Fangrui Lv
Chi Harold Liu
Jian Liang
Chen Qin
Wei Li
+ PDF Chat Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Driving 2023 Manuel Schwonberg
Joshua Niemeijer
Jan-Aike Termöhlen
Jörg Schäfer
Nico M. Schmidt
Hanno Gottschalk
Tim Fingscheidt
+ PDF Chat Crucial Semantic Classifier-based Adversarial Learning for Unsupervised Domain Adaptation 2023 Yumin Zhang
Yajun Gao
Hongliu Li
Ating Yin
Duzhen Zhang
Xiuyi Chen
+ PDF Chat Gradient Harmonization in Unsupervised Domain Adaptation 2024 Fuxiang Huang
Suqi Song
Lei Zhang