Prefer a chat interface with context about you and your work?
Hard Negative Sampling via Regularized Optimal Transport for Contrastive Representation Learning
We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum (worst-case) generalized contrastive learning loss over all couplings (joint distributions between positive and negative samples subject to marginal constraints) …