Semantically Distributed Robust Optimization for Vision-and-Language Inference
Semantically Distributed Robust Optimization for Vision-and-Language Inference
Analysis of vision-and-language models has revealed their brittleness under linguistic phenomena such as paraphrasing, negation, textual entailment, and word substitutions with synonyms or antonyms.While data augmentation techniques have been designed to mitigate against these failure modes, methods that can integrate this knowledge into the training pipeline remain under-explored.In this paper, …