Prefer a chat interface with context about you and your work?
Training a Multilingual Sportscaster: Using Perceptual Context to Learn Language
We present a novel framework for learning to interpret and generate language using only perceptual context as supervision. We demonstrate its capabilities by developing a system that learns to sportscast simulated robot soccer games in both English and Korean without any language-specific prior knowledge. Training employs only ambiguous supervision consisting …