Unspeech: Unsupervised Speech Context Embeddings
Unspeech: Unsupervised Speech Context Embeddings
We introduce "Unspeech" embeddings, which are based on unsupervised learning of context feature representations for spoken language.The embeddings were trained on up to 9500 hours of crawled English speech data without transcriptions or speaker information, by using a straightforward learning objective based on context and non-context discrimination with negative sampling.We …