Ask a Question

Prefer a chat interface with context about you and your work?

Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models

Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models

In recent years, large language models have achieved significant success in generative tasks (e.g., speech cloning and audio generation) related to speech, audio, music, and other signal domains. A crucial element of these models is the discrete acoustic codecs, which serves as an intermediate representation replacing the mel-spectrogram. However, there …