5 results found Sort:

ictnlp
LLaMA-Omni ictnlp
117
2.0k
apache-2.0
26
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
speech-to-text speech-to-speech speech-interaction large-language-models speech-language-model multimodal-large-language-models
Created 2024-09-10
12 commits to main branch, last one 5 days ago
jishengpeng
WavTokenizer jishengpeng
39
673
mit
17
SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling
dac codec gpt4o encodec acoustic semantic soundstream text-to-speech audio-representation speech-language-model speech-representation music-representation-learning
Created 2024-08-29
20 commits to main branch, last one 8 days ago
zhenye234
xcodec zhenye234
3
88
unknown
6
Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
gpt audio codec music sound speech vall-e semantic tokenizer audio-codec text-to-music text-to-sound language-model text-to-speech speech-language-model self-supervised-learning
Created 2024-05-26
26 commits to main branch, last one 4 days ago
hhguo
SoCodec hhguo
2
39
mit
5
Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications
tts audio speech speech-codec speech-language-model
Created 2024-09-02
8 commits to master branch, last one 9 days ago
slp-rl
salmon slp-rl
0
38
unknown
1
The official code for the SALMon🍣 benchmark
acoustic-model audio-processing speech-language-model
Created 2024-04-29
17 commits to main branch, last one 13 days ago