6 results found Sort:

ictnlp
LLaMA-Omni ictnlp
174
2.6k
apache-2.0
28
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
speech-to-text speech-to-speech speech-interaction large-language-models speech-language-model multimodal-large-language-models
Created 2024-09-10
13 commits to main branch, last one 9 days ago
jishengpeng
WavTokenizer jishengpeng
43
797
mit
20
SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling
dac codec gpt4o encodec acoustic semantic soundstream text-to-speech audio-representation speech-language-model speech-representation music-representation-learning
Created 2024-08-29
23 commits to main branch, last one 19 hours ago
zhenye234
xcodec zhenye234
5
104
unknown
8
Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
gpt audio codec music sound speech vall-e semantic tokenizer audio-codec text-to-music text-to-sound language-model text-to-speech speech-language-model self-supervised-learning
Created 2024-05-26
28 commits to main branch, last one about a month ago
jishengpeng
WavChat jishengpeng
3
94
unknown
5
A Survey of Spoken Dialogue Models (60 pages)
moshi duplex gpt-4o speech encodec mini-omni streaming llama-omni intreaction wavtokenizer modal-alignment speech-language-model speech-representation spoken-dialogue-models
Created 2024-11-11
21 commits to main branch, last one 19 hours ago
hhguo
SoCodec hhguo
3
63
mit
7
Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications
tts audio speech speech-codec speech-language-model
Created 2024-09-02
8 commits to master branch, last one 2 months ago
slp-rl
salmon slp-rl
0
40
unknown
1
The official code for the SALMon🍣 benchmark
acoustic-model audio-processing speech-language-model
Created 2024-04-29
17 commits to main branch, last one 2 months ago