8 results found Sort:

ictnlp
LLaMA-Omni ictnlp
194
2.8k
apache-2.0
30
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
speech-to-text speech-to-speech speech-interaction large-language-models speech-language-model multimodal-large-language-models
Created 2024-09-10
13 commits to main branch, last one 3 months ago
jishengpeng
WavTokenizer jishengpeng
75
1.0k
mit
23
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
dac codec gpt4o encodec acoustic semantic soundstream text-to-speech audio-representation speech-language-model speech-representation music-representation-learning
Created 2024-08-29
32 commits to main branch, last one 8 days ago
jishengpeng
WavChat jishengpeng
16
271
unknown
8
A Survey of Spoken Dialogue Models (60 pages)
moshi duplex gpt-4o speech encodec mini-omni streaming llama-omni intreaction wavtokenizer modal-alignment speech-language-model speech-representation spoken-dialogue-models
Created 2024-11-11
32 commits to main branch, last one 3 months ago
zhenye234
xcodec zhenye234
11
177
unknown
7
AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
gpt audio codec music sound speech vall-e semantic tokenizer audio-codec text-to-music text-to-sound language-model text-to-speech speech-language-model self-supervised-learning
Created 2024-05-26
31 commits to main branch, last one 2 months ago
slp-rl
slamkit slp-rl
8
171
mit
7
SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on One GPU in a Day"
transformers language-model efficient-training speech-language-model
Created 2025-02-18
15 commits to main branch, last one 5 days ago
hhguo
SoCodec hhguo
4
80
mit
8
Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications
tts audio speech speech-codec speech-language-model
Created 2024-09-02
10 commits to master branch, last one 2 months ago
kehanlu
DeSTA2 kehanlu
4
69
other
5
Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"
speech-processing large-language-models speech-language-model
Created 2024-09-13
11 commits to main branch, last one about a month ago
slp-rl
salmon slp-rl
0
44
unknown
1
The official code for the SALMonšŸ£ benchmark (ICASSP 2025 - Oral)
acoustic-model audio-processing speech-language-model
Created 2024-04-29
29 commits to main branch, last one a day ago