7 results found Sort:

s3prl
s3prl s3prl
496
2.4k
apache-2.0
44
Self-Supervised Speech Pre-training and Representation Learning Toolkit
apc cpc pase tera wavlm decoar hubert vq-apc decoar2 wav2vec data2vec wav2vec2 mockingjay vq-wav2vec distilhubert unispeech-sat speech-pretraining speech-representation representation-learning self-supervised-learning
Created 2019-07-15
3,207 commits to main branch, last one 20 days ago
jishengpeng
WavTokenizer jishengpeng
82
1.1k
mit
25
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
dac codec gpt4o encodec acoustic semantic soundstream text-to-speech audio-representation speech-language-model speech-representation music-representation-learning
Created 2024-08-29
32 commits to main branch, last one 29 days ago
ddlBoJack
emotion2vec ddlBoJack
57
780
unknown
16
[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
iemocap speech-representation pytorch-implementation speech-emotion-recognition
Created 2023-11-25
44 commits to main branch, last one 3 months ago
jishengpeng
WavChat jishengpeng
16
284
unknown
8
A Survey of Spoken Dialogue Models (60 pages)
moshi duplex gpt-4o speech encodec mini-omni streaming llama-omni intreaction wavtokenizer modal-alignment speech-language-model speech-representation spoken-dialogue-models
Created 2024-11-11
32 commits to main branch, last one 4 months ago
mechanicalsea
lighthubert mechanicalsea
6
70
mit
4
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
pytorch lighthubert speech-representation self-supervised-learning neural-architecture-search
Created 2022-03-24
15 commits to main branch, last one 2 years ago
andi611
Mockingjay-Speech-Representation andi611
12
54
mit
5
Official Implementation of Mockingjay in Pytorch
apc speech pytorch mockingjay feature-extraction phoneme-prediction speaker-recognition phone-classification speech-representation pytorch-implementation speaker-classification representation-learning sentiment-classification
Created 2020-06-08
7 commits to master branch, last one 3 years ago
vectominist
MiniASR vectominist
6
50
mit
4
A mini, simple, and fast end-to-end automatic speech recognition toolkit.
asr ctc s3prl hubert fairseq minimal pytorch wav2vec2 speech-recognition speech-representation
Created 2021-07-14
27 commits to main branch, last one 2 years ago