7 results found Sort:

s3prl
s3prl s3prl
487
2.3k
apache-2.0
46
Self-Supervised Speech Pre-training and Representation Learning Toolkit
apc cpc pase tera wavlm decoar hubert vq-apc decoar2 wav2vec data2vec wav2vec2 mockingjay vq-wav2vec distilhubert unispeech-sat speech-pretraining speech-representation representation-learning self-supervised-learning
Created 2019-07-15
3,184 commits to main branch, last one 19 days ago
jishengpeng
WavTokenizer jishengpeng
43
792
mit
20
SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling
dac codec gpt4o encodec acoustic semantic soundstream text-to-speech audio-representation speech-language-model speech-representation music-representation-learning
Created 2024-08-29
21 commits to main branch, last one 29 days ago
ddlBoJack
emotion2vec ddlBoJack
47
650
unknown
15
[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
iemocap speech-representation pytorch-implementation speech-emotion-recognition
Created 2023-11-25
43 commits to main branch, last one 5 days ago
jishengpeng
WavChat jishengpeng
3
87
unknown
5
A Survey of Spoken Dialogue Models (60 pages)
moshi duplex gpt-4o speech encodec mini-omni streaming llama-omni intreaction wavtokenizer modal-alignment speech-language-model speech-representation spoken-dialogue-models
Created 2024-11-11
18 commits to main branch, last one 7 days ago
mechanicalsea
lighthubert mechanicalsea
6
69
mit
4
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
pytorch lighthubert speech-representation self-supervised-learning neural-architecture-search
Created 2022-03-24
15 commits to main branch, last one 2 years ago
andi611
Mockingjay-Speech-Representation andi611
12
52
mit
5
Official Implementation of Mockingjay in Pytorch
apc speech pytorch mockingjay feature-extraction phoneme-prediction speaker-recognition phone-classification speech-representation pytorch-implementation speaker-classification representation-learning sentiment-classification
Created 2020-06-08
7 commits to master branch, last one 3 years ago
vectominist
MiniASR vectominist
6
47
mit
3
A mini, simple, and fast end-to-end automatic speech recognition toolkit.
asr ctc s3prl hubert fairseq minimal pytorch wav2vec2 speech-recognition speech-representation
Created 2021-07-14
27 commits to main branch, last one about a year ago