Search Results - RepositoryStats

203

1.6k

mit

32

Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models

talking-head face-animation video-generation audio-visual-learning

Created 2023-12-28

17 commits to main branch, last one 11 months ago

AVSBench OpenNLPLab

43

449

apache-2.0

16

[ECCV 2022] & [IJCV 2024] Official implementation of the paper: Audio-Visual Segmentation (with Semantics)

audio-visual-learning segmentation-benchmark multi-modal-segmentation audio-visual-segmentation

Created 2022-07-08

29 commits to main branch, last one about a month ago

EDTalk tanshuai0219

34

364

apache-2.0

14

[ECCV 2024 Oral] EDTalk - Official PyTorch Implementation

talking-head face-animation video-generation audio-visual-learning talking-face-generation

Created 2024-04-02

163 commits to main branch, last one 2 months ago

AVE-ECCV18 YapengTian

32

175

unknown

6

Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018

eccv-2018 ave-dataset audio-visual-events audio-visual-learning

Created 2018-07-04

95 commits to master branch, last one 3 years ago

HA2G alvinliu0

9

133

gpl-3.0

4

[CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"

cvpr2022 co-speech-gesture audio-visual-learning

Created 2022-03-18

14 commits to main branch, last one about a year ago

co-separation rhgao

23

94

cc-by-4.0

4

Co-Separating Sounds of Visual Objects (ICCV 2019)

cross-modality sound-separation audio-visual-learning

Created 2019-10-11

16 commits to master branch, last one about a year ago

CCL yanbeic

11

85

apache-2.0

5

PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning

pytorch cvpr2021 distillation video-recognition audio-teacher-models contrastive-learning audio-visual-learning multi-modal-distillation compositional-contrastive-learning

Created 2021-03-29

9 commits to main branch, last one 3 years ago

UnAV ttgeng233

6

61

mit

3

Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)

audio-visual-events multi-modal-learning audio-visual-learning

Created 2023-04-05

13 commits to main branch, last one 10 months ago

av-superb roger-tseng

4

50

other

2

A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)

audio-visual-learning representation-learning

Created 2023-09-14

367 commits to main branch, last one 8 months ago

PSP_CVPR_2021 jasongief

12

40

unknown

3

[2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line

audio-visual-events audio-visual-learning

Created 2021-04-03

19 commits to master branch, last one 2 years ago

JointCrossAttentional-AV-Fusion praveena2j

10

36

unknown

2

ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition

emotion attention-model affective-computing emotion-recognition multimodal-learning audio-visual-learning

Created 2022-03-25

11 commits to main branch, last one 11 months ago

CVPR2023-CMPAE MengyuanChen21

3

34

mit

2

[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception

cvpr2023 audio-visual video-understanding audio-visual-learning audio-visual-video-parsing

Created 2023-03-06

9 commits to main branch, last one about a year ago

AVGN stoneMo

3

34

apache-2.0

1

Official implementation for AVGN

audio-visual-learning visual-sound-localization weakly-supervised-learning audio-visual-correspondence

Created 2023-03-23

4 commits to main branch, last one about a year ago

Joint-Cross-Attention-for-Audio-Visual-Fusion praveena2j

6

31

unknown

2

IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"

attention attention-model affective-computing emotion-recognition multimodal-learning audio-visual-learning

Created 2022-08-31

20 commits to master branch, last one 22 days ago

EZ-VSL stoneMo

8

30

apache-2.0

2

Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)

audio-visual-learning self-supervised-learning visual-sound-localization audio-visual-correspondence

Created 2022-03-14

41 commits to main branch, last one 2 years ago

DeepAVFusion stoneMo

2

25

apache-2.0

6

Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".

masked-autoencoder attention-mechanism multimodal-learning audio-visual-learning masked-image-modeling sound-source-separation self-supervised-learning transformer-architecture sound-source-localization audio-visual-correspondence

Created 2023-12-02

6 commits to main branch, last one 4 months ago