2 results found Sort:

OFA-Sys
ONE-PEACE OFA-Sys
52
877
apache-2.0
12
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
multimodal audio-language vision-language contrastive-loss foundation-models vision-transformer vision-and-language representation-learning
Created 2023-05-18
135 commits to main branch, last one 2 days ago
TXH-mercury
VAST TXH-mercury
12
212
mit
18
Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
dataset audio-language vision-language cross-modality-pretraining vision-audio-subtitle-text multimodal-foundation-model
Created 2023-05-29
13 commits to master branch, last one 3 months ago