Search Results - RepositoryStats

63

964

apache-2.0

14

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

multimodal audio-language vision-language contrastive-loss foundation-models vision-transformer vision-and-language representation-learning

Created 2023-05-18

136 commits to main branch, last one about a month ago

VAST TXH-mercury

16

238

mit

18

Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset

dataset audio-language vision-language cross-modality-pretraining vision-audio-subtitle-text multimodal-foundation-model

Created 2023-05-29

13 commits to master branch, last one 7 months ago

AudioLLM AudioLLMs

7

121

unknown

6

Audio Large Language Models

audio-language audio-processing audio-understanding

Created 2024-06-15

51 commits to main branch, last one 13 days ago

GAMA Sreyan88

7

77

apache-2.0

7

Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities

audio dataset reasoning audio-language question-answering large-language-model multimodal-large-language-models

Created 2024-06-15

24 commits to main branch, last one 3 months ago