Search Results - RepositoryStats

235

2.6k

bsd-3-clause

31

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

blip2 llama minigpt4 multi-modal-chatgpt large-language-models cross-modal-pretraining video-language-pretraining vision-language-pretraining

Created 2023-05-06

145 commits to main branch, last one 25 days ago

chat-with-nerf sled-group

16

273

apache-2.0

5

Chat with NeRF enables users to interact with a NeRF model by typing in natural language.

lerf nerf blip2 gpt-4 chatgpt nerfstudio

Created 2023-04-27

137 commits to main branch, last one 2 months ago

BLIVA mlpc-ucsd

22

240

bsd-3-clause

12

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

llm lora blip2 bliva llama chatbot multimodal instruction-tuning visual-language-learning

Created 2023-08-02

26 commits to main branch, last one 2 months ago

PaddleMIX PaddlePaddle

99

235

apache-2.0

21

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...

dit aigc clip sora blip2 llava sd-xl qwen-vl eva-clip minigpt4 controlnet multimodal ppdiffusers image-to-text text-to-image text-to-video stable-diffusion stablevideodiffusion

Created 2023-07-05

675 commits to develop branch, last one 15 days ago

fashion_image_caption SmithaUpadhyaya

6

40

unknown

3

Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features ...

blip2 image transformer huggingface-datasets image-caption-generator huggingface-transformers multimodal-deep-learning

Created 2023-05-23

16 commits to master branch, last one 10 months ago

ComCLIP eric-ai-lab

0

27

mit

3

Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"

svo clip slip blip2 causality flickr30k winoground compositionality flickr8k-dataset image-text-matching vision-and-language image-text-retrieval

Created 2023-11-10

13 commits to main branch, last one 2 months ago