Search Results - RepositoryStats

974

9.9k

bsd-3-clause

98

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer

Created 2022-08-24

492 commits to main branch, last one 2 days ago

awesome-generative-ai-guide aishwaryanr

2.0k

9.3k

mit

320

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

llms awesome awesome-list generative-ai notebook-jupyter interview-questions vision-and-language large-language-models

Created 2024-02-06

242 commits to main branch, last one 15 days ago

ALBEF salesforce

199

1.6k

bsd-3-clause

13

Code for ALBEF: a new vision-language pre-training method

image-text vision-and-language contrastive-learning representation-learning weakly-supervised-learning

Created 2021-07-13

39 commits to main branch, last one 2 years ago

OmDet om-ai-lab

143

1.5k

apache-2.0

98

Real-time and accurate open-vocabulary end-to-end object detection

open-vocabulary object-detection vision-and-language zero-shot-object-detection

Created 2024-03-11

31 commits to main branch, last one 2 months ago

Multimodal-GPT open-mmlab

126

1.5k

apache-2.0

13

Multimodal-GPT

gpt gpt-4 llama flamingo multimodal transformer vision-and-language

Created 2023-04-26

24 commits to main branch, last one about a year ago

ViLT dandelin

208

1.4k

apache-2.0

15

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

vision-and-language

Created 2021-03-25

19 commits to master branch, last one 2 years ago

maestro roboflow

102

1.4k

apache-2.0

20

streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL

vqa paligemma captioning florence-2 multimodal fine-tuning phi-3-vision transformers objectdetection vision-and-language

Created 2023-11-24

255 commits to develop branch, last one 16 days ago

prismer NVlabs

75

1.3k

other

16

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa language-model image-captioning multi-task-learning vision-and-language multi-modal-learning vision-language-model

Created 2023-03-02

36 commits to main branch, last one 10 months ago

OmAgent om-ai-lab

101

1.3k

apache-2.0

61

A Multimodal Native Agent Framework for Smart Hardware and More

agent gpt-4o workflow framework smart-hardware multimodal-agent vision-and-language large-language-models

Created 2024-07-04

202 commits to main branch, last one a day ago

awesome-vision-language-pretraining-papers yuewang-cuhk

101

1.1k

unknown

53

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

bert vl-ptms pretraining vision-and-language multimodal-deep-learning

Created 2020-03-25

38 commits to master branch, last one 2 years ago

Oscar microsoft

252

1.0k

mit

25

Oscar and VinVL

vqa oscar vinvl pre-training image-captioning image-text-search vision-and-language

This repository has been archived (exclude archived)

Created 2020-05-14

28 commits to master branch, last one about a year ago

xmodaler YehLi

111

1.0k

other

35

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

tden pretraining image-captioning video-captioning vision-and-language cross-modal-retrieval visual-question-answering

Created 2021-06-25

84 commits to master branch, last one about a year ago

awesome-japanese-llm llm-jp

31

1.0k

apache-2.0

22

日本語LLMまとめ - Overview of Japanese LLMs

llm llms japanese multimodal japanese-llm llm-japanese generative-ai language-model language-models vision-language generative-model foundation-models generative-models japanese-language vision-and-language large-language-model large-language-models vision-language-model japanese-language-model

Created 2023-07-09

474 commits to main branch, last one 4 days ago

ONE-PEACE OFA-Sys

63

973

apache-2.0

14

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

multimodal audio-language vision-language contrastive-loss foundation-models vision-transformer vision-and-language representation-learning

Created 2023-05-18

136 commits to main branch, last one about a month ago

DL-NLP-Readings 26hzhang

268

850

mit

80

My Reading Lists of Deep Learning and Natural Language Processing

paper robotics commonsense deep-learning language-model machine-learning source-code-link bibtex-references vision-and-language reinforcement-learning natural-language-processing

Created 2018-02-02

18 commits to master branch, last one 2 years ago

Aria rhymes-ai

70

840

apache-2.0

18

Codebase for Aria - an Open Multimodal Native MoE

multimodal mixture-of-experts vision-and-language

Created 2024-09-29

185 commits to main branch, last one a day ago

UNITER ChenRocks

109

784

unknown

18

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

pytorch pre-training transformers vision-and-language

Created 2020-01-28

70 commits to master branch, last one 3 years ago

groundingLMM mbzuai-oryx

38

782

unknown

31

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

lmm llm-agent foundation-models vision-and-language vision-language-model

Created 2023-11-02

42 commits to main branch, last one 5 months ago

VL-BERT jackroos

110

738

mit

14

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

bert pytorch vl-bert iclr2020 pre-training vision-and-language representation-learning self-supervised-learning

Created 2019-11-22

25 commits to master branch, last one 4 years ago

AlphaCLIP SunzeY

43

705

apache-2.0

13

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

deep-learning vision-language machine-learning vision-transformer vision-and-language vision-language-model

Created 2023-11-27

97 commits to main branch, last one 3 months ago

ClipBERT jayleicn

86

705

mit

9

[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.

vqa pytorch cvpr2021 video-retrieval vision-and-language video-question-answering

Created 2021-02-10

14 commits to main branch, last one 2 years ago

top-cvpr-2024-papers SkalskiP

60

663

cc0-1.0

14

This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]

cvpr paper cvpr2024 transformers computer-vision object-detection image-segmentation vision-and-language

Created 2024-04-10

56 commits to master branch, last one 5 months ago

PointLLM OpenRobotLab

32

651

unknown

14

[ECCV 2024 Best Paper Candidate] PointLLM: Empowering Large Language Models to Understand Point Clouds

3d gpt-4 llama chatbot pointllm objaverse multimodal point-cloud foundation-models vision-and-language large-language-models representation-learning

Created 2023-08-17

51 commits to master branch, last one 22 days ago

top-cvpr-2023-papers SkalskiP

66

640

cc0-1.0

14

This repository is a curated collection of the most exciting and influential CVPR 2023 papers. 🔥 [Paper + Code]

cvpr paper cvpr2023 transformers computer-vision object-detection image-segmentation vision-and-language

Created 2023-06-15

30 commits to master branch, last one 4 months ago

DoRA NVlabs

42

633

other

9

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

lora deep-learning instruction-tuning vision-and-language deep-neural-networks commonsense-reasoning large-language-models parameter-efficient-tuning large-vision-language-models parameter-efficient-fine-tuning

Created 2024-04-11

45 commits to main branch, last one about a month ago

Proctoring-AI vardanagarwal

335

553

mit

29

Creating a software for automatic monitoring in online proctoring

ssd dlib nltk opencv tflite yolov3 mobilenet automation proctoring eye-tracking face-spoofing hacktoberfest proctoring-ai face-detection speech-to-text phone-detection vision-and-language

Created 2020-05-04

85 commits to master branch, last one 2 months ago