Search Results - RepositoryStats

890

9.0k

bsd-3-clause

95

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer

Created 2022-08-24

490 commits to main branch, last one 5 months ago

awesome-generative-ai-guide aishwaryanr

1.1k

5.2k

mit

157

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

llms awesome awesome-list generative-ai notebook-jupyter interview-questions vision-and-language large-language-models

Created 2024-02-06

132 commits to main branch, last one 16 days ago

Multimodal-GPT open-mmlab

113

1.4k

apache-2.0

12

Multimodal-GPT

gpt gpt-4 llama flamingo multimodal transformer vision-and-language

Created 2023-04-26

24 commits to main branch, last one 12 months ago

ALBEF salesforce

190

1.4k

bsd-3-clause

11

Code for ALBEF: a new vision-language pre-training method

image-text vision-and-language contrastive-learning representation-learning weakly-supervised-learning

Created 2021-07-13

39 commits to main branch, last one about a year ago

ViLT dandelin

205

1.3k

apache-2.0

14

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

vision-and-language

Created 2021-03-25

19 commits to master branch, last one 2 years ago

prismer NVlabs

74

1.3k

other

15

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa language-model image-captioning multi-task-learning vision-and-language multi-modal-learning vision-language-model

Created 2023-03-02

36 commits to main branch, last one 4 months ago

awesome-vision-language-pretraining-papers yuewang-cuhk

101

1.1k

unknown

51

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

bert vl-ptms pretraining vision-and-language multimodal-deep-learning

Created 2020-03-25

38 commits to master branch, last one 2 years ago

Oscar microsoft

247

1.0k

mit

25

Oscar and VinVL

vqa oscar vinvl pre-training image-captioning image-text-search vision-and-language

Created 2020-05-14

28 commits to master branch, last one 9 months ago

xmodaler YehLi

112

1.0k

other

35

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

tden pretraining image-captioning video-captioning vision-and-language cross-modal-retrieval visual-question-answering

Created 2021-06-25

84 commits to master branch, last one about a year ago

ONE-PEACE OFA-Sys

52

858

apache-2.0

12

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

multimodal audio-language vision-language contrastive-loss foundation-models vision-transformer vision-and-language representation-learning

Created 2023-05-18

134 commits to main branch, last one 6 months ago

DL-NLP-Readings 26hzhang

269

848

mit

79

My Reading Lists of Deep Learning and Natural Language Processing

paper robotics commonsense deep-learning language-model machine-learning source-code-link bibtex-references vision-and-language reinforcement-learning natural-language-processing

Created 2018-02-02

18 commits to master branch, last one 2 years ago

awesome-japanese-llm llm-jp

21

800

apache-2.0

19

日本語LLMまとめ - Overview of Japanese LLMs

llm llms japanese multimodal japanese-llm llm-japanese generative-ai language-model language-models vision-language generative-model foundation-models generative-models japanese-language vision-and-language large-language-model large-language-models vision-language-model japanese-language-model

Created 2023-07-09

359 commits to main branch, last one 7 days ago

UNITER ChenRocks

109

768

unknown

18

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

pytorch pre-training transformers vision-and-language

Created 2020-01-28

70 commits to master branch, last one 2 years ago

VL-BERT jackroos

110

735

mit

14

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

bert pytorch vl-bert iclr2020 pre-training vision-and-language representation-learning self-supervised-learning

Created 2019-11-22

25 commits to master branch, last one 3 years ago

ClipBERT jayleicn

85

690

mit

9

[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.

vqa pytorch cvpr2021 video-retrieval vision-and-language video-question-answering

Created 2021-02-10

14 commits to main branch, last one about a year ago

groundingLMM mbzuai-oryx

28

602

unknown

30

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

lmm llm-agent foundation-models vision-and-language vision-language-model

Created 2023-11-02

40 commits to main branch, last one about a month ago

Proctoring-AI vardanagarwal

322

526

mit

28

Creating a software for automatic monitoring in online proctoring

ssd dlib nltk opencv tflite yolov3 mobilenet automation proctoring eye-tracking face-spoofing hacktoberfest proctoring-ai face-detection speech-to-text phone-detection vision-and-language

Created 2020-05-04

82 commits to master branch, last one about a year ago

AlphaCLIP SunzeY

28

525

apache-2.0

10

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

deep-learning vision-language machine-learning vision-transformer vision-and-language vision-language-model

Created 2023-11-27

88 commits to main branch, last one 2 months ago

Matterport3DSimulator peteanderson80

128

458

other

20

AI Research Platform for Reinforcement Learning from Real Panoramic Images.

rl simulator vision-and-language matterport3d-dataset matterport3d-simulator reinforcement-learning natural-language-processing

Created 2017-09-29

210 commits to master branch, last one 2 years ago

X-VLM zengyan-97

53

435

bsd-3-clause

5

X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)

x-vlm multimodality vision-and-language

Created 2021-11-15

31 commits to master branch, last one about a year ago

awesome-vision-and-language sangminwoo

33

401

unknown

11

A curated list of awesome vision and language resources (still under construction... stay tuned!)

awesome awesome-list multimodal-learning vision-and-language

Created 2019-10-25

42 commits to master branch, last one 9 months ago

PointLLM OpenRobotLab

18

400

unknown

10

[arXiv 2023] PointLLM: Empowering Large Language Models to Understand Point Clouds

3d gpt-4 llama chatbot pointllm objaverse multimodal point-cloud foundation-models vision-and-language large-language-models representation-learning

Created 2023-08-17

42 commits to master branch, last one 2 months ago

Awesome_Matching_Pretraining_Transfering Paranioar

47

357

mit

11

The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.