Search Results - RepositoryStats

557

5.3k

apache-2.0

35

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

open-world vision-language object-detection open-world-detection vision-language-transformer

Created 2023-03-09

78 commits to main branch, last one 8 days ago

BLIP salesforce

576

4.4k

bsd-3-clause

34

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

vision-language image-captioning visual-reasoning image-text-retrieval visual-question-answering vision-language-transformer vision-and-language-pre-training

Created 2022-01-25

64 commits to main branch, last one about a year ago

marqo marqo-ai

178

4.2k

apache-2.0

35

Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai

Created 2022-08-01

1,121 commits to mainline branch, last one 4 days ago

Chinese-CLIP OFA-Sys

404

3.8k

mit

35

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

nlp clip chinese pytorch multi-modal transformers coreml-models deep-learning computer-vision vision-language contrastive-loss pretrained-models image-text-retrieval multi-modal-learning vision-and-language-pre-training

Created 2022-07-08

374 commits to master branch, last one 6 months ago

OFA OFA-Sys

247

2.3k

apache-2.0

21

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

prompt chinese multimodal pretraining prompt-tuning vision-language image-captioning pretrained-models text-to-image-synthesis visual-question-answering referring-expression-comprehension

Created 2022-01-29

712 commits to main branch, last one 9 months ago

AdvancedLiterateMachinery AlibabaResearch

133

1.1k

apache-2.0

26

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

Created 2022-09-28

54 commits to main branch, last one about a month ago

Video-ChatGPT mbzuai-oryx

88

996

cc-by-4.0

14

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for ...

clip gpt-4 llama llava vicuna chatbot mulit-modal video-chatboat vision-language video-conversation vision-language-pretraining

Created 2023-05-18

40 commits to main branch, last one 12 days ago

ONE-PEACE OFA-Sys

52

858

apache-2.0

12

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

multimodal audio-language vision-language contrastive-loss foundation-models vision-transformer vision-and-language representation-learning

Created 2023-05-18

134 commits to main branch, last one 6 months ago

pix2seq google-research

67

825

apache-2.0

18

Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)

pix2seq tensorflow2 deep-learning computer-vision vision-language object-detection

Created 2022-03-08

35 commits to main branch, last one about a year ago

awesome-japanese-llm llm-jp

21

800

apache-2.0

19

日本語LLMまとめ - Overview of Japanese LLMs

llm llms japanese multimodal japanese-llm llm-japanese generative-ai language-model language-models vision-language generative-model foundation-models generative-models japanese-language vision-and-language large-language-model large-language-models vision-language-model japanese-language-model

Created 2023-07-09

359 commits to main branch, last one 7 days ago

LLaVA-pp mbzuai-oryx

46

690

unknown

10

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

llm lmms phi3 llava llama3 llava-phi3 phi3-llava phi-3-llava phi3-vision conversation llama3-llava llava-llama3 phi-3-vision llama-3-llava llama3-vision llama-3-vision vision-language

Created 2024-04-26

11 commits to main branch, last one about a month ago

DriveLM OpenDriveLab

40

660

apache-2.0

20

DriveLM: Driving with Graph Visual Question Answering

llm prompting vision-language chain-of-thought tree-of-thoughts graph-of-thoughts autonomous-driving prompt-engineering large-language-models

Created 2023-08-08

395 commits to main branch, last one 18 days ago

daclip-uir Algolzw

28

561

mit

8

[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.

prompt pytorch deep-learning image-dehazing shadow-removal face-inpainting image-denoising image-deraining image-desnowing vision-language diffusion-models image-deblurring low-level-vision image-restoration jpeg-artifacts-removal low-light-image-enhancement

Created 2023-09-30

39 commits to main branch, last one about a month ago

AlphaCLIP SunzeY

28

525

apache-2.0

10

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

deep-learning vision-language machine-learning vision-transformer vision-and-language vision-language-model

Created 2023-11-27

88 commits to main branch, last one 2 months ago

SEED AILab-CVC

27

499

other

14

Official implementation of SEED-LLaMA (ICLR 2024).

multimodal vision-language foundation-model

Created 2023-07-15

77 commits to main branch, last one about a month ago

cliport cliport

80

425

apache-2.0

6

CLIPort: What and Where Pathways for Robotic Manipulation

clip vision pytorch robotics grounding manipulation deep-learning rearrangement computer-vision vision-language natural-language-processing

Created 2021-09-20

91 commits to master branch, last one about a year ago

Visual-Chinese-LLaMA-Alpaca airaria

36

381

apache-2.0

9

多模态中文LLaMA&Alpaca大语言模型（VisualCLA）

llm nlp lora llama alpaca chinese multimodal vision-language

Created 2023-06-16

16 commits to main branch, last one 10 months ago

TinyLLaVA_Factory TinyLLaVA

27

372

apache-2.0

11

A Framework of Small-scale Large Multimodal Models

nlp llama llava tinyllama transformers vision-language large-multimodal-models

Created 2024-02-21

168 commits to main branch, last one a day ago

Vision-Language-Transformer henghuiding

21

335

mit

4

[ICCV2021 & TPAMI2023] Vision-Language Transformer and Query Generation for Referring Segmentation

keras tpami iccv2021 tensorflow transformer vision-language referring-segmentation vision-language-transformer

Created 2021-07-23

7 commits to main branch, last one 2 years ago

calvin mees

44

280

mit

6

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2021-07-20

259 commits to main branch, last one 2 months ago

Kaleido-BERT mczhuge

19

264

mit

2

💐Kaleido-BERT: Vision-Language Pre-training on Fashion Domain

bert fashion e-commerce multimodal pre-training vision-language

Created 2021-03-05

153 commits to main branch, last one about a year ago

Open-GroundingDino longzw1997

41

261

mit

2

This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.

open-world vision-language object-detection open-world-detection

Created 2023-10-14

10 commits to main branch, last one 5 months ago

LViT HUANGLIZI

24

260

mit

4

[IEEE Transactions on Medical Imaging/TMI] This repo is the official implementation of "LViT: Language meets Vision Transformer in Medical Image Segmentation"

pytorch segmentation vision-language multimodal-learning medical-image-analysis

Created 2022-03-10

64 commits to main branch, last one 7 months ago