Search Results - RepositoryStats

471

6.1k

mit

53

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

gpt llm gpt-4o gpt-4v vit-6b vit-22b multi-modal image-classification image-text-retrieval video-classification semantic-segmentation vision-language-model

Created 2023-11-22

216 commits to main branch, last one a day ago

BLIP salesforce

642

4.8k

bsd-3-clause

34

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

vision-language image-captioning visual-reasoning image-text-retrieval visual-question-answering vision-language-transformer vision-and-language-pre-training

Created 2022-01-25

64 commits to main branch, last one 2 years ago

Chinese-CLIP OFA-Sys

471

4.6k

mit

35

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

nlp clip chinese pytorch multi-modal transformers coreml-models deep-learning computer-vision vision-language contrastive-loss pretrained-models image-text-retrieval multi-modal-learning vision-and-language-pre-training

Created 2022-07-08

382 commits to master branch, last one 3 months ago

Awesome_Matching_Pretraining_Transfering Paranioar

47

401

mit

11

The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning multimodal-large-language-models

Created 2020-12-22

129 commits to main branch, last one 4 months ago

PicQuery greyovo

30

257

mit

4

🔍 Search local images with natural language on Android, powered by OpenAI's CLIP model. / 在 Android 上用自然语言搜索本地图片 (基于 OpenAI 的 CLIP 模型)

clip openai android jetpack-compose image-text-search material-design-3 image-text-retrieval

Created 2023-08-10

110 commits to master branch, last one 28 days ago

tidy slavabarkov

16

234

gpl-3.0

7

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

nlp clip onnx kotlin android image-search quantization deep-learning computer-vision image-retrieval semantic-search image-text-matching image-text-retrieval cross-modal-retrieval

Created 2023-02-24

43 commits to main branch, last one about a year ago

SGRAF Paranioar

36

214

unknown

5

[AAAI2021] The code of “Similarity Reasoning and Filtration for Image-Text Matching”

aaai text-matching image-retrieval similarity-metric image-text-matching image-text-retrieval cross-modal-retrieval

Created 2020-12-16

45 commits to main branch, last one 7 months ago

Text2Poster-ICASSP-22 chuhaojin

16

205

mit

4

Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"

aigc pytorch deep-learning layout-design image-retrieval banner-generator image-processing object-detection poster-generation geneative-creation image-text-retrieval banner-advertisements multimodal-generation artificial-neural-networks encoder-decoder-architecture

Created 2022-09-18

61 commits to master branch, last one 11 months ago

Ant-Multi-Modal-Framework alipay

5

123

cc-by-4.0

4

Research Code for Multimodal-Cognition Team in Ant Group

video-editing multimodal-llm multimodal-learning image-text-retrieval video-text-retrieval

Created 2023-08-21

142 commits to main branch, last one 4 months ago

BagFormer howard-hou

33

115

unknown

30

PyTorch code for BagFormer: Better Cross-Modal Retrieval via bag-wise interaction

vision-language image-text-retrieval cross-modal-retrieval

Created 2022-05-24

35 commits to main branch, last one about a year ago

UPop sdc17

5

99

bsd-3-clause

5

[ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.

pruning sparsity framework structured weight-pruning image-captioning visual-reasoning model-compression vision-transformer multimodal-learning image-text-retrieval text-image-retrieval efficient-deep-learning visual-question-answering vision-language-transformer

Created 2023-05-27

146 commits to main branch, last one about a year ago

mPLUG X-PLUG

6

83

unknown

2

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)

vqa pytorch image-text multimodal pretraining transformer visual-language image-captioning image-text-retrieval

Created 2023-05-08

4 commits to main branch, last one about a year ago

rosita MILVLG

13

56

apache-2.0

0

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

vqa pre-training vision-and-language image-text-retrieval referring-expression-comprehension

Created 2021-08-02

59 commits to main branch, last one about a year ago

Chinese-CLIP-opencv-onnxrun hpc203

13

53

unknown

3

使用OpenCV+onnxruntime部署中文clip做以文搜图，给出一句话来描述想要的图片，就能从图库中搜出来符合要求的图片。包含C++和Python两个版本的程序

clip opencv-dnn image-text-retrieval multimodal-large-language-models

Created 2023-12-24

17 commits to main branch, last one 10 months ago

image-captioning cobanov

10

41

unknown

2

Image captioning using python and BLIP

blip img2text vision-language image-captioning visual-reasoning image-text-retrieval

Created 2023-01-13

32 commits to master branch, last one about a year ago

ComCLIP eric-ai-lab

3

33

mit

3

Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"

svo clip slip blip2 causality flickr30k winoground compositionality flickr8k-dataset image-text-matching vision-and-language image-text-retrieval

Created 2023-11-10

13 commits to main branch, last one 7 months ago

CPL eric-ai-lab

5

32

mit

3

Official implementation of our EMNLP 2022 paper "CPL: Counterfactual Prompt Learning for Vision and Language Models"

vqa prompt-tuning causal-inference vision-and-language image-classification image-text-retrieval counterfactual-reasoning

Created 2022-10-26

16 commits to master branch, last one about a year ago

RCAR Paranioar

3

29

apache-2.0

1

[TIP2023] The code of “Plug-and-Play Regulators for Image-Text Matching”

tip regulator text-matching image-retrieval image-text-matching image-text-retrieval cross-modal-retrieval

Created 2023-03-23

15 commits to main branch, last one 7 months ago

CrossGET sdc17

0

26

unknown

6

[ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.

framework transformer token-ensemble token-matching image-captioning visual-reasoning model-acceleration multimodal-learning image-text-retrieval text-image-retrieval efficient-deep-learning visual-question-answering vision-language-transformer

Created 2023-05-27

11 commits to main branch, last one about a year ago