Search Results - RepositoryStats

2.1k

12.2k

other

221

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

bert onnx openai pytorch image2vec clip-model sentence2vec deep-learning neural-search cross-modality multi-modality bert-as-service clip-as-service sentence-encoding cross-modal-retrieval

Created 2018-11-12

1,960 commits to main branch, last one 5 months ago

xmodaler YehLi

112

1.0k

other

35

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

tden pretraining image-captioning video-captioning vision-and-language cross-modal-retrieval visual-question-answering

Created 2021-06-25

84 commits to master branch, last one about a year ago

Awesome_Matching_Pretraining_Transfering Paranioar

47

357

mit

11

The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning

Created 2020-12-22

128 commits to main branch, last one 2 months ago

Image-Text-Embedding layumi

73

281

mit

12

TOMM2020 Dual-Path Convolutional Image-Text Embedding :feet: https://arxiv.org/abs/1711.05535

matlab matconvnet image-search cross-modality image-retrieval visual-semantic language-retrieval cross-modal-retrieval bidirectional-retrieval person-reidentification

Created 2017-11-17

146 commits to master branch, last one 11 months ago

KG-MM-Survey zjukg

13

213

mit

5

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

awsome survey surveys paper-list awsome-list entity-linking knowledge-graph entity-alignment image-generation multi-modal-fusion image-classification multi-modal-learning cross-modal-retrieval large-language-models information-extraction visual-question-answering knowledge-graph-embeddings multi-modal-knowledge-graph

Created 2024-01-29

77 commits to main branch, last one 15 days ago

SGRAF Paranioar

37

201

unknown

5

[AAAI2021] The code of “Similarity Reasoning and Filtration for Image-Text Matching”

aaai text-matching image-retrieval similarity-metric image-text-matching image-text-retrieval cross-modal-retrieval

Created 2020-12-16

45 commits to main branch, last one about a month ago

vse_infty woodfrog

18

150

mit

4

Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021

vse pytorch vision-language visual-semantic image-text-matching cross-modal-retrieval

Created 2021-01-10

72 commits to master branch, last one about a year ago

pvse yalesong

24

131

mit

4

Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval (CVPR 2019)

mrw-dataset tgif-dataset mscoco-dataset metric-learning cross-modal-retrieval

Created 2019-06-11

84 commits to master branch, last one 3 months ago

tidy slavabarkov

13

125

gpl-3.0

7

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

nlp clip onnx kotlin android image-search quantization deep-learning computer-vision image-retrieval semantic-search image-text-matching image-text-retrieval cross-modal-retrieval

Created 2023-02-24

43 commits to main branch, last one 7 months ago

pcme naver-ai

17

119

other

4

Official Pytorch implementation of "Probabilistic Cross-Modal Embedding" (CVPR 2021)

cvpr2021 cross-modal-retrieval probabilistic-embeddings probabilistic-machine-learning

Created 2021-06-15

8 commits to main branch, last one 3 months ago

BagFormer howard-hou

33

113

unknown

30

PyTorch code for BagFormer: Better Cross-Modal Retrieval via bag-wise interaction

vision-language image-text-retrieval cross-modal-retrieval

Created 2022-05-24

35 commits to main branch, last one about a year ago

EMCL jpthu17

8

104

mit

3

[NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations

neurips video-retrieval video-captioning cross-modal-retrieval video-question-answering

Created 2022-09-23

33 commits to main branch, last one about a month ago

DiffusionRet jpthu17

4

100

apache-2.0

3

[ICCV 2023] DiffusionRet: Generative Text-Video Retrieval with Diffusion Model

iccv2023 video-retrieval diffusion-models cross-modal-retrieval

Created 2023-03-16

20 commits to main branch, last one about a month ago

muscall ilaria-manco

8

99

gpl-3.0

6

Official implementation of "Contrastive Audio-Language Learning for Music" (ISMIR 2022)

music-ai cross-modal-retrieval music-information-retrieval

Created 2022-08-16

5 commits to main branch, last one about a year ago

HBI jpthu17

4

95

apache-2.0

4

[CVPR 2023 Highlight] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning

cvpr video-retrieval cross-modal-retrieval video-question-answering

Created 2023-02-28

33 commits to main branch, last one about a month ago

on-the-fly-FGSBIR AyanKumarBhunia

15

58

unknown

4

[CVPR 2020, Oral] "Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval”, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2020. .

cvpr sbir sketch fg-sbir cvpr2020 cvpr-oral continuous-rl image-retrieval policy-gradient re-identification cross-modal-retrieval reinforcement-learning pytorch-policy-gradient continuous-reinforcement-learning

Created 2019-12-16

33 commits to master branch, last one 3 years ago

eccv-caption naver-ai

2

51

other

2

Extended COCO Validation (ECCV) Caption dataset (ECCV 2022)

dataset eccv2022 evaluation vl-benchmark deep-learning machine-learning image-text-matching vision-and-language cross-modal-retrieval

Created 2022-03-30

4 commits to main branch, last one 3 months ago

MRL penghu-cs

10

48

mit

3

Learning Cross-Modal Retrieval with Noisy Labels (CVPR 2021, PyTorch Code)

noisy-labels cross-modal-retrieval multimodal-deep-learning

Created 2021-04-06

103 commits to main branch, last one 2 years ago

DiCoSA jpthu17

2

43

apache-2.0

2

[IJCAI 2023] Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment

ijcai video-retrieval cross-modal-retrieval

Created 2023-04-29

15 commits to main branch, last one about a month ago

pcmepp naver-ai

1

42

other

3

Official Pytorch implementation of "Improved Probabilistic Image-Text Representations" (ICLR 2024)

iclr2024 cross-modal-retrieval probabilistic-embeddings probabilistic-machine-learning

Created 2023-05-29

8 commits to main branch, last one 6 days ago

TextReID BrandonHanx

5

42

unknown

2

[BMVC 2021] Text-Based Person Search with Limited Data

clip transfer-learning cross-modal-retrieval person-reidentification

Created 2021-02-15

14 commits to main branch, last one about a year ago

Text2Pos-CVPR2022 mako443

7

37

unknown

3

Code, dataset and models for our CVPR 2022 publication "Text2Pos"

nlp cvpr pytorch cvpr2022 cross-modal localization deep-learning computer-vision language-processing cross-modal-learning cross-modal-retrieval

Created 2021-02-09

202 commits to master branch, last one about a year ago

UCCH penghu-cs

9

37

unknown

3

Unsupervised Contrastive Cross-modal Hashing (IEEE TPAMI 2023, PyTorch Code)

cross-modal-hashing contrastive-learning cross-modal-retrieval unsupervised-learning

Created 2022-05-20

55 commits to main branch, last one 5 months ago

RCAR Paranioar

2

25

apache-2.0

1

[TIP2023] The code of “Plug-and-Play Regulators for Image-Text Matching”

tip regulator text-matching image-retrieval image-text-matching image-text-retrieval cross-modal-retrieval

Created 2023-03-23

15 commits to main branch, last one about a month ago