23 results found Sort:

jina-ai
discoart jina-ai
246
3.8k
other
34
🪩 Create Disco Diffusion artworks in one line
dalle imgen prompts diffusion midjourney multimodal creative-ai cross-modal creative-art discodiffusion generative-art disco-diffusion latent-diffusion stable-diffusion clip-guided-diffusion
Created 2022-06-30
385 commits to main branch, last one about a year ago
docarray
docarray docarray
222
2.8k
apache-2.0
44
Represent, send, store and search multimodal data
qdrant fastapi pytorch docarray protobuf pydantic weaviate dataclass multimodal cross-modal multi-modal nested-data deep-learning elasticsearch neural-search data-structures semantic-search machine-learning nearest-neighbor-search
Created 2021-12-14
1,448 commits to main branch, last one about a month ago
shaoxiongji
knowledge-graphs shaoxiongji
288
1.6k
unknown
61
A collection of research on knowledge graphs
ner paper survey reasoning commonsense cross-modal knowledge-graph dialogue-systems question-answering relation-extraction information-retrieval recommendation-systems representation-learning meta-relational-learning temporal-knowledge-graph knowledge-graph-completion natural-language-processing
Created 2019-01-02
73 commits to master branch, last one about a year ago
roboflow
multimodal-maestro roboflow
68
966
mit
14
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
lmm gpt-4 llava cross-modal gpt-4-vision multimodality object-detection segment-anything visual-prompting prompt-engineering instance-segmentation vision-language-model
Created 2023-11-24
71 commits to develop branch, last one 4 months ago
krantiparida
awesome-audio-visual krantiparida
70
622
unknown
17
A curated list of different papers and datasets in various areas of audio-visual processing
awesome cross-modal mutli-modal audio-visual awesome-list localization source-separation
Created 2019-03-30
63 commits to master branch, last one 4 months ago
kuanghuei
SCAN kuanghuei
111
528
apache-2.0
10
PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)
pytorch cross-modal deep-learning neural-network computer-vision visual-semantic image-captioning
Created 2018-05-11
19 commits to master branch, last one about a year ago
towhee-io
examples towhee-io
104
390
apache-2.0
8
Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.
nlp embeddings cross-modal video-tagging machine-learning audio-classification image-classification
Created 2022-04-11
401 commits to main branch, last one 6 months ago
JizhiziLi
RIM JizhiziLi
12
199
unknown
23
[CVPR 2023] Referring Image Matting
matting multimodal cross-modal image-matting image-segmentation
Created 2022-06-12
6 commits to master branch, last one about a year ago
yisun98
SOLC yisun98
20
151
unknown
2
Remote Sensing Sar-Optical Land-use Classfication Pytorch Pytorch高分辨率遥感语义分割/地物分割/地物分类
pytorch oa-kappa deeplabv3 cross-modal multi-modal sar-optical multi-source segmentation remote-sensing land-use-classification
Created 2022-06-01
86 commits to main branch, last one 25 days ago
DRSY
MoTIS DRSY
10
116
unknown
4
[NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)
ai knn lsh clip naacl k-means ios-swift retrieval cross-modal image-search vector-search semantic-search random-projection k-means-clustering knowledge-distillation
Created 2021-08-07
132 commits to main branch, last one about a year ago
Zengyi-Qin
Weakly-Supervised-3D-Object-Detection Zengyi-Qin
17
101
mit
7
Weakly Supervised 3D Object Detection from Point Clouds (VS3D), ACM MM 2020
vs3d ws3d kitti lidar stereo monocular tensorflow acm-mm-2020 cross-modal point-cloud object-proposals transfer-learning 3d-object-detection unsupervised-learning weakly-supervised-detection unsupervised-object-detection
Created 2020-07-28
10 commits to master branch, last one 3 years ago
yangli18
VLTVG yangli18
5
86
unknown
2
Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning, CVPR 2022
cross-modal vision-language visual-grounding visual-linguistic
Created 2022-04-29
5 commits to master branch, last one about a year ago
qcraftai
distill-bev qcraftai
5
75
unknown
5
DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation (ICCV 2023)
bev lidar nuscenes cross-modal multi-modal point-cloud distillation multi-camera self-driving autonomous-driving 3d-object-detection knowledge-distillation
Created 2023-09-25
19 commits to main branch, last one 6 months ago
QizhiPei
BioT5 QizhiPei
3
74
mit
3
BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations (EMNLP 2023)
nlp cross-modal bioinformatics machine-learning nlp-applications computational-biology
Created 2023-10-11
42 commits to main branch, last one 4 days ago
haihuangcode
CMG haihuangcode
1
70
unknown
3
The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)
multimodal cross-modal pretrained-models cross-modal-generalization
Created 2023-10-24
20 commits to master branch, last one 23 days ago
kywen1119
DSRAN kywen1119
12
68
apache-2.0
4
Code for journal paper "Learning Dual Semantic Relations with Graph Attention for Image-Text Matching", TCSVT, 2020.
tcsvt pytorch cross-modal computer-vision image-text-matching
Created 2020-10-22
60 commits to main branch, last one 2 years ago
marslanm
Multimodality-Representation-Learning marslanm
6
61
unknown
7
This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl....
cross-modal multimodal-pretext transformer-models multimodal-datasets multimodal-applications multimodal-deep-learning vision-language-pretraining multimodal-pre-trained-model
Created 2022-03-13
66 commits to main branch, last one 7 months ago
GT-RIPL
Xmodal-Ctx GT-RIPL
10
60
unknown
2
Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning
clip cross-modal image-captioning vision-and-language
Created 2022-05-09
3 commits to main branch, last one about a year ago
Paranioar
UniPT Paranioar
0
52
apache-2.0
1
[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
cross-modal transfer-learning memory-efficient-tuning memory-efficient-learning parameter-efficient-tuning parameter-efficient-learning
Created 2023-08-28
13 commits to main branch, last one about a month ago
Eaphan
UPIDet Eaphan
7
51
apache-2.0
6
Unleash the Potential of Image Branch for Cross-modal 3D Object Detection [NeurIPS2023]
cross-modal multi-modal 3d-object-detection
Created 2023-01-20
12 commits to main branch, last one 4 months ago
zerovl
ZeroVL zerovl
5
41
mit
3
[ECCV2022] Contrastive Vision-Language Pre-training with Limited Resources
clip cross-modal deep-learning vision-and-language
Created 2022-01-18
10 commits to main branch, last one about a year ago
zjukg
DUET zjukg
8
41
mit
4
[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning
pytorch semantic grounding cross-modal transformer visual-grounding knowledge-transfer zero-shot-learning pretrained-language-model
Created 2022-11-27
48 commits to main branch, last one 3 months ago
mako443
Text2Pos-CVPR2022 mako443
7
37
unknown
3
Code, dataset and models for our CVPR 2022 publication "Text2Pos"
nlp cvpr pytorch cvpr2022 cross-modal localization deep-learning computer-vision language-processing cross-modal-learning cross-modal-retrieval
Created 2021-02-09
202 commits to master branch, last one about a year ago