9 results found Sort:

salesforce
LAVIS salesforce
890
9.0k
bsd-3-clause
95
LAVIS - A One-stop Library for Language-Vision Intelligence
salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer
Created 2022-08-24
490 commits to main branch, last one 5 months ago
IDEA-Research
GroundingDINO IDEA-Research
557
5.3k
apache-2.0
35
Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
open-world vision-language object-detection open-world-detection vision-language-transformer
Created 2023-03-09
78 commits to main branch, last one 8 days ago
salesforce
BLIP salesforce
576
4.4k
bsd-3-clause
34
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
vision-language image-captioning visual-reasoning image-text-retrieval visual-question-answering vision-language-transformer vision-and-language-pre-training
Created 2022-01-25
64 commits to main branch, last one about a year ago
AlibabaResearch
AdvancedLiterateMachinery AlibabaResearch
133
1.1k
apache-2.0
26
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
ocr document documentai multimodal end-to-end-ocr text-detection computer-vision vision-language text-recognition document-analysis document-recognition scene-text-detection document-intelligence vision-language-model document-understanding scene-text-recognition artificial-intelligence multimodal-deep-learning vision-language-transformer scene-text-detection-recognition
Created 2022-09-28
54 commits to main branch, last one about a month ago
henghuiding
ReLA henghuiding
15
650
mit
5
[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation
cvpr2023 multimodal-learning vision-language-transformer referring-image-segmentation referring-expression-segmentation referring-expression-comprehension
Created 2023-03-11
14 commits to main branch, last one 9 months ago
shenyunhang
APE shenyunhang
28
444
apache-2.0
6
[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception
open-world object-detection image-segmentation vision-language-transformer referring-expression-comprehension
Created 2023-08-25
57 commits to main branch, last one 24 days ago
henghuiding
Vision-Language-Transformer henghuiding
21
335
mit
4
[ICCV2021 & TPAMI2023] Vision-Language Transformer and Query Generation for Referring Segmentation
keras tpami iccv2021 tensorflow transformer vision-language referring-segmentation vision-language-transformer
Created 2021-07-23
7 commits to main branch, last one 2 years ago
sdc17
UPop sdc17
7
86
bsd-3-clause
5
[ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
pruning sparsity framework structured weight-pruning image-captioning visual-reasoning model-compression vision-transformer multimodal-learning image-text-retrieval text-image-retrieval efficient-deep-learning visual-question-answering vision-language-transformer
Created 2023-05-27
146 commits to main branch, last one 6 months ago
lhao499
instructrl lhao499
4
48
mit
1
Instruction Following Agents with Multimodal Transforemrs
jax flax transformer instructions machine-learning instruction-following reinforcement-learning vision-language-transformer
Created 2022-10-23
5 commits to main branch, last one about a year ago