8 results found Sort:

salesforce
LAVIS salesforce
1.0k
10.4k
bsd-3-clause
96
LAVIS - A One-stop Library for Language-Vision Intelligence
salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer
Created 2022-08-24
492 commits to main branch, last one 4 months ago
IDEA-Research
GroundingDINO IDEA-Research
777
7.7k
apache-2.0
46
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
open-world vision-language object-detection open-world-detection vision-language-transformer
Created 2023-03-09
84 commits to main branch, last one 7 months ago
salesforce
BLIP salesforce
679
5.1k
bsd-3-clause
31
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
vision-language image-captioning visual-reasoning image-text-retrieval visual-question-answering vision-language-transformer vision-and-language-pre-training
Created 2022-01-25
64 commits to main branch, last one 2 years ago
AlibabaResearch
AdvancedLiterateMachinery AlibabaResearch
190
1.7k
apache-2.0
40
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
ocr document documentai multimodal end-to-end-ocr text-detection computer-vision vision-language text-recognition document-analysis document-recognition scene-text-detection document-intelligence vision-language-model document-understanding scene-text-recognition artificial-intelligence multimodal-deep-learning vision-language-transformer scene-text-detection-recognition
Created 2022-09-28
69 commits to main branch, last one 2 months ago
henghuiding
ReLA henghuiding
19
690
mit
5
[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation
cvpr2023 multimodal-learning vision-language-transformer referring-image-segmentation referring-expression-segmentation referring-expression-comprehension
Created 2023-03-11
14 commits to main branch, last one about a year ago
shenyunhang
APE shenyunhang
42
555
apache-2.0
9
[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception
open-world object-detection image-segmentation vision-language-transformer referring-expression-comprehension
Created 2023-08-25
57 commits to main branch, last one 10 months ago
henghuiding
Vision-Language-Transformer henghuiding
23
352
mit
4
[ICCV2021 & TPAMI2023] Vision-Language Transformer and Query Generation for Referring Segmentation
keras tpami iccv2021 tensorflow transformer vision-language referring-segmentation vision-language-transformer
Created 2021-07-23
7 commits to main branch, last one 3 years ago
haoliuhl
instructrl haoliuhl
5
52
mit
1
Instruction Following Agents with Multimodal Transforemrs
jax flax transformer instructions machine-learning instruction-following reinforcement-learning vision-language-transformer
Created 2022-10-23
5 commits to main branch, last one 2 years ago