14 results found Sort:

roboflow
multimodal-maestro roboflow
71
989
mit
14
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
lmm gpt-4 llava cross-modal gpt-4-vision multimodality object-detection segment-anything visual-prompting prompt-engineering instance-segmentation vision-language-model
Created 2023-11-24
71 commits to develop branch, last one 5 months ago
mbzuai-oryx
groundingLMM mbzuai-oryx
30
646
unknown
29
[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
lmm llm-agent foundation-models vision-and-language vision-language-model
Created 2023-11-02
42 commits to main branch, last one 27 days ago
BAAI-Agents
Cradle BAAI-Agents
58
608
mit
11
The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...
ai gcc llm lmm vlm cradle ai-agent grounding personoid generative-ai multimodality computer-control foundation-agent ai-agents-framework large-language-models vision-language-model general-computer-control
Created 2024-03-03
17 commits to main branch, last one 2 days ago
LLaVA-VL
LLaVA-Interactive-Demo LLaVA-VL
25
328
apache-2.0
15
LLaVA-Interactive-Demo
lmm multimodal
Created 2023-10-12
36 commits to main branch, last one 4 months ago
mbzuai-oryx
Video-LLaVA mbzuai-oryx
11
222
unknown
14
PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
llm lmm video grounding transcription video-grounding video-conversation
Created 2023-11-20
8 commits to main branch, last one 5 months ago
tianyi-lab
HallusionBench tianyi-lab
3
200
bsd-3-clause
4
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
llm lmm vlms gpt-4 llava gpt-4v benchmark benchmarks hallucination large-language-models large-vision-language-models
Created 2023-10-22
132 commits to main branch, last one 3 months ago
xieyuquanxx
awesome-Large-MultiModal-Hallucination xieyuquanxx
11
129
unknown
5
😎 up-to-date & curated list of awesome LMM hallucinations papers, methods & resources.
lmm multimodal multi-modal hallucination
Created 2023-10-11
57 commits to main branch, last one 3 months ago
Q-Future
A-Bench Q-Future
2
113
unknown
8
[LMM + AIGC] What do we expect from LMMs as AIGI evaluators and how do they perform?
lmm evaluation ai-generated-images
Created 2024-05-29
44 commits to main branch, last one 8 days ago
TIGER-AI-Lab
Mantis TIGER-AI-Lab
8
109
apache-2.0
8
Official code for Paper "Mantis: Multi-Image Instruction Tuning"
lmm vlm fuyu mllm video mantis vision language multimodal llava-llama3 multi-image-understanding
Created 2024-04-12
164 commits to main branch, last one a day ago
MLLM-Tool
MLLM-Tool MLLM-Tool
3
86
mit
2
MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning
llm lmm gpt4 tool-agent
Created 2024-01-08
59 commits to main branch, last one about a month ago
graphic-design-ai
graphist graphic-design-ai
1
77
unknown
9
Official Repo of Graphist
hlg llm lmm mllm graphic-design layout-generation
Created 2024-03-24
3 commits to main branch, last one 2 months ago
TideDra
VL-RLHF TideDra
1
57
apache-2.0
3
A RLHF Infrastructure for Vision-Language Models
dpo llm lmm vlm mllm rlhf
Created 2023-12-27
5 commits to main branch, last one 17 days ago
mapluisch
LLaVA-CLI-with-multiple-images mapluisch
4
34
mit
3
LLaVA inference with multiple images at once for cross-image analysis.
lmm vqa lmms llava llama2 pillow python python3 pytorch inference llama2-13b image-processing image-concatenation visual-question-answering
Created 2023-11-30
18 commits to main branch, last one 3 months ago
WisconsinAIVision
YoLLaVA WisconsinAIVision
0
25
unknown
0
🌋👵🏻 Yo'LLaVA: Your Personalized Language and Vision Assistant
llm lmm llms lmms llava personalized personalization multi-modal-models
Created 2024-06-13
2 commits to main branch, last one 15 days ago