Search Results - RepositoryStats

unilm microsoft

2.6k

20.2k

mit

308

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Created 2019-07-23

1,216 commits to master branch, last one 12 days ago

MobileAgent X-PLUG

279

3.0k

mit

49

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

app gui ios mllm agent gpt4v mobile android copilot harmony automation multimodal mobile-agents multimodal-agent multimodal-large-language-models

Created 2024-01-26

139 commits to main branch, last one about a month ago

InternLM-XComposer InternLM

154

2.5k

apache-2.0

43

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

395 commits to main branch, last one about a month ago

Awesome-LLM-Reasoning atfortes

111

1.9k

mit

38

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓

cot gpt mllm gpt-4o papers prompt awesome chatgpt openai-o1 reasoning multimodal strawberry language-models chain-of-thought prompt-engineering in-context-learning

Created 2022-11-05

167 commits to main branch, last one 4 days ago

cambrian cambrian-mllm

115

1.8k

apache-2.0

21

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

clip dino llms mllm chatbot computer-vision instruction-tuning large-language-models representation-learning multimodal-large-language-models

Created 2024-06-17

59 commits to main branch, last one 21 days ago

mPLUG-DocOwl X-PLUG

101

1.6k

apache-2.0

31

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

mllm multimodal chart-understanding table-understanding document-understanding multimodal-large-language-models

Created 2023-07-04

134 commits to main branch, last one about a month ago

MagicQuill magic-quill

85

1.2k

other

12

Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

aigc mllm image-editing

Created 2024-11-12

15 commits to main branch, last one 18 hours ago

Bunny BAAI-DCAI

69

933

apache-2.0

18

A family of lightweight multimodal models.

vlm mllm gpt-4 chatgpt chinese english multimodal-large-language-models

Created 2024-01-31

114 commits to main branch, last one 2 days ago

Osprey CircleRadon

43

772

apache-2.0

14

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

sam mllm pixel-understanding visual-instruction-tuning

Created 2023-12-17

29 commits to main branch, last one 3 months ago

Woodpecker BradyFU

29

611

unknown

15

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.

llm mllm hallucination multimodality hallucinations large-language-models multimodal-large-language-models

Created 2023-09-26

106 commits to main branch, last one 5 months ago

Agent-S simular-ai

83

607

apache-2.0

21

Agent S: an open agentic framework that uses computers like a human

mllm memory planning ai-agents gui-agents computer-automation agent-computer-interface retrieval-augmented-generation in-context-reinforcement-learning experience-augmented-hierarchical-planning

Created 2024-10-09

37 commits to main branch, last one 16 days ago

Groma FoundationVision

61

563

apache-2.0

35

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 5 months ago

EAGLE NVlabs

45

539

apache-2.0

32

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

llm lmm demo gpt4 lvlm mllm eagle llama llava nvdia llama3 huggingface large-language-models

Created 2024-06-27

81 commits to main branch, last one 2 months ago

LLMGA dvlab-research

29

462

apache-2.0

13

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral

llm aigc mllm multi-modal image-editing image-generation large-language-model image-design-assistant

Created 2023-11-27

2 commits to master branch, last one 3 months ago

ComfyUI_VLM_nodes gokayfem

36

414

apache-2.0

7

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning

Created 2024-01-24

271 commits to main branch, last one 15 days ago

Vitron SkyworkAI

24

386

unknown

14

NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing

mllm segmentation multimodal-large-language-models

Created 2024-03-18

78 commits to main branch, last one about a month ago

MPP-LLaVA Coobiw

20

381

unknown

4

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train...

mllm qwen deepspeed fine-tuning pretraining model-parallel pipeline-parallelism video-language-model video-large-language-models multimodal-large-language-models

Created 2023-10-24

133 commits to master branch, last one about a month ago

Awesome-LLMs-meet-Multimodal-Generation YingqingHe

20

362

unknown

14

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

llm aigc lvlm mllm text-to-3d multimodality text-to-audio text-to-image text-to-music text-to-sound text-to-video text-to-speech multimodal-models large-language-models multimodal-generation large-vision-language-models multimodal-large-language-models

Created 2023-11-17

346 commits to main branch, last one 6 days ago

Youku-mPLUG X-PLUG

11

284

apache-2.0

5

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

mllm video youku chinese dataset benchmark multimodal video-retrieval multimodal-pretraining video-question-answering multimodal-large-language-models

Created 2023-06-06

18 commits to main branch, last one 10 months ago

Awesome_Multimodel_LLM Atomic-man007

18

269

unknown

8

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context l...

gpt llm nlp mllm chatgpt dataset multimodel pretrained-models

Created 2023-06-11

35 commits to main branch, last one 3 months ago

EVE baaivision

3

231

mit

8

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

llm vlm clip mllm encoder-free-vlm instruction-following large-language-models vision-language-models multimodal-large-language-models

Created 2024-06-14

19 commits to main branch, last one about a month ago

mPLUG-2 X-PLUG

18

220

apache-2.0

5

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

vqa mllm mplug video multimodal image-retrieval video-retrieval foundation-models multimodal-pretraining video-question-answering

Created 2023-05-22

4 commits to main branch, last one about a year ago

TokenPacker CircleRadon

9

214

unknown

8

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

lmm mllm connector tokenpacker token-reduction visual-projector

Created 2024-07-03

18 commits to main branch, last one about a month ago

Mantis TIGER-AI-Lab

15

184

apache-2.0

9

Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)

lmm vlm fuyu mllm video mantis vision language multimodal llava-llama3 multi-image-understanding

Created 2024-04-12

219 commits to main branch, last one a day ago

SeViLA Yui010206

22

178

bsd-3-clause

3

[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

mllm video-localization video-question-answering

Created 2023-05-10

36 commits to main branch, last one 10 months ago

AUITestAgent bz-lab

10

151

unknown

3

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.

gui llm mllm agent gpt-4o testing automation mobile-app multimodal multi-agent multimodal-agent

Created 2024-07-11

22 commits to main branch, last one 4 months ago

image-textualization sterzhang

8

144

unknown

4

Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)

mllm text-image dense-captioning

Created 2024-04-15

98 commits to main branch, last one 3 months ago

GenerateU FoundationVision

6

139

unknown

6

[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection

mllm open-world multimodality open-vocabulary object-detection open-vocabulary-detection

Created 2024-03-15

2 commits to main branch, last one 8 months ago

DenseFusion baaivision

1

119

unknown

4

DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception

vlm mllm visual-perception image-descriptions vision-language-models multimodal-large-language-models

Created 2024-07-05

8 commits to main branch, last one about a month ago

Emotion-LLaMA ZebangCheng

12

114

bsd-3-clause

5

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

mllm instruction-tuning affective-computing

Created 2024-05-22

86 commits to main branch, last one 2 days ago