Search Results - RepositoryStats

unilm microsoft

2.5k

19.6k

mit

301

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Created 2019-07-23

1,190 commits to master branch, last one about a month ago

MobileAgent X-PLUG

256

2.8k

mit

47

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

app gui ios mllm agent gpt4v mobile android copilot harmony automation multimodal mobile-agents multimodal-agent multimodal-large-language-models

Created 2024-01-26

139 commits to main branch, last one 2 days ago

InternLM-XComposer InternLM

153

2.5k

apache-2.0

41

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

394 commits to main branch, last one 29 days ago

cambrian cambrian-mllm

112

1.7k

apache-2.0

22

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

clip dino llms mllm chatbot computer-vision instruction-tuning large-language-models representation-learning multimodal-large-language-models

Created 2024-06-17

55 commits to main branch, last one 9 days ago

Awesome-LLM-Reasoning atfortes

92

1.6k

mit

36

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓

cot gpt mllm gpt-4o papers prompt awesome chatgpt openai-o1 reasoning multimodal strawberry language-models chain-of-thought prompt-engineering in-context-learning

Created 2022-11-05

163 commits to main branch, last one 16 hours ago

mPLUG-DocOwl X-PLUG

84

1.3k

apache-2.0

29

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

mllm multimodal chart-understanding table-understanding document-understanding multimodal-large-language-models

Created 2023-07-04

134 commits to main branch, last one 9 hours ago

Bunny BAAI-DCAI

66

889

apache-2.0

19

A family of lightweight multimodal models.

vlm mllm gpt-4 chatgpt chinese english multimodal-large-language-models

Created 2024-01-31

112 commits to main branch, last one 24 days ago

Osprey CircleRadon

43

752

apache-2.0

14

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

sam mllm pixel-understanding visual-instruction-tuning

Created 2023-12-17

29 commits to main branch, last one about a month ago

Woodpecker BradyFU

29

600

unknown

15

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.

llm mllm hallucination multimodality hallucinations large-language-models multimodal-large-language-models

Created 2023-09-26

106 commits to main branch, last one 3 months ago

Groma FoundationVision

57

543

apache-2.0

35

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 3 months ago

EAGLE NVlabs

43

503

apache-2.0

31

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

llm lmm demo gpt4 lvlm mllm eagle llama llava nvdia llama3 huggingface large-language-models

Created 2024-06-27

81 commits to main branch, last one 9 days ago

LLMGA dvlab-research

29

451

apache-2.0

13

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral

llm aigc mllm multi-modal image-editing image-generation large-language-model image-design-assistant

Created 2023-11-27

2 commits to master branch, last one about a month ago

ComfyUI_VLM_nodes gokayfem

32

374

apache-2.0

7

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning

Created 2024-01-24

236 commits to main branch, last one 4 days ago

MPP-LLaVA Coobiw

20

358

unknown

4

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train...

mllm qwen deepspeed fine-tuning pretraining model-parallel pipeline-parallelism video-language-model video-large-language-models multimodal-large-language-models

Created 2023-10-24

133 commits to master branch, last one 4 days ago

Youku-mPLUG X-PLUG

11

281

apache-2.0

5

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

mllm video youku chinese dataset benchmark multimodal video-retrieval multimodal-pretraining video-question-answering multimodal-large-language-models

Created 2023-06-06

18 commits to main branch, last one 8 months ago

Awesome_Multimodel_LLM Atomic-man007

16

252

unknown

8

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context l...

gpt llm nlp mllm chatgpt dataset multimodel pretrained-models

Created 2023-06-11

35 commits to main branch, last one about a month ago

mPLUG-2 X-PLUG

17

216

apache-2.0

6

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

vqa mllm mplug video multimodal image-retrieval video-retrieval foundation-models multimodal-pretraining video-question-answering

Created 2023-05-22

4 commits to main branch, last one about a year ago

EVE baaivision

3

209

mit

8

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

llm vlm clip mllm encoder-free-vlm instruction-following large-language-models vision-language-models multimodal-large-language-models

Created 2024-06-14

17 commits to main branch, last one 2 months ago

Mantis TIGER-AI-Lab

14

162

apache-2.0

8

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

lmm vlm fuyu mllm video mantis vision language multimodal llava-llama3 multi-image-understanding

Created 2024-04-12

202 commits to main branch, last one 19 days ago

TokenPacker CircleRadon

7

159

unknown

8

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

lmm mllm connector tokenpacker token-reduction visual-projector

Created 2024-07-03

16 commits to main branch, last one 12 days ago

AUITestAgent bz-lab

9

139

unknown

2

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.