Search Results - RepositoryStats

unilm microsoft

2.6k

20.4k

mit

307

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Created 2019-07-23

1,229 commits to master branch, last one 6 days ago

MobileAgent X-PLUG

300

3.2k

mit

53

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

app gui ios mllm agent gpt4v mobile android copilot harmony automation multimodal mobile-agents multimodal-agent multimodal-large-language-models

Created 2024-01-26

139 commits to main branch, last one 2 months ago

InternLM-XComposer InternLM

159

2.7k

apache-2.0

43

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

409 commits to main branch, last one 3 days ago

MagicQuill magic-quill

203

2.3k

other

25

Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

aigc mllm gradio image-editing

Created 2024-11-12

50 commits to main branch, last one 5 days ago

Awesome-LLM-Reasoning atfortes

123

2.1k

mit

39

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓

cot gpt mllm gpt-4o papers prompt awesome chatgpt marco-o1 insight-v openai-o1 reasoning multimodal strawberry language-models chain-of-thought prompt-engineering in-context-learning

Created 2022-11-05

173 commits to main branch, last one 4 days ago

mPLUG-DocOwl X-PLUG

115

2.0k

apache-2.0

33

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

mllm multimodal chart-understanding table-understanding document-understanding multimodal-large-language-models

Created 2023-07-04

134 commits to main branch, last one 2 months ago

cambrian cambrian-mllm

118

1.8k

apache-2.0

23

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

clip dino llms mllm chatbot computer-vision instruction-tuning large-language-models representation-learning multimodal-large-language-models

Created 2024-06-17

59 commits to main branch, last one about a month ago

Bunny BAAI-DCAI

71

962

apache-2.0

20

A family of lightweight multimodal models.

vlm mllm gpt-4 chatgpt chinese english multimodal-large-language-models

Created 2024-01-31

114 commits to main branch, last one about a month ago

Osprey CircleRadon

42

780

apache-2.0

14

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

sam mllm pixel-understanding visual-instruction-tuning

Created 2023-12-17

29 commits to main branch, last one 4 months ago

Agent-S simular-ai

95

703

apache-2.0

22

Agent S: an open agentic framework that uses computers like a human

mllm memory planning ai-agents gui-agents computer-automation agent-computer-interface retrieval-augmented-generation in-context-reinforcement-learning experience-augmented-hierarchical-planning

Created 2024-10-09

88 commits to main branch, last one 15 days ago

Woodpecker BradyFU

29

619

unknown

15

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.

llm mllm hallucination multimodality hallucinations large-language-models multimodal-large-language-models

Created 2023-09-26

106 commits to main branch, last one 6 months ago

Groma FoundationVision

61

585

apache-2.0

36

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 6 months ago

EAGLE NVlabs

45

552

apache-2.0

31

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

llm lmm demo gpt4 lvlm mllm eagle llama llava nvdia llama3 huggingface large-language-models

Created 2024-06-27

81 commits to main branch, last one 3 months ago

LLMGA dvlab-research

29

465

apache-2.0

13

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral

llm aigc mllm multi-modal image-editing image-generation large-language-model image-design-assistant

Created 2023-11-27

2 commits to master branch, last one 4 months ago

ComfyUI_VLM_nodes gokayfem

39

432

apache-2.0

7

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning

Created 2024-01-24

271 commits to main branch, last one about a month ago

Vitron SkyworkAI

24

414

unknown

14

NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing

mllm segmentation multimodal-large-language-models

Created 2024-03-18

78 commits to main branch, last one 2 months ago

MPP-LLaVA Coobiw

20

390

unknown

4

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train...

mllm qwen deepspeed fine-tuning pretraining model-parallel pipeline-parallelism video-language-model video-large-language-models multimodal-large-language-models

Created 2023-10-24

134 commits to master branch, last one 11 days ago

Awesome-LLMs-meet-Multimodal-Generation YingqingHe

22

389

unknown

14

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

llm aigc lvlm mllm text-to-3d multimodality text-to-audio text-to-image text-to-music text-to-sound text-to-video text-to-speech multimodal-models large-language-models multimodal-generation large-vision-language-models multimodal-large-language-models

Created 2023-11-17

346 commits to main branch, last one about a month ago

Youku-mPLUG X-PLUG

11

286

apache-2.0

5

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

mllm video youku chinese dataset benchmark multimodal video-retrieval multimodal-pretraining video-question-answering multimodal-large-language-models

Created 2023-06-06

18 commits to main branch, last one 11 months ago

Awesome_Multimodel_LLM Atomic-man007

18

280

unknown

8

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context l...

gpt llm nlp mllm chatgpt dataset multimodel pretrained-models

Created 2023-06-11

35 commits to main branch, last one 4 months ago

EVE baaivision

4

249

mit

8

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

llm vlm clip mllm encoder-free-vlm instruction-following large-language-models vision-language-models multimodal-large-language-models

Created 2024-06-14

19 commits to main branch, last one 2 months ago

TokenPacker CircleRadon

9

234

unknown

9

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

lmm mllm connector tokenpacker token-reduction visual-projector

Created 2024-07-03

20 commits to main branch, last one 25 days ago

mPLUG-2 X-PLUG

19

221

apache-2.0

5

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

vqa mllm mplug video multimodal image-retrieval video-retrieval foundation-models multimodal-pretraining video-question-answering

Created 2023-05-22

4 commits to main branch, last one about a year ago

Mantis TIGER-AI-Lab

15

190

apache-2.0

9

Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)

lmm vlm fuyu mllm video mantis vision language multimodal llava-llama3 multi-image-understanding

Created 2024-04-12

230 commits to main branch, last one 2 days ago

SeViLA Yui010206

22

182

bsd-3-clause

3

[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

mllm video-localization video-question-answering

Created 2023-05-10

36 commits to main branch, last one 11 months ago

AUITestAgent bz-lab

12

167

unknown

3

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.