95 results found Sort:

316
3.3k
mit
55
Mobile-Agent: The Powerful Mobile Device Operation Assistant Family
Created 2024-01-26
159 commits to main branch, last one 3 days ago
328
2.9k
apache-2.0
38
ModelScope-Agent: An agent framework connecting models in ModelScope with the world
Created 2023-08-03
474 commits to master branch, last one 2 months ago
186
2.8k
apache-2.0
30
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
Created 2024-09-10
13 commits to main branch, last one 2 months ago
124
2.1k
apache-2.0
32
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
Created 2023-07-04
135 commits to main branch, last one about a month ago
147
2.0k
other
47
✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
Created 2024-08-10
126 commits to main branch, last one 10 days ago
125
1.8k
apache-2.0
23
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
Created 2024-06-17
59 commits to main branch, last one 3 months ago
[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (RPG)
Created 2024-01-22
59 commits to main branch, last one about a month ago
75
982
apache-2.0
19
A family of lightweight multimodal models.
Created 2024-01-31
114 commits to main branch, last one 2 months ago
LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
Created 2023-11-07
404 commits to main branch, last one about a year ago
65
694
mit
23
Speech, Language, Audio, Music Processing with Large Language Model
Created 2023-10-23
882 commits to main branch, last one 9 days ago
实时语音交互数字人,支持端到端语音方案(GLM-4-Voice - THG)和级联方案(ASR-LLM-TTS-THG)。可自定义形象与音色,无须训练,支持音色克隆,首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cas...
Created 2024-10-18
40 commits to master branch, last one 2 months ago
A collection of resources on applications of multi-modal learning in medical imaging.
Created 2022-07-13
154 commits to main branch, last one 8 days ago
31
627
unknown
16
✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs
Created 2023-09-26
107 commits to main branch, last one about a month ago
33
599
apache-2.0
7
A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
Created 2024-06-13
32 commits to main branch, last one 2 months ago
42
575
bsd-3-clause
12
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
Created 2023-06-26
122 commits to main branch, last one 2 days ago
25
509
unknown
10
MLCD & UNICOM : Large-Scale Visual Representation Model
Created 2023-02-15
123 commits to main branch, last one 8 days ago
27
471
unknown
15
NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
Created 2024-03-18
78 commits to main branch, last one 3 months ago
18
448
unknown
6
✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
Created 2024-06-02
50 commits to main branch, last one about a month ago
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
Created 2023-11-17
348 commits to main branch, last one 13 days ago
21
395
unknown
6
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train...
Created 2023-10-24
134 commits to master branch, last one about a month ago
Research Trends in LLM-guided Multimodal Learning.
Created 2023-05-29
16 commits to main branch, last one about a year ago
31
346
unknown
12
A Gradio demo of MGIE
Created 2023-09-28
1 commits to main branch, last one 11 months ago
16
340
apache-2.0
8
Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"
Created 2024-06-12
48 commits to main branch, last one 17 days ago
13
302
apache-2.0
9
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
Created 2025-01-07
8 commits to main branch, last one 18 days ago
11
290
apache-2.0
6
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
Created 2023-06-06
18 commits to main branch, last one about a year ago
Curated papers on Large Language Models in Healthcare and Medical domain
Created 2023-06-28
45 commits to main branch, last one 6 months ago
[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
Created 2024-06-14
19 commits to main branch, last one 4 months ago
✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
Created 2024-11-04
21 commits to main branch, last one 29 days ago