Search Results - RepositoryStats

ollama ollama

8.2k

103.2k

mit

597

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

go llm llms phi3 gemma llama llava gemma2 golang llama2 llama3 ollama mistral

Created 2023-06-26

3,745 commits to main branch, last one 13 hours ago

LLaVA haotian-liu

2.3k

20.7k

apache-2.0

157

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning

Created 2023-04-17

460 commits to main branch, last one 7 months ago

sglang sgl-project

580

6.6k

apache-2.0

60

SGLang is a fast serving framework for large language models and vision language models.

llm moe vlm cuda llama llava llama2 llama3 pytorch llama3-1 inference llm-serving transformer

Created 2024-01-08

1,519 commits to main branch, last one 20 hours ago

SUPIR Fanghua-Yu

390

4.5k

other

65

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.

sdxl llava pytorch restoration deep-learning diffusion-models stable-diffusion super-resolution pytorch-lightning

Created 2023-12-21

36 commits to master branch, last one 4 months ago

xtuner InternLM

321

4.1k

apache-2.0

36

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning

Created 2023-07-11

330 commits to main branch, last one about a month ago

data-juicer modelscope

186

3.1k

apache-2.0

18

Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

Created 2023-08-01

261 commits to main branch, last one 5 days ago

zero_nlp yuanzhoulvpi2017

373

3.1k

mit

30

中文nlp解决方案(大模型、数据、模型、训练、推理)

gpt nlp bert clip gpt2 llama llava llama2 pytorch chatglm-6b transformers text-generation huggingface-transformers

Created 2023-02-05

242 commits to main branch, last one 20 hours ago

LLamaSharp SciSharp

357

2.8k

mit

56

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

gpt llm llama llava llama2 llama3 chatbot llamacpp llama-cpp multi-modal semantic-kernel

Created 2023-05-09

1,761 commits to master branch, last one 6 days ago

FindTheChatGPTer chenking2020

201

2.0k

unknown

57

ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利

Created 2023-04-07

65 commits to main branch, last one about a year ago

VLMEvalKit open-compass

212

1.5k

apache-2.0

11

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks

gpt llm vit vqa clip gpt4 qwen llava claude gemini gpt-4v openai chatgpt pytorch evaluation openai-api multi-modal computer-vision large-language-models

Created 2023-12-01

1,084 commits to main branch, last one 22 hours ago

Video-ChatGPT mbzuai-oryx

110

1.2k

cc-by-4.0

15

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for ...

clip gpt-4 llama llava vicuna chatbot mulit-modal video-chatboat vision-language video-conversation vision-language-pretraining

Created 2023-05-18

43 commits to main branch, last one 3 months ago

uform unum-cloud

63

1.1k

apache-2.0

15

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

Created 2023-02-21

293 commits to main branch, last one 2 months ago

LLaVA-pp mbzuai-oryx

61

816

unknown

10

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

llm lmms phi3 llava llama3 llava-phi3 phi3-llava phi-3-llava phi3-vision conversation llama3-llava llava-llama3 phi-3-vision llama-3-llava llama3-vision llama-3-vision vision-language

Created 2024-04-26

11 commits to main branch, last one 7 months ago

taggui jhc13

38

799

gpl-3.0

15

Tag manager and captioner for image datasets

llava cogvlm pyside6 florence-2 tag-manager image-tagging image-captioning stable-diffusion

Created 2023-03-08

559 commits to main branch, last one 4 days ago

machina PsyChip

33

723

unknown

2

OpenCV+YOLO+LLAVA powered video surveillance system

rtsp yolo llava camera opencv python ollama-api

Created 2024-10-07

14 commits to main branch, last one 29 days ago

TinyLLaVA_Factory TinyLLaVA

73

686

apache-2.0

11

A Framework of Small-scale Large Multimodal Models

nlp llama llava tinyllama transformers vision-language large-multimodal-models

Created 2024-02-21

221 commits to main branch, last one 4 days ago

mlx-vlm Blaizzy

53

592

mit

8

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

llm mlx llava molmo idefics pixtral local-ai florence2 paligemma apple-silicon vision-framework vision-transformer vision-language-model

Created 2024-04-16

180 commits to main branch, last one 12 days ago

awesome-foundation-and-multimodal-models SkalskiP

44

589

unknown

26

👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

nlp blip clip llava multimodal grounding-dino computer-vision image-captioning segment-anything foundational-models zero-shot-detection open-vocabulary-detection open-vocabulary-segmentation

Created 2023-10-08

31 commits to master branch, last one 9 months ago

EAGLE NVlabs

45

550

apache-2.0

31

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

llm lmm demo gpt4 lvlm mllm eagle llama llava nvdia llama3 huggingface large-language-models

Created 2024-06-27

81 commits to main branch, last one 3 months ago

awesome-vlm-architectures gokayfem

25

502

cc0-1.0

12

Famous Vision Language Models and Their Architectures

vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model

Created 2024-02-15

231 commits to main branch, last one 3 months ago

llama-assistant nrl-ai

35

454

gpl-3.0

10

AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing tex...

owen llama llava llama3 llama-3-2 moondream private-gpt personal-assistant

Created 2024-09-26

91 commits to main branch, last one 4 days ago

ComfyUI_VLM_nodes gokayfem

39

430

apache-2.0

7

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning

Created 2024-01-24

271 commits to main branch, last one about a month ago

Open-LLaVA-NeXT xiaoachen98

20

401

unknown

13

An open-source implementation for training LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

36 commits to master branch, last one about a month ago

llmcord jakobdylanc

77

401

mit

5

Make Discord your LLM frontend ● Supports any OpenAI compatible API (Ollama, LM Studio, vLLM, OpenRouter, xAI, Mistral, Groq and more)

Created 2023-05-08

345 commits to main branch, last one a day ago

restai apocas

75

400

apache-2.0

10

RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precis...

llm rag llama llava ollama openai python fastapi langchain openaiapi embeddings llamaindex transformers stable-diffusion

Created 2023-05-18

820 commits to master branch, last one 13 days ago

PaddleMIX PaddlePaddle

159

373

apache-2.0

22

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...

Created 2023-07-05

965 commits to develop branch, last one 24 hours ago

InternEvo InternLM

54

317

apache-2.0

10

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism

Created 2024-01-16

493 commits to develop branch, last one 22 hours ago

ViP-LLaVA WisconsinAIVision

21

302

apache-2.0

5

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

clip gpt-4 llama llava llama2 chatbot cvpr2024 multi-modal gpt-4-vision vision-language visual-prompting foundation-models

Created 2023-12-02

44 commits to main branch, last one 5 months ago

ai-devices developersdigest

40

283

mit

3

AI Device Template Featuring Whisper, TTS, Groq, Llama3, OpenAI and more

llm tts groq llava llama3 openai serper whisper langchain langsmith gpt-4-vision function-calling

Created 2024-04-20

42 commits to main branch, last one 7 months ago

LRV-Instruction FuxiaoLiu

13

262

bsd-3-clause

11

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

gpt vqa iclr gpt-4 llama llava vicuna vision chatgpt iclr2024 evaluation multimodal hallucination object-detection foundation-models evaluation-metrics prompt-engineering vision-and-language

Created 2023-06-15

366 commits to main branch, last one 9 months ago