4 results found Sort:

gokayfem
awesome-vlm-architectures gokayfem
22
398
cc0-1.0
12
Famous Vision Language Models and Their Architectures
vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model
Created 2024-02-15
231 commits to main branch, last one about a month ago
PaddlePaddle
PaddleMIX PaddlePaddle
129
348
apache-2.0
22
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...
dit aigc clip sora llava sd-xl qwen-vl eva-clip minigpt4 qwen2-vl internvl2 controlnet multimodal ppdiffusers unidiffuser image-to-text text-to-image text-to-video stable-diffusion stablevideodiffusion
Created 2023-07-05
905 commits to develop branch, last one 23 hours ago
zjysteven
lmms-finetune zjysteven
22
170
apache-2.0
5
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, qwen-vl, qwen2-vl, phi3-v etc.
llava qwen-vl finetuning llava-next multimodal vision-language foundation-models instruction-tuning large-language-model large-multimodal-models visual-instruction-tuning multimodal-large-language-models
Created 2024-07-20
95 commits to main branch, last one 15 days ago
NetEase-Media
grps_trtllm NetEase-Media
1
87
apache-2.0
3
【grps接入trtllm】通过接入TensorRT-LLM以及Tokenizers.cpp实现纯c++版本高性能LLM服务，兼容OpenAI接口协议，支持chat和function call模式，支持ai agent，支持多卡推理，支持多模态，支持gradio聊天界面。
llm qwen2 llama3 openai chatglm qwen-vl ai-agent internvl2 llama-index multi-modal tensorrt-llm function-call
Created 2024-08-21
101 commits to master branch, last one 4 days ago