3 results found Sort:

133
352
apache-2.0
22
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...
Created 2023-07-05
909 commits to develop branch, last one 2 days ago
【grps接入trtllm】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务,支持chat和function call模式,支持ai agent,支持分布式多卡推理,支持多模态,支持gradio聊天界面。
Created 2024-08-21
101 commits to master branch, last one 13 days ago
8
54
bsd-3-clause
2
Explore LLM model deployment based on AXera's AI chips
Created 2024-03-14
63 commits to prefill branch, last one 4 days ago