3 results found Sort:
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...
Created
2023-07-05
909 commits to develop branch, last one 2 days ago
【grps接入trtllm】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务,支持chat和function call模式,支持ai agent,支持分布式多卡推理,支持多模态,支持gradio聊天界面。
Created
2024-08-21
101 commits to master branch, last one 13 days ago
Explore LLM model deployment based on AXera's AI chips
Created
2024-03-14
63 commits to prefill branch, last one 4 days ago