2 results found Sort:

intel
neural-speed intel
33
303
apache-2.0
8
An innovative library for efficient LLM inference via low-bit quantization
cpu fp4 fp8 gpu nf4 int1 int2 int3 int4 int5 int6 int7 int8 gaudi2 low-bit llamacpp mxformat sparsity llm-inference llm-fine-tuning
Created 2023-11-20
344 commits to main branch, last one 4 days ago
opea-project
GenAIExamples opea-project
81
172
apache-2.0
20
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
rag tgi llms xeon genai gaudi2 chatqna codegen copilot summarization
Created 2024-03-20
246 commits to main branch, last one 22 hours ago