2 results found Sort:

intel
neural-speed intel
38
349
apache-2.0
8
An innovative library for efficient LLM inference via low-bit quantization
cpu fp4 fp8 gpu nf4 int1 int2 int3 int4 int5 int6 int7 int8 gaudi2 low-bit llamacpp mxformat sparsity llm-inference llm-fine-tuning
This repository has been archived (exclude archived)
Created 2023-11-20
345 commits to main branch, last one 3 months ago
opea-project
GenAIExamples opea-project
198
300
apache-2.0
24
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
rag tgi llms xeon genai gaudi2 chatqna codegen copilot summarization
Created 2024-03-20
765 commits to main branch, last one a day ago