1 result found Sort:

intel
neural-speed intel
33
303
apache-2.0
8
An innovative library for efficient LLM inference via low-bit quantization
cpu fp4 fp8 gpu nf4 int1 int2 int3 int4 int5 int6 int7 int8 gaudi2 low-bit llamacpp mxformat sparsity llm-inference llm-fine-tuning
Created 2023-11-20
344 commits to main branch, last one 4 days ago