3 results found Sort:

NVIDIA
TransformerEngine NVIDIA
255
1.6k
apache-2.0
34
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization i...
fp8 gpu jax cuda python pytorch deep-learning machine-learning
Created 2022-09-20
603 commits to main branch, last one 2 days ago
Azure
MS-AMP Azure
33
478
mit
11
Microsoft Automatic Mixed Precision Library
amp fp8 gpu pytorch transformer deep-learning mixed-precision
Created 2023-01-30
97 commits to main branch, last one 4 months ago
intel
neural-speed intel
33
303
apache-2.0
8
An innovative library for efficient LLM inference via low-bit quantization
cpu fp4 fp8 gpu nf4 int1 int2 int3 int4 int5 int6 int7 int8 gaudi2 low-bit llamacpp mxformat sparsity llm-inference llm-fine-tuning
Created 2023-11-20
344 commits to main branch, last one 4 days ago