28 results found Sort:

linkedin
Liger-Kernel linkedin
230
3.9k
bsd-2-clause
40
Efficient Triton Kernels for LLM Training
llms phi3 llama gemma2 llama3 triton mistral finetuning llm-training triton-kernels
Created 2024-08-06
358 commits to main branch, last one 19 hours ago
ELS-RD
kernl ELS-RD
94
1.5k
apache-2.0
29
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
cuda triton pytorch cuda-kernel transformer
Created 2022-08-05
122 commits to main branch, last one about a year ago
TritonDataCenter
containerpilot TritonDataCenter
134
1.1k
mpl-2.0
83
A service for autodiscovery and configuration of applications running in containers
consul docker joyent triton containers orchestration containerpilot service-discovery
Created 2015-10-22
697 commits to master branch, last one 3 years ago
JonathanSalwan
Tigress_protection JonathanSalwan
144
816
unknown
37
Playing with the Tigress software protection. Break some of its protections and solve their reverse engineering challenges. Automatic deobfuscation using symbolic execution, taint analysis and LLVM.
llvm triton tigress deobfuscation taint-analysis symbolic-execution reverse-engineering tigress-protections solution-tigress-challenge
Created 2016-10-28
39 commits to master branch, last one about a year ago
thu-ml
SageAttention thu-ml
35
709
apache-2.0
18
Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.
llm cuda triton attention quantization video-generation inference-acceleration
Created 2024-10-03
64 commits to main branch, last one 11 hours ago
BobMcDear
attorch BobMcDear
24
498
mit
11
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
cuda openai triton pytorch deep-learning openai-triton machine-learning
Created 2023-07-13
158 commits to main branch, last one about a month ago
JafarAkhondali
acer-predator-turbo-and-rgb-keyboard-linux-module JafarAkhondali
75
392
gpl-3.0
21
Linux kernel module to support Turbo mode and RGB Keyboard for Acer Predator notebook series
led rgb acer linux turbo helios triton rgb-led predator hacktoberfest
Created 2021-05-13
202 commits to main branch, last one 8 days ago
FlagOpen
FlagGems FlagOpen
55
372
apache-2.0
19
FlagGems is an operator library for large language models implemented in Triton Language.
triton pytorch triton-kernels
Created 2024-03-21
365 commits to master branch, last one a day ago
opendilab
DI-hpc opendilab
7
226
apache-2.0
4
OpenDILab RL HPC OP Lib, including CUDA and Triton kernel
hpc cuda lstm triton pytorch reinforcement-learning
Created 2021-07-05
10 commits to main branch, last one 5 months ago
Colton1skees
Dna Colton1skees
19
195
gpl-3.0
5
LLVM based static binary analysis framework
x86 llvm binary lifter triton x86-64 llvm-ir analysis deobfuscation static-analysis program-analysis instruction-semantics
Created 2022-03-12
146 commits to master branch, last one 2 months ago
kakaobrain
trident kakaobrain
11
182
apache-2.0
4
A performance library for machine learning applications.
ai python triton library pytorch performance deep-learning machine-learning
This repository has been archived (exclude archived)
Created 2023-04-30
234 commits to main branch, last one about a year ago
coderonion
awesome-cuda-triton-hpc coderonion
22
168
unknown
5
🔥🔥🔥 A collection of some awesome public CUDA, cuBLAS, TensorRT, TensorRT-LLM, Triton and High Performance Computing (HPC) projects.
gpu hpc llm blas cuda gemm yolo cudnn llama scipy cublas lapack triton awesome cutlass pytorch openblas tensorrt tensorrt-llm parallel-computing
Created 2023-02-23
14 commits to main branch, last one 6 days ago
mmsaeed509
bspwm-dots mmsaeed509
10
160
gpl-3.0
5
Ozoz dotfiles for bspwm, i3WM
acer arch i3wm rofi bspwm linux turbo helios neovim triton polybar dotfiles exodiaos neofetch predator archlinux
Created 2022-04-16
261 commits to master branch, last one 5 months ago
allegroai
clearml-serving allegroai
40
139
apache-2.0
11
ClearML - Model-Serving Orchestration and Repository Solution
ai mlops devops triton clearml serving kubernetes serving-ml deep-learning model-serving machine-learning tensorflow-serving serving-pytorch-models triton-inference-server
Created 2021-04-12
142 commits to main branch, last one 5 days ago
novioleo
Savior novioleo
28
137
bsd-2-clause
8
(WIP)The deployment framework aims to provide a simple, lightweight, fast integrated, pipelined deployment framework for algorithm service that ensures reliability, high concurrency and scalability of...
rpa triton workflow deployment distributed deeplearning
Created 2021-03-07
408 commits to master branch, last one 3 years ago
NVIDIA-ISAAC-ROS
isaac_ros_object_detection NVIDIA-ISAAC-ROS
27
124
apache-2.0
3
NVIDIA-accelerated, deep learned model support for image space object detection
gpu ros ros2 jetson nvidia triton tensorrt inference ros2-humble deep-learning machine-learning object-detection
Created 2022-03-22
39 commits to main branch, last one 10 days ago
NVIDIA-ISAAC-ROS
isaac_ros_dnn_inference NVIDIA-ISAAC-ROS
17
106
apache-2.0
4
NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
ai dnn gpu ros tao ros2 jetson nvidia triton tensorrt ros2-humble deeplearning deep-learning tensorrt-inference triton-inference-server
Created 2021-10-13
42 commits to main branch, last one 10 days ago
notAI-tech
fastDeploy notAI-tech
17
96
mit
8
Deploy DL/ ML inference pipelines with minimal extra code.
docker falcon gevent python triton pytorch serving gunicorn websocket tf-serving torchserve http-server deep-learning model-serving triton-server streaming-audio inference-server model-deployment tensorflow-serving triton-inference-server
Created 2020-04-09
503 commits to master branch, last one about a month ago
alexzhang13
flashattention2-custom-mask alexzhang13
8
86
apache-2.0
5
Triton implementation of FlashAttention2 that adds Custom Masks.
triton attention triton-lang cuda-kernels deep-learning flash-attention flash-attention-2 attention-mechanism
Created 2024-07-20
18 commits to main branch, last one 4 months ago
triton
triton triton
9
64
mit
12
Triton Operating System
nix linux nixos atomic triton nixpkgs systemd packages atomic-updates operating-system linux-distribution declarative-language
Created 2015-06-02
94,340 commits to master branch, last one 4 years ago
ergrelet
triton-bn ergrelet
4
58
apache-2.0
7
Binary Ninja plugin that can be used to apply Triton's dead store eliminitation pass on basic blocks or functions.
cpp triton binary-ninja deobfuscation binary-ninja-plugin reverse-engineering
Created 2022-06-06
21 commits to main branch, last one 5 months ago
redis-developer
redis-nvidia-recsys redis-developer
5
57
bsd-3-clause
6
Three examples of recommendation system pipelines with NVIDIA Merlin and Redis
dlrm redis triton nvidia-merlin vector-search recommendation vector-database recommender-system
Created 2022-11-21
10 commits to master branch, last one about a year ago
hyperai
triton-cn hyperai
4
47
mit
4
Triton Documentation in Chinese Simplified / Triton 中文文档
gpu nvidia openai triton translation deep-learning documentation machine-learning chinese-simplified
Created 2024-09-19
57 commits to master branch, last one 10 days ago
suvash
nixos-nvidia-cuda-python-docker-compose suvash
5
37
unknown
3
A step-by-step guide to setting up Nvidia GPUs with CUDA support running on Docker (and Compose) containers on NixOS host
jax nixos nvidia python triton pytorch nvidia-smi tensorflow nvidia-cuda deep-learning nvidia-docker docker-compose
Created 2021-08-07
18 commits to main branch, last one 5 months ago
Lallapallooza
fast-audiomentations Lallapallooza
1
33
mit
3
⚡ Blazing fast audio augmentation in Python, powered by GPU for high-efficiency processing in machine learning and audio analysis tasks.
dsp gpu audio python triton pytorch audio-effects augmentations machine-learning data-augmentation audio-augmentation audio-data-augmentation
Created 2024-01-19
2 commits to main branch, last one 11 months ago
dame-cell
Triformer dame-cell
0
28
mit
2
Transformers components but in Triton
gpt2 triton transformer-architecture
Created 2024-10-14
254 commits to main branch, last one about a month ago
rkinas
triton-resources rkinas
5
27
unknown
2
A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
cuda triton
Created 2024-12-07
18 commits to main branch, last one a day ago
DeepAuto-AI
hip-attention DeepAuto-AI
3
27
unknown
5
Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
triton attention hip-attention openai-triton attention-mechanism sub-quadratic-attention
Created 2024-02-29
904 commits to main branch, last one 16 days ago