14 results found Sort:

FMInference
FlexLLMGen FMInference
565
9.3k
apache-2.0
111
Running large language models on a single GPU for throughput-oriented scenarios.
opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models
This repository has been archived (exclude archived)
Created 2023-02-15
107 commits to main branch, last one 4 months ago
alphadose
ZenQ alphadose
20
674
mit
12
A thread-safe queue faster and more resource efficient than golang's native channels
go zenq golang fastest lock-free mpsc-queue ringbuffer spsc-queue concurrency low-latency thread-safe optimization high-throughput memory-efficient zero-allocations highly-concurrent
Created 2022-04-27
227 commits to main branch, last one about a year ago
salesforce
warp-drive salesforce
79
478
bsd-3-clause
13
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
gpu cuda numba pytorch deep-learning high-throughput reinforcement-learning multiagent-reinforcement-learning
Created 2021-08-25
381 commits to master branch, last one 7 months ago
FMInference
H2O FMInference
54
433
unknown
5
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models
Created 2023-06-12
41 commits to main branch, last one 9 months ago
Quantum-Accelerators
quacc Quantum-Accelerators
54
207
bsd-3-clause
3
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
dft hpc python database workflow chemistry high-throughput quantum-chemistry quantum-mechanics computational-materials-science
Created 2021-12-18
3,104 commits to main branch, last one 14 hours ago
JoyalAJohney
Realtime-distributed-chat JoyalAJohney
23
201
unknown
2
Realtime distributed messaging platform built using Go and React (Fullstack) ❤️
low-latency system-design high-throughput realtime-messaging
Created 2024-01-15
33 commits to main branch, last one 25 days ago
materialsproject
atomate2 materialsproject
107
196
other
10
atomate2 is a library of computational materials science workflows
dft vasp automation high-throughput materials-science
Created 2020-10-22
2,966 commits to main branch, last one a day ago
bytedance
ShadowKV bytedance
6
152
apache-2.0
3
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
low-rank research cpu-offload long-context llm-inference high-throughput sparse-attention
Created 2024-10-22
13 commits to main branch, last one 4 months ago
jnk0le
AVR-UART-lib jnk0le
35
106
mit
14
extremly light uart library for AVR 8 bit microcontrollers
c avr uart rs232 rs485 usart avr-gcc optimized high-speed prematured arduino-less flow-control low-overhead transmission high-throughput avr-microcontroller avr-microcontrollers
Created 2015-02-21
270 commits to master branch, last one about a year ago
tugrul512bit
LruClockCache tugrul512bit
6
71
mit
3
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
cpp lru fast cache caching fastest benchmark lru-cache low-latency memoization cache-simulator data-structures high-throughput high-performance multi-level-cache clock-second-chance direct-mapped-cache least-recently-used low-latency-queries set-associative-cache
Created 2021-10-04
167 commits to main branch, last one about a year ago
svenkubiak
mangooio svenkubiak
12
56
apache-2.0
10
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
java backend frontend undertow fullstack performance web-framework high-throughput
Created 2015-06-01
4,775 commits to main branch, last one 12 days ago
RUB-Bioinf
VesselExpress RUB-Bioinf
6
47
gpl-3.0
5
🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes
docker snakemake 3d-imaging 3d-skeleton bioinformatics graph-analysis high-throughput vessel-segmentation light-sheet-microscopy
Created 2020-04-16
121 commits to master branch, last one 9 months ago
jmsadair
RapidTrader jmsadair
9
37
unknown
2
A low-latency, high-throughput order matching system implementation.
cpp finance trading orderbook concurrency low-latency multithreading high-throughput matching-engine trading-platform
Created 2022-05-18
174 commits to dev branch, last one about a year ago
zavolanlab
zarp zavolanlab
5
35
apache-2.0
6
The Zavolab Automated RNA-seq Pipeline
fair conda docker rna-seq pipeline workflow snakemake singularity bioinformatics high-throughput transcriptomics reproducible-research
Created 2021-08-30
287 commits to dev branch, last one 6 months ago