10 results found Sort:

FMInference
FlexiGen FMInference
540
9.1k
apache-2.0
111
Running large language models on a single GPU for throughput-oriented scenarios.
opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models
Created 2023-02-15
104 commits to main branch, last one a day ago
alphadose
ZenQ alphadose
18
655
mit
12
A thread-safe queue faster and more resource efficient than golang's native channels
go zenq golang fastest lock-free mpsc-queue ringbuffer spsc-queue concurrency low-latency thread-safe optimization high-throughput memory-efficient zero-allocations highly-concurrent
Created 2022-04-27
227 commits to main branch, last one 6 months ago
salesforce
warp-drive salesforce
79
458
bsd-3-clause
14
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
gpu cuda numba pytorch deep-learning high-throughput reinforcement-learning multiagent-reinforcement-learning
Created 2021-08-25
381 commits to master branch, last one about a month ago
FMInference
H2O FMInference
37
366
unknown
5
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models
Created 2023-06-12
41 commits to main branch, last one 3 months ago
Quantum-Accelerators
quacc Quantum-Accelerators
47
173
bsd-3-clause
5
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
dft hpc python database workflow chemistry high-throughput quantum-chemistry quantum-mechanics computational-materials-science
Created 2021-12-18
2,827 commits to main branch, last one 2 days ago
materialsproject
atomate2 materialsproject
87
155
other
11
atomate2 is a library of computational materials science workflows
dft vasp automation high-throughput materials-science
Created 2020-10-22
2,878 commits to main branch, last one a day ago
jnk0le
AVR-UART-lib jnk0le
36
103
mit
15
extremly light uart library for AVR 8 bit microcontrollers
c avr uart rs232 rs485 usart avr-gcc optimized high-speed prematured arduino-less flow-control low-overhead transmission high-throughput avr-microcontroller avr-microcontrollers
Created 2015-02-21
270 commits to master branch, last one 6 months ago
tugrul512bit
LruClockCache tugrul512bit
5
64
mit
4
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
cpp lru fast cache caching fastest benchmark lru-cache low-latency memoization cache-simulator data-structures high-throughput high-performance multi-level-cache clock-second-chance direct-mapped-cache least-recently-used low-latency-queries set-associative-cache
Created 2021-10-04
167 commits to main branch, last one 8 months ago
svenkubiak
mangooio svenkubiak
12
56
apache-2.0
11
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
java backend frontend undertow fullstack performance web-framework high-throughput
Created 2015-06-01
4,531 commits to main branch, last one 24 days ago
jmsadair
RapidTrader jmsadair
7
34
unknown
2
A low-latency, high-throughput order matching system implementation.
cpp finance trading orderbook concurrency low-latency multithreading high-throughput matching-engine trading-platform
Created 2022-05-18
174 commits to dev branch, last one about a year ago