13 results found Sort:

FMInference
FlexLLMGen FMInference
557
9.3k
apache-2.0
112
Running large language models on a single GPU for throughput-oriented scenarios.
opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models
This repository has been archived (exclude archived)
Created 2023-02-15
107 commits to main branch, last one 3 months ago
alphadose
ZenQ alphadose
20
669
mit
13
A thread-safe queue faster and more resource efficient than golang's native channels
go zenq golang fastest lock-free mpsc-queue ringbuffer spsc-queue concurrency low-latency thread-safe optimization high-throughput memory-efficient zero-allocations highly-concurrent
Created 2022-04-27
227 commits to main branch, last one 10 months ago
salesforce
warp-drive salesforce
78
470
bsd-3-clause
14
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
gpu cuda numba pytorch deep-learning high-throughput reinforcement-learning multiagent-reinforcement-learning
Created 2021-08-25
381 commits to master branch, last one 6 months ago
FMInference
H2O FMInference
51
419
unknown
5
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models
Created 2023-06-12
41 commits to main branch, last one 7 months ago
Quantum-Accelerators
quacc Quantum-Accelerators
53
201
bsd-3-clause
4
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
dft hpc python database workflow chemistry high-throughput quantum-chemistry quantum-mechanics computational-materials-science
Created 2021-12-18
2,999 commits to main branch, last one a day ago
materialsproject
atomate2 materialsproject
103
184
other
11
atomate2 is a library of computational materials science workflows
dft vasp automation high-throughput materials-science
Created 2020-10-22
2,941 commits to main branch, last one 7 days ago
bytedance
ShadowKV bytedance
6
146
apache-2.0
3
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
low-rank research cpu-offload long-context llm-inference high-throughput sparse-attention
Created 2024-10-22
13 commits to main branch, last one 3 months ago
jnk0le
AVR-UART-lib jnk0le
36
105
mit
15
extremly light uart library for AVR 8 bit microcontrollers
c avr uart rs232 rs485 usart avr-gcc optimized high-speed prematured arduino-less flow-control low-overhead transmission high-throughput avr-microcontroller avr-microcontrollers
Created 2015-02-21
270 commits to master branch, last one 10 months ago
tugrul512bit
LruClockCache tugrul512bit
5
68
mit
4
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
cpp lru fast cache caching fastest benchmark lru-cache low-latency memoization cache-simulator data-structures high-throughput high-performance multi-level-cache clock-second-chance direct-mapped-cache least-recently-used low-latency-queries set-associative-cache
Created 2021-10-04
167 commits to main branch, last one about a year ago
svenkubiak
mangooio svenkubiak
12
56
apache-2.0
11
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
java backend frontend undertow fullstack performance web-framework high-throughput
Created 2015-06-01
4,712 commits to main branch, last one 17 days ago
RUB-Bioinf
VesselExpress RUB-Bioinf
5
43
gpl-3.0
5
🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes
docker snakemake 3d-imaging 3d-skeleton bioinformatics graph-analysis high-throughput vessel-segmentation light-sheet-microscopy
Created 2020-04-16
121 commits to master branch, last one 7 months ago
jmsadair
RapidTrader jmsadair
10
37
unknown
2
A low-latency, high-throughput order matching system implementation.
cpp finance trading orderbook concurrency low-latency multithreading high-throughput matching-engine trading-platform
Created 2022-05-18
174 commits to dev branch, last one about a year ago
zavolanlab
zarp zavolanlab
5
35
apache-2.0
6
The Zavolab Automated RNA-seq Pipeline
fair conda docker rna-seq pipeline workflow snakemake singularity bioinformatics high-throughput transcriptomics reproducible-research
Created 2021-08-30
287 commits to dev branch, last one 5 months ago