2 results found Sort:

FMInference
H2O FMInference
48
407
unknown
5
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models
Created 2023-06-12
41 commits to main branch, last one 6 months ago
barrust
pyprobables barrust
11
112
mit
7
Probabilistic data structures in python http://pyprobables.readthedocs.io/en/latest/index.html
python bitarray data-mining probability bloom-filter data-science cuckoo-filter data-analysis heavy-hitters datastructures data-structures quotient-filter count-min-sketch stream-threshold count-mean-sketch count-mean-min-sketch counting-bloom-filter counting-cuckoo-filter probabilistic-programming
Created 2017-07-08
145 commits to master branch, last one a day ago