4 results found Sort:

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models
Created 2023-10-26
21 commits to main branch, last one about a year ago
Superpipe - optimized LLM pipelines for structured data
Created 2024-02-07
99 commits to main branch, last one 10 months ago
Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.
Created 2024-04-22
26 commits to main branch, last one 4 months ago
2
42
unknown
2
Nadir is a Python package designed to dynamically choose the best llm for your prompt by balancing complexity and cost and response time.
Created 2025-01-23
53 commits to main branch, last one 2 months ago