phospho-app / fastassert

Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.

Date Created 2024-02-13 (7 months ago)

Commits 20 (last one 7 months ago)

Stargazers 28 (0 this week)

Watchers 3 (0 this week)

Forks 0

License unknown

Ranking

RepositoryStats indexes 565,279 repositories, of these phospho-app/fastassert is ranked #550,351 (3rd percentile) for total stargazers, and #413,827 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #15,593/16,285.

phospho-app/fastassert is also tagged with popular topics, for these it's ranked: docker (#5,959/6049), llm (#2,304/2462), llm-inference (#137/141)

Other Information

Homepage URL: https://phospho.ai

All Topics

llm vllm docker outlines llm-inference

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

20 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The primary language is Jupyter Notebook but there's also others...

updated: 2024-08-06 @ 10:12am, id: 756670424 / R_kgDOLRnf2A