phospho-app / fastassert

Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.

Date Created 2024-02-13 (about a year ago)
Commits 20 (last one about a year ago)
Stargazers 27 (0 this week)
Watchers 3 (0 this week)
Forks 0
License unknown
Ranking

RepositoryStats indexes 617,630 repositories, of these phospho-app/fastassert is ranked #601,252 (3rd percentile) for total stargazers, and #433,764 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #17,704/18,409.

phospho-app/fastassert is also tagged with popular topics, for these it's ranked: docker (#6,391/6498),  llm (#3,106/3273),  llm-inference (#185/192)

Other Information

Homepage URL: https://phospho.ai

Star History

Github stargazers over time

303025252020151510105500Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Watcher History

Github watchers over time, collection started in '23

44443333332222May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Recent Commit History

20 commits on the default branch (main) since jan '22

2020181816161414121210108866442200Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Yearly Commits

Commits to the default branch (main) per year

202018181616141412121010886644220020242024

Issue History

No issues have been posted

Languages

The primary language is Jupyter Notebook but there's also others...

Jupyter NotebookJupyter NotebookPythonPythonDockerfileDockerfile

updated: 2024-11-15 @ 09:22pm, id: 756670424 / R_kgDOLRnf2A