VectorInstitute / vector-inference

Efficient LLM inference on Slurm clusters using vLLM.

Date Created 2024-03-06 (about a year ago)
Commits 474 (last one 16 days ago)
Stargazers 55 (1 this week)
Watchers 6 (0 this week)
Forks 10
License mit
Ranking

RepositoryStats indexes 635,689 repositories, of these VectorInstitute/vector-inference is ranked #462,540 (27th percentile) for total stargazers, and #290,497 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #90,345/130,103.

VectorInstitute/vector-inference is also tagged with popular topics, for these it's ranked: llm (#2,574/3626),  inference (#263/332),  llm-inference (#156/203)

Other Information

VectorInstitute/vector-inference has 4 open pull requests on Github, 69 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 3 open issues and 4 closed issues.

There have been 12 releases, the latest one was published on 2025-03-20 (16 days ago) with the name v0.5.0.

Homepage URL: https://vectorinstitute.github.io/vector-inference/

Star History

Github stargazers over time

60605050404030302020101000May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Watcher History

Github watchers over time, collection started in '23

88887777776666Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Recent Commit History

474 commits on the default branch (main) since jan '22

500500450450400400350350300300250250200200150150100100505000Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Yearly Commits

Commits to the default branch (main) per year

25025020020015015010010050500020242024

Issue History

Total Issues
Open Issues
Closed Issues
7766554433221100Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Languages

The primary language is Python but there's also others...

PythonPythonShellShellDockerfileDockerfile

updated: 2025-04-04 @ 08:13pm, id: 767839751 / R_kgDOLcROBw