madroidmaq / mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

Date Created 2024-11-05 (3 months ago)
Commits 131 (last one 19 days ago)
Stargazers 258 (3 this week)
Watchers 6 (0 this week)
Forks 15
License unknown
Ranking

RepositoryStats indexes 619,774 repositories, of these madroidmaq/mlx-omni-server is ranked #154,695 (75th percentile) for total stargazers, and #304,012 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #27,368/125,413.

madroidmaq/mlx-omni-server is also tagged with popular topics, for these it's ranked: openai (#769/2411),  tools (#358/948),  tts (#200/525),  openai-api (#119/519)

Other Information

madroidmaq/mlx-omni-server has 1 open pull request on Github, 5 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 5 open issues and 11 closed issues.

There have been 7 releases, the latest one was published on 2025-02-05 (19 days ago) with the name v0.3.2.

Star History

Github stargazers over time

300300250250200200150150100100505000Dec '24Dec '2410 Dec10 Dec20 Dec20 DecJan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 Feb

Watcher History

Github watchers over time, collection started in '23

8877665544332210 Dec10 Dec20 Dec20 DecJan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 Feb

Recent Commit History

131 commits on the default branch (main) since jan '22

14014012012010010080806060404020200015 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Yearly Commits

Commits to the default branch (main) per year

12012010010080806060404020200020242024

Issue History

Total Issues
Open Issues
Closed Issues
1616141412121010886644220010 Dec10 Dec20 Dec20 DecJan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 Feb

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-02-24 @ 03:50pm, id: 883682853 / R_kgDONKvuJQ