Repository · GitHub

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Owner	jundot
License (as declared)	Apache-2.0
Stars	22,811
Forks	2,022
Main language	Python
Created	13 February 2026
Last updated at source	15 October 2026

pythonapple-siliconinference-serverllmmacosmlxopenai-api

Embed this entry

<iframe src="https://silytics.si/embed/item/bb5a7620-e915-42a4-9925-691a9d0b46d3" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.