Sign inGet started
Repository · GitHub

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Ownerxorbitsai
License (as declared)Apache-2.0
Stars9,610
Forks877
Main languagePython
Created14 June 2023
Last updated at source14 October 2026
pythonartificial-intelligencedeploymentdiffusersgemmaglmglm-5-3inferencekimikimi-k3llama-cppllamacppllmmachine-learningopenai-apipytorchqwensglangtransformersvllmwhisper
Embed this entry
<iframe src="https://silytics.si/embed/item/89f1268f-b54f-41f5-9053-01158c781915" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from xorbitsai

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.