Repository · GitHub

bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Owner	bentoml
License (as declared)	Apache-2.0
Stars	12,559
Forks	859
Main language	Python
Created	19 April 2023
Last updated at source	12 October 2026

pythonbentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmopsmistralmlopsmodel-inferenceopen-source-llmopenllmvicuna

Embed this entry

<iframe src="https://silytics.si/embed/item/22013daf-ced1-4457-8fa4-c57b6a459c2f" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from bentoml

BentoMLRepository

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.