Repository · GitHub

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Owner	jmaczan
License (as declared)	Apache-2.0
Stars	1,153
Forks	98
Main language	C++
Created	9 February 2026
Last updated at source	24 September 2026

c++aiattentionbatchingcoursecppcudahpcinferencellmllm-inferencepagedattentiontiny-vllmvllm

Embed this entry

<iframe src="https://silytics.si/embed/item/cc75901b-90ff-41bb-9777-100bb498c3cf" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.