Sign inGet started
Repository · GitHub

ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

OwnerModelCloud
Stars1,274
Forks211
Main languagePython
Created17 June 2024
Last updated at source17 October 2026
pythongptqoptimumpeftquantizationsglangtransformersvllm
Embed this entry
<iframe src="https://silytics.si/embed/item/822a665f-9bc3-40de-b431-4f81f0dd2ab6" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Stars, last 3 days

1,274 now. Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.