_Envy_/Flux Dev Q5_K_M GGUF quantization (a nice balance of speed and quality in under 9 gigabytes)

NOTE: Ignore the model format listed! This is not an NF4 ONNX model, it is a Q5_K_M GGUF model. This is a GGUF of flux_dev quantized in Q5_K_M GGUF format that should provide a significant quality boost over 4-bit quantizations while being a lot smaller than the 8-bit version (and since it's a relatively small GGUF, load times should be significantly improved over FP8 as well). This model is ideal of mid-sized graphics cards, and in my tests (without any memory optimizations such as offloading t5 onto the CPU) fits comfortably in 16GB of VRAM, and may work on as low as 8GB (if you have under 1

<iframe src="https://silytics.si/embed/item/ce32eebb-af91-4913-9b87-d14e1bbbf326" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Civitai and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.