abhijithneilabraham/longctx30

longctx30 Thirty long-context prompts for benchmarking LLM inference throughput. Each prompt is about 10,000 input tokens and asks for about 1,500 output tokens, which is long enough that decode time dominates and tokens per second is a meaningful number. Built for the article Learning inference: How to host and improve the token speed of an LLM, where it is the benchmark set for Gemma 4 31B on a single B300. The data and code the article uses are in this repository: file… See the full description on the dataset page: https://huggingface.co/datasets/abhijithneilabraham/longctx30.

<iframe src="https://silytics.si/embed/item/dd939040-d273-42ed-b9c5-08a69a3cf6de" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.