Sign inGet started
Dataset · Hugging Face

ftajwar/maxrl_qwen3_4B_base_polaris_rollouts

MaxRL Qwen3-4B-Base training rollouts (POLARIS math prompts) Every training rollout from an online RL run, with exact token ids, sampling log-probs, and raw rewards — usable as a replay buffer to study off-policy RL for LLM reasoning completely offline. The run: Qwen3-4B-Base trained with the maxRL advantage estimator (A = (r - mean)/(mean + eps), group mean over 16 rollouts per prompt; maxRL paper) and a pure REINFORCE loss (L = -A * log pi; no importance ratio, no clipping, no… See the full description on the dataset page: https://huggingface.co/datasets/ftajwar/maxrl_qwen3_4B_base_polaris_r

Author / organizationftajwar
License (as declared)apache-2.0
Downloads234 (as reported by Hugging Face)
Likes0
Created27 July 2026
Last updated at source27 July 2026
reinforcement-learningrlhfrlvrmathrolloutsreplay-bufferqwen3
Embed this entry
<iframe src="https://silytics.si/embed/item/8cdce8fe-383f-4f8a-a7e4-b24917a99370" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

234 now (-28 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from ftajwar

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.