---
title: RL
description: AI notes by Mrinaal Arora tagged "RL"
updated: 2026-04-29
canonical: https://aroramrinaal.com/ai/tags/rl
source: https://aroramrinaal.com/ai/tags/rl.md
alternate: https://aroramrinaal.com/ai/tags/rl/markdown
---

# RL

AI notes, small builds, and writeups by Mrinaal Arora tagged "RL".

- Page: https://aroramrinaal.com/ai/tags/rl
- Markdown: https://aroramrinaal.com/ai/tags/rl/markdown
- Markdown (.md): https://aroramrinaal.com/ai/tags/rl.md
- All tags: https://aroramrinaal.com/ai/tags/markdown
- Full AI index: https://aroramrinaal.com/ai/markdown
- Posts with this tag: 4 of 19

## Posts

- [CrisisOps: My (Final Round) OpenEnv Hackathon Project](https://aroramrinaal.com/ai/crisisops-openenv-hackathon-finale/markdown) — 2026-04-29; tags: RL. How I built CrisisOps for the OpenEnv hackathon finale, then trained a small model with GRPO using TRL, Unsloth, and Modal. [HTML](https://aroramrinaal.com/ai/crisisops-openenv-hackathon-finale)
- [My First Successful RL Training Run With OpenEnv And Wordle](https://aroramrinaal.com/ai/rl-training-openenv-environment/markdown) — 2026-04-02; tags: RL. A full fine-tune of Qwen3-1.7B on Wordle using OpenEnv, with a reward curve that actually went up and shaped rewards that taught real gameplay behavior. [HTML](https://aroramrinaal.com/ai/rl-training-openenv-environment)
- [My Second RL Experiment On Prime Intellect Lab](https://aroramrinaal.com/ai/second-rl-experiment-on-prime-intellect-lab/markdown) — 2026-03-25; tags: RL. My second RL experiment while studying GRPO: moving to Prime Intellect Lab, testing smaller and larger setups, and finally getting a reward curve that went up. [HTML](https://aroramrinaal.com/ai/second-rl-experiment-on-prime-intellect-lab)
- [First RL Experimental Project: RLVR Using GRPO With TRL On Modal](https://aroramrinaal.com/ai/first-rl-experimental-project/markdown) — 2026-03-23; tags: RL. My first ever RL experiment: RLVR on GSM8K using Hugging Face TRL, Qwen2.5 1.5B Instruct, and an NVIDIA H100 on Modal, with notes on where the reward function broke and what I want to fix in v2. [HTML](https://aroramrinaal.com/ai/first-rl-experimental-project)