Skip to content
Bud's Wiki

RL Environment Platforms

TL;DR

Section titled “TL;DR”

Across the recent filings, “RL environment” has become a packaged, distributable artifact — a Docker-bootstrapped backend + per-task verifier + standardized agent-interaction interface — rather than a per-project research scaffold. The three filed instances span a clear scale gradient: SETA ships ~400 Terminal-Bench-compatible tasks as a single-repo synthesizer, Toolathlon-GYM ships 503 MCP/PostgreSQL enterprise-workflow tasks as a Docker Compose stack, and OpenReward ships 330+ environments × 4.5M+ tasks behind a managed API governed by the Open Reward Standard (ORS, an MCP extension). The unifying bet: standardize the env↔trainer interface, decouple env compute from training compute, and the “scrape-domain-Q&A → auto-generate verifiable tasks → GRPO” pipeline becomes plug-and-play across domains.

Key claims

Section titled “Key claims”

Recent contributions

Section titled “Recent contributions”
  • [2026-08-31] Microduck Sim 2 Real: Microduck Sim2Real demo montage — real-robot behaviors (walking, standup, forward-roll, roller-skating) trained end-to-end via the microduck_rl mjlab + PPO stack, validating the BAM-actuator + DR sim2real recipe on sub-1 kg humanoid hardware.
  • [2026-08-31] Microduck RL — RL training environments for a ~800 g open-source bipedal robot: Microduck RL — Pollen Robotics releases a full mjlab (MuJoCo Warp) + PPO training stack for a ~800 g, 14-servo open-source biped, with 13 task families (walking, fall recovery, standup, roulade, ball-kick, roller-skating variants) sharing a 61-dim observation contract for runtime policy hot-swapping.
  • [2026-08-29] Inspect Robots — An Open-Source Evaluation Framework for Physical AI (Robocurve): Inspect Robots (Robocurve, MIT) formally open-sources the harness code underneath the three prior Chooi/Robocurve real-hardware tweets (Claude Opus 5 driving robot arms zero-shot via Inspect Robots (Jay Chooi / Robocurve), Gemini Robotics-ER 2 vs Claude Opus 5 clapboard eval — ER2 threw robot arms off table, hallucinated success (Robocurve / Jay Chooi), Gemini 3.7 Flash saturates Robocurve physical tool-use benchmark at 92% vs 32% for 3.6 Flash (three weeks apart)), with Robocurve itself announced as a Public Benefit Corporation the same day. Explicitly modeled on Inspect AI’s LLM eval harness: Task = scenes + controller + scorer, plugin-registered Policy × Embodiment two-slot inputs with fail-fast compatibility check before actuation, immutable schema-versioned EvalLog per run with .rrd Rerun stream attached. Six real-robot embodiment plugins ship on day one (YAM, Franka FR3/Panda, AgiBot A2, Unitree G1, SO-ARM100/101, WidowX 250S) plus Isaac Lab, ROS-bridge, and a dependency-free CubePick mock; policy plugins cover 40+ XPolicyLab-served VLAs, frontier LLMs via --policy agent, and CaP-X code-as-policy (SAM3 + Contact-GraspNet + Pyroki). First filed open-sourced substrate in this cluster whose target is real hardware, complementing SETA (terminal), Toolathlon-GYM (MCP workflows), and OpenReward (managed service).
  • [2026-08-28] LeRobot demos Claude Code operating SO-ARM101 zero-shot via Anthropic MHS — self-calibration to 4.1mm accuracy: LeRobot ships SO-ARM101 as an MHS driver for Claude Code — hardware exposed with read/write primitives + natural-language tags, promised open-source release forthcoming; a shipping-side counterpart to benchmark harnesses like Robocurve.
  • [2026-08-27] CARGO: Physical AI for Industrial Package Stacking: CARGO relies on a proprietary microsecond-per-step 3D bin-packing simulator that validates stability + hardware feasibility inline; treated as the load-bearing scaling axis (40M actions per run), a datapoint that task-specific analytic sims can still be a competitive substrate against general-purpose engines when the task is narrow.
  • [2026-08-27] Previewing the Model Hardware Standard: Anthropic’s Model Hardware Standard (MHS) research preview generalizes the “packaged, distributable agent-interaction interface” pattern from digital eval environments to physical hardware — a model-agnostic, harness-agnostic driver spec with read/write primitives, natural-language device tags, and MCP/CLI/API access surfaces for lab instruments and manufacturing equipment; deployment protocol rather than benchmark, but shares the “standardized interface as the substrate that unlocks agent operation” thesis with Toolathlon-GYM, OpenReward, OSGym, and DimOS.
  • [2026-08-27] Navigator n2: Frontier Computer Use at a Fraction of the Cost: Yutori’s private computer-use environment fleet (>10,000 tasks across hundreds of applications, spanning Linux/macOS/Windows) is the closed-source frontier analog to OSGym’s open OS-replica infrastructure — same design principle (full-desktop replicas with per-task programmatic or LLM-rubric verifiers), but with continuous curriculum refresh where solved tasks demote from RL to SFT and newly surfaced failure modes promote from SFT to RL. Ships a 27B model with OSWorld-Verified 85.3 as evidence the private-fleet + recursive-data-generation recipe reaches frontier at this parameter scale.
  • [2026-08-27] Project SuperDex — A unified simulation platform for dexterous manipulation: Project SuperDex (Meta) is a four-layer open-source dexterous-manipulation simulator (Physics / Robotics / Studio / Lab) with a Gymnasium-compatible RL interface and Ray/RLlib integration in early preview — Meta’s entry into the same design space Genesis World and Isaac Lab occupy, differentiated by a nonlinear-optimization solver shared across forward dynamics and IK, and a Studio authoring tool with SolidWorks/NX CAD-exporter plugins. Landing page only; no benchmarks, throughput numbers, or code links surfaced.
  • [2026-08-20] Binh ports PhysX to AMD Radeon and wins the global AMD robotics hackathon: First filed datapoint that the CUDA-only PhysX GPU solver — the rigid-body core underneath ManiSkill / Isaac Gym / Isaac Lab, i.e. essentially every GPU-physics RL platform on this page — can be ported to AMD Radeon inside a hackathon timeframe. ManiSkill Franka PushCube on W7900 reaches 67,320 steps/s vs 110,705 on RTX5090 at 4096 parallel envs (1.67× gap, attributed to the 5090’s 2× memory bandwidth), and the SO-Frame Sim2Real pipeline reproduces end-to-end with successful real-rig transfer. Won the AMD Radeon 2026-07 robotics hackathon (Track 3). Not yet a third-party-replicated result, but suggests env-compute fleets don’t have to remain homogenous NVIDIA — relevant to the “decouple env compute from training compute” cost model.
  • [2026-08-18] Gemini 3.7 Flash saturates Robocurve physical tool-use benchmark at 92% vs 32% for 3.6 Flash (three weeks apart): Third Inspect Robots real-hardware eval from Robocurve — Gemini 3.7 Flash vs 3.6 Flash on a “cover a block with a towel” task, 5 rollouts each, 0-100 partial-credit rubric. 3.7 averages 92 (4/5 perfect) vs 3.6’s 32 (0-50 range), with per-turn latency halving (17.5 s → 9.0 s). First filed external quantitative measurement of a 3-week frontier-LLM API refresh delivering a real embodied-capability jump, and the moving-target counterpoint to the July 31 ER-2 clapboard failure.
  • [2026-08-10] SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulation: SimToolReal shows procedural sim generation (handle + head cylinder/cuboid primitives with randomized dimensions and independent densities) is a sufficient training substrate for zero-shot real-world dexterous transfer, when paired with SAPG (population-based PPO variant to escape exploration bottlenecks in massively parallel sim) and asymmetric actor-critic. Also releases DexToolBench: 24 tool-use tasks × 12 tools × 6 categories with paired RGB-D videos and digital-twin sim environments.
  • [2026-08-08] AI Sapiens Open Source — ROBOTIS Docs Directory: ROBOTIS’s AI Sapiens docs page names cyclo_lab as the sim + reinforcement-learning entry point for policy training on the K1 humanoid, alongside URDF and MuJoCo robot-description assets.
  • [2026-08-07] Cyclo — ROBOTIS Open-Source Modular Physical AI Framework: CYCLO’s cyclo_lab sub-module is ROBOTIS’s simulation + reinforcement learning layer inside the broader Cyclo Physical AI framework — a hardware-vendor-owned sim/RL environment that targets the same actuator + robot line the deployment stack (cyclo_control) runs on, keeping sim and real-hardware interfaces aligned by construction rather than by post-hoc integration.
  • [2026-08-06] VISTA: A Visual Harness for Reasoning in an Interactive World: Third filed harness-uplift datapoint on ARC-AGI-3 (after Schema and OpenAI’s Responses-API blog): Opus 5.0 driving VISTA reaches 100.00 mean RHAE on the 25-game public set, self-reported. Sharpens the verifier-cheap / action-expensive design assumption of the benchmark: VISTA never builds a verifier — it just makes read-only inspection of past frames free under the scoring protocol, and that alone (plus free-form language reasoning) suffices to move Claude Opus 5.0 from the ~30% ARC-Prize-protocol baseline to a perfect public-set score. Self-reported, no semi-private / private measurement.
  • [2026-08-04] Assemble Benchmark — DAgger with Code-as-Policy (HUD.ai): HUD.ai’s Assemble blog post announces a code-as-policy training recipe on the HUD managed RL-environment platform that reportedly applies DAgger (expert relabels states the student visits) rather than the GRPO/PPO recipes dominant across the other filed platforms — the first filed datapoint in this cluster using imitation-with-aggregation instead of outcome-verified RL. Filed from a Slack pointer without full content retrieval (429 at ingest); a /bud refresh is warranted once the article is reachable.
  • [2026-08-04] AgentOmnia: Scaling Agentic Models for Full-Scenario Applications: AgentOmnia ships 5,018 stateful environments with 255,375 tools tied to program/solver/verifier correctness signals — env infrastructure fully in-house rather than shipped as a public package, wired directly into a Difficulty × Capability curriculum.
  • [2026-08-03] Robot-eval-bench: Benchmarking Task Success Evaluation for VLMs: Kite ML’s Robot-eval-bench positions the auto-eval-in-simulation loop (generate varied worlds → run policy → VLM judge scores every rollout) as the alternative to human-with-spreadsheet real-hardware grading, and quantifies which frontier VLMs make trustworthy judges — data, code, ground truth, cost model open-sourced.
  • [2026-07-31] Gemini Robotics-ER 2 vs Claude Opus 5 clapboard eval — ER2 threw robot arms off table, hallucinated success (Robocurve / Jay Chooi): Second Inspect Robots eval from Robocurve — head-to-head Gemini Robotics-ER 2 vs Claude Opus 5 on a YAM-arm clapboard task, 5 rollouts per model, binary success + qualitative failure-mode labels (hallucinated success, hardware damage). Establishes the per-rollout video-diagnostic format for the real-hardware slot in the env-as-package cluster and produces the first filed neutral-third-party number on Gemini Robotics-ER 2 specifically.
  • [2026-07-29] Tacmap: Bridging the Tactile Sim-to-Real Gap via Geometry-Consistent Penetration Depth Map: Tacmap (Sharpa + HKUST + NVIDIA) extends the tactile-front-end category alongside Tactile Genesis: Exploring Tactile Sensors at Scale for Learning Dexterous Tasks but bets on a single-abstraction commitment: geometry-consistent penetration-depth (“deform map”) computed by GPU ray-casting inside Isaac Lab’s Raycaster API (and MuJoCo’s mjray) at RL-relevant parallelism — memory scales near-linearly to 8,192 parallel envs and enabling tactile rendering yields negligible throughput hit, because the ray-cast pipeline is vectorised alongside the physics step rather than run as a separate FEM stage. Sim-to-real closed by a ResNet encoder-decoder that inverts real tactile images back into the same geometric quantity, validated by zero-shot PPO transfer of an in-hand rotation policy to the SharpaWave hand. Adds the “commit to one geometric abstraction and align both domains to it” design axis to the tactile-simulator sub-cluster, complementing Tactile Genesis’s “expose eight abstractions under a common interface” bet.
  • [2026-07-29] Netherite — Minecraft 1.11.2 rewritten in C/CUDA, bit-verified against Java, 7,200 parallel worlds on one GPU: Netherite (Elliot Arledge) opens a new axis in this cluster — collapse action cost by rewriting the simulator against the training hardware rather than eating it as Docker sandboxes (SETA / Toolathlon-GYM) or offloading to a separate GPU pool (Anyscale + Isaac Lab). A C + CUDA reimplementation of Minecraft 1.11.2 with bit-exact CPU↔CUDA ticks, 23/23 input-tape replay against Java Minecraft, 3.0M env-ticks/s at N=8192 batched worlds, and a stripped 64×36 block-ID observation for training; positioning is explicitly “train here, replay in Java, get the same result.” Same design bet as Genesis World — Simulation platform for general-purpose robotics & embodied AI learning made for robotics, applied to Minecraft — and the throughput substrate the sibling Pantograph introduces Pan-1 — Minecraft model with RL-based pretraining, arguing video games are the right testbed for robotics Pan-1 argument was implicitly asking for. Systems numbers are self-reported and no third-party replay exists yet.
  • [2026-07-29] 3 Billion Expert Transitions Across 11 Million Physics-Based Tasks (Kinetix-Offline): Kinetix-Offline (FLAIR / Oxford) extends the env-as-package pattern with a pre-computed offline data substrate at unprecedented scale: 3B expert transitions across 11M procedurally-generated 2D physics tasks (326 GB), collected via per-level PPO specialists that save only successful trajectories. Raw environment state is stored rather than pre-rendered frames, so downstream training swaps observation modality (pixel vs symbolic) and can restart evaluation from any point in a trajectory. First filed instance in this cluster whose distinguishing contribution is the offline dataset, not the sim or the verifier.
  • [2026-07-29] WorldModelGym: a decision-based fidelity benchmark for world models: WorldModelGym (Reka Labs) extends the env-as-package pattern to learned world models as the thing being scored: a Gymnasium-contract step extension where the environment adapter is the submitted model (JEPA latents / tokens / pixel video-diffusion states all opaque to the evaluator), and 100+ declarative-file tracks across Atari / Meta-World / DMC / classic control. Verifier-cheap / action-expensive design inverted from the usual pattern — action cost here is the WFM’s own rollout compute, not Docker sandbox setup — and open-loop multiple-choice ranking replaces full-horizon rollouts to keep pixel WFMs tractable. First filed platform that puts learned world models behind the Gymnasium contract rather than using simulators to train/evaluate policies.
  • [2026-07-28] CausalGame: Benchmarking Causal Thinking of LLM Agents in Games: CausalGame extends the env-as-package pattern to causal-reasoning diagnosis of AI-Scientist agents: 14 game scenarios with hard-coded ground-truth causal DAGs plus injected selection bias / measurement error / hidden confounders, so both the analytical optimum and the process-level rubric are automatically computable. Differs from Toolathlon-GYM / SETA / OpenReward on grading axis: outcome (“survival”) + explicit process rubric on the agent’s causal explanation, not just end-to-end task completion. Reported 5–7% rubric credit across 30 models is the first filed process-grade result on this kind of platform.
  • [2026-07-27] RoboLab — Task-Based Evaluation Benchmark for Robot Manipulation Policies on Isaac Lab (NVLabs): RoboLab (NVLabs, RSS 2026 — Yang, Dagli, Zook, Hadfield, Goyal, Birchfield, Ramos, Tremblay) extends the env-as-package pattern to embodiment-agnostic Isaac Lab manipulation: 120 initial tasks (RoboLab-120) spanning pick-and-place, stacking, rearrangement, and tool use, each with language instructions and automated success/failure detection via composable predicates. Tasks are not tied to a specific robot arm (any IsaacLab-compatible robot plugs in), the policy under test runs as a separate HTTP inference server the eval client calls each step, and two Claude Code skills (/robolab-scenegen, /robolab-taskgen) generate new scenes and tasks from natural language. Ships a self-contained web dashboard for cross-experiment comparison and video replay. Reported throughput ~30 GPU-hours per 100 tasks (Sid’s Slack context confirms 4-5 hours per VLA checkpoint on the full 120-task set). Complements the sim + real RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies and the kitchen-domain RoboCasa365 — Large-Scale Simulation of Everyday Tasks for Generalist Robots as the third Isaac-family sim-eval leaderboard filed this year — RoboLab’s differentiator is embodiment-agnostic tasks + AI-authored extension of the task library.
  • [2026-07-27] RW-RL Dataset: Real-World Reinforcement Learning for Robots: RW-RL Dataset ships the offline data-substrate half of the SJTU MINT + Boden + Junpu real-world RL platform, paired with Evo-RL: Open Real-World Offline RL on SO-101 and AgileX PiPER as the online loop — a real-robot data infrastructure stack (BRIC Robo / BASE Omni / Blink) plus a validation loop where autonomous rollouts feed back for the next policy iteration. Concrete counterpart to the sim-first RL environments on this page for RECAP-style on-hardware training.
  • [2026-07-25] Claude Opus 5 driving robot arms zero-shot via Inspect Robots (Jay Chooi / Robocurve): Inspect Robots (Robocurve, MIT) extends the env-as-package / evaluation-harness pattern from terminal (SETA), enterprise-workflow (Toolathlon-GYM), and managed sandboxes (OpenReward) to real hardware for VLA / physical-AI models; announcement tweet demonstrates Claude Opus 5 zero-shot on two tabletop manipulation tasks with a promised frontier-LLM-vs-VLA report to follow.
  • [2026-07-22] LeRobot Sim-to-Real Tutorial — 72% real-SO-100 success from LuckyEngine sim demos only: LuckyEngine (MuJoCo + Vulkan, C# scene scripts, Python gRPC SDK) paired with Genesis as a sim-to-sim generalization probe — a two-simulator workflow where the second sim serves as a cheap real-world proxy before touching hardware.
  • [2026-07-20] Danfei Xu — two root-level paradigm shifts in robot learning: Sim2Real for locomotion, Behavior Cloning for manipulation: Danfei Xu casts Sim2Real (for locomotion) as one of only two root-level paradigm shifts of the deep-learning era in robot learning — an implicit endorsement of simulator platforms as the load-bearing substrate for that sub-field.
  • [2026-07-16] Schema — Frontier Models with Our Harness Achieve ~99% on ARC-AGI-3 Public: Schema is the first filed harness result on ARC-AGI-3 (the concept’s most demanding filed environment): self-reported 98.98% Public RHAE with Opus 4.8 / Fable 5 fallback versus 42.83% for the same pair under unconstrained Claude Code, isolating a 56.15% harness effect. Sharpens the verifier-cheap / action-expensive design pattern: here the learned world-model program is the verifier and BFS inside it substitutes for environment actions; residual failures are 5-6 games where representation discovery, not verification, is the bottleneck.
  • [2026-07-15] Pantograph introduces Pan-1 — Minecraft model with RL-based pretraining, arguing video games are the right testbed for robotics: Pantograph explicitly argues Minecraft-class video games are the right RL testbed for robotics methods (reproducible / safe / open-ended / long-horizon) — treating game environments as first-class robotics-adjacent RL platforms rather than just eval curiosities. Product-tweet framing; Pan-1 launch is the first datapoint attached to this argument on the wiki.
  • [2026-07-14] Tactile Genesis: Exploring Tactile Sensors at Scale for Learning Dexterous Tasks: Tactile Genesis (Chung et al.; NSF/DARPA/Amazon/CMU/Google-supported) extends the env-as-package pattern with a tactile front-end integrated into Genesis World — 8 sensor abstractions (contact / depth / kinematic force-torque / elastomer / proximity / temperature / audio) under one interface, 20,000+ parallel envs and 1,000+ taxels on a single GPU, 3-20× throughput over TacSL / Tacmap / HydroShear / FOTS. Turns “sensor hardware ablation” from a hardware-swap-per-lab problem into an in-simulator sweep, and validates the resulting placement-over-type design directive with sim-to-real transfer on a real XHand1.
  • [2026-07-14] How Claude Performs on Robotics Tasks: Anthropic assembles a mixed sim-and-real evaluation harness on top of Mujoco (classic control + Go2/G1 locomotion), LIBERO kitchen scenes (direct + VLA-supervised manipulation), and a physical Unitree Go2 for real-world navigation. Introduces TwinFlipper as a novel chaotic-dynamics classic-control task explicitly designed to avoid pretraining-corpus contamination (unlike inverse pendulum and hopper), and an eleven-task Go2 navigation suite with self-monitoring probes (drift_detection: notice commands are being silently corrupted; explore_report: answer layout questions from memory). Sim runs are paused between LLM calls to approximate an upper bound on capability by removing real-time latency — the paper quantifies the gap: ~83 Hz needed vs 0.2–0.4 Hz non-reasoning inference, roughly two orders of magnitude. Complements the packaged-env pattern (SETA, Toolathlon-GYM, RoboCasa365, RoboDojo) with a frontier-lab safety-evaluation framing where the environment is instrumented specifically to measure LLM-as-controller capability trends across model generations.
  • [2026-07-14] GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Tasks: GaP (Berkeley/NVIDIA/CMU; Goldberg, Fan, Zhu) extends the CaP-Gym env-as-package pattern with a parameterized simulator that spins up per-candidate-graph instances for parallel rehearsal, with pre/post-node state and contact feedback logged at every node boundary for failure localization. Ships 8 new Variational Automation benchmarks (4 sim, 4 real — grocery fulfillment, grocery packing, popcorn, USB-C insertion, bimanual crate washing) explicitly designed with larger pose/geometry variation than LIBERO/LIBERO-Pro; the sim table pairs each benchmark with per-instance randomization of object poses and arrangements.
  • [2026-07-14] ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory: EmbodiedWorldBench (companion benchmark to ABot-AgentOS, Alibaba): 16 indoor/outdoor/hybrid scenes × 4 difficulty levels × 200+ tasks spanning navigation, object search, NPC dialogue, dynamic events, with trace-grounded scoring rather than terminal-state scoring — targeted at long-horizon embodied agent OS evaluation.
  • [2026-07-09] RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies: RoboDojo (HKU MMLAB + Berkeley) unifies the sim and real halves of the env-platform pattern: 42 Isaac Sim tasks partitioned across 5 capability dimensions (generalization, memory, precision, long-horizon, open-vocab) plus 18 real tasks on cloud-remote standardized hardware (RoboDojo-RealEval), with XPolicyLab as a common policy-integration layer; ships a public leaderboard from a 30-policy sweep — the largest filed policy pool on a single manipulation benchmark, complementing RoboArena’s real-only crowd-sourced protocol and RoboCasa365’s sim-only kitchen suite.
  • [2026-07-05] Agent² RL-Bench: Can LLM Agents Engineer Agentic RL Post-Training?: Uses ALFWorld / WebShop / DeepSearchQA as packaged environment substrates but flips the evaluated agent: instead of measuring an RL-trained policy inside the env (the concept’s usual pattern), it measures whether a CLI coding agent can engineer the training pipeline (data, rewards, rollout collection, GRPO/DPO/PPO code) that would produce such a policy. Behavioral instrumentation records every submission and code revision inside the workspace — adds a “how the agent constructed the pipeline” observability layer on top of the standard verifier-cheap / action-expensive env-as-package design.
  • [2026-07-04] RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation: RoboWorld turns a single real initial frame into an interactive neural simulator and runs closed-loop VLA policy evaluation with no simulator engineering or asset creation, including eight extreme unseen-scene variants of RoboArena episodes.
  • [2026-07-01] Scale Robot Policy Evaluation with Ray (Distributed Sim-Eval on Anyscale): Anyscale’s engineering post lays out a Ray + Anyscale reference architecture for large-scale robot-policy evaluation: policy (GR00T-N1.7-3B) as an autoscaling Ray Serve deployment on one GPU pool, Isaac Lab simulators as isolated Ray tasks on a separate GPU pool, HTTP boundary between them, action-chunk amortization (action_horizon = 8 steps per ~1.6 s inference) across the hop; standardizes the rollout runtime the way SETA/Toolathlon-GYM/OpenReward standardize the task side and RoboArena/RoboCasa365/Genesis standardize the evaluation substrate — same verifier-cheap/action-expensive design principle where action cost is GPU physics + rendering rather than Docker sandbox setup.
  • [2026-06-30] ASPIRE — self-evolving sensorimotor skill library that compounds across robots and the sim-to-real gap (Jim Fan / NVIDIA GEAR): Jim Fan announces NVIDIA GEAR’s ASPIRE — a sim+real co-training setup where coding agents run evolutionary search over control programs against multimodal sensory traces from both simulated and real robots, with successful programs distilled into a self-evolving code skill library. Full stack promised as open-source alongside a gallery of 150+ tasks and 90+ self-taught skills.
  • [2026-06-29] CHORD: Object-Centric Contact Wrench Guidance for Dexterous Manipulation: CHORD ships a 4,739-task simulation-ready bimanual dexterous manipulation benchmark constructed from mocap datasets and reconstructed in-house human videos, paired with the demonstrations themselves — the largest filed dexterous-RL task surface and a direct answer to the “where do dexterous RL environments come from at scale” gap.
  • [2026-06-29] SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluation: SimFoundry reconstructs deployable simulation environments from a single video, with cousin-style automated augmentation along object / scene / task axes — a user-supplied real scene → on-demand parameterized sim environment pattern complementing RoboCasa’s fixed kitchen-task benchmark and Genesis World’s general-purpose simulator.
  • [2026-06-24] Qwen-AgentWorld: Language World Models for General Agents: Qwen-AgentWorld is the strongest filed counter-bet to the env-as-package design pattern: instead of shipping environments as Docker stacks (SETA, Toolathlon-GYM) or managed services (OpenReward) or synthesizing executable SQL-backed environments (AWM), train a single MoE LLM (35B-A3B / 397B-A17B) to simulate environment dynamics across 7 agentic domains via long CoT reasoning. Reports that this simulator scales to thousands of environments controllably and yields agentic-RL gains exceeding real-environment training alone. Inverts the verifier-cheap / action-expensive assumption: when the simulator is a learned model, both verifier and action become cheap inference passes.
  • [2026-06-20] Playful Agentic Robot Learning: RATs reuses LIBERO-PRO and MolmoSpaces (the same env-as-package artifacts CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation benchmarks against) but flips the role: the env is now a play substrate for skill-library acquisition rather than a downstream evaluator. Verifier-cheap + action-expensive design extends to a setting where rollouts are exploratory and the verifier scores intermediate progress, not just final task success — adds a new use-case axis (skill discovery) alongside policy-fitting and evaluation.
  • [2026-06-17] ABC: Scalable Behavior Cloning with Open Data, Training, and Evaluation: ABC Sim extends the env-as-evaluation-substrate pattern (Genesis World, RoboCasa365) to bimanual manipulation: MuJoCo physics + an offline Blender re-rendering pipeline for higher-fidelity ray-traced frames, 400h of sim-teleop across 20 tasks. Headline contribution to this cluster is a quantified sim-real correlation study across 12 paired checkpoints (r=0.85 strict success, r=0.91 task progress) — the second filed datapoint after Genesis (Pearson 0.8996) supporting the “use sim purely as cheap eval, decouple from training” thesis.
  • [2026-06-16] ENPIRE: Agentic Robot Policy Self-Improvement in the Real World: ENPIRE extends the verifier-cheap / action-expensive env-as-package pattern from terminal and enterprise-workflow surfaces to physical manipulation: each task is wrapped as self-resetting (randomized initial state + reset behavior + verification of reset success) and self-verifying (multi-camera detector + segmentation fused into a binary reward), with the auto-reset + multi-camera verifier playing the role the Docker sandbox plays in SETA / Toolathlon-GYM; also supplies simulation evaluation in RoboCasa as the parallel sim track.
  • [2026-06-14] LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World: LEGS is a hybrid MuJoCo + 3DGS simulator with a procedural Walk → Pick → Place motion-primitive generator that emits verified-success-only labeled demonstrations — a humanoid-loco-manipulation analog to RoboCasa365’s auto-trajectory pipeline but with photorealistic 3DGS backgrounds replacing meshed kitchens.
  • [2026-06-14] RoboArena rolls back evaluations after benchmark hacking observed since April (Pranav Atreya announcement): First filed integrity-attack datapoint on any platform in this cluster — RoboArena lead author Pranav Atreya publicly announces that benchmark hacking has been observed on RoboArena since April 2026, that mitigations are now in place, and that affected evaluations (including, per the Slack pointer, NVIDIA’s Cosmos) have been rolled back; the §3 “robustness against single-actor manipulation” property of RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies survived only because the maintainer team detected the attack out-of-band, not because the protocol caught it automatically.
  • [2026-06-08] RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies: RoboArena (CoRL 2025) is the real-world / human-evaluator counterpoint to the standardized env-as-package pattern — instead of a fixed task set with an automatic verifier, evaluation is crowd-sourced across seven academic institutions on the DROID platform, with double-blind pairwise A/B comparisons aggregated by a task-aware Bradley-Terry extension; a 1:1 evaluation-credit system balances supply and demand. At matched episode budget across 612 paired comparisons over 7 generalist DROID policies, the crowd-sourced ranking matches a 4,284-episode oracle ranking more accurately than the conventional centralized 17-task DROID protocol — direct evidence that the “verifier-cheap, action-expensive” design assumption (Docker sandbox + unit tests) breaks for embodied generalist policies where the deeper signal lives in unstandardized real-world conditions a human judge can resolve.
  • [2026-06-08] RoboCasa365 — Large-Scale Simulation of Everyday Tasks for Generalist Robots: RoboCasa365 — ICLR 2026 release of a kitchen-domain manipulation env platform with 365 LLM-authored tasks, 2,500+ scenes, 3,200+ objects, and 2,200+ hours of human+auto demos. First filed manipulation-specific entry in the env-as-package pattern, with built-in Diffusion Policy / pi0 / GR00T baselines and a public leaderboard. The 600h-human + 1,600h-auto demo split mirrors SETA’s frontier-synthesizes-tasks pattern on the trajectory side.
  • [2026-06-03] Project Chrono — Open-Source Multi-Physics Simulation Engine: Project Chrono — long-running open-source multi-physics simulator covering rigid-body, FEM, granular, fluid-solid, and ODE dynamics with a ROS2-integrated camera/LiDAR/GPS/IMU/SPAD sensor suite. Predates the recent wave of pip-installable robotics platforms and is the closest C++ analog to Genesis World.
  • [2026-06-01] Genesis World — Simulation platform for general-purpose robotics & embodied AI learning: Open-source physical-robotics environment platform (Apache 2.0): unified multi-physics scene API + multi-embodiment support (Franka, Go2, humanoid, drones), heterogeneous parallel simulation, broad sensor suite (RGB, depth, lidar, tactile, IMU, contact, temperature). First filed RL env platform whose underlying simulator is itself a research artifact, not a thin wrapper around an existing engine.
  • [2026-06-01] The Role of Simulation in Scalable Robotics, Genesis World 1.0, and the Path Forward: Genesis World 1.0 extends the env-as-package pattern to physical robotics — Apache 2.0 stack (physics + renderer + compiler) framed primarily as the evaluation substrate, with sim-to-real correlation (Pearson 0.8996) as the trust metric and a perturbation-axis taxonomy (visual/behavioral/semantic) replacing scalar success rates. Where the existing terminal/coding env entries are verifier-cheap + action-expensive via Docker, Genesis is verifier-cheap + action-expensive via full multi-physics + path-tracing.
  • [2026-05-27] stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation: stable-worldmodel — extends the env-as-package pattern from terminal/coding agents to world-model research: bundled environments with controllable visual / geometric / physical factors of variation, plus a Lance-based data layer with LeRobot ingestion. First filed instance applying the standardized-env+verifier discipline to the WFM evaluation surface rather than to RL training.
  • [2026-05-23] OpenReward — 330+ RL Environments through one API (General Reasoning announcement): OpenReward launches as the first managed-platform datapoint — 330+ environments × 4.5M+ tasks behind an HTTP API, ORS protocol extending MCP with RL primitives, autoscaled sandbox compute provisioned per rollout, trainer compatibility announced for Tinker / Miles / Slime. Turns “env-as-package” into “env-as-managed-service” and shifts the quality-control problem from per-env synthesizer to platform-level policing.
  • [2026-05-23] Toolathlon-GYM: Large-Scale Long-Horizon Environments for Tool-Use Agents: Toolathlon-GYM (Eigent.AI + HKUST-NLP + CAMEL-AI) — 503 long-horizon multi-MCP tasks with brand-obfuscated descriptions, 25 MCP servers, 8.2 MB PostgreSQL dump as shared mock backend. Adds the enterprise-workflow surface (Canvas LMS, Snowflake DW, WooCommerce, Yahoo Finance) to a space that previously held only terminal/shell.
  • [2026-05-22] SETA: Scaling Environments for Terminal Agents (env repo): SETA (CAMEL-AI + Eigent.AI + SambaNova) — ~400 Terminal-Bench-compatible tasks auto-synthesized by a Claude-Sonnet-4.5 two-agent factory and validated by Terminal-Bench’s own Oracle agent. First filed instance of the “env compute on a separate AWS fleet” pattern, and a +20.2% Qwen3-8B GRPO lift on the synthetic 260-task subset.

Open questions

Section titled “Open questions”
  • How does task quality scale with a federated, third-party-authored environment catalog (OpenReward) compared to a curated single-team release (SETA, Toolathlon-GYM)? No filed paper measures the quality-vs-scale curve.
  • Does the MCP/ORS abstraction actually let trainers drop a new env in without per-env special-casing, or does it leak enough that GRPO recipes still need env-specific reward shaping? Toolathlon-GYM ships uniform tools, OpenReward claims protocol-level uniformity, but neither reports a “trainer-agnostic” headline number.
  • What is the right granularity for “task” vs “environment”? OpenReward’s 4.5M tasks / 330 envs ratio (≈13.6K tasks/env) implies envs are parameterized task generators, not single tasks; SETA’s ~400 tasks live inside a single env; Toolathlon-GYM’s 503 tasks live across 25 MCP servers. The dataset-vs-env boundary is unclear in the filed material.
  • Where is the RL-recipe ceiling on this kind of training? SETA reports a +20.2% unit-test-pass-ratio lift on a small base (Qwen3-8B) over a small training set (260 tasks). Toolathlon-GYM is dataset-only at filing time. OpenReward is platform-only. No filed result yet pins down the asymptote.
  • How does the “frontier model synthesizes tasks, smaller model trains on them” recipe (SETA) interact with the “third-party authors author the env, anyone trains” recipe (OpenReward)? The two have different incentive structures for env quality and different attack surfaces for synthesizer-bias.
  • Are brand-obfuscated task descriptions (Toolathlon-GYM) sufficient to prevent shortcut behavior in agents that were pretrained on the un-obfuscated versions (Notion / Google Calendar / Snowflake docs)? No filed paper measures this.
  • Does the verifier-cheap-action-expensive design pattern have natural limits — i.e. is there a domain where verifier compute dominates action compute and these recipes invert? Image/video generation evaluation (where a learned reward model is the dominant cost) is the obvious candidate.

Papers

Section titled “Papers”

2026-05

Section titled “2026-05”

2026-04

Section titled “2026-04”

2026-03

Section titled “2026-03”

2026-01

Section titled “2026-01”

2025-12

Section titled “2025-12”

2025-11

Section titled “2025-11”

2025-02

Section titled “2025-02”