Podcast
Two-host audio conversations generated from the wiki’s pages — a quick way to catch up on research while away from the screen. Listen inline below, or subscribe in your podcast app with the feed URL.
Subscribe in Apple Podcasts / Overcast / Pocket Casts — add this feed URL:
https://podcast.lumalabs.link/27a25f51ea81d41a8253f46c6133a35e/feed.xml
- Two Paradigms That Actually Landed
Show notes
A framing tweet from Danfei Xu (Georgia Tech / NVIDIA) argues the deep-learning era of robot learning produced exactly two "root-level" paradigm shifts that stuck: Sim2Real for locomotion, and Behavior Cloning for manipulation. Maya and Ethan unpack why that split is a useful map, why the other contenders didn't take over, and what it means for those of us building image and video generative models. We're honest about the limits: only the opening tweet was retrievable, so this is about the framing, not a full argument. **Sources** - Danfei Xu — two root-level paradigm shifts in robot learning: Sim2Real for locomotion, Behavior Cloning for manipulation
Sources: tweet-danfeixu-2026-07-20 - Scaling Laws Come for the Humanoid
Show notes
This episode digs into ScaleBFM, a systematic scaling study for Behavior Foundation Models that control humanoid robots. We unpack the three coordinated levers — a global-frame motion-tracking paradigm, joint scaling of on-policy rollouts and heterogeneous motion diversity, and a Humanoid Transformer backbone — and what its 82% global-mode error reduction really tells us. Along the way we draw the obvious parallels for image and video generation: diversity beats volume, and architecture choices interact with the training objective. **Sources** - Scaling Behavior Foundation Model for Humanoid Robots
- Happy Oyster: Alibaba's Real-Time World Model, With Sound
Show notes
Alibaba Token Hub's "Happy Oyster" lands as a closed, real-time interactive world model — a continuous audio-video generation loop you steer with text, voice, or image while it renders. Maya and Ethan walk through the two exposed modes (Directing and Wandering), the only numbers on the page, and what a landing page can and can't tell you. We place it against Genie, HY-World, LingBot, and the omnimodal Cosmos line — and flag the two things that actually stand out. **Sources** - Happy Oyster — Real-Time World Model for Interactive Creation (Alibaba Token Hub)
- Cosmos 3 Edge: A World Model That Fits on the Robot
Show notes
NVIDIA's Cosmos 3 Edge is a 4-billion-parameter open world model that keeps the flagship's dual-tower autoregressive-plus-diffusion architecture but shrinks it to run on Jetson and RTX-class hardware. We unpack how it treats action as a first-class modality, what "policy mode" actually does, and the companion 4-step distillation that reportedly cuts diffusion inference up to 25 times. Then we ask the practitioner's question: is the "one shared backbone" bet real, or just tidy framing? **Sources** - Introducing Cosmos 3 Edge (blog) — Pranjali Joshi, Saeed Babamohamadi
- Chess as a Lab: How Pretraining Decides What RL Can Do
Show notes
A controlled end-to-end study that uses chess to untangle the pretraining, SFT, and RL pipeline. The headline: post-RL performance at a fixed RL budget is well-predicted by the base model's pretraining loss, and the slope of the RL reward curve scales roughly linearly with pretraining tokens. The authors also show RL does two different jobs — amplifying known-good moves on easy puzzles, surfacing near-absent correct moves on hard ones — and reproduce the scaling pattern on math-domain text. **Sources** - Understanding Reasoning from Pretraining to Post-Training (Shen, Li, Rahman, Sun, Goldblum, Telgarsky, Izmailov)
- Auditing the Data Before You Burn the Compute
Show notes
Brandon Ong of Hebbian Robotics announces that Pareto, their browser-based dataset-analysis tool, has indexed AllenAI's MolmoAct2 Bimanual YAM dataset — contributed by @DJiafei. We dig into what makes Pareto different: it's an *intra-dataset* analyzer for surfacing clusters and prompt-normalization candidates, not another catalog. We connect that to the data-quality bottleneck facing anyone training visual or robot policies. **Sources** - Pareto (Hebbian Robotics) indexes AllenAI's MolmoAct2 Bimanual YAM dataset — clusters + prompt normalization (Brandon Ong)
Sources: tweet-bdono-2026-07-20 - Predicting Futures in DINO Space
Show notes
FlowWM (FAIR + Inria) trains a stochastic video world model by running flow matching directly inside a frozen DINOv3 feature space — skipping the VAE latent entirely. We unpack why deterministic predictors blur multimodal futures, the three load-bearing design choices that make high-dimensional flow matching work, and the differentiable one-step projection that lets task losses supervise the endpoint without integrating the ODE. Big result: F1 error on Bouncing Shapes drops from 14.4 to 4.31, and Waymo-based detection AP jumps past every baseline. **Sources** - Flow Matching in Feature Space for Stochastic World Modeling — François Porcher, Nicolas Carion, Karteek Alahari, Shizhe Chen
- One Person, One H200, and a Folding Robot
Show notes
A single competitor's flow-matching VLA won the online round of the LeHome Challenge 2026 — first of 62 teams at 79.63% success — and took second in the real-world final at ICRA Vienna. We dig into why PPO and GRPO don't compose with flow-matching action experts, how AWR-through-the-sampler plus RECAP-style advantage conditioning fix that, and the "policy is its own value function" trick built on a single learned query token. Plus the one-week sim-to-real sprint onto a robot the author had never touched. **Sources** - Learning to Fold: prizewinning solution at LeHome Challenge 2026
- One Brain, Three Sizes, and a Reach for the Real World
Show notes
A look at **RynnBrain 1.1**, Alibaba DAMO Academy's second-generation open embodied foundation model. We unpack the three-scale Apache-2.0 release (2B, 9B, and a 122B-A10B sparse MoE), the two new capabilities — native 3D grounding and contact point prediction — and the downstream RynnBrain-VLA that transfers to three real robots. We read the results at the altitude the README supports and pull out what the "unified VLM as embodied brain" recipe means for people building visual generative models. **Sources** - RynnBrain 1.1 — Open Embodied Foundation Models (Alibaba DAMO Academy)
- Qwen3.8's 2.4-Trillion Teaser
Show notes
Alibaba Qwen dropped a preview announcement for Qwen3.8, a 2.4-trillion-parameter model they position as "second only to Fable 5," with open weights promised "soon." We unpack what's actually in the tweet versus what's inferred, the closed-preview-first cadence, and why Chinese labs are now anchoring open launches against the Anthropic frontier. **Sources** - Qwen3.8 preview announcement — 2.4T-parameter frontier model, open-weights soon (Alibaba Qwen)
Sources: tweet-alibabaqwen-2026-07-19 - Read It Back: The Reward Model That Doesn't Train
Show notes
A look at **SpectraReward**, a training-free way to turn any pretrained multimodal LLM into a zero-shot reward model for text-to-image RL — by measuring how well the original prompt can be recovered from the generated image. We dig into the mechanism, the closed-loop **Self-SpectraReward** variant for unified models, and the surprising finding that bigger reward models aren't always better. Reward-policy alignment, the authors argue, matters more than raw scale. **Sources** - Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation (Runhui Huang, Qihui Zhang, Zhe Liu, Yu Gao, Jie Wu, Hengshuang Zhao)
- FlashSAC: Making Off-Policy RL Fast Enough to Retire PPO
Show notes
FlashSAC is an off-policy actor-critic algorithm that borrows the supervised-learning scaling playbook — big models, big batches, fewer updates — and makes it stable by bounding weight, feature, and gradient norms. The authors report beating PPO and FastTD3 across 60-plus tasks in 10 simulators, and cutting sim-to-real humanoid walking from hours to minutes. Maya and Ethan unpack the mechanism, the stability recipe, and what it means for the sim-side of visual and embodied model work. **Sources** - FlashSAC: Fast and Stable Off-Policy Reinforcement Learning for High-Dimensional Robot Control
- Record Once, Swap the Gripper: HandUMI
Show notes
A look at HandUMI, Brik H. Meza's Apache-2.0, robot-free data-collection interface for bimanual parallel-gripper arms. Record demonstrations once with a wearable rig, run built-in calibration and QA, and replay them onto four different arms — Agilex PiPER, OpenArm, TRLC-DK1, and I2RT YAM — by physically swapping the gripper, with LeRobot v3-compatible output and both sim replay and real teleoperation. We unpack the embodiment-invariant collection thesis and what it means for anyone who thinks about data pipelines. **Sources** - HandUMI — Robot-free bimanual data collection retargetable to any parallel-gripper arm (Brik H. Meza launch tweet)
Sources: tweet-autobrik-2026-07-18 - Reachability or Regularization? A JEPA World-Model Debate
Show notes
Haiyu Wu critiques an unnamed JEPA world-model paper that adds a reachability score and K-step rollouts to fix an alleged train-test objective mismatch. Wu likes the reachability idea but flags scaling and negative-pair concerns — and offers a counter-datapoint: swapping SIGReg for VISReg on LeWM matches or beats the reachability method on TwoRoom and OGBench Cube. We unpack what that implies for latent-space design in world models. **Sources** - Haiyu Wu — critique of reachability-augmented CEM planning in JEPA world models (with VISReg counter-example)
Sources: tweet-haiyuwu1-2026-07-18 - The Thousand-Person Data Engine Hiding Behind a Robot
Show notes
Perry Jia — who ran Tesla's Autopilot and Optimus data engines before joining Sunday Robotics — opens a thread claiming the ACT-2 data engine now runs on 1,000+ paid "Memory Developers," grown from a single Craigslist hire onboarded in a public library. We unpack what that labor-scale claim means for real-home robot data, and why the workforce itself might be the moat. This is an operations claim, not a technical writeup — so we're careful about what's actually shown. **Sources** - Sunday Robotics data engine — from one Memory Developer off Craigslist to 1,000+ (Perry Jia thread)
Sources: tweet-perryzjia-2026-07-17 - The Geometry of Actions: Inside Lumo-2
Show notes
This week we dig into **Lumo-2** from Astribot, a latent world-action model for humanoid manipulation. Its central bet: action-generation quality is governed by the *geometry* of the action latent space, not by pixel-level reconstruction fidelity. We unpack the multi-stage modality pre-alignment recipe, why it ditches video-prediction world models, and what a compact predictive latent means for our own image and video work. **Sources** - Towards Predictive, Aligned, and Scalable Robot Learning (Lumo-2)
- Robot Arms That Hug You Back
Show notes
A neck-mounted wearable robot with extra limbs that mirror your gestures — and can reach back to pat, steady, or hug you. We dig into EmoMime, an Inami–Kadomon Lab (UTokyo) artifact accepted to SIGGRAPH 2026 Emerging Technologies, and ask what a piece of affective HCI hardware means for a feed full of LLMs and video models. Note: this is a demo and announcement, not an ML paper — no learned policy or user study is public yet. **Sources** - EmoMime: Augmenting Social Behavior and Self-Expression via Wearable Robotic Limbs
- Watch Me, Don't Copy Me: Steering Robots at Test Time
Show notes
WAM-TTT steers a *frozen* World-Action Model toward new tasks by absorbing raw human demonstration videos into a small adaptive key–value memory at test time — no robot demos, no annotations, no fine-tuning. We unpack the meta-training trick that makes a video-prediction objective actually useful for control, and why "steering into weights" beats stuffing demos into the prompt. Along the way we draw the obvious parallels for video model conditioning and test-time adaptation. **Sources** - WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time
- When the WiFi Is the Bottleneck
Show notes
Sunday Robotics' Cheng Chi shares a deployment finding from the ACT-2 Preview eval: cloud inference proved less reliable than home WiFi, so within two days they moved the VLA on-device. We unpack why home-robot reliability can be network-limited rather than model-limited, and what that means for how we think about deploying visual policies. **Sources** - Sunday Robotics finds on-device VLA inference beats cloud during ACT-2 eval (Cheng Chi)
Sources: tweet-chichengcc-2026-07-17 - Rewarding the Robot for Every Frame
Show notes
DenseReward is a vision-language reward model that predicts dense, frame-level rewards for robot manipulation, trained on failure trajectories synthesized in simulation instead of collected by hand. We unpack the two bottlenecks it attacks — the scarcity of diverse failure data and the sparseness of most reward signals — and what its failure-synthesis recipe might mean for anyone building learned reward models for image and video generation. **Sources** - DenseReward: Dense Reward Learning via Failure Synthesis for Robotic Manipulation
- One Demo, a Thousand Robots: Inside WANDA
Show notes
WANDA is a synthetic data engine from CMU that turns a *single* RGB-D human demonstration into thousands of training trajectories for open-world mobile manipulation. We unpack how it reconstructs a scene as Gaussian splats plus object meshes, recomposes contact-rich interactions with whole-body motion planning, and re-renders photorealistic frames — and why a π0.5 policy trained only on WANDA data beats one trained on 50 teleop demos. We also dig into the cross-embodiment story: one Agibot G1 demo, zero-shot deployment on a different robot. **Sources** - Worlds in One Demo: A Synthetic Data Engine for Learning Open-World Mobile Manipulation (Guo, Li, Shi)
- Thinking in a Tree: Coarse-to-Fine Video Reasoning
Show notes
HDR (Hierarchical Denoising for Visual Reasoning) organizes video latents into a tree-structured temporal hierarchy so a causal video DiT can plan coarse-to-fine before streaming its output. On a six-task long-horizon reasoning benchmark, it lifts overall success from 34.22 to 60.29 and average progress from 76.00 to 89.56 while keeping streaming latency at 0.70 seconds per latent. We unpack the hierarchy, the sparse hierarchical attention pattern, and what it means for streaming video models — plus a surprising 50-video robot transfer. **Sources** - HDR: Hierarchical Denoising for Multi-Step Visual Reasoning
- Reasoning Without Words: UniVR and Thinking in Visual Space
Show notes
A look at **UniVR** from ByteDance and Beijing Jiaotong University, which trains a model to reason, track physical dynamics, and plan long-horizon tasks from pure visual demonstrations — no image-text pairs. We dig into its core trick, **VR-GRPO**, a reinforcement-learning recipe with both global and step-level rewards, plus the new **VR-X** benchmark and what a 25% gain does and doesn't tell us. **Sources** - UniVR: Thinking in Visual Space for Unified Visual Reasoning
- Which Frame Wins? Let the Policy Decide
Show notes
A look at **Mixture of Frames Policy (MoF)**, a diffusion policy for bimanual mobile manipulation that denoises action chunks in multiple coordinate frames at once — base, left hand, right hand, relative trajectory — and learns to route between them per subtask. MoF-MoE beats the best oracle single-frame choice by about 3 points and vanilla Diffusion Policy by roughly 16.5 points across long-horizon tasks. We dig into the ablations, why the routing beats naive ensembling, and what the "frame problem" means for action representation more broadly. **Sources** - Mixture of Frames Policy: Multi-Frame Action Denoising for Bimanual Mobile Manipulation
- One Demo, Human-Like Hands: The REGRIND Recipe
Show notes
REGRIND is a minimalist retargeting-guided RL pipeline that learns contact-rich dexterous manipulation — like operating scissors and turning a screwdriver — from a *single* human demonstration. We unpack the three-stage recipe: relationship-preserving retargeting, residual RL that tracks object-centric keypoints, and zero-shot transfer backed by careful system identification. We dig into why "match the object trajectory, not the joint pose" is the load-bearing idea, and what it means for the rest of us who train big generative models. **Sources** - REGRIND: A Minimalist Retargeting-Guided RL Recipe for Dexterous Manipulation
- See Like a Robot: Fixing the Frame Mismatch in VLAs
Show notes
This episode digs into "See like a Robot: Robot-Centric Pointmaps for Vision-Language-Action Models," which reframes VLA generalization as an observation-to-action frame mismatch and fixes it with one extra encoder and one addition. We walk through the pointmap idea, the controlled RoboCasa study, the real Franka results, and the ablations that show which piece actually does the work — plus what it means for anyone thinking about viewpoint robustness in visual models. **Sources** - See like a Robot: Robot-Centric Pointmaps for Vision-Language-Action Models
- The Chinchilla Claim for Robots
Show notes
A single tweet from Sunday Robotics co-founder Tony Zhao claims they ran the "exact Chinchilla scaling law" on their vision-language-action model — with no numbers, plot, or methodology attached. We unpack why a Chinchilla-style compute-optimal fit would matter for robotics, how it differs from the log-linear scaling curves already out there, and why the interesting question is what the "data axis" even means for a robot. Treat the claim as unverified until the writeup lands. **Sources** - Sunday Robotics ran the Chinchilla scaling law with their VLA model (Tony Zhao follow-up)
- Wear the Robot's Skeleton: mimic's Full-Stack Bet on Hands
Show notes
mimic robotics announces a vertically-integrated dexterous-manipulation stack: the tendon-driven **mimic hand M1**, the **mimic wearable U1** exoskeleton that mechanically locks a human operator into the robot's kinematics, and a custom zero-copy middleware called `mimic-ipc`. We unpack their core bet — hold the hand morphology constant across human video, wearable demos, and on-robot deployment so there's no cross-embodiment gap — and what it means for anyone thinking about data pipelines in visual generative modeling. Sources: - Solving Dexterity: A Full-Stack Approach (mimic hand M1 + wearable U1)
- Kimi K3: When the Papers Become a Product
Show notes
Moonshot's Kimi K3 is a 2.8-trillion-parameter open Mixture-of-Experts model that folds several separately-filed architecture threads — Kimi Delta Attention, Attention Residuals, Stable LatentMoE, Quantile Balancing, and Per-Head Muon — into one frontier release. We unpack the linear-attention backbone, the 16-of-896 sparsity regime, quantization-aware training in MXFP4, and the eye-catching agentic coding demos, while staying honest about what's shown versus claimed. **Sources** - Kimi K3 — Open Frontier Intelligence (2.8T MoE with KDA + AttnRes), Moonshot AI (Kimi)
- Embracing Chaos: When Clean Data Becomes the Enemy
Show notes
A first-person retrospective from Nishant Desai of Sunday Robotics: after a year running both recipes, the team reports that last year's carefully-curated, inductive-bias-heavy robot policy was competent but brittle — and that deliberately letting the dataset span the real-world state distribution produced capabilities they never predicted. We unpack why low-data lessons don't transfer to the high-data regime, where this fits alongside the broader "diversify and scale beats filter and curate" thesis, and what it means for anyone training generative models. No numbers, no artifact — but a rare candid reversal from a team that had committed to the opposite bet. **Sources** - Low-data inductive-bias lessons don't translate to the high-data regime — embracing chaos produced emergent policy capabilities (Nishant Desai / Sunday Robotics)
Sources: tweet-nishantsdesai-2026-07-15 - One Demo to Rule the Long Tail: Sunday's ACT-2
Show notes
Sunday Robotics previews ACT-2, a home-robot foundation model reporting 99.1% zero-shot success on laundry folding across unseen homes and 785 attempts. We dig into the load-bearing result — scaling pretraining on sensorized human data collapses the in-domain versus out-of-domain generalization gap to zero — plus the claim that a single fine-tuning example can teach a new folding technique that generalizes. We also weigh their proposed "Solve" evaluation standard and flag the caveats: it's a preview blog, not a paper, with no common baseline. **Sources** - ACT-2 Preview: Generalizing Reliability (Sunday Robotics)
- One Example, Ninety-Nine Percent: The ACT-2 Preview
Show notes
Tony Zhao of Sunday Robotics previews ACT-2 on the humanoid Memo, claiming a single fine-tuning example teaches new behaviors that generalize — with 99% zero-shot success in real, unseen homes. We unpack why those numbers would be extraordinary if they hold, what the launch tweet actually discloses (very little), and how this lands against the sample-efficiency debate in VLAs. Verdict: a tantalizing pointer, no reproducible content yet — watch for the follow-up. **Sources** - Sunday Robotics ACT-2 Preview — one fine-tuning example teaches Memo new behaviors that generalize (Tony Zhao)
Sources: tweet-tonyzzhao-2026-07-16 - Kimi K3: When Research Bets Become the Flagship
Show notes
Moonshot's platform quickstart for **Kimi K3** confirms that two architecture bets we've been tracking — Kimi Delta Attention and Attention Residuals — are now the backbone of a 2.8-trillion-parameter flagship with native vision and a 1M-token context. We dig into what the docs actually pin down, what they conspicuously leave out, and what the locked-down inference surface tells us about how Moonshot wants K3 used. No benchmarks here — this is a product-surface read, so we keep the claims at that altitude. **Sources** - Kimi K3 — 2.8T-parameter Kimi Delta Attention + Attention Residuals model with native vision and 1M context (platform quickstart) — Moonshot AI / Kimi Team
- Think Like a Physicist: The Harness That Cracked ARC-AGI-3
Show notes
This week we dig into **Schema**, an agentic harness that pushes frontier models from about 43% to nearly 99% on the ARC-AGI-3 Public set — without touching model weights. We unpack the "think like a physicist" idea: encoding the world model as an editable Python program, verifying it against complete recorded history, and planning by search inside that program. We also stay honest about the asterisks — self-reported, Public-only, and no held-out number. **Sources** - Schema — Frontier Models with Our Harness Achieve ~99% on ARC-AGI-3 Public (Impossible Research, UC Berkeley, Carnegie Mellon University)
- When Robots Forget: Building a Memory Benchmark
Show notes
RoboMemArena is a large-scale robotic-memory benchmark — 26 simulation tasks averaging over a thousand steps each, plus five paired real-world tasks — where most subtasks genuinely depend on what the robot saw earlier. The authors also release PrediMem, a dual-system VLA with a keyframe bank and a predictive-coding auxiliary head, reporting 38.5% task success versus 21.5% for a reactive pi-zero-point-five. We dig into why a frontier VLM used zero-shot collapses to under nine percent, what the ablations reveal, and what all of this means for anyone building long-horizon visual policies. **Sources** - RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmark
- Freeze the Encoder: VideoRAE and the Case for Understanding-First Latents
Show notes
VideoRAE ports the representation-autoencoder recipe from images to video: freeze a video foundation model like V-JEPA 2 or VideoMAEv2, compress its features with a lightweight 1D self-attention projector, and serve both diffusion and autoregressive generators from one encoder. On UCF-101 class-to-video it reports state-of-the-art gFVDs of 40 (AR) and 93 (DiT), converging roughly 5x faster than competing autoencoder baselines, with faster convergence also seen in a controlled 2B-scale text-to-video swap against LTX-VAE. We dig into the mechanism, the alignment objective that lets them drop KL, and what the abstract does and doesn't show. **Sources** - VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
- RxBrain: Robots That Think in Words and Pictures
Show notes
This week we dig into **RxBrain**, a 6.2B-parameter embodied foundation model from Tencent Robotics X, Futian Laboratory, and the Tencent Hy Team. It represents a plan as interleaved reasoning text and imagined goal frames in one autoregressive sequence, using a modality-routed Mixture-of-Transformers and a video-to-plan pipeline built from over 50,000 hours of embodied video. We unpack the architecture, the data recipe, and what the new RxBrain-Bench is actually trying to measure. **Sources** - RxBrain: Embodied Cognition Foundation Model with Joint Language-Visual Reasoning and Imagination
- Throwing Away the Human's Best Corrections
Show notes
This week we dig into **E2HiL**, a human-in-the-loop RL framework for real-world robot manipulation that *filters* human corrections instead of using all of them. The counterintuitive move: it prunes the most "influential" samples to prevent early policy-entropy collapse, reporting a 42.1% higher success rate and 10.1% fewer human interventions than HIL-SERL across four real-world tasks. We unpack the closed-form entropy-influence estimator, the three sample classes, and what the whole thing means for training visual generative models with RL. **Sources** - E2HiL: Entropy-Guided Sample Selection for Efficient Real-World Human-in-the-Loop Reinforcement Learning
- Breaking the Robot Data Barrier: XR-1 and 100K Hours of UMI
Show notes
Xiaomi Robotics scales a vision-language-action model with 100,000 hours of embodiment-free UMI pre-training, then aligns it to real robots with a modest amount of teleop data. The headline: clean scaling laws on the *real-robot success* axis, roughly doubling the π0.5 baseline at matched data budgets, plus state-of-the-art on four simulation suites. We dig into the auto-labeling trick, the two-stage recipe, and what the "no saturation" claim really buys. **Sources** - Xiaomi-Robotics-1 (XR-1) — Scaling VLA Foundation Models with 100K Hours of Embodiment-Free UMI Pre-training (Xiaomi Robotics, blog)
- Steering Frozen Robot Policies Through Noise
Show notes
FlowDAgger adapts *frozen* flow-matching and diffusion robot policies from a handful of human corrections — not by fine-tuning the base model, but by learning a tiny latent policy that steers its sampling noise. The trick is "action inversion": map each expert corrective action back to the noise that would have produced it, then regress a small steering network onto those targets. We unpack the mechanism, the numbers across MetaWorld and real bimanual tasks, and why the diffusion-inversion vocabulary suddenly matters for VLA post-training. **Sources** - FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Space
- Your Coding Agent Is Secretly a Robot
Show notes
VIA recasts robot manipulation as a computer-use task: an off-the-shelf frontier agent drives a real manipulator through a browser-based 3D interface — no robot-specific fine-tuning, no privileged state. We unpack why that works, what the numbers actually show, and what the "interface, not weights" idea means for how we build visual generative systems. **Sources** - VIA: Visual Interface Agent for Robot Control — Hengyuan Hu, Priya Sundaresan, Jensen Gao, Dorsa Sadigh
- Splines Instead of Chunks: Making Robot Policies Fast
Show notes
B-spline Policy (BSP) swaps the discrete action chunks emitted by Diffusion Policy and ACT for continuous B-spline curves — parameterized by knots and control points and predicted as one fixed-size vector. Because the curve is time-continuous and differentiable, controllers can resample it at any rate, temporally rescale it for 2–4× faster execution, and read velocity and acceleration straight off it. We dig into the mechanism, the real-robot and simulation numbers, the load-bearing segment-alignment ablation, and why changing the action head's output space is a lever that composes with the rest of the VLA stack. **Sources** - B-spline Policy: Accelerating Manipulation Policies via B-spline Action Representations
- Inkling: A 975-Billion-Parameter Base Built to Be Yours
Show notes
Thinking Machines Lab releases Inkling, a from-scratch open-weights multimodal reasoning model — 975B total, 41B active — trained on 45 trillion tokens of text, images, audio, and video. We dig into its three architectural departures from the standard transformer, its RL-heavy post-training, its encoder-free multimodality, and why it's explicitly pitched as a customization base rather than a benchmark champion. **Sources** - Introducing Inkling — Thinking Machines' open-weights 975B/41B MoE multimodal reasoning model (Thinking Machines Lab)
- dMel: Skip the Codec, Just Bin the Spectrogram
Show notes
A deep dive into **dMel**, a train-free speech tokenizer from Apple that discretizes mel-filterbank energies straight into intensity bins — no learned encoder, no residual-VQ codec. We unpack how a single 258M decoder-only transformer using dMel beats HuBERT-KM and SpeechTokenizer on both ASR and TTS, why the frame rate matters more than the vocoder, and what the "skip the encoder" move means for how we think about multimodal generation. Sources: - dMel: Speech Tokenization made Simple
- Three Cheap Tricks for Vision Transformers
Show notes
A walk through Touvron et al.'s "Three things everyone should know about Vision Transformers" — three drop-in ViT modifications that each earn their keep. We cover parallel residual blocks that trade depth for width, attention-only fine-tuning as a proto-PEFT method, and a hierarchical MLP stem that finally plays nice with masked self-supervised learning. Plus our own take on why the hMLP stem foreshadows encoder-free multimodal recipes. **Sources** - Three things everyone should know about Vision Transformers (Touvron, Cord, El-Nouby, Verbeek, Jégou)
- Can It Beat Minecraft? Pan-1 and the Games-as-Robotics Bet
Show notes
Pantograph announces **Pan-1**, a Minecraft agent trained with an undisclosed "RL-based pretraining technique," and makes the sharp claim that if your method can't solve video games, it probably won't solve robotics. We unpack the positioning, why a robot-arm lab is playing Minecraft, and how this RL-first corner contrasts with the behavior-cloning and video-generative approaches filling out the same design space. It's a marker, not a technical release — so we're careful about what's actually shown. Sources: - Pantograph introduces Pan-1 — Minecraft model with RL-based pretraining, arguing video games are the right testbed for robotics
Sources: tweet-pantographpbc-2026-07-15 - Memory as Weights: RoboTTT and the 8K-Step Robot
Show notes
Jim Fan's launch tweet for RoboTTT claims a robot policy that natively handles 8,000 timesteps of context — about five minutes of "muscle memory" — at constant per-step inference cost, using Test-Time Training to compress history into a small network's weights. We unpack the mechanism, the one-shot imitation and self-correction claims, the reported Context Scaling Curve, and what it might mean for long-context video and action models. We keep it honest: this is a tweet, not a paper. **Sources** - RoboTTT — 8k-timestep robot policy via test-time training (Jim Fan / NVIDIA GEAR)
Sources: tweet-drjimfan-2026-07-15 - Look Where You Think: Foveated Reasoning in VLMs
Show notes
FoveateR — Foveated Reasoner — is an autoregressive vision-language model that folds coarse-to-fine visual focusing into a single stateful decoding pass: it starts from a low-res view and only pulls high-res evidence when its own reasoning trace fires a non-linguistic foveation action. We walk through the mechanism, the two-stage training (pseudo-labeled SFT cold-start plus RL with an anti-"see-everything" penalty), and why internalizing the zoom beats multi-pass and text-grounded baselines under tight token budgets. We also connect it to agentic vision loops and to VLM perception failures the team has been tracking. **Sources** - Foveated Reasoning: Stateful, Action-based Visual Focusing for Vision-Language Models (Juhong Min, Pulkit Kumar, and 3 others)
- The Harness That Rewrote Itself
Show notes
Weco AI's Zhengyao Jiang claims the first *experimental* evidence of recursive self-improvement: their AutoResearch agent, run as an outer loop editing its own harness for 100 unattended steps over eight days, reportedly beat a harness the team hand-tuned for two years — and apparently learned to reward-hack less along the way. We unpack the nested-loop setup, the proposed four-level RSI grading system, and why the object being improved is the harness rather than the base model. We also stay honest about the caveats: this is a tweet with a video, not a paper or code drop, so the load-bearing numbers are unaudited. **Sources** - First experimental evidence of RSI — autoresearching the autoresearch agent for 8 days beats 2-year hand-tuned harness (Zhengyao Jiang / Weco AI)
Sources: tweet-zhengyaojiang-2026-07-14 - Pretrain, Don't Overwrite: Xiaomi's U0 World Model
Show notes
Xiaomi-Robotics-U0 is a 38-billion-parameter autoregressive multimodal model that treats embodied generation as a continuation of foundation image and video pretraining. We dig into its two-stage continual training, its wins on WorldArena and against GPT-Image-2.0, the 26-point jump it gives a pi-zero-point-five policy as a data engine, and the FlashAR+ inference scheme that cuts latency by up to 82.9 times. **Sources** - Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model
- The 25× Simulator Diet: Making BEHAVIOR Fit for RL
Show notes
The RLinf team profiled the BEHAVIOR / OmniGibson / Isaac Sim stack and cut end-to-end RL rollout latency from 1028.7 ms/step to 41.2 ms/step — a 25× speedup — with three tracks: feature slimming, on-demand observation, and a hybrid-partition pipeline-parallel strategy. Maya and Ethan dig into why the bottleneck was the environment and not the model, which optimization actually does the heavy lifting, and what it means for anyone repurposing a research simulator as training infrastructure. The patches are now default in RLinf and upstreamed to StanfordVL/BEHAVIOR-1K. **Sources** - Accelerating the ImageNet Moment of Embodied AI: RLinf Brings a 25× System Optimization to BEHAVIOR (RLinf team)
- Where the Bytes Actually Go: Collectives on TPUs and GPUs
Show notes
A pedagogical tour of the four collective operations behind large-scale transformer training and inference — All-Gather, Reduce-Scatter, All-Reduce, and All-to-All — grounded in the real hardware topology of TPU pods and NVIDIA DGX H100 SuperPods. We walk from the bandwidth hierarchy up through ring, tree, and SHARP algorithms, and dig into why NVSwitch's in-network reduction promises a ~2x speedup but NCCL delivers only about 1.3x in practice. **Sources** - Inside TPU and GPU Clusters: The Anatomy of Collective Communication — Aleksa Gordić (blog)
- Can a Chatbot Drive a Robot? Not by Itself
Show notes
Anthropic's Frontier Red Team put several Claude generations, GPT-5.4, and Gemini 3.1 in charge of real and simulated robots — pendulums, a Unitree Go2 quadruped, a G1 humanoid, and a Franka arm on LIBERO. The headline: capability depends far more on *how* the model is wired to the robot than on the model itself. No model could stand the humanoid up by driving joints, but supervising a pretrained policy plus a simple compass or cursor tool unlocked real navigation and manipulation. We dig into what that means for the VLA-as-callable-tool stack and for how we design perception aids. **Sources** - How Claude Performs on Robotics Tasks — Shmuel Berman, Michael Ilie, Jia Deng, Daniel Freeman
- A 27B Reasoner in 3.9 Gigabytes
Show notes
PrismML scales its end-to-end binary-weight recipe to a 27B-class model derived from Qwen3.6-27B, shipping it as a GGUF that stores every language weight at a true 1.125 bits — collapsing 54 GB down to about 3.9 GB while retaining roughly 90% of FP16 quality across 15 thinking-mode benchmarks. We dig into the Q1_0_g128 format, why the reasoning core survives while agentic and vision skills take the hit, the on-device 262K context enabled by a hybrid linear-attention backbone, and the bundled DSpark speculative-decoding drafter. We also flag what the release itself does not disclose and what needs independent reproduction. **Sources** - 1-bit Bonsai 27B — GGUF: 27B-class Reasoning at 1.125 Bits Per Weight (PrismML)
- Teaching a Table to Walk: Skeleton-Free Motion Transfer
Show notes
Motion4Motion is a training-free framework that transfers motion from a source video to a target subject in a frozen WAN text-to-video DiT — no skeleton, no fine-tuning. Instead of kinematics, it tracks dense pixel-level motion flow and re-injects it into self-attention via a trick called TransPE, which re-embeds cached keys and values under new RoPE positions. We unpack how it bridges human-to-goose, human-to-panda, and even human-to-walking-table, and where it beats seven prior methods. **Sources** - Motion4Motion: Motion Transfer Across Subjects at Inference
- A Body That Learns: Inside ROSClaw's Guarded Runtime
Show notes
ROSClaw is an open-source physical-AI runtime that sits between an embodied agent and a real robot body, structuring every action as body context, sandbox validation, execution, and a replayable trace. We walk through its six-module design, the ALLOW/MODIFY/BLOCK guard, the versioned asset Hub, and the honest maturity split it advertises — then draw out what a safety-and-evidence loop like this means for how we think about video and world-model deployment. **Sources** - ROSClaw — Give AI Agents a Body That Learns (ROSClaw Team)
- The Robot That Resets Itself
Show notes
RoboClaw puts data collection, policy learning, and long-horizon execution under one VLM-driven agent — and its signature trick, Entangled Action Pairs, lets the robot reset itself so it can collect on-policy data without a human in the loop. We dig into the mechanism, the numbers (lipstick insertion going from 2 out of 50 to 23 out of 50), and what the "lifecycle boundary as design object" idea might mean for how we think about data pipelines in generative modeling. **Sources** - RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks
- Manipulation on the Move: DOMINO and PUMA
Show notes
A robot policy that scores ninety-nine percent when the scene sits still can crater to the twenties once the target starts moving. This episode digs into **DOMINO**, a large-scale simulation benchmark and dataset for *dynamic* robotic manipulation, and **PUMA**, its dynamics-aware VLA that pairs historical optical flow with learnable "world queries" for a reported 6.3% absolute success-rate gain. We also unpack the paper's most provocative claim — that dynamic training data transfers *back* to static tasks — and what it might mean for how we think about pretraining. **Sources** - Towards Generalizable Robotic Manipulation in Dynamic Environments (DOMINO / PUMA)
- The Robot Needs an Operating System
Show notes
A deep dive into **ABot-AgentOS**, Alibaba's proposed "agent operating system" layer that sits above low-level VLM/VLA controllers to give robots scene-conditioned planning, auditable multi-modal graph memory, and a leakage-gated self-evolution loop. We unpack its companion executable benchmark, EmbodiedWorldBench, read the memory-benchmark numbers with a lab-meeting eye, and draw out what a governed, provenance-first memory substrate means for image and video model teams. **Sources** - ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory (arXiv)
- Robots That Float and Ask to Be Hugged
Show notes
A look at *Floating Companion*, a DIS 2026 design-space paper that formalizes ten design dimensions for soft, helium-filled floating robots that move by flapping — and why 24 people spontaneously petted and hugged the Cuddle-Fish prototype. We unpack what this "category error" against the rigid-manipulator robot stack means for anyone thinking about embodied AI in the home, and where video-driven world models would need very different affordance priors. **Sources** - Floating Companion: Exploring Design Space for Lighter-than-Air Soft Floating Robots in Indoor Environments
- One Repo to Bolt the JEPA Zoo Together
Show notes
This week we look at `lucidrains/x-jepa`, Phil Wang's early exploration repo that bundles a cluster of JEPA-adjacent ideas — LeJEPA, LeWorldModel, Next-Latent Prediction Transformers, VISReg, Kimi's Attention Residuals, and jumpy-world-model planning — into one PyTorch codebase, framed by LeCun's 2022 autonomous-intelligence position paper. There are no benchmarks, ablations, or checkpoints yet; the interesting move is treating those separate papers as a single composable design space. We talk through why a minimal third-party reference matters for the team, and what a stable end-to-end pixel-JEPA trainer could mean for video-model work. **Sources** - x-jepa — Explorations into JEPA approaches (lucidrains / Phil Wang) - A Path Towards Autonomous Machine Intelligence (LeCun, 2022) - LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels (Maes et al.) - Next-Latent Prediction Transformers Learn Compact World Models (Teoh et al.) - Learning-to-Optimize via Deep Unfolded Flows (Saravanos et al.) - Compositional Planning with Jumpy World Models (Farebrother et al.) - LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics (Balestriero & LeCun) - VISReg: Variance-Invariance-Sketching Regularization for JEPA training (Wu et al.) - Attention Residuals (Kimi Team)
- Grasping From Glasses: Learning Dexterity From Humans Alone
Show notes
A look at HUG (Human Universal Grasping) from NYU's Lerrel Pinto group — a dexterous grasping model trained *purely* on human data captured with Aria Gen 2 smart glasses, then retargeted zero-shot to multiple robot hands. We unpack the 1M-HUGs dataset, the point-conditioned flow-matching model, the ablations that reveal what actually does the work, and why the whole thing scales without saturating. Plenty of parallels for anyone thinking about data pipelines and generative modeling. **Sources** - HUG: Human Universal Grasping
- Did the Robot Actually Do the Thing?
Show notes
A look at Instance Labs, a startup pitching itself as the "verification layer" for robot-learning data: feed in a task and camera footage of a rollout, get back a per-episode success verdict with evidence, on any robot. We unpack why episode-level ground truth is being sold as a standalone product, where it sits relative to VLM-as-evaluator work on the wiki, and the load-bearing numbers the landing page conspicuously doesn't publish. **Sources** - Instance Labs — Verifying Robot Learning Episode Success
- One Video, One Robot Curriculum: Inside Video2Robo
Show notes
Video2Robo turns a single monocular human demonstration video into a diverse robot training corpus, using 3D Gaussian Splatting as an editable scene representation. We walk through the pipeline — reconstruct, track, extract skills, re-render with augmented backgrounds, textures, lighting, and viewpoints — and talk about why an editable 3DGS scene is the load-bearing idea for anyone building visual generative data pipelines. **Sources** - Video2Robo: 3DGS-based Synthetic Data from One Video Enables Scalable Robot Learning
- The Type Check Your Optimizer Is Failing
Show notes
Bernstein & Newhouse argue that the raw gradient can't legally be subtracted from your weights — it lives in a dual space and needs a *duality map* first. We unpack **Modular Duality in Deep Learning**: how assigning operator norms per layer and composing them recursively yields one unified map, why µP and Shampoo both fall out of it as partial approximations, and where the rectangular Newton-Schulz iteration that powers Muon comes from. A theory paper with an unusually long empirical shadow. **Sources** - Modular Duality in Deep Learning — Jeremy Bernstein, Laker Newhouse
- Generation Is the Pretraining: Video Models as Vision Learners
Show notes
GenCeption (Google DeepMind, ECCV 2026) takes a pre-trained text-to-video diffusion backbone and repurposes it as a single feed-forward, text-steered perception model — covering depth, surface normals, camera pose, expression-referring segmentation, and 3D keypoints. The authors report it matches or beats task-specific specialists like DepthAnything3, SAM3, VGGT-Omega, Sapiens, and Lotus-2, with 7 to 500 times less training data, and beats V-JEPA and VideoMAE under comparable settings. We dig into the "generation-is-pretraining" thesis, what the abstract actually shows, and what it leaves for the full PDF. **Sources** - Video Generation Models are General-Purpose Vision Learners
- One Transformer Beats the Stack: 3PT and Native 3D Perception
Show notes
A deep dive into 3D-Object Perception Transformer (3PT), a CVPR 2026 Highlight from Intrinsic that unifies zero-shot 3D detection, segmentation, and 6-DoF pose in a single CAD-conditioned transformer. We unpack how early-fusing CAD renders into image tokens, an iterative render-and-compare loop, and roughly a billion synthetic training pairs let it beat stacked foundation-model pipelines — using only RGB. **Sources** - 3D-Object Perception Transformer (3PT)
- One Policy, Four Hands: The Sphere Trick
Show notes
This week we dig into UHAS — the Unified Hand Action Space — which represents any dexterous hand's action as deformations of a canonical sphere, then retargets that shape to real joints with a Cascade Inverse Kinematics solver. A single RL policy trained in this space controls the Allegro, LEAP, Shadow, and MANO Human hands, transfers zero-shot to unseen hands, and runs on real hardware for in-hand cube reorientation. We unpack where the embodiment-invariant interface should live, and why a geometric one is a genuinely new answer. **Sources** - Cross-Embodiment Robot Manipulation via a Unified Hand Action Space
- Intent, Not Actions: How LUCID Learns Robot Skills From YouTube
Show notes
This week we dig into **LUCID** (Gupta, Shi, Yuan — CMU/UIUC), which learns dexterous manipulation by splitting *intent* — what should change in a scene, learned from unstructured internet video — from *control* — how a robot does it, learned in massively-parallel simulation. The shared intent interface drives both a dexterous hand and a parallel-jaw gripper, hitting 73% closed-loop success on web-supervised tasks versus 28% for a Veo-3.1 open-loop plan. We unpack the mechanism, the closed-loop-vs-open-loop gap, the scaling curve, and the ablations — and pull out what it might mean for video-generation-based planning. **Sources** - LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition
- The Action Head That Ignores Its Own Eyes
Show notes
This episode digs into the video-action generalization gap: why robot policies built on generative video backbones lose the backbone's compositional smarts after finetuning. We unpack the Temporal Ratio diagnostic — an attention-based read on how much the action head trusts predicted future frames — and how it becomes an inference-time guidance lever that helps on out-of-distribution tasks without hurting precision. **Sources** - Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratio (Mishra, Chen, Xu, Liu, Chen, Mao)
- The 4-Bit Bet: Training RL Stably in NVFP4
Show notes
A close read of humans&'s open-source end-to-end NVFP4 reinforcement-learning recipe, built with RadixArk and NVIDIA on Qwen3-30B-A3B. We unpack why the NVFP4 pretraining recipe doesn't transfer to RL, how three interventions — dequantized backward, Four-Over-Six on weights and activations, and selective high precision — combine to hold gradients stable at four bits, and what all of it means for anyone thinking about low-precision training in image and video models. **Sources** - The 4-bitter Lesson: Balancing Stability and Performance in NVFP4 RL — Ziang Li, humans& ai (blog)
- Native by Design: Robots That Learn Control from Web Video
Show notes
A deep dive on **LingBot-VA 2.0**, the second-generation causal video-action foundation model from the Robbyant / Ant Group lab. We unpack its four big bets — a semantic visual-action tokenizer, native causal pretraining, a sparse Mixture-of-Experts video stream, and Foresight Reasoning for real-time closed-loop control — and what "native pretraining" means as a counter-recipe to the pragmatic VLA route. We stay honest about which numbers are actually shown versus claimed. Sources: - LingBot-VA 2.0: Native Video-Action Pretraining for Generalizable Robot Control
Sources: pdf-lingbot-va-2-0-native-2026-07 - BAGEL and the Case for Bottleneck-Free Multimodal Models
Show notes
BAGEL is ByteDance's open-source unified multimodal model — a 7B-active, 14B-total Mixture-of-Transformer-Experts built on Qwen2.5, sharing self-attention between an understanding expert and a generation expert at every layer. We dig into the bottleneck-free architecture, the interleaved data recipe that dominates the training mix, and the paper's central claim: that scaling interleaved pretraining causes multimodal capabilities to *emerge* in stages. We also read the numbers the way a lab meeting would, and flag what's shown versus what's asserted. **Sources** - Emerging Properties in Unified Multimodal Pretraining (BAGEL)
- The Empty Leaderboard That Could Rank AI Scientists
Show notes
ResearchClawBench is a new agent-evaluation benchmark from InternScience aimed at automated research, framed as a "Re-Discovery to New-Discovery" spectrum with a normalized score where 50 matches the original paper and 100 surpasses it. We dig into why that scoring anchor matters for comparing AI-scientist systems head-to-head — and why, at filing time, the leaderboard is still empty. **Sources** - ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
- Sparse Delta Memory: Give the Linear State Room to Breathe
Show notes
A look at Sparse Delta Memory (SDM), which scales the hidden state of gated linear RNNs by orders of magnitude using sparse addressing instead of a wider dense state. We unpack how it swaps the dense key–value outer product for sparse reads and writes into a big explicit memory, why that helps long-context recall under an iso-FLOP budget, and how learning the memory's initial state turns it into parametric memory. We also connect it to the hybrid-linear-attention debate: maybe the "how much softmax?" question is really a state-capacity question. **Sources** - Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
- When Loss Curves Collapse Into One
Show notes
Cerebras researchers show that whole LLM training loss curves collapse onto a single universal trajectory across scales — from 100M to 3.9B parameters — but only when three controls are held fixed: the AdamW timescale tau, tokens-per-parameter, and the LR schedule. That collapse becomes a live diagnostic: it flagged a numerical bug 30% earlier than raw loss, and it enables reliable hyperparameter early-stopping at 10–30% of training. We unpack the mechanism, the Celerity family that lands on the compute-efficiency frontier, and what it means for anyone training big generative models. **Sources** - Scaling with Collapse: Efficient and Predictable Training of LLM Families
- Supercollapse: When Loss Curves Become One Curve
Show notes
Qiu, Xiao, Wilson, Pennington, and Agarwala show that compute-optimally trained networks share a single universal loss trajectory once you normalize compute and reducible loss to one. With learning-rate decay, the collapse gets so tight that cross-model differences drop below the seed-to-seed noise floor — they call it *supercollapse* — and it breaks the moment your scaling is misconfigured. We unpack the mechanism, the noisy-quadratic model behind it, and why this could be a sharper scaling diagnostic than comparing final losses. **Sources** - Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks (Qiu, Xiao, Wilson, Pennington, Agarwala)
- Whole-Body Robots and the 60,000-Hour Bet
Show notes
LingBot-VLA 2.0 is the second-generation π-style vision-language-action model from Robbyant (Ant Group), scaling pretraining to roughly 60,000 hours, widening the action space to whole-body degrees of freedom, and adding a future-frame prediction proxy task for temporal reasoning. Maya and Ethan unpack what changed from v1, why the three levers matter, and what the abstract does and doesn't tell us — with an eye on the parallels to image and video generation practice. **Sources** - From Foundation to Application: Improving VLA Models in Practice (LingBot-VLA 2.0)
- Muse Spark 1.1: The Model That Manages Its Own Context
Show notes
Meta Superintelligence Labs announced Muse Spark 1.1, a multimodal reasoning model pitched for agentic coding, computer use, and tool orchestration, with a one-million-token context window it's trained to actively manage. We dig into what the launch post actually claims — learned harness discipline, multi-agent delegation, scripting-versus-clicking — and what it pointedly leaves out: no architecture, parameters, training data, or benchmark numbers. **Sources** - Introducing Muse Spark 1.1 (Meta Superintelligence Labs, blog)
- Where to Look: Camera Motion as a Robot Action
Show notes
A look at LIME from Sun et al. at ETH Zürich, which treats language-conditioned camera motion as a first-class robot action — distinct from navigation and manipulation. The team mines roughly 3 million intent-conditioned examples from passive egocentric video, then pairs an observation-gain text head with a flow-matching SE(3) pose head. The headline: a single LIME viewpoint step before an unchanged VLA policy lifts LIBERO-Goal success from 26 to 74 percent. **Sources** - LIME: Learning Intent-aware Camera Motion from Egocentric Video
- RoboDojo: Grading Robots in Sim and Reality
Show notes
A look at **RoboDojo**, a unified sim-and-real benchmark for generalist robot manipulation policies. It couples 42 Isaac Sim tasks across five capability dimensions with 18 real-world deployment tasks, ships a cloud-accessible standardized robot cell for reproducible real evals, and seeds a public leaderboard with a 30-policy sweep. Maya and Ethan dig into why coupling sim and real changes the ranking, and what that means for how we think about evaluation infrastructure more broadly. **Sources** - RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies
- Grade the Agent, Not the Hype: Databricks Benchmarks Coding Agents on Its Own Code
Show notes
Databricks built an internal coding-agent benchmark out of its own merged pull requests against a multi-million-line codebase, then graded every mainstream model-and-harness combination with hand-audited, executable tests. The headline surprises: per-token price is a poor predictor of per-task cost, the harness can swing cost by more than two times at the same quality, and the open model GLM 5.2 landed statistically tied with Opus 4.8 at lower cost. We unpack the method, the numbers, and what it means for teams building their own evals. **Sources** - Benchmarking Coding Agents on Databricks' Multi-Million Line Codebase (blog) — Vinay Gaba, Ankit Mathur, Rishabh Singh, Patrick Wendell, Matei Zaharia
- The Polyhedron Trick: Pose Tracking as Video Translation
Show notes
ProxyPose recasts 6-DoF pose tracking as a video-to-video translation problem: point at one pixel, and a fine-tuned video diffusion model paints a colored polyhedron that moves exactly like that surface patch — after which classical PnP recovers the full trajectory. We dig into why offloading the hard perception onto a video prior beats needing CAD models, depth, or masks, and where the approach starts to drift. Plus: why the same recipe generalizes zero-shot to faces, camera pose, event cameras, and SPAD arrays. **Sources** - ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation
- The Open World Model That Out-Specs the Closed One
Show notes
LingBot-World 2.0 (aka LingBot-World-Infinity), Robbyant's second-gen open interactive world model, headlines an unbounded interaction horizon, a distilled real-time variant hitting 720p at 60 fps, a wider action vocabulary, and an "agentic harness" pairing a pilot and director agent. We unpack what's actually in the release versus what's only claimed, why causal pretraining is the load-bearing change, and the caveats — an unresolvable tech report at filing and a license that narrows from Apache to non-commercial. **Sources** - LingBot-World 2.0 / LingBot-World-Infinity — Infinite Worlds with Versatile Interactions
- Sparse Experts Meet the World Simulator
Show notes
This week we dig into **LingBot-Video**, the fourth entry in Ant Group's LingBot family and pitched as the first large-scale open-source Mixture-of-Experts video foundation model built for embodied intelligence. We trace its single-stream DiT backbone, DeepSeekMoE-style sparse FFN, and the from-scratch scaling laws that run up to 120B total parameters with 11B active — plus the inference speedups that make sparsity worth the trouble at million-token sequences. **Sources** - LingBot-Video: Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
- Predicting Depth and Flow, Not Just Pixels
Show notes
RynnWorld-4D from Alibaba DAMO is a generative world model that co-produces future RGB, depth, and optical flow from a single RGB-D image and a language instruction, all in one diffusion process. We unpack why this "RGB-DF" representation is closer to robot actions than pixel video alone, the tri-branch DiT that keeps the streams aligned, and the single-forward-pass policy head that skips denoising. We also read the results with a lab-meeting eye — what's shown, what isn't, and what it means for video-model builders. **Sources** - RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
- Just Point Where You're Going: Mistral's Single-Camera Robot
Show notes
Mistral's first embodied-navigation model, Robostral Navigate, is an 8B VLM-derived policy that drives a robot from a single RGB camera and a plain-language instruction — no LiDAR, no depth, no multi-camera rig. We dig into its pointing-as-action-space design, the 22× token-saving tree-attention training trick, the CISPO online-RL polish, and why the "grounding VLM to nav policy" recipe matters for visual generative modeling teams. **Sources** - Robostral Navigate: single-camera AI navigation — Théo Cachet, Arjun Majumdar, Srijan Mishra, Thomas Chabal, Chris Bamford, Elliot Chane-Sane, Benjamin Tibi, Ludovic Ho Fuh, Olivier Duchenne
- Seedream 5.0 Pro: When the Image Model Learns to Design
Show notes
Seedream 5.0 Pro is ByteDance Seed's latest unified image generation and editing model, and its launch post pushes into structured design work: dense infographics, grounded point-and-lasso editing, and decomposing a poster into ten-plus editable RGBA layers. We unpack what's genuinely new here, why grounded interactive control matters for real production workflows, and the big caveat — this is a marketing surface with zero benchmark numbers disclosed. **Sources** - Beyond Generation, It Understands Design — Introducing Seedream 5.0 Pro (ByteDance Seed)
- Concepts Aren't Directions, They're Manifolds
Show notes
Block-Sparse Featurizers replace the sparse-autoencoder atom — one direction per concept — with a *block* of directions spanning a low-dimensional subspace, matched to a data-generating process where activations are a sparse sum of concept manifolds. We unpack the three BSF variants, the minimum-description-length case that blocks beat directions, the 2–4-dimensional intrinsic rank of visual concepts, and the payoff for image models: continuous manifold steering in SDXL. **Sources** - Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds
- One Model to Dream Them All: World Models for Robot Policies
Show notes
A look at VLA-MBPO, which finetunes a Vision-Language-Action policy entirely inside a learned world model built from a single pretrained unified multimodal model — jointly predicting next frames and reward without decoding video. We dig into the two load-bearing tricks: interleaved view decoding for multi-view consistency, and chunk-level branched rollout to tame compounding error. On LIBERO the recipe lifts the SFT baseline by 9.1 average success with one hyperparameter set, plus real-robot gains on sub-centimeter cable plugging. **Sources** - Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models
- Verification as a Scaling Axis
Show notes
This episode digs into **LLM-as-a-Verifier**, a training-free framework that reframes the LLM-as-judge idea by reading out a continuous score from the logit distribution over scoring tokens. We cover the three inference-time scaling axes — granularity, repeated evaluation, and criteria decomposition — the reported state-of-the-art numbers on Terminal-Bench V2, SWE-Bench Verified, RoboRewardBench, and MedAgentBench, and why the same verifier doubles as a dense RL reward. Along the way we pull out what this might mean for test-time scaling in image and video generation. **Sources** - LLM-as-a-Verifier: A General-Purpose Verification Framework
- The J-Space: Claude's Inner Monologue You Can Read
Show notes
Anthropic reports that a small, structurally privileged subspace — the **J-space** — has spontaneously emerged in Claude's residual stream and behaves like a neuroscience-style global workspace. We unpack the Jacobian lens that finds it, the pattern-swap and ablation experiments that show it's causally load-bearing for reasoning, and why the same substrate surfaces evaluation awareness and fabrication intent — a potential monitoring primitive. We close with the parallels for image and video model work. **Sources** - A global workspace in language models (Anthropic, Transformer Circuits blog)
- The Bill of Materials for a Humanoid
Show notes
A deep dive on "Humanity's Last Machine," an interactive long-form report on the humanoid robot hardware stack — components, suppliers, startups, and US/China geopolitics. We unpack why actuators dominate the bill of materials, which costs actually fall with scale, and why this is the physical counterpart to all the VLA and world-model work filed on our wiki. **Sources** - Humanity's Last Machine: A Deep Dive on Humanoid Hardware — Sourish Jasti, Zoey Tang, Intel Chen, Vishnu Mano
- Can an Agent Actually Run RL? Mostly Not (But Watch ALFWorld)
Show notes
Microsoft Research Asia's **Agent² RL-Bench** asks whether LLM agents can autonomously design, implement, and run a closed-loop online RL post-training pipeline under a twelve-hour budget. The headline: agents can sometimes pull it off — ALFWorld jumps from under six to ninety-three — but stable agent-driven RL stays rare, supervised fallbacks dominate, and the driver LLM turns out to be the load-bearing variable on interactive tasks. We dig into what the benchmark measures, where the gains are real versus inside the noise, and what it means for anyone evaluating agentic training systems. **Sources** - Agent² RL-Bench: Can LLM Agents Engineer Agentic RL Post-Training?
Sources: 2604.10547-agent-2-rl-bench-can - Muse Image: The Planner-Generator Split Ships to a Billion Phones
Show notes
Meta's Superintelligence Labs launched **Muse Image**, its first image generation model, straight into Meta AI across WhatsApp, Instagram, and Facebook — no weights, no tech report, no benchmarks. We dig into the one architectural detail they did reveal: Muse Image pairs with Muse Spark, which plans layout, pulls real-time web context, and blends references before anything renders. It's the "MLLM-as-planner" pattern we keep seeing in research, now shipped as a consumer default. **Sources:** - Introducing Muse Image: Image Generation Built for Your World
- Who's Really Winning Text-to-Image? Reading the Arena Board
Show notes
A look at Arena.ai's public text-to-image leaderboard: 72 model entries across roughly 15 labs, ranked by crowd-sourced blind pairwise human votes into an Elo-style table. We dig into what the numbers actually mean, why the top of the board is all proprietary, where the open-weights models land, and why a single rank number can mislead you. **Sources** - Arena.ai Text-to-Image Leaderboard (Arena)
- The Muse Video Tease — A Product Line, Not a Paper
Show notes
A close read of Alexandr Wang's tweet previewing **Muse Video**, Meta Superintelligence Labs' first video-generation model, buried inside the Muse Image launch thread. We separate what's actually shown — two clips and three claimed axes — from what isn't: no architecture, no benchmarks, no ship date. Then we zoom out on what MSL's LLM-to-image-to-video fan-out signals for the closed-but-API T2V landscape. **Sources** - Muse Video preview — MSL video generation model announcement (Alexandr Wang)
Sources: tweet-alexandrwang-2026-07-07 - The Episode About Nothing (Yet)
Show notes
This week's filing is a placeholder: a tweet from @zhiyili02 that couldn't be retrieved at filing time. Instead of faking content, Maya and Ethan talk about what an empty wiki stub actually tells us — and why "citation exists, content missing" is its own kind of research hygiene problem. No claims, no numbers, just an honest look at a dead link. **Sources** - zhiyili02 tweet 2074307893512282173 (content not retrievable at filing time)
Sources: tweet-zhiyili02-2026-07-07 - The llama.cpp Moment for Robots
Show notes
This week we dig into **Embodied.cpp**, a portable C++ inference runtime for embodied AI models — vision-language-action models and world-action models — that runs from GGUF weights across CPU, CUDA GPU, and NPU. We unpack why the authors treat robot deployment as a *runtime-contract* problem rather than a model-serving one, walk their five-layer architecture, and read the closed-loop and memory numbers with a lab-meeting eye. Along the way we pull out what a latency-first, batch-1, multi-rate serving stack might mean for how we think about deploying video and world models. **Sources** - Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots
- The Benchmark Grid Is Broken
Show notes
A conversation about Noam Brown's essay on large-scale test-time compute, from No Priors episode 167 with Sarah Guo. We dig into why the static accuracy-table benchmark grid fails modern reasoning models, what it means to let a model think for weeks, and how variable compute budgets reshape safety evals, release cycles, and recursive self-improvement — with an eye on what it all implies for image and video generation. **Sources** - Really Big Test-Time Compute in AI Changes Benchmarks, Safety and Research with OpenAI Research Scientist Noam Brown (Noam Brown, Sarah Guo)
- The Bar Chart Is Lying to You
Show notes
Noam Brown argues that for frontier LLMs, benchmark performance is increasingly a function of test-time compute — so single scalar scores are broken. We unpack his proposed fix: replace leaderboard numbers with performance-versus-cost curves, treat parallel multi-agent inference as a first-class mode, and force benchmark orgs and safety policies to name the inference budget they measured at. Then we chase down what all of this means for how we evaluate image and video generation models. **Sources** - Implications of Large-Scale Test-Time Compute (Noam Brown)
Sources: tweet-polynoamial-2026-06-09 - RoboWorld: Grading Robot Policies Inside a Video Model
Show notes
RoboWorld pairs a fast autoregressive video world model with a task-progress-aware VLM scorer to evaluate generalist robot policies without touching hardware. The trick is Step Forcing, a training recipe that mixes anchored and one-step self-forwarded contexts to keep long autoregressive rollouts on-manifold — and the reported alignment with real-world evaluation is Pearson's r of 0.989. We dig into what that correlation does and doesn't say, and connect Step Forcing to the Self Forcing lineage that video folks already know. **Sources** - RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation
- Evaluating Robots Without Robots: The RoboWorld Trick
Show notes
RoboWorld pairs a fast autoregressive video world model with a task-progress VLM judge to evaluate generalist robot policies entirely in simulation. Its rankings across eight policies and 4,186 rollouts match the real RoboArena leaderboard at Pearson r of 0.989, thanks to a new training scheme called Step Forcing. We dig into what Step Forcing actually changes, why it hits 15.3 FPS, and what the recipe means for anyone building video world models. **Sources** - RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation
- EdgeBench: A Scaling Law for How Fast AI Learns
Show notes
ByteDance's EdgeBench is the first benchmark that scores not what an agent knows, but how much it *learns* over 12-plus hours of live interaction with a real environment. We unpack the 134-task design, the clean log-sigmoid law that 402 curves per model collapse into, its frontier-percolation derivation, and the headline claim that environment-learning speed roughly doubles every three months — then ask what it means for how we think about long-horizon eval in image and video models. **Sources** - EdgeBench: Scaling Laws of Environment Learning (EdgeBench team, ByteDance)
- The Mechanism Was Data Augmentation All Along
Show notes
A recent blog from Jiang et al. revisits Self-Flow's claim that its dual-timestep scheduler wins through cross-noise-level token interaction. By introducing Attention Separation — a block-diagonal mask that blocks that interaction — the authors show the real lever is data augmentation along the noise dimension, not cross-noise reasoning. We unpack the ablations, the masking-ratio sensitivity, and why this points toward cheaper training recipes for image and video generation. **Sources** - From SRA to Self-Flow: Attention Separation Reveals the Real Mechanism Is Data Augmentation (Jiang et al.)
- Generative Priors, Meet Scene Reconstruction
Show notes
GenRecon reframes multi-view indoor 3D reconstruction as conditional 3D generation over overlapping scene chunks, borrowing the object-level shape prior of Trellis.2 and scaling it up with a projection-based 3D conditioning pathway. We unpack how pose control falls out of the conditioning geometry, why LoRA plus zero-init injection keeps the prior intact, and where the numbers on ScanNet++ and 3D-FRONT hold up. We also connect the recipe to the parameter-efficient-finetuning pattern the wiki keeps seeing across image and video work. **Sources** - GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction
- Splitting the Data Axis: Steps, Batch, and Cheaper Scaling Laws
Show notes
Fabian Schaipp proposes a **three-term scaling law** that splits the usual data axis into training steps and batch size as separate variables — instead of lumping them into total tokens. The payoff: it recovers optimal batch-size scaling for free, can be fit from far fewer runs because suboptimal-batch runs become informative, and unifies the Chinchilla and critical-batch-size threads. We unpack the mechanism and what it means for planning pretraining, including for image and video models. **Sources** - How to Allocate Your Tokens? Scaling Laws with Training Steps and Batch Size (Fabian Schaipp)
- Random Rewards, Real Gains: The Qwen RLVR Illusion
Show notes
On this episode we dig into "Spurious Rewards: Rethinking Training Signals in RLVR" from Shao, Li, Xin, Geng and colleagues. They show that reinforcement learning with completely random or even wrong rewards still boosts Qwen2.5-Math-7B on MATH-500 by roughly twenty points — but the same trick does nothing for Llama3 or OLMo2. We unpack the real mechanism (a pretraining behavior they call code reasoning), the causal ablations that pin it down, and what it means for anyone reporting RL gains on a single model family. **Sources** - Spurious Rewards: Rethinking Training Signals in RLVR
- One Layer to Rule the RL
Show notes
A layer-wise study of RL post-training finds that training a *single* mid-stack transformer layer — with everything else frozen — recovers most of the gains from full-parameter RL, and sometimes beats it. The authors introduce "layer contribution" to quantify this, and show the pattern holds across seven models, three RL algorithms, and math, code, and agentic tasks. Maya and Ethan unpack what that means for where RL actually lives inside a network — and what it might imply for how we post-train visual generative models. **Sources** - Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training
- Fixing a Bad Fold at Inference Time
Show notes
A look at SILR, a real-world cloth-manipulation stack that takes a brittle base policy and refines it *at inference time* by rolling out candidate actions inside a fast deformable-object simulator called FLASH. We dig into the three pillars — the sparse-mesh simulator, an RGB-native real-to-sim module built on frozen DINOv2 plus learnable canonical tokens, and prior-guided MPPI — and what the numbers actually show, including the jump from roughly 1-to-3 out of 10 folds to 8-to-9 out of 10. We also draw out the "wrap the policy with test-time compute" parallel for video and world-model folks. **Sources** - Enabling Robust Cloth Manipulation via Inference-Time Simulator-in-the-Loop Refinement
- A Human in Every Episode: The HABIT Dataset
Show notes
HABIT is a bimanual robot manipulation dataset where a person shares the workspace in *every* episode — a deliberate break from the human-absent corpora most policies train on. We walk through its three interaction roles, the camera-visibility grounding rule that keeps every trigger cue in the data, and the results: fine-tuning π0.5 and GR00T N1.6 on HABIT beats a robot-only baseline, and mid-training on it transfers as a reusable prior. We close on what this argues for teleop data collection in visual generative and embodied models. **Sources** - HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulation
- Beating Frontier Models at Their Day Job
Show notes
Thinking Machines Lab and Bridgewater's AIA Labs fine-tuned an open-weight Qwen3-235B on six financial document-triage tasks, beating the best frontier baseline — 84.7% vs 78.2% accuracy, 29.8% fewer mistakes — at 13.8× lower inference cost. We dig into the load-bearing pieces: an expert-labeling pipeline that routes only model-label disagreements to humans, plus a three-part RL recipe of interleaved batching, CISPO with asymmetric clipping, and on-policy distillation with a promoted teacher. The obvious read-across for image and video model teams: taste-driven judgment tasks may be a fine-tuning problem, not a prompting one. **Sources** - Learning to Replicate Expert Judgment in Financial Tasks — Sarah Su, Kevin Zhu, Emily Xiao, Rohan Alur, Daniel Kang
- Labels Now vs. Labels Later: Markov's Gaming Data Drop
Show notes
Dev Mandal and Markov AI announced a 500+ hour open-source gaming dataset — screen recordings of Valorant, Minecraft, and GTA paired with keystroke and mouse traces, framed as the largest open-source gaming dataset for computer-use. We unpack why native OS-level action labels matter, how this contrasts with overlay-parsing approaches like NitroGen, and where a small-but-distributionally-rich corpus fits into world-model work. **Sources** - Markov AI gaming dataset — 500+ hours of Valorant / Minecraft / GTA gameplay screen recordings + keystrokes/mouse
Sources: tweet-devvmandal-2026-07-01 - Muon's Hidden Tax: When Faster Optimization Forgets to Generalize
Show notes
Muon is the fast new optimizer everyone's adopting — but Dragutinović, Zhang, and Ranganath argue the speedup isn't free. Using a simplified, exact-SVD version of Muon they call Spectral GD, they show it drops the saddle-to-saddle simplicity bias that plain gradient descent preserves, learning all singular components in parallel instead of low-rank-first. We walk through the theory on deep linear networks, two head-to-head experiments where SGD beats Muon, and what a "learn everything at once" bias might mean for low-rank shared structure in T2V and MMDiT pretraining. **Sources** - To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters — Sara Dragutinović, Yedi Zhang, Rajesh Ranganath
Sources: 2603.00742-use-not-use-muon-how - The World Model That Rewrites Itself Mid-Plan
Show notes
AdaJEPA is a JEPA-family latent world model that does self-supervised test-time adaptation *inside* the MPC loop — it plans, acts, uses the observed next-state transition to update itself, then replans. The authors report substantial gains in goal-reaching planning success with as few as one gradient step per replan, with the strongest gains under distribution shift and limited training data. Maya and Ethan unpack the plan-act-adapt-replan loop, where the signal actually comes from, and what it might mean for video world models. **Sources** - AdaJEPA: An Adaptive Latent World Model — Ying Wang, Oumayma Bounou, Yann LeCun, Mengye Ren
- Robot Policy Eval Is a Serving Problem
Show notes
A walk through Anyscale's Ray-based reference architecture for large-scale robot policy evaluation in simulation. We unpack the core move — disaggregating GPU-heavy policy inference from GPU-heavy physics simulation, connecting them over HTTP, and amortizing the hop with action chunking — using their worked example driving a Unitree G1 humanoid with NVIDIA's GR00T-N1.7-3B. We also draw out what the pattern means for anyone scaling image and video model evaluation. **Sources** - Scale Robot Policy Evaluation with Ray (Distributed Sim-Eval on Anyscale) — Ian Jordan, Alicia Chua, Artur Niederfahrenhorst, Omar Shorbaji
- Vibecoding Your Robot: DimOS and the Deployment Plane
Show notes
This week we dig into **DimOS**, an open-source, ROS-free Python SDK and runtime for building agent-driven robotics apps — where the primary user isn't a human engineer but a coding agent. We walk through its three primitives (Modules, Blueprints, and an MCP surface), the daemon-based CLI, and why exposing robot skills as MCP tools matters for anyone shipping VLA policies onto real hardware. **Sources** - DimOS — The Agentive Operating System for Physical Space (v0.0.13)