NEW MODEL: Roblox now has its own world model!
DEFINITIONS:
- World model: an AI model that learns to predict what happens next in an environment.
- ControlNet-style conditioning: a technique from image generation where a side network feeds a precise spatial guide (here the draft frame and depth map) into the generator, forcing the output to follow that structure pixel for pixel.
- Cross-attention: the mechanism that lets the generator "look up" side information (here, object descriptions) while producing each patch of the image, instead of having it baked into the input.
- Latents: the compressed internal representation a generative model works in.
- Self-forcing: a training trick that converts a video model built to generate whole clips offline into one that emits frames one at a time from its own previous output, which is what makes live streaming possible.
- KV cache: the transformer's running memory of everything it has generated so far.
Roblox Reality is a WIP "hybrid architecture" for photorealistic multiplayer games.
The game engine, running in Roblox Cloud across 20–26+ edge data centers, holds authoritative world state (positions, velocities, materials, physics, collision, ray tracing) as the single source of truth and emits a low-quality draft frame plus a depth map, lighting/weather data, and structured object descriptions.
A video world model called the Super Upsampler, running on H200/B200-class edge GPUs, takes that draft as conditioning and repaints each frame into 2K photorealistic video (target 60fps), streamed to the client.
It is meant to replace the traditional setup where high-fidelity rendering demands powerful user hardware and a large art budget.
Worth specifying imho: this is not a world model as we usually expect.
It is not generating the world.
The engine still renders a real draft frame with true physics and state, and the model only repaints pixels on top of it.
Dense signals (draft frame + depth) inject via ControlNet-style nets, global lighting/weather via modulation, object descriptions via cross-attention.
The name "Super Upsampler" is more honest imho.
Roblox explicitly rejected "pure" video world models because they can't do multiplayer, rule enforcement, persistent state, or reliable control.
Nothing is cached and inference is per-player, per-frame: appearance lives only as video latents regenerated continuously and never saved, and each player runs their own model generating their own view -> pretty impressive and compute intensive imho.
Durable world state (position, velocity, materials, direction) lives server-side in the engine's data model and is shipped identically to every client.
Appearance is ephemeral latents each client regenerates.
Player input (WASD) feeds straight into the model as conditioning, with client-side predictive simulation for immediate responsiveness, and locally-rendered upsampled avatars optionally overlaid to keep foreground actions low-latency.
With regards to compute, Roblox owns 20–26+ edge data centers and its own proprietary GPUs, deliberately avoiding cloud provider dependency.
The latency ask is ~30ms/frame, Roblox closes it with "self-forcing" (converts the offline model into autoregressive, frame-by-frame streaming generation), smaller models, key-value cache compression (needed at all for high resolution), and edge GPUs co-located with the game engine.
Roblox did three acqui-hires in this space: Morpheus AI (self-forcing + long context to fight drift), Lucid AI (the "Game Cartridge Harness" that wraps deterministic engine logic around the model so rules hold), and Dynamics Lab (real-time image-to-world generation).
22K Followers 20K Following3D NFT Brand tied to Movies Produced by Film & Television Actress, Recording Artist & Producer @DarcyDonavan .
Minting Now
https://t.co/eZxJE9Bt5f
1K Followers 2K FollowingNo emotions, just power, anime runs in my veins, walking like a villain, feared by many, understood by none, chaos is my true identity✨
765 Followers 2K FollowingIt get tweaky in the trenches. | NFTz | Investor | Collector | Builder | Trader | GoMining Ambassador ⛏️ | Nobody said it would be easy | RHC 💚
4K Followers 7K FollowingMY REDEEMER LIVES.
MY BOSS IS A JEWISH CARPENTER.
SC VILLA JOGOO die hard as MANCHESTER UNITED fan.
CIVIL ENGINEER and GRADER MACHINE OPERATOR
154K Followers 25 FollowingExperience the fastest onchain execution with unmatched rewards. Trade with Trojan on web or Telegram. Support: https://t.co/189iR2Aa1f | https://t.co/9yjZCpB2u7
2K Followers 167 FollowingCuenta oficial de Tangem para la comunidad hispanoparlante. Disfruta de la libertad de las criptos. Seguridad. Utilidad. Movilidad. Ecosistema.
32K Followers 980 FollowingCo-founder & CEO @dune. Down with music/books/crypto/tech/econ/running/outdoors/freestyle skiing/great design in any form factor/coffee/burgundy wine etc.