Co-founder and Chief Research Officer @RhodaAI
Scaling visual intelligence toward physical AGI.
Prev: @Stanford @UTAustin @FAIR.changan.io Bay Area, San FranciscoJoined December 2015
I am thrilled to join rhoda.ai@RhodaAI as an advisor, where I am helping harness the abilities of large-scale pre-training and video models for robotics, putting many of my lab's research learnings of the past few years into practice! I will be in-person at the Mountain View office for part of the summer - reach out if you want to chat :)
One theme came up over and over in the past few days: excitement around world models for robotics. 🤖
The interest from the research community has been incredible. It feels like we’re entering a new phase for physical AI by approaching it with real time video models!
🙏 We’re incredibly grateful to everyone who joined our @RhodaAI party last night at @CVPR.
The turnout exceeded anything we expected, and it was a pleasure meeting so many researchers and builders from the vision / robotics community. Thank you for all the great conversations!
I’ve known Yuejiang and worked with him for many years. He’s always curious, humble, and eager to learn new things.
He's not only a fantastic researcher but also one of the best mentors I've worked with.
If you're pursuing a PhD in embodied AI, consider applying to his lab!
Excited to share that I’ll join @NUSComputing as an Assistant Professor in 2027
🏛️ I’ll build LEMA Lab: lema-nus.github.io, study the principles of embodied intelligence, & empower every lab member to thrive
📢 Recruiting 3-6 PhD students in the next application cycles
We’re hiring across research and engineering 🚀
Open roles:
• video model pre-training
• robot post-training
• ml infrastructure
• deployment
• phd internships
Careers: rhoda.ai/careers
I'll be at CVPR next week (6/3–6/7). If you’re working on or exploring opportunities in video models for robotics (research or engineering), happy to chat 🤖
We’re also hosting a Rhoda party Thursday night with many of our technical team in town. DM me for an invite 🍻
Can a large foundation video model run as a real-time robot policy at the edge, on a single RTX 5090?
• ✅ No quantization
• ✅ No distillation
• ✅ Full denoising (all the way from noise to clean video)
We just proved it's possible. 👇🎬
@GeneralistAI@BerkayAntmen@RhodaAI Great to see the shell game getting traction! Long-context memory is genuinely hard to get right. Good to see the robot learning field paying more attention to long-context visual memory.
Here’s something we’ve never seen done before.
Real-world tasks are long and ambiguous. Solving them requires visual memory and state tracking. Most robot policies only see the last few frames. Ours doesn't.
We put our DVA, FutureVision, to the perfect testbed: the shell game
@rhodaai While this may seem like a simple task, it requires long-context memory and the ability to reason about object motion across an entire sequence. This capability is naturally supported by our video models that are trained on large-scale video data.
We are entering a new era of robot deployment.
With our model, teams can iterate on solutions and data collection more rapidly thanks to highly efficient training. What once took months can now be achieved in as little as 19 days, bringing development to an entirely new pace.
1/ We are speed running industrial robotics.
It took us just 19 days from the first day of data collection to filming a 2.5-hour continuous run of our model autonomously breaking down industrial containers — zero human intervention.
The data efficiency of our DVA model is
@karpathy This is cool! I wonder what you think about the following potential issues:
1. How does the agent avoid getting stuck in local minima during exploration?
2. How well does training on a small model translate to larger-scale models with significantly more compute and data?
23K Followers 477 FollowingAssociate Professor @UTCompSci | Director @NVIDIAAI Co-Leading GEAR | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my own
10K Followers 980 FollowingAssistant Professor @Cambridge_Eng, working on 3D computer vision and computer graphics, previously postdoc @StanfordSVL, PhD @Oxford_VGG
8K Followers 2K FollowingAssistant Professor @CMU_Robotics @SCSatCMU, leading the @LeCARLab. @Amazon Scholar @ FAR. I build generalist robots with agility. Ph.D. from @Caltech.
12K Followers 1K FollowingAssistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at Berkeley
22K Followers 1K FollowingProfessor @ucsantabarbara. Head of Research @SimularAI. Director @ucsbcrml @UCSB_AI. Build the Science of Multimodal AI Agents. AI for Humanity in the long run.
20K Followers 329 FollowingBuilding AI that learns by interacting with the world. Associate Professor @ MIT, leading the Scene Representation Group (https://t.co/h5gvhLYZj4).
9 Followers 52 FollowingResearch Scientist of ByteDance. Intern at Google, ByteDance, and Microsoft Research Asia. My research interests are interactive world models and robotics.
567K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
23K Followers 477 FollowingAssociate Professor @UTCompSci | Director @NVIDIAAI Co-Leading GEAR | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my own
102K Followers 738 FollowingVP Digital Human Research, Epic Games. Emeritus Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Opinions are my own.
840K Followers 354 FollowingTogether with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
1.5M Followers 274 FollowingThe engine room of @Google. Building AI safely and responsibly to solve the world’s most complex problems. Join us: https://t.co/jUHQA27iBL
10K Followers 980 FollowingAssistant Professor @Cambridge_Eng, working on 3D computer vision and computer graphics, previously postdoc @StanfordSVL, PhD @Oxford_VGG
4K Followers 342 FollowingAI Research at Meta SuperIntelligence Labs. Former Director @wayve_ai @allen_ai.
Best/Outstanding papers at CVPR, Neurips, CoRL, IROS and ICRA.
7K Followers 1K FollowingAssistant Professor at @NUScomputing | Robotics & AI PhD @uwcse | Host of @RoboPapers | Ex-@allen_ai robotics lead, @NVIDIA
my opinion is my alone.
3K Followers 988 FollowingScaling video world models for robots @RhodaAI |
Built 1st version of ManiSkill https://t.co/NuQOXaNhud |
Prev @UCSanDiego @1x_tech @NVIDIA @MSFTResearch
27K Followers 807 FollowingMeta MSL. I led PoT, MMMU, MMLU-Pro, ClawBench, MAmmoTH, General-Reasoner, VL-Rethinker, VLM2Vec. I contributed to Gemini-2.5 and Muse Spark series.