BURKOV @burkov
Books: https://t.co/0EmPM3De9B & https://t.co/45NGbbXIzC App: https://t.co/n2jvMtYhVm PhD in AI, author of 📖 The Hundred-Page LMs Book & The Hundred-Page ML Book linktr.ee/burkov Québec, Canada Joined June 2009-
Tweets24K
-
Followers58K
-
Following121
-
Likes11K
A standard transformer keeps every past token in memory and looks back at them through attention whenever it needs to, so it never has a reason to boil down its history into a small summary that it updates one step at a time the way a recurrent network does. This freedom helps the model fit its training data, but it often leaves the model's internal representations disorganized, so the model fails on inputs different from those it trained on. The Manhattan taxi example considered in the paper demonstrates this: a model trained only on turn-by-turn routes learns to predict legal turns correctly, yet when researchers reconstruct the street map the model has effectively built from its own predictions, that map is full of impossible roads. The authors of this paper from Microsoft Research introduce Next-Latent Prediction, an extra training objective that asks the model to predict its own next internal state (the compressed vector it forms after reading each token) from its current state plus the next token, using a small separate network to model that one-step transition. The authors prove that a model satisfying this consistency condition is forced to compress its history into a "belief state," meaning a summary that holds everything needed to predict the future and nothing redundant, and they show this can be done without slowing the transformer's fast parallel training. The helper network also leaves inference untouched, since it is used only during training and discarded afterward. Across taxi-route world modeling, an arithmetic reasoning game, graph path-finding, and full language-model pretraining at the 1.3-billion-parameter scale, the method yields more compact internal representations, better planning, and a useful side effect for speed: because the small transition network can be run forward on its own to guess several upcoming tokens, the model can verify multiple tokens at once and run inference up to about three times faster. chapterpal.com/s/6d62f92c/nex…
Since they took the stillborn Metaverse from Zuck, all he does at Meta looks like sabotage.
NEW: Meta has reportedly paused its AI training program that recorded employees’ keystrokes & mouse movements after an internal leak exposed sensitive data companywide.
@RanDomAjy @elonmusk It's not supposed the be this way. There's no technical difficulty in fixing this.
Hey, @elonmusk, could you please address this injustice on X already? When someone replies to your post or comment with an insult and then blocks you so you cannot tell them who they are, it's unfair. It's my comment, and they replied to it. I must be able to reply. Otherwise, it's like kicking someone in the back and hiding behind a closed door. Unfair.
Childish argument. First of all, we all know there are plenty of stupid permits and limitations in Europe, take Germany for example. Second, we all know that many countries do have rules forbidding lowering the indoor temperature below some ridiculous threshold. Third, you don't need to force plebs to do something. You can simply make it too expensive or you can shame them and the plebs will choose to do that on their own.
Only about 25% of French households have air conditioners. Not that I'm shocked, but only because I already knew that European citizens are forced to take a shower only a couple of times a week and wear sweaters at home in the winter. No sane person without the Stockholm syndrome would accept living in such conditions in 2026. European bureaucrats and left-wing politicians are working and living in air-conditioned spaces, but the average European citizen lives in a medieval castle. All hotels I ever stayed in Europe have air conditioners, because why would anyone respect the aborigine, right? npr.org/2025/08/19/nx-…
@ACEaceACE4ce I would not fact-check a bot, especially when its comment is irrelevant. Not having an air conditioner in 2026 and not being able to have one is outrageous enough on its own.
@_DataStrategies There are various ways to force people into doing something. Making something too expensive or shaming for doing something are two such ways. ec.europa.eu/eurostat/fr/we… group.vattenfall.com/press-and-medi…
@RalphAichinger Not really. It might sting depending on the wool. I prefer pajamas.
@zcserei Fart anything once again and it will be your last fart here.
@RalphAichinger Indeed. Why also not wearing ski pants and boots indoors?
@zcserei I have data, and you, dumbass? ec.europa.eu/eurostat/fr/we… group.vattenfall.com/press-and-medi…
@GaryMarcus They are most likely cooking something awesome with the World First AI Software Engineer, Devin 😆
The Sakana Fugu technical report: chapterpal.com/s/7ff4f6ba/sak…
My take on Sakana Fugu is available to Cool Supporters on Substack, Patreon, and Buy Me a Coffee: aiweekly.substack.com/p/on-sakana-fu… patreon.com/burkov/posts/o… buymeacoffee.com/burkov/on-saka… Also, I just published a couple of days ago my take on GLM-5.2. Become a Cool Supported and stay informed about what you should care about and get other perks such as early access to new book chapters and signed books.
@atomic_chat_hq "surprisingly performed near GLM 5.2." It is "orchestrating" frontier closed-weight models and cannot even beat them. It's an embarrassment.
Free and open frontier AI is the first truly communist gift China has given to humanity. It's the first such gift since the Soviet Union gave the workers of the world gender equality, an 8-hour workday, a month of vacation, and social security. Without China, three fat U.S. capitalists would still be selling us GPT-3.7 with ads.
Sebastian Raschka @rasbt
467K Followers 1K Following ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)
elvis @omarsar0
309K Followers 879 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Kirk Borne @KirkDBorne
485K Followers 3K Following Advisor to startups. Freelancer. @LeadershipData founder. Global Speaker. Top #B2B influencer & social promoter #DataScience #AI #ML. PhD Astrophysics @Caltech
MIT CSAIL @MIT_CSAIL
347K Followers 20K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected] Check out the latest CSAIL content ⬇️
abhishek @abhi1thakur
101K Followers 1K Following
Jean de Nyandwi @Jeande_d
49K Followers 1K Following Incoming CS PhD @CarnegieMellon • NLP, Data, Evals, Human + AI • CMU MS '24. Blog: https://t.co/1BEFLZAY3F ML: https://t.co/7PkTyDw2gQ
Pau Labarta Bajo @paulabartabajo_
70K Followers 335 Following Citizen of the World who teaches AI that works | @liquidai | Maths Olympian | Father of 1… sorry 2 | Opinions are my own
Turing Post @TheTuringPost
86K Followers 9K Following On X we surface the AI research that matters and explain the ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
Gary Marcus @GaryMarcus
229K Followers 7K Following OG GenAI Skeptic; spoke at US Senate. Warned about hallucinations in 2001. Advocating world models & neurosymbolic AI ever since. Author, Marcus on AI & 6 books
Alejandro Piad Morffi... @alepiad
16K Followers 1K Following Democratizing knowledge one keystroke at a time. PhD in NLP, full-time professor, CS Department @UdeLaHabana. Co-founder @syalia_srl.
kirsten lum @kirsten_lum_
11K Followers 926 Following 🌲🌲 follower the way | applied AI, data science | wife of @wingyewlum, mom of 2 | cofounder and cto building https://t.co/TBEWa1IYzH
Lior Alexander @LiorOnAI
116K Followers 2K Following Founder @AlphaSignalAI → the Intelligence layer of AI (300k users) • MIT Lecturer • ex-MILA researcher • In ML since GANs
Omar Sanseviero @osanseviero
70K Followers 3K Following MTS at @GoogleDeepMind Building Gemini, Gemma, AI Studio and more. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
Hamel Husain @HamelHusain
50K Followers 3K Following Evals Evals Evals - https://t.co/Zrmp6LRd9c About Me: https://t.co/P6WyeKkyTa
Nick Singh | The Data... @NickSinghTech
33K Followers 4K Following Author of Ace the Data Science Interview. Free Book Preview 👇 https://t.co/1izgOFy1Kt Founder of https://t.co/yyE4B5Ltpf (SQL Interview Prep) Ex-Facebook
Jay Alammar @JayAlammar
50K Followers 1K Following Machine Learning Researcher and writer https://t.co/5GlbofAHs0. O'Reilly Author https://t.co/Fl3uPAZHLg. LLM Builder @Cohere.
Machine Learning FLX @machinelearnflx
171K Followers 28K Following ML & AI Engineering • LLMs • MLOps • Data Engineering • Practical AI systems, architectures, tools and curated resources for AI.
Daniel Bourke @mrdbourke
19K Followers 591 Following • Technical Staff @artificialanlys • Teaching AI/ML @zerotomasteryio • Building @nutrifyfoodapp
(((ل()(ل() 'yoav)))... @yoavgo
83K Followers 2K Following
forrest wang @forrest201217
32 Followers 149 Following
Abhinav SB @Abhhinav_SB
292 Followers 704 Following Redefining the future of scientific discovery with AI systems engineered for accelerated innovation. | Cofounder and CTO at https://t.co/mpr5GZfcJk | AI4Science
Giorgio Canale @GiorgioCanale
4 Followers 70 Following
martian.77 @77Martian
0 Followers 3K Following
Janice @kirk19KK
299 Followers 3K Following It`s not called being whipped , it`s called having respect for your girl.
- @moggcap
32 Followers 532 Following
Fernando Ulrich @fernandoulrich
273K Followers 2K Following Partner at Liberta Investimentos. @libertainvestir . Board Member and Founding Partner at @OranjeBTC
CuriousCats @CuriousCats_US
109 Followers 17 Following CuriousCats fetches the most important opinions, news and videos from across the internet. Get your personal brief at https://t.co/ceAaoIEynC.
Universal Basic Ideol... @debugtweets
219 Followers 2K Following CMU ECE debugging public health & macroecon. AI ends labor; Universal Basic Land (UBL) is the structural fix. Georgism. Curiously strong antitrust.
🅲🅷🆁🅸🆂 @ChrisEngineer42
2 Followers 297 Following Carpe Diem - YOLO | Family | Navy Engineering LDO ⚓️ | Patriot 🇺🇸 | Power Systems Engineer⚡️ | Ai • Tech • Robotics
wang xk @wangxk3
18 Followers 471 Following
poe lake @LakePoe723
3 Followers 118 Following
Léo @LeoKharon
49 Followers 186 Following I write about robots and AI. Co-host @roboticsstack, the weekly pod on what's actually shipping in 🤖
Buğra @metrodweller
44 Followers 959 Following
turgay leichtfuß @turyildiz
463 Followers 4K Following anotalien, hikikomori, ἐργομίσης. #dogs, #fullstack, #blockchain, #psycore, #madscience, #southeastasia. festina lente. Ⓐ
Youssef @YoussChawki
13 Followers 148 Following
Estherjjl @EstherJJL
0 Followers 401 Following
bc @beecxyz
8 Followers 380 Following
Reef Menaged @ReefMenaged
12 Followers 121 Following Undergraduate Researcher @HebrewU | NLP • LLM Agents • Interactive Learning 🚀
wnb @weysller
34 Followers 2K Following
Tao @tao3894
17 Followers 689 Following
Plasmic @plasmicapp
5K Followers 2K Following The open source visual development platform for React. Build beautiful apps, sites, and content fast—without compromise. Break the no-code ceiling.
Ayham☮️ @ayhamkan
45 Followers 755 Following Data Scientist! | "Too many parameters, too little time." | Give peace a chance, don't fuel wars | Opinions my own.
PUNDITOOR @thepunditoor
229 Followers 3K Following Multi-disciplinary Capital Allocator Turning Chaos Into Coinage
Ahmed Fathy @afathykhalid
13K Followers 77 Following CTO @ https://t.co/ZWfDFdANDu | Founder @ https://t.co/5biZkYIJ4G
ElijahLikesTech @Elijahdavidg
3 Followers 110 Following
Gleb Mazovetskiy @glebm
2K Followers 2K Following https://t.co/hwqoTjIysY ☂🧦 🇺🇦🇮🇱. 🌐: en, ja, es, ru. I work on speech at Google DeepMind. As a hobby, I port old games to obsolete or obscure hardware.
TristamTechAI @TristamTechAI
20 Followers 3K Following
denvit @denvit91
1K Followers 1K Following 👨💻 Adobe Commerce/Magento 2 - Laravel - React+VueJS developer from 🇸🇮 | Tech blog at https://t.co/r8CimmHduA
Jooney @jooney0909
12 Followers 461 Following
yoe @yoxei101
19 Followers 2K Following
Lucas Mandai @lucas2051337
0 Followers 82 Following
Astronauthi @astronau_thi
73 Followers 902 Following Murphy's law doesn't mean that something bad will happen. It means that whatever can happen, will happen. And that sounded just fine to us.
Saikrishna Poluri @sai_krishpoluri
130 Followers 2K Following Data Engineer By Profession. I am contributing my two cents using https://t.co/UVkGhVA0r5 || https://t.co/7mmd9KnTnd
Sundar Swaminathan @idonttweetgen
35 Followers 2K Following
Bruno Almada @23123121rf33xx
0 Followers 8 Following
Sebastian Raschka @rasbt
467K Followers 1K Following ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)
elvis @omarsar0
309K Followers 879 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Kirk Borne @KirkDBorne
485K Followers 3K Following Advisor to startups. Freelancer. @LeadershipData founder. Global Speaker. Top #B2B influencer & social promoter #DataScience #AI #ML. PhD Astrophysics @Caltech
MIT CSAIL @MIT_CSAIL
347K Followers 20K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected] Check out the latest CSAIL content ⬇️
abhishek @abhi1thakur
101K Followers 1K Following
Jean de Nyandwi @Jeande_d
49K Followers 1K Following Incoming CS PhD @CarnegieMellon • NLP, Data, Evals, Human + AI • CMU MS '24. Blog: https://t.co/1BEFLZAY3F ML: https://t.co/7PkTyDw2gQ
Google DeepMind @GoogleDeepMind
1.5M Followers 278 Following The engine room of @Google. Building AI safely and responsibly to solve the world’s most complex problems. Join us: https://t.co/jUHQA27iBL
Turing Post @TheTuringPost
86K Followers 9K Following On X we surface the AI research that matters and explain the ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
AI at Meta @AIatMeta
810K Followers 322 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Alejandro Piad Morffi... @alepiad
16K Followers 1K Following Democratizing knowledge one keystroke at a time. PhD in NLP, full-time professor, CS Department @UdeLaHabana. Co-founder @syalia_srl.
PyTorch @PyTorch
499K Followers 87 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Lior Alexander @LiorOnAI
116K Followers 2K Following Founder @AlphaSignalAI → the Intelligence layer of AI (300k users) • MIT Lecturer • ex-MILA researcher • In ML since GANs
Hugging Face @huggingface
711K Followers 222 Following The AI community building the future. https://t.co/TpiXQMQ9rZ
Machine Learning FLX @machinelearnflx
171K Followers 28K Following ML & AI Engineering • LLMs • MLOps • Data Engineering • Practical AI systems, architectures, tools and curated resources for AI.
Ville de Québec @villequebec
87K Followers 605 Following Twitter officiel de la Ville de Québec - Animé par le Service des communications, de 8h30 à 16h30. Plaintes ou demandes d'intervention: 311 ou https://t.co/0vvHJLXkTC
Jeff Dean @JeffDean
446K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Ian Hogarth @soundboy
25K Followers 4K Following investor at @pluralplatform, chair UK AI Security Institute, co-founder @songkick
DAIR.AI @dair_ai
127K Followers 1 Following Democratizing AI research, education, and technologies. Learn about AI Agents for FREE at https://t.co/HHXg8rryu4
Alexia Jolicoeur-Mart... @jm_alexia
25K Followers 2K Following Principal Researcher @ Microsoft 🐱💻 2025 ARC Prize Winner I build generative AI for images, videos, text, tabular data, weights, molecules, and video games.
Jen Zhu @jenzhuscott
63K Followers 1K Following Cofounder/CEO, Power Dynamics (AIDC cooling tech + ESS BYOE 12GWh p.a. output) | Cofounder, Tech Fellowship & Moderator of Socratic seminars @AspenInstitute
Chris Laub @ChrisLaubAI
26K Followers 499 Following Founder - Programmatic Persuasion | AI subsidy abuser | Trilingual surfer living overseas since '13
Robert Youssef @rryssf
40K Followers 12 Following Building @godofprompt & @prompt_copilot Agentic Memory and Context Engineering
Sergey Levine @svlevine
131K Followers 143 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
ChapterPal @ChapterPal
524 Followers 4 Following An intelligent reading partner designed for students, researchers, and lifelong learners. Read at your own pace and get help from AI if you are stuck.
Toby Pohlen @TobyPhln
163K Followers 612 Following Sleeping. Previously founding team @xAI, engineer @GoogleDeepMind. @RWTH alumnus.
Yuchen Jin @Yuchenj_UW
187K Followers 788 Following Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.
Denis Loginoff ⚡️ @DenLoginoff
1K Followers 743 Following Trier of things, solopreneur, @MIT grad diy/acc 👔 https://t.co/NPHwa8MZfE 📰 https://t.co/wTQhHj57ts 👾 https://t.co/wXQ3oPTryp
Jason Knight @onejasonknight
33K Followers 82 Following London-based B2B product consultant & coach, excellent podcaster and thinker of random thoughts
Richard Sutton @RichardSSutton
65K Followers 59 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award
Teortaxes▶️ (Deep... @teortaxesTex
67K Followers 3K Following We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization. @deepseek_ai stan #1, 2023–Deep Time «C’est la guerre.» ®1
Teknium 🪽 @Teknium
105K Followers 6K Following Cofounder and Lead Engineer - Hermes Agent @NousResearch, prev @StabilityAI Github: https://t.co/LZwHTUFwPq HuggingFace: https://t.co/sN2FFU8PVE
David @DavidSHolz
118K Followers 10K Following founder @midjourney, previously founded leap motion, before that was at nasa and max planck - vibeposting @davidvibesonly
Dr. Roman Yampolskiy @romanyam
160K Followers 709 Following Professor of Computer Science. AI Safety & Security Researcher. For Talks: [email protected], Interviews: [email protected]
Peter Yang @petergyang
227K Followers 2K Following Practical AI tutorials and interviews for busy people | Join 150K+ readers at https://t.co/XYKTmGVH14
Ewan Morrison @MrEwanMorrison
33K Followers 17K Following Untopian. New novel: FOR EMMA. https://t.co/R6y8pSxyV8 Agents: @DMilaschewski @CBTheatreFilmTV SUBSTACK: https://t.co/R5m8LINRh8
Brian Merchant @bcmerchant
29K Followers 3K Following author: BLOOD IN THE MACHINE and THE ONE DEVICE editor: TERRAFORM formerly: LA Times tech columnist, Motherboard, etc NEWSLETTER ----------v
Shane Gu @shaneguML
50K Followers 2K Following Gemini/Omni Thinking, Senior Staff AE @GoogleDeepMind. 🇯🇵-born 🇨🇳🇨🇦. ex: Gemini 1.5-3, GPT-4 @OpenAI, Google Robotics (JP: @shanegJP). Personal opinions.
Balaji @balajis
1.7M Followers 4K Following Author of the Network State. Founder of the Network School.
Charlie Snell @sea_snell
8K Followers 6K Following PhD student @berkeley_ai; research @cursor_ai; prev @GoogleDeepMind. My friend told me to tweet more. I stare at my computer a lot and make things
Machine Learning Stre... @MLStreetTalk
39K Followers 753 Following MLST is by Dr. Tim Scarfe @ecsquendor w/ cameos from @DoctorDuggar https://t.co/5YCv2SdFwN (early access/priv.discord) - Sponsor us!
Simeon Emanuilov @s_emanuilov
313 Followers 142 Following Senior Software Engineer, PhD | Production ML systems & AI products | Founder UnfoldAI | Sharing real-world insights on building scalable systems
Demis Hassabis @demishassabis
1.3M Followers 175 Following Nobel Laureate. Co-Founder & CEO @GoogleDeepMind - working on AGI. Solving disease @IsomorphicLabs. Trying to understand the fundamental nature of reality.
Brad Neuberg @bradneuberg
12K Followers 9K Following Tech Lead for Edge Compute/Staff ML Engineer @ planet. Prev Dropbox & Google. Started coworking. Interests: EO, ML, Space, XR. https://t.co/m7fXSRYQW3
James V @james_mtc
26K Followers 5K Following CTO, CAIO, and VC/PE Board Advisor. Former head of AI @NASA CAS and tech wonk for @WhiteHouse, DOD, and DOJ. Tweets are my own.
Mark Saroufim @marksaroufim
16K Followers 997 Following Amdahl comes for us all mts & co-founder @coreautoai @pytorch @gpu_mode enjoyer
Filip Piekniewski🌻... @filippie509
10K Followers 549 Following Hype-free rational view on AI. Also on threads: @[email protected], https://t.co/mwZKgJgrN2 Caution: will block ad hominem instantly.
Peter J. Liu @peterjliu
9K Followers 3K Following Building @getcompoundai (hiring: https://t.co/7kGFr76pcX). Was Research Scientist @ Google Brain / DeepMind, language model research. 🇨🇦🇺🇸



























