Lukas Fisch @codingfisch
Don't panic! Just build! https://t.co/FNuUXBB6HY Joined December 2013-
Tweets133
-
Followers197
-
Following103
-
Likes322
@kjaved_ @chris_j_paxton Can you share specifics about the new OaK implementation? Options and Knowledge is clearly what we currently lack in RL! Instead of learning one blob of weights a composable set of learned things is needed. E.g. what OOM parameter count is it? Thousand, millions or billions?
@mhutter42 The models show respect because they know that they are all slowly converging towards the AIXI model 😄
@__tinygrad__ @bsilone Does the exabox fit in a bike shed? Would love that picture just for the lolz 😄
@___Harald___ And this is the one true reward: ∃
@OosGergVer @__tinygrad__ He should reconsider: Selling chips w solid firmware and OSS stack on top -> other people fixing the OSS stack -> possible alternative to CUDA moat CUDA is why nvidia is worth that much
@__tinygrad__ These straighforward comparisons to LLMs are an insult to the brain. The brain runs so much more efficient software. LLM vs brain is like Windows 11 vs TempleOS. I liked the estimate in your blog post "Brain FLOPS": 162 GFLOPS.
@gadevenyi Oops, this one should work: github.com/wwu-mmll/deepm…
"deepmriprep: VBM preprocessing via deep neural networks" is published in Nature Computational Science 🧠💻 🔗 Paper: rdcu.be/e1t4N VBM preprocessing in ~10 seconds per #brain image 🚀 🔗 GitHub: github.com/wwu-mmll/deepm… Install via "pip install deepmriprep"
This really speeds up preprocessing and shows - yet again - that neural networks are eating software. Great work, @codingfisch !! Happy to see this finally published.
📢Out now! @codingfisch and colleagues present deepmriprep, a tool that leverages neural networks to enable 37x faster Voxel-based Morphometry preprocessing of MRI data than existing methods. nature.com/articles/s4358…
Not convinced? How about this: Christian Gaser (author of CAT12) is building his new SBM toolbox around deepmriprep: github.com/ChristianGaser…
📢Out now! @codingfisch and colleagues present deepmriprep, a tool that leverages neural networks to enable 37x faster Voxel-based Morphometry preprocessing of MRI data than existing methods. nature.com/articles/s4358…
@__tinygrad__ @ID_AA_Carmack RISC for array ops sounds too elegant to be impossible (as George said @clattner_llvm told him). I hope you will find the right abstractions to crush this problem soon!
Our GPU stack for both NVIDIA and AMD, aside from minimal pieces of signed firmware, is 100% open source and pure Python except for the compiler. It's not using vendor drivers, frameworks, or libraries. That's why it's so easy to make it work on Mac. For compilers, on AMD, we use upstream LLVM, and on NVIDIA, we use the NAK compiler from the MESA project. We plan to replace the compiler with pure tinygrad in a year or two as well. With RANGEIFY merged, our lowering stuff now matches the state of the art, TVM style. We're studying ThunderKittens and TileLang for speed at that level, and should have all this stuff ready in 200 days for the due date of our AMD Llama 405B training contract. Due to tinygrad's small size and pure Python nature, it's the easiest ML library to make progress on, aka fastest slope of improvement. With Megakernel style for scheduling, MODeL_opt style for planning, and E-graph style for symbolic, we should blow past the state of the art in PyTorch and JAX speed. If we do that, NVIDIA's moat is over. It's 1000 lines at most to add a new accelerator to tinygrad. And I don't mean to add a new accelerator with help from a kernel driver, compiler, and libraries. Just 1000 lines of software for the *whole* accelerator speaking right on the PCIe BARs, like what tinygrad is doing with the NVIDIA and AMD GPUs now.
This!
the solution is simple but you aren’t demoralized enough yet geohot.github.io//blog/jekyll/u…
These are special times 📈
Theorem: The maximum possible duration of the computational singularity is 470 years. Proof: The FLOPs capacity of all computers which existed in the year 1986 is estimated to be at most 4.5e14 (Hilbert et al. 2011). Based on public Nvidia revenue and GPU specs, this capacity
@eigenron Even better because only rollout is even faster! You can use the rollout function (see flashrl/main.py).
@eigenron Here is the repo: github.com/codingfisch/fl…
@eigenron Try "pip install flashrl" to make it even faster (on CPU and GPU). Write 6 lines of code to trains Pong in a few seconds!
thirteen @pineT0x
11 Followers 407 Following
Jiashun Zhang @JiashunZhang31
0 Followers 14 Following
mamba @conswellcank24
0 Followers 242 Following It is not about the destination, it is the journey #GoLakers #MambaOut
Daniel Martinez @GuyMartinez111
14 Followers 182 Following actively exploring human flourishing since i was 14
heavywan @rayparkir
12 Followers 28 Following
Pedram Mouseli @__pedram
168 Followers 474 Following PhD student @UofT, @PainUoft | Research analyst @KBI_UHN | AI & Neuroscience
Hao Wang @h_wang90
117 Followers 433 Following Hainan University, Assoc Prof. David Geffen School of Medicine at UCLA(2019-2021) Univ of Electronic Science and Technology of China (2017-2022).
Elowen Lyra @lowenlyra
5 Followers 131 Following “Founder & CEO of a U.S.-based marketing company | Driving brand growth through strategy, creativity & data | Marketing • Innovation • Leadership”
Donato Quiccione @Piovego_
73 Followers 826 Following We chose to do these things not because they are easy, but because we thought they were easy. PhD student | Algebraic Topology ∩ Neuroscience
Kyle Ratner @kyleratner
2K Followers 2K Following Experimental social psychologist, Department of Psychological & Brain Sciences at UC Santa Barbara.
Dr. Salim Al-Wasity @salim_alwasity
219 Followers 1K Following Computational Neuroscientist, PhD @ #Uoglasgow #CCNi_UoG | brain research | fMRI Neurofeedback | multimodal MRI | machine learning | deep learning
Giovanni Salum @gsalumjr
528 Followers 743 Following Associate Professor, Universidade Federal do Rio Grande do Sul
Charles Geier (he/him... @GeierBrainLab
2K Followers 5K Following Professor of HDFS @ UGA | Dev Cog Neuro | BS, MS OhioU | PhD Pitt | He/him/his | First Gen | Tweets = my views, not my employers' #Ally #BLM #Gratitude
Bruno Hebling Vieira ... @HeblingVieira
424 Followers 689 Following PhD in Physics Applied to Medicine and Biology || Postdoc at @UZH_en with @langer_nicolas || https://t.co/8UkDpKYo8b || sharing a paper doesn't mean I read it
Marcelo Valadares @mvaladares
208 Followers 1K Following Science, tech, art, humor & Neurosurgery (Movement disorders and pain).
!.! @xypyth
44 Followers 7K Following
JohnM @John7605718306
9 Followers 429 Following
Georgios Bakirtzis @bakirtzisg
3 Followers 219 Following
Christina @Ytritie1993538
288 Followers 7K Following Like to talk Do not hold any investment products
EXD-Canis @ExdCanis
0 Followers 69 Following
Plugyawn @plugyawn
360 Followers 691 Following writing as a rehearsal of language. language as a rehearsal of logic. pretraining research
Mohammad Edris Amarkh... @EdrisAmarkhil
14 Followers 2K Following
Blake Newberry @BlakeNewbempyq
0 Followers 13 Following
Muhammad Afif Faheem @afiffaheem09
0 Followers 14 Following
Amine ANDAM ⴰⵎⵉ... @AmineAndam
280 Followers 3K Following PhD student @UM6PCC | Adversarial Reinforcement Learning
luv @CakrBes27650
4 Followers 177 Following
Joseph Suarez 🐡 @jsuarez
31K Followers 124 Following I build sane open-source RL tools. MIT PhD, creator of Neural MMO and founder of PufferAI. DM for business: non-LLM sim engineering, RL R&D, infra & support.
Kinvert @KinvertOG
459 Followers 273 Following ME/AE/Dev - Seeking work - Worked on Aurora Semi Truck at Conti - Ex EDU Company Founder - Automater of Homesteads
Braxton Matthews @BMatthews8077
0 Followers 16 Following
Mihai Dinu @mihaidinu88
953 Followers 773 Following @roDigitalHealth CEO ⠙ Med Eng ⠙ Researcher ⠙ SWE ❙❙❙ https://t.co/6gkjC4igZD - multi-AI chat app 🌅 https://t.co/quUqxt6guy - elevate your QOL ╾╼ INTVL - medical stats
Patricia @Gg9eS5cQ60u9TQ
37 Followers 1K Following The strongest actions for a woman is to love herself, be herself, and shine amongst those who never believed she could.
Zephrone Vinas @ZephroneV83899
0 Followers 26 Following
Kamil Kret @kret_kamil
1 Followers 40 Following
Dr. Katharina Brosch @_kabro_
331 Followers 692 Following Science is magic that works✨ Postdoc at @zhhresearch @NorthwellHealth – Risk and Resilience / Neuroimaging
Georgina @1TI5xKDq5XOK7
44 Followers 760 Following
Yassine Yousfi @yassineyousfi_
3K Followers 2K Following Professional overfitter. Head of Machine Learning at @comma_ai
Dam_musk_ @madsw2cabrah
1K Followers 7K Following
Khurram Javed @kjaved_
6K Followers 191 Following Developing efficient algorithms for learning in big worlds @oaklab_ai Prev ~ Keen Technologies and PhD with Richard S. Sutton
Tufalabs @tufalabs
1K Followers 83 Following We are a small, independent research group working on fundamental AI research. The initial focus is on ARC
Ineffable Intelligenc... @IneffableLabs
9K Followers 0 Following Making first contact with superintelligence.
Larry Dial @classiclarryd
2K Followers 48 Following Technical Staff at Open Athena, working on Marin
antirez @antirez
75K Followers 795 Following Reproducible bugs are candies. I like programming too much for not liking automatic programming.
Daniel Hooper @DanielcHooper
11K Followers 234 Following Graphics/games/low level programming. Created https://t.co/8vlhOleF3K. Former Apple engineer.
Тsфdiиg @tsoding
116K Followers 439 Following Recreational Programming - https://t.co/0cNzC7z24Y - https://t.co/EilSXwJsXC - https://t.co/cPjxUvz266 ⠀⢀⣰⣾⡿⣶⣿⠿⣶ ⢠⣼⣿⣿⣷⣿⣿⣶⠉ ⢸⣿⣿⣿⣿⣿⣿⠀⠀
Ben Visness @its_bvisness
5K Followers 168 Following My help comes from the Lord. Lead of the Handmade Network (@handmade_net). WASM engineer at @mozilla. Mentor for @frc2175.
LAW Workshop@NeurIPS ... @LAW2025_NeurIPS
88 Followers 27 Following Bridging Language, Agent, and World Models 🧠🤖🌍
Dominic Szablewski @phoboslab
8K Followers 265 Following
GLADIA Research Lab @GladiaLab
5K Followers 25 Following Based in Rome, GLADIA is a team of computer scientists, physicists, engineers and mathematicians venturing beyond the boundaries of machine intelligence
george hotz archive @geohotarchive
9K Followers 4 Following Not George Hotz. Just an archive. We archive @comma_ai, @__tinygrad__ and @realGeorgeHotz videos for fun. [email protected]
Plugyawn @plugyawn
360 Followers 691 Following writing as a rehearsal of language. language as a rehearsal of logic. pretraining research
Marcus Hutter @mhutter42
5K Followers 54 Following I 👨🔬 a math. definition&theory of Artificial Super-Intelligence 🎥&🎤@ https://t.co/OZsooP9AbV 🍀 I now work @GoogleDeepMind 🧠 History:🇩🇪🇨🇭🇦🇺🇬🇧
SemiAnalysis @SemiAnalysis_
145K Followers 29 Following
Durk Kingma @dpkingma
55K Followers 403 Following @AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
Thien Tran @gaunernst
3K Followers 261 Following
Yassine Yousfi @yassineyousfi_
3K Followers 2K Following Professional overfitter. Head of Machine Learning at @comma_ai
Positron AI @positron_ai
2K Followers 51 Following Developing the next generation of machine learning hardware and software
alex zhang @a1zhang
36K Followers 964 Following phd student @mit_csail @nlp_mit, previously undergrad @princeton 🫵🏻 go participate in the @GPU_MODE kernel competitions!
Keller Jordan @kellerjordan0
18K Followers 449 Following CIFAR-10 fanatic Pretraining @OpenAI OpCo LLC.
SzymonOzog @SzymonOzog_
3K Followers 301 Following Maximizing throughput at @poolsideai Educating people about GPUs at https://t.co/81rRJ4KoUt I like my tea green and my compute parallel
Aleksey Vaneev @AlekseyVaneev
141 Followers 14 Following Owner and founder of Voxengo brand, software engineer, creator of PRVHASH, r8brain-free, BiteOpt, AVIR, other projects.
xjdr @_xjdr
29K Followers 724 Following building AI that wont embarrass me in front of my own standards
Nathan Lambert @natolambert
96K Followers 930 Following Open model research @ something new. Prev. co-led Olmo at Ai2. Contact via email. Writes @interconnectsai Wrote The RLHF Book, 🏔️🏃♂️
Quentin Lhoest 🤗 @lhoestq
5K Followers 331 Following Datasets @huggingface | Open Source + HF Dataset Hub
Logan Garbarini @LoganGarbarini
375 Followers 491 Following Surgery and robotics hardware @neuralink. via @tufts. from Boulder, CO.
FFmpeg @FFmpeg
117K Followers 184 Following The universal multimedia toolkit. A diverse, community-driven project; posts are by individuals.
Costa Huang @vwxyzjn
8K Followers 2K Following Exploiting physical rewards @periodiclabs. Creator of @cleanrl_lib. Prev: RL @allen_ai @huggingface.
Hunter Schone @HunterSchone
853 Followers 767 Following Assistive technologies and neuroplasticity | NIH BRAIN Initiative fellow in the Collinger lab at @RNELabs | Prev: @UCL and @NIMHgov | 🏳️🌈
Nathanael @PatcherInTheRye
243 Followers 2K Following
Michael Notter @miyka_el
249 Followers 67 Following Senior ML researcher & neuroscientist fascinated by hidden patterns, innovating in neuroimaging, computer vision, AR/VR, vital signs & multi-sensor sensing
Joseph Suarez 🐡 @jsuarez
31K Followers 124 Following I build sane open-source RL tools. MIT PhD, creator of Neural MMO and founder of PufferAI. DM for business: non-LLM sim engineering, RL R&D, infra & support.
Danijar Hafner @danijarh
32K Followers 1K Following Building AI that autonomously understands and interacts with the world. Previous: @GoogleDeepMind @UCBerkeley @UofT
AGI House @agihouse_org
24K Followers 1K Following Accelerating humanity's transition to AGI — Note: we are exclusively located in Hillsborough, CA, no physical location in SF nor any other city yet.
Mistral AI @MistralAI
201K Followers 2 Following Frontier AI in your hands. Get work done with @MistralVibe at https://t.co/JsGnCVMUFq.You might like
