Schurger Lab 🧠🤌 @schurgerlab
Neuroscience of Action & Volition (studying self-initiated movements) was a lab at @NeuroSpin_91 @UNICOG1 Now moved to @Brain_CU @FreeNeuro sites.google.com/site/schurgerl… Paris-Saclay🇫🇷/Orange CA🇺🇸 Joined October 2017-
Tweets116
-
Followers151
-
Following268
-
Likes362
Israel is committing some of the worst atrocities of our age, live-streamed on a daily basis. The politicians and media outlets who facilitated this obscenity must be held to account. Israel does this because it believes it will be allowed to. It is correct.
Horrible scenes of a new massacre in Rafah: The Israeli army committed a horrific massacre in North West Rafah which is supposed to be a safe area bombarding and burning tents of displaced Palestinians killing more than 30 civilians many of whom were burned to death and injuring
If you are a student interested in building the next generation of AI systems, don't work on LLMs
Voici l’image du cerveau la plus précise de l’Histoire, obtenue grâce au scanner IRM du CEA, le plus puissant au monde. C’est une avancée majeure et un espoir immense pour l’étude de notre santé. Félicitations à l’équipe du projet Iseult. Fierté française !
"The secret of happiness is: Find something more important than you are and dedicate your life to it." Daniel Dennett (March 28, 1942 - April 19, 2024)
very saddened to hear of Dan Dennett's passing. he was a transformative influence on my thinking about a great many topics, and a kind and generous man. his presence will be missed dearly by a great many people.
A new experiment for English speakers with a personal computer and 15 minutes to spare : help us understand how shapes are encoded ! Click here neurospin-data.cea.fr/exp/Barbu/Shap…
# explaining llm.c in layman terms Training Large Language Models (LLMs), like ChatGPT, involves a large amount of code and complexity. For example, a typical LLM training project might use the PyTorch deep learning library. PyTorch is quite complex because it implements a very general Tensor abstraction (a way to arrange and manipulate arrays of numbers that hold the parameters and activations of the neural network), a very general Autograd engine for backpropagation (the algorithm that trains the neural network parameters), and a large collection of deep learning layers you may wish to use in your neural network. The PyTorch project is 3,327,184 lines of code in 11,449 files. On top of that, PyTorch is written in Python, which is itself a very high-level language. You have to run the Python interpreter to translate your training code into low-level computer instructions. For example the cPython project that does this translation is 2,437,955 lines of code across 4,306 files. I am deleting all of this complexity and boiling the LLM training down to its bare essentials, speaking directly to the computer in a very low-level language (C), and with no other library dependencies. The only abstraction below this is the assembly code itself. I think people find it surprising that, by comparison to the above, training an LLM like GPT-2 is actually only a ~1000 lines of code in C in a single file. I am achieving this compression by implementing the neural network training algorithm for GPT-2 directly in C. This is difficult because you have to understand the training algorithm in detail, be able to derive all the forward and backward pass of backpropagation for all the layers, and implement all the array indexing calculations very carefully because you don’t have the PyTorch tensor abstraction available. So it’s a very brittle thing to arrange, but once you do, and you verify the correctness by checking agains PyTorch, you’re left with something very simple, small and imo quite beautiful. Okay so why don’t people do this all the time? Number 1: you are giving up a large amount of flexibility. If you want to change your neural network around, in PyTorch you’d be changing maybe one line of code. In llm.c, the change would most likely touch a lot more code, may be a lot more difficult, and require more expertise. E.g. if it’s a new operation, you may have to do some calculus, and write both its forward pass and backward pass for backpropagation, and make sure it is mathematically correct. Number 2: you are giving up speed, at least initially. There is no fully free lunch - you shouldn’t expect state of the art speed in just 1,000 lines. PyTorch does a lot of work in the background to make sure that the neural network is very efficient. Not only do all the Tensor operations very carefully call the most efficient CUDA kernels, but also there is for example torch.compile, which further analyzes and optimizes your neural network and how it could run on your computer most efficiently. Now, in principle, llm.c should be able to call all the same kernels and do it directly. But this requires some more work and attention, and just like in (1), if you change anything about your neural network or the computer you’re running on, you may have to call different kernels, with different parameters, and you may have to make more changes manually. So TLDR: llm.c is a direct implementation of training GPT-2. This implementation turns out to be surprisingly short. No other neural network is supported, only GPT-2, and if you want to change anything about the network, it requires expertise. Luckily, all state of the art LLMs are actually not a very large departure from GPT-2 at all, so this is not as strong of a constraint as you might think. And llm.c has to be additionally tuned and refined, but in principle I think it should be able to almost match (or even outperform, because we get rid of all the overhead?) PyTorch, with not too much more code than where it is today, for most modern LLMs. And why I am working on it? Because it’s fun. It’s also educational, because those 1,000 lines of very simple C are all that is needed, nothing else. It's just a few arrays of numbers and some simple math operations over their elements like + and *. And it might even turn out to be practically useful with some more work that is ongoing.
Kinda interesting 🧐 that most of the DeSci OGs were neuroscientists before, there must be something going on with that 🤯🧠 @Shamburgularara @hebbianloop @oraclide -> maybe because once you study the brain, everything else seems easier? 😂 (Quote)
I applied yesterday as a TA!🙂 I encourage to NOT MISS this opportunity w/ @neuromatch!🤗 I had a great time last summer being a Computational Neuroscience 🧠TA for PhD & MSc students from EMEA 🌍 Looking forward to being a Deep Learning TA this year! 🤖 New #opensource tracks: Climate Science 🌱 & NeuroAI⚡!
We heard you loud and clear! Lots of people said they needed a little more time to get their TA applications in! ➡️ TA applications will be extended by one week! ⬅️ Applications will be due March 24, midnight in the last time zone on Earth. buff.ly/3PaEQys
📣 Good news! As negotiations between the 🇪🇺 EU and 🇨🇭 Switzerland have been officially launched today, researchers based in Switzerland can now once again apply for ERC grants. Read more 👉 erc.europa.eu/news-events/ne…
A fake paper… in Frontiers… why am I not surprised? This predatory publisher once again reveals its true nature.
The rat with the big balls and the enormous penis – how Frontiers published a paper with botched AI-generated images @FrontiersIn scienceintegritydigest.com/2024/02/15/the…
LARPing sick 🤧🤒 from my bed If you wanna cheer me up #Anons do you know any 📣 🎨 Artist who use #GenerativeAI 🤖 Researcher who use or research on #LLM 👾 Entrepreneur who uses LLMs for their company ⚖️ Attorneys specialized in IP, AI, Web3 LFG 🥷 pls share 🔁 and DM me
📢Appel à #volontaires pour participer à l'étude "7TlayersVA" 🧠menée par @zhanminye #chercheuse à @NeuroSpin_91 @UNICOG1 au @CEAParisSaclay @CEA_Joliot. ➡️Répondez au questionnaire de pré-recrutement : groom.cea.fr/groom2/Volunte…
The Brain Institute is hiring a Research Coordinator. Please share this to spread the word! We will fully consider all applications received by March 31. Apply here: chapman.peopleadmin.com/postings/29949
Very happy to be starting the Brain, Body and Technology Lab (BBT Lab) at the @DondersInst Sensorimotor Neuroscience Department. New lab website is now online! brainbodytech.com And I will be posting a PhD position for my ERC project soon. Watch this space!
We have 2 open calls for a fully-funded PhD in #NeuroAI at Ecole Normale Supérieure: 1. euraxess.ec.europa.eu/jobs/66405 w/ Pierre Bourdillon 2. euraxess.ec.europa.eu/jobs/67064 w/ Yair Lakretz.
Open call for 2023 internships (potentially followed by PhD) in our Brain & AI team at Meta: metacareers.com/jobs/849054792… Strong experience in {deep learning, signal processing, neuroscience} (2 out of 3) required. Application from under-represented groups encouraged.
A PhD position in Artificial Intelligence and Cognitive NeuroScience “Linking Linguistics and Brain Dynamics with Deep Language Models” at @ENS_ULM Co-supervised with @JeanRemiKing
It's happening again! I was a TA there two editions ago and it was a wonderful (intense) experience. Don't miss it! #NMA #neurotwitter #compneuro #DNN #AI
NMA 2023 course dates have been established! The two courses (Computational Neuroscience and Deep Learning) will happen in parallel for 3 weeks, starting July 10th and ending July 28th. The portal for students and TAs applications will open soon, for now save the date! 🧠💻🌎🌍🌏
Michael Ehinmowo @ehinmich
141 Followers 3K Following student of ψ. likes poetry and music. man utd fan.
Gal Vishne @neurogal.... @neuro_gal
515 Followers 636 Following Postdoc @DataSciColumbia (w Mike Shadlen & Rich Zemel), Zuckerman @stem_program & Rothschild fellow. Past: PhD student @ELSCbrain, HUJI, @azrielifdn fellow
Irene Wang @IreneRadiooo
1 Followers 50 Following
Tracey Davis @TraceyDavi94145
14 Followers 658 Following
Evolution, Morality a... @evolutionmoral
126 Followers 230 Following https://t.co/4JegmZ03Uw https://t.co/39I3CUIZ4t by @walterva
SciPatron @SciPatron
49 Followers 126 Following Empowering researchers through crowdfunding on XRP Ledger, by @bianca_troveaux 🧠🗝 Built🌊@xrpl_commons w/☕️@xrpcafe Pre-product/launch🚨NFTs for demo only
Blanke Lab @OlafBlankeLab
1K Followers 143 Following Neuroscience of self-consciousness | Altered states | Meditation |Neuroprosthetics | Virtual Reality | Robotics/Haptics | @Neuro_X_EPFL | @Brainmind_EPFL
Olorunosenkanti Abiod... @Em_Tee1
248 Followers 3K Following Polymath • IFA Mathematical Sciences & the IFA Internet • STEM/STEAM Educator • Founder, CENProject & IFA Coding Academy • Oníṣẹ̀ṣe
Journal of Cognitive ... @JOCN_Journal
2K Followers 2K Following The Journal of Cognitive Neuroscience investigates brain-behavior interactions and promotes a lively interchange among the mind sciences. Published by @mitpress
Jeremy Sarby @Sarbados
104 Followers 2K Following Husband. Father. Financial Advisor. UWSP Alum. Go Bucks, Broncos, and Badgers!
Nikos Chalas @nikos_chalas
88 Followers 434 Following
Perrine Porte @pp_porte
37 Followers 110 Following PhD student in cognitive psychology and neuroscience on metacognition and multisensory integration at LPNC in Grenoble
Spinal Cord NFT @SpinalCordNFT
320 Followers 1K Following spinal cord injury research x web3 ⚡Radiology NFTs 🧠 🦴 collect NFTs to fund neuroRecovery research 🔬#paralysis #neuroscience #blockchain #nft #deSci #web3
Mariana Babo-Rebelo @BaboRebelo
311 Followers 407 Following Researcher @IDIBAPS, Ramon y Cajal Fellow. Cognitive neuroscience: brain-body coupling & self-consciousness. Former @OlafBlankeLab @EPFL @UCL_ICN @Cognition_ENS
Joseph(Ziheng) Zhou @JosephZiheng
88 Followers 637 Following CS PhD student@UCLA , Personal Page : https://t.co/y2O2wANRA0 , Prev founding partner @ https://t.co/AC6WXSLFYT. Looking for AI model team job now.
Pengcheng Zhang @PengchengZhang1
13 Followers 391 Following
Sri vidya Sundaram @SriVidy77942529
31 Followers 222 Following Doctoral Researcher @MPI_CBS, Leipzig. Gut - Brain Axis 🧠| Eating behavior 🍕🥦🥪🦠🚻♂️♀️
Saeed Taghavi @SaeedTaghaviV
210 Followers 1K Following #physics #computational_neuroscience #modeling_brain_circuits #DevOps #sysAdmin #AI4Science I focus on how we know what we know!
Allison Hamilos @AllisonHamilos
390 Followers 254 Following Valhalla Whitehead Fellow (PI) @WhiteheadInst | neuroscientist, swimmer, soprano
Saanchi Thawani @saanchi_t
104 Followers 526 Following On a quest to understand, explore and impact the Universe through Science and Art | Undergrad @IISERPune | Masters Thesis student @Donner_lab
🦷#AIEthics #NeuroR... @Neuroseguro
730 Followers 4K Following Analizamos escenarios distópicos para gobernanza de tech disruptivas mediante pensamiento lateral.
Ricardo Pizarro @rap_ndl
61 Followers 345 Following Postdoc at @TheNeuro_MNI: Neuroscience. Machine and Deep Learning. Statistical Signal Processing. Futbol. IPA. 🇨🇱🇧🇷🇺🇸🇨🇦
Keiji Ota @KeijiOta3
206 Followers 326 Following Postdoc rep @QM_Psych || Cognitive Computational Neuroscientist || decision, action, cognitive control || 🇯🇵→🇺🇸→🇬🇧 ||
Karim Jerbi @karimjerbineuro
5K Followers 3K Following Prof @ Univ Montreal & Canada Research Chair in Comp Neuroscience & Cog Neuroimaging. Heads UNIQUE @ai_unique Biological/Artificial Neural Networks 🧠🤖 he/him
CEAJoliot @CEA_Joliot
638 Followers 291 Following Frédéric Joliot Institute for Life Sciences of the @CEA_Officiel Fundamental Research Division👩🔬👨🏿🔬🔬💊🦠🧫🧠🌱🏥
HealthiGlobal Maysher... @Newdoon_Tech
128 Followers 2K Following Specialized in neuroscience products. 🧠🐭We've got your every neuroscience needs! Email: 📧 [email protected] [email protected]
Chapman Brain Institu... @Brain_CU
73 Followers 96 Following The Institute for Interdisciplinary Brain and Behavioral Sciences at @ChapmanU
Daniel Yon @danieljamesyon
3K Followers 831 Following Psychologist and neuroscientist. Studying how we perceive, act and decide | Reader (Associate Professor) @bbkpsychology
Sarang Dalal @sarangnemo
2K Followers 2K Following Professor, Center of Functionally Integrative Neuroscience @CFIN_AU @AarhusUni | #MEG | Despite living in Denmark, lately I prefer 🟦 skies online...
Anne Urai - @neuromat... @AnneEUrai
5K Followers 3K Following Wandering neuroscientist 🧠 | Doubtful decision-maker 🤔 | Assistant Professor @LeidenPsy | Climate worrier 🌍 | Now at https://t.co/uzJRA13FLc
Miriam Klein-Flügge ... @MKFlugge
2K Followers 855 Following cog neuro, associate prof, mum, decision making, ultrasound neuromod & mental health @OxfordWIN @OxExpPsy @OxPsychiatry (she/her) @mkflugge.bsky.social
Parvaneh Adibpour @parvanehadib
101 Followers 174 Following
Tuomas Pernu @TuomasPernu
3K Followers 5K Following PhD and all that. Lecturer in Philosophy of Science and Research Ethics @UniEastFinland. Also here: https://t.co/T3ITXb8Xsw
Haiyan Zheng @Zheng_haiyan
16 Followers 299 Following
Parietal, INRIA @Parietal_INRIA
2K Followers 1K Following INRIA Neurospin research team. NeuroImaging + computer science = modelling brain structure, function and variability based on high-field MRI data.
Litian Chen @litian_psychen
94 Followers 334 Following PhD student with @HeleenASlagter | Memory, Attention, Predictive mind |
Dror Dotan @DrorDotan
274 Followers 164 Following Researcher at @TelAvivUni of numerical cognition and mathematical thinking.
Cassandra Visconti @viscontcas
98 Followers 213 Following PhD Student | Professur für Neuroimaging | TUD | Combined Computational-Experimental Approach
xuuNbDD8 @J7Hdsp
0 Followers 133 Following
Adi Sarig @Adi_Sarig
20 Followers 178 Following MSc student @TelAvivUni | Cognitive Neuroscience | Consciousness
Yarden Shir @yardenshir1
193 Followers 246 Following PhD student @TelAvivUni | Cognitive Psychology | Studying the role of consciousness in voluntary actions
Ants-Review (🐜 , �... @AntsReview
746 Followers 818 Following Bounty Protocol Peer-Reviews on chain cofounded by @bianca_troveaux🥇@ETHTurin built at @KERNEL0x💰1st #DeSci grant @gitcoin🗣Speaker @euro_par🌱
~ @charity12301230
28 Followers 2K Following
NeuroPhilFreeWill @FreeNeuro
148 Followers 16 Following Consciousness and Free Will: A Joint Neuroscientific-Philosophical Investigation
Robyn Waller @RobynRWaller
429 Followers 928 Following Philosopher of mind and cognitive science @sussexphilos
Laura Dugué @lauradugue
599 Followers 288 Following PI @DugueLab & Full Prof. @Univ_Paris_Cite & @CNRS Now only on @lauradugue.bsky.social
Mediterranean Society... @mesec_
1K Followers 351 Following Grassroots association for early-career researchers in consciousness science | events & community building | join us https://t.co/E1BfPQPd5m
Mustafa Barghouti @Mu... @MustafaBarghou1
155K Followers 575 Following Palestinian MD and MP, Presidential candidate 2005, Founder and Leader of the Palestinian National Initiative (PNI) Activist and advocate of Palestinian rights.
SciPatron @SciPatron
49 Followers 126 Following Empowering researchers through crowdfunding on XRP Ledger, by @bianca_troveaux 🧠🗝 Built🌊@xrpl_commons w/☕️@xrpcafe Pre-product/launch🚨NFTs for demo only
Yair Lakretz @lakretz
145 Followers 70 Following
European Research Cou... @ERC_Research
156K Followers 528 Following European Research Council, set up by the EU, funds top researchers of any nationality, helping them pursue ideas at the frontiers of knowledge. 🦋https://t.co/Y9s8R2t8Qr.
EU Research Results @CORDIS_EU
49K Followers 7K Following 🇪🇺 We bring you results from #EUfunded research projects @EU_Commission 👩🔬🔬👨🔬 | 🎧 Listen to our podcast #CORDIScovery 👉 https://t.co/U1KsbwEQQZ
ASSC25 Amsterdam @assc25
514 Followers 176 Following We are happy to announce that the annual meeting of the ASSC will be hosted in real life once again - after a two year corona-related hiatus - in Amsterdam
ASAPbio @ASAPbio_
5K Followers 243 Following Biologist-driven org promoting transparency and innovation in life sciences communication. Find us on different networks 👉 https://t.co/7daRbwjEwi
#ScienceForUkraine �... @Sci_for_Ukraine
7K Followers 872 Following #ScienceForUkraine is an NGO run by an international group of volunteer scholars to support scholars and students affected by the Russia's war in #Ukraine 🇺🇦
Cognition ENS @Cognition_ENS
4K Followers 322 Following Formation et recherche sur les fonctions mentales. Le Département d'Etudes Cognitives (DEC) est un département transdisciplinaire de l'@ENS_ULM @psl_univ.
CoCoSci MIT @MITCoCoSci
4K Followers 106 Following Computational Cognitive Science Group | MIT | BCS Latest updates from Josh Tenenbaum's lab + Alumni
Simon Fisher @ProfSimonFisher
6K Followers 303 Following @[email protected] @profsimonfisher.bsky.social
Garance Merholz @garanceme
42 Followers 32 Following
Chapman Brain Institu... @Brain_CU
73 Followers 96 Following The Institute for Interdisciplinary Brain and Behavioral Sciences at @ChapmanU
Biyu Jade He @BiyuHe
4K Followers 209 Following Director, Perception & Brain Dynamics Laboratory @nyu; Cognitive neuroscientist interested in how the brain generates the mind; “He” rhymes with “the” /hə/
Daniel Yon @danieljamesyon
3K Followers 831 Following Psychologist and neuroscientist. Studying how we perceive, act and decide | Reader (Associate Professor) @bbkpsychology
Wu Tsai Institute | Y... @WuTsaiYale
3K Followers 343 Following Our goal is to understand cognition. #KnowTogether
Wu Tsai Neurosciences... @StanfordBrain
11K Followers 412 Following Official feed of @Stanford Wu Tsai Neurosciences Institute. Unlocking the mysteries of brain and behavior through cross-disciplinary research.
Yale Neuroscience @YaleNeuro
12K Followers 255 Following Yale Department of Neuroscience Find us at https://t.co/afEiK7nsqh
Anne Urai - @neuromat... @AnneEUrai
5K Followers 3K Following Wandering neuroscientist 🧠 | Doubtful decision-maker 🤔 | Assistant Professor @LeidenPsy | Climate worrier 🌍 | Now at https://t.co/uzJRA13FLc
Sarang Dalal @sarangnemo
2K Followers 2K Following Professor, Center of Functionally Integrative Neuroscience @CFIN_AU @AarhusUni | #MEG | Despite living in Denmark, lately I prefer 🟦 skies online...
Miriam Klein-Flügge ... @MKFlugge
2K Followers 855 Following cog neuro, associate prof, mum, decision making, ultrasound neuromod & mental health @OxfordWIN @OxExpPsy @OxPsychiatry (she/her) @mkflugge.bsky.social
Stefano Palminteri @StePalminteri
6K Followers 1K Following Behavioral scientist interested in learning and decision-making. Co-author of Decision Making: a Very Short Introduction https://t.co/uXQze1CBzH
Mael Lebreton @mael_lebreton
1K Followers 863 Following Neuroeconomist, with broad interests in cognitive neurosciences, human behavior, social sciences
Alessandro Crimi 🧠... @Dr_Alex_Crimi
8K Followers 4K Following Prof.@AGH_Krakow. Intersecting #neuroscience/#AI and #impact #social development. #innovation #globalhealth All links: https://t.co/t2oeiJcBnH
Ida Momennejad @criticalneuro
16K Followers 2K Following Principal Researcher @MSFTResearch. I study memory & planning in brains. I build & evaluate AI inspired by the brain.
Pierre Ablin @PierreAblin
6K Followers 358 Following https://t.co/sNXqNTO0Vm Machine learning research @Apple
Hubert Banville @hubertjbanville
350 Followers 153 Following Research scientist at Meta AI, working on machine learning for neuroimaging data.
Omar Chehab @lomarchehab
233 Followers 363 Following Postdoc in Machine Learning at Carnegie Mellon @mldcmu. Working on sampling and estimating energy-based models.
Mainak Jas @mainakjas
519 Followers 614 Following Instructor at @MGHMartinos, open source dev @mne_news, machine learning, neural time series, PhD @telecomptech '18, @aaltouniversity '15, @iitkgp '12.
Parietal, INRIA @Parietal_INRIA
2K Followers 1K Following INRIA Neurospin research team. NeuroImaging + computer science = modelling brain structure, function and variability based on high-field MRI data.
Cassandra Visconti @viscontcas
98 Followers 213 Following PhD Student | Professur für Neuroimaging | TUD | Combined Computational-Experimental Approach
Association Doc'Up @AssoDocUp
920 Followers 175 Following Doc’Up était l'association des doctorant.e.s de Sorbonne Universités Sciences (2010-2022) 🎓 🥼🔬•@Sorbonne_Univ_ @ScienceSorbonne •Suivez 👉@collectifSU
Ghislaine Dehaene @ghisdl
149 Followers 47 Following
CEA @CEA_Officiel
46K Followers 1K Following Acteur majeur de la recherche 🇫🇷 et 🇪🇺 Apporte des solutions technologiques concrètes 💪 #Énergie #Climat #Numérique #Santé #Défense #Sécurité
Collège de France @cdf1530
61K Followers 58 Following "Docet (omnes) omnia" 😊 Enseigner (à tous) le savoir en train de se constituer dans les #Sciences, les #Arts & #Lettres | @psl_univ
CNRS 🌍 @CNRS
221K Followers 2K Following Organisme public 🇫🇷 de recherche pluridisciplinaire, le Centre national de la recherche scientifique c'est 33 000 personnes qui font avancer la connaissance.
Dror Dotan @DrorDotan
274 Followers 164 Following Researcher at @TelAvivUni of numerical cognition and mathematical thinking.
Paris Brain Institute @ParisBrainInst
2K Followers 390 Following This twitter account is now inactive. Please join @InstitutCerveau account which will provide informations both in french and english.
Sylvain Baillet 🕊�... @sylvain_baillet
5K Followers 877 Following Director, Research & Innovation, U of Montreal Health Centre (CHUM), and Director CHUM Research Centre (CRCHUM) | Professor, Neuroscience @ U of Montreal.
CEAJoliot @CEA_Joliot
638 Followers 291 Following Frédéric Joliot Institute for Life Sciences of the @CEA_Officiel Fundamental Research Division👩🔬👨🏿🔬🔬💊🦠🧫🧠🌱🏥
Xiaoxia Feng @xiaoxia_feng
73 Followers 349 Following
Mel_Goodale @action_brain
5K Followers 374 Following I'm a cognitive neuroscientist at The University of Western Ontario where I study the brain bases of visual perception and visuomotor control.























