I'd like to start 2024 with some thoughts on the state of optimization theory. To begin with, let me quote Nesterov's 2003 book:
"The main fact, which should be known to any person dealing with optimization models, is that, in general, the optimization problems are unsolvable"
🧵
Excited to be launching a series of short videos (5 min or less) to optimize the training performance of your PyTorch models!
Covering
- mixed-precision training
- multi-GPU training strategies
- Compiling PyTorch models
- and finding good batch sizes
🔗 lightning.ai/pages/courses/…
@docmilanfar@benedictevans@docmilanfar
Do you have any survey paper or references in mind which outline current open problems/questions/mysteries in DL which you or your colleagues think should be addressed?
As you see people from various domains approach this differently.
@kawaiitruecrime عكس اقاي ناصري رو كه ديدم يادم اومد اقاي ميلاد ناصري ٤-٥ سال پيش از تجربه مهاجرتش به عنوان SW حرف زد و مطالب جالبي درمورد ديدگاه الگوريتمي گفت. حتي يادم هست يك مقاله جالبي هم در لينكداين نوشته بود در مورد تجربه اماده سازي مصاحبه گوگل.روحش شاد. sokanacademy.com/podcast/میلاد-ناصری
@ADutchEngineer I started off with C++ and it gave me a good grasp of how pointers work with regards to memory or better abstraction of Object Oriented programming.I’d say which ones better suited hugely depends on future tasks though.
@marktenenholtz I have not ever found better material in this topic than this course youtube.com/playlist?list=… from @rasbt Lectures from 8 to 12. The entre course is amazing but the model evaluation lectures are incredible.
1K Followers 4K FollowingLearning spiral has a workforce with diverse set of skills & the ability to deliver #data_annotation & #labeling at scale #ai #cv #autonomous #ml #DeepLearning
63K Followers 11K FollowingBuilding intelligence that evolves @adaption_ai. Built @Cohere_Labs, @GoogleBrain, @GoogleDeepmind. ML Efficiency, Multimodal\lingual.
4K Followers 642 Followingmathematics Thief & Chef
"through the window of differential equations, mathematics sees the light in the real world" / "通过微分方程的窗子,数学家看到现实世界的光" (Jiang Zehan)
58K Followers 121 FollowingBooks: https://t.co/0EmPM3De9B & https://t.co/45NGbbXIzC
App: https://t.co/n2jvMtYhVm
PhD in AI, author of 📖 The Hundred-Page LMs Book & The Hundred-Page ML Book
154K Followers 1K FollowingAssis. prof. of Comparative Politics @TilburgU-Founder/Director of @GAMAANresearch-board mem.@IHRights-Iran expert-tweeting in Persian/English جمهوریخواه/سکولار
12K Followers 19 Followingاکانت رسمی گمان: گروه مطالعات افکارسنجی ایرانیان Official account of GAMAAN: The Group for Analyzing & Measuring Attitudes in IRAN. Tweets in Persian & English
3K Followers 711 FollowingWriting mostly about US history, political philosophy, democracy, free speech, and constitutional law جمهوریخواه. به امید آزادی ایران🦁☀️
2.4M Followers 93 FollowingOfficial account of Ray Dalio, founder of Bridgewater Associates, author of #1 New York Times bestseller 'Principles,' professional mistake maker
32K Followers 36 FollowingJoin neuroscientist, philosopher, and bestselling author Sam Harris as he explores the mind, society, and current events. Account run by Team Sam.
4K Followers 1K FollowingProfessor for CS at the Tuebingen AI Center @uni_tue and affiliated Professor at MIT-IBM Watson AI lab @MITIBMLab - Multimodal learning and video understanding
15K Followers 367 FollowingComputer Vision research group @UniofOxford led by Andrew Zisserman, Andrea Vedaldi, João Henriques, Christian Rupprecht, and Iro Laina
21K Followers 3K FollowingFrom SLAM to Spatial AI; Professor of Robot Vision, Imperial College London; Director of the Dyson Robotics Lab; Co-Founder of Slamcore. FREng, FRS.
1K Followers 169 FollowingWorking on a Startup. Ex- NVIDIA Senior Research Scientist / UofT.
I am recruiting, please reach out if you are interested in digital content creation.
94K Followers 925 FollowingOpen model research @ something new.
Prev. co-led Olmo at Ai2.
Contact via email.
Writes @interconnectsai
Wrote The RLHF Book,
🏔️🏃♂️
81K Followers 701 FollowingSharing insights on Probability, Statistics, ML, DL and AI research. Subscribe for recent research paper discussions at $2/month. DM to collaborate.