@0xSero I think the config is broken, it says n_routed_experts: 256 but only 156 experts/layer exist.
vLLM seems to allocate 256 → ~95GB/GPU → OOM on 4x RTX PRO 6000 before it ever loads.
Gate + bias are still 256-wide and unmasked too, so even if it fit it'd route ~40% of tokens to deleted experts. How'd you get the 78GB/GPU run in the README — compacted checkpoint or a loader that reads num_experts?
@no_stp_on_snek@daniel_mac8@subquadratic My timeline filled with nothing but speculative glazing of these dudes with crazy view numbers, and meanwhile this gem is buried with relatively no views. This is a strange place.
@Bombilly_ Because humans are so great at coding. (Spoiler it wasn’t the code we were good at it was the solving problems, hence by languages evolved to mostly be more readable so you could focus on the problem not the syntax)
@jun_song 💯...the number that matter's is "brain" sessions (where you have planned/coordinated/spec'd out in some amount of real detail). Sub-agents is just an arbitrary hyper param you can inflate out the ying yang.
@TeksEdge@AMD@nvidia Dude, you have to tell Nvidia about this. All that work they've done on Rubin, and they've been marching in the wrong direction the ENTIRE TIME?? 🙄
2K Followers 7K FollowingAll ETFs are NOT the same. BEWARE! If it pays $0.4 that week, but looses $1 or $2 per share, your losing money. Reverse splits are #ETF #Death spirals.
225 Followers 2K FollowingOnly private elites here !. I will mainly talk about crypto market, price action analysis etc. ONLY FOR A FEW PEOPLE. MAIN PAGE @pakpakchicken
1K Followers 7K FollowingFor God so loved the world, that he gave his only begotten Son, that whosoever believeth in him should not perish, but have everlasting life.
340 Followers 223 FollowingAn Oncologist I sell and ship ivermectin, Fenbendazole, mebendazole and lots more to any where. Medbed quantum available, just send a dm👍[email protected]
2K Followers 7K FollowingAll ETFs are NOT the same. BEWARE! If it pays $0.4 that week, but looses $1 or $2 per share, your losing money. Reverse splits are #ETF #Death spirals.
287K Followers 3K FollowingJournalist & Host @CryptoAmerica_ • Former @FoxBusiness • Citizen of 🇺🇸🇬🇧 • Mother of Cats🐈 • Breaker of News🗞️ • THIS IS MY ONLY X ACCOUNT! •
3.0M Followers 24K FollowingReposting Trump’s Truth Social posts (with date/time) on X + news/commentary. Unofficial. Profile Artist: @ElenaRuseva1 Not affiliated with @realdonaldtrump.
681K Followers 124 Following#1 New York Times Bestselling Author of five books, including "The Subtle Art of Not Giving F*ck". Co-Founder of @Purpose_AI. Host of Solved Podcast.
481K Followers 3K Following*Tweets are my opinion, not financial advice* Only on X- be careful of impersonators. WILL NEVER DM YOU FOR MONEY. NO PAID SERVICES.
25K Followers 245 FollowingI need more allowance.
Verified to not be a degenspartan alt through chainlink proof of reserves
Youtube of mostly unstructured aspergers droning linked below
365K Followers 7K FollowingWorking on nation-state #Bitcoin adoption. CEO @JAN3com, building @AquaBitcoin, CEO @Pixelmatic & creator of @InfiniteFleet. Might be in HBO's #MoneyElectric.
167K Followers 954 FollowingFounded by @ScottPresler to elect Republicans by mobilizing a nationwide grassroots network for voter registration and increasing absentee and early voting.
170K Followers 2K FollowingCo-Managing Partner of Bitcoin Opportunity Fund | Board Director of Strive (NASDAQ: ASST) | CFA | Author of 💡The Informationist Newsletter
1.4M Followers 2K FollowingFounder/CEO Global Macro Investor, @RealVision. Figuring things out at the nexus of Macro, Web3 & the Exponential Age. Not a guru.
1.0M Followers 1K FollowingAuthor of Broken Money & The Stolguard Incident. Investor with a blended engineering/finance background. GP @egodeathcapital. Director at Bakkt & @Swan.
1.1M Followers 1K FollowingThe Wolf Of All Streets | The Daily Wolf On @YahooFinance | Media Host | Author | Markets | Hot Takes | Bitcoin | Married up to @emimelker ALL CAPS = news team
1.1M Followers 2K FollowingPremier site for classical chart analysis of futures markets. Trader for five decades. Market Wizard. Author.
Membership Factor Report https://t.co/83DcDyF2SE