Transformers just got a serious rival. Allen AI just open-sourced a 7B model that beats its own transformer.
OLMo Hybrid mixes standard attention with linear RNN layers into one architecture.
> Same accuracy, half the training data
> Long-context jumps from 70.9% to 85.0%
> Beats the pure transformer on every eval domain
> Fully open: base, fine-tuned, and aligned versions
The trick is a 3:1 pattern. Three recurrent layers handle most of the sequence processing cheaply. One attention layer then catches what the recurrent state missed.
This cuts 75% of the expensive attention operations while keeping precision where it matters.
Building long-context apps used to mean paying the full cost of attention across every layer. Now you can get better long-context performance with a leaner architecture, and the theory proving why it scales better is released alongside the weights.
huggingface.co/collections/al…
Started digging into the BDH (Dragon Hatchling) architecture, a post-Transformer model that claims native continual learning via dynamic connectivity.
Want to reproduce it at a small scale and evaluate it for day-to-day tasks.
Will share learnings as I go.
We’re gearing up to launch a financial product built specifically for the Indian market.
It’s been developed by a dedicated team I've been freelancing, and we’ve already soft-launched with 50 customers, iterating based on real user feedback.
The public launch is coming up soon, I’ll share the link shortly. Excited for this next phase. 🤞
Yep yep, it’s late, I know 😅
But here’s my 2025 wrap.
I used to think posting on social media was overrated.
It turns out that staying invisible is worse.
My 2025, in short:
– > Started working at an early-stage fintech startup (freelancing via Upwork)
– >Earned ~$8,000 (paid ~$960 to Upwork as service charge)
–> Moved from just learning math for deep learning and building models around research papers to real engineering: backend, infra, CI, testing (all in Python)
–> Graduated in CSE (AI & ML) in Sept 2025
– >Attended PyCon 2025, Bengaluru
– >Solo trips across Tamil Nadu + a group trip to Hampi.
Big lesson:
Skills matter. But sharing your work compounds them.
2026:
Build in public.
Ship libraries & products. ( Have a couple of ideas)
Hopefully, I start being consistent.
Participate in public hackathons (I'm not sure why I completely ignore them).
Go deeper into multi-agent systems & reinforcement learning.
Let’s see where this goes 🚀
I’m excited to announce that Roi has been acquired by OpenAI!
We started Roi 3 years ago to make investing accessible to everyone by building the most personalized financial experience. Along the way we realized personalization isn’t just the future of finance. It’s the future
While attending #PyConIndia2025 in Bengaluru, I met a friend who casually showed me JAXA astronaut water pack.
Not only did I get to see it up close, I actually got to taste the water astronauts drink in space!
Python, space tech, and unexpected adventures week.
Still reflecting on #PyConIndia2025 🔥
Loved:
Democratization of software dev with GenAI (Subhajit Mukherjee)
Memory is the Agent (Archit Singh)
Also discovered @coderabbitai & already started using it, such a great tool.
Built, tested, and deployed API's for our in-house financial engines today. Always love turning ideas into production-ready solutions! 🚀 #API#FinTech#DeveloperLif
GPT-Realtime delivers huge gains across benchmarks: +17% in reasoning (BigBench), +10% in instruction following (MultiChallenge), and +17% in function calling (ComplexFuncBench)
Realtime API goes GA with BIG upgrades:
-> Image inputs → Combine visual + voice understanding
-> SIP (Session Initiation Protocol) support → Voice agents can make & receive real phone calls.
-> Remote MCP servers.
Big news from OpenAI: GPT-Realtime is here!
A next-gen speech-to-speech model + major Realtime API upgrades → making voice AI faster, more natural, and smarter than ever.
Here’s what you need to know 👇
🔗 openai.com/index/introduc…
47 Followers 329 FollowingProject Lead in Data & AI | Building with AI before it was cool
Writing about AI, data engineering & what actually works in the real world
📍 India
16 Followers 386 FollowingGlobal leaders in displays and disruptive marketing
🌐 Using Mixed Reality to enhance and captivate the imagination.
📩 [email protected]
👋🏼 Exhibitions
3K Followers 36 FollowingA dev-tool that helps with faster responsive web apps development. A must-have tool for all web developers. Free and Open Source!
77K Followers 150 Followingretired from corporate and full time YouTuber, x founder of LCO (acquired), x CTO, Sr. Director at PW. 2 YT channels (1M & 800k), stepped into 45 countries.
25K Followers 2K FollowingPrincipal Researcher @ Microsoft 🐱💻
2025 ARC Prize Winner
I build generative AI for images, videos, text, tabular data, weights, molecules, and video games.
17K Followers 796 FollowingFull-Stack AI Engineer | Shipping Products | Writing about tech, AI and things that industry refuses to admit | Book a call → https://t.co/shw55s3eVx
2K Followers 5 Followingan absolute goddess
only love exists
fastest swimmer ever | pro badminton player | currently streaming crimson desert 🏜️| cult leader | ai engineering
16 Followers 386 FollowingGlobal leaders in displays and disruptive marketing
🌐 Using Mixed Reality to enhance and captivate the imagination.
📩 [email protected]
👋🏼 Exhibitions
47 Followers 329 FollowingProject Lead in Data & AI | Building with AI before it was cool
Writing about AI, data engineering & what actually works in the real world
📍 India
12K Followers 1K FollowingBuilding MVPs & Personal Brands
Founder @shadowrites
Designs @haarisuiux
Ghostwriting for founders & creators
Ex 2 US remote startups
DM for work & collabs
327K Followers 65 FollowingWe're sharing/showcasing best of @github projects/repos. Follow to stay in loop. Promoting Open-Source Contributions. UNOFFICIAL, but followed by github
130K Followers 296 FollowingI am an AI & Finance learner. I share real-world AI use cases and what I learn.
E-mail/DM me for anything - [email protected]
17K Followers 10 FollowingOpenxAI is a P2P permissionless AI protocol. What Bitcoin did for money OpenxAI does for intelligence.
https://t.co/x5tlMKB0wo
1K Followers 155 Following1 API key, 220,000+ AI models. We’re the largest inference API on the internet and power NeurIPS and CVPR to bridge the gap between AI papers and runnable code✨
2.3M Followers 222 FollowingOfficial Spokesperson, Ministry of External Affairs, India. Passport issues may kindly be addressed to @CPVIndia @passportsevamea. FactCheck acct: @MEAFactCheck
927K Followers 187 FollowingFounder & CEO @Zerodha @Rainmatterin Learning at @RainmatterOrg Musings on business & life: https://t.co/gQi9cu6E5h. Views are personal, Nothing is advice.
1K Followers 2K FollowingSerial internet solopreneur | Building the #1 macro tracker and calorie estimator; What The Food (https://t.co/wmGVSEffoa).
🟩🟧⬜⬜⬜⬜⬜⬜⬜⬜ 10.5% completed ($1M)
36K Followers 2K FollowingSenior Software Engineer @Google | Building AI powered video editing | Ex- Microsoft | Sharing my insights on AI and software engineering | Opinions my own.
1.4M Followers 25 FollowingDeputy Chair of the Security Council of the Russian Federation. The third President of Russia, 2008-2012. For tweets in Russian, follow @MedvedevRussia
356K Followers 58 FollowingWork, but smarter. Find AI-enabled freelancers & new opportunities, all in one place. ✨ Need support? We got you 👉 https://t.co/6GvJOhglpE