-
Tweets299
-
Followers714
-
Following233
-
Likes5K
You've heard of Infrastructure as Code- but agent evals can now ride your existing Terraform setup! I've been using the new LangSmith Terraform provider to auto-provision online evals + monitoring alerts for my agents, and think you should too. Here's how 🧵
Together these three resources close the online evaluation and monitoring loop, with the added flexibility and benefits that infrastructure as code provides. If you want to set this up for your own agents, the provider is live on the Terraform registry and documentation can be checked out here: docs.langchain.com/langsmith/mana… registry.terraform.io/providers/lang…
But, as always, scores are only useful if someone sees them. The alert resource lets you set a threshold and target for your online eval, and send messages to common services like PagerDuty or a Slack channel. For example, I set up an alert that pings me directly if my PII code evaluator detects even one mention of highly sensitive information, something worth investigating!
No one wants to talk about how setting up agentic „loops” has almost nothing to do with the code being generated- rather effective tests, CI, scans, codebase rules, formatting/linters, documentation, historical references, QA tools, hooks, templates, tickets, reviews etc
A man cannot prompt the same Claude twice, for it is not the same Claude, and he is not the same man
@sydneyrunkle @hwchase17 All my homies use dcode
8 hrs of sleep really do change your life
i love infrastructure as code. instead of opening the GCP console 20 times I now only have to open it 19 times
Actually a critical concept to understand for anyone seriously building agents. I work on one that can spawn up to 50 subagents at once- the only way to do that reliably and effectively is with this feature
Memory is what turns an ok general agent into YOUR excelling agent- but requires constant reflection and updating Engine does this 24/7 for you
🧠LangSmith Engine as Sleep Time Compute Memory for agents is often described as “sleep time compute” or “dreaming” This involves running a background process to analyze agent trajectories and update a memory store Today, we show how to do that in LangSmith: 1. Trace all
Suman @0xSuman
1K Followers 1K Following Agents @SierraPlatform | Prev: @coinbase @uber @kp_fellows @WolframResearch | 🇳🇵
Rick @rick852
261 Followers 3K Following
Evaldo Klock @ejklock
84 Followers 528 Following
Ramy Barsoum @barsoumramy
350 Followers 475 Following 18 years inside a broken healthcare system. Now building AI agents to fix it. Seniors deserve better. Humans handle what only humans can.
⚡️bolt @infinitystone43
70 Followers 2K Following
Luke Pham @REMEMBER_70411
61 Followers 6K Following
Facundo Mendilaharzu @FMendilaharzu_
8 Followers 154 Following
Ali Haydar @Alee_Haydar
402 Followers 1K Following Geek 🤓 | Software Engineer | AI-augmented coding | Platform Engineering. Tech Room 101 → https://t.co/E2g1Kf0jn9
Garrett @GarrettMichiels
551 Followers 3K Following
daniel torres @danieltorr99904
0 Followers 155 Following
Michael Chen @grokdimension
425 Followers 3K Following 🇨🇦🍁Cybersecurity by day AgenticLLM by night 😉🧠 Tesla referral link: https://t.co/z7hoXIkrpT
Mihir Jha @mihirjha13
167 Followers 645 Following Traveller| mountaineer | Photographer | Development architect at SAP | Views/tweets are my own!
Raam Das - Om Sarve B... @Compassion111
513 Followers 3K Following Test ur every action against How it will help earth & humanity. Here to bounce ideas & interested in healthy discussions. RT≠endorsement. सर्वे भवन्तु सुखिनः
prove @coneiceman
36 Followers 1K Following
glovvva @glovvva
71 Followers 2K Following Polish Solo Founder trying to bring Polish SMEs closer to AI;, heavy into Token Economics and Knowledge Management; https://t.co/LkqC2xgDK0
Satya Pattnaik @SatyaPattnaik26
33 Followers 635 Following Data & Applied Scientist @ Microsoft, India.
ᴊᴇᴡᴊᴏɴɴʏ... @JewJonny
326 Followers 624 Following Platform Engineering Group Manager | מנחה פודקאסט אסימטרי
Sagar Dubey @dubeyornotdubey
123 Followers 3K Following Always shipping : Takes x AI × Product. Maximalist Prototypes. Tiny projects with delusional upside. (ง •̀_•́)ง 父 | isä | pai ASCII enthusiast (☞ﾟヮﾟ)☞
Seif Bassem @SeifBassem
279 Followers 1K Following Sr. Cloud Solution Architect @ Microsoft. I create blog posts, YouTube Shorts and will share tips and tricks that will help you navigate the cloud ☁️☁️
Avinash Sivaraman @AvinashSivaram
128 Followers 1K Following Software Development Engineer, working for AWS | AWS, React, Full Stack Developer. Love Open Source ❤️
tyler @tylerbarstow
2K Followers 4K Following AI @trustandwill. former co-founder @vinylmeplease. mad question askin.
ucalyptus @ucalyd
1K Followers 599 Following gh/hf: ucalyptus Applied AI Scientist Startups: @premai_io @lenianalyst R&D @vectorinst @ETH All tweets are personal and neurodivergent.
LaRue @LaRueGz
1K Followers 5K Following Revolutionizing the tax industry through collaborative innovation.
Ichi wa Zen, Zen wa I... @skholmes_
505 Followers 1K Following Not reducible to labels. ⚒️ AI systems. Spiral out, keep going 🚀 bot: @thekaizenbot
mrragava @mrragava
248 Followers 7K Following
Ujwal @dastan878
22 Followers 560 Following
Ben Hughes @bwghughes
13 Followers 253 Following Helping enterprises understand the shift from cloud AI to local AI.
Björn Schotte @BjoernSchotte
3K Followers 5K Following Making things happen @mayflowergmbh | ❤️ Software | AI | Data
Chad @can00336
0 Followers 223 Following
HASSAN @hassanxelamin
87 Followers 203 Following
Vishal Waghmode @vishal_555_
201 Followers 3K Following
Dee Phunk @DeePhunk
11K Followers 1K Following Now: LA; then: NYC; 🎨 for @Slate, ¼ of @RareFormNYC, @DonutsRForever cofounder, @MakossaCookout fam, playlist savant, hoops enthusiast, dad, Libra.
Benito Antonio @sanbenito
5.1M Followers 0 Following
Lavi Nigam @lavinigam
2K Followers 3K Following ML Engineer @Google | Building & Scaling Google Agent Development Kit (ADK): All views expressed are personal!
Emmett Shear @eshear
123K Followers 1K Following CEO of Softmax: Massively Multiplayer Learning Environments
λux @novasarc01
22K Followers 3K Following tensor shepherd in a non-euclidean pasture | grazing on cuda cores
Victor Algaze @valgaze
146 Followers 409 Following Software Engineer/Sloganeer-- good code is like a good car: fast, reliable, safe, and easy to maintain. Passionate about sensors + intelligent agents
Brendan Whiting @brendan_whiting
22 Followers 142 Following
Jacob Kleiman @jacobkleiman3
152 Followers 295 Following
Lora Lee @lora_yaps
87 Followers 90 Following eng @langchain | prev @samsara @dartmouth alum opinions my own
spoonkid @spoonkid3
100K Followers 151 Following loot enthusiast https://t.co/kDKwv9WVo6 @monkeclothing
Paarth Ahuja @paarth_a
192 Followers 235 Following engineering @LangChain prev @Bloomberg @Meta @Amazon @WesternU opinions are my own
Christian Bromann @bromann
3K Followers 878 Following Running on agentic reasoning and espresso. Building with @LangChain 🦜🔗.
ClaudeDevs @ClaudeDevs
590K Followers 2 Following Official updates for developers building with @ClaudeAI
Amada Echeverría @amadaecheverria
447 Followers 298 Following 🧋 Community @langchain_oss + Startups @LangChain | language + etymology nerd 🤓
Julia Schottenstein @j_schottenstein
4K Followers 877 Following Building @LangChain | ex-product @getdbt | angel investor 👼 | @Stanford CS engineer | NYC native + SF transplant | runner (sometimes) | https://t.co/QuVTU4GU8U
gabriel @gabriel1
113K Followers 590 Following new thing, previously research at @OpenAI & @midjourney
Sam Crowder @samecrowder
1K Followers 628 Following Head of Product, LangSmith at @LangChain 🚀 | prev: @Harvard MS/MBA, @RocksetCloud (acq. OpenAI), @BainCapVC, @ContraryCapital
Viv @Vtrivedy10
14K Followers 2K Following applied research lead @LangChain Labs, prev @awscloud, phd cs @templeuniv
Brace @BraceSproul
6K Followers 718 Following Head of Applied AI at @LangChain ~ Interested in agents, drones and rockets ~ prev @anything
0.005 Seconds (3/694) @seconds_0
20K Followers 3K Following human first systems are the only thing left checkout https://t.co/DSD2mZsWkR & https://t.co/G7SnfYPeZp!
Pangram @pangram
13K Followers 21 Following Keeping the world free of AI slop. This account has automated replies: Tag @pangram with 'ai?' to get an AI check on any post.
Mayor Zohran Kwame Ma... @NYCMayor
2.3M Followers 1K Following Fighting every day to deliver a city that working New Yorkers can actually afford. Mayor of New York City.
Lucas Beyer (bl16) @giffmana
143K Followers 619 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Lee Robinson @leerob
270K Followers 839 Following Model behavior @cursor_ai. Helping train useful models.
Jeremy Howard @jeremyphoward
322K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
Rhys @RhysSullivan
59K Followers 1K Following building https://t.co/gIFOwRUrLU to connect any agent to every tool, API, and service your team uses | yc 26
sankalp @dejavucoder
26K Followers 681 Following ai and side quests. i post well, just follow. i consult on ai engineering stuff | seeking post-training, auto-research adjacent, evals related work atm
Mike A. Merrill @Mike_A_Merrill
3K Followers 401 Following Evals at Anthropic, Co-Creator of Terminal Bench, Go Bills
Michal Valko ✈️ I... @misovalko
9K Followers 10K Following Founding Researcher @ Isara Labs & Inria & MVA. Ex: Llama @AIatMeta; Gemini & BYOL @GoogleDeepMind. LLMs, RL, alignment.You might like
