Jacob Hilton @JacobHHilton
At the Alignment Research Center, formerly at OpenAI Joined November 2012-
Tweets155
-
Followers3K
-
Following59
-
Likes108
Jacob Hilton retweeted
[1/6] $150,000+ for one question: predict what a neural net does - without running it. The bet: read the weights, use the structure. ARC and @aicrowdHQ just launched the ARC White-Box Estimation Challenge. w/ @JacobHHilton, @paulfchristiano, Wilson Wu Here's the problem 👇
1
2
2
192
1
View Details
Jacob Hilton retweeted
We are starting a new, nonprofit alignment organization, ⊢ Sequent Research, bringing together researchers previously on UK AISI’s Alignment Team, Timaeus, and elsewhere to research how to align superintelligence. We are hiring! 🧵
For more discussion, see our announcement post: alignment.org/blog/announcin…
It's rare to find good, easily-measurable metrics for progress in alignment. But we are cautiously optimistic that top submissions will produce ideas that meaningfully advance our research.
ARC and @aicrowdHQ are launching a ≥$100k contest for white-box estimation algorithms: given the weights of an MLP, the goal is to estimate the expected output of the network on Gaussian inputs. (Thread)
Jacob Hilton retweeted
Could an AI company lose control of its own agents? To find out, Anthropic, Google, Meta, and OpenAI let us (1) test their best internal models with CoT access, (2) review non-public info about capabilities, alignment, and control. The result: our first Frontier Risk Report.
Jacob Hilton retweeted
Some personal news: I've started a new AI safety standards org, and our first two standards are out today. We're called Guidelight, co-founded with fellow ex-OpenAI safety researcher, Page Hedley. (1/n)
@_Suresh2 The method works for estimating variance too! But yes, perhaps we should add a plot for that too.
Can you estimate the average behavior of a neural network without running it? In ARC's latest paper, we address this question for wide randomly-initialized MLPs with Gaussian inputs. (Thread)
@ABAtanasov Thank you! We are working on low width too, but it's harder :)
Congrats to first author Wilson Wu, as well as my other coauthors @vclecomte, Mike Winer, George Robinson and @paulfchristiano. Paper: arxiv.org/abs/2605.05179 Blog post: alignment.org/blog/mechanist…
Our current approach works at the start of training, but we have a lot more work to do to produce methods that work throughout training (even for small models like the AlgZoo models we shared a few months ago).
Jacob Hilton retweeted
Seems like a great opportunity for technical talent to come into government and help the USG make sound, technically informed decisions on AI
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more. They're serious about bringing in strong researchers & engineers and letting them do good work. Based in DC or SF: nist.gov/caisi/careers-…
Miles Brundage @Miles_Brundage
73K Followers 13K Following AI policy researcher, @lfschiavo wife guy, fan of cute animals and sci-fi, executive director of AVERI (https://t.co/qq9xcmKQas), Substacker, views my own
Jan Leike @janleike
133K Followers 335 Following AI research @AnthropicAI. Previously OpenAI & DeepMind. Optimizing for a post-AGI future where humanity flourishes. Opinions aren't my employer's.
Amanda Askell @AmandaAskell
104K Followers 662 Following Philosopher & ethicist trying to make AI be good @AnthropicAI. Personal account. All opinions come from my training data.
Ethan Caballero @ethanCaballero
13K Followers 2K Following ML @Mila_Quebec ; previously @GoogleDeepMind
andy jones @andy_l_jones
22K Followers 351 Following engineering & research at anthropic. i don't check twitter DMs. email me!
Sam Bowman @sleepinyourhat
66K Followers 3K Following AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. Into @givingwhatwecan.
Nathan 🔎 @NathanpmYoung
31K Followers 4K Following Director, Goodheart Labs. AI-written Community Notes (world first). Part time forecaster @swift_centre. Capital case tweets are literal, others less.
Jack Clark @jackclarkSF
136K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkIJ2 Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Jason Wei @_jasonwei
109K Followers 707 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Matthew Barnett @MatthewJBar
9K Followers 392 Following Co-founder of @MechanizeWork Married to @natalia__coelho email: matthew at mechanize dot work
Leo Gao @nabla_theta
13K Followers 580 Following working on AGI alignment. prev: GPT-Neo, the Pile, LM evals, RL overoptimization, scaling SAEs to GPT-4, interp via circuit sparsity. EleutherAI cofounder.
Daniel Paleka @dpaleka
5K Followers 941 Following ai safety researcher | phd @CSatETH | https://t.co/hCoh5RJgZD
David Krueger 🦥 �... @DavidSKrueger
22K Followers 5K Following Raising AI risk awareness at https://t.co/Fat9r8oGp0 AI prof at Mila. Formerly Cambridge, DeepMind, UK AISI. https://t.co/KKWOE9xKZB
davidad 🎇 @davidad
23K Followers 10K Following cognizing structures of information processing systems, in all their forms | category theory, perennial philosophy, Bodhitropic Alignment | cancel heat death
John Schulman @johnschulman2
76K Followers 2K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music
Spencer Greenberg �... @SpencrGreenberg
35K Followers 7K Following A psychology researcher/mathematician/entrepreneur. I tweet about psychology, society, rationality, science, and philosophy. My book: https://t.co/qd3iRl7q1X
Stanislav Fort @stanislavfort
17K Followers 8K Following Founder & Chief Scientist @Aisle_Inc | AI security | Stanford PhD in AI & Cambridge physics | ex-Anthropic and DeepMind | scientific progress + economic growth
Oliver Habryka @ohabryka
8K Followers 836 Following Building https://t.co/O5mQY6jndL and https://t.co/s49h898W4b.
Marius Hobbhahn @MariusHobbhahn
7K Followers 1K Following CEO at Apollo Research @apolloaievals prev. ML PhD with Philipp Hennig & AI forecasting @EpochAIResearch
Dipam Chakraborty @__dipam__
196 Followers 740 Following Machine Learning Engineer at @h2oai 🤖 Tweets about topics that interest me in Deep Learning/Reinforcement Learning
Oscar Sykes @OscarSykes7
686 Followers 623 Following
CEO X @emuske_109
8 Followers 495 Following CEO and lead designer/engineer. space launch costs and enable Mars colonization. Innovations include reusable rockets, Starlink satellite internet service.🚀🚀
Olivia Jack @Emilypgl
11 Followers 155 Following Corinthians 16:13 🩺🪖💐 🎵 Music lover | 💡 Big dreams | 🌍 Positive vibes DMs open for meaningful conversations.
Ozan Biçkin @443363dr
1 Followers 115 Following
alex @jack40733761
1 Followers 108 Following
Mohamed @mekkcyber
842 Followers 844 Following ML Research Engineer @whitecircle | prev @huggingface 🤗 | Msc @ParisSaclay | Making LLMs Faster & Smaller & Safer
𝕚𝕚𝕒 @nataliia_babina
5 Followers 154 Following
Amin Marashi @marashiai
6 Followers 224 Following
Qovren @Qovren
0 Followers 31 Following Status: dormant. Observation active. This will make sense soon.
Joey Rudoler @JRudoler
289 Followers 2K Following stats phd @Wharton into ML theory and 🧠 | prev: BCI @MemoryLab, physics @Penn ✡️עם ישראל חי
Diari @diari_cc
213 Followers 2K Following Product Builder 🚧 🤖 Trying to understand the stochastic machine ghosts https://t.co/monZOJVFkL
Shawn Im @shawnim00
245 Followers 210 Following PhD Student @UWMadison | NSF GRFP Fellow | Prev Intern @Apple MLR | @MIT https://t.co/ZI4hwpg1PG
Thomas Kiefer @th0maskiefer
32 Followers 988 Following Research @Stanford | MSc Computer Science @ETH Zurich | Ex-@Google SWE Intern
a @aaa17567
0 Followers 172 Following
JT @j1stime
112 Followers 1K Following ontology/robotics. currently obsessed with Trails (Crossbell, Erebonia arcs).
JackSmolly @JackLopsicle
2 Followers 84 Following
Tin (Kevin) Nguyen @tin_ng_qn
96 Followers 1K Following comp sci phd @ auuburn university summer intern at university of virginia
Momo @th000fly100
38 Followers 5K Following
Sharon cherian @SCherian5734
4 Followers 536 Following
Seth Lazar @sethlazar
8K Followers 3K Following Professor working on AI safety, governance and resilience. Now: ANU Philosophy. Soon: Johns Hopkins Government and Policy.
Rossa O'Keeffe-O'Dono... @rossaokod
607 Followers 846 Following AI Safety at @coeff_giving (fka Open Philanthropy). Formerly economist at @NuffieldCollege / @GPIoxford. Interests: AI/GCRs, development econ, animal welfare
Alm Chu @chu_alm
4 Followers 657 Following
Chris Harig @chrisharig99
77 Followers 860 Following
Eric Gilliam @eric_is_weird
5K Followers 3K Following I write about how 20th C. R&D orgs operated | Associate @RenPhilanthropy and Fellow @GoodSciProject, Stanford '19. Working to build more BBNs
Giovanni Occhipinti @G_Paintedeyes
6 Followers 265 Following AI safety research and field building | upcoming ERA fellow | founder of Safe AI Italy
Lisa Soder @lisa_soder_
460 Followers 671 Following Lisa is my name, AI governance my game | EU AI Office & @aigioxford
Josh Harkins-Finn @JHarkFinn
2 Followers 8K Following
ChristopherT @SegFault0612
3 Followers 439 Following
invi-bhagyesh 🏴... @invi_bhagyesh
657 Followers 7K Following maths ∩ AISafety, sophomore, I play dice, working w/ @lionellevine, currently on exchange @USTC
Indra @inderjitkl
24 Followers 228 Following
Allen Su @allenysu
291 Followers 3K Following mech interp & building https://t.co/YUJPigVfFw, Prev @BrainGateTeam @Rflabsinc @Apple
y8y @y8yc137
12 Followers 429 Following
JohnASloan6 @Sloan6A
436 Followers 2K Following
Jake McAllister Dorma... @JakeDorman64
17 Followers 60 Following PhD Researcher at the University of Nottingham, applying techniques from Statistical Physics to AI Safety and Alignment.
Clemens Winter @ClemensWinter
990 Followers 28 Following Maker. Distinguished member of the Rust Evangelism Strikeforce. Aspiring mad scientist-engineer.
Juhani Mykkänen @juhanimykkanen
3K Followers 381 Following Tech entrepreneur. Into AI. Past: Co-founder of Wolt, acquired for $8B. Mostly reading here. More active in real-world conversations, columns and podcasts.
Anthropic @AnthropicAI
1.5M Followers 2 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
Miles Brundage @Miles_Brundage
73K Followers 13K Following AI policy researcher, @lfschiavo wife guy, fan of cute animals and sci-fi, executive director of AVERI (https://t.co/qq9xcmKQas), Substacker, views my own
Amanda Askell @AmandaAskell
104K Followers 662 Following Philosopher & ethicist trying to make AI be good @AnthropicAI. Personal account. All opinions come from my training data.
Nathan 🔎 @NathanpmYoung
31K Followers 4K Following Director, Goodheart Labs. AI-written Community Notes (world first). Part time forecaster @swift_centre. Capital case tweets are literal, others less.
OpenAI @OpenAI
5.0M Followers 4 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
Matthew Barnett @MatthewJBar
9K Followers 392 Following Co-founder of @MechanizeWork Married to @natalia__coelho email: matthew at mechanize dot work
Leo Gao @nabla_theta
13K Followers 580 Following working on AGI alignment. prev: GPT-Neo, the Pile, LM evals, RL overoptimization, scaling SAEs to GPT-4, interp via circuit sparsity. EleutherAI cofounder.
Rob Wiblin @robertwiblin
51K Followers 855 Following Host of the 80,000 Hours Podcast. Exploring the inviolate sphere of ideas one interview at a time: https://t.co/2YMw00bkIQ
John Schulman @johnschulman2
76K Followers 2K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music
The OpenAI Foundation @FoundationOAI
7K Followers 0 Following OpenAI was founded in 2015 as a nonprofit; its mission is to ensure artificial general intelligence benefits all of humanity.
Elizabeth Barnes @BethMayBarnes
5K Followers 389 Following
Alex Mallen @alextmallen
626 Followers 308 Following Redwood Research (@redwood_ai) Prev. @AiEleuther
Ryan Greenblatt @RyanPGreenblatt
9K Followers 6 Following Chief scientist at Redwood Research (@redwood_ai), focused on technical AI safety research to reduce risks from rogue AIs
Sharada Mohanty @MeMohanty
1K Followers 1K Following CEO & Founder @AICrowdHQ | previously @EPFL , @CERN , IIIT-Hyd | Wannabe Artist | ❤️s AI, Art and Science
page @michaelhpage
492 Followers 458 Following Co-founder of Guidelight AI Standards (https://t.co/nnfFmyS3vd); ex-lawyer, ex-forecaster, ex-OpenAI (before it was cool). Michael Page = Page Hedley.
Americans for Respons... @americans4ri
3K Followers 896 Following AI policy advocacy in the public interest. ARI is leading the charge for a policy framework that mitigates risks, promotes innovation, and leaves no one behind.
Claire Hilton @claire_hilton6
115 Followers 67 Following
Samuel Hilton @weeatquince
13 Followers 42 Following
Geoffrey Irving @geoffreyirving
12K Followers 352 Following Cofounder and Chief Scientist at Sequent Research. Alignment will be solved, but not necessarily in time. Previously AISI, DeepMind, OpenAI, Google Brain, etc.
Bella Forristal 🔸 @bellaforristal
1K Followers 534 Following Effective altruism, veganism, various weakly-held takes on things | @80000hours | she/her | https://t.co/1NCIR2vZvg
Eli Lifland @eli_lifland
9K Followers 2K Following AI forecasting and governance @AI_Futures_. Co-author of AI 2027 and the AI Futures Model. Also @aidigest_, @SamotsvetyF. Prev @oughtinc
William MacAskill @willmacaskill
63K Followers 1K Following Consider donating 10% to effective charities: https://t.co/VMXkr4hnd7 Or a career for impact: https://t.co/AUIhrElLkr My research: https://t.co/dEcMWUnNHU
Alexander Berger @albrgr
16K Followers 2K Following Enjoys a good applied micro paper. CEO of @coeff_giving. Views my own, tweets self-destruct every once in a while.
Roger Grosse @RogerGrosse
12K Followers 806 Following
Joshua Achiam @jachiam0
27K Followers 1K Following Freedom, flourishing, and abundance. Chief Futurist @openai. Main author of https://t.co/cKuSh21yaz
Nathan Lambert @natolambert
90K Followers 917 Following Open model research @ something new. Prev. co-led Olmo at Ai2. Contact via email. Writes @interconnectsai Wrote The RLHF Book, 🏔️🏃♂️
Victor Lecomte @vclecomte
650 Followers 192 Following CS PhD student at Stanford / Researcher at the Alignment Research Center
The Midas Project Wat... @SafetyChanges
1K Followers 2 Following We monitor AI safety policies and web content for substantive changes. Anonymous submissions: https://t.co/5Ke9mIqOSM Run by @TheMidasProj
Eric Neyman @ericneyman
2K Followers 132 Following Professional reference class tennis player. I like non-fillet frozen fish, packaged medicaments, and other oily seeds.
Helen Toner @hlntnr
37K Followers 1K Following AI, national security, China. Part of the founding team at @CSETGeorgetown (opinions my own). Author of Rising Tide on substack: https://t.co/LKAoyL00iB
METR @METR_Evals
26K Followers 32 Following We work to scientifically measure whether and when AI systems might threaten catastrophic harm to society. Nonprofit.
Ajeya Cotra @ajeya_cotra
16K Followers 491 Following Helping the world prepare for extremely powerful AI. Risk assessment @METR_evals. Writing at Planned Obsolescence (about AI), Good Bones (about whatever).
James Bradbury @jekbradbury
17K Followers 9K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
Dustin Moskovitz @moskov
72K Followers 499 Following
Laurent Mazare @lmazare
3K Followers 88 Following Co-founder & engineering @kyutai_labs and @GradiumAI
EA Paddington 🍊�... @ea_paddington
603 Followers 471 Following Making the world a better place, one marmalade sandwich at a time. This century seems to be most important. If we are kind and polite, the world will be right.
Benjamin Hilton @benjamin_hilton
4K Followers 858 Following Head of Alignment Team & Loss of Control Risk Modelling and Mitigations Team at the UK AI Security Institute (AISI). views my own
80,000 Hours @80000Hours
31K Followers 516 Following You have 80,000 hours in your career. This makes it your best opportunity to have a positive impact on the world.
Samuel Persaud @samuel_persaud
79 Followers 207 Following A motivated, enthusiastic, engaged engineering student @BrunelUni, interested in motorsport, Ultimate Frisbee and music.
Derren Brown @DerrenBrown
1.8M Followers 66 Following Prince of Eternia and Defender of the Secrets of Castle Grayskull. Dislikes mushrooms.
Mayan Apocalypse @kabooooooooom
2K Followers 0 Following The end of the world. Floods, fire, meteorites - all that jazz.
Quite Interesting @qikipedia
1.1M Followers 904 Following A Quite Interesting Twitter feed from the team behind the BBC TV show QI. https://t.co/1JWvBwO1PN
Trends for United States
You might like
Jan Leike
@janleike
133K Followers
Leo Gao
@nabla_theta
13K Followers
Nat McAleese
@__nmca__
17K Followers
Rachel Freedman (will...
@FreedmanRach
3K Followers
andy jones
@andy_l_jones
22K Followers
Evan Hubinger
@EvanHub
10K Followers
Ethan Perez
@EthanJPerez
16K Followers
Jacob Steinhardt
@JacobSteinhardt
12K Followers
Jack Rae
@jack_w_rae
25K Followers
Dan Hendrycks
@hendrycks
45K Followers
Mark Chen
@markchen90
74K Followers
Rohin Shah
@rohinmshah
11K Followers
Alex Turner
@Turn_Trout
5K Followers
Jesse Hoogland
@jesse_hoogland
2K Followers
Daniel Filan
@dfrsrchtwts
3K Followers