I'll say it again for the AI risk experts in the back:
We've already run a real life, large scale experiment on what happens when a superintelligence is unleashed on a narrow objective.
Look no further than U.S. capital markets.
Millions of investors, analysts, traders and algorithms, backed by trillions of dollars and wired together through prices, all chasing one goal: the highest risk-adjusted return on capital.
And it is spectacularly good at its job. It funds the best ideas, punishes the worst ones, and turns new information into prices faster than any of us can react. No individual can out-think it. 99+ percent of professionals can't beat it.
But look at what else it's done along the way:
- Optimized the measure instead of the intent. Quarterly earnings became the scoreboard, so companies learned to manage the scoreboard.
- Treated anything without a price as free. Pollution, addiction, obesity, depression, political fragmentation, fragile supply chains, the long-term health of the communities it operates in.
- Found every gap in the rules, then paid lobbyists to help write the next set and pull up the ladder behind incumbents.
- Remade the world around its objective. Companies, pension funds and our retirement accounts now answer to the S&P 500.
- Made itself impossible to switch off, because everything else now depends on it.
None of this required malice. Nobody sat in a room and chose these outcomes. It's simply what a very capable optimizer does when its objective is a narrow proxy for what we actually care about.
And note that we never solved this alignment problem. We've managed it, imperfectly, with regulation, taxes, disclosure rules and the occasional crisis to show us where the guardrails were missing. Over time, the market has captured the instutions designed to constrain it. We've been at it the better part of a century, and the misalignment is the worst it's ever been.
So the next time someone tells you AI is only dangerous if it "wants" something bad, or if its goals are mis-specified, point them at the S&P 500. It doesn't want anything. It just optimizes.
That's the whole problem.
@Aella_Girl Does this mean that living in central NJ is an even better solution than rationalism since we didn’t have to start a cult to figure this out ?
NYU math professor Tristan Buckmaster says OpenAI’s Tuesday drop of 722 AI-generated math papers wiped out entire research programs:
“This recent dump of papers on Tuesday destroyed the careers of early career mathematicians.”
@mmjukic Now imagine the Rape of Nanking.
Then the peak of the US Civil War.
How about Napoleon’s retreat?
Maybe the Revolutionary war…
This whole sequence of “my struggles are the worst that humanity has ever experienced” is the same old tiresome narcissism.
It is time to stop listening to autistic tech bros about every single thing associated with qualia, consciousness, emotion, belief, and materialism.
Elevating the values of people with a broken emotive capacity is not an evolutionary impulse.
@Bensam123TV@stephenjhall@elonmusk@levie You’re going even further in absurdity.
The simulation is just another unfalsifiable conjecture… like God
“Be nice, cause God”
“Don’t say bad words to the wall, cause the wall might have feelings”
@stephenjhall@elonmusk@levie This is the correct answer.
“Pain” is associated with triggers and pain receptors on animal bodies.
Matrix multiplication is not in any way related here.
@ChrisHeidorn@David97717063@dvassallo@Val_on_x Oh… you mean the banks we bailed out thanks to more bad policy decisions from a decade prior?
I don’t think “global phase” means what you think it does.
After six years in stealth, Atomic Machines is out. Our mission: on-demand, universal command of matter. First beachhead: the Matter Compiler, an AI-native manufacturing system that builds working micro-machines from code alone. No per-product tooling. No process development.
It’s really hard to justify any of these ideas.
Hot take: everyone who still votes democrat after 2026 has failed the IQ test. Even never-Red @billmaher is shifting.
Reading the responses, I still can’t wrap my head around the universal hate for Russia in the West. Since at least Reagan, there is no threat.
Hot take: Russia wouldn’t have invaded if the Western intelligence agencies weren’t doing everything in their power to subvert Ukraine.
Some notes on my situation in Latvia:
What I am observing at the moment is a threat of very severe extrajudicial punishment for speaking my mind and providing original opinions and analysis.
The reason they opt for persona non grata status is the desire to deny me justice in
@DissapointedK@KaiserLoengramm@curtis_yarvin I don’t think you’ve properly responded to the point of pragmatism.
This pedestal of theory is why the Romans beat the Greeks but absorbed their literature.
The Laws of Power don’t include theory.
@alex_raynor1968 This is wrong.
NATO, since 1950s, was fully funded and subsidized by USA while European banks received all of the benefits. Dulles did not form his Intel agencies in the US; he did it in Europe.
London wagged the dog until 2024.
33K Followers 96 FollowingCo-founder of the https://t.co/MeQaJmVqzM (1,600+ participants). Author of https://t.co/eByVy8oVhs (100,000+ subscribers). Mother of 3.
29K Followers 185 FollowingI am retired Emeritus Professor at The University of Arizona, Tucson, Arizona and Senior Scientist, Quantum Life Technologies, San Francisco, California
14K Followers 775 FollowingCo-founder of Standard Agents (🤫). Compulsive open source builder. Creator of dmux, ArrowJS, FormKit, AutoAnimate, Tempo, zodown...
53K Followers 5K Followingart bell fan. gordon lightfoot❤️. i write about internet history + culture, commission me. bylines all over. default.friend on insta. 🐬
1.2M Followers 811 FollowingExecutive Director, @FFO_Freedom. Former State Dept Cyber. Author of the unpublishable monstrosity, Weapons Of Mass Deletion.
733K Followers 2K FollowingTour: https://t.co/0EvFPCAWq7 My show https://t.co/vU0FN5Npky, Stand Up https://t.co/lYWunjjmw8 Podcast https://t.co/ifaVHHqvrd Book https://t.co/zdHM2ncpCD
469K Followers 149 FollowingAdvocating for Trump's economic revolution - tariffs, American industry, and manufacturing. Check out our merch store 👕 https://t.co/SImD6UZvhN
132K Followers 175 FollowingPromethean Action co-host. American System and America First; student of economic scientist, Lyndon LaRouche. Only genuine account. I don't sell crypto!
89K Followers 2K Following#Gold #Goats & #Geopolitics.
It's time to get serious about collapsing institutions.
Long Guillotines, Rope Makers and Lead Futures.
End Trotskyism!
1.1M Followers 2K FollowingDire Wolf Mode | Sateré-Mawé Warrior | Honorary Berkutchi
8830 AC64 17F2 5164 195C 05DE 21E3 E377 13E1 5586 | CEO of IOG and King of the Rats
472K Followers 5K FollowingFacts & Conspiracy | Non-(Pay)triot | | N.O. B & R | Pro Gun-Pro Money | Infotainment | Comedy | Red Line Intel/Info 🚫 | Simon Says Follow Me | 易っイ h
478K Followers 72 FollowingChief Macro Strategist
Contrarian Macro Advisors
53 yrs on Wall Street, first as an institutional portfolio manager, then as as a macro strategist.