John Keiser @jkeiser2
Mad scientist / software engineer. In spare time, I design languages and unicycle with my kids. I helped start @CampQuestNW. johnkeiser.com Seattle, WA Joined July 2009-
Tweets2K
-
Followers657
-
Following244
-
Likes183
System Initiative is the future of DevOps Automation. It's ready to replace Infrastructure as Code today. systeminit.com/blog-system-in… - sign up at systeminit.com!
System Initiative is the future and it's ready for you to replace Infrastructure as Code. Read more about why on our blog, systeminit.com/blog-system-in…, and get started today: systeminit.com youtu.be/20vIl7I0R4I
@spacegho_st Yeah, true. Your use case seems to split up the file and process it in parallel, which implies you are copying parts of the file to other machines. If you controlled the producer you could even *generate* each machine's part locally and avoid copy cost.
@spacegho_st Parallel processing is harder if records split across chunks. Ensuring a clean split during JSON generation seems easiest. Surgically scanning for record boundaries when splitting could work too. Could also overlap chunks if records have max size.
@spacegho_st We called it "on demand" in simdjson. It doesn't use schema explicitly, but takes advantage of the fact that most code that consumes JSON already encodes the schema (loop this array, read string with key "name" and int "age" ...).
@spacegho_st I suspect simdjson will beat most custom jobs up until the point where they are so big they need streaming parsing (which is your case). Parallel parsing is also an interesting case, and I've got thoughts on that but haven't had time to write them down in C++ :)
@justinschiebs Is it permissible to stub someone's toe as part of an art piece that inspires contentment, leading many people not to stub others' toes?
@justinschiebs @GhostCoase Do you mean it might always be the less moral option, or that it depends? Your original question reads like "is it *ever* ok to prioritize aesthetic good over harm?" And if it depends, the answer to that is yes.
@PhilAndrew61181 @lemire Yep, if you access the keys in a different order than the json it will circle round. There isn't an explicit stack: outerObj and b are variables that keep track of their own start positions.
@spacegho_st @lemire It's clever since it is still valid json. But the pretty printing step has to be serial, no? Are you going to process the pretty printed JSON more than once? Otherwise I'm not sure how you gain much ...
@spacegho_st @lemire Yep, your trick is essentially to store the depth of each value using the number of tabs before it. This particularly allows you to parallelize the parse since you can start anywhere and know what you are looking at (assuming your schema is simple enough).
@PhilAndrew61181 @lemire No, since you just finished reading the email, it starts looking for "password" key starting from the comma (e.g {"email": "...", "password": "..."})
@the_yamiteru @lemire When you use ondemand you get a cursor representing an object or array; jsonObj["email"] puts the cursor at the "," after the email, jsonObj["password"] scans from that point to find the password and puts the cursor at the "}" or "," after the password.
@PhilAndrew61181 @lemire It's not designed around a skeleton. ondemand myobject["key"] scans through the JSON (counting braces) until it finds "key" in the current JSON object, skips (and validates) the ":", and puts the parser at the start of the value so you can work with it.
@clintonmead @lemire @etorreborre On Demand is a streaming dom, and will check the closing brace when you get to the end of the array or object you are reading. SIMD isn't really the trick here: On Demand reads whole documents faster than simdjson's SIMD DOM parser, even using the same SIMD code.
@PhilAndrew61181 @lemire In most cases dom is slower, because you have to iterate the whole document a second time (in its dom form) when you actually use it. dom can get faster when you *need* to iterate the document multiple times in a generic form.
@the_yamiteru @lemire To use a typical one-shot JSON parser, you have to iterate the document twice: first to create a generic object that can hold any JSON type, and second to retrieve "email" and "password" keys from that generic structure. On Demand lets you do it once, strictly faster.
@adamhjk I'm really looking forward to seeing infrastructure management that actually cares about its user interface!
Adam Jacob @adamhjk
19K Followers 1K Following CEO of Swamp Club, Co-Founder of Chef. Sustainable free and open source software communities. Music. He/Him. https://t.co/fyc6yziWBv
Geoff Langdale @geofflangdale
4K Followers 144 Following CMU CS PhD; Hyperscan chief; Intel Principal Engineer. Side projects include a superoptimizer. he/him. Vegetative electron microscopist.
Yvonne Lam @yvonnezlam
3K Followers 749 Following I play with books, cats, food, yarn, and dirt, not all at the same time. Software engineer. Society of People Interested in Boring Things. She/her, cis.
Daniel Lemire @lemire
36K Followers 2K Following Software performance expert. Ranked in the top 2% of scientists globally (Stanford/Elsevier 2025) and among GitHub's top 1000 developers. Father, husband.
Jon Masters 🏴�... @jonmasters
17K Followers 7K Following Troublemaker | Computer Architect | @Arm Servers Architect @Google | Previously @RedHat, @Nuvia_Inc | Runner | Author | All views my own | #ArmServers
Rijul Rajesh @RijulTP
46 Followers 163 Following I build tools. Right now I'm focused on LiveReview, AI code review that gives teams control over AI-generated code without slowing them down.
Paul @PaulSangleF
2K Followers 4K Following Founder at https://t.co/UUeydPyIis (YC X25) AI code reviews for complex codebases
Fejo @Fejo69252
47 Followers 2K Following
Yfleuirdirn @Yfleuirdirn682
29 Followers 1K Following
Zhiwei Li @lzwjava
469 Followers 7K Following Zhiwei Li | AI Full-Stack Engineer | Read 320+ Books | Java Spring MySQL Redis JavaScript iOS Android Vue | Azure AWS GCP Alibaba Cloud | PyTorch CUDA
Justen Abshire @AbshireJus29412
0 Followers 124 Following
Olawale @olawwwale
359 Followers 665 Following programmer - interested in low-level systems programming. i love technology, vr, sim racing, cycling, cars
Gambo A Maina @GamboMaina
93 Followers 2K Following 🇪 🇳 🇹 🇷 🇪 🇵 🇷 🇪 🇳 🇪 🇺 🇷 🅼︎🅰︎🆁︎🅺︎🅴︎🆃︎📶🅴︎🅳︎🆄︎🅲︎🅰︎🆃︎🅾︎🆁︎ FINANCIAL ANALYSTS 📉📈 💻
Jinghua Zhong @zhongjinghua
0 Followers 5K Following
Dmitrii Odintcov @CyprusSocialite
11 Followers 388 Following “The nice thing about standards is that there are so many to choose from” — Andrew S. Tanenbaum
System Initiative @thesysteminit
2K Followers 119 Following
Matthew Alp @MatthewAlp
259 Followers 3K Following 🇨🇦 | Curious about compilers, databases, (noisy) systems of all sorts. Follows are footnotes, not endorsements
Tommi Rocks @tommi_rocks
0 Followers 148 Following
~g @germelcar
155 Followers 2K Following
Rob Palmer @robpalmer2
12K Followers 2K Following JavaScript Infrastructure & Tooling at Bloomberg. Co-chairing @TC39. Likely to tweet tech stuff about JS & software performance. Opinions are my own.
William @willbr
7 Followers 5K Following
Tommy Reilly ⛰🌨�... @gnurizen
119 Followers 921 Following Garbage collector, musician, lumberjack, nutrition nerd and terrible hockey player. Do your own research!
Ryan Cragun @ryancragun
315 Followers 639 Following Find me somewhere else: 🦋https://t.co/OhA0GLSntI GH: ryancragun 🦣 [email protected]
Kriau @_Kriau_
88 Followers 459 Following
Ash @bak2k2
183 Followers 3K Following Engineering executive| investor | Stanford GSB | fintech| commerce | Innovation| Amazon
Data Value Strategy @innovimax
622 Followers 5K Following W3C Member (XSL, XQuery, XProc), ISO SC 34 Member, AFNOR Member, ANR CODEX Project
Dr Ian Preston @Ianopolous
561 Followers 3K Following Ex particle physicist turned privacy researcher. Building an e2ee web with @peergos #covidisnotover #maskswork @ianopolous.bsky.social priv/acc
Thetheson @thetheson21183
95 Followers 1K Following
MillionInMaking @MillionInMaking
4 Followers 112 Following My dream is to become a millionaire and gift a house to my parents. Cashapp, Venmo : MillionInMaking
Whiskey Tango @foo61263002
95 Followers 715 Following
Olivier @maholi03
1 Followers 885 Following
SpiderPuli @SpiderPuli
351 Followers 2K Following I work for @amazon Always looking for new things to learn Opinions are my own
Selythath @selythath51191
69 Followers 5K Following
Shenneet @Shenneet175685
45 Followers 3K Following
Mateusz Szczyrzyca @Eszekesze
138 Followers 1K Following Mainly about programming and science (Go & Rust Kraków meetups)
rkecojoncb @rkecojoncb
6 Followers 7K Following
Jeroen Koekkoek @k0ekk0ek
7 Followers 59 Following
Nidhal Saïdani @nidhalsaidani
188 Followers 5K Following
a @Ngeol2021A
14 Followers 1K Following
Mary Alice @MarySandra4326
93 Followers 763 Following I'M HERE LOOKING FOR SERIOUS RELATIONSHIP THAT WILL LEAD TO MARRIED ❣️💞💞
Adam Jacob @adamhjk
19K Followers 1K Following CEO of Swamp Club, Co-Founder of Chef. Sustainable free and open source software communities. Music. He/Him. https://t.co/fyc6yziWBv
Matty Stratton @mattstratton
15K Followers 1K Following Head of Developer Advocacy & Docs at Tiger Data
John Carmack @ID_AA_Carmack
3.1M Followers 289 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo Aerospace
Charity Majors @mipsytipsy
81K Followers 591 Following honeycomb, observability, the second edition of "Observability Engineering" is coming out soon. find me on substack, bsky, LI, and occasionally here. 🐝🏳️🌈🦄
Corey Quinn @QuinnyPig
105K Followers 1K Following Chief Cloud Economist and co-founder at Duckbill. Author, Artificial Confidence. Professional skeptic with receipts.
cheeseplus @cheeseplus
1K Followers 943 Following build/release for ??? @Respawn; milbrat/goalkeeper/breaker of computers; @cheeseplus.biz on bsky
Geoff Langdale @geofflangdale
4K Followers 144 Following CMU CS PhD; Hyperscan chief; Intel Principal Engineer. Side projects include a superoptimizer. he/him. Vegetative electron microscopist.
Yvonne Lam @yvonnezlam
3K Followers 749 Following I play with books, cats, food, yarn, and dirt, not all at the same time. Software engineer. Society of People Interested in Boring Things. She/her, cis.
Patrick Debois @patrickdebois
31K Followers 8K Following Generative AI and DevOps specialist - co-author Devops Handbook - https://t.co/PZlox9jwoq
Daniel Lemire @lemire
36K Followers 2K Following Software performance expert. Ranked in the top 2% of scientists globally (Stanford/Elsevier 2025) and among GitHub's top 1000 developers. Father, husband.
Jon Masters 🏴�... @jonmasters
17K Followers 7K Following Troublemaker | Computer Architect | @Arm Servers Architect @Google | Previously @RedHat, @Nuvia_Inc | Runner | Author | All views my own | #ArmServers
Kate @thingskatedid
22K Followers 1K Following she/her · If I unfollowed you, it's because you keep posting things without alt text https://t.co/FpwhLrRETb
Mary Thengvall (she/h... @mary_grace
6K Followers 987 Following Director #DevRel @Camunda🥑 #DevRelBook author https://t.co/GE5CCm19wQ 📚 @community_pulse🎙 #DevRelWeekly📝 @jermops's partner 💗 #MayaMalle #LillieRaptor 🐶
AU @amubiera
63 Followers 774 Following
January 6th Committee @January6thCmte
587K Followers 9 Following Select Committee to Investigate the January 6th Attack on the United States Capitol | Representative @BennieGThompson, Chairman
Mueller, She Wrote @MuellerSheWrote
722K Followers 13K Following I have the same handle everywhere. Subscribe to my FREE newsletter: https://t.co/QZeOoeMenI Secure contact: [email protected]
Alasdair Beckett-King @MisterABK
91K Followers 4K Following Find me on Bluesky or basically any other website | Books, Podcasts, Links: https://t.co/c9vCn1jFBL | Pronouns like a butler coughing: he/him
Opening Arguments @openargs
22K Followers 2K Following The law podcast that helps you make sense of the news! With comedian Thomas Smith and real life lawyer Matt Cameron
ejzdsl @ejzdsl
4 Followers 35 Following
Anatoliy Kuznetsov @bitmagicio
262 Followers 305 Following BitMagic Library for search systems, bioinformatics, logical inference, succinct data structures, compression. SIMD, HPC, data parallel programming.
Sergey Slotin @sergey_slotin
2K Followers 537 Following I'm teaching sand to think. He/он/er/él/il/他
moves like baggins @shiftleftist
472 Followers 759 Following Technical debt credit counselor | #TeamADHD | Bacon number of 3 | He/him
an/dre @consumptive_ai
1K Followers 639 Following all opinions are mine, not that of my corporate overlords. product @mezmodata
Darrell @beached_whale
409 Followers 683 Following C++, computer science, electronics, oxford commas, and running (he/him) https://t.co/jZOJl4pGke @[email protected]
Felix Geisendörfer @felixge
14K Followers 2K Following Software Engineer @datadoghq working on Go Profiling, Performance, OpenTelemetry and more. Before: @Apple, Co-founder @transloadit, @nodejs core dev
Thomas Pelletier @thompelletier
216 Followers 145 Following Head of ML Platform and Infrastructure @ https://t.co/dnBQUsGxRv
Gen Gambardella @GenGambardella
8 Followers 65 Following
Manish @ManishEarth
15K Followers 623 Following territory mapper. 💉did @ca_covid . 🗣️ likes languages. ✈️ Repatriate/ABCD. 👨🔬 Formerly physics. he/him
Patrick Walton @pcwalton
18K Followers 516 Following Programming languages and graphics person. @pcwalton.bsky.social
@aturon.bsky.social @aaron_turon
4K Followers 1K Following Moving to https://t.co/P5wWeIrvf4 @[email protected]
This Week in Rust @ThisWeekInRust
33K Followers 31 Following Cataloguing the Rust community's awesomeness. Also at https://t.co/nGTNd2tHk4 #rustlang
Kira Franz @TotallyNotKira
258 Followers 1K Following Now on Bluesky, same handle. Parent, lawyer, startup builder, bicycle fan, lover of the ocean. Pronouns they/them. Opinions are my own, and multitudinous.
nivin ☕ @paulnivin
1K Followers 2K Following occasional veridian dynamics employee. former lyft eng & tweet mine worker. life. better.
No longer here 🏳�... @sophiajturner
10K Followers 0 Following
Rust Language @rustlang
153K Followers 2 Following A programming language empowering everyone to build reliable and efficient software. ** This account is no longer active. Follow us on other platforms! **
Brad Fitzpatrick 🌻 @bradfitz
49K Followers 1K Following I do computers. Married to @radkat. 3 kids. Xoogler. @golang team '10~'20. Made LiveJournal, memcached. Now @Tailscale. Mostly in bluer skies these days.
Mike Keiser @instig88
21 Followers 267 Following Heavy equipment tech and truck driver in Seattle. I'm mostly here for entertainment, traffic updates and stock info.
Christopher Webber @cwebber
2K Followers 1K Following Ride HEAD or die trying. Shaver of Yaks and lover of Ops. Dir Plat Eng, Formstack. Former Tenable, Chef, UCR. Rotarian. I speak for myself, not where I work.
Herb Sutter @herbsutter
22K Followers 4 Following Author, chair of the ISO C++ standards committee, and native languages architect at Microsoft.
Chandler Carruth @chandlerc1024
14K Followers 230 Following Software, performance, optimization, programming languages, security, open source, #CarbonLang lead, #LLVM, #Clang, C++. 🏳️🌈 he / they
Tim Babb @tr_babb
1K Followers 550 Following advanced cat befriender. see also https://t.co/SmrE6gf5KJ
Ken Chiu @kjw_chiu
928 Followers 2K Following Ass. Prof. of Comp Sci at Binghamton U. Parallel computing, applied ML, science groupie. I reply/tweet haphazardly and eclectically. @kjw-chiu.bsky.social
Christoph 🇺🇦 �... @chsiedentop
325 Followers 2K Following ex-Autonomous Driving engineer. Likes to bike. he/him 🚴🏻♂️💻 @[email protected]
Stephen Delano @sdelano
187 Followers 125 Following
Mara Null Cating-Subr... @selfification
198 Followers 281 Following I science things or blow up software by sheer existence. Aspiring astrophysicist. Very skeletally broken. Queer AF. Abstract math+lefty nonsense. She/They
Ryan Cragun @ryancragun
315 Followers 639 Following Find me somewhere else: 🦋https://t.co/OhA0GLSntI GH: ryancragun 🦣 [email protected]
Jeff Atwood @codinghorror
263K Followers 2 Following Indoor enthusiast. Co-founder https://t.co/e62S5uByfO / https://t.co/Tuh5wHPHTI. Let’s be kind to each other. I am no longer on twitter. Find me @[email protected]
Joshua L Gilliland @HeadInCloudPM
17 Followers 48 Following Realized I needed a professional Twitter profile...so here it is. I do program management stuff for Azure.
Niall Murphy @niallm
4K Followers 3K Following CEO, Stanza Systems. [email protected] for automation
You might like
