Brandon Simonsen @B__Simo

numbers and stuff brandonsimonsen.com Sandy, UT Joined February 2009

Tweets

10K
Followers

186
Following

1K
Likes

2K

Tim Urban @waitbutwhy

2 years ago

Good day to remember just how big that green tree is

293 6K 58K 4.1M 12K

View Details

Brandon Simonsen @B__Simo

2 years ago

this applies just as well to modeling in general, ai or no. static distributions exist only in textbooks/theory.

A mindworm that has caused great damage among AI researchers is the implicit, universal assumption that every piece of data is a (random) "sample" from a (static) "distribution". This is a valid way of modeling some phenomena, but it isn't applicable to the vast majority of

73 125 1K 131K 387

0 0 0 58 0

View Details

Edward Snowden @Snowden

2 years ago

The vector of development that the internet and society is traveling leads away from extraordinary people sharing unique beliefs, and toward a tyranny of mediocrity. It is a preference for "normal" so strong that it extinguishes excellence; a ruthless allegiance to the average.

1K 3K 15K 1.7M 1K

View Details

Edward Snowden @Snowden

2 years ago

America lost something important today, and hardly anyone heard. The headlines of state-aligned media screech and crow about the nefarious designs of your fellow citizens and the necessity of foreign wars without end, but find few words for a crime against the Constitution.

Elizabeth Goitein @LizaGoitein

2 years ago

It’s over (for now). A majority of senators caved to the fearmongering and bush league tactics of the administration and surveillance hawks in Congress, and they sold out Americans’ civil liberties. Section 702 has been reauthorized, not just without any meaningful reforms… 1/10

434 4K 12K 6.2M 2K

460 7K 20K 1.8M 1K

View Details

François Chollet @fchollet

3 years ago

Every situation we find ourselves in had an infinitesimal probability of happening. If nothing else, we should appreciate that uniqueness.

13 33 298 33K 20

View Details

Joseph Cox @josephfcox

3 years ago

New from 404 Media: those food delivery robots that are armed with cameras and driving all over sidewalks in LA? They're providing filmed footage to the LAPD, according to internal emails we got. Food delivery robots just became surveillance devices 404media.co/serve-food-del…

40 532 1K 194K 101

View Details

John LeFevre @JohnLeFevre

3 years ago

The 18-44 age bucket is shocking…. Within two decades.

287 2K 7K 2.3M 2K

View Details

François Chollet @fchollet

3 years ago

The ability to access information online has been decaying for a few years, but with the rise of LLMs that decay is accelerating fast

Tyler Glaiel @TylerGlaiel

3 years ago

this is actually hilarious. Quora SEO'd themselves to the top of every search result, and is now serving chatGPT answers on their page, so that's propagating to the answers google gives the internet is dying

70 1K 12K 1.1M 292

15 98 557 108K 51

View Details

François Chollet @fchollet

4 years ago

A reflection on LLM capabilities and scaling laws. nature.com/articles/d4158…

4 36 181 40K 63

View Details

Brandon Simonsen @B__Simo

4 years ago

That boy gooooood

Skrillex @Skrillex

4 years ago

🔥QUEST FOR FIRE🔥 - new album out 2/17. You can hear tracks from QFF in my basement set live on YouTube now youtu.be/hb0XLX0b4Y4

419 3K 14K 1.5M 208

0 1 0 49 0

View Details

Brandon Simonsen @B__Simo

4 years ago

@subdocta Still to this day (probably forever) the best show I’ve ever been to

0 0 1 75 0

View Details

Brandon Simonsen @B__Simo

4 years ago

🧵

François Chollet @fchollet

4 years ago

It's clear that we're far from peak LLM performance -- these models will keep getting better. It's also clear that pure generation is just the first step -- we can largely alleviate the LLM reliability issue by using them as information retrieval devices over a knowledge corpus.

14 89 635 165K 136

0 0 0 58 0

View Details

Brandon Simonsen @B__Simo

4 years ago

Just wait, ChatGPT is only the tip of the iceberg. But don’t be fooled, there is zero real intelligence here. The capacity for it does not exist, not will it for the foreseeable future.

0 0 0 31 0

View Details

Brandon Simonsen @B__Simo

4 years ago

AGI will require wholly different capacities that data more broadly, and AI models specifically, of today are fundamentally incapable of solving. Bigger data and fancier models will not be enough, though the achievements can and will continue to astound.

1 0 0 25 0

View Details

Brandon Simonsen @B__Simo

4 years ago

AGI is not coming anytime soon. Don’t just take the word of this one lowly data scientist, trust François. One of the most brilliant minds in the field, and always upfront about the limitations of current ML/AI methods.

François Chollet @fchollet

4 years ago

So far all evidence that LLMs can perform few-shot reasoning on novel problems seems to boil down to "LLMs store patterns they can reapply to new inputs", i.e. it works for problems that follow a structure the model has seen before, but doesn't work on new problems.

35 69 591 156K 130

1 0 0 65 0

View Details

Brandon Simonsen @B__Simo

4 years ago

@calebhicks At least you’re getting some sleep in there. Often for me, when inspiration strikes and I’m really in the flow, it can mean zero sleep at all 🥴 do not recommend.

1 0 0 0 0

View Details

Brandon Simonsen @B__Simo

4 years ago

@calebhicks Long long way to go yet. Not inevitable we get there either imo. What is inevitable though are increasingly stunning abilities that meet — maybe surpass — our expectations of one.

0 0 0 0 0

View Details

NASA @NASA

4 years ago

We can't contain the excitement for @NASAWebb's first full-color images! On Monday, July 11 at 5pm ET (21:00 UTC), President Biden will unveil one of the space telescope's first images of deep space as a preview of what's ahead: go.nasa.gov/3NUQ8Dx

551 3K 17K 0 156

View Details

Brandon Simonsen @B__Simo

4 years ago

0 0 0 0 0

View Details

Brandon Simonsen @B__Simo

4 years ago

IME (admittedly zero of which FAANG-like), even at companies *with* data engineers, any data role will be 90% data engineering. Static, tidy data simply does not exist in the real world.

Santiago @svpino

4 years ago

A shocking revelation: Companies don't have "datasets" waiting for you. It's your job to create and maintain them. This is time-consuming and hard, but primarily responsible for the success of your machine learning system. Here are some thoughts: 1 of 7