Conclusion after my trial use of the much vaunted (and overhyped) DeepSeek's AI platform: this chatbot is simply just an AI version of the PRC Ministry of Foreign Affairs. 🙃
One of the great memos of the LLM era, very much bears rereading.
So many investors read it and still invested a sky-high valuations anyway.
Can’t say people like me and the unnamed memo writer didn’t warn them.
FROM THE PAST 🤯
remember 2 years ago, there was a leaked internal Google document claiming open-source AI will surpass google and openAI
how true is this today?
Perplexity is one of the most critical metrics when designing large language models, yet most people can't explain how it works.
Perplexity quantifies how uncertain a model is when predicting the next word in a sequence. It tells us how many options the model considers on average when making predictions.
For example, if a language model has a perplexity of 10, it means that the model is choosing between 10 plausible options for the next word at any given step. The lower the perplexity, the better the model's predictions align with the actual text.
A good way to think about perplexity is to look at how "perplexed" a model is at any given time. When the model is confident about what comes next, it will have fewer choices and a lower perplexity score. When the input is ambiguous or unfamiliar, the model's uncertainty increases, raising the perplexity score.
You'd never want to trust a model with high perplexity, so it's a great metric to decide whether you want to ask humans to step in before using the model's output.
Fortunately, it's very simple to compute the perplexity of a model, so we can use it during training to monitor how well a model is learning. The metric is also easy to understand, explain, and interpret.
Keep in mind that perplexity doesn't measure accuracy. A model can have low perplexity but still make incorrect predictions. For instance, it might confidently predict the wrong word.
We can't use perplexity to compare different models unless they use the same tokenization, dataset, and training methods. A model's perplexity score depends heavily on these factors, making it less useful as a universal benchmark.
Finally, perplexity doesn't capture a model's ability to understand long-term dependencies in text. It evaluates predictions token by token, missing the bigger picture in complex language tasks.
Here is a link to the book:
bit.ly/49lBHVq
A few notes about the book:
1. It's a good mix of theoretical concepts, code, and practical case studies.
2. You'll get a ton of time building real-world RAG pipelines. There's plenty of practice here.
3. The main focus of the book is on balancing performance and costs. I love books that acknowledge that "the best solution" is full of tradeoffs.
(Sorry I botched the name a bit)
Cursor editor: cursor.com
Get pro for $20, then in Cursor settings select Sonnet 3.5. Then watch all the videos on how to use and practice.
(I think both the setup above and the usage is somewhat beginner unfriendly, maybe someone can link to good videos / guides)
I'd like to have a real conversation about whether AI is a risk for human extinction. Honestly, I don't get how AI poses this risk.
What are your thoughts? And, who do you think has a thoughtful perspective on how AI poses this risk that I should talk to?
Ep. 7 of BOB Radio is here ⬇️
youtu.be/mJF_r4HsNs0
Our special guest: Mr. Albert Buu, (@subnetmask) Founder and CEO of @neutronpay recorded straight from Da Nang where they hosted @LightningconVN. Are you ready for Hyperbitcoinization in SEA?
BOB Radio ep. 8 is here!!
Our special guest: Mr. @louishliu, Founder & CEO of @MimesisCapital, possibly the world's first #Bitcoin family office.
How Louis innately understood scarcity? Why did he start Mimesis? What did he invest in? What's next? 🔥🔥
youtu.be/Dj0yy7PBX4U
No need to endlessly scroll on your streaming platform—you can now watch all #FutureForward short films right now! Experience the inspiring journeys of people and companies taking bold climate action, right from your living room. Check it out: theclimatepledge.com/future
Let's start with this prompt from Midjourney V4
This is already quite a verbose prompt for MJV4.
Now let's run it through my little magic ChatGPT prompt.
Hold on to my beer.
Make custom videos with just text and your input video.
He cleverly used @LumaLabsAI and @runwayml's Gen-1 for this (great work)
The results are amazing.
426 Followers 1K FollowingLead full-stack engineer & architect with a founder's instinct for what to build. One of the first engineers at Parloa (pre-seed to ~$3B), VC-backed founder.
2K Followers 1K Following“Build On Bitcoin”. #Bitcoin only incubator, co-working and education space in Bangkok. npub1vlkx3xr0ulv5l65u4vwr7hknnkge4mwe76dd6gwfjezcffmu03aqpks68j on Nostr
917 Followers 2K FollowingRetired with a few cards less of a full deck but can now can win....Opinionated and will say what I think. Hopefully in a respectful manner. Sometimes, maybe.
6K Followers 3K Following🅼🅰🅳🅴 SOVEREIGN. #God1st #BITCOIN #Maxi #TexasSTRONG #Tonkawa #Mestiza 🪶#Esoteric #Theocentric #GFY🌕🌑 Cynical AF! YES, I study demons for a living ✝️🌅
354K Followers 7K FollowingLEE Kin Mun, Blogfather of Singapore, satirist, writer, lyricist, photographer, podcaster. Showers in the morning and at night. mr_brown on IG & Threads.
12K Followers 3K Followingex-Head of APAC ecosystem @huggingface, interested in future tech. Ex-Googler on TFLite/micro. Ideas are my own. DM me to talk open source and robotics in APAC
7K Followers 1K FollowingI cover tech & geopolitics @business. Don't use this site much but you can find me on Signal @/mackhawk.71, off record unless agreed otherwise. DM for WeChat
1.5M Followers 2 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
196 Followers 196 FollowingCommunity of bootstrapped founders looking to grow.
Sharing how to go from 0-1k users organically.
Building https://t.co/odwEtAaQyS to automate the whole thing.
22K Followers 73 FollowingAssociate Professor at @NTUsg. Science, Technology, and Society (STS). Risk and Disaster. Sociotechnical Resilience. City Studies.
117 Followers 3 FollowingThe official global account of Tabelog – Japan’s #1 restaurant discovery & reservation platform.
*Please note that we are unable to respond to DMs or replies.
2K Followers 659 FollowingInnovatrics is an independent, trusted partner for biometric identity management technology. 500+ projects in 80+ countries and over a billion people processed
18K Followers 2K FollowingAuthor of Scaling People. Work @stripe. Board member, mom, wife and busy friend. Never enough time to read all on my list. Pretend to garden. Roughly that!
844K Followers 131K FollowingWe discover and support independent film and media artists. 2027 #SundanceFilmFestival: January 21–31 in Boulder, Colorado
57K Followers 11 FollowingBuild and share machine learning apps in 3 lines of Python. Part of the @Huggingface family 🤗.
DMs are open for sharing your gradio app with us for promotion!
15K Followers 774 FollowingLightning infrastructure for businesses that move money at scale. Instant payments. No chargebacks. Voltage Credit: working capital in USD or BTC.
4K Followers 1K FollowingI turn AI into Art, Worlds & Stories ⛩️ Unimpressed
Web 3 Hub | AR Digital Art Gallery & Coworking Space
@chainguru 🌋🏝️🌊 自由だ 🔴
943K Followers 2K FollowingA magazine of U.S. foreign policy and international affairs, founded in 1922.
Sign up for our newsletters: https://t.co/MpbtG0OxgB