Human Feedback Foundation is a Linux Foundation AI & Data nonprofit focused on human feedback and input layer for open source AI.humanfeedback.io Toronto, CanadaJoined January 2024
🇨🇦 From Toronto to London 🇬🇧
We’ve had another month full of exciting discussions with AI/ML builders at @AITinkerers! We headed to the Toronto AI Agents meetup at @ada_cx's HQ, also catching up with our partner and the meetup series producer @HumanFeedbackIO.
CDL, @HumanFeedbackIO, and @daisTMU are proud to jointly announce the launch of the Responsible AI Adoption for Social Impact (RAISE) pilot program, a national initiative to help nonprofit organizations across Canada adopt AI responsibly and effectively.
globenewswire.com/news-release/2…
📊 Introducing Prolific’s AI user experience leaderboard—the most reliable framework for evaluating AI against human preferences.
We’re thrilled to share our benchmark on @huggingface, which assesses how well language models handle real-world tasks based on user experiences. 👇
This evaluation approach means we can tune #AI output to human preferences for better accuracy, alignment, and advancement.
Special thanks to @huggingface, @HumanFeedbackIO, @MLCommons, @collect_intel, and @FactoredAI for supporting the development of this benchmark.
AI in Philanthropy Conference speakers that stood out:
- Mark Bloomberg of Bloombergs Charity Law
- Tareq Alani of @chorus_ai_inc
- Jason Shim of CCNDR
- Elena Yunusov, @HumanFeedbackIO
Presented by @Hilborninfo and @FoundationMaga1
OpenAI's CPO Kevin Weil: Why You Need Evals to Build AI Products
"The easiest way to think about it is as a quiz or a test to gauge how well a model knows a certain set of subject material, or how good it is at responding to a set of questions.
Evals basically perform as benchmarks for how smart and capable the model is."
@kevinweil with @lennysan
Loved the @lennysan ep with @rauchg . Some non-obvious insights/themes that stood out to me:
Idea velocity going wild: AI lets you test, iterate, and fail way faster.
Roles are blurring, silos collapsing: AI means PMs, Designers, Marketers can actually build stuff, fewer hand-offs needed.
Open ecosystems are powerful: Shared code (LLM training data) + shared ideas (v0 Community) = faster innovation.
Engineering grounds AI: Best AI tools spit out reliable, scalable, production-level code and practical results.
Feedback loops power AI: Direct user feedback literally trains the AI, making products get better quickly.
Human intent still king: AI is a superpowered co-pilot, but human creativity, judgment, and vision are crucial.
Tools for builders = force multiplier: Building tools that help others build stuff creates exponential impact.
At my org @HumanFeedbackIO we:
- Produce Paper Club feat. AI researchers doing talks on their papers for AI/ML builders
- Build AI Tinkerers Toronto community via meetups, tech workshops, etc
- Collaborate with leading universities on AI in Production mentorship program
Join our next Paper Club session @AITinkerers@HumanFeedbackIO - almost 700 people registered for this online session with the authors. @communicable - I just added @Paper2Audio to the page so you can listen to a summary of the paper.
@sojoodi@UofT@AITinkerers@mozilla Thrilled to see our mentorship program thrive -- the eyes in the room lighting up, the energy and drive and the tech demos all tell the story better than we ever could!! Heard nothing but great things about the mentors, too.
Such an awesome photo. You rock for doing this
This awesome team of @UofT students is about to demo the AI Tutor Chatbot they created over the course of the last couple of months as part of their course. I’m very proud of the effort you put in guys 👏🎉 @HumanFeedbackIO@AITinkerers#TorontoAI@mozilla
One reason I wish more humanities-oriented people would engage with AI is that models are writers, trained on words, producing words.
There are strengths & weaknesses in the models that can only be seen if you engage deeply with them as writers. They do not show up in benchmarks
2K Followers 3K FollowingVisual Thinker, Horseman, Conservationist. Working at the intersection of art, neuroscience & philsophy. INTJ. All pics mine except retweets.
No Lists
3K Followers 6K FollowingHelping people and organizations transform with technology and permissionless innovation. My personal view here (likes/RT ≠ endorsement).
129 Followers 1K FollowingI made GPT read contracts at a Fortune 100. Escaped to tinker with ML plumbing, one failed compile at a time. Founder: https://t.co/j5kD3SfN42
3 Followers 129 FollowingTaiStat is an AI firm that trains participants to power intelligent systems through surveys and AI training, helping industries apply AI to boost innovation.
210 Followers 495 FollowingWorking on democratic AI governance at AI & Democracy Foundation. Governance Innovation Advisor @Meta.
Formerly: @GovAIOrg @FLForg @oiioxford and @B_I_Team
2K Followers 534 FollowingFounding Member @Recursive_SI. PhD @UBC_CS. Building self-improving AI for knowledge discovery. ADAS | DGM | The AI Scientist
4K Followers 2K FollowingProfessor at @McMasterU. Director of @DigSocietyLab and @McMasterMPP. Founder and CEO of @VoxPopLabs. Creator of @VoteCompass.
22K Followers 4K FollowingMember of Technical Staff (Agents), Research @sullyai
Building AI medical employees
Previously worked on AI persona development & HCI @ 99Ravens
66 Followers 86 FollowingDiscover data, machine learning, & AI through practical, interactive courses as captivating as your favorite series 💡🎓🤖🎞️ 4000+ students worldwide 🚀
112K Followers 182 FollowingCSO @ Sooth Labs, Professor @ CMU, President Elect ICML Board, Ex-VP of Research @ Meta (Multimodal LLMs, AI Agents), ex-Director of AI at @Apple.
373K Followers 1K FollowingCo-founder of stealth startup. Inventor of GANs. Lead author of https://t.co/M6vl8pEQ4I Founding chairman of @pubhealthaction
124K Followers 648 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
33K Followers 442 FollowingCo-founder, Recursive. Professor, CS, U. British Columbia. CIFAR AI Chair, Vector Institute. | ML, AI, deep RL, deep learning, AI-Generating Algorithms (AI-GAs)
2K Followers 534 FollowingFounding Member @Recursive_SI. PhD @UBC_CS. Building self-improving AI for knowledge discovery. ADAS | DGM | The AI Scientist
65K Followers 59 FollowingStudent of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award
473K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
263K Followers 182 FollowingCo-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
2K Followers 801 FollowingMTS @adaption_ai | Prev: Research Engineer @Cohere_Labs @cohere | “Research means that you don't know, but are willing to find out” ✨
40K Followers 5K Following💚+❤️🇺🇳
I like ducks, they're fowl but not through choice.
Born 321 ppm CO₂.
https://t.co/iNxwz6cGtn ... the official home of Wardley Mapping