Introducing a new side project called Model Regression. It tests daily Claude, GPT, and Grok on various benchmark statistics to determine how well its performing and to identify model degrades over time.
@edskoudis had an idea for model testing before they conducted offensive testing to ensure the model was performing as expected, and @BlasikRandy pushed me down this road with actually going and doing it.
The main intent here is the frontier models will experience outages, issues, bugs, intentional/unintentional nerfing of the models without notice. You can't typically trust day to day activities in these models for stability, so leveraging this on your daily routine to see how well the model is performing for that day is something I'll be using everyday.
Runs every morning in my DGX sparks environment and automatically updates with how well its performing.
Enjoy!
modelregression.com
Also open-sourced the project, can run on your own server as well and look at the benchmarks and how they are calculated:
github.com/HackingDave/mo…
67K Followers 37 Following🦔 Making financial nonsense make sense, one prickly take at a time 🦔 | Weekly newsletter: https://t.co/zgdVSm4Iq5 | Not financial advice (I'm a Hedgehog)
61K Followers 2K FollowingTecnología, Ciberseguridad, Privacidad, Derecho de las TIC, Redes Sociales y mucho más. Creador: @juliosanjose Telegram: https://t.co/orRrSABVoT
266K Followers 3K FollowingPentester, Forensic investigator, and former college professor. Trained hackers at each US military and intelligence.
Visit me at https://t.co/G478wug0p4
184K Followers 80 FollowingI'm T. Balaji. Weather enthusiast & Civil engg graduate from JNTUH HYD. Follow me for weather updates of Telangana. Not affiliated to any official agency
919 Followers 38 FollowingOfficial Twitter handle - Invest Kerala initiatives undertaken by Kerala Government. Account managed by KSIDC - nodal agency for Invest Kerala initiatives
105K Followers 151 FollowingA portable multi-tool device in a toy-like body for pentesters and hardware geeks. Buy worldwide here ➡️ https://t.co/n09EKVnYgQ
16K Followers 9 FollowingLatest game news & deals. ICG strives to push Console Gaming in India. As an Amazon Associate I earn from qualifying purchases.
773K Followers 2K FollowingOutside from ur History Book,A(Story Teller), for Positive Threads😊 , Animals lover , Science & Nature and informative videos ❣️
58K Followers 524 FollowingTypos and segfaults. I write curl. On team @wolfSSL. I don't know anything. @[email protected]
My weekly email: https://t.co/9UYYYMLWaw
298K Followers 0 FollowingThe Internet's Observatory: Tracking cybersecurity and digital governance • connectivity and democracy • tools and policy for change
5K Followers 50 FollowingProbably the most modern and sophisticated insecure web application. Only we offer a 100% @OWASP Top Ten incompliance guarantee! Tweets by @bkimminich & @j12934
15K Followers 5 FollowingOfficial announcements (low vol) for ZAP by @Checkmarx - the worlds most popular web app scanner. Free and open source. https://t.co/pxO8zZ6usH
50K Followers 2K FollowingSecure Coding Trainer, Best-selling author of Alice and Bob Learn Secure Coding & Alice and Bob Learn Application Security. #AppSec she/her 🌻
16K Followers 0 FollowingTips and tricks for Burp Suite Pro
Managed by @Agarri_FR | Not affiliated with @Portswigger
More free resources at https://t.co/MWqXmV66lr