Papers with Code @paperswithcode
Our mission is to organize science by converting information into useful knowledge. paperswithcode.com London, UK Joined December 2018-
Tweets455
-
Followers113K
-
Following10
-
Likes531
Read about the research at: arxiv.org/abs/2211.09085
Thank you everyone for trying the Galactica model demo. We appreciate the feedback we have received so far from the community, and have paused the demo for now. Our models are available for researchers who want to learn more about the work and reproduce results in the paper.
Galactica is basically GPT-3 for science. It can write whitepapers, reviews, wikipedia pages and code. It knows how to cite and how to write equations. It's kind of big deal 1/ 🧵
Today a 120B model called “Galactica” is open-sourced by @paperswithcode. It’s capable of writing math notations, citations, code, chemical formula, DNA, etc. Here’s why I think Galactica is a huge milestone in open foundation models, scientific automation, and responsible AI: 🧵
Foundation #AI models come to science👍
Incredible application of AI: summarize academic literature, generate wiki articles!!
The new language model for science galactica.org. Upon few quick tries, it seems to generate professional text in the areas I am familiar with. And 7 years ago we were *joking* about ML writing papers!
Haven’t been so excited by a text LM for a long time! And it’s all open! A true gift to science. 🎁
🪐 Introducing Galactica. A large language model for science. Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more. Explore and get weights: galactica.org
This is just the first step on our mission to organize science. And there is a lot more work to be done. We look forward to seeing what the open ML community builds with the model.
Despite not being trained on a general corpus, Galactica outperforms BLOOM and OPT-175B on BIG-bench. Galactica is also significantly less toxic than other language models based on evaluations.
🪐 Introducing Galactica. A large language model for science. Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more. Explore and get weights: galactica.org
We have explored some of the latest progress, architectural improvements, and emerging new techniques for long-range modeling. We'll continue to keep track of the progress on long-range modeling and LRA. More threads like this coming soon! Follow @paperswithcode for more. 10/10
Besides transformers, other types of models have been tested on LRA. Some of the top performing models are attained by S4 variants which are based on state space models. A recent, improved S4 variant (Liquid-S4) attained competitive results with Mega (current SoTA). 9/10
How well do machine learning models perform on long sequences? This is a question of high interest in ML research so let’s take a look at what we know so far? 1/10
Yann LeCun @ylecun
1.2M Followers 787 Following Professor at NYU & Executive Chairman at AMI Labs. Ex-Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AK @_akhaliq
507K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5XOCi
Andrew Ng @AndrewYNg
1.6M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
elvis @omarsar0
309K Followers 879 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Mark Tenenholtz @marktenenholtz
151K Followers 706 Following Member of Technical Staff @perplexity_ai
AI at Meta @AIatMeta
811K Followers 322 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
AI Pub @ai__pub
71K Followers 339 Following AI papers and AI research explained, for technical people. Get hired by the best AI companies: https://t.co/MySVjUGOQ3
Soumith Chintala @soumithchintala
309K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Jeremy Howard @jeremyphoward
319K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
Turing Post @TheTuringPost
86K Followers 9K Following On X we surface the AI research that matters and explain the ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
Jean de Nyandwi @Jeande_d
49K Followers 1K Following Incoming CS PhD @CarnegieMellon • NLP, Data, Evals, Human + AI • CMU MS '24. Blog: https://t.co/1BEFLZAY3F ML: https://t.co/7PkTyDw2gQ
Lior Alexander @LiorOnAI
116K Followers 2K Following Founder @AlphaSignalAI → the Intelligence layer of AI (300k users) • MIT Lecturer • ex-MILA researcher • In ML since GANs
merve @mervenoyann
88K Followers 5K Following (mer-veh) open-sourceress at @huggingface 🧙🏻♀️ DM me for any feedback about HF 🤗 https://t.co/MhrMkGTm7p
Christoph Molnar 🦋... @ChristophMolnar
35K Followers 969 Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8
Delip Rao e/σ @deliprao
69K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Tanishq Mathew Abraha... @iScienceLuvr
89K Followers 1K Following CEO @SophontAI | Founder @MedARC_AI | PhD at 19 (2023) | ex Research Director Stability AI | Biomed. engineer @ 14 | TEDx talk➡https://t.co/xPxwKTq6Qb
Radek Osmulski @radekosmulski
30K Followers 615 Following LLMs and retrieval by day and other genres of AI when I get the chance 🧪 Senior AI Eng @NVIDIAAI 🏫 @fastdotai trained DL Eng 📝 https://t.co/By87iXx5Pu
Sanyam Bhutani @bhutanisanyam1
42K Followers 1K Following 👨💻 Working on llama models @AIatMeta | Previously: @h2oai, @weights_biases 🎙 Podcast @ctdsshow 👨🎓 Fellow @fastdotai 🎲 Grandmaster @Kaggle
Omar Sanseviero @osanseviero
71K Followers 3K Following MTS at @GoogleDeepMind Building Gemini, Gemma, AI Studio and more. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
Rahul Padmanabhan @rah_padmanabhan
40 Followers 174 Following knowledge miner. Runs AI projects at a major Wall Street bank. Part-time Math PhD @Concordia (MSc Math there too). MSc CS @USouthFlorida.
锦鲤 @jinlivn
3 Followers 172 Following
Elinor Samuelsson @elisamuelsson
1 Followers 44 Following
Leo @SonOfDobbe
0 Followers 29 Following
Sheikyon @sh3iky0n
159 Followers 4K Following Not in use anymore, only for lurking. Full-Stack developer & Mathematician. @sheikyon
Siru Zhong @zhongsiru191756
2 Followers 201 Following
Anis Rahman @AnisCodex
764 Followers 4K Following Java Full Stack Dev ☕ @AnisCodex - Mentor & Career Guide Spring Boot • React • REST APIs Building & sharing my developer journey 🚀 Part-time meme engineer 😂
Aviral Bohra @AviralBohra
2 Followers 30 Following
KEYMAN @KEYMAN483792236
20 Followers 121 Following
Aakash singh azad @aakash_azad_
0 Followers 33 Following
Raghavi Ravi @raghavirk116
0 Followers 54 Following
Tushar Mali @tushaarmali
0 Followers 38 Following
0xLyonsupernova @0xLyonsupernova
61 Followers 109 Following 📘 - Learn 🌱 - Grow ✨ - Evolve, be a supernova
rahul @withqwerty
1K Followers 2K Following 🛠️ universal id for 35+ ⚽ data providers: https://t.co/GcrHeNmKmM ⚽ projects and essays: https://t.co/Jk7375e8gq buy me a ☕: https://t.co/MdaobtTQ2y
Anh @Anhqifv
0 Followers 24 Following
Tushar Borse @bors43289
5 Followers 97 Following
StickyOneStill @StickyOneStill
7 Followers 109 Following
Levers @real_levers
40 Followers 45 Following Life doesn't tell you every rug. Coin or token, you should choose one.
Alberto Díez_ CEO of... @AdmAdg5
36 Followers 2K Following Founder & CEO, Global Authority UNITED NATIONS SDG Global Advisor FGO World Elevare Award Miami Diamond Excellence World Prize: Agency of the Year, Madrid
yaseen_578 @578Yaseen
2 Followers 26 Following AIML student building small ML/data/simulation projects. Football analytics, applied ML, and side quests
Pavneet Thind @PavneetThind3
0 Followers 62 Following
Miranda Batterson @MirandaBat22521
2 Followers 29 Following
Jialong @usas860787
2 Followers 83 Following
Ismail Omer @Ismail_omer3141
1 Followers 32 Following
Manish @07Ump86129
27 Followers 110 Following
W.N. @w_n_japan1212
283 Followers 372 Following UEC22 メディア→UEC26 Dx2 M1 学ロボ24ピット CV, Generative AI, Blue Archive
manasj @map31395
0 Followers 33 Following
Nicolas Klein @NickyKln
80 Followers 363 Following 2x founder, 2 exits. CTO-at-heart. Deep into LLMs, AI agents, and building things that actually ship. Paris 🇫🇷
Tong shen @whitemouse0617
0 Followers 19 Following
Ignacio Leyton @ign_nx
3 Followers 177 Following
julian @julian9coph
0 Followers 60 Following
egor novikov @mmorwynn
0 Followers 15 Following
jotisbhoewt @jotisenq3
3 Followers 135 Following
Lieu Kuo @liyu_guo58183
5 Followers 32 Following
Mahad Munawar @sapnonmeinghum
0 Followers 20 Following
Michael @mikeforthewin98
2 Followers 135 Following
Ding Islamic @ISAM2111
2 Followers 98 Following
Le Programmer @LeProgrammer
0 Followers 52 Following
elvis @omarsar0
309K Followers 879 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Soumith Chintala @soumithchintala
309K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Iliyan Zarov @iliyanzarov
314 Followers 2K Following Research @GenReasoning. Previously: GenAI research, math & reasoning for Llama @MetaAI
Thomas Scialom @ThomasScialom
8K Followers 280 Following RL & Agents @Meta Superintelligence Labs, recently Muse Spark. Previously built postraining from scratch, led Llama 2&3, pioneered Agents (Toolformer, GAIA 1&2)
Papers with Datasets @paperswithdata
17K Followers 1 Following Keep up with the latest machine learning datasets from @paperswithcode. Follow for daily updates.
Guillem Cucurull @g_cucurull
395 Followers 529 Following Machine Learning and Computer Vision, doing cool things at @paperswithcode (@MetaAI)
Marcin Kardas @misterkardas
941 Followers 229 Following Lifelong learner passionate about math, computers and artificial intelligence.
Ross Taylor @rosstaylor90
12K Followers 1K Following Co-founder and CEO @GenReasoning. Previously lots of other things like: reasoning lead Meta AI, Llama 3/2, Galactica, Papers with Code.
Robert Stojnic @rbstojnic
3K Followers 580 Following Building something new. ⌛Past: Llama 2 and Llama 3 technical leadership at Meta AI, Papers with Code co-creator.You might like
