Dhruv Gupta @AIPulp

Hello Everyone So, This is a message to the people of India. A horrifying incident has come to light — Where a male student studying in Allen Kota was brutally beaten by a mob with sticks while he watched helplessly as his sworn sister was physically and sexually harassed.

@derekm00r3 @ylecun @ylecun is answering all the questions before they actually get asked.

If you make a text corpus by instering the word 'love' after every token, and then mask 80% of these love tokens and then train an LLM on token prediction/filling, would you get a human back ?

Testing a pipeline w/ hard structured outputs, success rates: - Qwen2-72B & DeepSeek v2 (AWQ 4bit): 500/500 (100%) 🔥 - Llama3.1-72B (BF16): 443/500 (88%) - Most community finetunes <50%, except Magnum-32B: 361/500 (72%) Qwen2 & DeepSeek-v2's perfect score is mind-blowing!🔥

🚀Introducing MiniCPM-V 2.6! 🔥 1、Surpassing GPT-4V in single image, multi-image and video understanding 📸🎥 2、Outperforms GPT-4o mini and Gemini 1.5 on OpenCompass 🏆 3、Real-time video analysis on iPad 📱💨 Try out the best on-device multimodal LLM here！ 👑 GitHub：github.com/OpenBMB/MiniCP… Huggingface：huggingface.co/openbmb/MiniCP… #MLLM #MiniCPM

@giffmana Do you play dota ? @giffmana

Hello @BlrCityPolice Today, we've had a shocking experience at ACP Kengeri Gate's office for a young girl's case of stalking, voyeurism, threats of sending her nude pictures to her father etc. Another young girl, a witness to this case, requested privacy of her address (1/3)

‘You will be watched further,’ Bengaluru police threaten social worker @AcpKengeri police issued the threat after the social worker @St_Brosephs,and others requested not to include the address of a witness in the interest of privacy. thesouthfirst.com/karnataka/you-…

@elonmusk There was a huge anti-government protest in Brazil a few weeks ago. This hardly got any coverage, but it went viral on 𝕏. This is why 𝕏 is Lula's Public Enemy #1.

New (2h13m 😅) lecture: "Let's build the GPT Tokenizer" Tokenizers are a completely separate stage of the LLM pipeline: they have their own training set, training algorithm (Byte Pair Encoding), and after training implement two functions: encode() from strings to tokens, and decode() back from tokens to strings. In this lecture we build from scratch the Tokenizer used in the GPT series from OpenAI.

@jconorgrogan @fchollet @davidmanheim I think its about the difference in levels of abstraction of memory blocks/patterns.

Better data = better AI. That's why I've spent the last 3 months on: - Marker - fast, accurate PDF to markdown (5k GH ⭐️s) - Texify - SOTA math to LaTeX OCR - Libgen to txt - get 3TB of HQ data - Textbook quality - HQ synth data Find them at github.com/VikParuchuri .

Mixtral-8x7B on free Google Colab just dropped! TL;DR: - Novel offloading trick & mixed quantization. - Managed to run Mixtral-8x7B on free-tier Google Colab. Notebook: github.com/dvmazur/mixtra… Code: github.com/dvmazur/mixtra… Paper: arxiv.org/pdf/2312.17238…

A new family of antibiotics discovered with graph deep learning.

Eric Topol @EricTopol

3 years ago

Big #AI discovery: a new structural class of antibiotics (the last one took 38 years) with multiple compounds effective vs methicillin-resistant Staph aureus, without toxicity @Nature nature.com/articles/s4158…

keyboard_arrow_left Previous keyboard_arrow_right Next

2 1K 4K 1.8M 1K

ML News of the day 🚨 Are you getting ready for a long weekend? No time to read all the ML news? Here is a quick summary of the latest exciting research - from video generation to new chat models, a fully open-source Whisper, and 78x faster BERT. 1. Stability releases Stable Video Diffusion 📹 Stable Video Diffusion is the first image-to-video model released by SAI. Although it requires quite a bit of GPU, in just two days, the community has done quite a bit to run in consumer GPUs. Stay tuned for exciting updates! Announcement: stability.ai/news/stable-vi… Demo: huggingface.co/spaces/multimo… 2. Tulu 2 - Llama 2 trained with DPO at scale 🐪 Tulu v2 is a 70B Llama fine-tuned trained with Direct Preference Optimization and providing a strong alternative to Llama 2 70B Chat. This is the first time we see open-source DPO training at scale, which is quite exciting! Paper: arxiv.org/abs/2311.10702 Model: huggingface.co/allenai/tulu-2… 3. Lookahead decoding 👀 This new parallel decoding algorithm can make LLM inference much faster by breaking the sequential nature of autoregressive. Check out the GitHub repository or the blog; both contain great explanations! Repo: github.com/hao-ai-lab/Loo… Announcement: lmsys.org/blog/2023-11-2… 4. OWSM: Open Whisper-style model 🗣️ Whisper is quite exciting, but the training datasets are not public. Whisper is trained using open-source tools (espnet) and publicly available datasets. It is very efficient in training and robust at translations. All its artifacts are open-source! Paper: arxiv.org/abs/2309.13876 Demo: huggingface.co/spaces/pyf98/O… 5. UltraFastBert - exponentially faster language modeling ⚡️ UltraFastBERT shows some promising results - they achieve 78x faster inference with BERT while preserving 96% of downstream performance. This speedup is achieved due to selectively only activating 0.3% of the neurons during inference, thanks to replacing feedforward networks with fast feedforward networks. Paper page (some good convos in there): huggingface.co/papers/2311.10… Repo: github.com/pbelcak/UltraF… Quick resources One-2-3-45+ - transform a single image into high-fidelity textured mesh in one minute sudo-ai-3d.github.io/One2345plus_pa… ZipLora: Effectively merge independently trained LoRAs to generate any user-provided subject and style ziplora.github.io

Meta unveils an AI called 'MEG' 'that can decode the unfolding of visual representations in the brain. Using MEG, researchers can essentially turn what we see with our eyes into images. therundown.ai/p/openais-myst… x.com/AIatMeta/statu…

AI at Meta @AIatMeta

3 years ago

Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity. Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. More details ⬇️

61 460 2K 589K 598

The following were invented by non-profit researchers: - Alibi - Scaled RoPE - Flash Attention - Parallel attention and MLP layers - Latent diffusion - CLIP-Guidance - Training jointly on code and NL - GPT-NeoX tokenizer - 4-bit quant and qLoRA - RWKV - Instruction-tuning

clem 🤗 @ClementDelangue

3 years ago

Important to keep in mind that everyone in AI (including OAI) uses and benefits from open-source and wouldn’t be here without it. It’s the tide that lifts all boats!

7 61 486 507K 46

Things have gone too far

@

57 years ago

0 0 0 0 0

All new tech is scary, it's not just AI. • trains — the female body was feared to not be able to go over 50 mph, lest the uterus "fly out of the body" • subways — going underground was cursed because it brought you "closer to the devil" • elevators — early riders got "elevator sickness" (physically ill) out of hysterical fear Debatably, AI is the least scary invention on this list. The ones above all actually harmed people.

@ph_singer @kaggle A Kaggle thread on how I (finally 😅) managed to run a 70B model on a single GPU : kaggle.com/competitions/k…