view article Article Fine-tuning LLMs to 1.58bit: extreme quantization made easy Sep 18, 2024 β’ 217
Running 110 110 Open-LLM performances are plateauing, letβs make the leaderboard steep again π Update leaderboard for fair model evaluation
view article Article Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging By akjindal53244 β’ Aug 19, 2024 β’ 76
view article Article A failed experiment: Infini-Attention, and why we should keep trying? Aug 14, 2024 β’ 57
Running on Zero 28 28 Gpt2 Multiplication Predictor π Multiply large numbers using different reasoning methods
Running 633 633 FineWeb: decanting the web for the finest text data at scale π· Generate high-quality web text data for LLM training