Peter Szemraj's picture

Peter Szemraj PRO

pszemraj

·

https://pszemraj.carrd.co/

pszemraj

AI & ML interests

metallic intuition

Organizations

pszemraj's activity

upvoted 2 papers 2 days ago

Personalization of Large Language Models: A Survey

Paper • 2411.00027 • Published 15 days ago • 31

BitNet a4.8: 4-bit Activations for 1-bit LLMs

Paper • 2411.04965 • Published 5 days ago • 60

upvoted a collection 7 days ago

SmolLM2

State-of-the-art compact LLMs for on-device applications: 1.7B, 360M, 135M • 8 items • Updated 8 days ago • 163

upvoted 2 papers 13 days ago

Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction

Paper • 2410.21169 • Published 15 days ago • 29

A Survey of Small Language Models

Paper • 2410.20011 • Published 18 days ago • 36

upvoted a collection 17 days ago

OPT

OPT (Open Pretrained Transformer) is a series of open-sourced large causal language models which perform similar in performance to GPT3. • 12 items • Updated 19 days ago • 4

upvoted a collection about 1 month ago

INTELLECT-1 Dataset

INTELLECT-1 Training dataset • 5 items • Updated Oct 8 • 9

upvoted an article about 1 month ago

Article

Improving Parquet Dedupe on Hugging Face Hub

Oct 5

• 29

upvoted a collection about 1 month ago

Florence

9 items • Updated Jul 11 • 160

upvoted a paper about 1 month ago

The AdEMAMix Optimizer: Better, Faster, Older

Paper • 2409.03137 • Published Sep 5 • 5

upvoted a collection about 2 months ago

Qwen2.5

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 45 items • Updated Sep 18 • 326

upvoted a paper about 2 months ago

DSBench: How Far Are Data Science Agents to Becoming Data Science Experts?

Paper • 2409.07703 • Published Sep 12 • 66

upvoted 2 collections 2 months ago

NanoLM

a collection of nano LMs • 13 items • Updated Sep 11 • 4

Switch-Transformers release

This release included various MoE (Mixture of expert) models, based on the T5 architecture . The base models use from 8 to 256 experts. • 9 items • Updated Jul 31 • 16

upvoted 3 articles 3 months ago

Article

Improving Hugging Face Training Efficiency Through Packing with Flash Attention

Aug 21

• 22

Article

∞🧙🏼‍♂️AnyClassifier - Generating Synthetic Data For Text Classification

By

•

Aug 19

• 8

Article

The case for specialized pre-training: ultra-fast foundation models for dedicated tasks

By

•

Aug 4

• 26

upvoted a collection 3 months ago

📈 Scaling Laws with Vocabulary

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11 • 4

upvoted a paper 3 months ago

Gemma 2: Improving Open Language Models at a Practical Size

Paper • 2408.00118 • Published Jul 31 • 73

upvoted a paper 4 months ago

Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models

Paper • 2407.12327 • Published Jul 17 • 77