Florian Zimmermeister's picture

Florian Zimmermeister

flozi00

·

AI & ML interests

ASR, German LLM

Organizations

$A\\Ware's profile picture$

flozi00's activity

upvoted an article about 14 hours ago

Article

SauerkrautLM's Multi-Phase Spectrum Training: A Technical Deep Dive

By

•

about 20 hours ago

• 5

upvoted a paper 4 days ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published 5 days ago • 44

upvoted an article 19 days ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Sep 18

• 198

upvoted a paper 26 days ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7 • 165

upvoted an article about 1 month ago

Article

Welcome, Gradio 5

Oct 9

• 66

upvoted a paper about 1 month ago

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

Paper • 2407.10960 • Published Jul 15 • 11

upvoted a paper about 2 months ago

Spectrum: Targeted Training on Signal to Noise Ratio

Paper • 2406.06623 • Published Jun 7 • 7

upvoted a collection about 2 months ago

Strong German fp8 LLM's

Strong Large Language Models for the german language in fp8 format • 6 items • Updated Sep 24 • 3

upvoted 3 papers about 2 months ago

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

Paper • 2405.03003 • Published May 5 • 7

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published Sep 18 • 125

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Paper • 2407.08296 • Published Jul 11 • 31

upvoted a collection 2 months ago

INT4 LLMs for vLLM

Accurate INT4 quantized models by Neural Magic, ready for use with vLLM! • 18 items • Updated Sep 26 • 8

upvoted 2 collections 3 months ago

FP8 LLMs for vLLM

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated 24 days ago • 56

Research projects on top of vLLM

Papers cited in https://blog.vllm.ai/2024/07/25/lfai-perf.html • 6 items • Updated Jul 29 • 12

upvoted an article 4 months ago

Article

The Rise of Agentic Data Generation

By

•

Jul 15

• 75

upvoted an article 5 months ago

Article

Benchmarking Text Generation Inference

May 29

• 27

upvoted a collection 6 months ago

AQLM

AQLM quantized LLMs • 20 items • Updated May 3 • 43

upvoted an article 7 months ago

Article

Inference for PROs

Sep 22, 2023

• 47

upvoted a collection 7 months ago

DPO datasets for DE

A collection of DPO datasets for the DE language. • 6 items • Updated Apr 15 • 1

upvoted a collection 8 months ago

Tower

Model weights and SFT data for Tower. • 10 items • Updated Oct 3 • 25