1208 50 50

Quentin Gallouédec

qgallouedec

https://gallouedec.com

AI & ML interests

None yet

Recent Activity

updated a dataset about 4 hours ago

qgallouedec/trl-metrics

updated a Space 1 day ago

qgallouedec/train_memory

updated a dataset 1 day ago

huggingface/documentation-images

View all activity

Articles

Organizations

qgallouedec's activity

upvoted a paper 7 days ago

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Paper • 1910.10683 • Published Oct 23, 2019 • 10

upvoted a paper 8 days ago

Solving math word problems with process- and outcome-based feedback

Paper • 2211.14275 • Published Nov 25, 2022 • 7

upvoted a collection 25 days ago

Tiny models

Collection

23 items • Updated 25 days ago • 1

upvoted a paper 28 days ago

QLoRA: Efficient Finetuning of Quantized LLMs

Paper • 2305.14314 • Published May 23, 2023 • 46

upvoted an article about 2 months ago

Article

Finetuning PaliGemma with AutoTrain

•

Jul 25

• 8

upvoted 2 papers 3 months ago

The Perfect Blend: Redefining RLHF with Mixture of Judges

Paper • 2409.20370 • Published Sep 30 • 4

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation

Paper • 2401.08417 • Published Jan 16 • 34

upvoted a collection 3 months ago

PaliGemma Release

Collection

Pretrained and mix checkpoints for PaliGemma • 16 items • Updated 11 days ago • 142

upvoted 3 papers 3 months ago

Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF

Paper • 2405.21046 • Published May 31 • 4

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 63

Binary Classifier Optimization for Large Language Model Alignment

Paper • 2404.04656 • Published Apr 6 • 2

upvoted 2 papers 4 months ago

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published Aug 22 • 124

Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs

Paper • 2402.14740 • Published Feb 22 • 11

upvoted an article 4 months ago

Article

The 5 Most Under-Rated Tools on Hugging Face

Aug 22

• 86

upvoted 2 papers 4 months ago

Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking

Paper • 2312.09244 • Published Dec 14, 2023 • 7

Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment

Paper • 2408.06266 • Published Aug 12 • 9

upvoted 2 papers 5 months ago

A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA

Paper • 2312.03732 • Published Nov 28, 2023 • 7

The Curious Case of Neural Text Degeneration

Paper • 1904.09751 • Published Apr 22, 2019 • 3

upvoted an article 5 months ago

Article

Putting RL back in RLHF

Jun 12

• 65

upvoted a paper 5 months ago

Understanding Reference Policies in Direct Preference Optimization

Paper • 2407.13709 • Published Jul 18 • 16

Quentin Gallouédec

AI & ML interests

Recent Activity

Articles

Visualize and understand GPU memory in PyTorch

Preference Optimization for Vision Language Models

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Organizations

qgallouedec's activity

Finetuning PaliGemma with AutoTrain

The 5 Most Under-Rated Tools on Hugging Face

Putting RL back in RLHF