Younes Belkada's picture

Younes Belkada

ybelkada

·

AI & ML interests

Large Language Models, Quantization, Vision, Multimodality, Diffusion models

Articles

Welcome FalconMamba: The first strong attention-free 7B model

Welcome Llama 3 - Meta's new open LLM

GaLore: Advancing Large Model Training on Consumer-grade Hardware

quanto: a pytorch quantization toolkit

Fine-Tuning Gemma Models in Hugging Face

Mixture of Experts Explained

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

Overview of natively supported quantization schemes in 🤗 Transformers

Making LLMs lighter with AutoGPTQ and transformers

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV — An RNN with the advantages of a transformer

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Organizations

ybelkada's activity

New activity in tiiuae/falcon-rw-7b 3 days ago

Adding `safetensors` variant of this model

#5 opened 3 days ago by

New activity in ybelkada/t5-3b-sharded 14 days ago

Adding `safetensors` variant of this model

#1 opened 15 days ago by

New activity in tiiuae/falcon-mamba-7b 18 days ago

AttributeError: 'FalconMambaCausalLMOutput' object has no attribute 'past_key_values'

#12 opened about 1 month ago by

New activity in tiiuae/falcon-mamba-7b-Q4_K_M-GGUF 23 days ago

What is the Chat Format?

#1 opened 25 days ago by

New activity in tiiuae/falcon-7b 28 days ago

Adding `safetensors` variant of this model

#106 opened 29 days ago by

New activity in tiiuae/falcon-7b-instruct 28 days ago

Adding `safetensors` variant of this model

#126 opened 29 days ago by

New activity in tiiuae/falcon-7b-instruct about 2 months ago

429 Client Error: Too Many Requests for url

#123 opened about 2 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 2 months ago

About finetuning

#6 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF 3 months ago

Download command wrong

#1 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 3 months ago

The model doesn't load into Google colab with 4bit nf4 quantization. Why?

#12 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct-4bit 3 months ago

Cannot load quantized version of the model into a 15 GB VRAM gpu?

#3 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 3 months ago

Please Add GGUF support

#8 opened 3 months ago by

.input

#10 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct-4bit 3 months ago

PackageNotFoundError: No package metadata was found for bitsandbytes

#2 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 3 months ago

Trained on ChatGPT Responses?

#9 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct-4bit 3 months ago

The checkpoint you are trying to load has model type `falcon_mamba`

#1 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 3 months ago

Fine tune code ?

#4 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b 3 months ago

RuntimeError: Tensor on device meta is not on the expected device cuda:0!

#6 opened 3 months ago by

Transformers does not recognize this architecture

#5 opened 3 months ago by

New activity in tiiuae/falcon-mamba-7b-instruct 3 months ago

Transformers does not know model type 'falcon_mamba'

#3 opened 3 months ago by