Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,772

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 18 days ago • 121k • 20

sohail-shaikh-s07/distil-gpt-2-ava-test-v1

Text Generation • Updated 4 days ago • 36 • 3

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 749 • 24

SeanScripts/Molmo-72B-0924-nf4

Image-Text-to-Text • Updated Oct 2 • 494 • 7

ai-sage/GigaChat-20B-A3B-instruct-int8

Updated 10 days ago • 361 • 4

CaioXapelaum/Qwen-2.5-0.5B-Instruct-4bit

Text Generation • Updated 10 days ago • 55 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2 • 27 • 6

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 425 • 8

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 736 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.81k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 69 • 1

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 13.1k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 117 • 11

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3 • 5.6k • 9

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 89 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1 • 300 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 721 • 23

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 53 • 5

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3 • 19 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29 • 188 • 4

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 101 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 474 • 173

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 13 • 1

ChaimaMess/llama-2-7b-squad

Text Generation • Updated Mar 25 • 32 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27 • 391 • 248

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 119 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 96 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 3 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Nov 22 • 287k • 189

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22 • 43.8k • 131