Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,812

Full-text search

Active filters: bitsandbytes

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-8bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-4bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/KoboldAI_-_fairseq-dense-355M-4bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/KoboldAI_-_fairseq-dense-355M-8bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/LorenzoDeMattei_-_GePpeTto-4bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/LorenzoDeMattei_-_GePpeTto-8bits

Text Generation • Updated Apr 17 • 12

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-8bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-4bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-4bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-8bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-8bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-4bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/abinayam_-_gpt-2-tamil-4bits

Text Generation • Updated Apr 17 • 17

RichardErkhov/abinayam_-_gpt-2-tamil-8bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-8bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/akahana_-_gpt2-indonesia-4bits

Text Generation • Updated Apr 17 • 14 • 1

RichardErkhov/akahana_-_gpt2-indonesia-8bits

Text Generation • Updated Apr 17 • 14 • 1

RichardErkhov/akhooli_-_gpt2-small-arabic-4bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/akhooli_-_gpt2-small-arabic-8bits

Text Generation • Updated Apr 17 • 15

RichardErkhov/antoinelouis_-_belgpt2-4bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/antoinelouis_-_belgpt2-8bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/aubmindlab_-_aragpt2-base-4bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/aubmindlab_-_aragpt2-base-8bits

Text Generation • Updated Apr 17 • 13

RichardErkhov/aubmindlab_-_aragpt2-large-4bits

Text Generation • Updated Apr 17 • 14

RichardErkhov/aubmindlab_-_aragpt2-large-8bits

Text Generation • Updated Apr 17 • 12

G-reen/EXPERIMENT-ORPO-m7b2-2-merged

Text Generation • Updated Apr 19 • 18

Trubnik1967/zephyr-7b-beta-Agent-Instruct_v3

Text Generation • Updated May 7 • 7 • 1

adediu25/implicit-llama2-all

Text Generation • Updated Apr 17 • 24

samehfarouk/quantized_Mistral7B_v2_int8

Text Generation • Updated Apr 17 • 8

yyx123/Yi-6B-ruozhiba2

Updated May 6 • 53 • 1