Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

149

Full-text search

Active filters: q4_k_m

afrideva/llama2_xs_460M_uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 139 • 1

afrideva/phi-2-chat-turkish-GGUF

Text Generation • Updated Dec 21, 2023 • 155 • 2

afrideva/phi-2-chat-GGUF

Text Generation • Updated Dec 21, 2023 • 55

afrideva/LMCocktail-phi-2-v1-GGUF

Text Generation • Updated Dec 21, 2023 • 162

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • Updated Dec 21, 2023 • 142 • 2

afrideva/llama-160m-GGUF

Text Generation • Updated Dec 21, 2023 • 168

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • Updated Dec 22, 2023 • 133 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • Updated Dec 22, 2023 • 95 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • Updated Dec 22, 2023 • 88

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • Updated Dec 24, 2023 • 119 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • Updated Dec 24, 2023 • 94 • 2

afrideva/smol-3b-GGUF

Text Generation • Updated Dec 25, 2023 • 85

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 151 • 2

afrideva/MiniChat-2-3B-GGUF

Text Generation • Updated Dec 27, 2023 • 111 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • Updated Dec 27, 2023 • 141 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • Updated Dec 27, 2023 • 155

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • Updated Dec 27, 2023 • 95

afrideva/RocketZephyr-3b-GGUF

Text Generation • Updated Dec 27, 2023 • 108 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • Updated Dec 28, 2023 • 126 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • Updated Dec 28, 2023 • 82

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • Updated Dec 28, 2023 • 122

afrideva/gpt2-small-danish-GGUF

Text Generation • Updated Dec 28, 2023 • 157

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • Updated Dec 28, 2023 • 116

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • Updated Dec 29, 2023 • 156 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • Updated Dec 29, 2023 • 128

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • Updated Dec 29, 2023 • 82

afrideva/phi-2-code-instruct-GGUF

Text Generation • Updated Jan 16 • 128 • 1

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17 • 169 • 1

afrideva/Walter-Phi-GGUF

Text Generation • Updated Jan 17 • 120 • 1

afrideva/dolphin-2_6-phi-2_oasst2_chatML_V2-GGUF

Text Generation • Updated Jan 19 • 124 • 2