Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

1,490

Full-text search

Active filters: llama-2

mav23/trurl-2-7b-GGUF

Text Generation • Updated Nov 28, 2024 • 4

shashikanth-a/llama-2-7b-4bit

Text Generation • Updated Nov 28, 2024 • 79

mav23/Llama-2-7b-chat-hf-function-calling-v2-GGUF

Text Generation • Updated Nov 28, 2024 • 10

shashikanth-a/llama-2-7b-chat-4bit

Text Generation • Updated Nov 28, 2024 • 79

mav23/CodeLlama-7b-Python-hf-GGUF

Text Generation • Updated Nov 28, 2024 • 77

mav23/CodeLlama-13b-hf-GGUF

Text Generation • Updated Nov 28, 2024 • 34

Spockkk/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated Nov 28, 2024 • 3

mav23/CodeLlama-34b-hf-GGUF

Text Generation • Updated Nov 28, 2024 • 144

mav23/CodeLlama-34b-Instruct-hf-GGUF

Text Generation • Updated Nov 28, 2024 • 66

mradermacher/komt-llama2-7b-v1-GGUF

Updated Nov 28, 2024 • 2

mradermacher/komt-llama2-7b-v1-i1-GGUF

Updated Nov 28, 2024 • 10 • 1

amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated Dec 13, 2024 • 16

mradermacher/Nous-Hermes-Llama2-13b-GGUF

Updated Dec 3, 2024 • 103

mradermacher/Nous-Hermes-Llama2-13b-i1-GGUF

Updated Dec 3, 2024 • 221

mradermacher/Llama-2-7b-chat-norwegian-GGUF

Updated Dec 4, 2024 • 32

mradermacher/Llama-2-7b-chat-norwegian-i1-GGUF

Updated Dec 4, 2024 • 124

mradermacher/GOAT-70B-Storytelling-GGUF

Updated Dec 4, 2024 • 12

mradermacher/GOAT-70B-Storytelling-i1-GGUF

Updated Dec 5, 2024 • 106 • 1

retroboy3000/protectai_models_Retr0REG_Whats-up-gguf_2

Text Generation • Updated Dec 5, 2024 • 5

mradermacher/opencsg-CodeLlama-13b-v0.1-GGUF

Updated Dec 9, 2024 • 15

mradermacher/opencsg-CodeLlama-13b-v0.1-i1-GGUF

Updated Dec 9, 2024 • 52

Lucy-in-the-Sky/chronos-hermes-13b-v2-Q2_K-GGUF

Updated Dec 8, 2024 • 4

Lucy-in-the-Sky/chronos-hermes-13b-v2-Q8_0-GGUF

Updated Dec 8, 2024 • 6

mradermacher/karakuri-lm-70b-chat-v0.1-GGUF

Updated Dec 11, 2024 • 11

mradermacher/urllm-ko-7b-GGUF

Updated Dec 17, 2024 • 282

mradermacher/karakuri-lm-70b-chat-v0.1-i1-GGUF

Updated Dec 11, 2024 • 35

mradermacher/karakuri-lm-70b-v0.1-GGUF

Updated Dec 11, 2024 • 23

mradermacher/urllm-ko-7b-i1-GGUF

Updated Dec 10, 2024 • 158

mradermacher/karakuri-lm-70b-v0.1-i1-GGUF

Updated Dec 11, 2024 • 31

tensorblock/urllm-ko_en-2.7b-GGUF

Text Generation • Updated Dec 11, 2024 • 31