Nekuromento/functionary-v4r-small-preview-Q8_0-GGUF
Updated
•
20
Tool Calling GGUFs
GGUF quantizations for latest Tool Calling small model releases
-
-
Nekuromento/functionary-v4r-small-preview-Q6_K-GGUF
Updated • 16 -
Nekuromento/functionary-v4r-small-preview-Q5_K_M-GGUF
Updated • 10 -
Nekuromento/functionary-v4r-small-preview-Q4_K_M-GGUF
Updated • 8 -
Nekuromento/watt-tool-8B-Q8_0-GGUF
Updated • 36 -
Nekuromento/watt-tool-8B-Q6_K-GGUF
Updated • 18 -
Nekuromento/watt-tool-8B-Q5_K_M-GGUF
Updated • 32 • 1 -
Nekuromento/watt-tool-8B-Q4_K_M-GGUF
Updated • 79 • 1 -
DevQuasar/driaforall.Dria-Agent-a-7B-GGUF
Text Generation • Updated • 258 • 1 -
DevQuasar/driaforall.Dria-Agent-a-3B-GGUF
Text Generation • Updated • 281 • 2 -
Nekuromento/Hammer2.1-7b-Q8_0-GGUF
Updated • 8 -
Nekuromento/Hammer2.1-7b-Q6_K-GGUF
Updated • 7 -
Nekuromento/Hammer2.1-7b-Q5_K_M-GGUF
Updated • 6 • 1 -
Nekuromento/Hammer2.1-7b-Q4_K_M-GGUF
Updated • 13 • 1 -
Nekuromento/Hammer2.1-3b-Q8_0-GGUF
Updated • 9 -
Nekuromento/Hammer2.1-3b-Q6_K-GGUF
Updated • 5 -
Nekuromento/Hammer2.1-3b-Q5_K_M-GGUF
Updated • 7 • 1 -
Nekuromento/Hammer2.1-3b-Q4_K_M-GGUF
Updated • 20 • 1 -
Nekuromento/Hammer2.1-1.5b-Q8_0-GGUF
Updated • 15 -
Nekuromento/Hammer2.1-1.5b-Q6_K-GGUF
Updated • 6 -
Nekuromento/Hammer2.1-1.5b-Q5_K_M-GGUF
Updated • 9 • 1 -
Nekuromento/Hammer2.1-0.5b-Q8_0-GGUF
Updated • 10 -
Nekuromento/Hammer2.1-0.5b-Q6_K-GGUF
Updated • 6 -
katanemo/Arch-Function-7B.gguf
Text Generation • Updated • 85 • 3 -
katanemo/Arch-Function-3B.gguf
Text Generation • Updated • 110 • 2 -
katanemo/Arch-Function-1.5B.gguf
Text Generation • Updated • 81 -
Nekuromento/Hammer2.0-7b-Q8_0-GGUF
Updated • 3 • 1 -
Nekuromento/Hammer2.0-7b-Q6_K-GGUF
Updated • 5 -
Nekuromento/Hammer2.0-7b-Q5_K_M-GGUF
Updated • 3 -
Nekuromento/Hammer2.0-1.5b-Q8_0-GGUF
Updated • 3 -
Nekuromento/Hammer2.0-1.5b-Q6_K-GGUF
Updated • 4 -
Nekuromento/Hammer2.0-0.5b-Q8_0-GGUF
Updated • 5 -
Nekuromento/ToolACE-8B-Q8_0-GGUF
Updated • 12 -
Nekuromento/ToolACE-8B-Q6_K-GGUF
Updated • 7 -
Nekuromento/ToolACE-8B-Q5_K_M-GGUF
Updated • 4 -
Nekuromento/ToolACE-8B-Q4_K_M-GGUF
Updated • 11 -
Nekuromento/llama3-empower-functions-small-v1.1-Q8_0-GGUF
Updated • 12 -
Nekuromento/llama3-empower-functions-small-v1.1-Q6_K-GGUF
Updated • 21 -
Nekuromento/llama3-empower-functions-small-v1.1-Q5_K_M-GGUF
Updated • 11 -
Nekuromento/Hammer-7b-Q6_K-GGUF
Updated • 7 -
Nekuromento/Hammer-7b-Q5_K_M-GGUF
Updated • 4 -
Nekuromento/Hammer-7b-Q4_K_M-GGUF
Updated • 3 -
Nekuromento/Hammer-4b-Q8_0-GGUF
Updated • 4 -
Nekuromento/Hammer-4b-Q6_K-GGUF
Updated • 3 -
Nekuromento/Hammer-1.5b-Q8_0-GGUF
Updated • 3 -
squeeze-ai-lab/TinyAgent-7B-GGUF
Updated • 41 • 3 -
squeeze-ai-lab/TinyAgent-1.1B-GGUF
Updated • 99 • 6