Ollama-ready Coding Models - a onekq-ai Collection

onekq-ai 's Collections

Ollama-ready Coding Models

QLora-ready Coding Models

Ollama-ready Coding Models

updated 12 days ago

For inference. CPU is enough for both quantization and inference.

QuantFactory/OpenCoder-8B-Instruct-GGUF

Text Generation • Updated Nov 9, 2024 • 208 • 6
QuantFactory/OpenCoder-8B-Base-GGUF

Text Generation • Updated Nov 9, 2024 • 98 • 3
bartowski/starcoder2-15b-instruct-GGUF

Text Generation • Updated Mar 6, 2024 • 470 • 2
QuantFactory/starcoder2-15b-GGUF

Text Generation • Updated Sep 6, 2024 • 187 • 2
bartowski/starcoder2-15b-instruct-v0.1-GGUF

Text Generation • Updated Apr 30, 2024 • 393 • 6
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 27.5k • 93
QuantFactory/starcoder2-7b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 137 • 1
QuantFactory/starcoder2-7b-GGUF

Text Generation • Updated Sep 5, 2024 • 155 • 2
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF

Updated Oct 18, 2024 • 166 • 1
QuantFactory/starcoder2-3b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 42 • 1
QuantFactory/starcoder2-3b-GGUF

Text Generation • Updated Sep 5, 2024 • 507 • 3
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 15 days ago • 59.5k • 121
bartowski/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated Nov 11, 2024 • 1.1k • 14
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 54.6k • 35
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF

Updated 22 days ago • 367 • 2
Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 17.3k • 50
QuantFactory/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated Sep 19, 2024 • 545 • 2
Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 20.6k • 28
QuantFactory/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Sep 19, 2024 • 215 • 2
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF

Text Generation • Updated Jun 24, 2024 • 231 • 1
ibm-granite/granite-34b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 133 • 2
ibm-granite/granite-34b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 23 • 3
ibm-granite/granite-20b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 54 • 4
ibm-granite/granite-20b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 22 • 4
QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 125 • 3
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf

Updated Aug 22, 2024 • 104
ibm-granite/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 1.26k • 10
ibm-granite/granite-8b-code-base-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 18 • 2
mradermacher/granite-3b-code-instruct-128k-GGUF

Updated 29 days ago • 289
QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 103 • 2
ibm-granite/granite-3b-code-instruct-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 85 • 5
ibm-granite/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 38 • 2