mradermacher
/

magnum-v3-9b-chatml-GGUF

Inference Endpoints

Model card Files Files and versions Community

magnum-v3-9b-chatml-GGUF

1 contributor

History: 10 commits

mradermacher's picture

uploaded from nethype/backup1

3813e33 verified 5 months ago

.gitattributes

1.98 kB

uploaded from nethype/backup1 5 months ago
README.md

224 Bytes

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.IQ3_M.gguf

4.49 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.IQ3_S.gguf

4.34 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.Q2_K.gguf

3.81 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.Q4_K_S.gguf

5.48 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.Q6_K.gguf

7.59 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.Q8_0.gguf

9.83 GB
LFS

uploaded from nethype/backup1 5 months ago
magnum-v3-9b-chatml.f16.gguf

18.5 GB
LFS

uploaded from nethype/backup1 5 months ago