e88 88e d8
d888 888b 8888 8888 ,"Y88b 888 8e d88
C8888 8888D 8888 8888 "8" 888 888 88b d88888
Y888 888P Y888 888P ,ee 888 888 888 888
"88 88" "88 88" "88 888 888 888 888
b
8b,
e88'Y88 d8 888
d888 'Y ,"Y88b 888,8, d88 ,e e, 888
C8888 "8" 888 888 " d88888 d88 88b 888
Y888 ,d ,ee 888 888 888 888 , 888
"88,d88 "88 888 888 888 "YeeP" 888
PROUDLY PRESENTS
Mistral-Large-Instruct-2411-iMat-GGUF
Quantized from bf16 with love.
Original model author: rAIfle
- Importance Matrix calculated using groups_merged.txt
- 92 chunks
- n_ctx=512
- iMat Calculation uses fp16 precision model weights
Original model README here and below.
Questionable-MN
My last attempt (for now) at beating up Nemo. Done in several steps, but basically it's Nemo-Base, plus bigdata-pw/the-x-files, plus a small private set of RP data and a bit of c2 to finish it up. ChatML.
(Realized I forgot to make this one public, heh. Don't have the settings used for training this anymore, sorry. Anyway, it works. Use standard Nemo sampler settings and whatever sysprompt you feel good about, as usual.)
- Downloads last month
- 162
Model tree for Quant-Cartel/Questionable-MN-12B-iMat-GGUF
Base model
mistralai/Mistral-Nemo-Base-2407
Finetuned
rAIfle/Questionable-MN-bf16