GGUF-IQ-Imatrix quants for NLPark/Test1_SLIDE as requested in #27.
Updated! These quants have been redone with the fixes from llama.cpp/pull/6920 in mind.
Use KoboldCpp version 1.64 or higher.
Recommended presets here or here.
Use the latest version of KoboldCpp. Use the provided presets.
This is all still highly experimental, modified configs were used to avoid the tokenizer issues.
"Due to the poor performance of Test0 in Asian Languages, we trained a new preview model."
"This's NLPark's 8B chat model."
"The chat template of our chat models is similar as Llama3."
- Downloads last month
- 101
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.