Chronomaid Storytelling 13B - ExLlama V2
Original model: Chronomaid Storytelling 13B
Description
This is an EXL2 quantization of the NyxKrage's Chronomaid Storytelling 13B model.
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Quantizations
| Bits Per Weight | Size |
|---|---|
| main (2.4bpw) | 3.98 GB |
| 3bpw | 4.86 GB |
| 3.5bpw | 5.60 GB |
| 4bpw | 6.34 GB |
| 4.5bpw | 7.08 GB |
| 5bpw | 7.82 GB |
| 6bpw | 9.29 GB |
| 8bpw | 12.2 GB |
Original model card: Carsten Kragelund's Chronomaid Storytelling 13B
Chronomaid-Storytelling-13b
Merge including Noromaid-13b-v0.1.1, and Chronos-13b-v2 with the Storytelling-v1-Lora applied afterwards
Inteded for primarily RP, and will do ERP, narrator-character and group-chats without much trouble in my testing.
Prompt Format
Tested with Alpaca, the Noromaid preset's will probably also work (check the Noromaid model card for SillyTavern presets)
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Sampler Settings
Tested at
temp1.3min p0.05 and 0.15temp1.7,min p0.08 and 0.15
Quantized Models
The model has been kindly quantized in GGUF, AWQ, and GPTQ by TheBloke
Find them in the Chronomaid-Storytelling-13b Collection
Thanks ❤️
To Undi & Ikari for Noromaid and Elinas for Chronos
Support Undi and Elinas on Kofi
- Downloads last month
- 30
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.
Model tree for LogicismTV/Chronomaid-Storytelling-13b-exl2
Base model
NyxKrage/Chronomaid-Storytelling-13b