File size: 1,259 Bytes
e753120 096595a e753120 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
## Captain Adventure 32B
(Model card will be updated further in the near future.)
Fine-tuned from [c4ai-command-r-08-2024](https://huggingface.co/CohereForAI/c4ai-command-r-08-2024) using QLoRA at 8k context for training.
iMatrix GGUFs available here: [iMatrix GGUF](https://huggingface.co/MarsupialAI/Captain-Adventure-32B_iMat_GGUF)
Datasets used:
- Spring Dragon
- Skein
Total was around ~29-30M tokens of classic-style text adventure data.
This was trained in `completion` mode on axolotl, meaning I did not introduce any instruct format.
The intended use is in the style of KoboldLite's Adventure mode, which is raw text completion of the form:
```
Story text, setup, words
> User action
Narration describing the outcome of this action
> Another user action
More narration from the bot...
```
Set `>` as a stop token to use in traditional completion format.
**I've also been told this works well in instruct mode, in which case you will want to use Command-R Instruct format.**
Thanks, hope you have some fun with it.
*Extra thanks to Gargamel for sponsoring compute for this train. If you'd like me to train more models like this, feel free to donate to [my ko-fi](https://ko-fi.com/toastypigeon) so I can buy more compute credits.* |