|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- N8Programs/CreativeGPT |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
--- |
|
 |
|
|
|
# Model Card for Coxcomb |
|
|
|
A creative writing model, using the superb [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) as a base, finetuned on GPT-4 outputs to a diverse variety of prompts. It in no way competes with GPT-4 - it's quality of writing is below it, and it is primarily meant to be run in offline, local environments. |
|
On creative writing benchmarks, it is consistently ranked higher than most other models - [it scores 72.37](https://eqbench.com/creative_writing.html), beating goliath-120b, yi chat, and mistral-large. |
|
It is designed for **single-shot interactions**. You ask it to write a story, and it does. It is NOT designed for chat purposes, roleplay, or follow-up questions. |
|
|
|
## Model Details |
|
|
|
Trained w/ a 40M parameter lora on [N8Programs/CreativeGPT](https://huggingface.co/datasets/N8Programs/CreativeGPT) for 3 epochs. Overfit slightly (for much better benchmark results). |
|
|
|
|
|
### Model Description |
|
|
|
- **Developed by:** N8Programs |
|
- **Model type:** Mistral |
|
- **Language(s) (NLP):** English |
|
- **License:** Apache 2.0 |
|
- **Finetuned from model:** [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) |
|
|
|
## Uses |
|
|
|
Bot trained on NSFW (sexual or violent) content but will generate it when asked - it has not been trained with refusals. If you wish to ADD refusal behavior in, further tuning or filtering will be neccessary. |
|
|
|
### Direct Use |
|
|
|
GGUFs available at [Coxcomb-GGUF](https://huggingface.co/N8Programs/Coxcomb-GGUF) |
|
Should work with transformers (not officially tested). |
|
|
|
## Bias, Risks, and Limitations |
|
|
|
Tends to generate stories with happy, trite endings. Most LLMs do this. It's very hard to get them not to. |
|
|
|
## Training Details |
|
|
|
Trained on a single M3 Max in roughly 12 hours. |
