|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- control-vector |
|
- creative-writing |
|
--- |
|
|
|
## gghfez/Sorcerer_creative-writing-control-vectors |
|
|
|
Creative Writing control-vectors for [rAIfle/SorcererLM-8x22b-bf16](https://huggingface.co/rAIfle/SorcererLM-8x22b-bf16) |
|
|
|
This is an excellent model, but I found it somewhat diffcult to steer via prompting. |
|
|
|
These control vector solved it for me. |
|
|
|
## Usage example |
|
|
|
```sh |
|
llama-server --model SorcererLM-8x22b-iMat-IQ4_XS-00001-of-00002.gguf [other CLI arguments] \ |
|
--control-vector SorcererLM-8x22b-optimism_vs_nihilism__debias.gguf \ |
|
--control-vector <add as many as you want like this>.gguf |
|
``` |
|
|
|
Train on 1xH100NVL using jukofyork's [control-vectors](https://github.com/jukofyork/control-vectors) |
|
|
|
Based off Version v3.0 of [creative-writing-control-vectors-v3.0](https://huggingface.co/jukofyork/creative-writing-control-vectors-v3.0/). |
|
|
|
See here for more info about control-vectors [creative-writing-control-vectors-v3.0](https://huggingface.co/jukofyork/creative-writing-control-vectors-v3.0/) |
