|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- control-vector |
|
- creative-writing |
|
--- |
|
|
|
## gghfez/72B-Qwen2.5-Kunou-v1-control-vectors |
|
|
|
Creative Writing control-vectors for [Sao10K/72B-Qwen2.5-Kunou-v1](https://huggingface.co/Sao10K/72B-Qwen2.5-Kunou-v1) |
|
|
|
## Usage example |
|
|
|
### llama.cpp |
|
```sh |
|
llama-server --model 72B-Qwen2.5-Kunou-v1-Q4_K.gguf [other CLI arguments] \ |
|
--control-vector 72B-Qwen2.5-Kunou-v1-character_focus__debias.gguf \ |
|
--control-vector 72B-Qwen2.5-Kunou-v1-character_focus__dialogue.gguf \ |
|
--control-vector <other vectors> |
|
|
|
``` |
|
|
|
|
|
Trained on 1xH100NVL using jukofyork's [control-vectors](https://github.com/jukofyork/control-vectors) |
|
|
|
Based off Version v3.0 of [creative-writing-control-vectors-v3.0](https://huggingface.co/jukofyork/creative-writing-control-vectors-v3.0/). |
|
|
|
See here for more info about control-vectors [creative-writing-control-vectors-v3.0](https://huggingface.co/jukofyork/creative-writing-control-vectors-v3.0/) |