Update README.md

README.md

@@ -21,6 +21,261 @@ tags:
 This model was converted to GGUF format from [`EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1`](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1) for more details on the model.
 
+
+
+
+	
+	
+	
+	
+
+
+
+---
+Model details:
+-
+
+
+
+
+
+
+
+
+A RP/storywriting
+specialist model, full-parameter finetune of Qwen2.5-7B on mixture of
+synthetic and natural data.
+
+
+
+
+
+
+
+
+It uses Celeste 70B
+0.1 data mixture, greatly expanding it to improve 
+
+
+
+versatility,
+creativity and "flavor" of the resulting model.
+
+
+
+
+
+
+
+
+Version 0.1 notes:
+
+
+Dataset was deduped
+and cleaned from 
+
+
+
+version 0.0, and
+learning rate was adjusted. Resulting model seems to be
+
+
+stabler, and 0.0
+problems with handling short inputs and min_p sampling
+
+
+seem to be mostly
+gone.
+
+
+
+
+
+
+
+
+Will be retrained
+once more, because this run crashed around e1.2 (out
+
+
+of 3) (thanks,
+DeepSpeed, really appreciate it), and it's still 
+
+
+
+somewhat
+undertrained as a result.
+
+
+
+
+
+
+
+
+Prompt format is
+ChatML.
+
+
+
+
+
+
+
+
+Recommended sampler
+values:
+
+
+
+
+
+
+
+
+Temperature: 0.87
+
+
+Top-P: 0.81
+
+
+Repetition Penalty:
+1.03
+
+
+
+
+
+
+
+
+Model appears to
+prefer lower temperatures (at least 0.9 and lower). Min-P seems to
+work now, as well.
+
+
+
+
+
+
+
+
+Recommended
+SillyTavern presets (via CalamitousFelicitousness):
+
+
+
+
+
+
+
+
+Context
+
+
+
+
+
+
+
+
+Instruct and System
+Prompt
+
+
+
+
+
+
+
+
+Training data:
+
+
+
+
+
+
+
+
+Celeste 70B 0.1 data
+mixture minus Opus Instruct subset. See that model's card for
+details.
+
+
+Kalomaze's
+Opus_Instruct_25k dataset, filtered for refusals.
+
+
+A subset (1k rows)
+of ChatGPT-4o-WritingPrompts by Gryphe
+
+
+A subset (2k rows)
+of Sonnet3.5-Charcards-Roleplay by Gryphe
+
+
+A cleaned subset
+(~3k rows) of shortstories_synthlabels by Auri
+
+
+Synthstruct and
+SynthRP datasets by Epiculous
+
+
+
+
+
+
+
+
+Training time and
+hardware:
+
+
+
+
+
+
+
+
+2 days on 4x3090Ti
+(locally)
+
+
+
+
+
+
+
+
+Model was trained by
+Kearm and Auri.
+
+
+Special thanks:
+
+
+to Gryphe, Lemmy,
+Kalomaze, Nopm and Epiculous for the data
+
+
+to Alpindale for
+helping with FFT config for Qwen2.5
+
+
+and to
+InfermaticAI's community for their continued support for our
+endeavors
+
+
+
+
+
+
+
+
+---
 ## Use with llama.cpp
 Install llama.cpp through brew (works on Mac and Linux)