TeeZee/DarkForest-20B-v1.1

DarkForest 20B v1.1

Model Details

• To create this model two step procedure was used. First a new 20B model was created using microsoft/Orca-2-13b and KoboldAI/LLaMA2-13B-Erebus-v3 , deatils of the merge in mergekit-config_step1.yml
• then jebcarter/psyonic-cetacean-20B was used to produce the final model, merge config in mergekit-config-step2.yml
• instead of linear merge method used in v1.0, this time DARE TIES method was used for step2
• The resulting model has approximately 20 billion parameters.

Warning: This model can produce NSFW content!

Results

• produces SFW nad NSFW content without issues, switches context seamlessly.
• good at following instructions.
• good at tracking multiple characters in one scene.
• very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, menatal issues or complicated relationships.
• NSFW output is more creative and suprising than typical limaRP output.
• definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
• This is NOT Harry Potter level storytelling.

All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	61.46
AI2 Reasoning Challenge (25-Shot)	63.57
HellaSwag (10-Shot)	86.42
MMLU (5-Shot)	59.77
TruthfulQA (0-shot)	56.31
Winogrande (5-shot)	77.74
GSM8k (5-shot)	24.94