nielsijzerman commited on
Commit
efc292a
1 Parent(s): a0ef157

Update README.md

Browse files

First GGUF conversion, added Airoboros 2.1 dataset. Originally a Meta Llama3, abliterated and retrained by by mlabonne, using black voodoo magic and a dorpo-dpo-mix-40 dataset to recover performance loss, caused by voodoo/abliteration.
There are gguf versions available, but I'd like to try a Imatrix (importance matrix) version, because they are supposed to run better on AMD gpu's using rocm. And I like it run on my previous gpu, an RX580 8GB, using the rocm fork of kobolcpp, cause, why not?
Added the Airoboros dataset from jondurbin for the same reason. Un-censoring was already achieved by the abliteration, but it wasn't trained for NSFW conversation. Supposedly, Airoboros includes that part, or something similar. It was a bit too long, so I didn't read the dataset. Or much else, I took the 2.1 dataset from Github because it has the word recommended behind in parenthesis and I'm a sucker for parenthesis, and everything advertised on HF as recommended.
No idea how it turned out, yet.

Files changed (1) hide show
  1. README.md +14 -7
README.md CHANGED
@@ -2,6 +2,7 @@
2
  base_model: mlabonne/NeuralDaredevil-8B-abliterated
3
  datasets:
4
  - mlabonne/orpo-dpo-mix-40k
 
5
  license: llama3
6
  tags:
7
  - dpo
@@ -25,7 +26,8 @@ model-index:
25
  value: 69.28
26
  name: normalized accuracy
27
  source:
28
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
29
  name: Open LLM Leaderboard
30
  - task:
31
  type: text-generation
@@ -41,7 +43,8 @@ model-index:
41
  value: 85.05
42
  name: normalized accuracy
43
  source:
44
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
45
  name: Open LLM Leaderboard
46
  - task:
47
  type: text-generation
@@ -58,7 +61,8 @@ model-index:
58
  value: 69.1
59
  name: accuracy
60
  source:
61
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
62
  name: Open LLM Leaderboard
63
  - task:
64
  type: text-generation
@@ -74,7 +78,8 @@ model-index:
74
  - type: mc2
75
  value: 60
76
  source:
77
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
78
  name: Open LLM Leaderboard
79
  - task:
80
  type: text-generation
@@ -91,7 +96,8 @@ model-index:
91
  value: 78.69
92
  name: accuracy
93
  source:
94
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
95
  name: Open LLM Leaderboard
96
  - task:
97
  type: text-generation
@@ -108,7 +114,8 @@ model-index:
108
  value: 71.8
109
  name: accuracy
110
  source:
111
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
 
112
  name: Open LLM Leaderboard
113
  ---
114
 
@@ -154,4 +161,4 @@ Step 3: Run inference through the main binary.
154
  or
155
  ```
156
  ./llama-server --hf-repo nielsijzerman/NeuralDaredevil-8B-abliterated-IQ4_NL-GGUF --hf-file neuraldaredevil-8b-abliterated-iq4_nl-imat.gguf -c 2048
157
- ```
 
2
  base_model: mlabonne/NeuralDaredevil-8B-abliterated
3
  datasets:
4
  - mlabonne/orpo-dpo-mix-40k
5
+ - jondurbin/airoboros-2.1
6
  license: llama3
7
  tags:
8
  - dpo
 
26
  value: 69.28
27
  name: normalized accuracy
28
  source:
29
+ url: >-
30
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
 
43
  value: 85.05
44
  name: normalized accuracy
45
  source:
46
+ url: >-
47
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
48
  name: Open LLM Leaderboard
49
  - task:
50
  type: text-generation
 
61
  value: 69.1
62
  name: accuracy
63
  source:
64
+ url: >-
65
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
66
  name: Open LLM Leaderboard
67
  - task:
68
  type: text-generation
 
78
  - type: mc2
79
  value: 60
80
  source:
81
+ url: >-
82
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
83
  name: Open LLM Leaderboard
84
  - task:
85
  type: text-generation
 
96
  value: 78.69
97
  name: accuracy
98
  source:
99
+ url: >-
100
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
101
  name: Open LLM Leaderboard
102
  - task:
103
  type: text-generation
 
114
  value: 71.8
115
  name: accuracy
116
  source:
117
+ url: >-
118
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
119
  name: Open LLM Leaderboard
120
  ---
121
 
 
161
  or
162
  ```
163
  ./llama-server --hf-repo nielsijzerman/NeuralDaredevil-8B-abliterated-IQ4_NL-GGUF --hf-file neuraldaredevil-8b-abliterated-iq4_nl-imat.gguf -c 2048
164
+ ```