grimjim commited on
Commit
454361d
1 Parent(s): b195549

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -27
README.md CHANGED
@@ -1,27 +1,28 @@
1
- ---
2
- base_model:
3
- - meta-llama/Meta-Llama-3-8B-Instruct
4
- - failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - peft
9
- license: llama3
10
- ---
11
- # Llama-3-Instruct-abliteration-LoRA-8B
12
-
13
- This is a rank=32 LoRA extracted from a language model. It was extracted using [mergekit](https://github.com/arcee-ai/mergekit).
14
-
15
- This LoRA is derived from the refusal ablation vector also computed in [Llama-3-Instruct-abliteration-OVA-8B](https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-OVA-8B), and is around 5 orders of magnitude smaller than full bf16 weights of the base model.
16
-
17
- ## LoRA Details
18
-
19
- This LoRA adapter was extracted from [failspy/Meta-Llama-3-8B-Instruct-abliterated-v3](https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3) and uses [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
20
-
21
- ### Parameters
22
-
23
- The following command was used to extract this LoRA adapter:
24
-
25
- ```sh
26
- mergekit-extract-lora meta-llama/Meta-Llama-3-8B-Instruct failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 OUTPUT_PATH --rank=32 --model_name=Llama-3-8B-Instruct-counter-refusal
27
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - meta-llama/Meta-Llama-3-8B-Instruct
4
+ - failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - peft
9
+ - lora
10
+ license: llama3
11
+ ---
12
+ # Llama-3-Instruct-abliteration-LoRA-8B
13
+
14
+ This is a rank=32 LoRA extracted from a language model. It was extracted using [mergekit](https://github.com/arcee-ai/mergekit).
15
+
16
+ This LoRA is derived from the refusal ablation vector also computed in [Llama-3-Instruct-abliteration-OVA-8B](https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-OVA-8B), and is around 5 orders of magnitude smaller than full bf16 weights of the base model.
17
+
18
+ ## LoRA Details
19
+
20
+ This LoRA adapter was extracted from [failspy/Meta-Llama-3-8B-Instruct-abliterated-v3](https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3) and uses [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
21
+
22
+ ### Parameters
23
+
24
+ The following command was used to extract this LoRA adapter:
25
+
26
+ ```sh
27
+ mergekit-extract-lora meta-llama/Meta-Llama-3-8B-Instruct failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 OUTPUT_PATH --rank=32 --model_name=Llama-3-8B-Instruct-counter-refusal
28
+ ```