Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,5 @@
|
|
| 1 |
[Airoboros 13b GPT4 1.4](https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4) merged with kaiokendev's [SuperHOT 8k](https://huggingface.co/kaiokendev/superhot-13b-8k-no-rlhf-test) LoRA.
|
| 2 |
|
| 3 |
-
The code to merge these can be found [here](https://files.catbox.moe/mg5v4g.py). Change information as needed.
|
|
|
|
|
|
|
|
|
| 1 |
[Airoboros 13b GPT4 1.4](https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4) merged with kaiokendev's [SuperHOT 8k](https://huggingface.co/kaiokendev/superhot-13b-8k-no-rlhf-test) LoRA.
|
| 2 |
|
| 3 |
+
The code to merge these can be found [here](https://files.catbox.moe/mg5v4g.py). Change information as needed.
|
| 4 |
+
|
| 5 |
+
NOTE: This requires a monkey patch to work. FlashVenom has, along with kindly quantising this model to 4bit, added the monkeypatch file to their repo. You can access this [here](https://huggingface.co/flashvenom/Airoboros-13B-SuperHOT-8K-4bit-GPTQ).
|