Update README.md
Browse files
README.md
CHANGED
@@ -2,12 +2,16 @@
|
|
2 |
base_model: HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
|
3 |
license: apache-2.0
|
4 |
---
|
5 |
-
##
|
|
|
6 |
```
|
7 |
cd ~/Downloads
|
8 |
|
9 |
-
cat orpo3ns.gguf.part* > orpo3ns.gguf
|
10 |
|
|
|
|
|
|
|
11 |
```
|
12 |
|
13 |
For lmStudio you need to copy the full orpo3ns.gguf file to your ~/.cache/lm-studio/models/YourNAME/
|
|
|
2 |
base_model: HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
|
3 |
license: apache-2.0
|
4 |
---
|
5 |
+
## MAKE SURE TO MERGE TOGETHER THE TWO PARTS AFTER DOWNLOADING OR IT WONT WORK
|
6 |
+
## I.e. Download the 3bit orpo3ns.gguf.part0 & orpo3ns.gguf.part1 files then:
|
7 |
```
|
8 |
cd ~/Downloads
|
9 |
|
10 |
+
cat orpo3ns.gguf.part* > orpo3ns.gguf
|
11 |
|
12 |
+
cd llamacppFolderLocaltion
|
13 |
+
|
14 |
+
./server -m ~/Downloads/orpor3ns.gguf -ngl 56
|
15 |
```
|
16 |
|
17 |
For lmStudio you need to copy the full orpo3ns.gguf file to your ~/.cache/lm-studio/models/YourNAME/
|