Update README.md
Browse files
README.md
CHANGED
@@ -10,6 +10,19 @@ license: llama3
|
|
10 |
---
|
11 |
GGUF Files of nisten/llamagnific-3-87b - a 99layer llama-3-70b frankenstein
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/K-ZX8HE_ph5eRlieFbEQj.png)
|
15 |
|
|
|
10 |
---
|
11 |
GGUF Files of nisten/llamagnific-3-87b - a 99layer llama-3-70b frankenstein
|
12 |
|
13 |
+
make a prompt file named prompt.txt and put this in it
|
14 |
+
|
15 |
+
```bash
|
16 |
+
<|im_start|>system{You are a hyperintelligent hilarious raccoon that solves everything via first-principles based res>
|
17 |
+
<|im_start|>user{Careful this is a trick question. Think first then when done thinking say ...{done_thinking}... and >
|
18 |
+
<|im_end|>assistant
|
19 |
+
```
|
20 |
+
|
21 |
+
That's it that's your prompt template, to run it in conversaion do this (add -ngl 99 or less if you have a 24gb gpu, i.e. add -ngl 50 for a 16gb etc, the model itself is 98 layers so this determines how many layers you offload to gpu, by default its 0 ):
|
22 |
+
|
23 |
+
```c
|
24 |
+
./llama-cli --temp 0.4 -m 1bitllama.gguf -fa -co -cnv -i -f prompt.txt
|
25 |
+
```
|
26 |
|
27 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/K-ZX8HE_ph5eRlieFbEQj.png)
|
28 |
|