nisten commited on
Commit
5ad0b98
·
verified ·
1 Parent(s): 441aae7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -10,6 +10,19 @@ license: llama3
10
  ---
11
  GGUF Files of nisten/llamagnific-3-87b - a 99layer llama-3-70b frankenstein
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/K-ZX8HE_ph5eRlieFbEQj.png)
15
 
 
10
  ---
11
  GGUF Files of nisten/llamagnific-3-87b - a 99layer llama-3-70b frankenstein
12
 
13
+ make a prompt file named prompt.txt and put this in it
14
+
15
+ ```bash
16
+ <|im_start|>system{You are a hyperintelligent hilarious raccoon that solves everything via first-principles based res>
17
+ <|im_start|>user{Careful this is a trick question. Think first then when done thinking say ...{done_thinking}... and >
18
+ <|im_end|>assistant
19
+ ```
20
+
21
+ That's it that's your prompt template, to run it in conversaion do this (add -ngl 99 or less if you have a 24gb gpu, i.e. add -ngl 50 for a 16gb etc, the model itself is 98 layers so this determines how many layers you offload to gpu, by default its 0 ):
22
+
23
+ ```c
24
+ ./llama-cli --temp 0.4 -m 1bitllama.gguf -fa -co -cnv -i -f prompt.txt
25
+ ```
26
 
27
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/K-ZX8HE_ph5eRlieFbEQj.png)
28