neuralmagic
/

Llama2-7b-chat-pruned50-quant-ds

Text Generation

Model card Files Files and versions Community

mwitiderrick commited on Dec 20, 2023

Commit

edee858

·

1 Parent(s): 45051a3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ Run in a [Python pipeline](https://github.com/neuralmagic/deepsparse/blob/main/d
 from deepsparse import TextGeneration
 prompt = "How to make banana bread?"
-formatted_prompt =  f"### Instruction\n{prompt}\n### Response:\n"
 model = TextGeneration(model_path="hf:nm-testing/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds")

 from deepsparse import TextGeneration
 prompt = "How to make banana bread?"
+formatted_prompt =  f"<s>[INST]{prompt}[/INST]"
 model = TextGeneration(model_path="hf:nm-testing/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds")