README.md

metadata

license: mit
tags:
  - gguf
  - phi-3

NOTE: Requires 128k context support -> https://github.com/ggerganov/llama.cpp/releases/tag/b2961.

GGUF llama.cpp quantized version of:

• Original model: Microsoft/Phi-3-medium-128k-instruct
• Model creator: Microsoft
• License

Recommended Prompt Format (Chat Format)

<|user|>
Provide some context and/or instructions to the model.<|end|>
<|assistant|>
AI message goes here<|end|>
<|user|>
The user’s message goes here<|end|>
<|assistant|>