AI-Engine
/

Phi-3-medium-4k-instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

AI-Engine commited on May 22

Commit

3ea2daf

•

1 Parent(s): 9e387c8

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -5,6 +5,8 @@ tags:
 - phi-3
 ---
 GGUF [llama.cpp](https://github.com/ggerganov/llama.cpp) quantized version of:
 - Original model: [Microsoft/Phi-3-medium-4k-instruct](https://huggingface.co/microsoft/Phi-3-medium-4k-instruct/tree/main)
 - Model creator: [Microsoft](https://huggingface.co/microsoft)

 - phi-3
 ---
+<span style="color:red">NOTE: Requires 128k context support -> [https://github.com/ggerganov/llama.cpp/releases/tag/b2961](https://github.com/ggerganov/llama.cpp/releases/tag/b2961)</span>.
 GGUF [llama.cpp](https://github.com/ggerganov/llama.cpp) quantized version of:
 - Original model: [Microsoft/Phi-3-medium-4k-instruct](https://huggingface.co/microsoft/Phi-3-medium-4k-instruct/tree/main)
 - Model creator: [Microsoft](https://huggingface.co/microsoft)