How can i transform an .safetensor to .gguf file?

#1
by NoneGG - opened

Hello, I found out that llama.cpp does not support to convert deepseek model(which is in safetensor format) to gguf format? (will raise map error, such as issue )
if it i convenient for you, could you please tell me how can i convert the model file?

There appears to be plenty of deepseek gguf models, have you checked these?

https://huggingface.co/models?search=deepseek%20gguf

Sure, i use LoneStriker/OpenCodeInterpreter-DS-6.7B-GGUF for now, it works nice and thanks a lot!
I am just curious abou that.

Sign up or log in to comment