mradermacher

/

model_requests

like 83

They are all queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at the following locations for quants to appear:

• https://hf.tst.eu/model#DistilQwen2.5-0.5B-Instruct-GGUF
• https://hf.tst.eu/model#DistilQwen2.5-1.5B-Instruct-GGUF
• https://hf.tst.eu/model#DistilQwen2.5-3B-Instruct-GGUF
• https://hf.tst.eu/model#DistilQwen2.5-7B-Instruct-GGUF

@wqerrewetw Thouse models are using the Qwen2Model archidecture which seam to unfortinately not yet supported by llama.cpp:

INFO:hf-to-gguf:Loading model: DistilQwen2.5-1.5B-Instruct
ERROR:hf-to-gguf:Model Qwen2Model is not supported