datatab
/

Yugo45-GPT-Quantized-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Yugo45-GPT-Quantized-GGUF / Yugo45-GPT-Quantized-GGUF.Q4_K_M.gguf

Commit History

q4_k_m: Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K

d1a2db2
verified

datatab commited on Feb 28, 2024