SeaLLM-7B-v2.5-vi-pubmed-GPTQ / quantize_config.json

Commit History

AutoGPTQ model for SeaLLMs/SeaLLM-7B-v2.5: 4bits, gr128, desc_act=False
d5b1d11
verified

tminh commited on