leonardlin's picture
Create README.md
9f543b5 verified
metadata
license: apache-2.0
language:
  - ja
  - en
base_model:
  - cyberagent/Mistral-Nemo-Japanese-Instruct-2408
tags:
  - gptq

W4A16 gs32 no act order (desc_act=false) GPTQ quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ GPTQModel 1.7.2 using augmxnt/ultra-orca-boros-en-ja-v1 as calibration set