justinthelaw
/

Phi-3-mini-128k-instruct-4bit-128g-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

justinthelaw commited on Jul 30

Commit

40a155b

•

1 Parent(s): edafd33

modify README

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -22,8 +22,8 @@ tags:
 This repo contains GPTQ 4-bit, 128g Group Size, quantized model files for the recently released upgrade of [Phi-3-mini-128k-instruct](https://huggingface.co/justinthelaw/Phi-3-mini-128k-instruct-4bit-128g-instruct).
-<!-- README_AWQ.md-provided-files start -->
-## AWQ parameters
 Models are released as sharded safetensors files.
@@ -31,7 +31,7 @@ Models are released as sharded safetensors files.
 | ---- | -- | ----------- | ------- | ---- |
 | 4 | 128 | [wikitext2](https://huggingface.co/datasets/mindchain/wikitext2) | 128,000  | 2.28 GB
-<!-- README_AWQ.md-provided-files end -->
 ## Model Summary

 This repo contains GPTQ 4-bit, 128g Group Size, quantized model files for the recently released upgrade of [Phi-3-mini-128k-instruct](https://huggingface.co/justinthelaw/Phi-3-mini-128k-instruct-4bit-128g-instruct).
+<!-- README_GPTQ.md-provided-files start -->
+## GPTQ parameters
 Models are released as sharded safetensors files.
 | ---- | -- | ----------- | ------- | ---- |
 | 4 | 128 | [wikitext2](https://huggingface.co/datasets/mindchain/wikitext2) | 128,000  | 2.28 GB
+<!-- README_GPTQ.md-provided-files end -->
 ## Model Summary