abhinavkulkarni
/

mosaicml-mpt-7b-instruct-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions Community

abhinavkulkarni commited on Jul 12, 2023

Commit

5918ce5

•

1 Parent(s): 5005aef

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ git clone https://github.com/mit-han-lab/llm-awq \
 && cd llm-awq \
 && git checkout 71d8e68df78de6c0c817b029a568c064bf22132d \
 && pip install -e . \
-&& cd awq/kernels \\
 && python setup.py install
 ```
@@ -99,7 +99,7 @@ This evaluation was done using [LM-Eval](https://github.com/EleutherAI/lm-evalua
 |        |       |byte_perplexity| 1.5628|   |      |
 |        |       |bits_per_byte  | 0.6441|   |      |
-[MPT-7B-Instruct (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/mpt-7b-instruct-w4-g128-awq)
 |  Task  |Version|    Metric     | Value |   |Stderr|
 |--------|------:|---------------|------:|---|------|

 && cd llm-awq \
 && git checkout 71d8e68df78de6c0c817b029a568c064bf22132d \
 && pip install -e . \
+&& cd awq/kernels \
 && python setup.py install
 ```
 |        |       |byte_perplexity| 1.5628|   |      |
 |        |       |bits_per_byte  | 0.6441|   |      |
+[MPT-7B-Instruct (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/mosaicml-mpt-7b-instruct-w4-g128-awq)
 |  Task  |Version|    Metric     | Value |   |Stderr|
 |--------|------:|---------------|------:|---|------|