Create README.md

README.md

@@ -0,0 +1,21 @@
+---
+license: mit
+datasets:
+- wikitext
+---
+
+[gpt2](https://huggingface.co/openai-community/gpt2) quantized to 4-bit using [AutoGPTQ](https://github.com/AutoGPTQ/AutoGPTQ).
+
+To use:
+
+```shell
+pip install auto-gptq
+```
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+from auto_gptq import AutoGPTQForCausalLM, BaseQuantizeConfig
+
+model_name = "smpanaro/gpt2-AutoGPTQ-4bit-128g"
+model = AutoGPTQForCausalLM.from_quantized(model_name)
+```