Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
seonglae
/
opt-125m-4bit-gptq
like
0
Text Generation
Transformers
opt
auto-gptq
gptq
4bit
text-generation-inference
Inference Endpoints
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
seonglae
commited on
Jul 8, 2023
Commit
00f146a
•
1 Parent(s):
8a914b1
docs: notify inference from hugginf face workability
Browse files
Files changed (1)
hide
show
README.md
+3
-1
README.md
CHANGED
Viewed
@@ -2,4 +2,6 @@
2
license: mit
3
tags:
4
- auto-gptq
5
-
---
2
license: mit
3
tags:
4
- auto-gptq
5
+
---
6
+
7
+
This model should use [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) so inference from Hugging face might not working