Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
xiaoyizhu
/
test-exl2-4bit
like
0
Text Generation
Transformers
PyTorch
mistral
finetuned
text-generation-inference
Inference Endpoints
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
test-exl2-4bit
2 contributors
History:
3 commits
Xiaoyi
add quantization_config
4b1501a
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
2.41 kB
upload 4bit exl2
11 months ago
config.json
Safe
828 Bytes
add quantization_config
11 months ago
generation_config.json
Safe
116 Bytes
upload 4bit exl2
11 months ago
output.safetensors
Safe
3.86 GB
LFS
upload 4bit exl2
11 months ago
pytorch_model.bin.index.json
Safe
24 kB
upload 4bit exl2
11 months ago
special_tokens_map.json
Safe
72 Bytes
upload 4bit exl2
11 months ago
tokenizer.json
Safe
1.8 MB
upload 4bit exl2
11 months ago
tokenizer.model
Safe
493 kB
LFS
upload 4bit exl2
11 months ago
tokenizer_config.json
Safe
963 Bytes
upload 4bit exl2
11 months ago