Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
granite-3.1-8b-base-quantized.w4a16
like
0
Follow
Neural Magic
302
Text Generation
Transformers
Safetensors
English
granite
w4a16
int4
vllm
Inference Endpoints
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
granite-3.1-8b-base-quantized.w4a16
2 contributors
History:
12 commits
nm-research
Update README.md
0114da0
verified
4 days ago
.gitattributes
Safe
1.52 kB
initial commit
18 days ago
README.md
Safe
15.8 kB
Update README.md
4 days ago
config.json
Safe
13.7 kB
Upload model files
18 days ago
generation_config.json
Safe
132 Bytes
Upload model files
18 days ago
merges.txt
Safe
442 kB
Upload model files
18 days ago
model.safetensors
Safe
4.92 GB
LFS
Upload model files
18 days ago
recipe.yaml
Safe
336 Bytes
Upload model files
18 days ago
special_tokens_map.json
Safe
1.02 kB
Upload model files
18 days ago
tokenizer.json
Safe
3.48 MB
Upload model files
18 days ago
tokenizer_config.json
Safe
4.16 kB
Upload model files
18 days ago
vocab.json
Safe
777 kB
Upload model files
18 days ago