Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
granite-3.1-8b-base-quantized.w4a16
like
0
Follow
Neural Magic
320
Text Generation
Transformers
Safetensors
English
granite
w4a16
int4
vllm
Inference Endpoints
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
ffe6ea4
granite-3.1-8b-base-quantized.w4a16
2 contributors
History:
2 commits
Shubhra Pandit
Upload model files
ffe6ea4
28 days ago
.gitattributes
Safe
1.52 kB
initial commit
28 days ago
config.json
Safe
13.7 kB
Upload model files
28 days ago
generation_config.json
Safe
132 Bytes
Upload model files
28 days ago
merges.txt
Safe
442 kB
Upload model files
28 days ago
model.safetensors
Safe
4.92 GB
LFS
Upload model files
28 days ago
recipe.yaml
Safe
336 Bytes
Upload model files
28 days ago
special_tokens_map.json
Safe
1.02 kB
Upload model files
28 days ago
tokenizer.json
Safe
3.48 MB
Upload model files
28 days ago
tokenizer_config.json
Safe
4.16 kB
Upload model files
28 days ago
vocab.json
Safe
777 kB
Upload model files
28 days ago