Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation
Transformers
Safetensors
llama
int8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
3
Meta-Llama-3.1-8B-Instruct-quantized.w8a16
File size: 135 Bytes 
b892d70
 
 
 
1
2
3
4
 
version https://git-lfs.github.com/spec/v1
oid sha256:f454296c4173841a9bc2c8145ec3fd911cb127ae09e0fc7c7464a17879dbdfd5
size 4999416752