Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a16
like
9
Follow
Neural Magic
176
Text Generation
Transformers
Safetensors
8 languages
llama
int8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
arxiv:
2210.17323
License:
llama3.1
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
caf66fe
Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Commit History
Update README.md
caf66fe
verified
alexmarques
commited on
Jul 29
Update README.md
3927ba7
verified
alexmarques
commited on
Jul 26
Update README.md
0cfcb53
verified
alexmarques
commited on
Jul 26
Update README.md
7e4ac27
verified
alexmarques
commited on
Jul 26
Update README.md
44b6153
verified
alexmarques
commited on
Jul 25
Update README.md
edc122e
verified
alexmarques
commited on
Jul 24
Create README.md
8b65aea
verified
alexmarques
commited on
Jul 24
Upload folder using huggingface_hub
b892d70
verified
alexmarques
commited on
Jul 24
initial commit
c08f05e
verified
alexmarques
commited on
Jul 24