Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
neuralmagic
/
Llama-3.2-3B-Instruct-FP8-dynamic
like
2
Follow
Neural Magic
174
Text Generation
Safetensors
8 languages
llama
fp8
vllm
conversational
compressed-tensors
License:
llama3.2
Model card
Files
Files and versions
Community
Train
main
Llama-3.2-3B-Instruct-FP8-dynamic
Commit History
Updated compression_config to quantization_config
c308a86
verified
mgoin
commited on
Oct 9
Update README.md
4432a30
verified
alexmarques
commited on
Sep 26
add readme
9064e71
Eldar Kurtic
commited on
Sep 25
add model
8f9fd99
Eldar Kurtic
commited on
Sep 25
initial commit
e9489c3
verified
ekurtic
commited on
Sep 25