neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated 20 days ago • 5.28k • 9
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated 20 days ago • 9.04k • 11
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated 20 days ago • 8.77k • 21