neuralmagic
/

Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Resources

View closed (1)

Update README.md

#3 opened 8 days ago by

question about quantize method

#2 opened 2 months ago by