neuralmagic
/

Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-quantized.w4a16

Commit History

Update README.md

8fc8ead
verified

mgoin commited on 22 days ago

Update README.md

47eac7b
verified

alexmarques commited on Jul 18

Update README.md

bc2dec5
verified

abhinavnmagic commited on Jul 16

Update README.md

835e77a
verified

abhinavnmagic commited on Jul 16

Create README.md

ba7231d
verified

abhinavnmagic commited on Jul 16

Upload tokenizer_config.json with huggingface_hub

6c48620
verified

abhinavnmagic commited on Jul 11

Upload tokenizer.json with huggingface_hub

99e411f
verified

abhinavnmagic commited on Jul 11

Upload special_tokens_map.json with huggingface_hub

1cc1f16
verified

abhinavnmagic commited on Jul 11

Upload quantize_config.json with huggingface_hub

8033a3c
verified

abhinavnmagic commited on Jul 11

Upload model.safetensors with huggingface_hub

417db33
verified

abhinavnmagic commited on Jul 11

Upload config.json with huggingface_hub

d6df23a
verified

abhinavnmagic commited on Jul 11

initial commit

2efbe1f
verified

abhinavnmagic commited on Jul 11