quark_awq_g128_int4_asym_fp16_onnx_dml Collection These Models DirectML OGA models. These models are intermediate models (after quantization and model builder) for final Hybrid Models. • 11 items • Updated Dec 18, 2024
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid Text Generation • Updated Dec 13, 2024 • 16
amd/Llama2-7b-chat-awq-g128-int4-asym-bf16-onnx-ryzen-strix Text Generation • Updated Dec 13, 2024 • 135
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp16-onnx-hybrid Text Generation • Updated Dec 13, 2024 • 31
amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid Text Generation • Updated Dec 13, 2024 • 26
amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-bf16-onnx-ryzen-strix Text Generation • Updated Dec 13, 2024 • 21
amd/Llama-2-7b-hf-awq-g128-int4-asym-bf16-onnx-ryzen-strix Text Generation • Updated Dec 13, 2024 • 15
amd/Llama-3-8B-awq-g128-int4-asym-bf16-onnx-ryzen-strix Text Generation • Updated Dec 13, 2024 • 7 • 1