amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation
•
Updated
•
26
quark_awq_g128_int4_asym_fp16_onnx_hybrid 1.3
Models quantized by Quark and prepared for the OGA-based hybrid execution flow (Ryzen AI 1.3)
-
-
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 31 -
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 17 -
amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 29 -
amd/chatglm3-6b-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 13 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 6 -
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 16 -
amd/Llama-3-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 14 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 17 -
amd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 452 -
amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 27