Hugging Face's logo

mlc-ai
/
Llama-3-8B-Instruct-q3f16_2-MLC

MLC-LLM
web-llm
Model card Files Community
1

How do u make these?

#1
by ucalyptus - opened
Discussion
ucalyptus

Can you share the recipe?

cc: @ruihanglai

CharlieFRuan
 machine learning compilation org

@ucalyptus These are made with MLC-LLM, specifically this section https://llm.mlc.ai/docs/compilation/convert_weights.html

Sign up or log in to comment