quantflex's picture
Update README.md
12e6c55 verified
metadata
license: llama3.2
language:
  - en
pipeline_tag: text-generation
base_model: huihui-ai/MicroThinker-1B-Preview

QuantFlex Banner

GGUF Quants for: MicroThinker-1B-Preview

Model by: huihui-ai (thank you!)

Quants by: quantflex

Run with llama.cpp:

./llama-cli -m MicroThinker-1B-Preview-Q5_K_M.gguf -cnv -p "You are a helpful assistant. You should think step-by-step." --chat-template llama3