Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Hongrulee
/
gemma-2-9b-bnb-4bit-ANNIE
like
0
GGUF
gemma2
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
New: Create and edit this model card directly on the website!
Contribute a Model Card
Downloads last month
64
GGUF
Model size
9.24B params
Architecture
gemma2
4-bit
Q4_K_M
5-bit
Q5_K_M
8-bit
Q8_0
16-bit
BF16
Inference API
Unable to determine this model's library. Check the
docs
.