Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
Ayla-Light-12B-Stock-i1-GGUF
like
1
Transformers
GGUF
English
mergekit
Merge
Inference Endpoints
imatrix
conversational
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
6588533
Ayla-Light-12B-Stock-i1-GGUF
1 contributor
History:
24 commits
mradermacher
uploaded from rich1
6588533
verified
10 days ago
.gitattributes
Safe
3.07 kB
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ1_M.gguf
Safe
3.22 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ1_S.gguf
Safe
3 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ2_M.gguf
Safe
4.44 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ2_S.gguf
Safe
4.14 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ2_XS.gguf
Safe
3.92 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ2_XXS.gguf
Safe
3.59 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ3_M.gguf
Safe
5.72 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ3_XXS.gguf
Safe
4.95 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ4_NL.gguf
Safe
7.1 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-IQ4_XS.gguf
Safe
6.74 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q2_K.gguf
Safe
4.79 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q2_K_S.gguf
Safe
4.49 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q3_K_L.gguf
Safe
6.56 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q3_K_M.gguf
Safe
6.08 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q3_K_S.gguf
Safe
5.53 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q4_0.gguf
Safe
7.09 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q4_K_M.gguf
Safe
7.48 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q4_K_S.gguf
Safe
7.12 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q5_K_M.gguf
Safe
8.73 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q5_K_S.gguf
Safe
8.52 GB
LFS
uploaded from rich1
10 days ago
Ayla-Light-12B-Stock.i1-Q6_K.gguf
Safe
10.1 GB
LFS
uploaded from rich1
10 days ago
README.md
Safe
238 Bytes
uploaded from rich1
10 days ago
imatrix.dat
7.05 MB
LFS
uploaded from rich1
10 days ago