Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
An4-7Bv3-i1-GGUF
like
0
Transformers
GGUF
English
Merge
mergekit
lazymergekit
Nitral-AI/Kunocchini-7b-128k-test
Smuggling1710/An4-7Bv2
Endevor/InfinityRP-v1-7B
Not-For-All-Audiences
Inference Endpoints
imatrix
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
8b09bc6
An4-7Bv3-i1-GGUF
1 contributor
History:
21 commits
mradermacher
uploaded from rain
8b09bc6
verified
27 days ago
.gitattributes
Safe
2.64 kB
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ1_M.gguf
Safe
1.75 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ2_M.gguf
Safe
2.5 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ2_S.gguf
Safe
2.31 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ2_XS.gguf
Safe
2.2 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ2_XXS.gguf
Safe
1.99 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ3_M.gguf
Safe
3.28 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ3_XXS.gguf
Safe
2.83 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ4_NL.gguf
Safe
4.13 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-IQ4_XS.gguf
Safe
3.91 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q2_K.gguf
Safe
2.72 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q2_K_S.gguf
Safe
2.53 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q3_K_L.gguf
Safe
3.82 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q3_K_M.gguf
Safe
3.52 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q3_K_S.gguf
Safe
3.16 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q4_K_M.gguf
Safe
4.37 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q4_K_S.gguf
Safe
4.14 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q5_K_S.gguf
Safe
5 GB
LFS
uploaded from rain
27 days ago
An4-7Bv3.i1-Q6_K.gguf
Safe
5.94 GB
LFS
uploaded from rain
27 days ago
README.md
Safe
230 Bytes
uploaded from rain
27 days ago
imatrix.dat
4.99 MB
LFS
uploaded from rain
27 days ago