Hugging Face's logo

MaziyarPanahi
/
calme-2.1-llama3.1-70b-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
3
MaziyarPanahi commited on
Commit
aedb580
•
1 Parent(s): fb54e54

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. calme-2.1-llama3.1-70b-GGUF_imatrix.dat +3 -0
  3. calme-2.1-llama3.1-70b.IQ1_M.gguf +3 -0
  4. calme-2.1-llama3.1-70b.IQ1_S.gguf +3 -0
  5. calme-2.1-llama3.1-70b.IQ2_XS.gguf +3 -0
  6. calme-2.1-llama3.1-70b.IQ3_XS.gguf +3 -0
  7. calme-2.1-llama3.1-70b.IQ4_XS.gguf +3 -0
  8. calme-2.1-llama3.1-70b.Q2_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ calme-2.1-llama3.1-70b-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ calme-2.1-llama3.1-70b.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ calme-2.1-llama3.1-70b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ calme-2.1-llama3.1-70b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ calme-2.1-llama3.1-70b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ calme-2.1-llama3.1-70b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ calme-2.1-llama3.1-70b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
calme-2.1-llama3.1-70b-GGUF_imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:760b7e1636889f1bea10589411c4df79a17d4a9fdeb63980457ff403279fee49
3
+ size 24922274
calme-2.1-llama3.1-70b.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2da441af3992eebbe32b2b7ae13aa1118eff2fba00e5e90141cf96fc1462f54b
3
+ size 16751205248
calme-2.1-llama3.1-70b.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:463f762bcdbcfd8a90f9ae41360b18a5b7cbb43b418ff37f237150dba0aa455b
3
+ size 15343491968
calme-2.1-llama3.1-70b.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f32013eb76e2933d2b18c657b6f8f4ffc96cdb2d5e67e40dd4c0b41bee79fffd
3
+ size 21142117248
calme-2.1-llama3.1-70b.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cbf931d03e12a80c101f611d663073897ae9b9fbb45b730f99b71733044ddb4
3
+ size 29307740928
calme-2.1-llama3.1-70b.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53373cb862240e560de6082b08189a200c30a79ba97b62922e717b21fc9455c2
3
+ size 37902673472
calme-2.1-llama3.1-70b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c532c6995def7021bbf27be41d16066307841151bd92b1f55f96bcd45b93a287
3
+ size 26375118784