Hugging Face's logo

thesven
/
Llama-3-70B-Instruct-GGUF

Text Generation
PyTorch
English
facebook
meta
llama
llama-3
Model card Files Community
1
thesven commited on
Commit
ec752b6
·
verified ·
1 Parent(s): eb78be5

Upload folder using huggingface_hub

Browse files
Files changed (11) hide show
  1. Llama-3-70B-Instruct-GGUF-IQ1_S.bin +3 -0
  2. Llama-3-70B-Instruct-GGUF-IQ2_S.bin +3 -0
  3. Llama-3-70B-Instruct-GGUF-IQ2_XS.bin +3 -0
  4. Llama-3-70B-Instruct-GGUF-IQ3_S.bin +3 -0
  5. Llama-3-70B-Instruct-GGUF-IQ3_XXS.bin +3 -0
  6. Llama-3-70B-Instruct-GGUF-IQ4_NL.bin +3 -0
  7. Llama-3-70B-Instruct-GGUF-IQ4_XS.bin +3 -0
  8. Llama-3-70B-Instruct-GGUF-Q2_K.bin +3 -0
  9. Llama-3-70B-Instruct-GGUF-Q3_K.bin +3 -0
  10. Llama-3-70B-Instruct-GGUF-Q3_K_S.bin +3 -0
  11. Llama-3-70B-Instruct-GGUF-Q4_K_M.bin +3 -0
Llama-3-70B-Instruct-GGUF-IQ1_S.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07fa3cffa85b0a68136f757656d456cd02fefab947eaaaeb2405ceae701ba337
3
+ size 15343482592
Llama-3-70B-Instruct-GGUF-IQ2_S.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4806d99802972856ec2ca9791475d8f49b3e4bd0850ca90edaa8bebe4d268461
3
+ size 22242342624
Llama-3-70B-Instruct-GGUF-IQ2_XS.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edb3256131acf104668b8d326100d4a4c80b7c8f7ff15d7421348797498a17c7
3
+ size 21142107872
Llama-3-70B-Instruct-GGUF-IQ3_S.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1272ed9994af6d46678d8d9a01068a5b69c129cdf2ebfe01d546d29053feef5
3
+ size 30912050912
Llama-3-70B-Instruct-GGUF-IQ3_XXS.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:667d5432b38ad726135c424a9c04aa96933b653776ebe5538e318e371f603d77
3
+ size 27469493984
Llama-3-70B-Instruct-GGUF-IQ4_NL.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab706abdcf5f4504fefe307fcd7c062e036c91acbdbac4662b89621a58c798cb
3
+ size 40053618400
Llama-3-70B-Instruct-GGUF-IQ4_XS.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:471f73f62b7c11d9789a9f892620d7ecd6c03207f42c792e61743f33efa508aa
3
+ size 37902661344
Llama-3-70B-Instruct-GGUF-Q2_K.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f41d874808123e5a9e1ed9624fb1f9306fff369db50946110c530f875cc8657
3
+ size 26375108096
Llama-3-70B-Instruct-GGUF-Q3_K.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7477a99813dedb008ab30b3caf3ebfee934046b9a05bba006ae26046aee5e613
3
+ size 34267493888
Llama-3-70B-Instruct-GGUF-Q3_K_S.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e980833746394460f1b6e911211cd1cc8f9abe796989aeeadc95a7de21eeddf
3
+ size 30912050688
Llama-3-70B-Instruct-GGUF-Q4_K_M.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c15c1feae1aae7beb0eb37a4100491d743716ad1de228bb7da5ed39ce99e22c
3
+ size 42520393216