GGUF
Not-For-All-Audiences
nsfw
Inference Endpoints
conversational
brooketh commited on
Commit
78ce0f7
·
verified ·
1 Parent(s): 300c081

Upload Llama-3-Lumimaid-8B-v0.1-GGUF

Browse files
.gitattributes CHANGED
@@ -56,3 +56,5 @@ Llama-3-Lumimaid-8B-v0.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
  Llama-3-Lumimaid-8B-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
57
  Llama-3-Lumimaid-8B-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
58
  Llama-3-Lumimaid-8B-v0.1.imatrix filter=lfs diff=lfs merge=lfs -text
 
 
 
56
  Llama-3-Lumimaid-8B-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
57
  Llama-3-Lumimaid-8B-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
58
  Llama-3-Lumimaid-8B-v0.1.imatrix filter=lfs diff=lfs merge=lfs -text
59
+ Llama-3-Lumimaid-8B-v0.1.F32.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Llama-3-Lumimaid-8B-v0.1.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-Lumimaid-8B-v0.1.F32.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbd62ddbffed691e4304e07894ea0bfc59da60d799d60a6a9b3d7b5398891140
3
+ size 32128880928
Llama-3-Lumimaid-8B-v0.1.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8144206f3fdb071072fdebbbeb3ec11e4b22ca352cdb54b38e791451b2460f77
3
+ size 2161971712
Llama-3-Lumimaid-8B-v0.1.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bb8d7d739393a4a6576947521958e9fa58e158c42b531a1bae78b643213a61d
3
- size 2020140608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1612c28adc478a10aaafae73c708e64eba646397ec58be312bcf7573a15d050e
3
+ size 2019627520
Llama-3-Lumimaid-8B-v0.1.IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7026c4a79d166abcb9e56b4587495209d5949104e04446636bf9b1dfc1e520d
3
- size 2948793920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d62dac161eef216ddb538d7031e5c8e195609760d1f17f3260120a13d1aaf0
3
+ size 2948280832
Llama-3-Lumimaid-8B-v0.1.IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24910a3b7abc1b415c35547647783b22cfc7477e32ea24db59df8f7d70f440d9
3
- size 2759001664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f582eaf51ac653868832264be8bf3e5c052f056792116b32c0a037b3fad58ef1
3
+ size 2758488576
Llama-3-Lumimaid-8B-v0.1.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16487875e2f886af80e6377450ec34587510759299e088ea1fc603af8390533b
3
- size 2606294592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b88efdcff05a7d6f06eeffe7476c02bc83a5575c1a7a9bfa201659a6ea382bd0
3
+ size 2605781504
Llama-3-Lumimaid-8B-v0.1.IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1481714ad4312b90117de8d428a8e9f468fa8646d1e9c6521c58961c4c681900
3
- size 2399725120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bcf6c42fff15e9afbc275923d30df86504d7f30d313e7d8a4b43d07506048c4
3
+ size 2399212032
Llama-3-Lumimaid-8B-v0.1.IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc4d48e3bbd1f579d39995237ab6946df88990c99238e773341f85c8ba88ea0e
3
- size 3785336384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b168e284d4ba14183b29f636e480a447552fbea767684258a8fe4cfbffa6210
3
+ size 3784823296
Llama-3-Lumimaid-8B-v0.1.IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e0af8624b2088e3a6bf293df147a41c0c5ac0965b5ee861e3a0d2d47d4b8682
3
- size 3682838080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1715555562f0442f34d11bbc4d4d75d5372955434d728c9a32eb397f41742d8c
3
+ size 3682324992
Llama-3-Lumimaid-8B-v0.1.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:91cf050931daa097964b85b68680aca5794cc174c5a4cfb9dd1650adcdfc71c0
3
- size 3519260224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fdd5ca034635abc14bd205189cf48340eb94b689e4c20844b986421e2bbfe8e
3
+ size 3518747136
Llama-3-Lumimaid-8B-v0.1.IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1d3e2113ac115d09df2b56b3f43d32346c2e920fe9596637401a229559e650e6
3
- size 3275425344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:268f994674db86fe8e65e6755571fff139cabc99dd26465f5e96ef4e497cffd1
3
+ size 3274912256
Llama-3-Lumimaid-8B-v0.1.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f57231f74d6a8006fd4090066a4f9997129f222f42dae54694c96fee0d6b9014
3
- size 4448175680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:721ee444d95f20060bc3610520b547cf4264c77de15e9a637965b745f8a3c1e7
3
+ size 4447662592
Llama-3-Lumimaid-8B-v0.1.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fe7bb9bb45ccc81e4dcb5236b93f634b8a92557b2111e4f6b56b382c0a2684d
3
- size 4322469152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7815dc4da015ae019126807412575c4e9eafad2dafe2a6571061e02aa357415
3
+ size 4321956128
Llama-3-Lumimaid-8B-v0.1.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f533e63aa8c320c0e5487019ab78412454770182c1ecc09af1beb415297c5373
3
- size 4019430688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:183970a75a243adf256024b01da90fdc9894b69e9b713ea8d5116c20f18a630c
3
+ size 4018917664
Llama-3-Lumimaid-8B-v0.1.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd4ae78df9af3c93560078c1c0283b95d3b8cd3f6a5ac5fb295905b45a2d8c87
3
- size 3665012000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de5ac1b553ebfe08a434e6340553548b24e95b736f80f484945f973b59c8a31
3
+ size 3664498976
Llama-3-Lumimaid-8B-v0.1.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:624e3d938b63ffb81b4f94ab186963203e31637c85be633962e7259fcfe5eaca
3
- size 4921247008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:403068c2278bd8fdda6c2df27f53e35e55bd41deb6e5edfdf65c38603d4e60e2
3
+ size 4920733984
Llama-3-Lumimaid-8B-v0.1.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d634c29c53936a0219229519da4180a893af0118f5f123b22ea6985a12ae9d05
3
- size 4693181728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89cb17760e28d093514fa4d021f6de7a01c031c704ac95e4ebaf9875e9169eac
3
+ size 4692668704
Llama-3-Lumimaid-8B-v0.1.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3733c9c48e0b8c0d04b1492a920020ab4895871784c16d02245b44e5db458dae
3
- size 5733500192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08d6043f9b965d26fe8568c7b791d5b312eaaf09ce912d36defaca55f5cd711c
3
+ size 5732987168
Llama-3-Lumimaid-8B-v0.1.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6050c293c7e2bef0325e8b8d848dc86c087a59d448d4789abd3c079dbdac469
3
- size 5599806752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22d65200b0cace86f7a71491337d11d1d8fa32caa171ccd9d5f5092b2c3dcebb
3
+ size 5599293728
Llama-3-Lumimaid-8B-v0.1.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a5f9d1a21d2a7212d588dda5c7200e11316020836c3d38ba642bb08d911bde7
3
- size 6596519200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6938ed3c421d3cd6b764971e1b6f6d3b78c1897af0ff87cfcb34035481b78fb
3
+ size 6596006176
Llama-3-Lumimaid-8B-v0.1.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e53e1f71b72c9b83a3c59a0207eb7c18d61d34461dbe3de972c84541f1e1b92
3
- size 8541283616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f4e48e014aa3e582a096b90d9351da007e01be9dcf017458b281d428402dd8f
3
+ size 8540770592
Llama-3-Lumimaid-8B-v0.1.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a44d5e1d3eb0e03b81da5cc3cbd07c56f374ddb7c56d2accaf2666984b03cb0
3
- size 4988160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3acf4e1a96b5facffba1cef987c629a236decc0b0e44d93f5025426abf5c8c1c
3
+ size 4988153
README.md CHANGED
@@ -6,7 +6,7 @@ tags:
6
  base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1
7
  model_name: Llama-3-Lumimaid-8B-v0.1-GGUF
8
  quantized_by: brooketh
9
-
10
  ---
11
  <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
12
 
@@ -17,9 +17,9 @@ quantized_by: brooketh
17
  <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
18
 
19
  ***
20
- # Llama 3 Lumimaid 8B v0.1
21
  - **Creator:** [NeverSleep](https://huggingface.co/NeverSleep/)
22
- - **Original:** [Llama 3 Lumimaid 8B v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1)
23
  - **Date Created:** 2024-04-30
24
  - **Trained Context:** 8192 tokens
25
  - **Description:** RP model from Undi based on Llama3, which incorporates the Luminae dateset from Ikari. It tries to strike a balance between erotic and non-erotic RP, while being entirely uncensored.
 
6
  base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1
7
  model_name: Llama-3-Lumimaid-8B-v0.1-GGUF
8
  quantized_by: brooketh
9
+ parameter_count: 8030261248
10
  ---
11
  <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
12
 
 
17
  <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
18
 
19
  ***
20
+ # Llama 3 Lumimaid V0.1 8B
21
  - **Creator:** [NeverSleep](https://huggingface.co/NeverSleep/)
22
+ - **Original:** [Llama 3 Lumimaid V0.1 8B](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1)
23
  - **Date Created:** 2024-04-30
24
  - **Trained Context:** 8192 tokens
25
  - **Description:** RP model from Undi based on Llama3, which incorporates the Luminae dateset from Ikari. It tries to strike a balance between erotic and non-erotic RP, while being entirely uncensored.