Kooten
/

DaringLotus-5bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Kooten commited on Jan 16

Commit

1e5c755

•

1 Parent(s): a7af2fd

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -11,9 +11,9 @@ tags:
 ## Description
 EXL2 quant of [BlueNipples/DaringLotus-10.7B](https://huggingface.co/BlueNipples/DaringLotus-10.7B)
--6bpw should be comfortable on 12 gb with 8k context
--4bpw might just fit on 8gb of vram at 4k context
-if yo have more ram get the 8bpw
 ## Other quants:

 ## Description
 EXL2 quant of [BlueNipples/DaringLotus-10.7B](https://huggingface.co/BlueNipples/DaringLotus-10.7B)
+- 6bpw should be comfortable on 12 gb with 8k context
+- 4bpw might just fit on 8gb of vram at 4k context
+- if you have more ram get the 8bpw
 ## Other quants: