Hugging Face's logo
Lance's picture
26 5

Lance

clevnumb
21world's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity 21 days ago
unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF:Error loading on lm-studio
new activity 2 months ago
TheDrummer/Cydonia-22B-v1.3:What context size when using a 24GB VRAM card (4090) is best?
new activity 7 months ago
anthracite-org/magnum-v2-32b-exl2:Which Quant of this model will fit in VRAM entirely on a single 24GB video card (4090)
View all activity

Organizations

None yet

clevnumb's activity

New activity in unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF 21 days ago

Error loading on lm-studio

4
#1 opened about 1 month ago by
victor-Des
New activity in TheDrummer/Cydonia-22B-v1.3 2 months ago

What context size when using a 24GB VRAM card (4090) is best?

3
#1 opened 3 months ago by
clevnumb
New activity in anthracite-org/magnum-v2-32b-exl2 7 months ago

Which Quant of this model will fit in VRAM entirely on a single 24GB video card (4090)

3
#1 opened 7 months ago by
clevnumb
New activity in NeverSleep/Lumimaid-v0.2-12B 7 months ago

My alternate quantizations.

5
#3 opened 7 months ago by
ZeroWw
liked a model 7 months ago
New activity in bullerwins/Big-Tiger-Gemma-27B-v1-exl2_5.0bpw 7 months ago

Not loading in Latest Tabby (with SillyTavern) - ERROR

2
#2 opened 7 months ago by
clevnumb
New activity in BigHuggyD/alpindale_magnum-72b-v1_exl2_4.0bpw_h8 8 months ago

what quant should I use to use this with a single 24GB video card (PC) (4090 card)?

1
#2 opened 8 months ago by
clevnumb
New activity in bartowski/WizardLM-2-8x22B-GGUF 8 months ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

3
#3 opened 8 months ago by
clevnumb
liked a model 9 months ago
New activity in AzureBlack/PsyMedRP-v1-20B-8bpw-8h-exl2 9 months ago

Single 4090 using OogaBooga? (Windows 11, 96GB of RAM)

1
#1 opened about 1 year ago by
clevnumb
liked 2 models 11 months ago
New activity in jondurbin/bagel-20b-v04 11 months ago

How do I load this in OogaBooga? (text-generation-webui)
#1 opened 11 months ago by
clevnumb
New activity in Wanlau/RVC_datealive 11 months ago

Where do I install these in my install of RVC Webui to they show up as 'inferencing voice' options to select? Somewhere in ASSETS folder? Where?

1
#1 opened 11 months ago by
clevnumb
New activity in LoneStriker/miquella-120b-3.0bpw-h6-exl2 12 months ago

Will any 120b model currently fit on a single 24GB VRAM card through any app I can run on PC? (aka 4090)

15
#1 opened about 1 year ago by
clevnumb
New activity in supersonic013/Promptmaster-mistral-7b-GGUF 12 months ago

What is the difference between this model and Electrofried/Promptmaster-Mistral-7B-v1-GGUF (which is larger, but older)
#1 opened 12 months ago by
clevnumb
New activity in h94/IP-Adapter-FaceID 12 months ago

Are there safetensor files for the models?

7
#37 opened about 1 year ago by
wonderflex
New activity in LoneStriker/goliath-120b-2.18bpw-h6-exl2 12 months ago

Will this fit on a single 24GB Video card (4090)?

1
#2 opened 12 months ago by
clevnumb
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 12 months ago

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

2
#2 opened 12 months ago by
clevnumb
New activity in miqudev/miqu-1-70b 12 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

1
#30 opened 12 months ago by
clevnumb