New discussion

vllm support

#16 opened about 6 hours ago by gertrud

Model OS Error

3
#10 opened about 1 month ago by bshobhit67

Examples of fine-tuning code?

5
#7 opened about 2 months ago by gertrud

VRAM - how to run

2
#6 opened about 2 months ago by SinanAkkoyun

RTX 3090 24GB working with extra env var

5
#4 opened about 2 months ago by cktlco

How to run it on a mobile device?

2
#1 opened about 2 months ago by KoiSikhaDo