Spaces:

ggml-org
/

gguf-my-repo

Running on A10G

reach-vb HF staff commited on Jun 11, 2024

Commit

7ba4a24

verified ·

1 Parent(s): 4c4c78d

Update start.sh

Files changed (1) hide show

start.sh CHANGED Viewed

@@ -1,5 +1,5 @@
 cd llama.cpp
-make -j quantize gguf-split imatrix
 cd ..
 python app.py

 cd llama.cpp
+LLAMA_CUDA=1 make -j quantize gguf-split imatrix
 cd ..
 python app.py