Spaces:

limcheekin
/

orca_mini_v3_13B-GGML

Paused

limcheekin commited on Aug 14, 2023

Commit

12be50e

1 Parent(s): ac36b1f

chore: reverted model download link, confirmed that ggml model size cannot greater than 10GB

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -15,7 +15,7 @@ RUN pip install -U pip setuptools wheel && \
 # Download model
 RUN mkdir model && \
-    curl -L https://huggingface.co/TheBloke/orca_mini_v3_13B-GGML/resolve/main/orca_mini_v3_13b.ggmlv3.q6_K.bin -o model/ggmlv3-model.bin
 COPY ./start_server.sh ./start_server.sh

 # Download model
 RUN mkdir model && \
+    curl -L https://huggingface.co/TheBloke/orca_mini_v3_13B-GGML/resolve/main/orca_mini_v3_13b.ggmlv3.q5_K_S.bin -o model/ggmlv3-model.bin
 COPY ./start_server.sh ./start_server.sh