Hadeel11 commited on
Commit
d7c7a6c
1 Parent(s): a2dae26

Add Dockerfile for Hugging Face deployment

Browse files
Files changed (2) hide show
  1. Dockerfile +16 -0
  2. Dockerfile.txt +16 -0
Dockerfile ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ FROM huggingface/transformers-pytorch-gpu:latest
3
+
4
+
5
+ RUN pip install --upgrade pip
6
+ RUN pip install transformers
7
+
8
+
9
+ ENV MODEL_NAME="Hadeel11/your-finetuned-model"
10
+ ENV USE_FP16=True
11
+
12
+ Expose the port for the inference API
13
+ EXPOSE 8080
14
+
15
+ Run the TGI server
16
+ CMD ["python3", "-m", "transformers_serve", "--model-id", "${MODEL_NAME}"]
Dockerfile.txt ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ FROM huggingface/transformers-pytorch-gpu:latest
3
+
4
+
5
+ RUN pip install --upgrade pip
6
+ RUN pip install transformers
7
+
8
+
9
+ ENV MODEL_NAME="Hadeel11/your-finetuned-model"
10
+ ENV USE_FP16=True
11
+
12
+ Expose the port for the inference API
13
+ EXPOSE 8080
14
+
15
+ Run the TGI server
16
+ CMD ["python3", "-m", "transformers_serve", "--model-id", "${MODEL_NAME}"]