Anyone facing issues deploying this model on Sagemaker

by genzml - opened Jun 23, 2023

Jun 23, 2023

I am using ml.g5.12xlarge instance to deploy. The model deployments fails during health checks with the below error

sagemaker.exceptions.UnexpectedStatusException: Error hosting endpoint huggingface-pytorch-tgi-inference-2023-06-22-22-26-05-836: Failed. Reason: The primary container for production variant AllTraffic did not pass the ping health check. Please check CloudWatch logs for this endpoint..

psinger

H2O.ai org Jun 23, 2023

Hi @genzml - unfortunately I have no experience with sagemaker. Might be good to check with them to see if they know what's up.

psinger changed discussion status to closed Jul 3, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment