jpohhhh
/

msmarco-MiniLM-L-6-v3_onnx

sentence-embeddings

endpoints-template

Inference Endpoints

Model card Files Files and versions Community

jpohhhh commited on Jun 21, 2023

Commit

76f4690

·

1 Parent(s): 1b181eb

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -28,7 +28,7 @@ class EndpointHandler():
         """
         sentences = data.pop("inputs",data)
         # inputs = tokenizer("I love burritos!", return_tensors="pt")
-        pred = onnx_extractor(sentences)
         return pred
         # Perform pooling. In this case, max pooling.
         # sentence_embeddings = mean_pooling(model_output, encoded_input['attention_mask'])

         """
         sentences = data.pop("inputs",data)
         # inputs = tokenizer("I love burritos!", return_tensors="pt")
+        pred = self.onnx_extractor(sentences)
         return pred
         # Perform pooling. In this case, max pooling.
         # sentence_embeddings = mean_pooling(model_output, encoded_input['attention_mask'])