Broadcasting error if "num_return_sequences" in transformers pipeline is greater than 1

#29

by OSalem99 - opened Jul 14

Jul 14

I came across the following error once I increase the number of "num_return_sequences" to any value greater then 1. Any idea?
"RuntimeError: shape mismatch: value tensor of shape [32, 8, 612, 256] cannot be broadcast to indexing result of shape [16, 8, 612, 256]"

Renu11

Google org 25 days ago

Hi @OSalem99 , Could you please try again by updating the transformers version to the latest one using !pip install -U transformers or can share the reproducible code to replicate the error if the issue still persists. Thank you.

OSalem99

25 days ago

Hi @Renu11 ,
That would work indeed, the problem was fixed in PR #3216.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment