Fix Slowness and Stuck Issues with Long Inputs
#8
by
NA-Wen
- opened
The issue arises when the model is provided with long input sequences (~ 64k string length), which can lead to significant performance degradation. Specifically, the system may experience slower processing times or, in some cases, may even freeze or get stuck entirely.