seen_tokens and get_max_length depriciated

by singleffabric - opened 5 days ago

←

5 days ago

The seen_tokens attribute is deprecated and will be removed in v4.41. Use the cache_position model input instead.
AttributeError: 'DynamicCache' object has no attribute 'get_max_length'

past_length = past_key_values.cache_position
max_cache_length = past_key_values.get_max_cache_shape()

4 days ago

I my case (transformers v4.49) this one worked:

            past_length = past_key_values.seen_tokens
            max_cache_length = past_key_values.get_max_cache_shape()

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment