deepseek-ai

/

DeepSeek-R1-Distill-Qwen-1.5B

like 262

Follow

DeepSeek 9.31k

These values does not make sense to me.

{
  "max_position_embeddings": 131072,
  "rope_theta": 10000,
  "sliding_window": 4096,
}