fixes https://github.com/THUDM/GLM-4/issues/22 (#5)

- Update modeling_chatglm.py (7122f9503a0d915971b96adad7efad64e3609177)


Co-authored-by: Yaowei Zheng <[email protected]>

modeling_chatglm.py

@@ -624,7 +624,7 @@ class GLMTransformer(torch.nn.Module):
                     if len(presents) == 0:
                         presents = kv_cache
                     else:
-                        presents = torch.cat((presents, kv_cache), dim=0)
+                        presents = torch.cat((presents, kv_cache.to(presents.device)), dim=0)
 
         if output_hidden_states:
             all_hidden_states = all_hidden_states + (hidden_states,)