PMBeta

Paused

Sergidev commited on Jul 18

Commit

626324b

•

1 Parent(s): 417b8dc

Update modules/pmbl.py

Files changed (1) hide show

modules/pmbl.py CHANGED Viewed

@@ -111,6 +111,8 @@ class PMBL:
             stop=["</s>", "\nUser:", "\nuser:", "\nSystem:", "\nsystem:"],
             echo=False,
             stream=True
         )
         response_text = ""

             stop=["</s>", "\nUser:", "\nuser:", "\nSystem:", "\nsystem:"],
             echo=False,
             stream=True
+            use_flash_attn=True
+            mlock=True,
         )
         response_text = ""