RMU: https://arxiv.org/pdf/2403.03218
extend the discoveries https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • Updated • 4 -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • Updated • 24 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • Updated • 5 -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • Updated • 6