distily
/

distily_validate_extra_grad_stats4

Generated from Trainer

Model card Files Files and versions Metrics Training metrics Community

distily_validate_extra_grad_stats4 / logs

1 contributor

History: 2 commits

lapp0's picture

End of training

53337f6 verified 3 months ago

attn_projector=orthogonal, attn_weight=5, extra_grad_stats=True, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0
End of training 3 months ago