Hugging Face's logo

distily
/
distily_validate_extra_grad_stats

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
659e317
•
1 Parent(s): 4ee8921

Training in progress, step 2475

Browse files
Files changed (5) hide show
  1. logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=False, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/completed.flag +0 -0
  2. logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=False, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1725294179.261a4d6fb516 +2 -2
  3. logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=True, learning_rate=0.0001, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1725294919.261a4d6fb516 +3 -0
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=False, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/completed.flag ADDED
File without changes
logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=False, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1725294179.261a4d6fb516 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:173bdaac55f39183a3bd4b53181ca18f8b92020a9366a794a7418fb9e6a7219b
3
- size 249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ed0c931f95cccda67eb603772446cf0ee9c78e861c035b116ee0716e1d856e6
3
+ size 520
logs/attn_projector=orthogonal, attn_weight=5, extra_grad_stats=True, learning_rate=0.0001, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1725294919.261a4d6fb516 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fa3f972e456f2aac8f91089decb79c5f3c7f063ee0d91d4501cd09424de62da
3
+ size 90203
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c36b271745f9449de92e62983ae4ad78537022a49fb9547bbbdb224ee5313a64
3
  size 163832792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc09845ff81158e95000fb8609ba157113cda0eb0f245dd4fe6970759afe2b3c
3
  size 163832792
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c222a0defde32e2cd1e21d4a8aaf9c7c6fd922d367b52946d9ed734f8f411bf
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b236f0a9573c281bdbe2ed543558bc28ae43319aefc0fe8fab59f3ec4ab0a69a
3
  size 5496