File size: 1,006 Bytes
4868842 |
1 2 3 4 5 |
/scratch3/workspace/ctpham_umass_edu-ft/envs/prolong-final/lib/python3.10/site-packages/torch/utils/checkpoint.py:1399: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead.
with device_autocast_ctx, torch.cpu.amp.autocast(**cpu_autocast_kwargs), recompute_context: # type: ignore[attr-defined]
[INFO|trainer.py:175] 2024-12-31 10:01:50,057 >> {'loss': 1.4933, 'grad_norm': 33.300479888916016, 'learning_rate': 5.405405405405406e-09, 'epoch': 0.00027122321670735016, 'num_input_tokens_seen': 2097152, 'completed': '0.03% (1 / 3_687)', 'remaining time': '49:07:09', 'throughput': '2732.19', 'gpu_mem_free': '5581MB'}
[INFO|trainer.py:175] 2024-12-31 10:02:25,461 >> {'loss': 1.6295, 'grad_norm': 35.11330795288086, 'learning_rate': 1.0810810810810811e-08, 'epoch': 0.0005424464334147003, 'num_input_tokens_seen': 4194304, 'completed': '0.05% (2 / 3_687)', 'remaining time': '42:40:22', 'throughput': '7404.33', 'gpu_mem_free': '5581MB'}
|