2025-01-20 21:45:49,926 INFO monitor.py:688 -- Starting monitor using ray installation: /usr/local/lib/python3.10/dist-packages/ray/__init__.py 2025-01-20 21:45:49,926 INFO monitor.py:689 -- Ray version: 2.40.0 2025-01-20 21:45:49,926 INFO monitor.py:690 -- Ray commit: 22541c38dbef25286cd6d19f1c151bf4fd62f2ed 2025-01-20 21:45:49,926 INFO monitor.py:691 -- Monitor started with command: ['/usr/local/lib/python3.10/dist-packages/ray/autoscaler/_private/monitor.py', '--logs-dir=/tmp/ray/session_2025-01-20_21-45-49_032563_3836/logs', '--logging-rotate-bytes=536870912', '--logging-rotate-backup-count=5', '--gcs-address=192.168.0.2:53866', '--monitor-ip=192.168.0.2'] 2025-01-20 21:45:49,945 INFO monitor.py:159 -- session_name: session_2025-01-20_21-45-49_032563_3836 2025-01-20 21:45:49,947 INFO monitor.py:191 -- Starting autoscaler metrics server on port 44217 2025-01-20 21:45:49,949 INFO monitor.py:216 -- Monitor: Started 2025-01-20 21:45:49,966 INFO autoscaler.py:280 -- disable_node_updaters:False 2025-01-20 21:45:49,966 INFO autoscaler.py:288 -- disable_launch_config_check:True 2025-01-20 21:45:49,966 INFO autoscaler.py:300 -- foreground_node_launch:False 2025-01-20 21:45:49,966 INFO autoscaler.py:310 -- worker_liveness_check:True 2025-01-20 21:45:49,966 INFO autoscaler.py:318 -- worker_rpc_drain:True 2025-01-20 21:45:49,968 INFO autoscaler.py:368 -- StandardAutoscaler: {'cluster_name': 'default', 'max_workers': 0, 'upscaling_speed': 1.0, 'docker': {}, 'idle_timeout_minutes': 0, 'provider': {'type': 'readonly', 'use_node_id_as_ip': True, 'disable_launch_config_check': True}, 'auth': {}, 'available_node_types': {'ray.head.default': {'resources': {}, 'node_config': {}, 'max_workers': 0}}, 'head_node_type': 'ray.head.default', 'file_mounts': {}, 'cluster_synced_files': [], 'file_mounts_sync_continuously': False, 'rsync_exclude': [], 'rsync_filter': [], 'initialization_commands': [], 'setup_commands': [], 'head_setup_commands': [], 'worker_setup_commands': [], 'head_start_ray_commands': [], 'worker_start_ray_commands': []} 2025-01-20 21:45:49,972 INFO monitor.py:383 -- Autoscaler has not yet received load metrics. Waiting. 2025-01-20 21:45:54,983 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:45:54,984 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:45:54.984192 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:45:54,987 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:45:59,999 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:00,000 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:00.000422 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:00,003 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:05,016 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:05,017 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:05.016942 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:05,019 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:10,031 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:10,032 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:10.032376 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:10,034 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:46:15,043 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:15,044 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:15.044726 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:15,047 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:20,060 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:20,061 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:20.061626 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:20,064 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:25,077 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:25,078 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:25.078364 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:25,081 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:30,092 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:30,093 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:30.092862 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:30,095 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:35,105 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:35,106 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:35.106039 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:35,108 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:46:40,119 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:40,120 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:40.119859 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:40,122 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:46:45,134 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:45,135 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:45.135726 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:45,138 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:46:50,150 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:50,151 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:50.151003 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:50,153 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:46:55,166 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:46:55,167 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:46:55.167078 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:46:55,169 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:47:00,181 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:00,182 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:00.182292 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:00,184 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:05,195 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:05,196 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:05.195982 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:05,198 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:10,210 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:10,211 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:10.211337 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 9.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:10,214 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:47:15,226 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:15,227 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:15.227440 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:15,229 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:20,239 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:20,240 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:20.240084 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:20,242 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:25,251 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:25,252 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:25.252312 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:25,254 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:30,263 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:30,264 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:30.264122 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:30,266 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:35,279 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:35,280 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:35.280139 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:35,282 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:47:40,296 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:40,296 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:40.296765 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 6.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:40,299 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:47:45,312 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:45,312 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:45.312691 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 4.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:45,315 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:47:50,322 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:50,323 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:50.323052 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 3.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:50,324 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:47:55,336 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:47:55,337 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:47:55.337472 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:47:55,340 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:48:00,351 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:00,351 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:00.351723 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:00,353 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:05,364 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:05,365 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:05.365392 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:05,367 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:48:10,378 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:10,379 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:10.379004 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:10,381 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:15,391 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:15,392 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:15.392091 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:15,394 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:20,403 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:20,404 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:20.404045 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:20,406 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:25,414 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:25,415 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:25.414961 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:25,416 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:30,423 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:30,424 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:30.424008 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:30,426 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:35,435 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:35,436 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:35.436443 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:35,438 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:40,449 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:40,450 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:40.450077 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:40,451 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:48:45,459 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:45,460 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:45.459891 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:45,462 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:50,470 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:50,471 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:50.471663 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:50,473 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:48:55,486 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:48:55,487 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:48:55.487537 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:48:55,490 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:00,498 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:00,498 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:00.498863 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:00,500 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:49:05,511 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:05,512 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:05.512126 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:05,514 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:10,524 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:10,525 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:10.524953 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:10,527 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:49:15,535 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:15,536 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:15.536499 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:15,539 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:20,551 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:20,552 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:20.552294 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:20,555 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:49:25,566 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:25,566 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:25.566428 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:25,567 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:49:30,578 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:30,579 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:30.579493 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:30,582 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:49:35,593 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:35,594 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:35.594412 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:35,596 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:40,603 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:40,604 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:40.604378 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:40,607 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:45,619 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:45,620 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:45.620538 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:45,622 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:49:50,633 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:50,633 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:50.633524 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:50,635 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:49:55,642 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:49:55,643 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:49:55.643057 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 9.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:49:55,645 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:50:00,654 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:00,655 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:00.655457 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 9.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:00,657 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:05,666 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:05,667 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:05.667200 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:05,669 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:50:10,679 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:10,680 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:10.679955 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:10,682 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:15,691 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:15,691 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:15.691669 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:15,694 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:20,703 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:20,704 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:20.703866 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:20,706 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:25,715 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:25,715 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:25.715681 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 4.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:25,718 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:30,728 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:30,729 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:30.729322 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 2.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:30,731 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:50:35,742 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:35,743 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:35.743366 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:35,745 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:40,755 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:40,756 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:40.756498 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:40,759 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:45,766 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:45,767 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:45.767352 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:45,769 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:50,780 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:50,781 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:50.780830 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:50,782 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:50:55,791 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:50:55,791 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:50:55.791470 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:50:55,792 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:51:00,803 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:00,804 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:00.804289 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:00,807 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:51:05,819 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:05,820 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:05.819811 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:05,822 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:10,833 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:10,833 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:10.833669 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:10,836 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:15,846 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:15,847 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:15.847447 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:15,849 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:20,860 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:20,861 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:20.861459 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:20,863 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:25,876 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:25,877 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:25.876801 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:25,879 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:51:30,892 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:30,893 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:30.893019 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:30,895 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:51:35,908 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:35,909 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:35.909294 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:35,911 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:40,923 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:40,924 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:40.924657 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:40,927 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:51:45,940 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:45,941 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:45.940814 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:45,943 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:51:50,956 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:50,956 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:50.956639 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:50,959 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:51:55,971 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:51:55,972 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:51:55.972422 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:51:55,975 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:00,988 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:00,989 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:00.989069 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:00,991 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:06,003 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:06,004 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:06.004626 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:06,007 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:52:11,020 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:11,021 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:11.020807 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:11,023 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:16,036 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:16,037 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:16.037426 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:16,040 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:21,051 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:21,052 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:21.052550 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:21,055 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:52:26,068 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:26,069 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:26.068998 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:26,071 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:31,084 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:31,085 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:31.085676 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:31,088 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:36,101 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:36,102 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:36.102404 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:36,105 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:41,116 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:41,117 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:41.117460 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:41,120 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:52:46,132 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:46,133 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:46.133018 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:46,135 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:52:51,146 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:51,147 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:51.147124 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:51,149 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:52:56,160 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:52:56,161 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:52:56.160966 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:52:56,163 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:01,173 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:01,174 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:01.174322 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:01,176 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:06,187 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:06,188 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:06.188221 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:06,190 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:11,202 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:11,203 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:11.202984 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:11,205 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:53:16,216 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:16,217 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:16.217135 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:16,219 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:21,232 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:21,232 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:21.232690 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:21,235 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:53:26,247 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:26,248 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:26.248549 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:26,251 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:31,263 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:31,264 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:31.264539 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:31,267 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:53:36,275 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:36,276 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:36.276268 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:36,278 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:41,290 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:41,291 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:41.291201 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:41,293 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:46,304 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:46,305 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:46.305305 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:46,307 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:51,317 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:51,318 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:51.318264 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:51,320 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:53:56,331 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:53:56,332 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:53:56.331940 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:53:56,334 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:01,342 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:01,343 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:01.343220 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:01,344 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:54:06,355 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:06,356 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:06.356530 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:06,359 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:11,370 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:11,370 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:11.370708 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:11,372 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:16,383 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:16,384 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:16.384204 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:16,386 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:21,394 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:21,394 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:21.394312 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:21,395 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:54:26,403 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:26,404 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:26.404106 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:26,406 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:31,414 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:31,414 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:31.414637 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:31,416 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:36,429 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:36,429 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:36.429728 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:36,432 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:41,444 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:41,445 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:41.445643 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:41,448 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:46,459 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:46,460 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:46.460466 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:46,463 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:54:51,476 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:51,476 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:51.476655 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:51,479 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:54:56,493 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:54:56,493 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:54:56.493742 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:54:56,496 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:01,509 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:01,510 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:01.510442 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:01,513 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:06,526 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:06,527 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:06.526848 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:06,529 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:11,542 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:11,543 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:11.543568 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:11,546 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:16,555 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:16,556 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:16.556488 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:16,559 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:55:21,571 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:21,572 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:21.572462 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:21,575 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:26,587 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:26,588 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:26.588507 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:26,591 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:31,603 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:31,603 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:31.603586 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:31,605 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:55:36,617 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:36,617 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:36.617777 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:36,620 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:55:41,633 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:41,634 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:41.633965 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:41,636 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:55:46,646 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:46,647 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:46.647560 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:46,650 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:55:51,659 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:51,660 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:51.660401 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:51,662 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:55:56,671 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:55:56,672 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:55:56.672284 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:55:56,674 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:01,683 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:01,684 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:01.684135 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:01,686 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:06,695 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:06,696 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:06.696571 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:06,699 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:11,707 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:11,707 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:11.707698 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:11,710 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:16,719 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:16,720 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:16.720542 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:16,723 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:21,734 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:21,735 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:21.735038 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:21,737 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:26,747 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:26,748 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:26.747846 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:26,749 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:31,758 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:31,758 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:31.758822 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:31,760 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:56:36,771 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:36,772 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:36.772688 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:36,775 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:41,785 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:41,786 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:41.786599 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:41,789 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:56:46,801 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:46,802 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:46.802147 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:46,804 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:51,817 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:51,818 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:51.817985 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:51,820 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:56:56,831 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:56:56,832 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:56:56.832295 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:56:56,834 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:01,847 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:01,848 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:01.847907 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:01,850 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:06,859 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:06,860 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:06.860420 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:06,862 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:11,870 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:11,871 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:11.870886 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:11,872 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:16,883 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:16,884 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:16.883896 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:16,885 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:57:21,896 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:21,897 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:21.897037 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:21,899 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:57:26,911 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:26,912 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:26.912424 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:26,915 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:31,923 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:31,924 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:31.923919 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:31,926 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:57:36,935 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:36,936 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:36.936371 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:36,939 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:57:41,947 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:41,949 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:41.948759 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:41,951 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:57:46,961 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:46,962 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:46.962679 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:46,965 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:57:51,975 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:51,976 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:51.976569 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:51,979 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:57:56,992 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:57:56,993 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:57:56.992962 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:57:56,995 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:02,007 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:02,008 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:02.008695 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:02,011 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:07,024 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:07,025 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:07.025428 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 7.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:07,028 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:58:12,039 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:12,040 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:12.040521 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 6.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:12,043 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:58:17,055 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:17,056 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:17.055849 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 5.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:17,058 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:22,071 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:22,072 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:22.072069 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 4.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:22,074 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:58:27,087 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:27,088 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:27.088031 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:27,090 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:32,103 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:32,104 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:32.104253 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:32,106 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:58:37,115 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:37,116 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:37.116296 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:37,119 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:42,132 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:42,133 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:42.133014 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:42,135 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:47,148 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:47,149 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:47.148906 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:47,151 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:58:52,164 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:52,165 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:52.165285 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:52,168 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:58:57,180 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:58:57,181 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:58:57.180986 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:58:57,183 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:59:02,192 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:02,193 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:02.193243 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:02,195 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:59:07,208 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:07,209 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:07.209099 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:07,211 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:59:12,223 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:12,224 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:12.224283 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:12,226 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:59:17,239 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:17,240 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:17.240355 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:17,243 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:59:22,254 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:22,255 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:22.255359 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:22,256 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:59:27,267 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:27,267 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:27.267527 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:27,269 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:59:32,278 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:32,279 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:32.279360 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:32,281 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 21:59:37,292 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:37,292 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:37.292693 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:37,294 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 21:59:42,306 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:42,307 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:42.307163 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:42,309 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:59:47,323 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:47,324 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:47.323830 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:47,326 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:59:52,339 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:52,340 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:52.340677 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:52,343 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 21:59:57,356 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 21:59:57,357 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 21:59:57.356971 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 21:59:57,359 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:02,371 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:02,372 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:02.372432 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:02,374 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:07,387 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:07,388 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:07.387909 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:07,390 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:12,403 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:12,404 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:12.403952 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:12,406 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:17,419 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:17,419 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:17.419776 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:17,421 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:22,433 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:22,434 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:22.433953 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:22,436 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:27,449 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:27,449 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:27.449693 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:27,452 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:32,468 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:32,469 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:32.469060 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:32,471 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:00:37,483 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:37,484 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:37.484639 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:37,487 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:00:42,500 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:42,500 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:42.500697 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:42,503 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:00:47,515 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:47,516 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:47.516622 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:47,519 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:00:52,531 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:52,532 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:52.532623 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:52,535 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:00:57,546 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:00:57,547 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:00:57.547144 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:00:57,549 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:02,560 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:02,561 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:02.561523 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:02,564 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:07,577 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:07,577 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:07.577745 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:07,580 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:01:12,591 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:12,592 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:12.592575 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:12,595 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:01:17,608 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:17,609 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:17.609039 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:17,611 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:22,622 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:22,623 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:22.623530 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:22,626 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:01:27,639 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:27,640 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:27.639939 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:27,642 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:01:32,655 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:32,656 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:32.655813 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:32,658 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:37,667 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:37,667 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:37.667771 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:37,670 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:42,679 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:42,680 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:42.680438 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:42,683 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:47,691 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:47,692 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:47.691905 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:47,694 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:52,703 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:52,704 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:52.704074 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:52,706 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:01:57,718 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:01:57,719 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:01:57.719477 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:01:57,722 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:02,731 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:02,732 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:02.732411 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:02,735 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:07,747 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:07,748 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:07.747902 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:07,750 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:12,761 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:12,761 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:12.761553 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:12,763 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:17,772 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:17,773 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:17.773165 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:17,775 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:02:22,787 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:22,788 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:22.788568 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:22,791 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:27,803 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:27,804 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:27.804423 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:27,807 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:32,815 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:32,816 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:32.816429 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:32,819 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:02:37,827 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:37,828 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:37.828621 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:37,831 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:42,843 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:42,844 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:42.844524 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:42,847 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:02:47,862 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:47,863 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:47.863734 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:47,866 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:02:52,877 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:52,878 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:52.878634 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:52,881 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:02:57,894 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:02:57,895 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:02:57.895113 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:02:57,897 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:02,910 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:02,911 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:02.910878 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:02,913 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:07,924 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:07,924 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:07.924572 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:07,927 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:12,939 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:12,940 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:12.940150 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:12,942 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:17,954 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:17,955 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:17.955317 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:17,957 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:22,967 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:22,968 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:22.968310 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:22,970 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:27,983 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:27,984 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:27.984076 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:27,986 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:03:32,995 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:32,996 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:32.996267 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:32,998 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:38,010 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:38,011 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:38.011009 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:38,013 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:43,023 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:43,024 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:43.024367 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:43,026 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:48,035 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:48,036 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:48.036560 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:48,038 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:53,046 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:53,047 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:53.047232 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:53,049 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:03:58,057 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:03:58,058 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:03:58.058294 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:03:58,061 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:04:03,074 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:03,075 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:03.074826 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:03,077 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:08,088 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:08,089 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:08.088789 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:08,091 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:13,104 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:13,104 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:13.104732 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:13,107 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:04:18,116 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:18,117 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:18.117240 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:18,120 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:23,132 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:23,132 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:23.132780 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:23,135 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:28,147 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:28,147 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:28.147501 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:28,149 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:04:33,159 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:33,160 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:33.160000 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:33,161 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:04:38,171 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:38,172 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:38.172583 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:38,175 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:43,188 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:43,189 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:43.189033 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:43,192 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:48,205 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:48,206 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:48.206132 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:48,209 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:53,220 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:53,221 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:53.220841 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:53,223 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:04:58,236 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:04:58,237 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:04:58.237192 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:04:58,240 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:05:03,251 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:03,252 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:03.252278 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:03,254 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:08,267 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:08,268 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:08.268207 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:08,271 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:05:13,283 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:13,284 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:13.284329 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:13,287 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:05:18,296 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:18,297 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:18.297598 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:18,300 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:23,312 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:23,313 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:23.313112 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:23,315 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:28,327 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:28,328 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:28.328632 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:28,331 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:05:33,344 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:33,344 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:33.344704 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:33,347 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:38,360 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:38,360 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:38.360645 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:38,363 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:05:43,376 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:43,377 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:43.376919 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:43,379 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:48,391 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:48,392 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:48.392293 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:48,394 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:53,403 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:53,403 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:53.403621 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:53,405 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:05:58,416 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:05:58,417 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:05:58.417144 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:05:58,419 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:03,431 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:03,432 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:03.432101 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:03,434 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:08,443 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:08,444 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:08.444023 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:08,446 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:13,455 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:13,456 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:13.456585 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:13,459 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:18,467 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:18,468 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:18.468189 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:18,470 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:23,482 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:23,483 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:23.482849 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:23,485 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:28,497 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:28,498 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:28.498464 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:28,501 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:33,513 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:33,514 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:33.514163 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:33,517 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:06:38,526 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:38,527 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:38.527242 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:38,530 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:06:43,542 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:43,543 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:43.542912 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:43,545 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:48,555 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:48,556 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:48.556525 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:48,558 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:53,567 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:53,567 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:53.567757 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:53,570 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:06:58,582 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:06:58,583 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:06:58.582917 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:06:58,585 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:03,596 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:03,597 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:03.597299 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:03,599 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:08,610 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:08,611 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:08.611265 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:08,613 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:13,625 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:13,626 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:13.626565 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:13,629 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:18,642 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:18,643 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:18.643372 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:18,646 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:23,658 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:23,660 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:23.659831 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:23,662 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:28,674 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:28,675 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:28.674993 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:28,677 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:33,690 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:33,691 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:33.691031 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:33,694 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:38,706 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:38,707 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:38.707472 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:38,709 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:07:43,722 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:43,723 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:43.722832 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:43,725 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:48,736 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:48,737 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:48.736984 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:48,739 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:53,752 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:53,753 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:53.753159 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:53,756 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:07:58,765 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:07:58,766 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:07:58.765997 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:07:58,768 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:03,778 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:03,780 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:03.779254 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:03,782 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:08:08,790 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:08,791 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:08.791196 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:08,793 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:13,802 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:13,803 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:13.802824 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:13,805 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:08:18,818 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:18,819 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:18.819075 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:18,821 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:23,833 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:23,834 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:23.834118 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:23,836 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:28,848 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:28,849 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:28.849161 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:28,850 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:08:33,862 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:33,863 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:33.863673 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:33,866 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:38,878 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:38,879 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:38.879185 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:38,881 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:43,891 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:43,892 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:43.892348 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:43,895 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:48,903 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:48,904 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:48.904286 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:48,906 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:08:53,918 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:53,919 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:53.919613 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:53,922 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:08:58,932 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:08:58,933 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:08:58.932967 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:08:58,935 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:03,947 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:03,948 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:03.948319 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:03,950 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:08,962 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:08,963 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:08.963579 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:08,965 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:13,974 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:13,975 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:13.975201 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:13,976 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:09:18,987 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:18,988 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:18.988527 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:18,990 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:23,999 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:23,999 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:23.999677 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:24,002 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:29,009 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:29,010 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:29.009870 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:29,012 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:34,023 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:34,024 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:34.024196 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:34,026 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:39,037 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:39,037 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:39.037654 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:39,040 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:09:44,053 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:44,054 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:44.054000 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:44,056 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:09:49,067 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:49,068 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:49.068463 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:49,071 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:09:54,084 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:54,085 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:54.085012 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:54,088 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:09:59,100 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:09:59,101 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:09:59.101449 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:09:59,104 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:04,116 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:04,116 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:04.116657 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:04,119 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:09,132 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:09,132 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:09.132687 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:09,135 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:14,146 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:14,147 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:14.147149 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:14,149 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:19,161 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:19,162 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:19.162144 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:19,165 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:10:24,175 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:24,176 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:24.176319 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:24,178 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:29,185 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:29,186 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:29.186383 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:29,188 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:10:34,194 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:34,195 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:34.195196 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:34,197 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:10:39,206 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:39,207 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:39.207206 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:39,209 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:10:44,220 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:44,221 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:44.221095 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:44,223 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:10:49,236 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:49,237 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:49.236797 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:49,239 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:10:54,251 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:54,252 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:54.252413 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:54,255 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:10:59,268 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:10:59,268 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:10:59.268733 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:10:59,271 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:04,282 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:04,283 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:04.283149 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:04,285 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:09,296 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:09,297 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:09.297045 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:09,299 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:14,307 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:14,308 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:14.307997 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:14,309 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:11:19,320 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:19,320 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:19.320781 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:19,323 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:11:24,336 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:24,336 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:24.336836 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:24,338 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:11:29,350 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:29,351 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:29.351407 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:29,354 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:11:34,366 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:34,367 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:34.366949 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:34,369 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:39,379 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:39,380 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:39.380304 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:39,382 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:44,393 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:44,393 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:44.393595 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:44,395 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:49,407 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:49,407 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:49.407789 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:49,410 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:11:54,419 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:54,420 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:54.420643 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:54,423 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:11:59,434 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:11:59,435 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:11:59.435016 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:11:59,437 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:04,447 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:04,448 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:04.447822 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:04,449 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:09,460 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:09,460 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:09.460740 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:09,462 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:12:14,474 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:14,475 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:14.475180 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:14,478 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:12:19,490 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:19,491 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:19.491108 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:19,493 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:24,504 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:24,505 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:24.505468 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:24,507 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:29,518 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:29,519 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:29.519041 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:29,521 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:34,532 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:34,533 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:34.532892 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:34,535 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:39,545 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:39,546 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:39.546231 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:39,548 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:12:44,560 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:44,561 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:44.561278 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 3.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:44,564 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:49,575 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:49,576 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:49.575804 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:49,577 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:54,588 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:54,589 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:54.589150 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:54,591 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:12:59,600 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:12:59,601 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:12:59.601168 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:12:59,603 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:04,611 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:04,612 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:04.611844 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:04,614 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:09,625 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:09,626 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:09.626443 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:09,628 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:14,638 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:14,639 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:14.639455 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:14,641 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:19,651 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:19,652 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:19.652229 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:19,654 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:24,665 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:24,665 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:24.665654 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:24,667 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:29,679 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:29,680 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:29.679956 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:29,682 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:34,694 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:34,695 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:34.695090 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:34,697 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:13:39,709 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:39,710 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:39.710332 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:39,712 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:44,723 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:44,723 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:44.723708 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:44,725 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:49,736 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:49,737 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:49.737240 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:49,739 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:54,750 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:54,750 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:54.750726 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:54,753 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:13:59,762 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:13:59,763 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:13:59.763039 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:13:59,764 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:14:04,774 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:04,775 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:04.775410 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:04,778 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:09,788 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:09,789 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:09.789561 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:09,791 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:14,798 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:14,799 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:14.799276 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:14,801 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:19,811 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:19,811 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:19.811491 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:19,813 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:14:24,824 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:24,825 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:24.825012 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:24,827 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:29,838 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:29,839 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:29.839118 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:29,840 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:14:34,849 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:34,850 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:34.850281 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:34,852 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:39,863 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:39,864 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:39.864378 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:39,866 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:44,879 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:44,880 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:44.880097 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:44,882 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:49,890 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:49,890 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:49.890772 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:49,892 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:14:54,899 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:54,900 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:54.900133 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:54,902 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:14:59,914 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:14:59,915 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:14:59.915439 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:14:59,918 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:15:04,929 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:04,930 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:04.930341 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:04,932 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:09,943 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:09,944 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:09.944480 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:09,947 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:14,959 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:14,960 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:14.960607 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:14,963 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:19,973 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:19,974 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:19.974650 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:19,977 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:24,989 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:24,990 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:24.990399 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:24,993 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:30,004 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:30,004 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:30.004752 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:30,007 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:15:35,020 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:35,021 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:35.021453 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:35,024 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:15:40,036 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:40,037 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:40.036817 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:40,039 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:45,047 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:45,048 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:45.048693 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:45,051 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:50,061 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:50,062 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:50.062351 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:50,064 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:15:55,075 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:15:55,076 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:15:55.076567 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:15:55,078 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:00,088 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:00,088 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:00.088822 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:00,090 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:16:05,100 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:05,101 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:05.101629 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:05,104 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:16:10,116 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:10,117 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:10.116941 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:10,119 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:15,130 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:15,131 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:15.131648 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:15,133 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:20,145 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:20,146 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:20.146162 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:20,148 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:25,159 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:25,160 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:25.160675 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:25,163 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:16:30,172 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:30,173 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:30.172893 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:30,175 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:35,186 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:35,187 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:35.187215 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:35,189 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:40,199 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:40,200 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:40.199886 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:40,202 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:45,213 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:45,214 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:45.214170 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:45,216 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:16:50,228 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:50,229 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:50.228846 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:50,231 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:16:55,242 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:16:55,243 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:16:55.242973 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:16:55,244 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:17:00,254 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:00,254 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:00.254609 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:00,256 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:17:05,266 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:05,267 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:05.266954 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:05,269 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:10,279 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:10,280 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:10.280271 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:10,282 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:15,291 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:15,292 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:15.292216 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:15,294 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:17:20,304 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:20,305 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:20.305327 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:20,307 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:25,314 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:25,315 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:25.315195 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:25,317 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:17:30,326 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:30,327 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:30.327332 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:30,328 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:17:35,339 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:35,340 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:35.340280 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:35,342 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:40,352 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:40,352 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:40.352741 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:40,355 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:17:45,366 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:45,367 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:45.367475 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:45,369 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:50,380 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:50,381 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:50.381355 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:50,383 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:17:55,394 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:17:55,394 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:17:55.394851 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 17.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:17:55,396 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:18:00,401 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:00,402 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:00.402344 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:00,403 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:18:05,414 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:05,414 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:05.414798 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:05,417 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:10,427 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:10,428 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:10.427962 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:10,430 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:15,442 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:15,442 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:15.442784 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:15,445 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:20,453 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:20,453 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:20.453753 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:20,456 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:25,468 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:25,469 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:25.468979 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:25,471 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:18:30,483 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:30,484 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:30.483971 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:30,486 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:35,497 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:35,497 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:35.497754 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:35,500 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:40,513 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:40,513 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:40.513619 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:40,516 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:45,528 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:45,529 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:45.528848 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:45,531 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:18:50,544 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:50,545 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:50.544949 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:50,547 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:18:55,560 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:18:55,561 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:18:55.561021 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:18:55,563 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:00,574 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:00,575 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:00.574838 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:00,577 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:05,589 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:05,590 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:05.590498 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:05,593 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:10,603 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:10,604 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:10.604266 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:10,606 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:15,619 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:15,620 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:15.620082 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:15,622 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:20,635 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:20,636 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:20.635888 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:20,638 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:19:25,651 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:25,651 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:25.651726 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:25,654 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:30,663 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:30,664 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:30.664188 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:30,666 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:35,677 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:35,678 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:35.678674 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:35,681 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:40,690 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:40,691 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:40.691153 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:40,694 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:19:45,706 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:45,707 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:45.707399 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:45,709 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:50,721 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:50,722 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:50.721931 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:50,724 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:19:55,735 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:19:55,736 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:19:55.736012 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:19:55,738 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:00,749 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:00,750 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:00.750320 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:00,752 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:05,765 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:05,766 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:05.766275 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:05,768 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:10,780 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:10,781 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:10.781054 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:10,783 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:15,792 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:15,793 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:15.792952 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:15,795 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:20:20,806 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:20,807 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:20.807057 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:20,809 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:25,821 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:25,822 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:25.822273 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:25,824 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:30,835 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:30,836 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:30.836402 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:30,839 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:35,848 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:35,849 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:35.848926 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:35,851 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:40,859 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:40,860 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:40.860610 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:40,863 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:45,874 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:45,875 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:45.875527 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:45,877 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:50,889 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:50,890 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:50.890290 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:50,892 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:20:55,903 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:20:55,904 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:20:55.904238 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:20:55,906 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:00,917 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:00,918 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:00.918215 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:00,920 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:05,931 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:05,932 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:05.932383 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:05,934 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:10,947 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:10,948 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:10.948290 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:10,951 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:21:15,964 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:15,965 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:15.964802 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:15,967 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:21:20,979 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:20,980 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:20.980230 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:20,982 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:25,993 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:25,994 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:25.994213 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:25,996 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:31,008 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:31,009 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:31.009513 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:31,012 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:36,024 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:36,025 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:36.025511 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:36,028 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:41,040 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:41,041 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:41.041110 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:41,043 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:21:46,054 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:46,055 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:46.054948 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:46,057 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:51,066 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:51,067 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:51.067590 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:51,069 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:21:56,080 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:21:56,081 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:21:56.080905 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:21:56,083 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:01,095 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:01,096 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:01.095889 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:01,098 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:06,110 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:06,111 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:06.111008 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:06,113 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:11,123 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:11,124 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:11.123944 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:11,126 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:16,136 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:16,137 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:16.137118 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:16,139 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:21,152 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:21,154 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:21.153819 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:21,156 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:22:26,166 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:26,166 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:26.166602 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:26,168 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:22:31,179 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:31,179 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:31.179680 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:31,182 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:36,190 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:36,191 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:36.191503 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:36,193 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:41,202 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:41,203 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:41.203419 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:41,205 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:46,216 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:46,217 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:46.217236 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:46,219 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:51,227 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:51,228 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:51.228097 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:51,230 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:22:56,239 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:22:56,239 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:22:56.239798 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:22:56,241 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:01,252 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:01,253 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:01.253237 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:01,255 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:06,263 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:06,264 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:06.264190 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:06,266 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:11,274 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:11,275 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:11.275202 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:11,277 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:23:16,287 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:16,288 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:16.287884 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:16,290 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:21,299 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:21,299 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:21.299562 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:21,301 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:23:26,311 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:26,312 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:26.312460 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:26,315 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:31,323 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:31,324 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:31.323987 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:31,326 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:36,335 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:36,336 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:36.336426 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:36,339 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:41,349 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:41,350 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:41.350476 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:41,353 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:23:46,363 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:46,364 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:46.363936 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:46,366 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:23:51,374 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:51,374 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:51.374856 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:51,376 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:23:56,387 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:23:56,388 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:23:56.388342 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:23:56,390 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:01,399 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:01,400 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:01.399880 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:01,402 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:06,410 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:06,411 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:06.411211 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 10.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:06,413 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:11,423 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:11,424 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:11.423991 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:11,426 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:16,437 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:16,437 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:16.437888 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:16,439 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:24:21,451 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:21,452 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:21.451929 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:21,454 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:26,461 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:26,461 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:26.461723 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:26,463 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:24:31,471 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:31,471 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:31.471845 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:31,474 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:36,483 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:36,483 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:36.483617 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 6.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:36,485 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:24:41,494 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:41,494 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:41.494614 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 5.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:41,496 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:24:46,502 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:46,502 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:46.502523 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:46,504 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:24:51,510 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:51,512 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:51.511180 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:51,515 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:24:56,527 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:24:56,528 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:24:56.528077 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:24:56,530 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:25:01,543 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:01,544 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:01.544126 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:01,546 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:06,559 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:06,560 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:06.560657 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:06,563 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:11,571 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:11,572 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:11.572224 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:11,574 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:16,584 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:16,585 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:16.584916 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:16,586 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:25:21,595 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:21,596 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:21.596377 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:21,598 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:26,607 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:26,608 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:26.608037 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:26,610 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:31,622 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:31,623 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:31.623469 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:31,626 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:25:36,635 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:36,636 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:36.635982 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:36,638 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:41,650 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:41,651 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:41.651744 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:41,654 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:25:46,663 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:46,664 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:46.664168 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:46,666 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:25:51,674 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:51,675 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:51.675049 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:51,676 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:25:56,683 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:25:56,684 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:25:56.684601 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:25:56,687 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:26:01,700 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:01,701 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:01.701097 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:01,703 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:06,716 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:06,716 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:06.716400 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:06,718 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:26:11,730 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:11,730 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:11.730681 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:11,733 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:16,743 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:16,743 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:16.743753 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:16,746 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:21,758 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:21,759 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:21.759108 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:21,761 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:26,773 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:26,773 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:26.773730 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:26,776 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:31,788 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:31,789 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:31.789570 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:31,792 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:26:36,805 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:36,805 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:36.805639 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:36,808 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:26:41,819 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:41,820 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:41.820471 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:41,823 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:26:46,835 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:46,836 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:46.836137 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:46,839 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:26:51,850 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:51,851 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:51.850943 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:51,852 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:26:56,864 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:26:56,865 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:26:56.865199 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:26:56,868 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:27:01,881 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:01,882 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:01.882147 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:01,884 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:27:06,896 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:06,897 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:06.897603 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:06,900 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:27:11,913 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:11,914 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:11.913833 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:11,916 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:16,929 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:16,930 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:16.930052 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:16,932 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:27:21,943 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:21,944 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:21.944436 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:21,947 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:26,959 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:26,960 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:26.959841 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:26,962 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:31,971 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:31,971 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:31.971501 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:31,973 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:27:36,983 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:36,984 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:36.984455 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:36,986 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:41,999 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:42,000 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:41.999791 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:42,002 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:47,015 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:47,016 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:47.015889 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:47,018 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:27:52,031 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:52,032 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:52.031916 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:52,034 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:27:57,044 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:27:57,045 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:27:57.045187 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:27:57,047 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:02,059 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:02,060 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:02.060268 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:02,062 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:07,071 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:07,072 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:07.072150 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:07,074 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:12,082 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:12,083 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:12.082989 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:12,084 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:28:17,095 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:17,096 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:17.096648 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:17,098 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:22,107 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:22,108 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:22.107809 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:22,110 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:27,121 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:27,122 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:27.122078 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:27,124 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:32,136 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:32,137 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:32.137691 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:32,140 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:28:37,152 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:37,153 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:37.153666 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:37,156 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:28:42,168 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:42,169 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:42.169564 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:42,172 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:47,184 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:47,185 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:47.185013 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:47,187 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:52,196 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:52,197 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:52.197068 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:52,199 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:28:57,211 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:28:57,212 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:28:57.212453 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:28:57,215 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:02,225 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:02,226 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:02.226570 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:02,229 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:07,239 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:07,240 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:07.240537 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:07,243 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:12,255 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:12,256 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:12.256406 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:12,258 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:17,270 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:17,271 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:17.271400 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:17,274 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:22,285 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:22,286 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:22.286426 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:22,289 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:27,302 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:27,302 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:27.302756 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:27,305 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:32,317 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:32,318 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:32.318705 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:32,321 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:37,334 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:37,335 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:37.335147 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:37,338 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:29:42,348 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:42,349 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:42.348972 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:42,351 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:47,363 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:47,364 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:47.364188 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:47,366 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:52,375 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:52,375 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:52.375828 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:52,378 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:29:57,388 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:29:57,389 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:29:57.388899 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:29:57,391 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:30:02,403 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:02,404 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:02.404048 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:02,406 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:07,417 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:07,418 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:07.418570 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:07,421 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:12,433 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:12,434 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:12.433884 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:12,436 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:17,449 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:17,450 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:17.449905 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:17,452 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:22,462 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:22,463 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:22.463559 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:22,466 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:27,476 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:27,477 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:27.476786 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:27,479 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:30:32,491 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:32,492 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:32.492366 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:32,494 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:37,507 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:37,508 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:37.507786 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:37,510 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:30:42,523 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:42,524 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:42.523910 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:42,526 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:30:47,539 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:47,540 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:47.540156 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:47,542 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:30:52,555 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:52,556 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:52.556118 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:52,559 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:30:57,569 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:30:57,570 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:30:57.569802 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:30:57,572 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:02,581 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:02,582 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:02.582052 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:02,584 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:31:07,597 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:07,597 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:07.597811 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:07,599 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:12,611 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:12,611 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:12.611788 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:12,613 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:17,623 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:17,623 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:17.623544 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:17,625 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:31:22,636 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:22,637 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:22.637593 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:22,640 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:31:27,653 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:27,653 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:27.653731 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:27,656 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:32,668 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:32,669 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:32.669369 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:32,672 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:31:37,683 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:37,684 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:37.683925 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:37,686 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:42,695 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:42,696 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:42.696163 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:42,698 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:47,710 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:47,711 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:47.711167 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:47,713 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:52,726 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:52,726 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:52.726712 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:52,729 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:31:57,740 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:31:57,741 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:31:57.741316 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:31:57,744 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:32:02,755 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:02,756 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:02.756129 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:02,758 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:07,769 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:07,770 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:07.770487 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:07,773 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:12,785 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:12,786 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:12.786052 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:12,788 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:17,798 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:17,798 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:17.798527 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:17,800 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:32:22,811 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:22,812 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:22.812245 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:22,814 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:27,826 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:27,827 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:27.826991 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:27,828 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:32:32,839 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:32,840 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:32.840576 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:32,843 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:37,851 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:37,852 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:37.852229 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:37,854 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:32:42,867 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:42,868 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:42.868049 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:42,870 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:32:47,880 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:47,881 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:47.881040 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:47,883 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:32:52,896 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:52,897 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:52.897531 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:52,900 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:32:57,912 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:32:57,913 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:32:57.913606 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:32:57,916 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:02,925 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:02,925 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:02.925608 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:02,927 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:33:07,936 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:07,937 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:07.937022 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:07,939 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:33:12,952 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:12,953 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:12.953390 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:12,956 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:17,968 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:17,969 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:17.969027 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:17,971 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:22,983 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:22,984 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:22.984265 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:22,987 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:33:27,999 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:27,999 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:27.999651 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:28,001 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:33:33,012 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:33,013 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:33.012810 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:33,015 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:38,026 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:38,027 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:38.027223 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:38,029 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:43,041 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:43,042 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:43.042370 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:43,044 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:48,055 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:48,056 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:48.055906 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:48,058 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:33:53,070 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:53,071 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:53.071656 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:53,074 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:33:58,083 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:33:58,084 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:33:58.084214 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:33:58,086 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:03,099 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:03,100 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:03.100094 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:03,102 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:34:08,114 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:08,115 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:08.115393 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:08,117 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:13,129 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:13,130 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:13.130602 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:13,133 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:18,144 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:18,145 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:18.145521 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:18,147 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:23,155 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:23,156 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:23.156483 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:23,158 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:28,170 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:28,171 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:28.171409 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:28,173 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:33,184 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:33,185 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:33.185220 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:33,187 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:38,199 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:38,200 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:38.200394 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:38,202 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:43,214 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:43,215 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:43.214793 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:43,217 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:48,227 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:48,228 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:48.228346 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:48,230 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:53,243 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:53,244 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:53.244019 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:53,246 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:34:58,258 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:34:58,259 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:34:58.259377 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 10.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:34:58,262 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:35:03,274 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:03,275 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:03.275223 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:03,278 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:35:08,290 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:08,290 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:08.290719 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:08,293 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:13,303 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:13,304 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:13.303967 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:13,306 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:18,317 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:18,317 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:18.317768 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:18,319 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:35:23,330 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:23,331 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:23.331399 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 8.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:23,333 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:28,345 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:28,346 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:28.346372 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 4.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:28,348 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:33,359 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:33,359 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:33.359664 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 1.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:33,361 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:38,370 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:38,371 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:38.371008 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:38,372 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:35:43,379 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:43,380 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:43.380594 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:43,383 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:48,394 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:48,395 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:48.395533 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:48,397 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:53,408 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:53,409 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:53.409353 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:53,411 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:35:58,419 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:35:58,420 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:35:58.420262 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:35:58,422 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:03,432 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:03,433 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:03.433230 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:03,434 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:36:08,445 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:08,446 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:08.446251 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:08,448 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:13,454 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:13,455 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:13.455532 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:13,457 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:18,469 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:18,470 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:18.470635 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:18,473 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:23,486 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:23,486 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:23.486681 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:23,489 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:28,502 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:28,503 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:28.502780 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:28,505 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:36:33,517 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:33,517 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:33.517561 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:33,519 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:36:38,530 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:38,531 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:38.531585 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:38,534 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:43,544 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:43,544 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:43.544712 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:43,547 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:48,555 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:48,556 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:48.556351 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:48,558 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:53,567 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:53,568 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:53.568474 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:53,571 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:36:58,579 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:36:58,580 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:36:58.580442 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:36:58,582 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:03,592 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:03,593 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:03.592988 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:03,595 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:08,608 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:08,608 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:08.608580 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:08,611 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:13,623 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:13,624 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:13.623928 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:13,626 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:18,639 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:18,640 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:18.639970 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:18,642 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:23,654 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:23,655 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:23.655078 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:23,657 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:37:28,667 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:28,668 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:28.668636 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:28,671 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:33,682 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:33,683 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:33.682891 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:33,685 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:38,694 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:38,695 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:38.695006 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:38,697 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:43,709 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:43,710 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:43.710574 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:43,713 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:48,726 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:48,727 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:48.726807 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:48,729 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:53,742 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:53,743 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:53.743323 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:53,746 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:37:58,755 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:37:58,756 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:37:58.756460 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:37:58,758 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:38:03,771 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:03,772 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:03.772130 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:03,774 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:08,787 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:08,788 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:08.788543 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:08,791 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:13,803 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:13,804 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:13.804620 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:13,807 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:38:18,819 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:18,820 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:18.820646 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:18,823 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:23,835 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:23,836 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:23.836142 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:23,838 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:28,847 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:28,848 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:28.848663 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:28,851 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:33,864 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:33,864 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:33.864721 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:33,867 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:38,879 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:38,880 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:38.880356 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:38,883 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:38:43,891 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:43,892 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:43.892231 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:43,894 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:38:48,904 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:48,904 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:48.904727 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:48,907 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:38:53,917 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:53,918 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:53.918450 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:53,920 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:38:58,933 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:38:58,934 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:38:58.934160 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:38:58,936 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:03,949 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:03,950 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:03.950146 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:03,952 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:08,965 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:08,966 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:08.966031 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:08,968 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:13,977 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:13,978 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:13.978295 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:13,981 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:18,992 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:18,993 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:18.993085 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:18,995 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:24,007 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:24,008 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:24.008559 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:24,011 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:29,020 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:29,021 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:29.021097 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:29,023 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:34,036 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:34,037 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:34.036794 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:34,039 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:39,052 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:39,052 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:39.052709 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:39,055 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:44,066 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:44,067 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:44.067349 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:44,069 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:39:49,081 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:49,082 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:49.082058 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:49,084 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:54,097 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:54,098 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:54.098429 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:54,101 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:39:59,114 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:39:59,115 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:39:59.114932 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:39:59,117 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:40:04,127 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:04,128 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:04.128545 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:04,130 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:09,144 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:09,145 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:09.144929 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:09,147 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:40:14,158 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:14,159 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:14.159537 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:14,161 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:19,173 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:19,174 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:19.174078 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:19,176 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:24,188 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:24,189 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:24.189222 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:24,191 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:29,203 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:29,204 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:29.204178 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:29,206 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:34,218 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:34,219 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:34.219185 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:34,221 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:39,231 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:39,232 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:39.232272 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:39,234 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:44,246 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:44,247 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:44.247128 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:44,249 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:49,262 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:49,263 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:49.263071 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:49,266 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:40:54,275 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:54,276 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:54.276508 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:54,279 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:40:59,291 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:40:59,292 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:40:59.292685 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:40:59,295 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:04,305 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:04,306 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:04.305868 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:04,308 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:41:09,320 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:09,321 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:09.321332 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:09,324 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:14,335 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:14,336 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:14.336472 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:14,338 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:19,350 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:19,351 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:19.351492 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:19,353 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:24,365 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:24,366 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:24.366318 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:24,369 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:41:29,381 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:29,381 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:29.381762 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:29,383 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:41:34,395 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:34,396 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:34.396526 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:34,399 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:39,411 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:39,412 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:39.412706 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:39,415 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:44,426 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:44,427 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:44.427060 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:44,429 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:41:49,442 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:49,443 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:49.443424 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:49,446 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:41:54,459 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:54,460 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:54.459842 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:54,462 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:41:59,472 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:41:59,473 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:41:59.472963 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:41:59,475 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:04,488 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:04,489 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:04.489103 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:04,491 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:09,504 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:09,505 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:09.505084 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:09,508 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:42:14,520 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:14,521 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:14.520786 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:14,523 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:42:19,536 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:19,536 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:19.536818 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:19,538 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:24,550 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:24,551 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:24.551644 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:24,554 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:42:29,564 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:29,565 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:29.565233 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:29,567 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:34,579 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:34,580 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:34.580504 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:34,583 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:39,591 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:39,592 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:39.592584 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:39,595 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:44,607 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:44,607 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:44.607678 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:44,609 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:49,619 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:49,620 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:49.620495 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:49,623 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:42:54,635 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:54,635 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:54.635675 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:54,638 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:42:59,649 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:42:59,650 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:42:59.650362 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:42:59,653 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:04,664 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:04,665 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:04.664990 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:04,667 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:09,679 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:09,680 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:09.680450 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:09,683 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:14,691 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:14,692 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:14.692010 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:14,694 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:19,706 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:19,707 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:19.707609 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:19,710 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:43:24,719 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:24,719 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:24.719674 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:24,722 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:29,730 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:29,731 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:29.730974 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:29,732 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:43:34,743 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:34,744 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:34.744110 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:34,746 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:39,754 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:39,755 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:39.755377 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:39,757 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:44,767 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:44,768 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:44.768487 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:44,771 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:49,781 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:49,782 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:49.782142 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:49,784 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:43:54,794 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:54,795 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:54.795538 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:54,798 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:43:59,809 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:43:59,810 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:43:59.810606 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:43:59,813 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:04,822 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:04,823 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:04.823442 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:04,825 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:09,837 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:09,838 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:09.838043 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:09,840 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:14,852 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:14,853 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:14.853008 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:14,855 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:19,866 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:19,867 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:19.867253 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:19,869 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:24,880 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:24,881 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:24.881354 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:24,883 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:29,895 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:29,896 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:29.896438 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:29,898 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:34,907 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:34,908 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:34.908391 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:34,910 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:44:39,923 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:39,924 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:39.923855 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:39,926 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:44:44,939 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:44,940 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:44.940348 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:44,943 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:44:49,956 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:49,957 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:49.957017 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:49,959 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:44:54,972 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:54,973 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:54.973161 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:54,976 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:44:59,988 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:44:59,989 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:44:59.988831 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:44:59,991 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:45:05,002 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:05,002 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:05.002709 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:05,004 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:10,015 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:10,016 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:10.016325 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:10,018 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:15,027 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:15,027 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:15.027755 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:15,030 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:20,037 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:20,038 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:20.037915 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:20,040 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:45:25,052 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:25,053 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:25.053027 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:25,055 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:30,064 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:30,065 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:30.064816 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:30,067 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:45:35,079 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:35,080 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:35.080556 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:35,083 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:40,095 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:40,096 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:40.095950 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:40,098 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:45:45,108 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:45,109 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:45.109210 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:45,111 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:45:50,123 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:50,124 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:50.123816 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:50,126 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:45:55,135 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:45:55,136 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:45:55.135967 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:45:55,138 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:00,148 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:00,149 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:00.148954 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:00,151 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:05,159 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:05,160 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:05.160644 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:05,163 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:10,171 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:10,172 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:10.172550 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:10,174 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:15,187 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:15,188 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:15.187945 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:15,190 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:20,202 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:20,203 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:20.203165 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:20,205 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:25,218 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:25,219 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:25.219272 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:25,221 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:30,234 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:30,235 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:30.235266 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:30,238 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:46:35,247 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:35,248 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:35.248565 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:35,251 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:46:40,262 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:40,262 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:40.262732 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:40,264 INFO autoscaler.py:470 -- The autoscaler took 0.002 seconds to complete the update iteration. 2025-01-20 22:46:45,276 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:45,276 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:45.276772 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:45,279 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:50,287 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:50,288 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:50.288357 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:50,291 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:46:55,304 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:46:55,304 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:46:55.304684 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:46:55,307 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:47:00,319 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:00,320 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:00.320650 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:00,323 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:05,336 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:05,337 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:05.337141 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:05,339 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:47:10,349 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:10,350 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:10.350378 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:10,353 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:15,365 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:15,366 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:15.366343 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:15,368 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:47:20,376 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:20,376 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:20.376741 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:20,379 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:25,392 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:25,393 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:25.393137 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:25,395 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:30,408 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:30,408 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:30.408732 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:30,410 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:47:35,422 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:35,423 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:35.423523 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:35,426 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:40,438 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:40,439 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:40.439683 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:40,442 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:45,455 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:45,456 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:45.456288 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:45,459 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:50,472 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:50,473 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:50.472766 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:50,475 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:47:55,488 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:47:55,489 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:47:55.488900 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:47:55,491 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:48:00,502 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:48:00,503 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:48:00.503672 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:48:00,506 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:48:05,517 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:48:05,518 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:48:05.517799 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:48:05,520 INFO autoscaler.py:470 -- The autoscaler took 0.004 seconds to complete the update iteration. 2025-01-20 22:48:10,533 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:48:10,534 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:48:10.534302 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:48:10,536 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration. 2025-01-20 22:48:15,547 INFO autoscaler.py:147 -- The autoscaler took 0.0 seconds to fetch the list of non-terminated nodes. 2025-01-20 22:48:15,548 INFO autoscaler.py:427 -- ======== Autoscaler status: 2025-01-20 22:48:15.548130 ======== Node status --------------------------------------------------------------- Active: 1 node_ed5029aed12dfb118ce5ec8eeddd392389018cb6a21a8c84b00cbebd Pending: (no pending nodes) Recent failures: (no failures) Resources --------------------------------------------------------------- Usage: 0.0/20.0 CPU 0.0/2.0 GPU 0B/78.83GiB memory 0B/2.00GiB object_store_memory Demands: (no resource demands) 2025-01-20 22:48:15,550 INFO autoscaler.py:470 -- The autoscaler took 0.003 seconds to complete the update iteration.