ray/session_2025-01-21_06-16-12_444635_21900/logs/gcs_server.out

[2025-01-21 06:16:12,492 I 23643 23643] (gcs_server) gcs_server_main.cc:52: Ray cluster metadata ray_version=2.40.0 ray_commit=22541c38dbef25286cd6d19f1c151bf4fd62f2ed
[2025-01-21 06:16:12,492 I 23643 23643] (gcs_server) io_service_pool.cc:35: IOServicePool is running with 1 io_service.
[2025-01-21 06:16:12,497 I 23643 23643] (gcs_server) event.cc:493: Ray Event initialized for GCS
[2025-01-21 06:16:12,497 I 23643 23643] (gcs_server) event.cc:493: Ray Event initialized for EXPORT_NODE
[2025-01-21 06:16:12,497 I 23643 23643] (gcs_server) event.cc:493: Ray Event initialized for EXPORT_ACTOR
[2025-01-21 06:16:12,497 I 23643 23643] (gcs_server) event.cc:493: Ray Event initialized for EXPORT_DRIVER_JOB
[2025-01-21 06:16:12,497 I 23643 23643] (gcs_server) event.cc:324: Set ray event level to warning
[2025-01-21 06:16:12,503 I 23643 23643] (gcs_server) gcs_server.cc:73: GCS storage type is StorageType::IN_MEMORY
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:42: Loading job table data.
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:54: Loading node table data.
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:80: Loading actor table data.
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:93: Loading actor task spec table data.
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:66: Loading placement group table data.
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:46: Finished loading job table data, size = 0
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:58: Finished loading node table data, size = 0
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:84: Finished loading actor table data, size = 0
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:97: Finished loading actor task spec table data, size = 0
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_init_data.cc:71: Finished loading placement group table data, size = 0
[2025-01-21 06:16:12,505 I 23643 23643] (gcs_server) gcs_server.cc:162: No existing server cluster ID found. Generating new ID: b96c6f6510a38509f7a01fcc10d6eb313f07df412f48c16b64ee6690
[2025-01-21 06:16:12,506 I 23643 23643] (gcs_server) gcs_server.cc:644: Autoscaler V2 enabled: 0
[2025-01-21 06:16:12,509 I 23643 23643] (gcs_server) grpc_server.cc:134: GcsServer server started, listening on port 46413.
[2025-01-21 06:16:12,779 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 0
- DrainNode request count: 0
- GetAllNodeInfo request count: 0

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 0

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 0
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 0
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 0
-Total num of driver tasks: 0

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:16:12,780 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 25 total (5 active)
Queueing time: mean = 97.772 ms, max = 270.815 ms, min = 4.394 us, total = 2.444 s
Execution time:  mean = 10.960 ms, total = 274.009 ms
Event stats:
	GcsInMemoryStore.Put - 9 total (0 active), Execution time: mean = 30.093 ms, total = 270.838 ms, Queueing time: mean = 209.613 ms, max = 269.957 ms, min = 4.394 us, total = 1.887 s
	GcsInMemoryStore.GetAll - 5 total (0 active), Execution time: mean = 28.125 us, total = 140.623 us, Queueing time: mean = 125.155 us, max = 155.188 us, min = 107.339 us, total = 625.774 us
	PeriodicalRunner.RunFnPeriodically - 4 total (2 active, 1 running), Execution time: mean = 4.636 us, total = 18.544 us, Queueing time: mean = 135.355 ms, max = 270.815 ms, min = 270.606 ms, total = 541.422 ms
	event_loop_lag_probe - 2 total (0 active), Execution time: mean = 16.337 us, total = 32.673 us, Queueing time: mean = 6.579 ms, max = 12.817 ms, min = 342.010 us, total = 13.159 ms
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 1 total (0 active), Execution time: mean = 2.951 ms, total = 2.951 ms, Queueing time: mean = 2.557 ms, max = 2.557 ms, min = 2.557 ms, total = 2.557 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	RayletLoadPulled - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 1 total (0 active), Execution time: mean = 28.927 us, total = 28.927 us, Queueing time: mean = 6.527 us, max = 6.527 us, min = 6.527 us, total = 6.527 us


[2025-01-21 06:16:12,780 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 5 total (1 active)
Queueing time: mean = 430.111 us, max = 1.673 ms, min = 6.341 us, total = 2.151 ms
Execution time:  mean = 262.854 us, total = 1.314 ms
Event stats:
	event_loop_lag_probe - 3 total (0 active), Execution time: mean = 434.051 us, total = 1.302 ms, Queueing time: mean = 684.575 us, max = 1.673 ms, min = 6.341 us, total = 2.054 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us
	GcsTaskManager.GcJobSummary - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:16:12,780 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 5 total (1 active)
Queueing time: mean = 1.640 ms, max = 7.909 ms, min = 8.720 us, total = 8.202 ms
Execution time:  mean = 40.509 us, total = 202.544 us
Event stats:
	event_loop_lag_probe - 3 total (0 active), Execution time: mean = 49.819 us, total = 149.457 us, Queueing time: mean = 2.669 ms, max = 7.909 ms, min = 8.720 us, total = 8.007 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us
	Publisher.CheckDeadSubscribers - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:16:12,780 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 5 total (0 active)
Queueing time: mean = 1.225 ms, max = 6.022 ms, min = 5.657 us, total = 6.127 ms
Execution time:  mean = 51.899 us, total = 259.495 us
Event stats:
	event_loop_lag_probe - 3 total (0 active), Execution time: mean = 86.126 us, total = 258.378 us, Queueing time: mean = 2.029 ms, max = 6.022 ms, min = 5.657 us, total = 6.086 ms
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:16:15,088 I 23643 23643] (gcs_server) gcs_node_manager.cc:85: Registering node info, address = 192.168.0.2, node name = 192.168.0.2 node_id=70fc2fa5396fc132250cfaf4b4655b76759ab81263e74a39254c24b3
[2025-01-21 06:16:15,088 I 23643 23643] (gcs_server) gcs_node_manager.cc:91: Finished registering node info, address = 192.168.0.2, node name = 192.168.0.2, is_head_node = 1 node_id=70fc2fa5396fc132250cfaf4b4655b76759ab81263e74a39254c24b3
[2025-01-21 06:16:15,088 I 23643 23643] (gcs_server) gcs_placement_group_manager.cc:819: A new node: 70fc2fa5396fc132250cfaf4b4655b76759ab81263e74a39254c24b3 registered, will try to reschedule all the infeasible placement groups.
[2025-01-21 06:16:15,094 I 23643 23724] (gcs_server) ray_syncer.cc:377: Get connection node_id=70fc2fa5396fc132250cfaf4b4655b76759ab81263e74a39254c24b3
[2025-01-21 06:16:16,069 I 23643 23643] (gcs_server) gcs_job_manager.cc:90: Adding job, job id = 01000000, driver pid = 21900
[2025-01-21 06:16:16,069 I 23643 23643] (gcs_server) gcs_job_manager.cc:111: Finished adding job, job id = 01000000, driver pid = 21900
[2025-01-21 06:16:22,509 W 23643 23666] (gcs_server) metric_exporter.cc:105: [1] Export metrics to agent failed: RpcError: RPC Error message: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:42309: Failed to connect to remote host: Connection refused; RPC Error details: . This won't affect Ray, but you can lose metrics from the cluster.
[2025-01-21 06:17:12,780 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 12

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 21
- cumulative published bytes: 15995
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 23
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:17:12,781 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 1139 total (4 active)
Queueing time: mean = 2.193 ms, max = 270.815 ms, min = 644.000 ns, total = 2.498 s
Execution time:  mean = 490.489 us, total = 558.667 ms
Event stats:
	event_loop_lag_probe - 242 total (0 active), Execution time: mean = 23.365 us, total = 5.654 ms, Queueing time: mean = 62.963 us, max = 12.817 ms, min = 2.734 us, total = 15.237 ms
	GcsInMemoryStore.Put - 143 total (0 active), Execution time: mean = 1.909 ms, total = 273.013 ms, Queueing time: mean = 13.225 ms, max = 269.957 ms, min = 2.819 us, total = 1.891 s
	GcsInMemoryStore.Get - 78 total (0 active), Execution time: mean = 23.230 us, total = 1.812 ms, Queueing time: mean = 14.858 us, max = 81.780 us, min = 4.500 us, total = 1.159 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 77 total (0 active), Execution time: mean = 629.897 us, total = 48.502 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 77 total (0 active), Execution time: mean = 45.850 us, total = 3.530 ms, Queueing time: mean = 112.428 us, max = 242.642 us, min = 17.710 us, total = 8.657 ms
	RayletLoadPulled - 60 total (1 active), Execution time: mean = 256.896 us, total = 15.414 ms, Queueing time: mean = 78.326 us, max = 301.905 us, min = 8.077 us, total = 4.700 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 57 total (0 active), Execution time: mean = 79.656 us, total = 4.540 ms, Queueing time: mean = 111.753 us, max = 321.357 us, min = 27.310 us, total = 6.370 ms
	NodeManagerService.grpc_client.GetResourceLoad - 57 total (0 active), Execution time: mean = 1.688 ms, total = 96.228 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 39 total (0 active), Execution time: mean = 44.125 us, total = 1.721 ms, Queueing time: mean = 103.564 us, max = 169.744 us, min = 27.441 us, total = 4.039 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 39 total (0 active), Execution time: mean = 593.939 us, total = 23.164 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 24 total (0 active), Execution time: mean = 30.704 us, total = 736.885 us, Queueing time: mean = 102.594 us, max = 190.036 us, min = 10.147 us, total = 2.462 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 24 total (0 active), Execution time: mean = 592.289 us, total = 14.215 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 21 total (1 active), Execution time: mean = 9.351 us, total = 196.376 us, Queueing time: mean = 81.982 us, max = 218.486 us, min = 31.576 us, total = 1.722 ms
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	HealthCheck - 18 total (0 active), Execution time: mean = 7.497 us, total = 134.951 us, Queueing time: mean = 106.704 us, max = 154.640 us, min = 21.399 us, total = 1.921 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 12 total (0 active), Execution time: mean = 85.501 us, total = 1.026 ms, Queueing time: mean = 119.251 us, max = 188.587 us, min = 39.555 us, total = 1.431 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 12 total (0 active), Execution time: mean = 718.484 us, total = 8.622 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	GCSServer.deadline_timer.debug_state_dump - 6 total (1 active), Execution time: mean = 1.162 ms, total = 6.973 ms, Queueing time: mean = 41.338 us, max = 95.910 us, min = 10.015 us, total = 248.026 us
	GcsResourceManager::Update - 5 total (0 active), Execution time: mean = 103.234 us, total = 516.169 us, Queueing time: mean = 137.915 us, max = 162.601 us, min = 103.382 us, total = 689.577 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_event_stats_print - 1 total (1 active, 1 running), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us


[2025-01-21 06:17:12,781 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 2651 total (1 active)
Queueing time: mean = 52.189 us, max = 1.673 ms, min = 4.920 us, total = 138.353 ms
Execution time:  mean = 256.149 us, total = 679.052 ms
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 1197 total (0 active), Execution time: mean = 533.489 us, total = 638.586 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 1197 total (0 active), Execution time: mean = 26.606 us, total = 31.848 ms, Queueing time: mean = 110.976 us, max = 346.389 us, min = 8.273 us, total = 132.838 ms
	event_loop_lag_probe - 243 total (0 active), Execution time: mean = 34.864 us, total = 8.472 ms, Queueing time: mean = 18.269 us, max = 1.673 ms, min = 4.920 us, total = 4.439 ms
	GcsTaskManager.GcJobSummary - 13 total (1 active), Execution time: mean = 10.338 us, total = 134.396 us, Queueing time: mean = 75.318 us, max = 128.895 us, min = 48.062 us, total = 979.135 us
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:17:12,781 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 426 total (25 active)
Queueing time: mean = 49.352 us, max = 7.909 ms, min = 4.085 us, total = 21.024 ms
Execution time:  mean = 125.836 ms, total = 53.606 s
Event stats:
	event_loop_lag_probe - 242 total (0 active), Execution time: mean = 25.375 us, total = 6.141 ms, Queueing time: mean = 41.999 us, max = 7.909 ms, min = 4.085 us, total = 10.164 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 45 total (24 active), Execution time: mean = 1.190 s, total = 53.567 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 45 total (0 active), Execution time: mean = 35.070 us, total = 1.578 ms, Queueing time: mean = 121.803 us, max = 303.395 us, min = 12.689 us, total = 5.481 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 21 total (0 active), Execution time: mean = 687.651 us, total = 14.441 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 21 total (0 active), Execution time: mean = 113.622 us, total = 2.386 ms, Queueing time: mean = 114.450 us, max = 170.689 us, min = 31.344 us, total = 2.403 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us
	Publisher.CheckDeadSubscribers - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:17:12,782 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 255 total (0 active)
Queueing time: mean = 35.806 us, max = 6.022 ms, min = 479.000 ns, total = 9.130 ms
Execution time:  mean = 30.828 us, total = 7.861 ms
Event stats:
	event_loop_lag_probe - 243 total (0 active), Execution time: mean = 29.459 us, total = 7.159 ms, Queueing time: mean = 34.985 us, max = 6.022 ms, min = 5.657 us, total = 8.501 ms
	 - 5 total (0 active), Execution time: mean = 109.980 us, total = 549.901 us, Queueing time: mean = 116.581 us, max = 182.675 us, min = 54.004 us, total = 582.907 us
	RaySyncer.BroadcastMessage - 5 total (0 active), Execution time: mean = 30.339 us, total = 151.695 us, Queueing time: mean = 1.062 us, max = 1.460 us, min = 479.000 ns, total = 5.311 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:18:12,782 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 24

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 33
- cumulative published bytes: 25811
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 23
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:18:12,783 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 1858 total (4 active)
Queueing time: mean = 1.359 ms, max = 270.815 ms, min = 644.000 ns, total = 2.525 s
Execution time:  mean = 390.751 us, total = 726.014 ms
Event stats:
	event_loop_lag_probe - 482 total (0 active), Execution time: mean = 23.126 us, total = 11.147 ms, Queueing time: mean = 36.051 us, max = 12.817 ms, min = 1.856 us, total = 17.377 ms
	GcsInMemoryStore.Put - 239 total (0 active), Execution time: mean = 1.145 ms, total = 273.552 ms, Queueing time: mean = 7.930 ms, max = 269.957 ms, min = 2.819 us, total = 1.895 s
	RayletLoadPulled - 120 total (1 active), Execution time: mean = 263.109 us, total = 31.573 ms, Queueing time: mean = 71.026 us, max = 301.905 us, min = 8.077 us, total = 8.523 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 117 total (0 active), Execution time: mean = 78.449 us, total = 9.178 ms, Queueing time: mean = 100.736 us, max = 321.357 us, min = 14.145 us, total = 11.786 ms
	NodeManagerService.grpc_client.GetResourceLoad - 117 total (0 active), Execution time: mean = 1.585 ms, total = 185.395 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 90 total (0 active), Execution time: mean = 23.182 us, total = 2.086 ms, Queueing time: mean = 14.473 us, max = 81.780 us, min = 4.500 us, total = 1.303 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 89 total (0 active), Execution time: mean = 614.229 us, total = 54.666 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 89 total (0 active), Execution time: mean = 46.689 us, total = 4.155 ms, Queueing time: mean = 110.264 us, max = 242.642 us, min = 15.503 us, total = 9.814 ms
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 63 total (0 active), Execution time: mean = 41.068 us, total = 2.587 ms, Queueing time: mean = 97.477 us, max = 178.424 us, min = 12.060 us, total = 6.141 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 63 total (0 active), Execution time: mean = 550.541 us, total = 34.684 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 48 total (0 active), Execution time: mean = 30.135 us, total = 1.446 ms, Queueing time: mean = 99.129 us, max = 257.746 us, min = 10.147 us, total = 4.758 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 48 total (0 active), Execution time: mean = 549.441 us, total = 26.373 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 41 total (1 active), Execution time: mean = 9.958 us, total = 408.263 us, Queueing time: mean = 73.385 us, max = 218.486 us, min = 18.980 us, total = 3.009 ms
	HealthCheck - 38 total (0 active), Execution time: mean = 7.549 us, total = 286.879 us, Queueing time: mean = 101.462 us, max = 178.352 us, min = 19.219 us, total = 3.856 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 24 total (0 active), Execution time: mean = 90.825 us, total = 2.180 ms, Queueing time: mean = 115.722 us, max = 209.865 us, min = 19.108 us, total = 2.777 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 24 total (0 active), Execution time: mean = 664.324 us, total = 15.944 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_dump - 12 total (1 active), Execution time: mean = 1.294 ms, total = 15.530 ms, Queueing time: mean = 44.147 us, max = 95.910 us, min = 10.015 us, total = 529.758 us
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	GcsResourceManager::Update - 5 total (0 active), Execution time: mean = 103.234 us, total = 516.169 us, Queueing time: mean = 137.915 us, max = 162.601 us, min = 103.382 us, total = 689.577 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	GCSServer.deadline_timer.debug_state_event_stats_print - 2 total (1 active, 1 running), Execution time: mean = 818.083 us, total = 1.636 ms, Queueing time: mean = 28.184 us, max = 56.368 us, min = 56.368 us, total = 56.368 us
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:18:12,783 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 5422 total (1 active)
Queueing time: mean = 47.090 us, max = 1.673 ms, min = 3.297 us, total = 255.321 ms
Execution time:  mean = 238.750 us, total = 1.295 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 2457 total (0 active), Execution time: mean = 496.125 us, total = 1.219 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 2457 total (0 active), Execution time: mean = 24.604 us, total = 60.451 ms, Queueing time: mean = 100.513 us, max = 473.564 us, min = 6.159 us, total = 246.960 ms
	event_loop_lag_probe - 482 total (0 active), Execution time: mean = 30.727 us, total = 14.810 ms, Queueing time: mean = 13.596 us, max = 1.673 ms, min = 3.297 us, total = 6.553 ms
	GcsTaskManager.GcJobSummary - 25 total (1 active), Execution time: mean = 9.961 us, total = 249.033 us, Queueing time: mean = 68.466 us, max = 128.895 us, min = 23.056 us, total = 1.712 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:18:12,783 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 714 total (25 active)
Queueing time: mean = 35.832 us, max = 7.909 ms, min = 3.457 us, total = 25.584 ms
Execution time:  mean = 159.253 ms, total = 113.706 s
Event stats:
	event_loop_lag_probe - 482 total (0 active), Execution time: mean = 25.332 us, total = 12.210 ms, Queueing time: mean = 25.687 us, max = 7.909 ms, min = 3.457 us, total = 12.381 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 57 total (24 active), Execution time: mean = 1.994 s, total = 113.652 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 57 total (0 active), Execution time: mean = 38.104 us, total = 2.172 ms, Queueing time: mean = 116.018 us, max = 303.395 us, min = 12.689 us, total = 6.613 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 33 total (0 active), Execution time: mean = 662.482 us, total = 21.862 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 33 total (0 active), Execution time: mean = 119.235 us, total = 3.935 ms, Queueing time: mean = 109.528 us, max = 229.362 us, min = 19.258 us, total = 3.614 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us
	Publisher.CheckDeadSubscribers - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:18:12,783 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 494 total (0 active)
Queueing time: mean = 23.159 us, max = 6.022 ms, min = 479.000 ns, total = 11.441 ms
Execution time:  mean = 28.801 us, total = 14.228 ms
Event stats:
	event_loop_lag_probe - 482 total (0 active), Execution time: mean = 28.060 us, total = 13.525 ms, Queueing time: mean = 22.431 us, max = 6.022 ms, min = 3.881 us, total = 10.812 ms
	 - 5 total (0 active), Execution time: mean = 109.980 us, total = 549.901 us, Queueing time: mean = 116.581 us, max = 182.675 us, min = 54.004 us, total = 582.907 us
	RaySyncer.BroadcastMessage - 5 total (0 active), Execution time: mean = 30.339 us, total = 151.695 us, Queueing time: mean = 1.062 us, max = 1.460 us, min = 479.000 ns, total = 5.311 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:19:12,784 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 36

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 47
- cumulative published bytes: 35693
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 23
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:19:12,785 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 2577 total (4 active)
Queueing time: mean = 991.086 us, max = 270.815 ms, min = 644.000 ns, total = 2.554 s
Execution time:  mean = 352.296 us, total = 907.867 ms
Event stats:
	event_loop_lag_probe - 722 total (0 active), Execution time: mean = 23.226 us, total = 16.769 ms, Queueing time: mean = 27.022 us, max = 12.817 ms, min = 1.856 us, total = 19.510 ms
	GcsInMemoryStore.Put - 335 total (0 active), Execution time: mean = 818.406 us, total = 274.166 ms, Queueing time: mean = 5.671 ms, max = 269.957 ms, min = 2.819 us, total = 1.900 s
	RayletLoadPulled - 180 total (1 active), Execution time: mean = 274.293 us, total = 49.373 ms, Queueing time: mean = 71.839 us, max = 301.905 us, min = 8.077 us, total = 12.931 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 177 total (0 active), Execution time: mean = 78.576 us, total = 13.908 ms, Queueing time: mean = 102.435 us, max = 321.357 us, min = 14.145 us, total = 18.131 ms
	NodeManagerService.grpc_client.GetResourceLoad - 177 total (0 active), Execution time: mean = 1.590 ms, total = 281.472 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 102 total (0 active), Execution time: mean = 23.104 us, total = 2.357 ms, Queueing time: mean = 14.216 us, max = 81.780 us, min = 4.398 us, total = 1.450 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 101 total (0 active), Execution time: mean = 611.925 us, total = 61.804 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 101 total (0 active), Execution time: mean = 47.657 us, total = 4.813 ms, Queueing time: mean = 109.394 us, max = 242.642 us, min = 12.343 us, total = 11.049 ms
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 87 total (0 active), Execution time: mean = 41.598 us, total = 3.619 ms, Queueing time: mean = 100.749 us, max = 178.424 us, min = 11.792 us, total = 8.765 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 87 total (0 active), Execution time: mean = 551.574 us, total = 47.987 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 72 total (0 active), Execution time: mean = 30.104 us, total = 2.168 ms, Queueing time: mean = 105.506 us, max = 257.746 us, min = 10.147 us, total = 7.596 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 72 total (0 active), Execution time: mean = 555.748 us, total = 40.014 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 61 total (1 active), Execution time: mean = 10.315 us, total = 629.219 us, Queueing time: mean = 73.967 us, max = 218.486 us, min = 18.980 us, total = 4.512 ms
	HealthCheck - 58 total (0 active), Execution time: mean = 7.588 us, total = 440.132 us, Queueing time: mean = 99.895 us, max = 178.352 us, min = 14.928 us, total = 5.794 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 36 total (0 active), Execution time: mean = 90.458 us, total = 3.256 ms, Queueing time: mean = 117.083 us, max = 209.865 us, min = 19.108 us, total = 4.215 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 36 total (0 active), Execution time: mean = 665.817 us, total = 23.969 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	GCSServer.deadline_timer.debug_state_dump - 18 total (1 active), Execution time: mean = 1.360 ms, total = 24.473 ms, Queueing time: mean = 56.397 us, max = 154.654 us, min = 10.015 us, total = 1.015 ms
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsResourceManager::Update - 5 total (0 active), Execution time: mean = 103.234 us, total = 516.169 us, Queueing time: mean = 137.915 us, max = 162.601 us, min = 103.382 us, total = 689.577 us
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	GCSServer.deadline_timer.debug_state_event_stats_print - 3 total (1 active, 1 running), Execution time: mean = 1.155 ms, total = 3.464 ms, Queueing time: mean = 38.097 us, max = 57.923 us, min = 56.368 us, total = 114.291 us
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:19:12,785 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 8194 total (1 active)
Queueing time: mean = 47.233 us, max = 1.673 ms, min = 2.326 us, total = 387.029 ms
Execution time:  mean = 241.328 us, total = 1.977 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 3717 total (0 active), Execution time: mean = 501.725 us, total = 1.865 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 3717 total (0 active), Execution time: mean = 24.530 us, total = 91.180 ms, Queueing time: mean = 101.075 us, max = 473.564 us, min = 4.354 us, total = 375.697 ms
	event_loop_lag_probe - 722 total (0 active), Execution time: mean = 29.033 us, total = 20.962 ms, Queueing time: mean = 11.981 us, max = 1.673 ms, min = 2.326 us, total = 8.650 ms
	GcsTaskManager.GcJobSummary - 37 total (1 active), Execution time: mean = 10.113 us, total = 374.188 us, Queueing time: mean = 69.844 us, max = 128.895 us, min = 23.056 us, total = 2.584 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:19:12,785 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 1010 total (25 active)
Queueing time: mean = 30.518 us, max = 7.909 ms, min = 3.457 us, total = 30.824 ms
Execution time:  mean = 172.164 ms, total = 173.886 s
Event stats:
	event_loop_lag_probe - 722 total (0 active), Execution time: mean = 26.740 us, total = 19.307 ms, Queueing time: mean = 20.553 us, max = 7.909 ms, min = 3.457 us, total = 14.839 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 71 total (24 active), Execution time: mean = 2.448 s, total = 173.812 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 71 total (0 active), Execution time: mean = 39.816 us, total = 2.827 ms, Queueing time: mean = 113.639 us, max = 303.395 us, min = 12.689 us, total = 8.068 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 47 total (0 active), Execution time: mean = 664.333 us, total = 31.224 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 47 total (0 active), Execution time: mean = 113.443 us, total = 5.332 ms, Queueing time: mean = 105.111 us, max = 229.362 us, min = 15.170 us, total = 4.940 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us
	Publisher.CheckDeadSubscribers - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:19:12,785 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 734 total (0 active)
Queueing time: mean = 18.763 us, max = 6.022 ms, min = 479.000 ns, total = 13.772 ms
Execution time:  mean = 28.034 us, total = 20.577 ms
Event stats:
	event_loop_lag_probe - 722 total (0 active), Execution time: mean = 27.527 us, total = 19.874 ms, Queueing time: mean = 18.203 us, max = 6.022 ms, min = 3.811 us, total = 13.143 ms
	 - 5 total (0 active), Execution time: mean = 109.980 us, total = 549.901 us, Queueing time: mean = 116.581 us, max = 182.675 us, min = 54.004 us, total = 582.907 us
	RaySyncer.BroadcastMessage - 5 total (0 active), Execution time: mean = 30.339 us, total = 151.695 us, Queueing time: mean = 1.062 us, max = 1.460 us, min = 479.000 ns, total = 5.311 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:20:12,785 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 48

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 61
- cumulative published bytes: 46551
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 27
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:20:12,786 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 3298 total (4 active)
Queueing time: mean = 781.974 us, max = 270.815 ms, min = 644.000 ns, total = 2.579 s
Execution time:  mean = 325.658 us, total = 1.074 s
Event stats:
	event_loop_lag_probe - 962 total (0 active), Execution time: mean = 23.056 us, total = 22.180 ms, Queueing time: mean = 22.424 us, max = 12.817 ms, min = 1.856 us, total = 21.572 ms
	GcsInMemoryStore.Put - 431 total (0 active), Execution time: mean = 637.367 us, total = 274.705 ms, Queueing time: mean = 4.417 ms, max = 269.957 ms, min = 2.819 us, total = 1.904 s
	RayletLoadPulled - 240 total (1 active), Execution time: mean = 267.483 us, total = 64.196 ms, Queueing time: mean = 70.899 us, max = 301.905 us, min = 8.077 us, total = 17.016 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 237 total (0 active), Execution time: mean = 77.445 us, total = 18.355 ms, Queueing time: mean = 97.537 us, max = 321.357 us, min = 14.145 us, total = 23.116 ms
	NodeManagerService.grpc_client.GetResourceLoad - 237 total (0 active), Execution time: mean = 1.555 ms, total = 368.564 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 114 total (0 active), Execution time: mean = 22.651 us, total = 2.582 ms, Queueing time: mean = 13.859 us, max = 81.780 us, min = 4.398 us, total = 1.580 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 113 total (0 active), Execution time: mean = 593.899 us, total = 67.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 113 total (0 active), Execution time: mean = 47.655 us, total = 5.385 ms, Queueing time: mean = 105.595 us, max = 242.642 us, min = 12.343 us, total = 11.932 ms
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 111 total (0 active), Execution time: mean = 40.334 us, total = 4.477 ms, Queueing time: mean = 95.985 us, max = 197.950 us, min = 11.792 us, total = 10.654 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 111 total (0 active), Execution time: mean = 581.820 us, total = 64.582 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 96 total (0 active), Execution time: mean = 28.945 us, total = 2.779 ms, Queueing time: mean = 101.495 us, max = 257.746 us, min = 10.147 us, total = 9.744 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 96 total (0 active), Execution time: mean = 534.392 us, total = 51.302 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 81 total (1 active), Execution time: mean = 10.242 us, total = 829.595 us, Queueing time: mean = 70.848 us, max = 218.486 us, min = 18.980 us, total = 5.739 ms
	HealthCheck - 78 total (0 active), Execution time: mean = 7.227 us, total = 563.743 us, Queueing time: mean = 92.379 us, max = 190.796 us, min = 13.778 us, total = 7.206 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 48 total (0 active), Execution time: mean = 85.466 us, total = 4.102 ms, Queueing time: mean = 112.187 us, max = 209.865 us, min = 19.108 us, total = 5.385 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 48 total (0 active), Execution time: mean = 631.595 us, total = 30.317 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_dump - 24 total (1 active), Execution time: mean = 1.390 ms, total = 33.348 ms, Queueing time: mean = 59.326 us, max = 154.654 us, min = 10.015 us, total = 1.424 ms
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	GcsResourceManager::Update - 7 total (0 active), Execution time: mean = 109.353 us, total = 765.472 us, Queueing time: mean = 139.778 us, max = 162.601 us, min = 103.382 us, total = 978.447 us
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	GCSServer.deadline_timer.debug_state_event_stats_print - 4 total (1 active, 1 running), Execution time: mean = 1.302 ms, total = 5.210 ms, Queueing time: mean = 34.123 us, max = 57.923 us, min = 22.203 us, total = 136.494 us
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:20:12,787 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 10966 total (1 active)
Queueing time: mean = 45.649 us, max = 1.673 ms, min = 2.326 us, total = 500.584 ms
Execution time:  mean = 235.440 us, total = 2.582 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 4977 total (0 active), Execution time: mean = 489.565 us, total = 2.437 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 4977 total (0 active), Execution time: mean = 23.700 us, total = 117.957 ms, Queueing time: mean = 97.763 us, max = 473.564 us, min = 4.354 us, total = 486.568 ms
	event_loop_lag_probe - 962 total (0 active), Execution time: mean = 27.885 us, total = 26.826 ms, Queueing time: mean = 10.966 us, max = 1.673 ms, min = 2.326 us, total = 10.549 ms
	GcsTaskManager.GcJobSummary - 49 total (1 active), Execution time: mean = 9.774 us, total = 478.916 us, Queueing time: mean = 68.773 us, max = 128.895 us, min = 23.056 us, total = 3.370 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:20:12,787 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 1306 total (25 active)
Queueing time: mean = 27.051 us, max = 7.909 ms, min = 3.326 us, total = 35.329 ms
Execution time:  mean = 179.231 ms, total = 234.076 s
Event stats:
	event_loop_lag_probe - 962 total (0 active), Execution time: mean = 26.614 us, total = 25.603 ms, Queueing time: mean = 17.815 us, max = 7.909 ms, min = 3.326 us, total = 17.138 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 85 total (24 active), Execution time: mean = 2.753 s, total = 233.987 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 85 total (0 active), Execution time: mean = 39.314 us, total = 3.342 ms, Queueing time: mean = 107.240 us, max = 303.395 us, min = 12.689 us, total = 9.115 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 61 total (0 active), Execution time: mean = 636.256 us, total = 38.812 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 61 total (0 active), Execution time: mean = 111.135 us, total = 6.779 ms, Queueing time: mean = 100.000 us, max = 229.362 us, min = 15.170 us, total = 6.100 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us
	Publisher.CheckDeadSubscribers - 1 total (1 active), Execution time: mean = 0.000 s, total = 0.000 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:20:12,787 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 978 total (0 active)
Queueing time: mean = 16.593 us, max = 6.022 ms, min = 479.000 ns, total = 16.228 ms
Execution time:  mean = 27.663 us, total = 27.054 ms
Event stats:
	event_loop_lag_probe - 962 total (0 active), Execution time: mean = 27.085 us, total = 26.056 ms, Queueing time: mean = 15.986 us, max = 6.022 ms, min = 3.811 us, total = 15.379 ms
	 - 7 total (0 active), Execution time: mean = 112.116 us, total = 784.810 us, Queueing time: mean = 114.312 us, max = 182.675 us, min = 54.004 us, total = 800.182 us
	RaySyncer.BroadcastMessage - 7 total (0 active), Execution time: mean = 30.363 us, total = 212.544 us, Queueing time: mean = 1.107 us, max = 1.460 us, min = 479.000 ns, total = 7.747 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:21:12,787 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 60

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 73
- cumulative published bytes: 56367
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 27
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:21:12,788 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 4017 total (4 active)
Queueing time: mean = 648.046 us, max = 270.815 ms, min = 644.000 ns, total = 2.603 s
Execution time:  mean = 303.587 us, total = 1.220 s
Event stats:
	event_loop_lag_probe - 1202 total (0 active), Execution time: mean = 23.000 us, total = 27.646 ms, Queueing time: mean = 19.679 us, max = 12.817 ms, min = 1.856 us, total = 23.654 ms
	GcsInMemoryStore.Put - 527 total (0 active), Execution time: mean = 522.233 us, total = 275.217 ms, Queueing time: mean = 3.620 ms, max = 269.957 ms, min = 2.819 us, total = 1.908 s
	RayletLoadPulled - 300 total (1 active), Execution time: mean = 259.884 us, total = 77.965 ms, Queueing time: mean = 70.345 us, max = 301.905 us, min = 8.077 us, total = 21.103 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 297 total (0 active), Execution time: mean = 75.129 us, total = 22.313 ms, Queueing time: mean = 93.467 us, max = 321.357 us, min = 14.145 us, total = 27.760 ms
	NodeManagerService.grpc_client.GetResourceLoad - 297 total (0 active), Execution time: mean = 1.505 ms, total = 447.095 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 135 total (0 active), Execution time: mean = 38.967 us, total = 5.260 ms, Queueing time: mean = 92.696 us, max = 197.950 us, min = 11.792 us, total = 12.514 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 135 total (0 active), Execution time: mean = 542.965 us, total = 73.300 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 126 total (0 active), Execution time: mean = 22.294 us, total = 2.809 ms, Queueing time: mean = 13.612 us, max = 81.780 us, min = 4.398 us, total = 1.715 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 125 total (0 active), Execution time: mean = 576.214 us, total = 72.027 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 125 total (0 active), Execution time: mean = 50.403 us, total = 6.300 ms, Queueing time: mean = 103.664 us, max = 242.642 us, min = 12.343 us, total = 12.958 ms
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 120 total (0 active), Execution time: mean = 28.059 us, total = 3.367 ms, Queueing time: mean = 99.360 us, max = 257.746 us, min = 10.147 us, total = 11.923 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 120 total (0 active), Execution time: mean = 511.892 us, total = 61.427 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	ClusterResourceManager.ResetRemoteNodeView - 101 total (1 active), Execution time: mean = 10.066 us, total = 1.017 ms, Queueing time: mean = 68.915 us, max = 218.486 us, min = 18.980 us, total = 6.960 ms
	HealthCheck - 98 total (0 active), Execution time: mean = 7.108 us, total = 696.608 us, Queueing time: mean = 91.159 us, max = 190.796 us, min = 13.778 us, total = 8.934 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 60 total (0 active), Execution time: mean = 82.351 us, total = 4.941 ms, Queueing time: mean = 107.421 us, max = 209.865 us, min = 18.932 us, total = 6.445 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 60 total (0 active), Execution time: mean = 595.560 us, total = 35.734 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_dump - 30 total (1 active), Execution time: mean = 1.401 ms, total = 42.021 ms, Queueing time: mean = 61.688 us, max = 154.654 us, min = 10.015 us, total = 1.851 ms
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	GcsResourceManager::Update - 7 total (0 active), Execution time: mean = 109.353 us, total = 765.472 us, Queueing time: mean = 139.778 us, max = 162.601 us, min = 103.382 us, total = 978.447 us
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_event_stats_print - 5 total (1 active, 1 running), Execution time: mean = 1.388 ms, total = 6.939 ms, Queueing time: mean = 35.123 us, max = 57.923 us, min = 22.203 us, total = 175.614 us
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:21:12,788 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 13738 total (1 active)
Queueing time: mean = 41.891 us, max = 1.673 ms, min = 2.326 us, total = 575.497 ms
Execution time:  mean = 221.083 us, total = 3.037 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 6237 total (0 active), Execution time: mean = 459.396 us, total = 2.865 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 6237 total (0 active), Execution time: mean = 22.265 us, total = 138.869 ms, Queueing time: mean = 89.594 us, max = 473.564 us, min = 4.354 us, total = 558.797 ms
	event_loop_lag_probe - 1202 total (0 active), Execution time: mean = 27.056 us, total = 32.521 ms, Queueing time: mean = 10.399 us, max = 1.673 ms, min = 2.326 us, total = 12.499 ms
	GcsTaskManager.GcJobSummary - 61 total (1 active), Execution time: mean = 9.462 us, total = 577.201 us, Queueing time: mean = 67.284 us, max = 130.574 us, min = 23.056 us, total = 4.104 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:21:12,789 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 1595 total (25 active)
Queueing time: mean = 24.300 us, max = 7.909 ms, min = 3.326 us, total = 38.759 ms
Execution time:  mean = 184.496 ms, total = 294.272 s
Event stats:
	event_loop_lag_probe - 1202 total (0 active), Execution time: mean = 26.458 us, total = 31.802 ms, Queueing time: mean = 16.071 us, max = 7.909 ms, min = 3.326 us, total = 19.317 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 97 total (24 active), Execution time: mean = 3.033 s, total = 294.170 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 97 total (0 active), Execution time: mean = 38.483 us, total = 3.733 ms, Queueing time: mean = 99.562 us, max = 303.395 us, min = 12.689 us, total = 9.658 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 73 total (0 active), Execution time: mean = 598.813 us, total = 43.713 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 73 total (0 active), Execution time: mean = 107.286 us, total = 7.832 ms, Queueing time: mean = 92.065 us, max = 229.362 us, min = 15.170 us, total = 6.721 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	Publisher.CheckDeadSubscribers - 2 total (1 active), Execution time: mean = 10.836 us, total = 21.672 us, Queueing time: mean = 43.660 us, max = 87.321 us, min = 87.321 us, total = 87.321 us
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us


[2025-01-21 06:21:12,789 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 1218 total (0 active)
Queueing time: mean = 14.985 us, max = 6.022 ms, min = 479.000 ns, total = 18.252 ms
Execution time:  mean = 26.798 us, total = 32.640 ms
Event stats:
	event_loop_lag_probe - 1202 total (0 active), Execution time: mean = 26.324 us, total = 31.641 ms, Queueing time: mean = 14.478 us, max = 6.022 ms, min = 3.811 us, total = 17.403 ms
	 - 7 total (0 active), Execution time: mean = 112.116 us, total = 784.810 us, Queueing time: mean = 114.312 us, max = 182.675 us, min = 54.004 us, total = 800.182 us
	RaySyncer.BroadcastMessage - 7 total (0 active), Execution time: mean = 30.363 us, total = 212.544 us, Queueing time: mean = 1.107 us, max = 1.460 us, min = 479.000 ns, total = 7.747 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:22:12,789 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 72

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 85
- cumulative published bytes: 66183
- current buffered bytes: 818
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 27
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:22:12,789 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 4736 total (4 active)
Queueing time: mean = 555.823 us, max = 270.815 ms, min = 644.000 ns, total = 2.632 s
Execution time:  mean = 295.704 us, total = 1.400 s
Event stats:
	event_loop_lag_probe - 1442 total (0 active), Execution time: mean = 23.269 us, total = 33.554 ms, Queueing time: mean = 17.947 us, max = 12.817 ms, min = 1.856 us, total = 25.880 ms
	GcsInMemoryStore.Put - 623 total (0 active), Execution time: mean = 442.644 us, total = 275.767 ms, Queueing time: mean = 3.068 ms, max = 269.957 ms, min = 2.214 us, total = 1.912 s
	RayletLoadPulled - 360 total (1 active), Execution time: mean = 260.822 us, total = 93.896 ms, Queueing time: mean = 71.749 us, max = 301.905 us, min = 8.077 us, total = 25.830 ms
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 357 total (0 active), Execution time: mean = 75.525 us, total = 26.962 ms, Queueing time: mean = 95.952 us, max = 321.357 us, min = 14.145 us, total = 34.255 ms
	NodeManagerService.grpc_client.GetResourceLoad - 357 total (0 active), Execution time: mean = 1.525 ms, total = 544.521 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 159 total (0 active), Execution time: mean = 38.658 us, total = 6.147 ms, Queueing time: mean = 91.564 us, max = 197.950 us, min = 11.792 us, total = 14.559 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 159 total (0 active), Execution time: mean = 539.573 us, total = 85.792 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 144 total (0 active), Execution time: mean = 28.879 us, total = 4.159 ms, Queueing time: mean = 102.047 us, max = 257.746 us, min = 10.147 us, total = 14.695 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 144 total (0 active), Execution time: mean = 526.118 us, total = 75.761 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 138 total (0 active), Execution time: mean = 22.265 us, total = 3.073 ms, Queueing time: mean = 13.540 us, max = 81.780 us, min = 3.539 us, total = 1.868 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 137 total (0 active), Execution time: mean = 578.417 us, total = 79.243 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 137 total (0 active), Execution time: mean = 50.457 us, total = 6.913 ms, Queueing time: mean = 104.548 us, max = 242.642 us, min = 12.343 us, total = 14.323 ms
	ClusterResourceManager.ResetRemoteNodeView - 121 total (1 active), Execution time: mean = 10.282 us, total = 1.244 ms, Queueing time: mean = 69.824 us, max = 218.486 us, min = 18.980 us, total = 8.449 ms
	HealthCheck - 118 total (0 active), Execution time: mean = 7.205 us, total = 850.171 us, Queueing time: mean = 92.791 us, max = 190.796 us, min = 13.778 us, total = 10.949 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 72 total (0 active), Execution time: mean = 82.571 us, total = 5.945 ms, Queueing time: mean = 109.216 us, max = 209.865 us, min = 18.932 us, total = 7.864 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 72 total (0 active), Execution time: mean = 604.887 us, total = 43.552 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_dump - 36 total (1 active), Execution time: mean = 1.415 ms, total = 50.951 ms, Queueing time: mean = 64.793 us, max = 154.654 us, min = 10.015 us, total = 2.333 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	GcsResourceManager::Update - 7 total (0 active), Execution time: mean = 109.353 us, total = 765.472 us, Queueing time: mean = 139.778 us, max = 162.601 us, min = 103.382 us, total = 978.447 us
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	GCSServer.deadline_timer.debug_state_event_stats_print - 6 total (1 active, 1 running), Execution time: mean = 1.448 ms, total = 8.690 ms, Queueing time: mean = 36.265 us, max = 57.923 us, min = 22.203 us, total = 217.588 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:22:12,790 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 16510 total (1 active)
Queueing time: mean = 43.619 us, max = 1.673 ms, min = 2.326 us, total = 720.155 ms
Execution time:  mean = 226.514 us, total = 3.740 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 7497 total (0 active), Execution time: mean = 470.616 us, total = 3.528 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 7497 total (0 active), Execution time: mean = 22.944 us, total = 172.010 ms, Queueing time: mean = 93.438 us, max = 473.564 us, min = 4.354 us, total = 700.502 ms
	event_loop_lag_probe - 1442 total (0 active), Execution time: mean = 26.924 us, total = 38.824 ms, Queueing time: mean = 10.130 us, max = 1.673 ms, min = 2.326 us, total = 14.608 ms
	GcsTaskManager.GcJobSummary - 73 total (1 active), Execution time: mean = 9.503 us, total = 693.723 us, Queueing time: mean = 67.780 us, max = 130.574 us, min = 23.056 us, total = 4.948 ms
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:22:12,790 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 1883 total (25 active)
Queueing time: mean = 23.409 us, max = 7.909 ms, min = 3.326 us, total = 44.079 ms
Execution time:  mean = 188.198 ms, total = 354.376 s
Event stats:
	event_loop_lag_probe - 1442 total (0 active), Execution time: mean = 26.824 us, total = 38.680 ms, Queueing time: mean = 15.021 us, max = 7.909 ms, min = 3.326 us, total = 21.661 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 109 total (24 active), Execution time: mean = 3.250 s, total = 354.259 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 109 total (0 active), Execution time: mean = 38.857 us, total = 4.235 ms, Queueing time: mean = 103.661 us, max = 303.395 us, min = 12.689 us, total = 11.299 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 85 total (0 active), Execution time: mean = 602.163 us, total = 51.184 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 85 total (0 active), Execution time: mean = 105.898 us, total = 9.001 ms, Queueing time: mean = 94.786 us, max = 229.362 us, min = 15.170 us, total = 8.057 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	Publisher.CheckDeadSubscribers - 2 total (1 active), Execution time: mean = 10.836 us, total = 21.672 us, Queueing time: mean = 43.660 us, max = 87.321 us, min = 87.321 us, total = 87.321 us
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us


[2025-01-21 06:22:12,790 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 1458 total (0 active)
Queueing time: mean = 14.097 us, max = 6.022 ms, min = 479.000 ns, total = 20.554 ms
Execution time:  mean = 26.935 us, total = 39.272 ms
Event stats:
	event_loop_lag_probe - 1442 total (0 active), Execution time: mean = 26.542 us, total = 38.273 ms, Queueing time: mean = 13.665 us, max = 6.022 ms, min = 3.811 us, total = 19.705 ms
	 - 7 total (0 active), Execution time: mean = 112.116 us, total = 784.810 us, Queueing time: mean = 114.312 us, max = 182.675 us, min = 54.004 us, total = 800.182 us
	RaySyncer.BroadcastMessage - 7 total (0 active), Execution time: mean = 30.363 us, total = 212.544 us, Queueing time: mean = 1.107 us, max = 1.460 us, min = 479.000 ns, total = 7.747 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:25:01,040 I 23643 23643] (gcs_server) gcs_server.cc:245: Gcs Debug state:

GcsNodeManager: 
- RegisterNode request count: 1
- DrainNode request count: 0
- GetAllNodeInfo request count: 34

GcsActorManager: 
- RegisterActor request count: 0
- CreateActor request count: 0
- GetActorInfo request count: 0
- GetNamedActorInfo request count: 0
- GetAllActorInfo request count: 0
- KillActor request count: 0
- ListNamedActors request count: 0
- Registered actors count: 0
- Destroyed actors count: 0
- Named actors count: 0
- Unresolved actors count: 0
- Pending actors count: 0
- Created actors count: 0
- owners_: 0
- actor_to_register_callbacks_: 0
- actor_to_restart_callbacks_: 0
- actor_to_create_callbacks_: 0
- sorted_destroyed_actor_list_: 0

GcsResourceManager: 
- GetAllAvailableResources request count: 0
- GetAllTotalResources request count: 0
- GetAllResourceUsage request count: 74

GcsPlacementGroupManager: 
- CreatePlacementGroup request count: 0
- RemovePlacementGroup request count: 0
- GetPlacementGroup request count: 0
- GetAllPlacementGroup request count: 0
- WaitPlacementGroupUntilReady request count: 0
- GetNamedPlacementGroup request count: 0
- Scheduling pending placement group count: 0
- Registered placement groups count: 0
- Named placement group count: 0
- Pending placement groups count: 0
- Infeasible placement groups count: 0

Publisher:
GCS_JOB_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 283
- current buffered bytes: 283
RAY_LOG_CHANNEL
- cumulative published messages: 88
- cumulative published bytes: 67852
- current buffered bytes: 152
GCS_NODE_INFO_CHANNEL
- cumulative published messages: 1
- cumulative published bytes: 536
- current buffered bytes: 0

[runtime env manager] ID to URIs table:
[runtime env manager] URIs reference table:

GcsTaskManager: 
-Total num task events reported: 27
-Total num status task events dropped: 0
-Total num profile events dropped: 0
-Current num of task events stored: 7
-Total num of actor creation tasks: 0
-Total num of actor tasks: 0
-Total num of normal tasks: 6
-Total num of driver tasks: 1

GcsAutoscalerStateManager: 
- last_seen_autoscaler_state_version_: 0
- last_cluster_resource_state_version_: 0
- pending demands:



[2025-01-21 06:25:01,041 I 23643 23643] (gcs_server) gcs_server.cc:843: Main service Event stats:


Global stats: 4858 total (12 active)
Queueing time: mean = 97.826 ms, max = 158.204 s, min = 644.000 ns, total = 475.238 s
Execution time:  mean = 294.960 us, total = 1.433 s
Event stats:
	event_loop_lag_probe - 1480 total (1 active), Execution time: mean = 23.238 us, total = 34.392 ms, Queueing time: mean = 17.703 us, max = 12.817 ms, min = 1.856 us, total = 26.200 ms
	GcsInMemoryStore.Put - 639 total (6 active), Execution time: mean = 431.699 us, total = 275.856 ms, Queueing time: mean = 2.992 ms, max = 269.957 ms, min = 2.214 us, total = 1.912 s
	RayletLoadPulled - 371 total (1 active), Execution time: mean = 261.074 us, total = 96.858 ms, Queueing time: mean = 426.331 ms, max = 158.142 s, min = 8.077 us, total = 158.169 s
	NodeManagerService.grpc_client.GetResourceLoad - 368 total (1 active), Execution time: mean = 1.526 ms, total = 561.519 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 367 total (0 active), Execution time: mean = 75.594 us, total = 27.743 ms, Queueing time: mean = 96.808 us, max = 321.357 us, min = 14.145 us, total = 35.529 ms
	InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 163 total (0 active), Execution time: mean = 38.966 us, total = 6.352 ms, Queueing time: mean = 91.935 us, max = 197.950 us, min = 11.792 us, total = 14.985 ms
	InternalKVGcsService.grpc_server.InternalKVPut - 163 total (0 active), Execution time: mean = 538.730 us, total = 87.813 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 148 total (0 active), Execution time: mean = 29.025 us, total = 4.296 ms, Queueing time: mean = 102.085 us, max = 257.746 us, min = 10.147 us, total = 15.109 ms
	NodeInfoGcsService.grpc_server.CheckAlive - 148 total (0 active), Execution time: mean = 526.120 us, total = 77.866 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsInMemoryStore.Get - 140 total (0 active), Execution time: mean = 22.425 us, total = 3.139 ms, Queueing time: mean = 13.529 us, max = 81.780 us, min = 3.539 us, total = 1.894 ms
	InternalKVGcsService.grpc_server.InternalKVGet - 139 total (0 active), Execution time: mean = 578.646 us, total = 80.432 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 139 total (0 active), Execution time: mean = 50.426 us, total = 7.009 ms, Queueing time: mean = 104.892 us, max = 242.642 us, min = 12.343 us, total = 14.580 ms
	ClusterResourceManager.ResetRemoteNodeView - 125 total (1 active), Execution time: mean = 10.199 us, total = 1.275 ms, Queueing time: mean = 1.250 s, max = 156.255 s, min = 18.980 us, total = 156.264 s
	HealthCheck - 121 total (0 active), Execution time: mean = 7.216 us, total = 873.194 us, Queueing time: mean = 93.339 us, max = 190.796 us, min = 13.778 us, total = 11.294 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 74 total (0 active), Execution time: mean = 83.077 us, total = 6.148 ms, Queueing time: mean = 108.732 us, max = 209.865 us, min = 18.932 us, total = 8.046 ms
	NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 74 total (0 active), Execution time: mean = 605.072 us, total = 44.775 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GCSServer.deadline_timer.debug_state_dump - 38 total (1 active), Execution time: mean = 1.409 ms, total = 53.526 ms, Queueing time: mean = 4.163 s, max = 158.204 s, min = 10.015 us, total = 158.206 s
	NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 43.235 us, total = 1.470 ms, Queueing time: mean = 107.530 us, max = 210.944 us, min = 4.772 us, total = 3.656 ms
	NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 548.851 us, total = 18.661 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 544.899 us, total = 11.443 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 29.312 us, total = 615.544 us, Queueing time: mean = 92.541 us, max = 190.044 us, min = 20.072 us, total = 1.943 ms
	GcsResourceManager::Update - 7 total (0 active), Execution time: mean = 109.353 us, total = 765.472 us, Queueing time: mean = 139.778 us, max = 162.601 us, min = 103.382 us, total = 978.447 us
	GCSServer.deadline_timer.debug_state_event_stats_print - 7 total (1 active, 1 running), Execution time: mean = 1.373 ms, total = 9.610 ms, Queueing time: mean = 32.839 us, max = 57.923 us, min = 12.288 us, total = 229.876 us
	GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 28.656 us, total = 171.935 us, Queueing time: mean = 106.406 us, max = 155.188 us, min = 12.662 us, total = 638.436 us
	NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 615.011 us, total = 3.075 ms, Queueing time: mean = 610.142 us, max = 2.557 ms, min = 104.515 us, total = 3.051 ms
	NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.030 ms, total = 10.152 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 381.474 us, total = 1.526 ms, Queueing time: mean = 137.106 ms, max = 270.815 ms, min = 3.041 ms, total = 548.423 ms
	InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 526.327 us, total = 526.327 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 89.708 us, total = 89.708 us, Queueing time: mean = 123.809 us, max = 123.809 us, min = 123.809 us, total = 123.809 us
	InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 48.936 us, total = 48.936 us, Queueing time: mean = 115.173 us, max = 115.173 us, min = 115.173 us, total = 115.173 us
	JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 539.349 us, total = 539.349 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 508.082 us, total = 508.082 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 14.596 us, total = 14.596 us, Queueing time: mean = 644.000 ns, max = 644.000 ns, min = 644.000 ns, total = 644.000 ns
	GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.947 us, total = 21.947 us, Queueing time: mean = 12.740 us, max = 12.740 us, min = 12.740 us, total = 12.740 us
	InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 585.904 us, total = 585.904 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.446 us, total = 154.446 us, Queueing time: mean = 129.514 us, max = 129.514 us, min = 129.514 us, total = 129.514 us
	NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 193.932 us, total = 193.932 us, Queueing time: mean = 170.126 us, max = 170.126 us, min = 170.126 us, total = 170.126 us
	GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 15.250 us, total = 15.250 us, Queueing time: mean = 8.100 us, max = 8.100 us, min = 8.100 us, total = 8.100 us
	InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.003 us, total = 33.003 us, Queueing time: mean = 98.925 us, max = 98.925 us, min = 98.925 us, total = 98.925 us
	JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 26.474 us, total = 26.474 us, Queueing time: mean = 102.412 us, max = 102.412 us, min = 102.412 us, total = 102.412 us
	InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 795.531 us, total = 795.531 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 861.657 us, total = 861.657 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.670 us, total = 27.670 us, Queueing time: mean = 107.610 us, max = 107.610 us, min = 107.610 us, total = 107.610 us
	NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.111 ms, total = 1.111 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s


[2025-01-21 06:25:01,041 I 23643 23643] (gcs_server) gcs_server.cc:847: task_io_context Event stats:


Global stats: 16970 total (1 active)
Queueing time: mean = 9.385 ms, max = 158.527 s, min = 2.326 us, total = 159.270 s
Execution time:  mean = 226.820 us, total = 3.849 s
Event stats:
	TaskInfoGcsService.grpc_server.AddTaskEventData - 7707 total (0 active), Execution time: mean = 471.242 us, total = 3.632 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	TaskInfoGcsService.grpc_server.AddTaskEventData.HandleRequestImpl - 7707 total (0 active), Execution time: mean = 22.938 us, total = 176.787 ms, Queueing time: mean = 93.889 us, max = 473.564 us, min = 4.354 us, total = 723.599 ms
	event_loop_lag_probe - 1480 total (0 active), Execution time: mean = 26.868 us, total = 39.765 ms, Queueing time: mean = 10.112 us, max = 1.673 ms, min = 2.326 us, total = 14.966 ms
	GcsTaskManager.GcJobSummary - 75 total (1 active), Execution time: mean = 9.581 us, total = 718.588 us, Queueing time: mean = 2.114 s, max = 158.527 s, min = 23.056 us, total = 158.532 s
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 12.116 us, total = 12.116 us, Queueing time: mean = 96.833 us, max = 96.833 us, min = 96.833 us, total = 96.833 us


[2025-01-21 06:25:01,041 I 23643 23643] (gcs_server) gcs_server.cc:847: pubsub_io_context Event stats:


Global stats: 1933 total (25 active)
Queueing time: mean = 23.378 us, max = 7.909 ms, min = 3.326 us, total = 45.190 ms
Execution time:  mean = 188.507 ms, total = 364.383 s
Event stats:
	event_loop_lag_probe - 1480 total (0 active), Execution time: mean = 26.839 us, total = 39.721 ms, Queueing time: mean = 14.882 us, max = 7.909 ms, min = 3.326 us, total = 22.026 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll - 112 total (24 active), Execution time: mean = 3.252 s, total = 364.262 s, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberPoll.HandleRequestImpl - 112 total (0 active), Execution time: mean = 39.036 us, total = 4.372 ms, Queueing time: mean = 104.105 us, max = 303.395 us, min = 12.689 us, total = 11.660 ms
	InternalPubSubGcsService.grpc_server.GcsPublish - 88 total (0 active), Execution time: mean = 603.321 us, total = 53.092 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsPublish.HandleRequestImpl - 88 total (0 active), Execution time: mean = 105.524 us, total = 9.286 ms, Queueing time: mean = 95.934 us, max = 229.362 us, min = 15.170 us, total = 8.442 ms
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch - 25 total (0 active), Execution time: mean = 524.209 us, total = 13.105 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s
	InternalPubSubGcsService.grpc_server.GcsSubscriberCommandBatch.HandleRequestImpl - 25 total (0 active), Execution time: mean = 54.805 us, total = 1.370 ms, Queueing time: mean = 111.227 us, max = 309.897 us, min = 21.919 us, total = 2.781 ms
	Publisher.CheckDeadSubscribers - 2 total (1 active), Execution time: mean = 10.836 us, total = 21.672 us, Queueing time: mean = 43.660 us, max = 87.321 us, min = 87.321 us, total = 87.321 us
	PeriodicalRunner.RunFnPeriodically - 1 total (0 active), Execution time: mean = 53.087 us, total = 53.087 us, Queueing time: mean = 194.949 us, max = 194.949 us, min = 194.949 us, total = 194.949 us


[2025-01-21 06:25:01,041 I 23643 23643] (gcs_server) gcs_server.cc:847: ray_syncer_io_context Event stats:


Global stats: 1496 total (0 active)
Queueing time: mean = 13.990 us, max = 6.022 ms, min = 479.000 ns, total = 20.929 ms
Execution time:  mean = 26.971 us, total = 40.349 ms
Event stats:
	event_loop_lag_probe - 1480 total (0 active), Execution time: mean = 26.588 us, total = 39.350 ms, Queueing time: mean = 13.568 us, max = 6.022 ms, min = 3.811 us, total = 20.080 ms
	 - 7 total (0 active), Execution time: mean = 112.116 us, total = 784.810 us, Queueing time: mean = 114.312 us, max = 182.675 us, min = 54.004 us, total = 800.182 us
	RaySyncer.BroadcastMessage - 7 total (0 active), Execution time: mean = 30.363 us, total = 212.544 us, Queueing time: mean = 1.107 us, max = 1.460 us, min = 479.000 ns, total = 7.747 us
	RaySyncerRegister - 2 total (0 active), Execution time: mean = 558.500 ns, total = 1.117 us, Queueing time: mean = 20.466 us, max = 24.754 us, min = 16.179 us, total = 40.933 us


[2025-01-21 06:25:01,041 I 23643 23643] (gcs_server) gcs_server_main.cc:130: GCS server received SIGTERM, shutting down...
[2025-01-21 06:25:01,042 W 23643 23736] (gcs_server) server_call.h:331: [1] Not sending reply because executor stopped.
[2025-01-21 06:25:01,043 I 23643 23643] (gcs_server) gcs_server.cc:267: Stopping GCS server.
[2025-01-21 06:25:01,043 W 23643 23748] (gcs_server) server_call.h:331: [1] Not sending reply because executor stopped.
[2025-01-21 06:25:01,044 W 23643 23736] (gcs_server) server_call.h:331: [1] Not sending reply because executor stopped.
[2025-01-21 06:25:01,045 W 23643 23736] (gcs_server) server_call.h:331: [1] Not sending reply because executor stopped.
[2025-01-21 06:25:01,071 W 23643 23736] (gcs_server) server_call.h:331: [1] Not sending reply because executor stopped.