| Gcs Debug state: | |
| GcsNodeManager: | |
| - RegisterNode request count: 1 | |
| - DrainNode request count: 0 | |
| - GetAllNodeInfo request count: 34 | |
| GcsActorManager: | |
| - RegisterActor request count: 0 | |
| - CreateActor request count: 0 | |
| - GetActorInfo request count: 0 | |
| - GetNamedActorInfo request count: 0 | |
| - GetAllActorInfo request count: 0 | |
| - KillActor request count: 0 | |
| - ListNamedActors request count: 0 | |
| - Registered actors count: 0 | |
| - Destroyed actors count: 0 | |
| - Named actors count: 0 | |
| - Unresolved actors count: 0 | |
| - Pending actors count: 0 | |
| - Created actors count: 0 | |
| - owners_: 0 | |
| - actor_to_register_callbacks_: 0 | |
| - actor_to_restart_callbacks_: 0 | |
| - actor_to_create_callbacks_: 0 | |
| - sorted_destroyed_actor_list_: 0 | |
| GcsResourceManager: | |
| - GetAllAvailableResources request count: 0 | |
| - GetAllTotalResources request count: 0 | |
| - GetAllResourceUsage request count: 104 | |
| GcsPlacementGroupManager: | |
| - CreatePlacementGroup request count: 0 | |
| - RemovePlacementGroup request count: 0 | |
| - GetPlacementGroup request count: 0 | |
| - GetAllPlacementGroup request count: 0 | |
| - WaitPlacementGroupUntilReady request count: 0 | |
| - GetNamedPlacementGroup request count: 0 | |
| - Scheduling pending placement group count: 0 | |
| - Registered placement groups count: 0 | |
| - Named placement group count: 0 | |
| - Pending placement groups count: 0 | |
| - Infeasible placement groups count: 0 | |
| Publisher: | |
| RAY_LOG_CHANNEL | |
| - cumulative published messages: 118 | |
| - cumulative published bytes: 89040 | |
| - current buffered bytes: 818 | |
| GCS_NODE_INFO_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 534 | |
| - current buffered bytes: 0 | |
| GCS_JOB_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 256 | |
| - current buffered bytes: 256 | |
| [runtime env manager] ID to URIs table: | |
| [runtime env manager] URIs reference table: | |
| GcsTaskManager: | |
| -Total num task events reported: 42 | |
| -Total num status task events dropped: 0 | |
| -Total num profile events dropped: 0 | |
| -Current num of task events stored: 11 | |
| -Total num of actor creation tasks: 0 | |
| -Total num of actor tasks: 0 | |
| -Total num of normal tasks: 10 | |
| -Total num of driver tasks: 1 | |
| GcsAutoscalerStateManager: | |
| - last_seen_autoscaler_state_version_: 0 | |
| - last_cluster_resource_state_version_: 0 | |
| - pending demands: | |
| Global stats: 6662 total (4 active) | |
| Queueing time: mean = 398.120 us, max = 256.944 ms, min = 761.000 ns, total = 2.652 s | |
| Execution time: mean = 286.750 us, total = 1.910 s | |
| Event stats: | |
| event_loop_lag_probe - 2082 total (0 active), Execution time: mean = 24.479 us, total = 50.965 ms, Queueing time: mean = 16.662 us, max = 14.831 ms, min = 1.695 us, total = 34.690 ms | |
| GcsInMemoryStore.Put - 878 total (0 active), Execution time: mean = 299.832 us, total = 263.252 ms, Queueing time: mean = 2.090 ms, max = 256.536 ms, min = 1.392 us, total = 1.835 s | |
| RayletLoadPulled - 520 total (1 active), Execution time: mean = 248.719 us, total = 129.334 ms, Queueing time: mean = 114.826 us, max = 16.997 ms, min = 20.421 us, total = 59.710 ms | |
| NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 517 total (0 active), Execution time: mean = 81.014 us, total = 41.884 ms, Queueing time: mean = 108.337 us, max = 216.110 us, min = 16.818 us, total = 56.010 ms | |
| NodeManagerService.grpc_client.GetResourceLoad - 517 total (0 active), Execution time: mean = 1.506 ms, total = 778.722 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVPut - 222 total (0 active), Execution time: mean = 584.703 us, total = 129.804 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 222 total (0 active), Execution time: mean = 44.351 us, total = 9.846 ms, Queueing time: mean = 107.413 us, max = 200.615 us, min = 23.939 us, total = 23.846 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 208 total (0 active), Execution time: mean = 36.271 us, total = 7.544 ms, Queueing time: mean = 122.943 us, max = 239.706 us, min = 32.077 us, total = 25.572 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive - 208 total (0 active), Execution time: mean = 599.108 us, total = 124.614 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| ClusterResourceManager.ResetRemoteNodeView - 174 total (1 active), Execution time: mean = 10.920 us, total = 1.900 ms, Queueing time: mean = 173.759 us, max = 17.165 ms, min = 20.341 us, total = 30.234 ms | |
| GcsInMemoryStore.Get - 173 total (0 active), Execution time: mean = 26.605 us, total = 4.603 ms, Queueing time: mean = 15.647 us, max = 74.560 us, min = 2.273 us, total = 2.707 ms | |
| InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 172 total (0 active), Execution time: mean = 49.878 us, total = 8.579 ms, Queueing time: mean = 105.399 us, max = 273.037 us, min = 3.930 us, total = 18.129 ms | |
| InternalKVGcsService.grpc_server.InternalKVGet - 172 total (0 active), Execution time: mean = 616.326 us, total = 106.008 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| HealthCheck - 171 total (0 active), Execution time: mean = 8.724 us, total = 1.492 ms, Queueing time: mean = 109.196 us, max = 220.618 us, min = 26.125 us, total = 18.673 ms | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 104 total (0 active), Execution time: mean = 709.153 us, total = 73.752 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 104 total (0 active), Execution time: mean = 91.369 us, total = 9.502 ms, Queueing time: mean = 122.956 us, max = 185.638 us, min = 28.632 us, total = 12.787 ms | |
| GCSServer.deadline_timer.debug_state_dump - 52 total (1 active, 1 running), Execution time: mean = 1.432 ms, total = 74.464 ms, Queueing time: mean = 78.646 us, max = 201.348 us, min = 14.980 us, total = 4.090 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 36.599 us, total = 1.244 ms, Queueing time: mean = 125.778 us, max = 217.971 us, min = 29.829 us, total = 4.276 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 1.352 ms, total = 45.969 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 595.448 us, total = 12.504 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 31.094 us, total = 652.978 us, Queueing time: mean = 141.855 us, max = 626.362 us, min = 24.247 us, total = 2.979 ms | |
| GcsResourceManager::Update - 10 total (0 active), Execution time: mean = 111.755 us, total = 1.118 ms, Queueing time: mean = 130.313 us, max = 174.838 us, min = 104.579 us, total = 1.303 ms | |
| GCSServer.deadline_timer.debug_state_event_stats_print - 9 total (1 active), Execution time: mean = 1.329 ms, total = 11.959 ms, Queueing time: mean = 66.768 us, max = 127.713 us, min = 32.288 us, total = 600.916 us | |
| GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 14.325 us, total = 85.949 us, Queueing time: mean = 38.534 us, max = 46.574 us, min = 13.894 us, total = 231.202 us | |
| NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 2.318 ms, total = 11.588 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 476.847 us, total = 2.384 ms, Queueing time: mean = 325.286 us, max = 1.075 ms, min = 109.625 us, total = 1.626 ms | |
| PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 148.064 us, total = 592.256 us, Queueing time: mean = 129.681 ms, max = 256.944 ms, min = 2.306 ms, total = 518.726 ms | |
| InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 695.135 us, total = 695.135 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 727.589 us, total = 727.589 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 102.845 us, total = 102.845 us, Queueing time: mean = 159.315 us, max = 159.315 us, min = 159.315 us, total = 159.315 us | |
| GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 15.163 us, total = 15.163 us, Queueing time: mean = 761.000 ns, max = 761.000 ns, min = 761.000 ns, total = 761.000 ns | |
| InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 914.041 us, total = 914.041 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 44.771 us, total = 44.771 us, Queueing time: mean = 106.739 us, max = 106.739 us, min = 106.739 us, total = 106.739 us | |
| JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 180.458 us, total = 180.458 us, Queueing time: mean = 109.188 us, max = 109.188 us, min = 109.188 us, total = 109.188 us | |
| InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 49.592 us, total = 49.592 us, Queueing time: mean = 111.343 us, max = 111.343 us, min = 111.343 us, total = 111.343 us | |
| NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 206.752 us, total = 206.752 us, Queueing time: mean = 114.849 us, max = 114.849 us, min = 114.849 us, total = 114.849 us | |
| GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 17.946 us, total = 17.946 us, Queueing time: mean = 13.460 us, max = 13.460 us, min = 13.460 us, total = 13.460 us | |
| JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 578.614 us, total = 578.614 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 21.960 us, total = 21.960 us, Queueing time: mean = 13.626 us, max = 13.626 us, min = 13.626 us, total = 13.626 us | |
| JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 29.970 us, total = 29.970 us, Queueing time: mean = 137.291 us, max = 137.291 us, min = 137.291 us, total = 137.291 us | |
| JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 30.307 us, total = 30.307 us, Queueing time: mean = 109.446 us, max = 109.446 us, min = 109.446 us, total = 109.446 us | |
| NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.117 ms, total = 1.117 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 483.185 us, total = 483.185 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 751.231 us, total = 751.231 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s |