| Gcs Debug state: | |
| GcsNodeManager: | |
| - RegisterNode request count: 1 | |
| - DrainNode request count: 0 | |
| - GetAllNodeInfo request count: 34 | |
| GcsActorManager: | |
| - RegisterActor request count: 0 | |
| - CreateActor request count: 0 | |
| - GetActorInfo request count: 0 | |
| - GetNamedActorInfo request count: 0 | |
| - GetAllActorInfo request count: 0 | |
| - KillActor request count: 0 | |
| - ListNamedActors request count: 0 | |
| - Registered actors count: 0 | |
| - Destroyed actors count: 0 | |
| - Named actors count: 0 | |
| - Unresolved actors count: 0 | |
| - Pending actors count: 0 | |
| - Created actors count: 0 | |
| - owners_: 0 | |
| - actor_to_register_callbacks_: 0 | |
| - actor_to_restart_callbacks_: 0 | |
| - actor_to_create_callbacks_: 0 | |
| - sorted_destroyed_actor_list_: 0 | |
| GcsResourceManager: | |
| - GetAllAvailableResources request count: 0 | |
| - GetAllTotalResources request count: 0 | |
| - GetAllResourceUsage request count: 50 | |
| GcsPlacementGroupManager: | |
| - CreatePlacementGroup request count: 0 | |
| - RemovePlacementGroup request count: 0 | |
| - GetPlacementGroup request count: 0 | |
| - GetAllPlacementGroup request count: 0 | |
| - WaitPlacementGroupUntilReady request count: 0 | |
| - GetNamedPlacementGroup request count: 0 | |
| - Scheduling pending placement group count: 0 | |
| - Registered placement groups count: 0 | |
| - Named placement group count: 0 | |
| - Pending placement groups count: 0 | |
| - Infeasible placement groups count: 0 | |
| Publisher: | |
| RAY_LOG_CHANNEL | |
| - cumulative published messages: 53 | |
| - cumulative published bytes: 43495 | |
| - current buffered bytes: 818 | |
| GCS_NODE_INFO_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 536 | |
| - current buffered bytes: 0 | |
| GCS_JOB_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 283 | |
| - current buffered bytes: 283 | |
| [runtime env manager] ID to URIs table: | |
| [runtime env manager] URIs reference table: | |
| GcsTaskManager: | |
| -Total num task events reported: 3 | |
| -Total num status task events dropped: 0 | |
| -Total num profile events dropped: 0 | |
| -Current num of task events stored: 2 | |
| -Total num of actor creation tasks: 0 | |
| -Total num of actor tasks: 0 | |
| -Total num of normal tasks: 1 | |
| -Total num of driver tasks: 1 | |
| GcsAutoscalerStateManager: | |
| - last_seen_autoscaler_state_version_: 0 | |
| - last_cluster_resource_state_version_: 0 | |
| - pending demands: | |
| Global stats: 3395 total (4 active) | |
| Queueing time: mean = 604.276 us, max = 209.811 ms, min = 740.000 ns, total = 2.052 s | |
| Execution time: mean = 283.201 us, total = 961.467 ms | |
| Event stats: | |
| event_loop_lag_probe - 1002 total (0 active), Execution time: mean = 22.169 us, total = 22.213 ms, Queueing time: mean = 14.922 us, max = 6.396 ms, min = 1.620 us, total = 14.952 ms | |
| GcsInMemoryStore.Put - 447 total (0 active), Execution time: mean = 476.346 us, total = 212.927 ms, Queueing time: mean = 3.319 ms, max = 209.465 ms, min = 1.325 us, total = 1.483 s | |
| RayletLoadPulled - 250 total (1 active), Execution time: mean = 231.682 us, total = 57.921 ms, Queueing time: mean = 62.879 us, max = 183.264 us, min = 10.641 us, total = 15.720 ms | |
| NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 247 total (0 active), Execution time: mean = 68.594 us, total = 16.943 ms, Queueing time: mean = 85.859 us, max = 183.295 us, min = 13.656 us, total = 21.207 ms | |
| NodeManagerService.grpc_client.GetResourceLoad - 247 total (0 active), Execution time: mean = 1.369 ms, total = 338.051 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 115 total (0 active), Execution time: mean = 32.205 us, total = 3.704 ms, Queueing time: mean = 70.647 us, max = 203.571 us, min = 8.800 us, total = 8.124 ms | |
| InternalKVGcsService.grpc_server.InternalKVPut - 115 total (0 active), Execution time: mean = 449.239 us, total = 51.662 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GcsInMemoryStore.Get - 110 total (0 active), Execution time: mean = 18.649 us, total = 2.051 ms, Queueing time: mean = 17.861 us, max = 158.434 us, min = 2.067 us, total = 1.965 ms | |
| InternalKVGcsService.grpc_server.InternalKVGet - 109 total (0 active), Execution time: mean = 703.623 us, total = 76.695 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 109 total (0 active), Execution time: mean = 38.263 us, total = 4.171 ms, Queueing time: mean = 305.037 us, max = 8.337 ms, min = 11.063 us, total = 33.249 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 100 total (0 active), Execution time: mean = 28.023 us, total = 2.802 ms, Queueing time: mean = 89.944 us, max = 207.471 us, min = 15.170 us, total = 8.994 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive - 100 total (0 active), Execution time: mean = 487.948 us, total = 48.795 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| ClusterResourceManager.ResetRemoteNodeView - 84 total (1 active), Execution time: mean = 8.890 us, total = 746.732 us, Queueing time: mean = 82.130 us, max = 1.634 ms, min = 13.790 us, total = 6.899 ms | |
| HealthCheck - 81 total (0 active), Execution time: mean = 7.230 us, total = 585.628 us, Queueing time: mean = 87.498 us, max = 204.653 us, min = 14.748 us, total = 7.087 ms | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 50 total (0 active), Execution time: mean = 539.191 us, total = 26.960 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 50 total (0 active), Execution time: mean = 73.682 us, total = 3.684 ms, Queueing time: mean = 89.148 us, max = 201.135 us, min = 15.689 us, total = 4.457 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 34 total (0 active), Execution time: mean = 35.401 us, total = 1.204 ms, Queueing time: mean = 590.521 us, max = 8.472 ms, min = 11.517 us, total = 20.078 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo - 34 total (0 active), Execution time: mean = 938.702 us, total = 31.916 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GCSServer.deadline_timer.debug_state_dump - 25 total (1 active, 1 running), Execution time: mean = 1.293 ms, total = 32.317 ms, Queueing time: mean = 50.232 us, max = 119.431 us, min = 16.811 us, total = 1.256 ms | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 26.838 us, total = 563.603 us, Queueing time: mean = 126.532 us, max = 257.619 us, min = 30.842 us, total = 2.657 ms | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 491.931 us, total = 10.331 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 8.268 us, total = 49.609 us, Queueing time: mean = 32.229 us, max = 39.816 us, min = 10.594 us, total = 193.373 us | |
| GCSServer.deadline_timer.debug_state_event_stats_print - 5 total (1 active), Execution time: mean = 1.070 ms, total = 5.350 ms, Queueing time: mean = 46.927 us, max = 77.585 us, min = 20.717 us, total = 234.633 us | |
| NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 199.609 us, total = 998.045 us, Queueing time: mean = 58.098 us, max = 128.737 us, min = 15.591 us, total = 290.490 us | |
| NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 685.197 us, total = 3.426 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 117.076 us, total = 468.306 us, Queueing time: mean = 104.964 ms, max = 209.811 ms, min = 27.036 us, total = 419.855 ms | |
| GcsResourceManager::Update - 2 total (0 active), Execution time: mean = 82.721 us, total = 165.442 us, Queueing time: mean = 106.719 us, max = 117.209 us, min = 96.230 us, total = 213.439 us | |
| GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 9.530 us, total = 9.530 us, Queueing time: mean = 5.988 us, max = 5.988 us, min = 5.988 us, total = 5.988 us | |
| InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 54.650 us, total = 54.650 us, Queueing time: mean = 15.901 us, max = 15.901 us, min = 15.901 us, total = 15.901 us | |
| InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 46.994 us, total = 46.994 us, Queueing time: mean = 94.708 us, max = 94.708 us, min = 94.708 us, total = 94.708 us | |
| InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 33.033 us, total = 33.033 us, Queueing time: mean = 105.695 us, max = 105.695 us, min = 105.695 us, total = 105.695 us | |
| JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 17.533 us, total = 17.533 us, Queueing time: mean = 94.945 us, max = 94.945 us, min = 94.945 us, total = 94.945 us | |
| InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 492.808 us, total = 492.808 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 920.233 us, total = 920.233 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 23.201 us, total = 23.201 us, Queueing time: mean = 89.441 us, max = 89.441 us, min = 89.441 us, total = 89.441 us | |
| JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 395.533 us, total = 395.533 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 431.027 us, total = 431.027 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 975.673 us, total = 975.673 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 513.632 us, total = 513.632 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 19.693 us, total = 19.693 us, Queueing time: mean = 10.630 us, max = 10.630 us, min = 10.630 us, total = 10.630 us | |
| NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 209.342 us, total = 209.342 us, Queueing time: mean = 134.661 us, max = 134.661 us, min = 134.661 us, total = 134.661 us | |
| InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 479.251 us, total = 479.251 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 130.738 us, total = 130.738 us, Queueing time: mean = 148.481 us, max = 148.481 us, min = 148.481 us, total = 148.481 us | |
| GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 15.717 us, total = 15.717 us, Queueing time: mean = 740.000 ns, max = 740.000 ns, min = 740.000 ns, total = 740.000 ns |