| Gcs Debug state: | |
| GcsNodeManager: | |
| - RegisterNode request count: 1 | |
| - DrainNode request count: 0 | |
| - GetAllNodeInfo request count: 32 | |
| GcsActorManager: | |
| - RegisterActor request count: 0 | |
| - CreateActor request count: 0 | |
| - GetActorInfo request count: 0 | |
| - GetNamedActorInfo request count: 0 | |
| - GetAllActorInfo request count: 0 | |
| - KillActor request count: 0 | |
| - ListNamedActors request count: 0 | |
| - Registered actors count: 0 | |
| - Destroyed actors count: 0 | |
| - Named actors count: 0 | |
| - Unresolved actors count: 0 | |
| - Pending actors count: 0 | |
| - Created actors count: 0 | |
| - owners_: 0 | |
| - actor_to_register_callbacks_: 0 | |
| - actor_to_restart_callbacks_: 0 | |
| - actor_to_create_callbacks_: 0 | |
| - sorted_destroyed_actor_list_: 0 | |
| GcsResourceManager: | |
| - GetAllAvailableResources request count: 0 | |
| - GetAllTotalResources request count: 0 | |
| - GetAllResourceUsage request count: 124 | |
| GcsPlacementGroupManager: | |
| - CreatePlacementGroup request count: 0 | |
| - RemovePlacementGroup request count: 0 | |
| - GetPlacementGroup request count: 0 | |
| - GetAllPlacementGroup request count: 0 | |
| - WaitPlacementGroupUntilReady request count: 0 | |
| - GetNamedPlacementGroup request count: 0 | |
| - Scheduling pending placement group count: 0 | |
| - Registered placement groups count: 0 | |
| - Named placement group count: 0 | |
| - Pending placement groups count: 0 | |
| - Infeasible placement groups count: 0 | |
| Publisher: | |
| RAY_LOG_CHANNEL | |
| - cumulative published messages: 132 | |
| - cumulative published bytes: 106444 | |
| - current buffered bytes: 819 | |
| GCS_NODE_INFO_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 536 | |
| - current buffered bytes: 0 | |
| GCS_JOB_CHANNEL | |
| - cumulative published messages: 1 | |
| - cumulative published bytes: 283 | |
| - current buffered bytes: 283 | |
| [runtime env manager] ID to URIs table: | |
| [runtime env manager] URIs reference table: | |
| GcsTaskManager: | |
| -Total num task events reported: 23 | |
| -Total num status task events dropped: 0 | |
| -Total num profile events dropped: 0 | |
| -Current num of task events stored: 7 | |
| -Total num of actor creation tasks: 0 | |
| -Total num of actor tasks: 0 | |
| -Total num of normal tasks: 6 | |
| -Total num of driver tasks: 1 | |
| GcsAutoscalerStateManager: | |
| - last_seen_autoscaler_state_version_: 0 | |
| - last_cluster_resource_state_version_: 0 | |
| - pending demands: | |
| Global stats: 7830 total (4 active) | |
| Queueing time: mean = 328.924 us, max = 251.846 ms, min = 853.000 ns, total = 2.575 s | |
| Execution time: mean = 273.413 us, total = 2.141 s | |
| Event stats: | |
| event_loop_lag_probe - 2482 total (0 active), Execution time: mean = 21.126 us, total = 52.435 ms, Queueing time: mean = 14.355 us, max = 14.800 ms, min = 1.906 us, total = 35.630 ms | |
| GcsInMemoryStore.Put - 1039 total (0 active), Execution time: mean = 249.292 us, total = 259.015 ms, Queueing time: mean = 1.731 ms, max = 251.330 ms, min = 2.247 us, total = 1.798 s | |
| RayletLoadPulled - 620 total (1 active), Execution time: mean = 251.877 us, total = 156.164 ms, Queueing time: mean = 66.309 us, max = 202.188 us, min = 14.896 us, total = 41.111 ms | |
| NodeManagerService.grpc_client.GetResourceLoad - 616 total (0 active), Execution time: mean = 1.545 ms, total = 951.647 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeManagerService.grpc_client.GetResourceLoad.OnReplyReceived - 616 total (0 active), Execution time: mean = 74.482 us, total = 45.881 ms, Queueing time: mean = 99.916 us, max = 2.124 ms, min = 13.688 us, total = 61.548 ms | |
| InternalKVGcsService.grpc_server.InternalKVPut - 263 total (0 active), Execution time: mean = 526.992 us, total = 138.599 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVPut.HandleRequestImpl - 263 total (0 active), Execution time: mean = 36.788 us, total = 9.675 ms, Queueing time: mean = 92.115 us, max = 254.636 us, min = 12.388 us, total = 24.226 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive.HandleRequestImpl - 248 total (0 active), Execution time: mean = 30.943 us, total = 7.674 ms, Queueing time: mean = 98.915 us, max = 216.808 us, min = 14.918 us, total = 24.531 ms | |
| NodeInfoGcsService.grpc_server.CheckAlive - 248 total (0 active), Execution time: mean = 516.693 us, total = 128.140 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| ClusterResourceManager.ResetRemoteNodeView - 207 total (1 active), Execution time: mean = 9.706 us, total = 2.009 ms, Queueing time: mean = 65.278 us, max = 151.718 us, min = 16.805 us, total = 13.513 ms | |
| HealthCheck - 204 total (0 active), Execution time: mean = 7.672 us, total = 1.565 ms, Queueing time: mean = 89.766 us, max = 199.261 us, min = 17.136 us, total = 18.312 ms | |
| GcsInMemoryStore.Get - 184 total (0 active), Execution time: mean = 23.715 us, total = 4.364 ms, Queueing time: mean = 15.201 us, max = 337.749 us, min = 3.595 us, total = 2.797 ms | |
| InternalKVGcsService.grpc_server.InternalKVGet.HandleRequestImpl - 183 total (0 active), Execution time: mean = 47.638 us, total = 8.718 ms, Queueing time: mean = 96.466 us, max = 240.717 us, min = 12.541 us, total = 17.653 ms | |
| InternalKVGcsService.grpc_server.InternalKVGet - 183 total (0 active), Execution time: mean = 592.834 us, total = 108.489 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage.HandleRequestImpl - 124 total (0 active), Execution time: mean = 82.815 us, total = 10.269 ms, Queueing time: mean = 104.231 us, max = 211.974 us, min = 21.535 us, total = 12.925 ms | |
| NodeResourceInfoGcsService.grpc_server.GetAllResourceUsage - 124 total (0 active), Execution time: mean = 624.033 us, total = 77.380 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GCSServer.deadline_timer.debug_state_dump - 62 total (1 active, 1 running), Execution time: mean = 1.400 ms, total = 86.827 ms, Queueing time: mean = 62.568 us, max = 187.024 us, min = 11.375 us, total = 3.879 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo.HandleRequestImpl - 32 total (0 active), Execution time: mean = 45.754 us, total = 1.464 ms, Queueing time: mean = 96.826 us, max = 200.145 us, min = 4.641 us, total = 3.098 ms | |
| NodeInfoGcsService.grpc_server.GetAllNodeInfo - 32 total (0 active), Execution time: mean = 588.463 us, total = 18.831 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo - 21 total (0 active), Execution time: mean = 1.622 ms, total = 34.060 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| WorkerInfoGcsService.grpc_server.AddWorkerInfo.HandleRequestImpl - 21 total (0 active), Execution time: mean = 32.752 us, total = 687.799 us, Queueing time: mean = 112.379 us, max = 329.473 us, min = 17.925 us, total = 2.360 ms | |
| GCSServer.deadline_timer.debug_state_event_stats_print - 11 total (1 active), Execution time: mean = 1.444 ms, total = 15.886 ms, Queueing time: mean = 48.135 us, max = 90.983 us, min = 15.823 us, total = 529.484 us | |
| GcsResourceManager::Update - 10 total (0 active), Execution time: mean = 108.421 us, total = 1.084 ms, Queueing time: mean = 130.029 us, max = 158.567 us, min = 98.679 us, total = 1.300 ms | |
| GcsInMemoryStore.GetAll - 6 total (0 active), Execution time: mean = 12.808 us, total = 76.850 us, Queueing time: mean = 63.707 us, max = 93.369 us, min = 12.191 us, total = 382.240 us | |
| NodeInfoGcsService.grpc_server.GetClusterId.HandleRequestImpl - 5 total (0 active), Execution time: mean = 594.980 us, total = 2.975 ms, Queueing time: mean = 454.913 us, max = 1.926 ms, min = 37.965 us, total = 2.275 ms | |
| NodeInfoGcsService.grpc_server.GetClusterId - 5 total (0 active), Execution time: mean = 1.901 ms, total = 9.506 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| PeriodicalRunner.RunFnPeriodically - 4 total (0 active), Execution time: mean = 356.690 us, total = 1.427 ms, Queueing time: mean = 127.566 ms, max = 251.846 ms, min = 2.946 ms, total = 510.264 ms | |
| InternalKVGcsService.grpc_server.InternalKVExists - 1 total (0 active), Execution time: mean = 647.711 us, total = 647.711 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| NodeInfoGcsService.grpc_server.RegisterNode.HandleRequestImpl - 1 total (0 active), Execution time: mean = 210.583 us, total = 210.583 us, Queueing time: mean = 146.426 us, max = 146.426 us, min = 146.426 us, total = 146.426 us | |
| GcsInMemoryStore.Exists - 1 total (0 active), Execution time: mean = 20.427 us, total = 20.427 us, Queueing time: mean = 11.010 us, max = 11.010 us, min = 11.010 us, total = 11.010 us | |
| GcsInMemoryStore.Delete - 1 total (0 active), Execution time: mean = 27.593 us, total = 27.593 us, Queueing time: mean = 11.858 us, max = 11.858 us, min = 11.858 us, total = 11.858 us | |
| JobInfoGcsService.grpc_server.GetAllJobInfo - 1 total (0 active), Execution time: mean = 691.858 us, total = 691.858 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.GetInternalConfig.HandleRequestImpl - 1 total (0 active), Execution time: mean = 39.511 us, total = 39.511 us, Queueing time: mean = 125.761 us, max = 125.761 us, min = 125.761 us, total = 125.761 us | |
| JobInfoGcsService.grpc_server.AddJob - 1 total (0 active), Execution time: mean = 839.122 us, total = 839.122 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVExists.HandleRequestImpl - 1 total (0 active), Execution time: mean = 45.900 us, total = 45.900 us, Queueing time: mean = 126.144 us, max = 126.144 us, min = 126.144 us, total = 126.144 us | |
| JobInfoGcsService.grpc_server.GetNextJobID.HandleRequestImpl - 1 total (0 active), Execution time: mean = 29.468 us, total = 29.468 us, Queueing time: mean = 53.587 us, max = 53.587 us, min = 53.587 us, total = 53.587 us | |
| InternalKVGcsService.grpc_server.InternalKVDel - 1 total (0 active), Execution time: mean = 850.573 us, total = 850.573 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| GcsHealthCheckManager::AddNode - 1 total (0 active), Execution time: mean = 17.811 us, total = 17.811 us, Queueing time: mean = 853.000 ns, max = 853.000 ns, min = 853.000 ns, total = 853.000 ns | |
| NodeInfoGcsService.grpc_server.RegisterNode - 1 total (0 active), Execution time: mean = 1.226 ms, total = 1.226 ms, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| JobInfoGcsService.grpc_server.GetNextJobID - 1 total (0 active), Execution time: mean = 497.095 us, total = 497.095 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.GetInternalConfig - 1 total (0 active), Execution time: mean = 575.218 us, total = 575.218 us, Queueing time: mean = 0.000 s, max = -0.000 s, min = 9223372036.855 s, total = 0.000 s | |
| InternalKVGcsService.grpc_server.InternalKVDel.HandleRequestImpl - 1 total (0 active), Execution time: mean = 77.741 us, total = 77.741 us, Queueing time: mean = 97.930 us, max = 97.930 us, min = 97.930 us, total = 97.930 us | |
| JobInfoGcsService.grpc_server.GetAllJobInfo.HandleRequestImpl - 1 total (0 active), Execution time: mean = 27.480 us, total = 27.480 us, Queueing time: mean = 181.711 us, max = 181.711 us, min = 181.711 us, total = 181.711 us | |
| JobInfoGcsService.grpc_server.AddJob.HandleRequestImpl - 1 total (0 active), Execution time: mean = 154.576 us, total = 154.576 us, Queueing time: mean = 71.587 us, max = 71.587 us, min = 71.587 us, total = 71.587 us |